Java microservice framework tests in SB:3.2.5 Q:3.8.1 M:4.2.2 V:4.5.7 H:4.0.6 Dotnet:6 openjdk version "21.0.2" 2024-01-16 LTS rustc 1.77.2 (25ef9e3d8 2024-04-09)
In Linux fv-az573-962 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 7.925 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 6.966 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 10.780 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 10.287 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.070 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 2.769 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 2.753 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 8.247 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
6.1M | helidon-se-netty/target/helidon-quickstart-se.jar |
6.1M | helidon-se-netty/target/original-helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
16K | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar |
13M | micronaut/target/micronaut-demo-0.1.jar |
15K | micronaut/target/original-micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
21M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
24M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
13M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
8.8K | vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar |
:: Spring Boot :: (v3.2.5) Started DemoWebFluxApplication in 1.888 seconds (process running for 2.385)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 54 (OK=54 KO=- )
> max response time 5729 (OK=5729 KO=- )
> mean response time 1494 (OK=1494 KO=- )
> std deviation 987 (OK=987 KO=- )
> response time 50th percentile 1121 (OK=1121 KO=- )
> response time 75th percentile 1739 (OK=1738 KO=- )
> response time 95th percentile 3643 (OK=3644 KO=- )
> response time 99th percentile 5211 (OK=5211 KO=- )
> mean requests/sec 2666.667 (OK=2666.667 KO=- )
:: Spring Boot :: (v3.2.5) Started DemoApplication in 1.847 seconds (process running for 2.331)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 5185 (OK=5185 KO=- )
> mean response time 1192 (OK=1192 KO=- )
> std deviation 728 (OK=728 KO=- )
> response time 50th percentile 1001 (OK=1001 KO=- )
> response time 75th percentile 1282 (OK=1282 KO=- )
> response time 95th percentile 2793 (OK=2794 KO=- )
> response time 99th percentile 3441 (OK=3440 KO=- )
> mean requests/sec 3200 (OK=3200 KO=- )
powered by Quarkus 3.8.1) started in 0.994s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 9 (OK=9 KO=- )
> max response time 3034 (OK=3034 KO=- )
> mean response time 1030 (OK=1030 KO=- )
> std deviation 528 (OK=528 KO=- )
> response time 50th percentile 905 (OK=904 KO=- )
> response time 75th percentile 1241 (OK=1240 KO=- )
> response time 95th percentile 2081 (OK=2081 KO=- )
> response time 99th percentile 2282 (OK=2282 KO=- )
> mean requests/sec 3555.556 (OK=3555.556 KO=- )
micronaut version:4.2.0 Startup completed in 735ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 13 (OK=13 KO=- )
> max response time 2089 (OK=2089 KO=- )
> mean response time 889 (OK=889 KO=- )
> std deviation 489 (OK=489 KO=- )
> response time 50th percentile 784 (OK=784 KO=- )
> response time 75th percentile 1003 (OK=1003 KO=- )
> response time 95th percentile 1830 (OK=1830 KO=- )
> response time 99th percentile 1964 (OK=1964 KO=- )
> mean requests/sec 3555.556 (OK=3555.556 KO=- )
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 37 (OK=37 KO=- )
> max response time 1514 (OK=1514 KO=- )
> mean response time 922 (OK=922 KO=- )
> std deviation 352 (OK=352 KO=- )
> response time 50th percentile 1055 (OK=1055 KO=- )
> response time 75th percentile 1204 (OK=1204 KO=- )
> response time 95th percentile 1337 (OK=1337 KO=- )
> response time 99th percentile 1452 (OK=1452 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )
kumuluz version:4.1.0 Server – Started Server@773e2eb5{STARTING}[10.0.9,sto=0] @2826ms
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 23 (OK=23 KO=- )
> max response time 5774 (OK=5774 KO=- )
> mean response time 1488 (OK=1488 KO=- )
> std deviation 1038 (OK=1038 KO=- )
> response time 50th percentile 1180 (OK=1180 KO=- )
> response time 75th percentile 1446 (OK=1446 KO=- )
> response time 95th percentile 3954 (OK=3954 KO=- )
> response time 99th percentile 4597 (OK=4597 KO=- )
> mean requests/sec 2909.091 (OK=2909.091 KO=- )
Helidon SE 4.0.6 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 2069 (OK=2069 KO=- )
> mean response time 813 (OK=813 KO=- )
> std deviation 397 (OK=397 KO=- )
> response time 50th percentile 733 (OK=734 KO=- )
> response time 75th percentile 963 (OK=962 KO=- )
> response time 95th percentile 1655 (OK=1654 KO=- )
> response time 99th percentile 1807 (OK=1808 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 4958 (OK=4958 KO=- )
> mean response time 2276 (OK=2276 KO=- )
> std deviation 1386 (OK=1386 KO=- )
> response time 50th percentile 2226 (OK=2221 KO=- )
> response time 75th percentile 3074 (OK=3074 KO=- )
> response time 95th percentile 4654 (OK=4654 KO=- )
> response time 99th percentile 4836 (OK=4836 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
Rust rest services #
rustc 1.77.2 (25ef9e3d8 2024-04-09)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 758 (OK=758 KO=- )
> mean response time 205 (OK=205 KO=- )
> std deviation 147 (OK=147 KO=- )
> response time 50th percentile 186 (OK=186 KO=- )
> response time 75th percentile 263 (OK=263 KO=- )
> response time 95th percentile 505 (OK=505 KO=- )
> response time 99th percentile 631 (OK=631 KO=- )
> mean requests/sec 6400 (OK=6400 KO=- )
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 922 (OK=922 KO=- )
> mean response time 248 (OK=248 KO=- )
> std deviation 174 (OK=174 KO=- )
> response time 50th percentile 217 (OK=217 KO=- )
> response time 75th percentile 311 (OK=311 KO=- )
> response time 95th percentile 569 (OK=569 KO=- )
> response time 99th percentile 855 (OK=855 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
rocket = { version = 0.5.0, features = [json] }
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 800 (OK=800 KO=- )
> mean response time 279 (OK=279 KO=- )
> std deviation 164 (OK=164 KO=- )
> response time 50th percentile 249 (OK=249 KO=- )
> response time 75th percentile 335 (OK=335 KO=- )
> response time 95th percentile 636 (OK=636 KO=- )
> response time 99th percentile 712 (OK=712 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 657 (OK=657 KO=- )
> mean response time 227 (OK=227 KO=- )
> std deviation 154 (OK=154 KO=- )
> response time 50th percentile 211 (OK=211 KO=- )
> response time 75th percentile 287 (OK=287 KO=- )
> response time 95th percentile 569 (OK=569 KO=- )
> response time 99th percentile 610 (OK=610 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 1307 (OK=1307 KO=- )
> mean response time 523 (OK=523 KO=- )
> std deviation 287 (OK=287 KO=- )
> response time 50th percentile 467 (OK=467 KO=- )
> response time 75th percentile 633 (OK=633 KO=- )
> response time 95th percentile 1093 (OK=1093 KO=- )
> response time 99th percentile 1194 (OK=1194 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 5 (OK=5 KO=- )
> max response time 962 (OK=962 KO=- )
> mean response time 397 (OK=397 KO=- )
> std deviation 210 (OK=210 KO=- )
> response time 50th percentile 353 (OK=352 KO=- )
> response time 75th percentile 471 (OK=471 KO=- )
> response time 95th percentile 829 (OK=829 KO=- )
> response time 99th percentile 889 (OK=889 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
Dotnet 8 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 22 (OK=22 KO=- )
> max response time 1420 (OK=1420 KO=- )
> mean response time 550 (OK=550 KO=- )
> std deviation 281 (OK=281 KO=- )
> response time 50th percentile 508 (OK=508 KO=- )
> response time 75th percentile 632 (OK=632 KO=- )
> response time 95th percentile 1120 (OK=1120 KO=- )
> response time 99th percentile 1231 (OK=1231 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 1172 (OK=1172 KO=- )
> mean response time 475 (OK=475 KO=- )
> std deviation 222 (OK=222 KO=- )
> response time 50th percentile 449 (OK=449 KO=- )
> response time 75th percentile 581 (OK=581 KO=- )
> response time 95th percentile 911 (OK=912 KO=- )
> response time 99th percentile 1030 (OK=1030 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 1190 (OK=1190 KO=- )
> mean response time 369 (OK=369 KO=- )
> std deviation 184 (OK=184 KO=- )
> response time 50th percentile 334 (OK=333 KO=- )
> response time 75th percentile 460 (OK=460 KO=- )
> response time 95th percentile 726 (OK=726 KO=- )
> response time 99th percentile 897 (OK=897 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 2100 (OK=2100 KO=- )
> mean response time 494 (OK=494 KO=- )
> std deviation 280 (OK=280 KO=- )
> response time 50th percentile 441 (OK=441 KO=- )
> response time 75th percentile 589 (OK=589 KO=- )
> response time 95th percentile 1001 (OK=1001 KO=- )
> response time 99th percentile 1390 (OK=1390 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 23 (OK=23 KO=- )
> max response time 1676 (OK=1676 KO=- )
> mean response time 490 (OK=490 KO=- )
> std deviation 262 (OK=262 KO=- )
> response time 50th percentile 429 (OK=429 KO=- )
> response time 75th percentile 533 (OK=533 KO=- )
> response time 95th percentile 1044 (OK=1044 KO=- )
> response time 99th percentile 1309 (OK=1309 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 16 (OK=16 KO=- )
> max response time 696 (OK=696 KO=- )
> mean response time 396 (OK=396 KO=- )
> std deviation 132 (OK=132 KO=- )
> response time 50th percentile 400 (OK=400 KO=- )
> response time 75th percentile 511 (OK=511 KO=- )
> response time 95th percentile 594 (OK=594 KO=- )
> response time 99th percentile 645 (OK=645 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 932 (OK=932 KO=- )
> mean response time 351 (OK=351 KO=- )
> std deviation 172 (OK=172 KO=- )
> response time 50th percentile 331 (OK=331 KO=- )
> response time 75th percentile 443 (OK=443 KO=- )
> response time 95th percentile 703 (OK=704 KO=- )
> response time 99th percentile 775 (OK=775 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=31924 KO=76 )
> min response time 6 (OK=6 KO=88 )
> max response time 2956 (OK=2956 KO=1951 )
> mean response time 813 (OK=813 KO=511 )
> std deviation 477 (OK=477 KO=325 )
> response time 50th percentile 745 (OK=746 KO=481 )
> response time 75th percentile 1084 (OK=1085 KO=705 )
> response time 95th percentile 1784 (OK=1784 KO=993 )
> response time 99th percentile 2249 (OK=2249 KO=1448 )
> mean requests/sec 3555.556 (OK=3547.111 KO=8.444 )
source code for the java and dotnet tests source code for the rust tests
github action