Java microservice framework tests in SB:3.3.2 Q:3.8.1 M:4.6.0 V:4.5.9 H:4.0.11 Dotnet:6 openjdk version "21.0.4" 2024-07-16 LTS rustc 1.81.0 (eeb90cda1 2024-09-04)
In Linux fv-az1249-95 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 9.120 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 5.860 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 12.449 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 12.497 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.739 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 3.270 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 3.268 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 7.558 s]Size of created packages:
| Size in MB | Name |
|---|---|
| 22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
| 6.1M | helidon-se-netty/target/helidon-quickstart-se.jar |
| 6.1M | helidon-se-netty/target/original-helidon-quickstart-se.jar |
| 19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
| 14M | micronaut/target/micronaut-demo-0.1.jar |
| 14M | micronaut/target/original-micronaut-demo-0.1.jar |
| 17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
| 22M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
| 24M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
| 8.2M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.3.2) Started DemoWebFluxApplication in 1.914 seconds (process running for 2.429)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 47 (OK=47 KO=- )
> max response time 3981 (OK=3981 KO=- )
> mean response time 1530 (OK=1530 KO=- )
> std deviation 818 (OK=818 KO=- )
> response time 50th percentile 1452 (OK=1452 KO=- )
> response time 75th percentile 1631 (OK=1631 KO=- )
> response time 95th percentile 3181 (OK=3181 KO=- )
> response time 99th percentile 3808 (OK=3808 KO=- )
> mean requests/sec 2909.091 (OK=2909.091 KO=- ):: Spring Boot :: (v3.3.2) Started DemoApplication in 1.909 seconds (process running for 2.361)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 4021 (OK=4021 KO=- )
> mean response time 1155 (OK=1155 KO=- )
> std deviation 719 (OK=719 KO=- )
> response time 50th percentile 967 (OK=967 KO=- )
> response time 75th percentile 1365 (OK=1366 KO=- )
> response time 95th percentile 2603 (OK=2603 KO=- )
> response time 99th percentile 3370 (OK=3370 KO=- )
> mean requests/sec 3200 (OK=3200 KO=- )powered by Quarkus 3.8.1) started in 0.993s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 33 (OK=33 KO=- )
> max response time 3472 (OK=3472 KO=- )
> mean response time 1050 (OK=1050 KO=- )
> std deviation 576 (OK=576 KO=- )
> response time 50th percentile 877 (OK=877 KO=- )
> response time 75th percentile 1227 (OK=1228 KO=- )
> response time 95th percentile 2161 (OK=2161 KO=- )
> response time 99th percentile 2457 (OK=2457 KO=- )
> mean requests/sec 3555.556 (OK=3555.556 KO=- )micronaut version:4.2.0 Startup completed in 821ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 29 (OK=29 KO=- )
> max response time 2022 (OK=2022 KO=- )
> mean response time 837 (OK=837 KO=- )
> std deviation 457 (OK=457 KO=- )
> response time 50th percentile 736 (OK=736 KO=- )
> response time 75th percentile 980 (OK=980 KO=- )
> response time 95th percentile 1724 (OK=1724 KO=- )
> response time 99th percentile 1867 (OK=1867 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 24 (OK=24 KO=- )
> max response time 1855 (OK=1855 KO=- )
> mean response time 997 (OK=997 KO=- )
> std deviation 377 (OK=377 KO=- )
> response time 50th percentile 1076 (OK=1076 KO=- )
> response time 75th percentile 1305 (OK=1305 KO=- )
> response time 95th percentile 1522 (OK=1522 KO=- )
> response time 99th percentile 1681 (OK=1681 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )kumuluz version:4.1.0 Server – Started Server@3b7b05a8{STARTING}[10.0.9,sto=0] @3053ms
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 23 (OK=23 KO=- )
> max response time 5503 (OK=5503 KO=- )
> mean response time 1591 (OK=1591 KO=- )
> std deviation 1050 (OK=1050 KO=- )
> response time 50th percentile 1270 (OK=1269 KO=- )
> response time 75th percentile 1621 (OK=1621 KO=- )
> response time 95th percentile 4032 (OK=4032 KO=- )
> response time 99th percentile 4650 (OK=4651 KO=- )
> mean requests/sec 2666.667 (OK=2666.667 KO=- )Helidon SE 4.0.11 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1752 (OK=1752 KO=- )
> mean response time 742 (OK=742 KO=- )
> std deviation 370 (OK=370 KO=- )
> response time 50th percentile 663 (OK=663 KO=- )
> response time 75th percentile 872 (OK=872 KO=- )
> response time 95th percentile 1519 (OK=1519 KO=- )
> response time 99th percentile 1660 (OK=1661 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )ktor.application - Autoreload is disabled because the development mode is off.
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 5429 (OK=5429 KO=- )
> mean response time 2254 (OK=2254 KO=- )
> std deviation 1416 (OK=1416 KO=- )
> response time 50th percentile 1912 (OK=1911 KO=- )
> response time 75th percentile 2957 (OK=2957 KO=- )
> response time 95th percentile 4875 (OK=4874 KO=- )
> response time 99th percentile 5314 (OK=5314 KO=- )
> mean requests/sec 2461.538 (OK=2461.538 KO=- )Rust rest services #
rustc 1.81.0 (eeb90cda1 2024-09-04)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1536 (OK=1536 KO=- )
> mean response time 235 (OK=235 KO=- )
> std deviation 175 (OK=175 KO=- )
> response time 50th percentile 216 (OK=216 KO=- )
> response time 75th percentile 301 (OK=301 KO=- )
> response time 95th percentile 578 (OK=578 KO=- )
> response time 99th percentile 780 (OK=780 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 762 (OK=762 KO=- )
> mean response time 247 (OK=247 KO=- )
> std deviation 149 (OK=149 KO=- )
> response time 50th percentile 221 (OK=221 KO=- )
> response time 75th percentile 302 (OK=303 KO=- )
> response time 95th percentile 560 (OK=560 KO=- )
> response time 99th percentile 636 (OK=636 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )rocket = { version = 0.5.0, features = [json] }
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 870 (OK=870 KO=- )
> mean response time 266 (OK=266 KO=- )
> std deviation 170 (OK=170 KO=- )
> response time 50th percentile 234 (OK=234 KO=- )
> response time 75th percentile 336 (OK=335 KO=- )
> response time 95th percentile 625 (OK=625 KO=- )
> response time 99th percentile 711 (OK=711 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 719 (OK=719 KO=- )
> mean response time 238 (OK=238 KO=- )
> std deviation 151 (OK=151 KO=- )
> response time 50th percentile 218 (OK=218 KO=- )
> response time 75th percentile 291 (OK=291 KO=- )
> response time 95th percentile 558 (OK=558 KO=- )
> response time 99th percentile 631 (OK=631 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 1482 (OK=1482 KO=- )
> mean response time 597 (OK=597 KO=- )
> std deviation 326 (OK=326 KO=- )
> response time 50th percentile 517 (OK=517 KO=- )
> response time 75th percentile 721 (OK=722 KO=- )
> response time 95th percentile 1251 (OK=1250 KO=- )
> response time 99th percentile 1321 (OK=1321 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 5 (OK=5 KO=- )
> max response time 1087 (OK=1087 KO=- )
> mean response time 440 (OK=440 KO=- )
> std deviation 228 (OK=228 KO=- )
> response time 50th percentile 382 (OK=382 KO=- )
> response time 75th percentile 513 (OK=513 KO=- )
> response time 95th percentile 889 (OK=889 KO=- )
> response time 99th percentile 996 (OK=996 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )Dotnet 8 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 14 (OK=14 KO=- )
> max response time 2135 (OK=2135 KO=- )
> mean response time 519 (OK=519 KO=- )
> std deviation 285 (OK=285 KO=- )
> response time 50th percentile 470 (OK=470 KO=- )
> response time 75th percentile 600 (OK=600 KO=- )
> response time 95th percentile 1107 (OK=1107 KO=- )
> response time 99th percentile 1266 (OK=1266 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 8 (OK=8 KO=- )
> max response time 1247 (OK=1247 KO=- )
> mean response time 466 (OK=466 KO=- )
> std deviation 225 (OK=225 KO=- )
> response time 50th percentile 447 (OK=447 KO=- )
> response time 75th percentile 593 (OK=593 KO=- )
> response time 95th percentile 907 (OK=907 KO=- )
> response time 99th percentile 1076 (OK=1076 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 8 (OK=8 KO=- )
> max response time 1068 (OK=1068 KO=- )
> mean response time 378 (OK=378 KO=- )
> std deviation 200 (OK=200 KO=- )
> response time 50th percentile 344 (OK=344 KO=- )
> response time 75th percentile 473 (OK=473 KO=- )
> response time 95th percentile 777 (OK=777 KO=- )
> response time 99th percentile 910 (OK=910 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 2306 (OK=2306 KO=- )
> mean response time 545 (OK=545 KO=- )
> std deviation 344 (OK=344 KO=- )
> response time 50th percentile 475 (OK=475 KO=- )
> response time 75th percentile 640 (OK=640 KO=- )
> response time 95th percentile 1149 (OK=1149 KO=- )
> response time 99th percentile 2032 (OK=2032 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 27 (OK=27 KO=- )
> max response time 1513 (OK=1513 KO=- )
> mean response time 479 (OK=479 KO=- )
> std deviation 271 (OK=271 KO=- )
> response time 50th percentile 420 (OK=421 KO=- )
> response time 75th percentile 564 (OK=565 KO=- )
> response time 95th percentile 1038 (OK=1038 KO=- )
> response time 99th percentile 1257 (OK=1257 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 11 (OK=11 KO=- )
> max response time 760 (OK=760 KO=- )
> mean response time 423 (OK=423 KO=- )
> std deviation 159 (OK=159 KO=- )
> response time 50th percentile 458 (OK=458 KO=- )
> response time 75th percentile 550 (OK=550 KO=- )
> response time 95th percentile 644 (OK=644 KO=- )
> response time 99th percentile 701 (OK=701 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 854 (OK=854 KO=- )
> mean response time 395 (OK=395 KO=- )
> std deviation 155 (OK=155 KO=- )
> response time 50th percentile 393 (OK=393 KO=- )
> response time 75th percentile 499 (OK=499 KO=- )
> response time 95th percentile 657 (OK=657 KO=- )
> response time 99th percentile 797 (OK=797 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 2616 (OK=2616 KO=- )
> mean response time 1018 (OK=1018 KO=- )
> std deviation 618 (OK=618 KO=- )
> response time 50th percentile 973 (OK=973 KO=- )
> response time 75th percentile 1418 (OK=1418 KO=- )
> response time 95th percentile 2182 (OK=2182 KO=- )
> response time 99th percentile 2434 (OK=2434 KO=- )
> mean requests/sec 3555.556 (OK=3555.556 KO=- )source code for the java and dotnet tests 
source code for the rust tests github action