Java microservice framework tests in SB:3.3.2 Q:3.8.1 M:4.5.0 V:4.5.9 H:4.0.11 Dotnet:6 openjdk version "21.0.4" 2024-07-16 LTS rustc 1.80.0 (051478957 2024-07-21)

In Linux fv-az1567-91 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [  9.092 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [  6.354 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 11.682 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 11.911 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.756 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  4.579 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  4.579 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [  7.497 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
6.1M helidon-se-netty/target/helidon-quickstart-se.jar
6.1M helidon-se-netty/target/original-helidon-quickstart-se.jar
19M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
13M micronaut/target/micronaut-demo-0.1.jar
13M micronaut/target/original-micronaut-demo-0.1.jar
17M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
22M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
24M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
8.2M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.3.2) Started DemoWebFluxApplication in 1.857 seconds (process running for 2.365)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     54 (OK=54     KO=-     )
> max response time                                   4767 (OK=4767   KO=-     )
> mean response time                                  1537 (OK=1537   KO=-     )
> std deviation                                        919 (OK=919    KO=-     )
> response time 50th percentile                       1368 (OK=1367   KO=-     )
> response time 75th percentile                       1704 (OK=1706   KO=-     )
> response time 95th percentile                       3298 (OK=3297   KO=-     )
> response time 99th percentile                       4599 (OK=4599   KO=-     )
> mean requests/sec                                2666.667 (OK=2666.667 KO=-     )

:: Spring Boot :: (v3.3.2) Started DemoApplication in 1.994 seconds (process running for 2.484)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     30 (OK=30     KO=-     )
> max response time                                   4488 (OK=4488   KO=-     )
> mean response time                                  1164 (OK=1164   KO=-     )
> std deviation                                        752 (OK=752    KO=-     )
> response time 50th percentile                        958 (OK=958    KO=-     )
> response time 75th percentile                       1252 (OK=1252   KO=-     )
> response time 95th percentile                       2822 (OK=2823   KO=-     )
> response time 99th percentile                       3748 (OK=3749   KO=-     )
> mean requests/sec                                   3200 (OK=3200   KO=-     )

powered by Quarkus 3.8.1) started in 0.993s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     19 (OK=19     KO=-     )
> max response time                                   2798 (OK=2798   KO=-     )
> mean response time                                  1100 (OK=1100   KO=-     )
> std deviation                                        608 (OK=608    KO=-     )
> response time 50th percentile                        951 (OK=951    KO=-     )
> response time 75th percentile                       1285 (OK=1285   KO=-     )
> response time 95th percentile                       2307 (OK=2307   KO=-     )
> response time 99th percentile                       2455 (OK=2455   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

micronaut version:4.2.0 Startup completed in 728ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      7 (OK=7      KO=-     )
> max response time                                   2022 (OK=2022   KO=-     )
> mean response time                                   830 (OK=830    KO=-     )
> std deviation                                        466 (OK=466    KO=-     )
> response time 50th percentile                        723 (OK=722    KO=-     )
> response time 75th percentile                        956 (OK=956    KO=-     )
> response time 95th percentile                       1775 (OK=1775   KO=-     )
> response time 99th percentile                       1886 (OK=1886   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

vertx version:4.5.9

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     31 (OK=31     KO=-     )
> max response time                                   1702 (OK=1702   KO=-     )
> mean response time                                   983 (OK=983    KO=-     )
> std deviation                                        386 (OK=386    KO=-     )
> response time 50th percentile                       1041 (OK=1041   KO=-     )
> response time 75th percentile                       1320 (OK=1320   KO=-     )
> response time 95th percentile                       1542 (OK=1542   KO=-     )
> response time 99th percentile                       1642 (OK=1642   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

kumuluz version:4.1.0 Server – Started Server@6136998b{STARTING}[10.0.9,sto=0] @3207ms

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     47 (OK=47     KO=-     )
> max response time                                   6118 (OK=6118   KO=-     )
> mean response time                                  1504 (OK=1504   KO=-     )
> std deviation                                       1030 (OK=1030   KO=-     )
> response time 50th percentile                       1213 (OK=1213   KO=-     )
> response time 75th percentile                       1615 (OK=1615   KO=-     )
> response time 95th percentile                       3807 (OK=3807   KO=-     )
> response time 99th percentile                       4593 (OK=4593   KO=-     )
> mean requests/sec                                2666.667 (OK=2666.667 KO=-     )

Helidon SE 4.0.11 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1912 (OK=1912   KO=-     )
> mean response time                                   882 (OK=882    KO=-     )
> std deviation                                        376 (OK=376    KO=-     )
> response time 50th percentile                        899 (OK=899    KO=-     )
> response time 75th percentile                       1087 (OK=1087   KO=-     )
> response time 95th percentile                       1521 (OK=1521   KO=-     )
> response time 99th percentile                       1682 (OK=1682   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

ktor.application - Autoreload is disabled because the development mode is off.

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   5098 (OK=5098   KO=-     )
> mean response time                                  2276 (OK=2276   KO=-     )
> std deviation                                       1296 (OK=1296   KO=-     )
> response time 50th percentile                       2197 (OK=2193   KO=-     )
> response time 75th percentile                       2869 (OK=2866   KO=-     )
> response time 95th percentile                       4543 (OK=4543   KO=-     )
> response time 99th percentile                       4861 (OK=4861   KO=-     )
> mean requests/sec                                2285.714 (OK=2285.714 KO=-     )

Rust rest services #

rustc 1.80.0 (051478957 2024-07-21)

warp = 0.3.6

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    747 (OK=747    KO=-     )
> mean response time                                   259 (OK=259    KO=-     )
> std deviation                                        168 (OK=168    KO=-     )
> response time 50th percentile                        233 (OK=233    KO=-     )
> response time 75th percentile                        330 (OK=330    KO=-     )
> response time 95th percentile                        616 (OK=616    KO=-     )
> response time 99th percentile                        696 (OK=696    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

actix-web = 4.4.0

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    769 (OK=769    KO=-     )
> mean response time                                   269 (OK=269    KO=-     )
> std deviation                                        164 (OK=164    KO=-     )
> response time 50th percentile                        243 (OK=243    KO=-     )
> response time 75th percentile                        338 (OK=338    KO=-     )
> response time 95th percentile                        629 (OK=629    KO=-     )
> response time 99th percentile                        733 (OK=733    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

rocket = { version = 0.5.0, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                    920 (OK=920    KO=-     )
> mean response time                                   357 (OK=357    KO=-     )
> std deviation                                        192 (OK=192    KO=-     )
> response time 50th percentile                        313 (OK=313    KO=-     )
> response time 75th percentile                        416 (OK=416    KO=-     )
> response time 95th percentile                        742 (OK=742    KO=-     )
> response time 99th percentile                        840 (OK=840    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

axum = 0.7.1

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    822 (OK=822    KO=-     )
> mean response time                                   284 (OK=284    KO=-     )
> std deviation                                        180 (OK=180    KO=-     )
> response time 50th percentile                        250 (OK=250    KO=-     )
> response time 75th percentile                        357 (OK=357    KO=-     )
> response time 95th percentile                        682 (OK=682    KO=-     )
> response time 99th percentile                        766 (OK=767    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                   1329 (OK=1329   KO=-     )
> mean response time                                   554 (OK=554    KO=-     )
> std deviation                                        289 (OK=289    KO=-     )
> response time 50th percentile                        491 (OK=491    KO=-     )
> response time 75th percentile                        621 (OK=621    KO=-     )
> response time 95th percentile                       1126 (OK=1126   KO=-     )
> response time 99th percentile                       1258 (OK=1258   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

Dotnet 7 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                   1016 (OK=1016   KO=-     )
> mean response time                                   415 (OK=415    KO=-     )
> std deviation                                        222 (OK=222    KO=-     )
> response time 50th percentile                        385 (OK=385    KO=-     )
> response time 75th percentile                        473 (OK=473    KO=-     )
> response time 95th percentile                        869 (OK=869    KO=-     )
> response time 99th percentile                        945 (OK=945    KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

Dotnet 8 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     23 (OK=23     KO=-     )
> max response time                                   1571 (OK=1571   KO=-     )
> mean response time                                   612 (OK=612    KO=-     )
> std deviation                                        319 (OK=319    KO=-     )
> response time 50th percentile                        564 (OK=564    KO=-     )
> response time 75th percentile                        709 (OK=708    KO=-     )
> response time 95th percentile                       1263 (OK=1263   KO=-     )
> response time 99th percentile                       1364 (OK=1364   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                   1301 (OK=1301   KO=-     )
> mean response time                                   499 (OK=499    KO=-     )
> std deviation                                        220 (OK=220    KO=-     )
> response time 50th percentile                        459 (OK=459    KO=-     )
> response time 75th percentile                        647 (OK=647    KO=-     )
> response time 95th percentile                        915 (OK=915    KO=-     )
> response time 99th percentile                       1100 (OK=1100   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   1217 (OK=1217   KO=-     )
> mean response time                                   393 (OK=393    KO=-     )
> std deviation                                        234 (OK=234    KO=-     )
> response time 50th percentile                        343 (OK=343    KO=-     )
> response time 75th percentile                        496 (OK=496    KO=-     )
> response time 95th percentile                        905 (OK=906    KO=-     )
> response time 99th percentile                       1033 (OK=1033   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   2549 (OK=2549   KO=-     )
> mean response time                                   555 (OK=555    KO=-     )
> std deviation                                        407 (OK=407    KO=-     )
> response time 50th percentile                        450 (OK=450    KO=-     )
> response time 75th percentile                        621 (OK=621    KO=-     )
> response time 95th percentile                       1553 (OK=1553   KO=-     )
> response time 99th percentile                       1960 (OK=1960   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     11 (OK=11     KO=-     )
> max response time                                   1618 (OK=1618   KO=-     )
> mean response time                                   479 (OK=479    KO=-     )
> std deviation                                        254 (OK=254    KO=-     )
> response time 50th percentile                        411 (OK=411    KO=-     )
> response time 75th percentile                        564 (OK=564    KO=-     )
> response time 95th percentile                        982 (OK=982    KO=-     )
> response time 99th percentile                       1328 (OK=1328   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     24 (OK=24     KO=-     )
> max response time                                    858 (OK=858    KO=-     )
> mean response time                                   489 (OK=489    KO=-     )
> std deviation                                        172 (OK=172    KO=-     )
> response time 50th percentile                        539 (OK=539    KO=-     )
> response time 75th percentile                        632 (OK=632    KO=-     )
> response time 95th percentile                        725 (OK=725    KO=-     )
> response time 99th percentile                        782 (OK=782    KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    902 (OK=902    KO=-     )
> mean response time                                   363 (OK=363    KO=-     )
> std deviation                                        158 (OK=158    KO=-     )
> response time 50th percentile                        338 (OK=338    KO=-     )
> response time 75th percentile                        429 (OK=429    KO=-     )
> response time 95th percentile                        702 (OK=702    KO=-     )
> response time 99th percentile                        846 (OK=846    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=31948  KO=52    )
> min response time                                      7 (OK=7      KO=37    )
> max response time                                   2740 (OK=2740   KO=1046  )
> mean response time                                   882 (OK=883    KO=450   )
> std deviation                                        562 (OK=562    KO=258   )
> response time 50th percentile                        755 (OK=758    KO=419   )
> response time 75th percentile                       1262 (OK=1266   KO=651   )
> response time 95th percentile                       1992 (OK=1992   KO=790   )
> response time 99th percentile                       2435 (OK=2435   KO=1040  )
> mean requests/sec                                3555.556 (OK=3549.778 KO=5.778 )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: