Java microservice framework tests in SB:3.0.2 Q:2.16.0.Final M:3.8.3 V:4.3.7 H:3.1.0 Dotnet:6 openjdk version "17.0.5" 2022-10-18 rustc 1.66.1 (90743e729 2023-01-10)

In Linux fv-az577-5 5.15.0-1031-azure #38-Ubuntu SMP Mon Jan 9 12:49:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 24.937 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 33.593 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 34.620 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 32.295 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 42.479 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  7.074 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  7.072 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 22.580 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.2M helidon-se-netty/target/helidon-quickstart-se.jar
18M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
14M micronaut/target/micronaut-demo-0.1.jar
16M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.8M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.0.2) Started DemoWebFluxApplication in 3.023 seconds (process running for 3.71)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    175 (OK=175    KO=-     )
> max response time                                   5176 (OK=5176   KO=-     )
> mean response time                                  2212 (OK=2212   KO=-     )
> std deviation                                       1342 (OK=1342   KO=-     )
> response time 50th percentile                       1422 (OK=1422   KO=-     )
> response time 75th percentile                       3771 (OK=3771   KO=-     )
> response time 95th percentile                       4375 (OK=4375   KO=-     )
> response time 99th percentile                       4536 (OK=4536   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

:: Spring Boot :: (v3.0.2) Started DemoApplication in 3.15 seconds (process running for 3.817)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      7 (OK=7      KO=-     )
> max response time                                   5699 (OK=5699   KO=-     )
> mean response time                                  2417 (OK=2417   KO=-     )
> std deviation                                       1539 (OK=1539   KO=-     )
> response time 50th percentile                       1477 (OK=1477   KO=-     )
> response time 75th percentile                       3967 (OK=3967   KO=-     )
> response time 95th percentile                       5141 (OK=5141   KO=-     )
> response time 99th percentile                       5388 (OK=5388   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

powered by Quarkus 2.16.0.Final) started in 1.390s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    256 (OK=256    KO=-     )
> max response time                                   5030 (OK=5030   KO=-     )
> mean response time                                  2149 (OK=2149   KO=-     )
> std deviation                                       1383 (OK=1383   KO=-     )
> response time 50th percentile                       1450 (OK=1450   KO=-     )
> response time 75th percentile                       3565 (OK=3565   KO=-     )
> response time 95th percentile                       4234 (OK=4234   KO=-     )
> response time 99th percentile                       4391 (OK=4391   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

micronaut version:3.4.3 Startup completed in 1362ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     95 (OK=95     KO=-     )
> max response time                                   5047 (OK=5047   KO=-     )
> mean response time                                  2188 (OK=2188   KO=-     )
> std deviation                                       1364 (OK=1364   KO=-     )
> response time 50th percentile                       1643 (OK=1643   KO=-     )
> response time 75th percentile                       3757 (OK=3757   KO=-     )
> response time 95th percentile                       4402 (OK=4402   KO=-     )
> response time 99th percentile                       4667 (OK=4667   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

vertx version:4.3.7

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    169 (OK=169    KO=-     )
> max response time                                   3640 (OK=3640   KO=-     )
> mean response time                                  1560 (OK=1560   KO=-     )
> std deviation                                        948 (OK=948    KO=-     )
> response time 50th percentile                        998 (OK=998    KO=-     )
> response time 75th percentile                       2530 (OK=2530   KO=-     )
> response time 95th percentile                       2999 (OK=2999   KO=-     )
> response time 99th percentile                       3519 (OK=3519   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

kumuluz version:4.1.0 Server – Started Server@3104f7bd{STARTING}[10.0.9,sto=0] @5424ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     44 (OK=44     KO=-     )
> max response time                                   7606 (OK=7606   KO=-     )
> mean response time                                  2762 (OK=2762   KO=-     )
> std deviation                                       1940 (OK=1940   KO=-     )
> response time 50th percentile                       1717 (OK=1717   KO=-     )
> response time 75th percentile                       4516 (OK=4516   KO=-     )
> response time 95th percentile                       6117 (OK=6117   KO=-     )
> response time 99th percentile                       7168 (OK=7168   KO=-     )
> mean requests/sec                                615.385 (OK=615.385 KO=-     )

Helidon SE 3.1.0 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    237 (OK=237    KO=-     )
> max response time                                   4888 (OK=4888   KO=-     )
> mean response time                                  2484 (OK=2484   KO=-     )
> std deviation                                       1154 (OK=1154   KO=-     )
> response time 50th percentile                       2181 (OK=2181   KO=-     )
> response time 75th percentile                       3517 (OK=3517   KO=-     )
> response time 95th percentile                       4323 (OK=4323   KO=-     )
> response time 99th percentile                       4644 (OK=4644   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

ktor:2.2.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                   5864 (OK=5864   KO=-     )
> mean response time                                  2886 (OK=2886   KO=-     )
> std deviation                                       1597 (OK=1597   KO=-     )
> response time 50th percentile                       2644 (OK=2644   KO=-     )
> response time 75th percentile                       4481 (OK=4481   KO=-     )
> response time 95th percentile                       5311 (OK=5311   KO=-     )
> response time 99th percentile                       5665 (OK=5665   KO=-     )
> mean requests/sec                                615.385 (OK=615.385 KO=-     )

Rust rest services #

rustc 1.66.1 (90743e729 2023-01-10)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     49 (OK=49     KO=-     )
> max response time                                   2491 (OK=2491   KO=-     )
> mean response time                                   984 (OK=984    KO=-     )
> std deviation                                        594 (OK=594    KO=-     )
> response time 50th percentile                        915 (OK=915    KO=-     )
> response time 75th percentile                       1416 (OK=1416   KO=-     )
> response time 95th percentile                       2063 (OK=2063   KO=-     )
> response time 99th percentile                       2213 (OK=2213   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      3 (OK=3      KO=-     )
> max response time                                   1840 (OK=1840   KO=-     )
> mean response time                                   785 (OK=785    KO=-     )
> std deviation                                        429 (OK=429    KO=-     )
> response time 50th percentile                        676 (OK=676    KO=-     )
> response time 75th percentile                       1223 (OK=1223   KO=-     )
> response time 95th percentile                       1435 (OK=1435   KO=-     )
> response time 99th percentile                       1577 (OK=1577   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     17 (OK=17     KO=-     )
> max response time                                   2604 (OK=2604   KO=-     )
> mean response time                                  1056 (OK=1056   KO=-     )
> std deviation                                        622 (OK=622    KO=-     )
> response time 50th percentile                        896 (OK=897    KO=-     )
> response time 75th percentile                       1520 (OK=1519   KO=-     )
> response time 95th percentile                       2264 (OK=2264   KO=-     )
> response time 99th percentile                       2517 (OK=2517   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     45 (OK=45     KO=-     )
> max response time                                   2410 (OK=2410   KO=-     )
> mean response time                                   930 (OK=930    KO=-     )
> std deviation                                        547 (OK=547    KO=-     )
> response time 50th percentile                        722 (OK=721    KO=-     )
> response time 75th percentile                       1423 (OK=1423   KO=-     )
> response time 95th percentile                       1740 (OK=1739   KO=-     )
> response time 99th percentile                       2229 (OK=2229   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     72 (OK=72     KO=-     )
> max response time                                   3799 (OK=3799   KO=-     )
> mean response time                                  1641 (OK=1641   KO=-     )
> std deviation                                       1075 (OK=1075   KO=-     )
> response time 50th percentile                       1148 (OK=1148   KO=-     )
> response time 75th percentile                       2812 (OK=2812   KO=-     )
> response time 95th percentile                       3318 (OK=3318   KO=-     )
> response time 99th percentile                       3498 (OK=3498   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     65 (OK=65     KO=-     )
> max response time                                   3059 (OK=3059   KO=-     )
> mean response time                                  1358 (OK=1358   KO=-     )
> std deviation                                        828 (OK=828    KO=-     )
> response time 50th percentile                        944 (OK=943    KO=-     )
> response time 75th percentile                       2231 (OK=2231   KO=-     )
> response time 95th percentile                       2683 (OK=2683   KO=-     )
> response time 99th percentile                       2864 (OK=2864   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      7 (OK=7      KO=-     )
> max response time                                   2594 (OK=2594   KO=-     )
> mean response time                                  1127 (OK=1127   KO=-     )
> std deviation                                        622 (OK=622    KO=-     )
> response time 50th percentile                       1009 (OK=1009   KO=-     )
> response time 75th percentile                       1611 (OK=1611   KO=-     )
> response time 95th percentile                       2342 (OK=2342   KO=-     )
> response time 99th percentile                       2549 (OK=2549   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     13 (OK=13     KO=-     )
> max response time                                   3702 (OK=3702   KO=-     )
> mean response time                                  1464 (OK=1464   KO=-     )
> std deviation                                        870 (OK=870    KO=-     )
> response time 50th percentile                       1081 (OK=1081   KO=-     )
> response time 75th percentile                       2248 (OK=2248   KO=-     )
> response time 95th percentile                       3024 (OK=3024   KO=-     )
> response time 99th percentile                       3437 (OK=3437   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     98 (OK=98     KO=-     )
> max response time                                   3441 (OK=3441   KO=-     )
> mean response time                                  1347 (OK=1347   KO=-     )
> std deviation                                        854 (OK=854    KO=-     )
> response time 50th percentile                        946 (OK=946    KO=-     )
> response time 75th percentile                       1945 (OK=1945   KO=-     )
> response time 95th percentile                       2963 (OK=2963   KO=-     )
> response time 99th percentile                       3221 (OK=3221   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      9 (OK=9      KO=-     )
> max response time                                   2278 (OK=2278   KO=-     )
> mean response time                                  1003 (OK=1003   KO=-     )
> std deviation                                        570 (OK=570    KO=-     )
> response time 50th percentile                        924 (OK=924    KO=-     )
> response time 75th percentile                       1434 (OK=1434   KO=-     )
> response time 95th percentile                       2077 (OK=2077   KO=-     )
> response time 99th percentile                       2191 (OK=2191   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     77 (OK=77     KO=-     )
> max response time                                   2432 (OK=2432   KO=-     )
> mean response time                                  1065 (OK=1065   KO=-     )
> std deviation                                        638 (OK=638    KO=-     )
> response time 50th percentile                        866 (OK=866    KO=-     )
> response time 75th percentile                       1710 (OK=1710   KO=-     )
> response time 95th percentile                       2188 (OK=2188   KO=-     )
> response time 99th percentile                       2323 (OK=2323   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7965   KO=35    )
> min response time                                     45 (OK=45     KO=560   )
> max response time                                   5526 (OK=5526   KO=3185  )
> mean response time                                  1557 (OK=1556   KO=1603  )
> std deviation                                        864 (OK=864    KO=938   )
> response time 50th percentile                       1458 (OK=1459   KO=993   )
> response time 75th percentile                       2150 (OK=2149   KO=2453  )
> response time 95th percentile                       3062 (OK=3063   KO=2954  )
> response time 99th percentile                       3539 (OK=3539   KO=3137  )
> mean requests/sec                                888.889 (OK=885    KO=3.889 )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: