Java microservice framework tests in SB:3.0.2 Q:2.16.2.Final M:3.8.4 V:4.3.8 H:3.1.2 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.67.0 (fc594f156 2023-01-24)

In Linux fv-az574-317 5.15.0-1031-azure #38-Ubuntu SMP Mon Jan 9 12:49:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 23.267 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 32.008 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 31.579 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 30.182 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 40.102 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  5.958 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  6.198 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 20.274 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.2M helidon-se-netty/target/helidon-quickstart-se.jar
18M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
14M micronaut/target/micronaut-demo-0.1.jar
16M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.8M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.0.2) Started DemoWebFluxApplication in 2.872 seconds (process running for 3.545)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    221 (OK=221    KO=-     )
> max response time                                   4892 (OK=4892   KO=-     )
> mean response time                                  2182 (OK=2182   KO=-     )
> std deviation                                       1190 (OK=1190   KO=-     )
> response time 50th percentile                       1551 (OK=1551   KO=-     )
> response time 75th percentile                       3364 (OK=3364   KO=-     )
> response time 95th percentile                       4041 (OK=4041   KO=-     )
> response time 99th percentile                       4610 (OK=4610   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

:: Spring Boot :: (v3.0.2) Started DemoApplication in 2.986 seconds (process running for 3.543)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     90 (OK=90     KO=-     )
> max response time                                   5019 (OK=5019   KO=-     )
> mean response time                                  2134 (OK=2134   KO=-     )
> std deviation                                       1448 (OK=1448   KO=-     )
> response time 50th percentile                       1396 (OK=1396   KO=-     )
> response time 75th percentile                       3706 (OK=3706   KO=-     )
> response time 95th percentile                       4398 (OK=4398   KO=-     )
> response time 99th percentile                       4739 (OK=4739   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

powered by Quarkus 2.16.2.Final) started in 1.326s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    162 (OK=162    KO=-     )
> max response time                                   5038 (OK=5038   KO=-     )
> mean response time                                  2106 (OK=2106   KO=-     )
> std deviation                                       1245 (OK=1245   KO=-     )
> response time 50th percentile                       1821 (OK=1821   KO=-     )
> response time 75th percentile                       3185 (OK=3185   KO=-     )
> response time 95th percentile                       4274 (OK=4274   KO=-     )
> response time 99th percentile                       4823 (OK=4823   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

micronaut version:3.4.3 Startup completed in 1270ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    204 (OK=204    KO=-     )
> max response time                                   4339 (OK=4339   KO=-     )
> mean response time                                  1877 (OK=1877   KO=-     )
> std deviation                                       1173 (OK=1173   KO=-     )
> response time 50th percentile                       1464 (OK=1464   KO=-     )
> response time 75th percentile                       3005 (OK=3005   KO=-     )
> response time 95th percentile                       3823 (OK=3823   KO=-     )
> response time 99th percentile                       4181 (OK=4181   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

vertx version:4.3.8

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    194 (OK=194    KO=-     )
> max response time                                   2984 (OK=2984   KO=-     )
> mean response time                                  1306 (OK=1306   KO=-     )
> std deviation                                        730 (OK=730    KO=-     )
> response time 50th percentile                       1079 (OK=1079   KO=-     )
> response time 75th percentile                       1877 (OK=1877   KO=-     )
> response time 95th percentile                       2574 (OK=2574   KO=-     )
> response time 99th percentile                       2934 (OK=2934   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

kumuluz version:4.1.0 Server – Started Server@67c277a0{STARTING}[10.0.9,sto=0] @4995ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    185 (OK=185    KO=-     )
> max response time                                   7578 (OK=7578   KO=-     )
> mean response time                                  2884 (OK=2884   KO=-     )
> std deviation                                       1769 (OK=1769   KO=-     )
> response time 50th percentile                       2367 (OK=2367   KO=-     )
> response time 75th percentile                       4289 (OK=4289   KO=-     )
> response time 95th percentile                       6242 (OK=6242   KO=-     )
> response time 99th percentile                       6833 (OK=6833   KO=-     )
> mean requests/sec                                615.385 (OK=615.385 KO=-     )

Helidon SE 3.1.2 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    132 (OK=132    KO=-     )
> max response time                                   4557 (OK=4557   KO=-     )
> mean response time                                  2195 (OK=2195   KO=-     )
> std deviation                                       1228 (OK=1228   KO=-     )
> response time 50th percentile                       1997 (OK=1997   KO=-     )
> response time 75th percentile                       3464 (OK=3464   KO=-     )
> response time 95th percentile                       3995 (OK=3995   KO=-     )
> response time 99th percentile                       4463 (OK=4463   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

ktor:2.2.3

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      8 (OK=8      KO=-     )
> max response time                                   6754 (OK=6754   KO=-     )
> mean response time                                  2775 (OK=2775   KO=-     )
> std deviation                                       1640 (OK=1640   KO=-     )
> response time 50th percentile                       2298 (OK=2299   KO=-     )
> response time 75th percentile                       4245 (OK=4245   KO=-     )
> response time 95th percentile                       5721 (OK=5721   KO=-     )
> response time 99th percentile                       6139 (OK=6139   KO=-     )
> mean requests/sec                                666.667 (OK=666.667 KO=-     )

Rust rest services #

rustc 1.67.0 (fc594f156 2023-01-24)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     21 (OK=21     KO=-     )
> max response time                                   1573 (OK=1573   KO=-     )
> mean response time                                   739 (OK=739    KO=-     )
> std deviation                                        393 (OK=393    KO=-     )
> response time 50th percentile                        663 (OK=663    KO=-     )
> response time 75th percentile                       1088 (OK=1088   KO=-     )
> response time 95th percentile                       1384 (OK=1384   KO=-     )
> response time 99th percentile                       1491 (OK=1491   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   2219 (OK=2219   KO=-     )
> mean response time                                   799 (OK=799    KO=-     )
> std deviation                                        465 (OK=465    KO=-     )
> response time 50th percentile                        685 (OK=685    KO=-     )
> response time 75th percentile                       1137 (OK=1137   KO=-     )
> response time 95th percentile                       1505 (OK=1505   KO=-     )
> response time 99th percentile                       2095 (OK=2095   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   2792 (OK=2792   KO=-     )
> mean response time                                   976 (OK=976    KO=-     )
> std deviation                                        647 (OK=647    KO=-     )
> response time 50th percentile                        767 (OK=768    KO=-     )
> response time 75th percentile                       1406 (OK=1406   KO=-     )
> response time 95th percentile                       2422 (OK=2423   KO=-     )
> response time 99th percentile                       2657 (OK=2657   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      3 (OK=3      KO=-     )
> max response time                                   2266 (OK=2266   KO=-     )
> mean response time                                   913 (OK=913    KO=-     )
> std deviation                                        563 (OK=563    KO=-     )
> response time 50th percentile                        750 (OK=750    KO=-     )
> response time 75th percentile                       1383 (OK=1383   KO=-     )
> response time 95th percentile                       2065 (OK=2065   KO=-     )
> response time 99th percentile                       2175 (OK=2175   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     13 (OK=13     KO=-     )
> max response time                                   3053 (OK=3053   KO=-     )
> mean response time                                  1303 (OK=1303   KO=-     )
> std deviation                                        852 (OK=852    KO=-     )
> response time 50th percentile                       1007 (OK=1007   KO=-     )
> response time 75th percentile                       1999 (OK=1999   KO=-     )
> response time 95th percentile                       2806 (OK=2806   KO=-     )
> response time 99th percentile                       2962 (OK=2962   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     21 (OK=21     KO=-     )
> max response time                                   2306 (OK=2306   KO=-     )
> mean response time                                   996 (OK=996    KO=-     )
> std deviation                                        574 (OK=574    KO=-     )
> response time 50th percentile                        979 (OK=979    KO=-     )
> response time 75th percentile                       1317 (OK=1317   KO=-     )
> response time 95th percentile                       2113 (OK=2113   KO=-     )
> response time 99th percentile                       2254 (OK=2254   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     11 (OK=11     KO=-     )
> max response time                                   3094 (OK=3094   KO=-     )
> mean response time                                  1178 (OK=1178   KO=-     )
> std deviation                                        674 (OK=674    KO=-     )
> response time 50th percentile                       1044 (OK=1044   KO=-     )
> response time 75th percentile                       1668 (OK=1668   KO=-     )
> response time 95th percentile                       2476 (OK=2475   KO=-     )
> response time 99th percentile                       2814 (OK=2814   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     19 (OK=19     KO=-     )
> max response time                                   3145 (OK=3145   KO=-     )
> mean response time                                  1227 (OK=1227   KO=-     )
> std deviation                                        776 (OK=776    KO=-     )
> response time 50th percentile                        940 (OK=940    KO=-     )
> response time 75th percentile                       1842 (OK=1841   KO=-     )
> response time 95th percentile                       2467 (OK=2467   KO=-     )
> response time 99th percentile                       2832 (OK=2832   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    132 (OK=132    KO=-     )
> max response time                                   2673 (OK=2673   KO=-     )
> mean response time                                  1195 (OK=1195   KO=-     )
> std deviation                                        681 (OK=681    KO=-     )
> response time 50th percentile                        941 (OK=941    KO=-     )
> response time 75th percentile                       1820 (OK=1820   KO=-     )
> response time 95th percentile                       2511 (OK=2511   KO=-     )
> response time 99th percentile                       2613 (OK=2613   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     49 (OK=49     KO=-     )
> max response time                                   2008 (OK=2008   KO=-     )
> mean response time                                   778 (OK=778    KO=-     )
> std deviation                                        455 (OK=455    KO=-     )
> response time 50th percentile                        679 (OK=679    KO=-     )
> response time 75th percentile                       1199 (OK=1199   KO=-     )
> response time 95th percentile                       1470 (OK=1470   KO=-     )
> response time 99th percentile                       1843 (OK=1843   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     22 (OK=22     KO=-     )
> max response time                                   2881 (OK=2881   KO=-     )
> mean response time                                  1036 (OK=1036   KO=-     )
> std deviation                                        650 (OK=650    KO=-     )
> response time 50th percentile                        855 (OK=855    KO=-     )
> response time 75th percentile                       1553 (OK=1553   KO=-     )
> response time 95th percentile                       2445 (OK=2445   KO=-     )
> response time 99th percentile                       2745 (OK=2745   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7984   KO=16    )
> min response time                                     97 (OK=97     KO=514   )
> max response time                                   4202 (OK=4202   KO=3552  )
> mean response time                                  1438 (OK=1438   KO=1561  )
> std deviation                                        833 (OK=832    KO=947   )
> response time 50th percentile                       1243 (OK=1243   KO=1438  )
> response time 75th percentile                       2219 (OK=2218   KO=2250  )
> response time 95th percentile                       2877 (OK=2877   KO=2967  )
> response time 99th percentile                       3059 (OK=3059   KO=3435  )
> mean requests/sec                                   1000 (OK=998    KO=2     )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: