Java microservice framework tests in SB:3.0.6 Q:3.0.3.Final M:3.9.1 V:4.4.2 H:3.2.1 Dotnet:6 openjdk version "17.0.7" 2023-04-18 rustc 1.69.0 (84c898d65 2023-04-16)

In Linux fv-az422-171 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 16.594 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 23.185 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 22.736 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 21.823 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 29.700 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  4.791 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  4.789 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 13.155 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.3M helidon-se-netty/target/helidon-quickstart-se.jar
11K helidon-se-netty/target/original-helidon-quickstart-se.jar
19M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
16K ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar
15M micronaut/target/micronaut-demo-0.1.jar
13K micronaut/target/original-micronaut-demo-0.1.jar
17M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.9M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar
8.8K vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar

:: Spring Boot :: (v3.0.6) Started DemoWebFluxApplication in 2.112 seconds (process running for 2.595)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     91 (OK=91     KO=-     )
> max response time                                   2719 (OK=2719   KO=-     )
> mean response time                                  1178 (OK=1178   KO=-     )
> std deviation                                        577 (OK=577    KO=-     )
> response time 50th percentile                       1094 (OK=1094   KO=-     )
> response time 75th percentile                       1693 (OK=1693   KO=-     )
> response time 95th percentile                       1981 (OK=1981   KO=-     )
> response time 99th percentile                       2437 (OK=2437   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

:: Spring Boot :: (v3.0.6) Started DemoApplication in 2.339 seconds (process running for 2.799)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     64 (OK=64     KO=-     )
> max response time                                   3134 (OK=3134   KO=-     )
> mean response time                                  1183 (OK=1183   KO=-     )
> std deviation                                        703 (OK=703    KO=-     )
> response time 50th percentile                       1041 (OK=1042   KO=-     )
> response time 75th percentile                       1859 (OK=1859   KO=-     )
> response time 95th percentile                       2243 (OK=2243   KO=-     )
> response time 99th percentile                       2897 (OK=2897   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

powered by Quarkus 3.0.3.Final) started in 0.976s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     20 (OK=20     KO=-     )
> max response time                                   1856 (OK=1856   KO=-     )
> mean response time                                   807 (OK=807    KO=-     )
> std deviation                                        461 (OK=461    KO=-     )
> response time 50th percentile                        736 (OK=737    KO=-     )
> response time 75th percentile                       1173 (OK=1173   KO=-     )
> response time 95th percentile                       1626 (OK=1626   KO=-     )
> response time 99th percentile                       1690 (OK=1690   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

micronaut version:3.9.1 Startup completed in 921ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     85 (OK=85     KO=-     )
> max response time                                   2211 (OK=2211   KO=-     )
> mean response time                                   988 (OK=988    KO=-     )
> std deviation                                        497 (OK=497    KO=-     )
> response time 50th percentile                        849 (OK=849    KO=-     )
> response time 75th percentile                       1375 (OK=1375   KO=-     )
> response time 95th percentile                       1929 (OK=1929   KO=-     )
> response time 99th percentile                       2031 (OK=2031   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

vertx version:4.4.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1139 (OK=1139   KO=-     )
> mean response time                                   386 (OK=386    KO=-     )
> std deviation                                        294 (OK=294    KO=-     )
> response time 50th percentile                        298 (OK=298    KO=-     )
> response time 75th percentile                        585 (OK=585    KO=-     )
> response time 95th percentile                        950 (OK=950    KO=-     )
> response time 99th percentile                       1063 (OK=1063   KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

kumuluz version:4.1.0 Server – Started Server@22bd2039{STARTING}[10.0.9,sto=0] @3545ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     20 (OK=20     KO=-     )
> max response time                                   4005 (OK=4005   KO=-     )
> mean response time                                  1497 (OK=1497   KO=-     )
> std deviation                                        955 (OK=955    KO=-     )
> response time 50th percentile                       1302 (OK=1302   KO=-     )
> response time 75th percentile                       2355 (OK=2355   KO=-     )
> response time 95th percentile                       3071 (OK=3071   KO=-     )
> response time 99th percentile                       3460 (OK=3460   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

Helidon SE 3.2.1 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     68 (OK=68     KO=-     )
> max response time                                   2712 (OK=2712   KO=-     )
> mean response time                                  1416 (OK=1416   KO=-     )
> std deviation                                        605 (OK=605    KO=-     )
> response time 50th percentile                       1245 (OK=1245   KO=-     )
> response time 75th percentile                       1877 (OK=1877   KO=-     )
> response time 95th percentile                       2542 (OK=2542   KO=-     )
> response time 99th percentile                       2672 (OK=2672   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

ktor:2.3.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      3 (OK=3      KO=-     )
> max response time                                   3597 (OK=3597   KO=-     )
> mean response time                                  1998 (OK=1998   KO=-     )
> std deviation                                       1007 (OK=1007   KO=-     )
> response time 50th percentile                       2187 (OK=2187   KO=-     )
> response time 75th percentile                       2862 (OK=2862   KO=-     )
> response time 95th percentile                       3328 (OK=3328   KO=-     )
> response time 99th percentile                       3436 (OK=3436   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

Rust rest services #

rustc 1.69.0 (84c898d65 2023-04-16)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    430 (OK=430    KO=-     )
> mean response time                                    84 (OK=84     KO=-     )
> std deviation                                        113 (OK=113    KO=-     )
> response time 50th percentile                          8 (OK=8      KO=-     )
> response time 75th percentile                        136 (OK=136    KO=-     )
> response time 95th percentile                        330 (OK=330    KO=-     )
> response time 99th percentile                        397 (OK=397    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    432 (OK=432    KO=-     )
> mean response time                                   121 (OK=121    KO=-     )
> std deviation                                        129 (OK=129    KO=-     )
> response time 50th percentile                         88 (OK=88     KO=-     )
> response time 75th percentile                        187 (OK=187    KO=-     )
> response time 95th percentile                        369 (OK=369    KO=-     )
> response time 99th percentile                        406 (OK=406    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    531 (OK=531    KO=-     )
> mean response time                                   100 (OK=100    KO=-     )
> std deviation                                        125 (OK=125    KO=-     )
> response time 50th percentile                         34 (OK=34     KO=-     )
> response time 75th percentile                        165 (OK=165    KO=-     )
> response time 95th percentile                        374 (OK=374    KO=-     )
> response time 99th percentile                        395 (OK=395    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    525 (OK=525    KO=-     )
> mean response time                                   114 (OK=114    KO=-     )
> std deviation                                        138 (OK=138    KO=-     )
> response time 50th percentile                         63 (OK=63     KO=-     )
> response time 75th percentile                        192 (OK=192    KO=-     )
> response time 95th percentile                        427 (OK=427    KO=-     )
> response time 99th percentile                        509 (OK=509    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    901 (OK=901    KO=-     )
> mean response time                                   329 (OK=329    KO=-     )
> std deviation                                        226 (OK=226    KO=-     )
> response time 50th percentile                        278 (OK=278    KO=-     )
> response time 75th percentile                        505 (OK=505    KO=-     )
> response time 95th percentile                        739 (OK=739    KO=-     )
> response time 99th percentile                        826 (OK=826    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

Dotnet 7 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    766 (OK=766    KO=-     )
> mean response time                                   216 (OK=216    KO=-     )
> std deviation                                        219 (OK=219    KO=-     )
> response time 50th percentile                        162 (OK=162    KO=-     )
> response time 75th percentile                        328 (OK=328    KO=-     )
> response time 95th percentile                        664 (OK=664    KO=-     )
> response time 99th percentile                        712 (OK=712    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    861 (OK=861    KO=-     )
> mean response time                                   244 (OK=244    KO=-     )
> std deviation                                        223 (OK=223    KO=-     )
> response time 50th percentile                        181 (OK=181    KO=-     )
> response time 75th percentile                        397 (OK=397    KO=-     )
> response time 95th percentile                        729 (OK=729    KO=-     )
> response time 99th percentile                        788 (OK=788    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    697 (OK=697    KO=-     )
> mean response time                                   196 (OK=196    KO=-     )
> std deviation                                        190 (OK=190    KO=-     )
> response time 50th percentile                        154 (OK=154    KO=-     )
> response time 75th percentile                        304 (OK=304    KO=-     )
> response time 95th percentile                        569 (OK=569    KO=-     )
> response time 99th percentile                        670 (OK=670    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    748 (OK=748    KO=-     )
> mean response time                                   251 (OK=251    KO=-     )
> std deviation                                        192 (OK=192    KO=-     )
> response time 50th percentile                        215 (OK=215    KO=-     )
> response time 75th percentile                        390 (OK=390    KO=-     )
> response time 95th percentile                        603 (OK=603    KO=-     )
> response time 99th percentile                        669 (OK=669    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    657 (OK=657    KO=-     )
> mean response time                                   233 (OK=233    KO=-     )
> std deviation                                        191 (OK=191    KO=-     )
> response time 50th percentile                        201 (OK=201    KO=-     )
> response time 75th percentile                        381 (OK=381    KO=-     )
> response time 95th percentile                        568 (OK=567    KO=-     )
> response time 99th percentile                        613 (OK=613    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    429 (OK=429    KO=-     )
> mean response time                                   100 (OK=100    KO=-     )
> std deviation                                        120 (OK=120    KO=-     )
> response time 50th percentile                         49 (OK=49     KO=-     )
> response time 75th percentile                        160 (OK=160    KO=-     )
> response time 95th percentile                        341 (OK=341    KO=-     )
> response time 99th percentile                        402 (OK=402    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    582 (OK=582    KO=-     )
> mean response time                                   144 (OK=144    KO=-     )
> std deviation                                        156 (OK=156    KO=-     )
> response time 50th percentile                        104 (OK=104    KO=-     )
> response time 75th percentile                        225 (OK=225    KO=-     )
> response time 95th percentile                        457 (OK=457    KO=-     )
> response time 99th percentile                        532 (OK=532    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7910   KO=90    )
> min response time                                      0 (OK=0      KO=38    )
> max response time                                   1874 (OK=1874   KO=1347  )
> mean response time                                   441 (OK=439    KO=614   )
> std deviation                                        269 (OK=268    KO=278   )
> response time 50th percentile                        402 (OK=399    KO=588   )
> response time 75th percentile                        606 (OK=604    KO=783   )
> response time 95th percentile                        933 (OK=933    KO=1004  )
> response time 99th percentile                       1239 (OK=1237   KO=1253  )
> mean requests/sec                                1333.333 (OK=1318.333 KO=15    )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: