Java microservice framework tests in SB:3.0.2 Q:2.16.2.Final M:3.8.4 V:4.3.8 H:3.1.1 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.67.0 (fc594f156 2023-01-24)

In Linux fv-az349-686 5.15.0-1031-azure #38-Ubuntu SMP Mon Jan 9 12:49:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 17.875 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 23.292 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 23.671 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 22.979 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 29.272 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  4.547 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  4.545 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 14.413 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.2M helidon-se-netty/target/helidon-quickstart-se.jar
18M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
14M micronaut/target/micronaut-demo-0.1.jar
16M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.8M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.0.2) Started DemoWebFluxApplication in 2.012 seconds (process running for 2.532)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      6 (OK=6      KO=-     )
> max response time                                   2762 (OK=2762   KO=-     )
> mean response time                                  1136 (OK=1136   KO=-     )
> std deviation                                        640 (OK=640    KO=-     )
> response time 50th percentile                        975 (OK=975    KO=-     )
> response time 75th percentile                       1738 (OK=1738   KO=-     )
> response time 95th percentile                       2178 (OK=2178   KO=-     )
> response time 99th percentile                       2637 (OK=2637   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

:: Spring Boot :: (v3.0.2) Started DemoApplication in 2.313 seconds (process running for 2.8)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     39 (OK=39     KO=-     )
> max response time                                   4280 (OK=4280   KO=-     )
> mean response time                                  1184 (OK=1184   KO=-     )
> std deviation                                        721 (OK=721    KO=-     )
> response time 50th percentile                       1071 (OK=1071   KO=-     )
> response time 75th percentile                       1710 (OK=1711   KO=-     )
> response time 95th percentile                       2420 (OK=2420   KO=-     )
> response time 99th percentile                       2729 (OK=2729   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

powered by Quarkus 2.16.2.Final) started in 0.907s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     16 (OK=16     KO=-     )
> max response time                                   2173 (OK=2173   KO=-     )
> mean response time                                   901 (OK=901    KO=-     )
> std deviation                                        538 (OK=538    KO=-     )
> response time 50th percentile                        798 (OK=798    KO=-     )
> response time 75th percentile                       1407 (OK=1407   KO=-     )
> response time 95th percentile                       1882 (OK=1882   KO=-     )
> response time 99th percentile                       2019 (OK=2019   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

micronaut version:3.4.3 Startup completed in 995ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     19 (OK=19     KO=-     )
> max response time                                   2783 (OK=2783   KO=-     )
> mean response time                                  1102 (OK=1102   KO=-     )
> std deviation                                        701 (OK=701    KO=-     )
> response time 50th percentile                        901 (OK=901    KO=-     )
> response time 75th percentile                       1667 (OK=1667   KO=-     )
> response time 95th percentile                       2400 (OK=2400   KO=-     )
> response time 99th percentile                       2755 (OK=2754   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

vertx version:4.3.8

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   1401 (OK=1401   KO=-     )
> mean response time                                   494 (OK=494    KO=-     )
> std deviation                                        323 (OK=323    KO=-     )
> response time 50th percentile                        430 (OK=430    KO=-     )
> response time 75th percentile                        739 (OK=739    KO=-     )
> response time 95th percentile                       1019 (OK=1019   KO=-     )
> response time 99th percentile                       1306 (OK=1306   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

kumuluz version:4.1.0 Server – Started Server@2e3cdec2{STARTING}[10.0.9,sto=0] @4380ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     31 (OK=31     KO=-     )
> max response time                                   4199 (OK=4199   KO=-     )
> mean response time                                  1419 (OK=1419   KO=-     )
> std deviation                                        911 (OK=911    KO=-     )
> response time 50th percentile                       1133 (OK=1133   KO=-     )
> response time 75th percentile                       2020 (OK=2020   KO=-     )
> response time 95th percentile                       3198 (OK=3198   KO=-     )
> response time 99th percentile                       3699 (OK=3699   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

Helidon SE 3.1.1 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    120 (OK=120    KO=-     )
> max response time                                   2669 (OK=2669   KO=-     )
> mean response time                                  1344 (OK=1344   KO=-     )
> std deviation                                        672 (OK=672    KO=-     )
> response time 50th percentile                       1386 (OK=1386   KO=-     )
> response time 75th percentile                       1958 (OK=1958   KO=-     )
> response time 95th percentile                       2356 (OK=2356   KO=-     )
> response time 99th percentile                       2570 (OK=2570   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

ktor:2.2.3

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   3291 (OK=3291   KO=-     )
> mean response time                                  1467 (OK=1467   KO=-     )
> std deviation                                        800 (OK=800    KO=-     )
> response time 50th percentile                       1232 (OK=1232   KO=-     )
> response time 75th percentile                       2138 (OK=2138   KO=-     )
> response time 95th percentile                       2728 (OK=2728   KO=-     )
> response time 99th percentile                       2961 (OK=2961   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

Rust rest services #

rustc 1.67.0 (fc594f156 2023-01-24)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    445 (OK=445    KO=-     )
> mean response time                                   108 (OK=108    KO=-     )
> std deviation                                        127 (OK=127    KO=-     )
> response time 50th percentile                         69 (OK=69     KO=-     )
> response time 75th percentile                        186 (OK=186    KO=-     )
> response time 95th percentile                        388 (OK=388    KO=-     )
> response time 99th percentile                        420 (OK=420    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    473 (OK=473    KO=-     )
> mean response time                                   120 (OK=120    KO=-     )
> std deviation                                        132 (OK=132    KO=-     )
> response time 50th percentile                         88 (OK=88     KO=-     )
> response time 75th percentile                        203 (OK=203    KO=-     )
> response time 95th percentile                        375 (OK=376    KO=-     )
> response time 99th percentile                        437 (OK=437    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    543 (OK=543    KO=-     )
> mean response time                                   165 (OK=165    KO=-     )
> std deviation                                        159 (OK=159    KO=-     )
> response time 50th percentile                        144 (OK=144    KO=-     )
> response time 75th percentile                        259 (OK=259    KO=-     )
> response time 95th percentile                        458 (OK=458    KO=-     )
> response time 99th percentile                        491 (OK=491    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    596 (OK=596    KO=-     )
> mean response time                                   168 (OK=168    KO=-     )
> std deviation                                        164 (OK=164    KO=-     )
> response time 50th percentile                        148 (OK=149    KO=-     )
> response time 75th percentile                        267 (OK=267    KO=-     )
> response time 95th percentile                        456 (OK=456    KO=-     )
> response time 99th percentile                        548 (OK=548    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     14 (OK=14     KO=-     )
> max response time                                   1383 (OK=1383   KO=-     )
> mean response time                                   527 (OK=527    KO=-     )
> std deviation                                        322 (OK=322    KO=-     )
> response time 50th percentile                        474 (OK=474    KO=-     )
> response time 75th percentile                        785 (OK=785    KO=-     )
> response time 95th percentile                       1107 (OK=1107   KO=-     )
> response time 99th percentile                       1305 (OK=1305   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    795 (OK=795    KO=-     )
> mean response time                                   238 (OK=238    KO=-     )
> std deviation                                        224 (OK=224    KO=-     )
> response time 50th percentile                        176 (OK=176    KO=-     )
> response time 75th percentile                        343 (OK=343    KO=-     )
> response time 95th percentile                        729 (OK=729    KO=-     )
> response time 99th percentile                        775 (OK=775    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    944 (OK=944    KO=-     )
> mean response time                                   290 (OK=290    KO=-     )
> std deviation                                        242 (OK=242    KO=-     )
> response time 50th percentile                        250 (OK=250    KO=-     )
> response time 75th percentile                        482 (OK=482    KO=-     )
> response time 95th percentile                        778 (OK=778    KO=-     )
> response time 99th percentile                        859 (OK=859    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1145 (OK=1145   KO=-     )
> mean response time                                   326 (OK=326    KO=-     )
> std deviation                                        235 (OK=235    KO=-     )
> response time 50th percentile                        279 (OK=279    KO=-     )
> response time 75th percentile                        520 (OK=520    KO=-     )
> response time 95th percentile                        738 (OK=738    KO=-     )
> response time 99th percentile                       1055 (OK=1055   KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    943 (OK=943    KO=-     )
> mean response time                                   294 (OK=294    KO=-     )
> std deviation                                        248 (OK=248    KO=-     )
> response time 50th percentile                        256 (OK=256    KO=-     )
> response time 75th percentile                        501 (OK=501    KO=-     )
> response time 95th percentile                        741 (OK=741    KO=-     )
> response time 99th percentile                        814 (OK=814    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    493 (OK=493    KO=-     )
> mean response time                                   126 (OK=126    KO=-     )
> std deviation                                        143 (OK=143    KO=-     )
> response time 50th percentile                         77 (OK=77     KO=-     )
> response time 75th percentile                        202 (OK=202    KO=-     )
> response time 95th percentile                        413 (OK=413    KO=-     )
> response time 99th percentile                        461 (OK=461    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    686 (OK=686    KO=-     )
> mean response time                                   215 (OK=215    KO=-     )
> std deviation                                        195 (OK=195    KO=-     )
> response time 50th percentile                        189 (OK=189    KO=-     )
> response time 75th percentile                        381 (OK=381    KO=-     )
> response time 95th percentile                        547 (OK=547    KO=-     )
> response time 99th percentile                        662 (OK=662    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7767   KO=233   )
> min response time                                      1 (OK=1      KO=63    )
> max response time                                   1718 (OK=1627   KO=1718  )
> mean response time                                   491 (OK=480    KO=854   )
> std deviation                                        274 (OK=266    KO=262   )
> response time 50th percentile                        432 (OK=425    KO=845   )
> response time 75th percentile                        697 (OK=679    KO=1040  )
> response time 95th percentile                        951 (OK=911    KO=1131  )
> response time 99th percentile                       1271 (OK=1264   KO=1536  )
> mean requests/sec                                1333.333 (OK=1294.5 KO=38.833)

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: