Java microservice framework tests in SB:3.3.2 Q:3.8.1 M:4.5.0 V:4.5.9 H:4.0.11 Dotnet:6 openjdk version "21.0.4" 2024-07-16 LTS rustc 1.80.1 (3f5fd8dd4 2024-08-06)

In Linux fv-az1114-392 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [  6.895 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [  7.118 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 11.428 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 12.443 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.003 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  2.746 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  2.713 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [  7.304 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
6.1M helidon-se-netty/target/helidon-quickstart-se.jar
6.1M helidon-se-netty/target/original-helidon-quickstart-se.jar
19M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
13M micronaut/target/micronaut-demo-0.1.jar
13M micronaut/target/original-micronaut-demo-0.1.jar
17M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
22M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
24M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
8.2M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.3.2) Started DemoWebFluxApplication in 1.781 seconds (process running for 2.259)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     75 (OK=75     KO=-     )
> max response time                                   5237 (OK=5237   KO=-     )
> mean response time                                  1415 (OK=1415   KO=-     )
> std deviation                                       1048 (OK=1048   KO=-     )
> response time 50th percentile                       1160 (OK=1160   KO=-     )
> response time 75th percentile                       1506 (OK=1505   KO=-     )
> response time 95th percentile                       4145 (OK=4145   KO=-     )
> response time 99th percentile                       4938 (OK=4938   KO=-     )
> mean requests/sec                                2909.091 (OK=2909.091 KO=-     )

:: Spring Boot :: (v3.3.2) Started DemoApplication in 1.726 seconds (process running for 2.192)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                   4292 (OK=4292   KO=-     )
> mean response time                                  1080 (OK=1080   KO=-     )
> std deviation                                        745 (OK=745    KO=-     )
> response time 50th percentile                        913 (OK=913    KO=-     )
> response time 75th percentile                       1216 (OK=1216   KO=-     )
> response time 95th percentile                       2838 (OK=2838   KO=-     )
> response time 99th percentile                       3881 (OK=3881   KO=-     )
> mean requests/sec                                   3200 (OK=3200   KO=-     )

powered by Quarkus 3.8.1) started in 0.930s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     41 (OK=41     KO=-     )
> max response time                                   3146 (OK=3146   KO=-     )
> mean response time                                  1061 (OK=1061   KO=-     )
> std deviation                                        570 (OK=570    KO=-     )
> response time 50th percentile                        908 (OK=908    KO=-     )
> response time 75th percentile                       1175 (OK=1175   KO=-     )
> response time 95th percentile                       2202 (OK=2202   KO=-     )
> response time 99th percentile                       2768 (OK=2768   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

micronaut version:4.2.0 Startup completed in 687ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      7 (OK=7      KO=-     )
> max response time                                   1993 (OK=1993   KO=-     )
> mean response time                                   788 (OK=788    KO=-     )
> std deviation                                        447 (OK=447    KO=-     )
> response time 50th percentile                        669 (OK=669    KO=-     )
> response time 75th percentile                        927 (OK=927    KO=-     )
> response time 95th percentile                       1678 (OK=1678   KO=-     )
> response time 99th percentile                       1782 (OK=1782   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

vertx version:4.5.9

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     22 (OK=22     KO=-     )
> max response time                                   1826 (OK=1826   KO=-     )
> mean response time                                   941 (OK=941    KO=-     )
> std deviation                                        408 (OK=408    KO=-     )
> response time 50th percentile                        886 (OK=886    KO=-     )
> response time 75th percentile                       1299 (OK=1299   KO=-     )
> response time 95th percentile                       1584 (OK=1584   KO=-     )
> response time 99th percentile                       1767 (OK=1767   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

kumuluz version:4.1.0 Server – Started Server@5b94ccbc{STARTING}[10.0.9,sto=0] @2958ms

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     36 (OK=36     KO=-     )
> max response time                                   5213 (OK=5213   KO=-     )
> mean response time                                  1402 (OK=1402   KO=-     )
> std deviation                                        948 (OK=948    KO=-     )
> response time 50th percentile                       1107 (OK=1107   KO=-     )
> response time 75th percentile                       1494 (OK=1493   KO=-     )
> response time 95th percentile                       3583 (OK=3583   KO=-     )
> response time 99th percentile                       4201 (OK=4201   KO=-     )
> mean requests/sec                                2909.091 (OK=2909.091 KO=-     )

Helidon SE 4.0.11 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1818 (OK=1818   KO=-     )
> mean response time                                   810 (OK=810    KO=-     )
> std deviation                                        381 (OK=381    KO=-     )
> response time 50th percentile                        737 (OK=737    KO=-     )
> response time 75th percentile                        934 (OK=934    KO=-     )
> response time 95th percentile                       1587 (OK=1587   KO=-     )
> response time 99th percentile                       1729 (OK=1729   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

ktor.application - Autoreload is disabled because the development mode is off.

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   4748 (OK=4748   KO=-     )
> mean response time                                  2127 (OK=2127   KO=-     )
> std deviation                                       1317 (OK=1317   KO=-     )
> response time 50th percentile                       2020 (OK=2020   KO=-     )
> response time 75th percentile                       2906 (OK=2912   KO=-     )
> response time 95th percentile                       4428 (OK=4428   KO=-     )
> response time 99th percentile                       4586 (OK=4586   KO=-     )
> mean requests/sec                                2461.538 (OK=2461.538 KO=-     )

Rust rest services #

rustc 1.80.1 (3f5fd8dd4 2024-08-06)

warp = 0.3.6

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    669 (OK=669    KO=-     )
> mean response time                                   234 (OK=234    KO=-     )
> std deviation                                        151 (OK=151    KO=-     )
> response time 50th percentile                        212 (OK=212    KO=-     )
> response time 75th percentile                        290 (OK=290    KO=-     )
> response time 95th percentile                        557 (OK=557    KO=-     )
> response time 99th percentile                        635 (OK=635    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

actix-web = 4.4.0

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    736 (OK=736    KO=-     )
> mean response time                                   205 (OK=205    KO=-     )
> std deviation                                        155 (OK=155    KO=-     )
> response time 50th percentile                        193 (OK=193    KO=-     )
> response time 75th percentile                        272 (OK=272    KO=-     )
> response time 95th percentile                        517 (OK=517    KO=-     )
> response time 99th percentile                        641 (OK=641    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

rocket = { version = 0.5.0, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                    817 (OK=817    KO=-     )
> mean response time                                   271 (OK=271    KO=-     )
> std deviation                                        163 (OK=163    KO=-     )
> response time 50th percentile                        242 (OK=242    KO=-     )
> response time 75th percentile                        328 (OK=327    KO=-     )
> response time 95th percentile                        612 (OK=612    KO=-     )
> response time 99th percentile                        739 (OK=739    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

axum = 0.7.1

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    806 (OK=806    KO=-     )
> mean response time                                   256 (OK=256    KO=-     )
> std deviation                                        158 (OK=158    KO=-     )
> response time 50th percentile                        229 (OK=229    KO=-     )
> response time 75th percentile                        314 (OK=314    KO=-     )
> response time 95th percentile                        590 (OK=590    KO=-     )
> response time 99th percentile                        656 (OK=656    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   1430 (OK=1430   KO=-     )
> mean response time                                   566 (OK=566    KO=-     )
> std deviation                                        320 (OK=320    KO=-     )
> response time 50th percentile                        502 (OK=502    KO=-     )
> response time 75th percentile                        660 (OK=660    KO=-     )
> response time 95th percentile                       1201 (OK=1201   KO=-     )
> response time 99th percentile                       1303 (OK=1303   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

Dotnet 7 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   1165 (OK=1165   KO=-     )
> mean response time                                   418 (OK=418    KO=-     )
> std deviation                                        221 (OK=221    KO=-     )
> response time 50th percentile                        363 (OK=363    KO=-     )
> response time 75th percentile                        514 (OK=515    KO=-     )
> response time 95th percentile                        848 (OK=848    KO=-     )
> response time 99th percentile                       1005 (OK=1005   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

Dotnet 8 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   1285 (OK=1285   KO=-     )
> mean response time                                   511 (OK=511    KO=-     )
> std deviation                                        248 (OK=248    KO=-     )
> response time 50th percentile                        468 (OK=468    KO=-     )
> response time 75th percentile                        602 (OK=602    KO=-     )
> response time 95th percentile                       1041 (OK=1041   KO=-     )
> response time 99th percentile                       1125 (OK=1125   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1132 (OK=1132   KO=-     )
> mean response time                                   427 (OK=427    KO=-     )
> std deviation                                        208 (OK=208    KO=-     )
> response time 50th percentile                        380 (OK=380    KO=-     )
> response time 75th percentile                        508 (OK=508    KO=-     )
> response time 95th percentile                        864 (OK=864    KO=-     )
> response time 99th percentile                        992 (OK=992    KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     19 (OK=19     KO=-     )
> max response time                                   1180 (OK=1180   KO=-     )
> mean response time                                   388 (OK=388    KO=-     )
> std deviation                                        199 (OK=199    KO=-     )
> response time 50th percentile                        339 (OK=339    KO=-     )
> response time 75th percentile                        478 (OK=478    KO=-     )
> response time 95th percentile                        778 (OK=778    KO=-     )
> response time 99th percentile                        901 (OK=901    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   3045 (OK=3045   KO=-     )
> mean response time                                   487 (OK=487    KO=-     )
> std deviation                                        349 (OK=349    KO=-     )
> response time 50th percentile                        399 (OK=399    KO=-     )
> response time 75th percentile                        588 (OK=588    KO=-     )
> response time 95th percentile                       1124 (OK=1123   KO=-     )
> response time 99th percentile                       1816 (OK=1816   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     28 (OK=28     KO=-     )
> max response time                                   1727 (OK=1727   KO=-     )
> mean response time                                   456 (OK=456    KO=-     )
> std deviation                                        273 (OK=273    KO=-     )
> response time 50th percentile                        381 (OK=381    KO=-     )
> response time 75th percentile                        542 (OK=543    KO=-     )
> response time 95th percentile                        983 (OK=983    KO=-     )
> response time 99th percentile                       1402 (OK=1402   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     21 (OK=21     KO=-     )
> max response time                                    903 (OK=903    KO=-     )
> mean response time                                   498 (OK=498    KO=-     )
> std deviation                                        177 (OK=177    KO=-     )
> response time 50th percentile                        557 (OK=557    KO=-     )
> response time 75th percentile                        638 (OK=638    KO=-     )
> response time 95th percentile                        738 (OK=738    KO=-     )
> response time 99th percentile                        788 (OK=788    KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    955 (OK=955    KO=-     )
> mean response time                                   377 (OK=377    KO=-     )
> std deviation                                        163 (OK=163    KO=-     )
> response time 50th percentile                        365 (OK=365    KO=-     )
> response time 75th percentile                        439 (OK=440    KO=-     )
> response time 95th percentile                        735 (OK=735    KO=-     )
> response time 99th percentile                        834 (OK=834    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   2305 (OK=2305   KO=-     )
> mean response time                                   833 (OK=833    KO=-     )
> std deviation                                        536 (OK=536    KO=-     )
> response time 50th percentile                        735 (OK=735    KO=-     )
> response time 75th percentile                       1182 (OK=1181   KO=-     )
> response time 95th percentile                       1891 (OK=1891   KO=-     )
> response time 99th percentile                       2110 (OK=2110   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: