Java microservice framework tests in SB:3.2.5 Q:3.8.1 M:4.2.2 V:4.5.7 H:4.0.6 Dotnet:6 openjdk version "21.0.2" 2024-01-16 LTS rustc 1.77.2 (25ef9e3d8 2024-04-09)

In Linux fv-az573-962 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [  7.925 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [  6.966 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 10.780 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 10.287 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.070 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  2.769 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  2.753 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [  8.247 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
6.1M helidon-se-netty/target/helidon-quickstart-se.jar
6.1M helidon-se-netty/target/original-helidon-quickstart-se.jar
19M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
16K ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar
13M micronaut/target/micronaut-demo-0.1.jar
15K micronaut/target/original-micronaut-demo-0.1.jar
17M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
21M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
24M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
13M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar
8.8K vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar

:: Spring Boot :: (v3.2.5) Started DemoWebFluxApplication in 1.888 seconds (process running for 2.385)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     54 (OK=54     KO=-     )
> max response time                                   5729 (OK=5729   KO=-     )
> mean response time                                  1494 (OK=1494   KO=-     )
> std deviation                                        987 (OK=987    KO=-     )
> response time 50th percentile                       1121 (OK=1121   KO=-     )
> response time 75th percentile                       1739 (OK=1738   KO=-     )
> response time 95th percentile                       3643 (OK=3644   KO=-     )
> response time 99th percentile                       5211 (OK=5211   KO=-     )
> mean requests/sec                                2666.667 (OK=2666.667 KO=-     )

:: Spring Boot :: (v3.2.5) Started DemoApplication in 1.847 seconds (process running for 2.331)

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   5185 (OK=5185   KO=-     )
> mean response time                                  1192 (OK=1192   KO=-     )
> std deviation                                        728 (OK=728    KO=-     )
> response time 50th percentile                       1001 (OK=1001   KO=-     )
> response time 75th percentile                       1282 (OK=1282   KO=-     )
> response time 95th percentile                       2793 (OK=2794   KO=-     )
> response time 99th percentile                       3441 (OK=3440   KO=-     )
> mean requests/sec                                   3200 (OK=3200   KO=-     )

powered by Quarkus 3.8.1) started in 0.994s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      9 (OK=9      KO=-     )
> max response time                                   3034 (OK=3034   KO=-     )
> mean response time                                  1030 (OK=1030   KO=-     )
> std deviation                                        528 (OK=528    KO=-     )
> response time 50th percentile                        905 (OK=904    KO=-     )
> response time 75th percentile                       1241 (OK=1240   KO=-     )
> response time 95th percentile                       2081 (OK=2081   KO=-     )
> response time 99th percentile                       2282 (OK=2282   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

micronaut version:4.2.0 Startup completed in 735ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     13 (OK=13     KO=-     )
> max response time                                   2089 (OK=2089   KO=-     )
> mean response time                                   889 (OK=889    KO=-     )
> std deviation                                        489 (OK=489    KO=-     )
> response time 50th percentile                        784 (OK=784    KO=-     )
> response time 75th percentile                       1003 (OK=1003   KO=-     )
> response time 95th percentile                       1830 (OK=1830   KO=-     )
> response time 99th percentile                       1964 (OK=1964   KO=-     )
> mean requests/sec                                3555.556 (OK=3555.556 KO=-     )

vertx version:4.5.7

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     37 (OK=37     KO=-     )
> max response time                                   1514 (OK=1514   KO=-     )
> mean response time                                   922 (OK=922    KO=-     )
> std deviation                                        352 (OK=352    KO=-     )
> response time 50th percentile                       1055 (OK=1055   KO=-     )
> response time 75th percentile                       1204 (OK=1204   KO=-     )
> response time 95th percentile                       1337 (OK=1337   KO=-     )
> response time 99th percentile                       1452 (OK=1452   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

kumuluz version:4.1.0 Server – Started Server@773e2eb5{STARTING}[10.0.9,sto=0] @2826ms

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     23 (OK=23     KO=-     )
> max response time                                   5774 (OK=5774   KO=-     )
> mean response time                                  1488 (OK=1488   KO=-     )
> std deviation                                       1038 (OK=1038   KO=-     )
> response time 50th percentile                       1180 (OK=1180   KO=-     )
> response time 75th percentile                       1446 (OK=1446   KO=-     )
> response time 95th percentile                       3954 (OK=3954   KO=-     )
> response time 99th percentile                       4597 (OK=4597   KO=-     )
> mean requests/sec                                2909.091 (OK=2909.091 KO=-     )

Helidon SE 4.0.6 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   2069 (OK=2069   KO=-     )
> mean response time                                   813 (OK=813    KO=-     )
> std deviation                                        397 (OK=397    KO=-     )
> response time 50th percentile                        733 (OK=734    KO=-     )
> response time 75th percentile                        963 (OK=962    KO=-     )
> response time 95th percentile                       1655 (OK=1654   KO=-     )
> response time 99th percentile                       1807 (OK=1808   KO=-     )
> mean requests/sec                                   4000 (OK=4000   KO=-     )

ktor:2.3.10

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   4958 (OK=4958   KO=-     )
> mean response time                                  2276 (OK=2276   KO=-     )
> std deviation                                       1386 (OK=1386   KO=-     )
> response time 50th percentile                       2226 (OK=2221   KO=-     )
> response time 75th percentile                       3074 (OK=3074   KO=-     )
> response time 95th percentile                       4654 (OK=4654   KO=-     )
> response time 99th percentile                       4836 (OK=4836   KO=-     )
> mean requests/sec                                2285.714 (OK=2285.714 KO=-     )

Rust rest services #

rustc 1.77.2 (25ef9e3d8 2024-04-09)

warp = 0.3.6

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    758 (OK=758    KO=-     )
> mean response time                                   205 (OK=205    KO=-     )
> std deviation                                        147 (OK=147    KO=-     )
> response time 50th percentile                        186 (OK=186    KO=-     )
> response time 75th percentile                        263 (OK=263    KO=-     )
> response time 95th percentile                        505 (OK=505    KO=-     )
> response time 99th percentile                        631 (OK=631    KO=-     )
> mean requests/sec                                   6400 (OK=6400   KO=-     )

actix-web = 4.4.0

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    922 (OK=922    KO=-     )
> mean response time                                   248 (OK=248    KO=-     )
> std deviation                                        174 (OK=174    KO=-     )
> response time 50th percentile                        217 (OK=217    KO=-     )
> response time 75th percentile                        311 (OK=311    KO=-     )
> response time 95th percentile                        569 (OK=569    KO=-     )
> response time 99th percentile                        855 (OK=855    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

rocket = { version = 0.5.0, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    800 (OK=800    KO=-     )
> mean response time                                   279 (OK=279    KO=-     )
> std deviation                                        164 (OK=164    KO=-     )
> response time 50th percentile                        249 (OK=249    KO=-     )
> response time 75th percentile                        335 (OK=335    KO=-     )
> response time 95th percentile                        636 (OK=636    KO=-     )
> response time 99th percentile                        712 (OK=712    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

axum = 0.7.1

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    657 (OK=657    KO=-     )
> mean response time                                   227 (OK=227    KO=-     )
> std deviation                                        154 (OK=154    KO=-     )
> response time 50th percentile                        211 (OK=211    KO=-     )
> response time 75th percentile                        287 (OK=287    KO=-     )
> response time 95th percentile                        569 (OK=569    KO=-     )
> response time 99th percentile                        610 (OK=610    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   1307 (OK=1307   KO=-     )
> mean response time                                   523 (OK=523    KO=-     )
> std deviation                                        287 (OK=287    KO=-     )
> response time 50th percentile                        467 (OK=467    KO=-     )
> response time 75th percentile                        633 (OK=633    KO=-     )
> response time 95th percentile                       1093 (OK=1093   KO=-     )
> response time 99th percentile                       1194 (OK=1194   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

Dotnet 7 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      5 (OK=5      KO=-     )
> max response time                                    962 (OK=962    KO=-     )
> mean response time                                   397 (OK=397    KO=-     )
> std deviation                                        210 (OK=210    KO=-     )
> response time 50th percentile                        353 (OK=352    KO=-     )
> response time 75th percentile                        471 (OK=471    KO=-     )
> response time 95th percentile                        829 (OK=829    KO=-     )
> response time 99th percentile                        889 (OK=889    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

Dotnet 8 rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     22 (OK=22     KO=-     )
> max response time                                   1420 (OK=1420   KO=-     )
> mean response time                                   550 (OK=550    KO=-     )
> std deviation                                        281 (OK=281    KO=-     )
> response time 50th percentile                        508 (OK=508    KO=-     )
> response time 75th percentile                        632 (OK=632    KO=-     )
> response time 95th percentile                       1120 (OK=1120   KO=-     )
> response time 99th percentile                       1231 (OK=1231   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   1172 (OK=1172   KO=-     )
> mean response time                                   475 (OK=475    KO=-     )
> std deviation                                        222 (OK=222    KO=-     )
> response time 50th percentile                        449 (OK=449    KO=-     )
> response time 75th percentile                        581 (OK=581    KO=-     )
> response time 95th percentile                        911 (OK=912    KO=-     )
> response time 99th percentile                       1030 (OK=1030   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   1190 (OK=1190   KO=-     )
> mean response time                                   369 (OK=369    KO=-     )
> std deviation                                        184 (OK=184    KO=-     )
> response time 50th percentile                        334 (OK=333    KO=-     )
> response time 75th percentile                        460 (OK=460    KO=-     )
> response time 95th percentile                        726 (OK=726    KO=-     )
> response time 99th percentile                        897 (OK=897    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      3 (OK=3      KO=-     )
> max response time                                   2100 (OK=2100   KO=-     )
> mean response time                                   494 (OK=494    KO=-     )
> std deviation                                        280 (OK=280    KO=-     )
> response time 50th percentile                        441 (OK=441    KO=-     )
> response time 75th percentile                        589 (OK=589    KO=-     )
> response time 95th percentile                       1001 (OK=1001   KO=-     )
> response time 99th percentile                       1390 (OK=1390   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     23 (OK=23     KO=-     )
> max response time                                   1676 (OK=1676   KO=-     )
> mean response time                                   490 (OK=490    KO=-     )
> std deviation                                        262 (OK=262    KO=-     )
> response time 50th percentile                        429 (OK=429    KO=-     )
> response time 75th percentile                        533 (OK=533    KO=-     )
> response time 95th percentile                       1044 (OK=1044   KO=-     )
> response time 99th percentile                       1309 (OK=1309   KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                     16 (OK=16     KO=-     )
> max response time                                    696 (OK=696    KO=-     )
> mean response time                                   396 (OK=396    KO=-     )
> std deviation                                        132 (OK=132    KO=-     )
> response time 50th percentile                        400 (OK=400    KO=-     )
> response time 75th percentile                        511 (OK=511    KO=-     )
> response time 95th percentile                        594 (OK=594    KO=-     )
> response time 99th percentile                        645 (OK=645    KO=-     )
> mean requests/sec                                4571.429 (OK=4571.429 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=32000  KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    932 (OK=932    KO=-     )
> mean response time                                   351 (OK=351    KO=-     )
> std deviation                                        172 (OK=172    KO=-     )
> response time 50th percentile                        331 (OK=331    KO=-     )
> response time 75th percentile                        443 (OK=443    KO=-     )
> response time 95th percentile                        703 (OK=704    KO=-     )
> response time 99th percentile                        775 (OK=775    KO=-     )
> mean requests/sec                                5333.333 (OK=5333.333 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                      32000 (OK=31924  KO=76    )
> min response time                                      6 (OK=6      KO=88    )
> max response time                                   2956 (OK=2956   KO=1951  )
> mean response time                                   813 (OK=813    KO=511   )
> std deviation                                        477 (OK=477    KO=325   )
> response time 50th percentile                        745 (OK=746    KO=481   )
> response time 75th percentile                       1084 (OK=1085   KO=705   )
> response time 95th percentile                       1784 (OK=1784   KO=993   )
> response time 99th percentile                       2249 (OK=2249   KO=1448  )
> mean requests/sec                                3555.556 (OK=3547.111 KO=8.444 )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: