Java microservice framework tests in SB:3.0.2 Q:2.16.3.Final M:3.8.5 V:4.3.8 H:3.1.2 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.67.1 (d5a82bbd2 2023-02-07)

In Linux fv-az563-44 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 17.452 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 23.599 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 24.208 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 22.744 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 30.148 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  5.131 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  5.128 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 16.219 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.2M helidon-se-netty/target/helidon-quickstart-se.jar
18M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
14M micronaut/target/micronaut-demo-0.1.jar
16M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.8M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.0.2) Started DemoWebFluxApplication in 1.988 seconds (process running for 2.511)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     23 (OK=23     KO=-     )
> max response time                                   3077 (OK=3077   KO=-     )
> mean response time                                  1305 (OK=1305   KO=-     )
> std deviation                                        697 (OK=697    KO=-     )
> response time 50th percentile                       1052 (OK=1052   KO=-     )
> response time 75th percentile                       1839 (OK=1839   KO=-     )
> response time 95th percentile                       2583 (OK=2583   KO=-     )
> response time 99th percentile                       2968 (OK=2968   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

:: Spring Boot :: (v3.0.2) Started DemoApplication in 2.209 seconds (process running for 2.654)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     48 (OK=48     KO=-     )
> max response time                                   4561 (OK=4561   KO=-     )
> mean response time                                  1388 (OK=1388   KO=-     )
> std deviation                                        835 (OK=835    KO=-     )
> response time 50th percentile                       1186 (OK=1186   KO=-     )
> response time 75th percentile                       2069 (OK=2069   KO=-     )
> response time 95th percentile                       2843 (OK=2843   KO=-     )
> response time 99th percentile                       3286 (OK=3286   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

powered by Quarkus 2.16.3.Final) started in 0.913s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     50 (OK=50     KO=-     )
> max response time                                   3147 (OK=3147   KO=-     )
> mean response time                                  1240 (OK=1240   KO=-     )
> std deviation                                        750 (OK=750    KO=-     )
> response time 50th percentile                       1052 (OK=1052   KO=-     )
> response time 75th percentile                       1798 (OK=1798   KO=-     )
> response time 95th percentile                       2649 (OK=2649   KO=-     )
> response time 99th percentile                       3017 (OK=3017   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

micronaut version:3.4.3 Startup completed in 970ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    104 (OK=104    KO=-     )
> max response time                                   2965 (OK=2965   KO=-     )
> mean response time                                  1150 (OK=1150   KO=-     )
> std deviation                                        633 (OK=633    KO=-     )
> response time 50th percentile                       1019 (OK=1019   KO=-     )
> response time 75th percentile                       1566 (OK=1566   KO=-     )
> response time 95th percentile                       2315 (OK=2315   KO=-     )
> response time 99th percentile                       2654 (OK=2654   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

vertx version:4.3.8

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     14 (OK=14     KO=-     )
> max response time                                   1565 (OK=1565   KO=-     )
> mean response time                                   547 (OK=547    KO=-     )
> std deviation                                        351 (OK=351    KO=-     )
> response time 50th percentile                        462 (OK=462    KO=-     )
> response time 75th percentile                        765 (OK=765    KO=-     )
> response time 95th percentile                       1194 (OK=1194   KO=-     )
> response time 99th percentile                       1474 (OK=1474   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

kumuluz version:4.1.0 Server – Started Server@7159139f{STARTING}[10.0.9,sto=0] @3557ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      8 (OK=8      KO=-     )
> max response time                                   6611 (OK=6611   KO=-     )
> mean response time                                  1695 (OK=1695   KO=-     )
> std deviation                                       1100 (OK=1100   KO=-     )
> response time 50th percentile                       1359 (OK=1359   KO=-     )
> response time 75th percentile                       2406 (OK=2406   KO=-     )
> response time 95th percentile                       3586 (OK=3586   KO=-     )
> response time 99th percentile                       5912 (OK=5912   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

Helidon SE 3.1.2 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     43 (OK=43     KO=-     )
> max response time                                   3228 (OK=3228   KO=-     )
> mean response time                                  1342 (OK=1342   KO=-     )
> std deviation                                        692 (OK=692    KO=-     )
> response time 50th percentile                       1380 (OK=1380   KO=-     )
> response time 75th percentile                       1831 (OK=1831   KO=-     )
> response time 95th percentile                       2518 (OK=2518   KO=-     )
> response time 99th percentile                       3108 (OK=3109   KO=-     )
> mean requests/sec                                   1000 (OK=1000   KO=-     )

ktor:2.2.3

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   4208 (OK=4208   KO=-     )
> mean response time                                  1748 (OK=1748   KO=-     )
> std deviation                                        921 (OK=921    KO=-     )
> response time 50th percentile                       1590 (OK=1590   KO=-     )
> response time 75th percentile                       2300 (OK=2300   KO=-     )
> response time 95th percentile                       3431 (OK=3431   KO=-     )
> response time 99th percentile                       4007 (OK=4007   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

Rust rest services #

rustc 1.67.1 (d5a82bbd2 2023-02-07)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    642 (OK=642    KO=-     )
> mean response time                                   144 (OK=144    KO=-     )
> std deviation                                        172 (OK=172    KO=-     )
> response time 50th percentile                         72 (OK=72     KO=-     )
> response time 75th percentile                        237 (OK=237    KO=-     )
> response time 95th percentile                        508 (OK=508    KO=-     )
> response time 99th percentile                        593 (OK=593    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    664 (OK=664    KO=-     )
> mean response time                                   188 (OK=188    KO=-     )
> std deviation                                        194 (OK=194    KO=-     )
> response time 50th percentile                        149 (OK=149    KO=-     )
> response time 75th percentile                        297 (OK=297    KO=-     )
> response time 95th percentile                        556 (OK=556    KO=-     )
> response time 99th percentile                        646 (OK=646    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    665 (OK=665    KO=-     )
> mean response time                                   261 (OK=261    KO=-     )
> std deviation                                        204 (OK=204    KO=-     )
> response time 50th percentile                        241 (OK=241    KO=-     )
> response time 75th percentile                        452 (OK=452    KO=-     )
> response time 95th percentile                        588 (OK=588    KO=-     )
> response time 99th percentile                        642 (OK=642    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    542 (OK=542    KO=-     )
> mean response time                                   175 (OK=175    KO=-     )
> std deviation                                        170 (OK=170    KO=-     )
> response time 50th percentile                        151 (OK=151    KO=-     )
> response time 75th percentile                        289 (OK=289    KO=-     )
> response time 95th percentile                        485 (OK=485    KO=-     )
> response time 99th percentile                        533 (OK=533    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      2 (OK=2      KO=-     )
> max response time                                   1200 (OK=1200   KO=-     )
> mean response time                                   476 (OK=476    KO=-     )
> std deviation                                        309 (OK=309    KO=-     )
> response time 50th percentile                        405 (OK=406    KO=-     )
> response time 75th percentile                        740 (OK=740    KO=-     )
> response time 95th percentile                       1081 (OK=1081   KO=-     )
> response time 99th percentile                       1146 (OK=1146   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    992 (OK=992    KO=-     )
> mean response time                                   282 (OK=282    KO=-     )
> std deviation                                        243 (OK=243    KO=-     )
> response time 50th percentile                        229 (OK=229    KO=-     )
> response time 75th percentile                        419 (OK=419    KO=-     )
> response time 95th percentile                        818 (OK=818    KO=-     )
> response time 99th percentile                        973 (OK=973    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   1167 (OK=1167   KO=-     )
> mean response time                                   479 (OK=479    KO=-     )
> std deviation                                        271 (OK=271    KO=-     )
> response time 50th percentile                        409 (OK=409    KO=-     )
> response time 75th percentile                        751 (OK=751    KO=-     )
> response time 95th percentile                        901 (OK=901    KO=-     )
> response time 99th percentile                       1041 (OK=1041   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   1852 (OK=1852   KO=-     )
> mean response time                                   455 (OK=455    KO=-     )
> std deviation                                        260 (OK=260    KO=-     )
> response time 50th percentile                        402 (OK=402    KO=-     )
> response time 75th percentile                        649 (OK=649    KO=-     )
> response time 95th percentile                        930 (OK=930    KO=-     )
> response time 99th percentile                       1029 (OK=1029   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    771 (OK=771    KO=-     )
> mean response time                                   300 (OK=300    KO=-     )
> std deviation                                        219 (OK=219    KO=-     )
> response time 50th percentile                        281 (OK=281    KO=-     )
> response time 75th percentile                        453 (OK=453    KO=-     )
> response time 95th percentile                        695 (OK=695    KO=-     )
> response time 99th percentile                        736 (OK=736    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    620 (OK=620    KO=-     )
> mean response time                                   202 (OK=202    KO=-     )
> std deviation                                        191 (OK=191    KO=-     )
> response time 50th percentile                        178 (OK=178    KO=-     )
> response time 75th percentile                        341 (OK=341    KO=-     )
> response time 95th percentile                        553 (OK=553    KO=-     )
> response time 99th percentile                        610 (OK=610    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    789 (OK=789    KO=-     )
> mean response time                                   296 (OK=296    KO=-     )
> std deviation                                        213 (OK=213    KO=-     )
> response time 50th percentile                        257 (OK=257    KO=-     )
> response time 75th percentile                        472 (OK=472    KO=-     )
> response time 95th percentile                        658 (OK=658    KO=-     )
> response time 99th percentile                        728 (OK=728    KO=-     )
> mean requests/sec                                   1600 (OK=1600   KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7838   KO=162   )
> min response time                                     21 (OK=21     KO=112   )
> max response time                                   2140 (OK=2140   KO=2083  )
> mean response time                                   664 (OK=659    KO=918   )
> std deviation                                        356 (OK=352    KO=454   )
> response time 50th percentile                        585 (OK=583    KO=980   )
> response time 75th percentile                        926 (OK=920    KO=1190  )
> response time 95th percentile                       1231 (OK=1209   KO=1729  )
> response time 99th percentile                       1714 (OK=1694   KO=1980  )
> mean requests/sec                                1333.333 (OK=1306.333 KO=27    )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: