Java microservice framework tests in SB:2.6.7 Q:2.9.0.Final M:3.4.3 V:4.3.0 H:2.5.0 Dotnet:6 openjdk version "11.0.15" 2022-04-19 rustc 1.60.0 (7737e0b5c 2022-04-04)

In Linux fv-az173-358 5.13.0-1022-azure #26~20.04.1-Ubuntu SMP Thu Apr 7 19:42:45 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux, Here is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 24.195 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 35.822 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 35.145 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 52.242 s]
[INFO] springboot-demo 0.0.1-SNAPSHOT ..................... SUCCESS [ 55.483 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 55.474 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 22.471 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.6M helidon-se-netty/target/helidon-quickstart-se.jar
11K helidon-se-netty/target/original-helidon-quickstart-se.jar
14M micronaut/target/micronaut-demo-0.1.jar
11K micronaut/target/original-micronaut-demo-0.1.jar
15M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
19M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
22M spring-boot-webflux/target/springboot-demo-0.0.1-SNAPSHOT.jar
7.5M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar
6.8K vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar

:: Spring Boot :: (v0.0.1-SNAPSHOT) Started DemoWebFluxApplication in 2.202 seconds (JVM running for 2.721)

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    704 (OK=704    KO=-     )
> mean response time                                   195 (OK=195    KO=-     )
> std deviation                                        165 (OK=165    KO=-     )
> response time 50th percentile                        186 (OK=186    KO=-     )
> response time 75th percentile                        304 (OK=304    KO=-     )
> response time 95th percentile                        494 (OK=494    KO=-     )
> response time 99th percentile                        549 (OK=549    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

:: Spring Boot :: (v0.0.1-SNAPSHOT) Started DemoApplication in 2.379 seconds (JVM running for 2.816)

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    710 (OK=710    KO=-     )
> mean response time                                   282 (OK=282    KO=-     )
> std deviation                                        199 (OK=199    KO=-     )
> response time 50th percentile                        252 (OK=252    KO=-     )
> response time 75th percentile                        464 (OK=464    KO=-     )
> response time 95th percentile                        617 (OK=617    KO=-     )
> response time 99th percentile                        668 (OK=668    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

powered by Quarkus 2.9.0.Final) started in 1.140s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    838 (OK=838    KO=-     )
> mean response time                                   283 (OK=283    KO=-     )
> std deviation                                        231 (OK=231    KO=-     )
> response time 50th percentile                        250 (OK=251    KO=-     )
> response time 75th percentile                        465 (OK=465    KO=-     )
> response time 95th percentile                        728 (OK=728    KO=-     )
> response time 99th percentile                        794 (OK=794    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

micronaut version:3.4.3 Startup completed in 1086ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    617 (OK=617    KO=-     )
> mean response time                                   195 (OK=195    KO=-     )
> std deviation                                        169 (OK=169    KO=-     )
> response time 50th percentile                        187 (OK=187    KO=-     )
> response time 75th percentile                        328 (OK=328    KO=-     )
> response time 95th percentile                        475 (OK=475    KO=-     )
> response time 99th percentile                        576 (OK=576    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

vertx version:4.3.0

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    399 (OK=399    KO=-     )
> mean response time                                    64 (OK=64     KO=-     )
> std deviation                                         98 (OK=98     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                        100 (OK=100    KO=-     )
> response time 95th percentile                        293 (OK=293    KO=-     )
> response time 99th percentile                        348 (OK=348    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

kumuluz version:3.12.2 Server – Started @4646ms

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      4 (OK=4      KO=-     )
> max response time                                   1803 (OK=1803   KO=-     )
> mean response time                                   420 (OK=420    KO=-     )
> std deviation                                        226 (OK=226    KO=-     )
> response time 50th percentile                        372 (OK=372    KO=-     )
> response time 75th percentile                        608 (OK=608    KO=-     )
> response time 95th percentile                        802 (OK=802    KO=-     )
> response time 99th percentile                        855 (OK=855    KO=-     )
> mean requests/sec                                666.667 (OK=666.667 KO=-     )

Helidon SE 2.5.0 features: [Config, Health, Metrics, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1206 (OK=1206   KO=-     )
> mean response time                                   468 (OK=468    KO=-     )
> std deviation                                        329 (OK=329    KO=-     )
> response time 50th percentile                        386 (OK=386    KO=-     )
> response time 75th percentile                        776 (OK=776    KO=-     )
> response time 95th percentile                       1063 (OK=1063   KO=-     )
> response time 99th percentile                       1161 (OK=1161   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

Rust rest services #

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    184 (OK=184    KO=-     )
> mean response time                                    12 (OK=12     KO=-     )
> std deviation                                         29 (OK=29     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          2 (OK=2      KO=-     )
> response time 95th percentile                         88 (OK=88     KO=-     )
> response time 99th percentile                        137 (OK=137    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    185 (OK=185    KO=-     )
> mean response time                                    16 (OK=16     KO=-     )
> std deviation                                         36 (OK=36     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          3 (OK=3      KO=-     )
> response time 95th percentile                        102 (OK=102    KO=-     )
> response time 99th percentile                        163 (OK=163    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    409 (OK=409    KO=-     )
> mean response time                                    52 (OK=52     KO=-     )
> std deviation                                         88 (OK=88     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                         75 (OK=75     KO=-     )
> response time 95th percentile                        268 (OK=268    KO=-     )
> response time 99th percentile                        351 (OK=351    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native quarkus rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    216 (OK=216    KO=-     )
> mean response time                                    19 (OK=19     KO=-     )
> std deviation                                         42 (OK=42     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          6 (OK=6      KO=-     )
> response time 95th percentile                        118 (OK=118    KO=-     )
> response time 99th percentile                        189 (OK=189    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native micronaut rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    207 (OK=207    KO=-     )
> mean response time                                    14 (OK=14     KO=-     )
> std deviation                                         32 (OK=32     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          2 (OK=2      KO=-     )
> response time 95th percentile                        100 (OK=100    KO=-     )
> response time 99th percentile                        147 (OK=147    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native spring-boot-web rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    337 (OK=337    KO=-     )
> mean response time                                    18 (OK=18     KO=-     )
> std deviation                                         40 (OK=40     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          5 (OK=5      KO=-     )
> response time 95th percentile                        114 (OK=114    KO=-     )
> response time 99th percentile                        171 (OK=171    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native spring-boot-webflux rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    189 (OK=189    KO=-     )
> mean response time                                    12 (OK=12     KO=-     )
> std deviation                                         28 (OK=28     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          3 (OK=3      KO=-     )
> response time 95th percentile                         87 (OK=87     KO=-     )
> response time 99th percentile                        121 (OK=121    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: