Java microservice framework tests in SB:2.6.7 Q:2.9.0.Final M:3.4.3 V:4.2.7 H:2.5.0 Dotnet:6 openjdk version "11.0.15" 2022-04-19 LTS rustc 1.60.0 (7737e0b5c 2022-04-04)

Here is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 23.438 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 34.356 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 33.693 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 51.042 s]
[INFO] springboot-demo 0.0.1-SNAPSHOT ..................... SUCCESS [ 53.046 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 53.060 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 21.058 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.6M helidon-se-netty/target/helidon-quickstart-se.jar
11K helidon-se-netty/target/original-helidon-quickstart-se.jar
14M micronaut/target/micronaut-demo-0.1.jar
11K micronaut/target/original-micronaut-demo-0.1.jar
15M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
19M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
22M spring-boot-webflux/target/springboot-demo-0.0.1-SNAPSHOT.jar
7.5M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar
6.8K vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar

:: Spring Boot :: (v0.0.1-SNAPSHOT) Started DemoWebFluxApplication in 2.416 seconds (JVM running for 2.947)

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    587 (OK=587    KO=-     )
> mean response time                                   171 (OK=171    KO=-     )
> std deviation                                        146 (OK=146    KO=-     )
> response time 50th percentile                        164 (OK=164    KO=-     )
> response time 75th percentile                        285 (OK=285    KO=-     )
> response time 95th percentile                        424 (OK=424    KO=-     )
> response time 99th percentile                        477 (OK=477    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

:: Spring Boot :: (v0.0.1-SNAPSHOT) Started DemoApplication in 2.208 seconds (JVM running for 2.733)

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    755 (OK=755    KO=-     )
> mean response time                                   202 (OK=202    KO=-     )
> std deviation                                        167 (OK=167    KO=-     )
> response time 50th percentile                        186 (OK=187    KO=-     )
> response time 75th percentile                        333 (OK=333    KO=-     )
> response time 95th percentile                        488 (OK=488    KO=-     )
> response time 99th percentile                        606 (OK=606    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

powered by Quarkus 2.9.0.Final) started in 1.162s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    554 (OK=554    KO=-     )
> mean response time                                   143 (OK=143    KO=-     )
> std deviation                                        133 (OK=133    KO=-     )
> response time 50th percentile                        124 (OK=124    KO=-     )
> response time 75th percentile                        243 (OK=243    KO=-     )
> response time 95th percentile                        387 (OK=387    KO=-     )
> response time 99th percentile                        474 (OK=474    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

micronaut version:3.4.3 Startup completed in 1097ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    539 (OK=539    KO=-     )
> mean response time                                   143 (OK=143    KO=-     )
> std deviation                                        136 (OK=136    KO=-     )
> response time 50th percentile                        131 (OK=131    KO=-     )
> response time 75th percentile                        234 (OK=234    KO=-     )
> response time 95th percentile                        386 (OK=386    KO=-     )
> response time 99th percentile                        425 (OK=425    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

vertx version:4.2.7

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    285 (OK=285    KO=-     )
> mean response time                                    39 (OK=39     KO=-     )
> std deviation                                         69 (OK=69     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                         50 (OK=50     KO=-     )
> response time 95th percentile                        209 (OK=209    KO=-     )
> response time 99th percentile                        247 (OK=247    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

kumuluz version:3.12.2 Server – Started @4133ms

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1074 (OK=1074   KO=-     )
> mean response time                                   330 (OK=330    KO=-     )
> std deviation                                        230 (OK=230    KO=-     )
> response time 50th percentile                        285 (OK=285    KO=-     )
> response time 75th percentile                        492 (OK=492    KO=-     )
> response time 95th percentile                        757 (OK=757    KO=-     )
> response time 99th percentile                        907 (OK=907    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

Helidon SE 2.5.0 features: [Config, Health, Metrics, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                   1222 (OK=1222   KO=-     )
> mean response time                                   354 (OK=354    KO=-     )
> std deviation                                        302 (OK=302    KO=-     )
> response time 50th percentile                        281 (OK=281    KO=-     )
> response time 75th percentile                        546 (OK=546    KO=-     )
> response time 95th percentile                        917 (OK=917    KO=-     )
> response time 99th percentile                       1135 (OK=1135   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

Rust rest services #

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    230 (OK=230    KO=-     )
> mean response time                                    18 (OK=18     KO=-     )
> std deviation                                         40 (OK=40     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          6 (OK=6      KO=-     )
> response time 95th percentile                        119 (OK=119    KO=-     )
> response time 99th percentile                        173 (OK=173    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    185 (OK=185    KO=-     )
> mean response time                                    15 (OK=15     KO=-     )
> std deviation                                         33 (OK=33     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          2 (OK=2      KO=-     )
> response time 95th percentile                        107 (OK=107    KO=-     )
> response time 99th percentile                        133 (OK=133    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    405 (OK=405    KO=-     )
> mean response time                                    44 (OK=44     KO=-     )
> std deviation                                         73 (OK=73     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                         63 (OK=63     KO=-     )
> response time 95th percentile                        213 (OK=213    KO=-     )
> response time 99th percentile                        282 (OK=282    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native quarkus rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    217 (OK=217    KO=-     )
> mean response time                                    13 (OK=13     KO=-     )
> std deviation                                         33 (OK=33     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          1 (OK=1      KO=-     )
> response time 95th percentile                         98 (OK=98     KO=-     )
> response time 99th percentile                        155 (OK=155    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native micronaut rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    246 (OK=246    KO=-     )
> mean response time                                    14 (OK=14     KO=-     )
> std deviation                                         33 (OK=33     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          1 (OK=1      KO=-     )
> response time 95th percentile                        101 (OK=101    KO=-     )
> response time 99th percentile                        148 (OK=148    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native spring-boot-web rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    179 (OK=179    KO=-     )
> mean response time                                    14 (OK=14     KO=-     )
> std deviation                                         33 (OK=33     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          2 (OK=2      KO=-     )
> response time 95th percentile                         97 (OK=97     KO=-     )
> response time 99th percentile                        153 (OK=153    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

graalvm native spring-boot-webflux rest service #

---- Global Information --------------------------------------------------------
> request count                                       4000 (OK=4000   KO=0     )
> min response time                                      0 (OK=0      KO=-     )
> max response time                                    186 (OK=186    KO=-     )
> mean response time                                    10 (OK=10     KO=-     )
> std deviation                                         26 (OK=26     KO=-     )
> response time 50th percentile                          1 (OK=1      KO=-     )
> response time 75th percentile                          1 (OK=1      KO=-     )
> response time 95th percentile                         81 (OK=81     KO=-     )
> response time 99th percentile                        119 (OK=119    KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: