Java microservice framework tests in SB:3.0.5 Q:2.16.6.Final M:3.8.8 V:4.4.1 H:3.2.0 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.68.1 (8460ca823 2023-03-20)

In Linux fv-az341-193 5.15.0-1034-azure #41-Ubuntu SMP Fri Feb 10 19:59:45 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,

[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 21.915 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 29.000 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 29.042 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 27.912 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 36.572 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [  6.391 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [  6.388 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 18.775 s]

Size of created packages:

Size in MB Name
22M eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar
7.2M helidon-se-netty/target/helidon-quickstart-se.jar
18M ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar
15M micronaut/target/micronaut-demo-0.1.jar
16M quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar
20M spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar
23M spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar
7.8M vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar

:: Spring Boot :: (v3.0.5) Started DemoWebFluxApplication in 2.512 seconds (process running for 3.141)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     45 (OK=45     KO=-     )
> max response time                                   4247 (OK=4247   KO=-     )
> mean response time                                  1927 (OK=1927   KO=-     )
> std deviation                                       1039 (OK=1039   KO=-     )
> response time 50th percentile                       1462 (OK=1462   KO=-     )
> response time 75th percentile                       3077 (OK=3077   KO=-     )
> response time 95th percentile                       3680 (OK=3680   KO=-     )
> response time 99th percentile                       3881 (OK=3881   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

:: Spring Boot :: (v3.0.5) Started DemoApplication in 2.697 seconds (process running for 3.272)

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     61 (OK=61     KO=-     )
> max response time                                   4697 (OK=4697   KO=-     )
> mean response time                                  1873 (OK=1873   KO=-     )
> std deviation                                       1234 (OK=1234   KO=-     )
> response time 50th percentile                       1229 (OK=1229   KO=-     )
> response time 75th percentile                       3168 (OK=3168   KO=-     )
> response time 95th percentile                       3910 (OK=3910   KO=-     )
> response time 99th percentile                       4125 (OK=4125   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

powered by Quarkus 2.16.6.Final) started in 1.229s. Listening on: http://0.0.0.0:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     24 (OK=24     KO=-     )
> max response time                                   4204 (OK=4204   KO=-     )
> mean response time                                  1763 (OK=1763   KO=-     )
> std deviation                                       1064 (OK=1064   KO=-     )
> response time 50th percentile                       1286 (OK=1286   KO=-     )
> response time 75th percentile                       2771 (OK=2771   KO=-     )
> response time 95th percentile                       3487 (OK=3487   KO=-     )
> response time 99th percentile                       3778 (OK=3778   KO=-     )
> mean requests/sec                                888.889 (OK=888.889 KO=-     )

micronaut version:3.8.8 Startup completed in 1155ms. Server Running: http://localhost:8080

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    219 (OK=219    KO=-     )
> max response time                                   3955 (OK=3955   KO=-     )
> mean response time                                  1780 (OK=1780   KO=-     )
> std deviation                                       1224 (OK=1224   KO=-     )
> response time 50th percentile                       1038 (OK=1038   KO=-     )
> response time 75th percentile                       3088 (OK=3088   KO=-     )
> response time 95th percentile                       3614 (OK=3614   KO=-     )
> response time 99th percentile                       3856 (OK=3856   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

vertx version:4.4.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     70 (OK=70     KO=-     )
> max response time                                   2920 (OK=2920   KO=-     )
> mean response time                                  1164 (OK=1164   KO=-     )
> std deviation                                        742 (OK=742    KO=-     )
> response time 50th percentile                        967 (OK=967    KO=-     )
> response time 75th percentile                       1827 (OK=1827   KO=-     )
> response time 95th percentile                       2418 (OK=2418   KO=-     )
> response time 99th percentile                       2696 (OK=2696   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

kumuluz version:4.1.0 Server – Started Server@58294867{STARTING}[10.0.9,sto=0] @4449ms

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     85 (OK=85     KO=-     )
> max response time                                   5130 (OK=5130   KO=-     )
> mean response time                                  2115 (OK=2115   KO=-     )
> std deviation                                       1426 (OK=1426   KO=-     )
> response time 50th percentile                       1331 (OK=1331   KO=-     )
> response time 75th percentile                       3430 (OK=3430   KO=-     )
> response time 95th percentile                       4465 (OK=4465   KO=-     )
> response time 99th percentile                       4695 (OK=4695   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

Helidon SE 3.2.0 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                    112 (OK=112    KO=-     )
> max response time                                   4537 (OK=4537   KO=-     )
> mean response time                                  1988 (OK=1988   KO=-     )
> std deviation                                       1123 (OK=1123   KO=-     )
> response time 50th percentile                       1876 (OK=1876   KO=-     )
> response time 75th percentile                       3030 (OK=3030   KO=-     )
> response time 95th percentile                       3659 (OK=3659   KO=-     )
> response time 99th percentile                       4200 (OK=4200   KO=-     )
> mean requests/sec                                    800 (OK=800    KO=-     )

ktor:2.2.4

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   4790 (OK=4790   KO=-     )
> mean response time                                  2271 (OK=2271   KO=-     )
> std deviation                                       1116 (OK=1116   KO=-     )
> response time 50th percentile                       2103 (OK=2103   KO=-     )
> response time 75th percentile                       3421 (OK=3421   KO=-     )
> response time 95th percentile                       4002 (OK=4002   KO=-     )
> response time 99th percentile                       4250 (OK=4250   KO=-     )
> mean requests/sec                                727.273 (OK=727.273 KO=-     )

Rust rest services #

rustc 1.68.1 (8460ca823 2023-03-20)

warp = 0.3.2

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      6 (OK=6      KO=-     )
> max response time                                   1223 (OK=1223   KO=-     )
> mean response time                                   577 (OK=577    KO=-     )
> std deviation                                        341 (OK=341    KO=-     )
> response time 50th percentile                        505 (OK=505    KO=-     )
> response time 75th percentile                        900 (OK=900    KO=-     )
> response time 95th percentile                       1119 (OK=1119   KO=-     )
> response time 99th percentile                       1182 (OK=1182   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

actix-web = 4.0.1

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   1425 (OK=1425   KO=-     )
> mean response time                                   534 (OK=534    KO=-     )
> std deviation                                        316 (OK=316    KO=-     )
> response time 50th percentile                        458 (OK=458    KO=-     )
> response time 75th percentile                        831 (OK=831    KO=-     )
> response time 95th percentile                       1039 (OK=1039   KO=-     )
> response time 99th percentile                       1101 (OK=1101   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

rocket = { version = 0.5.0-rc.2, features = [json] }

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     20 (OK=20     KO=-     )
> max response time                                   1252 (OK=1252   KO=-     )
> mean response time                                   604 (OK=604    KO=-     )
> std deviation                                        353 (OK=353    KO=-     )
> response time 50th percentile                        525 (OK=525    KO=-     )
> response time 75th percentile                        880 (OK=880    KO=-     )
> response time 95th percentile                       1180 (OK=1180   KO=-     )
> response time 99th percentile                       1243 (OK=1243   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

axum = 0.6.0

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   1107 (OK=1107   KO=-     )
> mean response time                                   573 (OK=573    KO=-     )
> std deviation                                        316 (OK=316    KO=-     )
> response time 50th percentile                        482 (OK=482    KO=-     )
> response time 75th percentile                        889 (OK=889    KO=-     )
> response time 95th percentile                       1061 (OK=1061   KO=-     )
> response time 99th percentile                       1085 (OK=1085   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

Dotnet 6 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      9 (OK=9      KO=-     )
> max response time                                   2494 (OK=2494   KO=-     )
> mean response time                                   999 (OK=999    KO=-     )
> std deviation                                        605 (OK=605    KO=-     )
> response time 50th percentile                        829 (OK=829    KO=-     )
> response time 75th percentile                       1428 (OK=1428   KO=-     )
> response time 95th percentile                       2134 (OK=2134   KO=-     )
> response time 99th percentile                       2319 (OK=2319   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

Dotnet 7 rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      8 (OK=8      KO=-     )
> max response time                                   1496 (OK=1496   KO=-     )
> mean response time                                   729 (OK=729    KO=-     )
> std deviation                                        411 (OK=411    KO=-     )
> response time 50th percentile                        666 (OK=666    KO=-     )
> response time 75th percentile                       1155 (OK=1155   KO=-     )
> response time 95th percentile                       1396 (OK=1396   KO=-     )
> response time 99th percentile                       1464 (OK=1464   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native quarkus #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     43 (OK=43     KO=-     )
> max response time                                   2232 (OK=2232   KO=-     )
> mean response time                                   817 (OK=817    KO=-     )
> std deviation                                        479 (OK=479    KO=-     )
> response time 50th percentile                        696 (OK=696    KO=-     )
> response time 75th percentile                       1227 (OK=1227   KO=-     )
> response time 95th percentile                       1584 (OK=1584   KO=-     )
> response time 99th percentile                       1909 (OK=1909   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native micronaut #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     30 (OK=30     KO=-     )
> max response time                                   2284 (OK=2284   KO=-     )
> mean response time                                   853 (OK=853    KO=-     )
> std deviation                                        503 (OK=503    KO=-     )
> response time 50th percentile                        759 (OK=759    KO=-     )
> response time 75th percentile                       1171 (OK=1171   KO=-     )
> response time 95th percentile                       1842 (OK=1842   KO=-     )
> response time 99th percentile                       2100 (OK=2100   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native spring-boot-web #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     14 (OK=14     KO=-     )
> max response time                                   2653 (OK=2653   KO=-     )
> mean response time                                   953 (OK=953    KO=-     )
> std deviation                                        586 (OK=586    KO=-     )
> response time 50th percentile                        739 (OK=739    KO=-     )
> response time 75th percentile                       1403 (OK=1403   KO=-     )
> response time 95th percentile                       2142 (OK=2142   KO=-     )
> response time 99th percentile                       2278 (OK=2278   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native spring-boot-webflux #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      9 (OK=9      KO=-     )
> max response time                                   2199 (OK=2199   KO=-     )
> mean response time                                   848 (OK=848    KO=-     )
> std deviation                                        444 (OK=444    KO=-     )
> response time 50th percentile                        759 (OK=759    KO=-     )
> response time 75th percentile                       1232 (OK=1232   KO=-     )
> response time 95th percentile                       1540 (OK=1540   KO=-     )
> response time 99th percentile                       1981 (OK=1981   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native vertx #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                      1 (OK=1      KO=-     )
> max response time                                   1096 (OK=1096   KO=-     )
> mean response time                                   442 (OK=442    KO=-     )
> std deviation                                        275 (OK=275    KO=-     )
> response time 50th percentile                        359 (OK=359    KO=-     )
> response time 75th percentile                        666 (OK=666    KO=-     )
> response time 95th percentile                        956 (OK=956    KO=-     )
> response time 99th percentile                       1073 (OK=1073   KO=-     )
> mean requests/sec                                1333.333 (OK=1333.333 KO=-     )

graalvm native helidon #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=8000   KO=0     )
> min response time                                     28 (OK=28     KO=-     )
> max response time                                   1947 (OK=1947   KO=-     )
> mean response time                                   811 (OK=811    KO=-     )
> std deviation                                        450 (OK=450    KO=-     )
> response time 50th percentile                        733 (OK=733    KO=-     )
> response time 75th percentile                       1119 (OK=1119   KO=-     )
> response time 95th percentile                       1674 (OK=1674   KO=-     )
> response time 99th percentile                       1863 (OK=1863   KO=-     )
> mean requests/sec                                1142.857 (OK=1142.857 KO=-     )

graalvm native ktor rest service #

---- Global Information --------------------------------------------------------
> request count                                       8000 (OK=7907   KO=93    )
> min response time                                     40 (OK=40     KO=280   )
> max response time                                   4157 (OK=4157   KO=2804  )
> mean response time                                  1132 (OK=1128   KO=1426  )
> std deviation                                        643 (OK=641    KO=784   )
> response time 50th percentile                        982 (OK=982    KO=1661  )
> response time 75th percentile                       1682 (OK=1678   KO=2076  )
> response time 95th percentile                       2174 (OK=2168   KO=2532  )
> response time 99th percentile                       2552 (OK=2549   KO=2767  )
> mean requests/sec                                   1000 (OK=988.375 KO=11.625)

source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: