Java microservice framework tests in SB:3.1.0 Q:3.0.3.Final M:3.9.1 V:4.4.2 H:3.2.1 Dotnet:6 openjdk version "17.0.7" 2023-04-18 rustc 1.69.0 (84c898d65 2023-04-16)
In Linux fv-az993-662 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 19.752 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 25.995 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 25.537 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 25.399 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 33.247 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 4.609 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 4.593 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 15.540 s]Size of created packages:
| Size in MB | Name |
|---|---|
| 22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
| 7.3M | helidon-se-netty/target/helidon-quickstart-se.jar |
| 11K | helidon-se-netty/target/original-helidon-quickstart-se.jar |
| 19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
| 16K | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar |
| 15M | micronaut/target/micronaut-demo-0.1.jar |
| 13K | micronaut/target/original-micronaut-demo-0.1.jar |
| 17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
| 20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
| 23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
| 7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
| 8.8K | vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar |
:: Spring Boot :: (v3.1.0) Started DemoWebFluxApplication in 2.361 seconds (process running for 2.847)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 58 (OK=58 KO=- )
> max response time 2549 (OK=2549 KO=- )
> mean response time 1133 (OK=1133 KO=- )
> std deviation 596 (OK=596 KO=- )
> response time 50th percentile 985 (OK=985 KO=- )
> response time 75th percentile 1709 (OK=1709 KO=- )
> response time 95th percentile 2073 (OK=2072 KO=- )
> response time 99th percentile 2303 (OK=2303 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- ):: Spring Boot :: (v3.1.0) Started DemoApplication in 2.352 seconds (process running for 2.832)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 62 (OK=62 KO=- )
> max response time 3302 (OK=3302 KO=- )
> mean response time 1126 (OK=1126 KO=- )
> std deviation 669 (OK=669 KO=- )
> response time 50th percentile 950 (OK=950 KO=- )
> response time 75th percentile 1796 (OK=1796 KO=- )
> response time 95th percentile 2135 (OK=2135 KO=- )
> response time 99th percentile 2772 (OK=2772 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )powered by Quarkus 3.0.3.Final) started in 0.989s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 31 (OK=31 KO=- )
> max response time 3519 (OK=3519 KO=- )
> mean response time 1308 (OK=1308 KO=- )
> std deviation 815 (OK=815 KO=- )
> response time 50th percentile 1213 (OK=1214 KO=- )
> response time 75th percentile 1973 (OK=1970 KO=- )
> response time 95th percentile 2675 (OK=2675 KO=- )
> response time 99th percentile 3348 (OK=3347 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )micronaut version:3.9.1 Startup completed in 958ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 51 (OK=51 KO=- )
> max response time 2391 (OK=2391 KO=- )
> mean response time 1103 (OK=1103 KO=- )
> std deviation 544 (OK=544 KO=- )
> response time 50th percentile 1030 (OK=1030 KO=- )
> response time 75th percentile 1559 (OK=1559 KO=- )
> response time 95th percentile 2043 (OK=2043 KO=- )
> response time 99th percentile 2299 (OK=2299 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1048 (OK=1048 KO=- )
> mean response time 353 (OK=353 KO=- )
> std deviation 297 (OK=297 KO=- )
> response time 50th percentile 257 (OK=257 KO=- )
> response time 75th percentile 573 (OK=573 KO=- )
> response time 95th percentile 905 (OK=905 KO=- )
> response time 99th percentile 1000 (OK=1000 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )kumuluz version:4.1.0 Server – Started Server@3b0ee03a{STARTING}[10.0.9,sto=0] @3573ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 55 (OK=55 KO=- )
> max response time 3734 (OK=3734 KO=- )
> mean response time 1433 (OK=1433 KO=- )
> std deviation 830 (OK=830 KO=- )
> response time 50th percentile 1320 (OK=1321 KO=- )
> response time 75th percentile 1881 (OK=1881 KO=- )
> response time 95th percentile 3048 (OK=3048 KO=- )
> response time 99th percentile 3349 (OK=3349 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )Helidon SE 3.2.1 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 44 (OK=44 KO=- )
> max response time 2952 (OK=2952 KO=- )
> mean response time 1468 (OK=1468 KO=- )
> std deviation 623 (OK=623 KO=- )
> response time 50th percentile 1287 (OK=1287 KO=- )
> response time 75th percentile 1964 (OK=1964 KO=- )
> response time 95th percentile 2606 (OK=2606 KO=- )
> response time 99th percentile 2843 (OK=2843 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 3758 (OK=3758 KO=- )
> mean response time 1949 (OK=1949 KO=- )
> std deviation 1034 (OK=1034 KO=- )
> response time 50th percentile 1917 (OK=1917 KO=- )
> response time 75th percentile 2966 (OK=2966 KO=- )
> response time 95th percentile 3376 (OK=3376 KO=- )
> response time 99th percentile 3551 (OK=3551 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )Rust rest services #
rustc 1.69.0 (84c898d65 2023-04-16)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 398 (OK=398 KO=- )
> mean response time 97 (OK=97 KO=- )
> std deviation 117 (OK=117 KO=- )
> response time 50th percentile 45 (OK=45 KO=- )
> response time 75th percentile 154 (OK=154 KO=- )
> response time 95th percentile 339 (OK=339 KO=- )
> response time 99th percentile 370 (OK=370 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 394 (OK=394 KO=- )
> mean response time 95 (OK=95 KO=- )
> std deviation 114 (OK=114 KO=- )
> response time 50th percentile 47 (OK=47 KO=- )
> response time 75th percentile 154 (OK=154 KO=- )
> response time 95th percentile 334 (OK=334 KO=- )
> response time 99th percentile 375 (OK=375 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 465 (OK=465 KO=- )
> mean response time 65 (OK=65 KO=- )
> std deviation 110 (OK=110 KO=- )
> response time 50th percentile 1 (OK=1 KO=- )
> response time 75th percentile 93 (OK=93 KO=- )
> response time 95th percentile 342 (OK=342 KO=- )
> response time 99th percentile 443 (OK=443 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 514 (OK=514 KO=- )
> mean response time 129 (OK=129 KO=- )
> std deviation 150 (OK=150 KO=- )
> response time 50th percentile 75 (OK=75 KO=- )
> response time 75th percentile 211 (OK=211 KO=- )
> response time 95th percentile 451 (OK=451 KO=- )
> response time 99th percentile 498 (OK=498 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 962 (OK=962 KO=- )
> mean response time 390 (OK=390 KO=- )
> std deviation 267 (OK=267 KO=- )
> response time 50th percentile 329 (OK=330 KO=- )
> response time 75th percentile 620 (OK=620 KO=- )
> response time 95th percentile 854 (OK=854 KO=- )
> response time 99th percentile 927 (OK=927 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 815 (OK=815 KO=- )
> mean response time 193 (OK=193 KO=- )
> std deviation 187 (OK=187 KO=- )
> response time 50th percentile 151 (OK=151 KO=- )
> response time 75th percentile 324 (OK=324 KO=- )
> response time 95th percentile 532 (OK=532 KO=- )
> response time 99th percentile 778 (OK=778 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 635 (OK=635 KO=- )
> mean response time 166 (OK=166 KO=- )
> std deviation 168 (OK=168 KO=- )
> response time 50th percentile 131 (OK=131 KO=- )
> response time 75th percentile 267 (OK=267 KO=- )
> response time 95th percentile 526 (OK=526 KO=- )
> response time 99th percentile 598 (OK=598 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 648 (OK=648 KO=- )
> mean response time 224 (OK=224 KO=- )
> std deviation 188 (OK=188 KO=- )
> response time 50th percentile 190 (OK=190 KO=- )
> response time 75th percentile 357 (OK=357 KO=- )
> response time 95th percentile 571 (OK=571 KO=- )
> response time 99th percentile 618 (OK=618 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 826 (OK=826 KO=- )
> mean response time 280 (OK=280 KO=- )
> std deviation 202 (OK=202 KO=- )
> response time 50th percentile 240 (OK=240 KO=- )
> response time 75th percentile 440 (OK=440 KO=- )
> response time 95th percentile 637 (OK=637 KO=- )
> response time 99th percentile 769 (OK=769 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 622 (OK=622 KO=- )
> mean response time 179 (OK=179 KO=- )
> std deviation 169 (OK=169 KO=- )
> response time 50th percentile 155 (OK=155 KO=- )
> response time 75th percentile 298 (OK=298 KO=- )
> response time 95th percentile 479 (OK=479 KO=- )
> response time 99th percentile 572 (OK=572 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 391 (OK=391 KO=- )
> mean response time 92 (OK=92 KO=- )
> std deviation 114 (OK=114 KO=- )
> response time 50th percentile 37 (OK=37 KO=- )
> response time 75th percentile 147 (OK=147 KO=- )
> response time 95th percentile 332 (OK=332 KO=- )
> response time 99th percentile 374 (OK=374 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 643 (OK=643 KO=- )
> mean response time 152 (OK=152 KO=- )
> std deviation 158 (OK=158 KO=- )
> response time 50th percentile 111 (OK=111 KO=- )
> response time 75th percentile 243 (OK=243 KO=- )
> response time 95th percentile 474 (OK=475 KO=- )
> response time 99th percentile 610 (OK=610 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7927 KO=73 )
> min response time 0 (OK=0 KO=74 )
> max response time 1540 (OK=1540 KO=1238 )
> mean response time 395 (OK=394 KO=555 )
> std deviation 240 (OK=239 KO=287 )
> response time 50th percentile 331 (OK=330 KO=659 )
> response time 75th percentile 599 (OK=598 KO=740 )
> response time 95th percentile 811 (OK=810 KO=994 )
> response time 99th percentile 940 (OK=939 KO=1138 )
> mean requests/sec 1333.333 (OK=1321.167 KO=12.167)source code for the java and dotnet tests 
source code for the rust tests github action