Java microservice framework tests in SB:3.2.5 Q:3.8.1 M:4.4.3 V:4.5.7 H:4.0.6 Dotnet:6 openjdk version "21.0.3" 2024-04-16 LTS rustc 1.78.0 (9b00956e5 2024-04-29)
In Linux fv-az777-346 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 7.233 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 6.405 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 11.271 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 11.560 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 19.148 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 3.696 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 3.695 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 7.975 s]Size of created packages:
| Size in MB | Name |
|---|---|
| 22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
| 6.1M | helidon-se-netty/target/helidon-quickstart-se.jar |
| 6.1M | helidon-se-netty/target/original-helidon-quickstart-se.jar |
| 19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
| 17M | micronaut/target/micronaut-demo-0.1.jar |
| 17M | micronaut/target/original-micronaut-demo-0.1.jar |
| 17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
| 21M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
| 24M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
| 13M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.2.5) Started DemoWebFluxApplication in 1.793 seconds (process running for 2.277)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 28 (OK=28 KO=- )
> max response time 5381 (OK=5381 KO=- )
> mean response time 1395 (OK=1395 KO=- )
> std deviation 951 (OK=951 KO=- )
> response time 50th percentile 968 (OK=969 KO=- )
> response time 75th percentile 1819 (OK=1819 KO=- )
> response time 95th percentile 3528 (OK=3528 KO=- )
> response time 99th percentile 4146 (OK=4146 KO=- )
> mean requests/sec 2909.091 (OK=2909.091 KO=- ):: Spring Boot :: (v3.2.5) Started DemoApplication in 1.755 seconds (process running for 2.215)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 33 (OK=33 KO=- )
> max response time 3944 (OK=3944 KO=- )
> mean response time 1124 (OK=1124 KO=- )
> std deviation 720 (OK=720 KO=- )
> response time 50th percentile 895 (OK=894 KO=- )
> response time 75th percentile 1323 (OK=1324 KO=- )
> response time 95th percentile 2635 (OK=2636 KO=- )
> response time 99th percentile 3171 (OK=3171 KO=- )
> mean requests/sec 3200 (OK=3200 KO=- )powered by Quarkus 3.8.1) started in 0.929s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 29 (OK=29 KO=- )
> max response time 2663 (OK=2663 KO=- )
> mean response time 1019 (OK=1019 KO=- )
> std deviation 560 (OK=560 KO=- )
> response time 50th percentile 870 (OK=870 KO=- )
> response time 75th percentile 1152 (OK=1152 KO=- )
> response time 95th percentile 2085 (OK=2085 KO=- )
> response time 99th percentile 2304 (OK=2304 KO=- )
> mean requests/sec 3555.556 (OK=3555.556 KO=- )micronaut version:4.2.0 Startup completed in 688ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 27 (OK=27 KO=- )
> max response time 2172 (OK=2172 KO=- )
> mean response time 820 (OK=820 KO=- )
> std deviation 475 (OK=475 KO=- )
> response time 50th percentile 715 (OK=715 KO=- )
> response time 75th percentile 973 (OK=973 KO=- )
> response time 95th percentile 1735 (OK=1736 KO=- )
> response time 99th percentile 1976 (OK=1977 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 9 (OK=9 KO=- )
> max response time 1480 (OK=1480 KO=- )
> mean response time 815 (OK=815 KO=- )
> std deviation 334 (OK=334 KO=- )
> response time 50th percentile 848 (OK=848 KO=- )
> response time 75th percentile 1112 (OK=1112 KO=- )
> response time 95th percentile 1302 (OK=1302 KO=- )
> response time 99th percentile 1425 (OK=1425 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )kumuluz version:4.1.0 Server – Started Server@28a6301f{STARTING}[10.0.9,sto=0] @3018ms
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 10 (OK=10 KO=- )
> max response time 5645 (OK=5645 KO=- )
> mean response time 1481 (OK=1481 KO=- )
> std deviation 1025 (OK=1025 KO=- )
> response time 50th percentile 1173 (OK=1173 KO=- )
> response time 75th percentile 1614 (OK=1613 KO=- )
> response time 95th percentile 3845 (OK=3844 KO=- )
> response time 99th percentile 4636 (OK=4637 KO=- )
> mean requests/sec 2909.091 (OK=2909.091 KO=- )Helidon SE 4.0.6 features: [Config, Encoding, Health, Media, Metrics, Observe, WebServer]
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1869 (OK=1869 KO=- )
> mean response time 835 (OK=835 KO=- )
> std deviation 342 (OK=342 KO=- )
> response time 50th percentile 861 (OK=861 KO=- )
> response time 75th percentile 1101 (OK=1101 KO=- )
> response time 95th percentile 1370 (OK=1370 KO=- )
> response time 99th percentile 1629 (OK=1629 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 4913 (OK=4913 KO=- )
> mean response time 2137 (OK=2137 KO=- )
> std deviation 1293 (OK=1293 KO=- )
> response time 50th percentile 2051 (OK=2055 KO=- )
> response time 75th percentile 2973 (OK=2973 KO=- )
> response time 95th percentile 4477 (OK=4477 KO=- )
> response time 99th percentile 4661 (OK=4661 KO=- )
> mean requests/sec 2461.538 (OK=2461.538 KO=- )Rust rest services #
rustc 1.78.0 (9b00956e5 2024-04-29)
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 573 (OK=573 KO=- )
> mean response time 165 (OK=165 KO=- )
> std deviation 139 (OK=139 KO=- )
> response time 50th percentile 149 (OK=149 KO=- )
> response time 75th percentile 234 (OK=234 KO=- )
> response time 95th percentile 471 (OK=471 KO=- )
> response time 99th percentile 541 (OK=541 KO=- )
> mean requests/sec 6400 (OK=6400 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 884 (OK=884 KO=- )
> mean response time 248 (OK=248 KO=- )
> std deviation 171 (OK=171 KO=- )
> response time 50th percentile 231 (OK=231 KO=- )
> response time 75th percentile 319 (OK=319 KO=- )
> response time 95th percentile 589 (OK=589 KO=- )
> response time 99th percentile 738 (OK=738 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )rocket = { version = 0.5.0, features = [json] }
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 750 (OK=750 KO=- )
> mean response time 240 (OK=240 KO=- )
> std deviation 156 (OK=156 KO=- )
> response time 50th percentile 215 (OK=215 KO=- )
> response time 75th percentile 303 (OK=303 KO=- )
> response time 95th percentile 576 (OK=576 KO=- )
> response time 99th percentile 659 (OK=659 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 733 (OK=733 KO=- )
> mean response time 231 (OK=231 KO=- )
> std deviation 156 (OK=156 KO=- )
> response time 50th percentile 209 (OK=209 KO=- )
> response time 75th percentile 290 (OK=290 KO=- )
> response time 95th percentile 558 (OK=558 KO=- )
> response time 99th percentile 661 (OK=661 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 1346 (OK=1346 KO=- )
> mean response time 540 (OK=540 KO=- )
> std deviation 298 (OK=298 KO=- )
> response time 50th percentile 473 (OK=473 KO=- )
> response time 75th percentile 634 (OK=634 KO=- )
> response time 95th percentile 1144 (OK=1144 KO=- )
> response time 99th percentile 1276 (OK=1276 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 8 (OK=8 KO=- )
> max response time 1042 (OK=1042 KO=- )
> mean response time 377 (OK=377 KO=- )
> std deviation 210 (OK=210 KO=- )
> response time 50th percentile 341 (OK=341 KO=- )
> response time 75th percentile 442 (OK=442 KO=- )
> response time 95th percentile 802 (OK=802 KO=- )
> response time 99th percentile 881 (OK=881 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )Dotnet 8 rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 7 (OK=7 KO=- )
> max response time 1349 (OK=1349 KO=- )
> mean response time 538 (OK=538 KO=- )
> std deviation 268 (OK=268 KO=- )
> response time 50th percentile 500 (OK=500 KO=- )
> response time 75th percentile 624 (OK=624 KO=- )
> response time 95th percentile 1067 (OK=1067 KO=- )
> response time 99th percentile 1172 (OK=1172 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 1146 (OK=1146 KO=- )
> mean response time 444 (OK=444 KO=- )
> std deviation 213 (OK=213 KO=- )
> response time 50th percentile 414 (OK=414 KO=- )
> response time 75th percentile 573 (OK=573 KO=- )
> response time 95th percentile 850 (OK=850 KO=- )
> response time 99th percentile 979 (OK=978 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 1021 (OK=1021 KO=- )
> mean response time 353 (OK=353 KO=- )
> std deviation 188 (OK=188 KO=- )
> response time 50th percentile 319 (OK=319 KO=- )
> response time 75th percentile 432 (OK=432 KO=- )
> response time 95th percentile 732 (OK=732 KO=- )
> response time 99th percentile 837 (OK=838 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 3203 (OK=3203 KO=- )
> mean response time 480 (OK=480 KO=- )
> std deviation 356 (OK=356 KO=- )
> response time 50th percentile 429 (OK=429 KO=- )
> response time 75th percentile 580 (OK=580 KO=- )
> response time 95th percentile 1116 (OK=1119 KO=- )
> response time 99th percentile 1947 (OK=1947 KO=- )
> mean requests/sec 4000 (OK=4000 KO=- )graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 35 (OK=35 KO=- )
> max response time 1423 (OK=1423 KO=- )
> mean response time 462 (OK=462 KO=- )
> std deviation 229 (OK=229 KO=- )
> response time 50th percentile 399 (OK=399 KO=- )
> response time 75th percentile 528 (OK=528 KO=- )
> response time 95th percentile 912 (OK=912 KO=- )
> response time 99th percentile 1228 (OK=1228 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 29 (OK=29 KO=- )
> max response time 752 (OK=752 KO=- )
> mean response time 420 (OK=420 KO=- )
> std deviation 149 (OK=149 KO=- )
> response time 50th percentile 458 (OK=458 KO=- )
> response time 75th percentile 544 (OK=544 KO=- )
> response time 95th percentile 629 (OK=629 KO=- )
> response time 99th percentile 685 (OK=685 KO=- )
> mean requests/sec 4571.429 (OK=4571.429 KO=- )graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=32000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 935 (OK=935 KO=- )
> mean response time 344 (OK=344 KO=- )
> std deviation 158 (OK=158 KO=- )
> response time 50th percentile 337 (OK=337 KO=- )
> response time 75th percentile 404 (OK=404 KO=- )
> response time 95th percentile 674 (OK=674 KO=- )
> response time 99th percentile 798 (OK=798 KO=- )
> mean requests/sec 5333.333 (OK=5333.333 KO=- )graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 32000 (OK=31919 KO=81 )
> min response time 9 (OK=9 KO=63 )
> max response time 2934 (OK=2934 KO=1436 )
> mean response time 800 (OK=801 KO=378 )
> std deviation 504 (OK=504 KO=276 )
> response time 50th percentile 702 (OK=704 KO=329 )
> response time 75th percentile 1078 (OK=1081 KO=497 )
> response time 95th percentile 1814 (OK=1815 KO=986 )
> response time 99th percentile 2301 (OK=2302 KO=1090 )
> mean requests/sec 4000 (OK=3989.875 KO=10.125)source code for the java and dotnet tests 
source code for the rust tests github action