Java microservice framework tests in SB:3.0.5 Q:2.16.6.Final M:3.8.8 V:4.4.1 H:3.2.0 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.68.2 (9eb3afe9e 2023-03-27)
In Linux fv-az162-240 5.15.0-1035-azure #42-Ubuntu SMP Tue Feb 28 19:41:23 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 19.837 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 26.673 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 26.294 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 25.351 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 32.704 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 5.068 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 4.945 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 17.645 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.2M | helidon-se-netty/target/helidon-quickstart-se.jar |
18M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
15M | micronaut/target/micronaut-demo-0.1.jar |
16M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.8M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.0.5) Started DemoWebFluxApplication in 2.367 seconds (process running for 2.854)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 82 (OK=82 KO=- )
> max response time 3489 (OK=3489 KO=- )
> mean response time 1500 (OK=1500 KO=- )
> std deviation 791 (OK=791 KO=- )
> response time 50th percentile 1158 (OK=1158 KO=- )
> response time 75th percentile 2108 (OK=2108 KO=- )
> response time 95th percentile 2940 (OK=2941 KO=- )
> response time 99th percentile 3167 (OK=3167 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
:: Spring Boot :: (v3.0.5) Started DemoApplication in 2.555 seconds (process running for 3.092)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 18 (OK=18 KO=- )
> max response time 4341 (OK=4341 KO=- )
> mean response time 1541 (OK=1541 KO=- )
> std deviation 940 (OK=940 KO=- )
> response time 50th percentile 1189 (OK=1189 KO=- )
> response time 75th percentile 2362 (OK=2362 KO=- )
> response time 95th percentile 3121 (OK=3121 KO=- )
> response time 99th percentile 3665 (OK=3665 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
powered by Quarkus 2.16.6.Final) started in 0.977s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 122 (OK=122 KO=- )
> max response time 3201 (OK=3201 KO=- )
> mean response time 1402 (OK=1402 KO=- )
> std deviation 880 (OK=880 KO=- )
> response time 50th percentile 1018 (OK=1018 KO=- )
> response time 75th percentile 2101 (OK=2101 KO=- )
> response time 95th percentile 3001 (OK=3001 KO=- )
> response time 99th percentile 3140 (OK=3140 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
micronaut version:3.8.8 Startup completed in 994ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 53 (OK=53 KO=- )
> max response time 3113 (OK=3113 KO=- )
> mean response time 1455 (OK=1455 KO=- )
> std deviation 860 (OK=860 KO=- )
> response time 50th percentile 1121 (OK=1121 KO=- )
> response time 75th percentile 2303 (OK=2303 KO=- )
> response time 95th percentile 2854 (OK=2854 KO=- )
> response time 99th percentile 3014 (OK=3014 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 54 (OK=54 KO=- )
> max response time 1679 (OK=1679 KO=- )
> mean response time 637 (OK=637 KO=- )
> std deviation 351 (OK=351 KO=- )
> response time 50th percentile 558 (OK=558 KO=- )
> response time 75th percentile 944 (OK=944 KO=- )
> response time 95th percentile 1178 (OK=1178 KO=- )
> response time 99th percentile 1405 (OK=1405 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
kumuluz version:4.1.0 Server – Started Server@3db64bd4{STARTING}[10.0.9,sto=0] @3880ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 6 (OK=6 KO=- )
> max response time 5076 (OK=5076 KO=- )
> mean response time 1938 (OK=1938 KO=- )
> std deviation 1335 (OK=1335 KO=- )
> response time 50th percentile 1256 (OK=1256 KO=- )
> response time 75th percentile 3310 (OK=3310 KO=- )
> response time 95th percentile 4090 (OK=4090 KO=- )
> response time 99th percentile 4639 (OK=4639 KO=- )
> mean requests/sec 800 (OK=800 KO=- )
Helidon SE 3.2.0 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 86 (OK=86 KO=- )
> max response time 3330 (OK=3330 KO=- )
> mean response time 1639 (OK=1639 KO=- )
> std deviation 802 (OK=802 KO=- )
> response time 50th percentile 1695 (OK=1695 KO=- )
> response time 75th percentile 2412 (OK=2412 KO=- )
> response time 95th percentile 2841 (OK=2841 KO=- )
> response time 99th percentile 3067 (OK=3067 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 4856 (OK=4856 KO=- )
> mean response time 1956 (OK=1956 KO=- )
> std deviation 1143 (OK=1143 KO=- )
> response time 50th percentile 1671 (OK=1671 KO=- )
> response time 75th percentile 3051 (OK=3051 KO=- )
> response time 95th percentile 3898 (OK=3898 KO=- )
> response time 99th percentile 4176 (OK=4176 KO=- )
> mean requests/sec 800 (OK=800 KO=- )
Rust rest services #
rustc 1.68.2 (9eb3afe9e 2023-03-27)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 814 (OK=814 KO=- )
> mean response time 297 (OK=297 KO=- )
> std deviation 236 (OK=236 KO=- )
> response time 50th percentile 263 (OK=263 KO=- )
> response time 75th percentile 487 (OK=487 KO=- )
> response time 95th percentile 733 (OK=733 KO=- )
> response time 99th percentile 776 (OK=776 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 712 (OK=712 KO=- )
> mean response time 286 (OK=286 KO=- )
> std deviation 213 (OK=213 KO=- )
> response time 50th percentile 250 (OK=250 KO=- )
> response time 75th percentile 465 (OK=464 KO=- )
> response time 95th percentile 646 (OK=646 KO=- )
> response time 99th percentile 689 (OK=689 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 854 (OK=854 KO=- )
> mean response time 360 (OK=360 KO=- )
> std deviation 244 (OK=244 KO=- )
> response time 50th percentile 313 (OK=313 KO=- )
> response time 75th percentile 563 (OK=563 KO=- )
> response time 95th percentile 787 (OK=787 KO=- )
> response time 99th percentile 832 (OK=832 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 801 (OK=801 KO=- )
> mean response time 330 (OK=330 KO=- )
> std deviation 234 (OK=234 KO=- )
> response time 50th percentile 283 (OK=283 KO=- )
> response time 75th percentile 527 (OK=527 KO=- )
> response time 95th percentile 716 (OK=716 KO=- )
> response time 99th percentile 783 (OK=783 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 1410 (OK=1410 KO=- )
> mean response time 669 (OK=669 KO=- )
> std deviation 384 (OK=384 KO=- )
> response time 50th percentile 570 (OK=570 KO=- )
> response time 75th percentile 1026 (OK=1026 KO=- )
> response time 95th percentile 1267 (OK=1267 KO=- )
> response time 99th percentile 1367 (OK=1366 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1122 (OK=1122 KO=- )
> mean response time 396 (OK=396 KO=- )
> std deviation 283 (OK=283 KO=- )
> response time 50th percentile 340 (OK=340 KO=- )
> response time 75th percentile 579 (OK=579 KO=- )
> response time 95th percentile 923 (OK=923 KO=- )
> response time 99th percentile 1030 (OK=1030 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 989 (OK=989 KO=- )
> mean response time 408 (OK=408 KO=- )
> std deviation 241 (OK=241 KO=- )
> response time 50th percentile 347 (OK=347 KO=- )
> response time 75th percentile 611 (OK=611 KO=- )
> response time 95th percentile 833 (OK=833 KO=- )
> response time 99th percentile 937 (OK=937 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 1276 (OK=1276 KO=- )
> mean response time 487 (OK=487 KO=- )
> std deviation 262 (OK=262 KO=- )
> response time 50th percentile 421 (OK=421 KO=- )
> response time 75th percentile 703 (OK=703 KO=- )
> response time 95th percentile 936 (OK=936 KO=- )
> response time 99th percentile 1112 (OK=1112 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 2220 (OK=2220 KO=- )
> mean response time 578 (OK=578 KO=- )
> std deviation 375 (OK=375 KO=- )
> response time 50th percentile 489 (OK=489 KO=- )
> response time 75th percentile 778 (OK=778 KO=- )
> response time 95th percentile 1182 (OK=1182 KO=- )
> response time 99th percentile 1957 (OK=1957 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 14 (OK=14 KO=- )
> max response time 1450 (OK=1450 KO=- )
> mean response time 576 (OK=576 KO=- )
> std deviation 313 (OK=313 KO=- )
> response time 50th percentile 491 (OK=491 KO=- )
> response time 75th percentile 866 (OK=866 KO=- )
> response time 95th percentile 1058 (OK=1058 KO=- )
> response time 99th percentile 1385 (OK=1385 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 737 (OK=737 KO=- )
> mean response time 270 (OK=270 KO=- )
> std deviation 214 (OK=214 KO=- )
> response time 50th percentile 224 (OK=224 KO=- )
> response time 75th percentile 471 (OK=471 KO=- )
> response time 95th percentile 670 (OK=670 KO=- )
> response time 99th percentile 725 (OK=725 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 997 (OK=997 KO=- )
> mean response time 403 (OK=403 KO=- )
> std deviation 265 (OK=265 KO=- )
> response time 50th percentile 341 (OK=341 KO=- )
> response time 75th percentile 629 (OK=629 KO=- )
> response time 95th percentile 895 (OK=895 KO=- )
> response time 99th percentile 960 (OK=960 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7916 KO=84 )
> min response time 15 (OK=15 KO=333 )
> max response time 2397 (OK=2397 KO=1868 )
> mean response time 745 (OK=744 KO=842 )
> std deviation 382 (OK=382 KO=410 )
> response time 50th percentile 656 (OK=656 KO=753 )
> response time 75th percentile 1011 (OK=1011 KO=1190 )
> response time 95th percentile 1417 (OK=1414 KO=1598 )
> response time 99th percentile 1756 (OK=1755 KO=1844 )
> mean requests/sec 1142.857 (OK=1130.857 KO=12 )
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: