Java microservice framework tests in SB:3.0.6 Q:3.0.1.Final M:3.9.0 V:4.4.1 H:3.2.0 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.68.2 (9eb3afe9e 2023-03-27)
In Linux fv-az560-229 5.15.0-1035-azure #42-Ubuntu SMP Tue Feb 28 19:41:23 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 17.729 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 24.869 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 24.775 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 23.491 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 31.654 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 5.339 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 5.336 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 15.406 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.2M | helidon-se-netty/target/helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
15M | micronaut/target/micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.0.6) Started DemoWebFluxApplication in 2.234 seconds (process running for 2.754)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 62 (OK=62 KO=- )
> max response time 3388 (OK=3388 KO=- )
> mean response time 1482 (OK=1482 KO=- )
> std deviation 844 (OK=844 KO=- )
> response time 50th percentile 1055 (OK=1055 KO=- )
> response time 75th percentile 2384 (OK=2384 KO=- )
> response time 95th percentile 2939 (OK=2939 KO=- )
> response time 99th percentile 3098 (OK=3098 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
:: Spring Boot :: (v3.0.6) Started DemoApplication in 2.387 seconds (process running for 2.911)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 13 (OK=13 KO=- )
> max response time 3487 (OK=3487 KO=- )
> mean response time 1417 (OK=1417 KO=- )
> std deviation 869 (OK=869 KO=- )
> response time 50th percentile 992 (OK=992 KO=- )
> response time 75th percentile 2207 (OK=2207 KO=- )
> response time 95th percentile 2849 (OK=2849 KO=- )
> response time 99th percentile 3245 (OK=3245 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
powered by Quarkus 3.0.1.Final) started in 1.046s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 14 (OK=14 KO=- )
> max response time 3469 (OK=3469 KO=- )
> mean response time 1211 (OK=1211 KO=- )
> std deviation 714 (OK=714 KO=- )
> response time 50th percentile 993 (OK=993 KO=- )
> response time 75th percentile 1618 (OK=1618 KO=- )
> response time 95th percentile 2656 (OK=2656 KO=- )
> response time 99th percentile 3079 (OK=3079 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
micronaut version:3.9.0 Startup completed in 945ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 81 (OK=81 KO=- )
> max response time 3295 (OK=3295 KO=- )
> mean response time 1417 (OK=1417 KO=- )
> std deviation 764 (OK=764 KO=- )
> response time 50th percentile 1285 (OK=1285 KO=- )
> response time 75th percentile 1838 (OK=1838 KO=- )
> response time 95th percentile 2955 (OK=2955 KO=- )
> response time 99th percentile 3129 (OK=3129 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 1398 (OK=1398 KO=- )
> mean response time 586 (OK=586 KO=- )
> std deviation 342 (OK=342 KO=- )
> response time 50th percentile 511 (OK=511 KO=- )
> response time 75th percentile 867 (OK=867 KO=- )
> response time 95th percentile 1185 (OK=1185 KO=- )
> response time 99th percentile 1307 (OK=1307 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
kumuluz version:4.1.0 Server – Started Server@73044cdf{STARTING}[10.0.9,sto=0] @4477ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 111 (OK=111 KO=- )
> max response time 5560 (OK=5560 KO=- )
> mean response time 1800 (OK=1800 KO=- )
> std deviation 1328 (OK=1328 KO=- )
> response time 50th percentile 1060 (OK=1060 KO=- )
> response time 75th percentile 3189 (OK=3189 KO=- )
> response time 95th percentile 3739 (OK=3739 KO=- )
> response time 99th percentile 5294 (OK=5294 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
Helidon SE 3.2.0 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 90 (OK=90 KO=- )
> max response time 2802 (OK=2802 KO=- )
> mean response time 1382 (OK=1382 KO=- )
> std deviation 677 (OK=677 KO=- )
> response time 50th percentile 1493 (OK=1493 KO=- )
> response time 75th percentile 1910 (OK=1910 KO=- )
> response time 95th percentile 2478 (OK=2478 KO=- )
> response time 99th percentile 2669 (OK=2669 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 4464 (OK=4464 KO=- )
> mean response time 1959 (OK=1959 KO=- )
> std deviation 1098 (OK=1098 KO=- )
> response time 50th percentile 1690 (OK=1690 KO=- )
> response time 75th percentile 2832 (OK=2832 KO=- )
> response time 95th percentile 3846 (OK=3846 KO=- )
> response time 99th percentile 4195 (OK=4195 KO=- )
> mean requests/sec 800 (OK=800 KO=- )
Rust rest services #
rustc 1.68.2 (9eb3afe9e 2023-03-27)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 622 (OK=622 KO=- )
> mean response time 210 (OK=210 KO=- )
> std deviation 183 (OK=183 KO=- )
> response time 50th percentile 185 (OK=185 KO=- )
> response time 75th percentile 375 (OK=375 KO=- )
> response time 95th percentile 531 (OK=531 KO=- )
> response time 99th percentile 608 (OK=608 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 652 (OK=652 KO=- )
> mean response time 228 (OK=228 KO=- )
> std deviation 197 (OK=197 KO=- )
> response time 50th percentile 209 (OK=209 KO=- )
> response time 75th percentile 403 (OK=403 KO=- )
> response time 95th percentile 566 (OK=566 KO=- )
> response time 99th percentile 620 (OK=620 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 768 (OK=768 KO=- )
> mean response time 315 (OK=315 KO=- )
> std deviation 221 (OK=221 KO=- )
> response time 50th percentile 278 (OK=278 KO=- )
> response time 75th percentile 523 (OK=523 KO=- )
> response time 95th percentile 677 (OK=677 KO=- )
> response time 99th percentile 730 (OK=730 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 646 (OK=646 KO=- )
> mean response time 206 (OK=206 KO=- )
> std deviation 187 (OK=187 KO=- )
> response time 50th percentile 176 (OK=176 KO=- )
> response time 75th percentile 334 (OK=334 KO=- )
> response time 95th percentile 550 (OK=550 KO=- )
> response time 99th percentile 627 (OK=627 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 1287 (OK=1287 KO=- )
> mean response time 554 (OK=554 KO=- )
> std deviation 340 (OK=340 KO=- )
> response time 50th percentile 471 (OK=470 KO=- )
> response time 75th percentile 895 (OK=895 KO=- )
> response time 95th percentile 1144 (OK=1144 KO=- )
> response time 99th percentile 1263 (OK=1263 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1094 (OK=1094 KO=- )
> mean response time 357 (OK=357 KO=- )
> std deviation 275 (OK=275 KO=- )
> response time 50th percentile 296 (OK=296 KO=- )
> response time 75th percentile 543 (OK=543 KO=- )
> response time 95th percentile 925 (OK=925 KO=- )
> response time 99th percentile 1033 (OK=1033 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 770 (OK=770 KO=- )
> mean response time 285 (OK=285 KO=- )
> std deviation 201 (OK=201 KO=- )
> response time 50th percentile 243 (OK=243 KO=- )
> response time 75th percentile 455 (OK=455 KO=- )
> response time 95th percentile 636 (OK=636 KO=- )
> response time 99th percentile 689 (OK=689 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 934 (OK=934 KO=- )
> mean response time 436 (OK=436 KO=- )
> std deviation 227 (OK=227 KO=- )
> response time 50th percentile 381 (OK=381 KO=- )
> response time 75th percentile 628 (OK=628 KO=- )
> response time 95th percentile 826 (OK=826 KO=- )
> response time 99th percentile 900 (OK=900 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 6 (OK=6 KO=- )
> max response time 1995 (OK=1995 KO=- )
> mean response time 492 (OK=492 KO=- )
> std deviation 323 (OK=323 KO=- )
> response time 50th percentile 414 (OK=414 KO=- )
> response time 75th percentile 674 (OK=674 KO=- )
> response time 95th percentile 948 (OK=948 KO=- )
> response time 99th percentile 1805 (OK=1805 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 942 (OK=942 KO=- )
> mean response time 458 (OK=458 KO=- )
> std deviation 246 (OK=246 KO=- )
> response time 50th percentile 403 (OK=403 KO=- )
> response time 75th percentile 676 (OK=676 KO=- )
> response time 95th percentile 875 (OK=875 KO=- )
> response time 99th percentile 914 (OK=914 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 656 (OK=656 KO=- )
> mean response time 199 (OK=199 KO=- )
> std deviation 193 (OK=193 KO=- )
> response time 50th percentile 173 (OK=173 KO=- )
> response time 75th percentile 312 (OK=312 KO=- )
> response time 95th percentile 559 (OK=559 KO=- )
> response time 99th percentile 607 (OK=607 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1006 (OK=1006 KO=- )
> mean response time 326 (OK=326 KO=- )
> std deviation 206 (OK=206 KO=- )
> response time 50th percentile 264 (OK=264 KO=- )
> response time 75th percentile 488 (OK=488 KO=- )
> response time 95th percentile 722 (OK=722 KO=- )
> response time 99th percentile 938 (OK=938 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7814 KO=186 )
> min response time 19 (OK=19 KO=190 )
> max response time 2109 (OK=2054 KO=2109 )
> mean response time 593 (OK=586 KO=867 )
> std deviation 299 (OK=295 KO=321 )
> response time 50th percentile 554 (OK=545 KO=866 )
> response time 75th percentile 800 (OK=782 KO=1140 )
> response time 95th percentile 1114 (OK=1109 KO=1325 )
> response time 99th percentile 1387 (OK=1369 KO=1554 )
> mean requests/sec 1333.333 (OK=1302.333 KO=31 )
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: