Java microservice framework tests in SB:3.0.6 Q:3.0.1.Final M:3.9.1 V:4.4.1 H:3.2.0 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.69.0 (84c898d65 2023-04-16)
In Linux fv-az361-562 5.15.0-1036-azure #43-Ubuntu SMP Wed Mar 29 16:11:05 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 17.139 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 23.955 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 23.673 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 22.635 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 30.206 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 5.648 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 5.637 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 14.024 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.2M | helidon-se-netty/target/helidon-quickstart-se.jar |
11K | helidon-se-netty/target/original-helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
16K | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar |
15M | micronaut/target/micronaut-demo-0.1.jar |
13K | micronaut/target/original-micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
8.8K | vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar |
:: Spring Boot :: (v3.0.6) Started DemoWebFluxApplication in 2.267 seconds (process running for 2.801)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 15 (OK=15 KO=- )
> max response time 2716 (OK=2716 KO=- )
> mean response time 1139 (OK=1139 KO=- )
> std deviation 641 (OK=641 KO=- )
> response time 50th percentile 970 (OK=970 KO=- )
> response time 75th percentile 1598 (OK=1598 KO=- )
> response time 95th percentile 2410 (OK=2410 KO=- )
> response time 99th percentile 2628 (OK=2628 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
:: Spring Boot :: (v3.0.6) Started DemoApplication in 2.339 seconds (process running for 2.805)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 35 (OK=35 KO=- )
> max response time 3503 (OK=3503 KO=- )
> mean response time 1239 (OK=1239 KO=- )
> std deviation 808 (OK=808 KO=- )
> response time 50th percentile 857 (OK=857 KO=- )
> response time 75th percentile 1864 (OK=1864 KO=- )
> response time 95th percentile 2691 (OK=2691 KO=- )
> response time 99th percentile 3212 (OK=3212 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
powered by Quarkus 3.0.1.Final) started in 1.013s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 60 (OK=60 KO=- )
> max response time 2465 (OK=2465 KO=- )
> mean response time 1039 (OK=1039 KO=- )
> std deviation 624 (OK=624 KO=- )
> response time 50th percentile 854 (OK=854 KO=- )
> response time 75th percentile 1541 (OK=1541 KO=- )
> response time 95th percentile 2162 (OK=2162 KO=- )
> response time 99th percentile 2315 (OK=2315 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
micronaut version:3.9.1 Startup completed in 964ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 22 (OK=22 KO=- )
> max response time 2886 (OK=2886 KO=- )
> mean response time 1154 (OK=1154 KO=- )
> std deviation 707 (OK=707 KO=- )
> response time 50th percentile 974 (OK=974 KO=- )
> response time 75th percentile 1747 (OK=1747 KO=- )
> response time 95th percentile 2378 (OK=2378 KO=- )
> response time 99th percentile 2757 (OK=2757 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1051 (OK=1051 KO=- )
> mean response time 402 (OK=402 KO=- )
> std deviation 308 (OK=308 KO=- )
> response time 50th percentile 370 (OK=370 KO=- )
> response time 75th percentile 631 (OK=631 KO=- )
> response time 95th percentile 931 (OK=931 KO=- )
> response time 99th percentile 1010 (OK=1010 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
kumuluz version:4.1.0 Server – Started Server@f339eae{STARTING}[10.0.9,sto=0] @4513ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 4669 (OK=4669 KO=- )
> mean response time 1521 (OK=1521 KO=- )
> std deviation 1142 (OK=1142 KO=- )
> response time 50th percentile 1077 (OK=1077 KO=- )
> response time 75th percentile 2399 (OK=2399 KO=- )
> response time 95th percentile 3915 (OK=3917 KO=- )
> response time 99th percentile 4486 (OK=4486 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
Helidon SE 3.2.0 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 77 (OK=77 KO=- )
> max response time 2660 (OK=2660 KO=- )
> mean response time 1282 (OK=1282 KO=- )
> std deviation 570 (OK=570 KO=- )
> response time 50th percentile 1106 (OK=1106 KO=- )
> response time 75th percentile 1773 (OK=1773 KO=- )
> response time 95th percentile 2280 (OK=2280 KO=- )
> response time 99th percentile 2560 (OK=2560 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 6 (OK=6 KO=- )
> max response time 4329 (OK=4329 KO=- )
> mean response time 1650 (OK=1650 KO=- )
> std deviation 822 (OK=822 KO=- )
> response time 50th percentile 1460 (OK=1460 KO=- )
> response time 75th percentile 2241 (OK=2241 KO=- )
> response time 95th percentile 3190 (OK=3190 KO=- )
> response time 99th percentile 3552 (OK=3552 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
Rust rest services #
rustc 1.69.0 (84c898d65 2023-04-16)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 467 (OK=467 KO=- )
> mean response time 133 (OK=133 KO=- )
> std deviation 139 (OK=139 KO=- )
> response time 50th percentile 112 (OK=111 KO=- )
> response time 75th percentile 198 (OK=198 KO=- )
> response time 95th percentile 392 (OK=392 KO=- )
> response time 99th percentile 427 (OK=427 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 486 (OK=486 KO=- )
> mean response time 109 (OK=109 KO=- )
> std deviation 137 (OK=137 KO=- )
> response time 50th percentile 41 (OK=41 KO=- )
> response time 75th percentile 180 (OK=180 KO=- )
> response time 95th percentile 408 (OK=408 KO=- )
> response time 99th percentile 451 (OK=451 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 571 (OK=571 KO=- )
> mean response time 168 (OK=168 KO=- )
> std deviation 164 (OK=164 KO=- )
> response time 50th percentile 142 (OK=142 KO=- )
> response time 75th percentile 276 (OK=276 KO=- )
> response time 95th percentile 473 (OK=473 KO=- )
> response time 99th percentile 550 (OK=550 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 501 (OK=501 KO=- )
> mean response time 147 (OK=147 KO=- )
> std deviation 145 (OK=145 KO=- )
> response time 50th percentile 128 (OK=128 KO=- )
> response time 75th percentile 261 (OK=261 KO=- )
> response time 95th percentile 421 (OK=421 KO=- )
> response time 99th percentile 460 (OK=460 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 933 (OK=933 KO=- )
> mean response time 404 (OK=404 KO=- )
> std deviation 250 (OK=250 KO=- )
> response time 50th percentile 335 (OK=335 KO=- )
> response time 75th percentile 624 (OK=624 KO=- )
> response time 95th percentile 805 (OK=804 KO=- )
> response time 99th percentile 864 (OK=864 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 817 (OK=817 KO=- )
> mean response time 295 (OK=295 KO=- )
> std deviation 220 (OK=220 KO=- )
> response time 50th percentile 250 (OK=250 KO=- )
> response time 75th percentile 493 (OK=493 KO=- )
> response time 95th percentile 706 (OK=706 KO=- )
> response time 99th percentile 800 (OK=800 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 808 (OK=808 KO=- )
> mean response time 249 (OK=249 KO=- )
> std deviation 234 (OK=234 KO=- )
> response time 50th percentile 200 (OK=200 KO=- )
> response time 75th percentile 381 (OK=381 KO=- )
> response time 95th percentile 732 (OK=732 KO=- )
> response time 99th percentile 773 (OK=773 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 889 (OK=889 KO=- )
> mean response time 332 (OK=332 KO=- )
> std deviation 224 (OK=224 KO=- )
> response time 50th percentile 286 (OK=286 KO=- )
> response time 75th percentile 502 (OK=502 KO=- )
> response time 95th percentile 726 (OK=726 KO=- )
> response time 99th percentile 859 (OK=859 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1649 (OK=1649 KO=- )
> mean response time 277 (OK=277 KO=- )
> std deviation 192 (OK=192 KO=- )
> response time 50th percentile 240 (OK=240 KO=- )
> response time 75th percentile 449 (OK=449 KO=- )
> response time 95th percentile 593 (OK=593 KO=- )
> response time 99th percentile 632 (OK=632 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 928 (OK=928 KO=- )
> mean response time 386 (OK=386 KO=- )
> std deviation 235 (OK=235 KO=- )
> response time 50th percentile 325 (OK=325 KO=- )
> response time 75th percentile 587 (OK=587 KO=- )
> response time 95th percentile 763 (OK=763 KO=- )
> response time 99th percentile 910 (OK=910 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 589 (OK=589 KO=- )
> mean response time 171 (OK=171 KO=- )
> std deviation 172 (OK=172 KO=- )
> response time 50th percentile 144 (OK=144 KO=- )
> response time 75th percentile 265 (OK=265 KO=- )
> response time 95th percentile 526 (OK=526 KO=- )
> response time 99th percentile 551 (OK=551 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 762 (OK=762 KO=- )
> mean response time 276 (OK=276 KO=- )
> std deviation 205 (OK=205 KO=- )
> response time 50th percentile 238 (OK=238 KO=- )
> response time 75th percentile 447 (OK=447 KO=- )
> response time 95th percentile 651 (OK=651 KO=- )
> response time 99th percentile 734 (OK=734 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7927 KO=73 )
> min response time 2 (OK=2 KO=312 )
> max response time 1545 (OK=1545 KO=984 )
> mean response time 414 (OK=410 KO=785 )
> std deviation 226 (OK=224 KO=107 )
> response time 50th percentile 358 (OK=357 KO=818 )
> response time 75th percentile 606 (OK=599 KO=842 )
> response time 95th percentile 771 (OK=761 KO=896 )
> response time 99th percentile 922 (OK=920 KO=948 )
> mean requests/sec 1333.333 (OK=1321.167 KO=12.167)
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: