Java microservice framework tests in SB:3.1.0 Q:3.0.3.Final M:3.9.2 V:4.4.2 H:3.2.1 Dotnet:6 openjdk version "17.0.7" 2023-04-18 rustc 1.69.0 (84c898d65 2023-04-16)
In Linux fv-az622-799 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 18.217 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 23.797 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 23.410 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 22.327 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 29.782 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 4.849 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 4.854 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 13.577 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.3M | helidon-se-netty/target/helidon-quickstart-se.jar |
11K | helidon-se-netty/target/original-helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
16K | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT.jar |
15M | micronaut/target/micronaut-demo-0.1.jar |
13K | micronaut/target/original-micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
8.8K | vertx/target/vertx-demo-1.0.0-SNAPSHOT.jar |
:: Spring Boot :: (v3.1.0) Started DemoWebFluxApplication in 2.008 seconds (process running for 2.538)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 8 (OK=8 KO=- )
> max response time 2180 (OK=2180 KO=- )
> mean response time 1028 (OK=1028 KO=- )
> std deviation 524 (OK=524 KO=- )
> response time 50th percentile 1037 (OK=1037 KO=- )
> response time 75th percentile 1480 (OK=1480 KO=- )
> response time 95th percentile 1813 (OK=1813 KO=- )
> response time 99th percentile 1950 (OK=1950 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
:: Spring Boot :: (v3.1.0) Started DemoApplication in 2.091 seconds (process running for 2.585)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 2687 (OK=2687 KO=- )
> mean response time 972 (OK=972 KO=- )
> std deviation 585 (OK=585 KO=- )
> response time 50th percentile 769 (OK=769 KO=- )
> response time 75th percentile 1358 (OK=1358 KO=- )
> response time 95th percentile 2251 (OK=2251 KO=- )
> response time 99th percentile 2591 (OK=2591 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
powered by Quarkus 3.0.3.Final) started in 1.042s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 30 (OK=30 KO=- )
> max response time 1835 (OK=1835 KO=- )
> mean response time 798 (OK=798 KO=- )
> std deviation 444 (OK=444 KO=- )
> response time 50th percentile 737 (OK=737 KO=- )
> response time 75th percentile 1140 (OK=1140 KO=- )
> response time 95th percentile 1657 (OK=1657 KO=- )
> response time 99th percentile 1747 (OK=1747 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
micronaut version:3.9.2 Startup completed in 930ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 36 (OK=36 KO=- )
> max response time 1867 (OK=1867 KO=- )
> mean response time 855 (OK=855 KO=- )
> std deviation 426 (OK=426 KO=- )
> response time 50th percentile 766 (OK=766 KO=- )
> response time 75th percentile 1127 (OK=1127 KO=- )
> response time 95th percentile 1647 (OK=1647 KO=- )
> response time 99th percentile 1739 (OK=1739 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 733 (OK=733 KO=- )
> mean response time 230 (OK=230 KO=- )
> std deviation 226 (OK=226 KO=- )
> response time 50th percentile 175 (OK=175 KO=- )
> response time 75th percentile 403 (OK=402 KO=- )
> response time 95th percentile 655 (OK=655 KO=- )
> response time 99th percentile 712 (OK=712 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
kumuluz version:4.1.0 Server – Started Server@236134a1{STARTING}[10.0.9,sto=0] @3430ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 30 (OK=30 KO=- )
> max response time 5091 (OK=5091 KO=- )
> mean response time 1490 (OK=1490 KO=- )
> std deviation 958 (OK=958 KO=- )
> response time 50th percentile 1359 (OK=1359 KO=- )
> response time 75th percentile 2137 (OK=2137 KO=- )
> response time 95th percentile 3233 (OK=3233 KO=- )
> response time 99th percentile 4030 (OK=4030 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
Helidon SE 3.2.1 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 46 (OK=46 KO=- )
> max response time 2775 (OK=2775 KO=- )
> mean response time 1325 (OK=1325 KO=- )
> std deviation 590 (OK=590 KO=- )
> response time 50th percentile 1186 (OK=1186 KO=- )
> response time 75th percentile 1869 (OK=1869 KO=- )
> response time 95th percentile 2302 (OK=2302 KO=- )
> response time 99th percentile 2597 (OK=2597 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 4057 (OK=4057 KO=- )
> mean response time 1910 (OK=1910 KO=- )
> std deviation 1069 (OK=1069 KO=- )
> response time 50th percentile 2170 (OK=2170 KO=- )
> response time 75th percentile 2820 (OK=2820 KO=- )
> response time 95th percentile 3400 (OK=3400 KO=- )
> response time 99th percentile 3616 (OK=3616 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
Rust rest services #
rustc 1.69.0 (84c898d65 2023-04-16)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 662 (OK=662 KO=- )
> mean response time 136 (OK=136 KO=- )
> std deviation 151 (OK=151 KO=- )
> response time 50th percentile 101 (OK=101 KO=- )
> response time 75th percentile 228 (OK=228 KO=- )
> response time 95th percentile 458 (OK=458 KO=- )
> response time 99th percentile 524 (OK=524 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 450 (OK=450 KO=- )
> mean response time 73 (OK=73 KO=- )
> std deviation 107 (OK=107 KO=- )
> response time 50th percentile 1 (OK=1 KO=- )
> response time 75th percentile 116 (OK=116 KO=- )
> response time 95th percentile 303 (OK=303 KO=- )
> response time 99th percentile 419 (OK=419 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 486 (OK=486 KO=- )
> mean response time 116 (OK=116 KO=- )
> std deviation 130 (OK=130 KO=- )
> response time 50th percentile 84 (OK=84 KO=- )
> response time 75th percentile 182 (OK=183 KO=- )
> response time 95th percentile 374 (OK=374 KO=- )
> response time 99th percentile 421 (OK=421 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 399 (OK=399 KO=- )
> mean response time 88 (OK=88 KO=- )
> std deviation 111 (OK=111 KO=- )
> response time 50th percentile 31 (OK=31 KO=- )
> response time 75th percentile 146 (OK=146 KO=- )
> response time 95th percentile 339 (OK=339 KO=- )
> response time 99th percentile 373 (OK=373 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 999 (OK=999 KO=- )
> mean response time 357 (OK=357 KO=- )
> std deviation 265 (OK=265 KO=- )
> response time 50th percentile 293 (OK=293 KO=- )
> response time 75th percentile 554 (OK=554 KO=- )
> response time 95th percentile 864 (OK=862 KO=- )
> response time 99th percentile 963 (OK=963 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 675 (OK=675 KO=- )
> mean response time 147 (OK=147 KO=- )
> std deviation 151 (OK=151 KO=- )
> response time 50th percentile 116 (OK=116 KO=- )
> response time 75th percentile 249 (OK=249 KO=- )
> response time 95th percentile 415 (OK=415 KO=- )
> response time 99th percentile 570 (OK=570 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 601 (OK=601 KO=- )
> mean response time 167 (OK=167 KO=- )
> std deviation 161 (OK=161 KO=- )
> response time 50th percentile 139 (OK=139 KO=- )
> response time 75th percentile 265 (OK=265 KO=- )
> response time 95th percentile 481 (OK=481 KO=- )
> response time 99th percentile 590 (OK=590 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 673 (OK=673 KO=- )
> mean response time 197 (OK=197 KO=- )
> std deviation 173 (OK=173 KO=- )
> response time 50th percentile 174 (OK=174 KO=- )
> response time 75th percentile 350 (OK=350 KO=- )
> response time 95th percentile 497 (OK=497 KO=- )
> response time 99th percentile 617 (OK=617 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 809 (OK=809 KO=- )
> mean response time 261 (OK=261 KO=- )
> std deviation 204 (OK=204 KO=- )
> response time 50th percentile 230 (OK=230 KO=- )
> response time 75th percentile 430 (OK=430 KO=- )
> response time 95th percentile 603 (OK=603 KO=- )
> response time 99th percentile 716 (OK=716 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 632 (OK=632 KO=- )
> mean response time 238 (OK=238 KO=- )
> std deviation 191 (OK=191 KO=- )
> response time 50th percentile 206 (OK=206 KO=- )
> response time 75th percentile 391 (OK=391 KO=- )
> response time 95th percentile 577 (OK=577 KO=- )
> response time 99th percentile 614 (OK=614 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 417 (OK=417 KO=- )
> mean response time 76 (OK=76 KO=- )
> std deviation 108 (OK=108 KO=- )
> response time 50th percentile 2 (OK=2 KO=- )
> response time 75th percentile 130 (OK=130 KO=- )
> response time 95th percentile 325 (OK=325 KO=- )
> response time 99th percentile 373 (OK=373 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 533 (OK=533 KO=- )
> mean response time 156 (OK=156 KO=- )
> std deviation 152 (OK=152 KO=- )
> response time 50th percentile 130 (OK=130 KO=- )
> response time 75th percentile 248 (OK=248 KO=- )
> response time 95th percentile 434 (OK=434 KO=- )
> response time 99th percentile 484 (OK=484 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7864 KO=136 )
> min response time 0 (OK=0 KO=0 )
> max response time 1233 (OK=1233 KO=1129 )
> mean response time 341 (OK=336 KO=619 )
> std deviation 204 (OK=201 KO=187 )
> response time 50th percentile 289 (OK=284 KO=661 )
> response time 75th percentile 487 (OK=481 KO=690 )
> response time 95th percentile 698 (OK=696 KO=763 )
> response time 99th percentile 764 (OK=764 KO=869 )
> mean requests/sec 1333.333 (OK=1310.667 KO=22.667)
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: