Java microservice framework tests in SB:3.1.1 Q:3.2.0.Final M:3.9.4 V:4.4.4 H:3.2.2 Dotnet:6 openjdk version "17.0.7" 2023-04-18 rustc 1.70.0 (90c541806 2023-05-31)
In Linux fv-az175-420 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 18.713 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 25.406 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 26.822 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 24.394 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 36.141 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 5.969 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 5.936 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 15.560 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.5M | helidon-se-netty/target/helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
15M | micronaut/target/micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.1.1) Started DemoWebFluxApplication in 2.391 seconds (process running for 2.987)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 65 (OK=65 KO=- )
> max response time 3072 (OK=3072 KO=- )
> mean response time 1334 (OK=1334 KO=- )
> std deviation 653 (OK=653 KO=- )
> response time 50th percentile 1218 (OK=1218 KO=- )
> response time 75th percentile 1924 (OK=1924 KO=- )
> response time 95th percentile 2307 (OK=2307 KO=- )
> response time 99th percentile 2755 (OK=2755 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
:: Spring Boot :: (v3.1.1) Started DemoApplication in 2.671 seconds (process running for 3.267)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 18 (OK=18 KO=- )
> max response time 4318 (OK=4318 KO=- )
> mean response time 1660 (OK=1660 KO=- )
> std deviation 967 (OK=967 KO=- )
> response time 50th percentile 1297 (OK=1297 KO=- )
> response time 75th percentile 2483 (OK=2484 KO=- )
> response time 95th percentile 3316 (OK=3316 KO=- )
> response time 99th percentile 3842 (OK=3842 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
powered by Quarkus 3.2.0.Final) started in 1.147s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 19 (OK=19 KO=- )
> max response time 2479 (OK=2479 KO=- )
> mean response time 1137 (OK=1137 KO=- )
> std deviation 634 (OK=634 KO=- )
> response time 50th percentile 990 (OK=990 KO=- )
> response time 75th percentile 1646 (OK=1646 KO=- )
> response time 95th percentile 2248 (OK=2248 KO=- )
> response time 99th percentile 2408 (OK=2408 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
micronaut version:3.9.4 Startup completed in 1041ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 52 (OK=52 KO=- )
> max response time 3872 (OK=3872 KO=- )
> mean response time 1469 (OK=1469 KO=- )
> std deviation 809 (OK=809 KO=- )
> response time 50th percentile 1325 (OK=1325 KO=- )
> response time 75th percentile 1994 (OK=1994 KO=- )
> response time 95th percentile 3003 (OK=3003 KO=- )
> response time 99th percentile 3548 (OK=3548 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 1542 (OK=1542 KO=- )
> mean response time 586 (OK=586 KO=- )
> std deviation 354 (OK=354 KO=- )
> response time 50th percentile 541 (OK=541 KO=- )
> response time 75th percentile 907 (OK=907 KO=- )
> response time 95th percentile 1181 (OK=1181 KO=- )
> response time 99th percentile 1349 (OK=1349 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
kumuluz version:4.1.0 Server – Started Server@56f71edb{STARTING}[10.0.9,sto=0] @3844ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 101 (OK=101 KO=- )
> max response time 5611 (OK=5611 KO=- )
> mean response time 1988 (OK=1988 KO=- )
> std deviation 1272 (OK=1272 KO=- )
> response time 50th percentile 1474 (OK=1474 KO=- )
> response time 75th percentile 3004 (OK=3004 KO=- )
> response time 95th percentile 4359 (OK=4359 KO=- )
> response time 99th percentile 5167 (OK=5167 KO=- )
> mean requests/sec 800 (OK=800 KO=- )
Helidon SE 3.2.2 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 51 (OK=51 KO=- )
> max response time 3546 (OK=3546 KO=- )
> mean response time 1824 (OK=1824 KO=- )
> std deviation 748 (OK=748 KO=- )
> response time 50th percentile 1660 (OK=1660 KO=- )
> response time 75th percentile 2521 (OK=2521 KO=- )
> response time 95th percentile 3035 (OK=3035 KO=- )
> response time 99th percentile 3288 (OK=3288 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 6482 (OK=6482 KO=- )
> mean response time 2921 (OK=2921 KO=- )
> std deviation 1884 (OK=1884 KO=- )
> response time 50th percentile 2755 (OK=2754 KO=- )
> response time 75th percentile 4698 (OK=4698 KO=- )
> response time 95th percentile 5497 (OK=5497 KO=- )
> response time 99th percentile 6130 (OK=6130 KO=- )
> mean requests/sec 727.273 (OK=727.273 KO=- )
Rust rest services #
rustc 1.70.0 (90c541806 2023-05-31)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 739 (OK=739 KO=- )
> mean response time 292 (OK=292 KO=- )
> std deviation 222 (OK=222 KO=- )
> response time 50th percentile 255 (OK=255 KO=- )
> response time 75th percentile 513 (OK=513 KO=- )
> response time 95th percentile 671 (OK=671 KO=- )
> response time 99th percentile 703 (OK=703 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 849 (OK=849 KO=- )
> mean response time 282 (OK=282 KO=- )
> std deviation 236 (OK=236 KO=- )
> response time 50th percentile 235 (OK=235 KO=- )
> response time 75th percentile 515 (OK=515 KO=- )
> response time 95th percentile 719 (OK=719 KO=- )
> response time 99th percentile 804 (OK=804 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.3, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 743 (OK=743 KO=- )
> mean response time 266 (OK=266 KO=- )
> std deviation 226 (OK=226 KO=- )
> response time 50th percentile 229 (OK=229 KO=- )
> response time 75th percentile 450 (OK=450 KO=- )
> response time 95th percentile 669 (OK=669 KO=- )
> response time 99th percentile 698 (OK=698 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 746 (OK=746 KO=- )
> mean response time 262 (OK=262 KO=- )
> std deviation 233 (OK=233 KO=- )
> response time 50th percentile 240 (OK=240 KO=- )
> response time 75th percentile 421 (OK=421 KO=- )
> response time 95th percentile 709 (OK=709 KO=- )
> response time 99th percentile 723 (OK=723 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 21 (OK=21 KO=- )
> max response time 1489 (OK=1489 KO=- )
> mean response time 648 (OK=648 KO=- )
> std deviation 371 (OK=371 KO=- )
> response time 50th percentile 549 (OK=549 KO=- )
> response time 75th percentile 979 (OK=979 KO=- )
> response time 95th percentile 1275 (OK=1275 KO=- )
> response time 99th percentile 1467 (OK=1467 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1127 (OK=1127 KO=- )
> mean response time 378 (OK=378 KO=- )
> std deviation 266 (OK=266 KO=- )
> response time 50th percentile 319 (OK=319 KO=- )
> response time 75th percentile 607 (OK=607 KO=- )
> response time 95th percentile 806 (OK=806 KO=- )
> response time 99th percentile 1104 (OK=1104 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1068 (OK=1068 KO=- )
> mean response time 411 (OK=411 KO=- )
> std deviation 251 (OK=251 KO=- )
> response time 50th percentile 366 (OK=367 KO=- )
> response time 75th percentile 618 (OK=618 KO=- )
> response time 95th percentile 853 (OK=853 KO=- )
> response time 99th percentile 1043 (OK=1043 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 960 (OK=960 KO=- )
> mean response time 395 (OK=395 KO=- )
> std deviation 234 (OK=234 KO=- )
> response time 50th percentile 332 (OK=332 KO=- )
> response time 75th percentile 612 (OK=612 KO=- )
> response time 95th percentile 794 (OK=794 KO=- )
> response time 99th percentile 950 (OK=950 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 2 (OK=2 KO=- )
> max response time 2130 (OK=2130 KO=- )
> mean response time 513 (OK=513 KO=- )
> std deviation 339 (OK=339 KO=- )
> response time 50th percentile 432 (OK=432 KO=- )
> response time 75th percentile 710 (OK=710 KO=- )
> response time 95th percentile 998 (OK=998 KO=- )
> response time 99th percentile 1845 (OK=1845 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 851 (OK=851 KO=- )
> mean response time 372 (OK=372 KO=- )
> std deviation 253 (OK=253 KO=- )
> response time 50th percentile 323 (OK=323 KO=- )
> response time 75th percentile 616 (OK=616 KO=- )
> response time 95th percentile 782 (OK=782 KO=- )
> response time 99th percentile 820 (OK=820 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 574 (OK=574 KO=- )
> mean response time 186 (OK=186 KO=- )
> std deviation 182 (OK=182 KO=- )
> response time 50th percentile 164 (OK=164 KO=- )
> response time 75th percentile 313 (OK=313 KO=- )
> response time 95th percentile 520 (OK=520 KO=- )
> response time 99th percentile 549 (OK=549 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 865 (OK=865 KO=- )
> mean response time 306 (OK=306 KO=- )
> std deviation 243 (OK=243 KO=- )
> response time 50th percentile 244 (OK=244 KO=- )
> response time 75th percentile 473 (OK=473 KO=- )
> response time 95th percentile 785 (OK=784 KO=- )
> response time 99th percentile 838 (OK=838 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7862 KO=138 )
> min response time 10 (OK=10 KO=164 )
> max response time 2295 (OK=2178 KO=2295 )
> mean response time 596 (OK=591 KO=894 )
> std deviation 339 (OK=337 KO=326 )
> response time 50th percentile 518 (OK=509 KO=854 )
> response time 75th percentile 810 (OK=800 KO=1104 )
> response time 95th percentile 1140 (OK=1135 KO=1367 )
> response time 99th percentile 1693 (OK=1694 KO=1439 )
> mean requests/sec 1333.333 (OK=1310.333 KO=23 )
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: