Java microservice framework tests in SB:3.0.3 Q:2.16.3.Final M:3.8.6 V:4.3.8 H:3.1.2 Dotnet:6 openjdk version "17.0.6" 2023-01-17 rustc 1.67.1 (d5a82bbd2 2023-02-07)
In Linux fv-az206-475 5.15.0-1033-azure #40-Ubuntu SMP Mon Jan 23 20:36:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 18.714 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 25.122 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 24.884 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 24.326 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 30.790 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 4.524 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 4.281 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 16.967 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.2M | helidon-se-netty/target/helidon-quickstart-se.jar |
18M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
14M | micronaut/target/micronaut-demo-0.1.jar |
16M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.8M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.0.3) Started DemoWebFluxApplication in 2.08 seconds (process running for 2.58)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 51 (OK=51 KO=- )
> max response time 3273 (OK=3273 KO=- )
> mean response time 1319 (OK=1319 KO=- )
> std deviation 729 (OK=729 KO=- )
> response time 50th percentile 1009 (OK=1009 KO=- )
> response time 75th percentile 1936 (OK=1936 KO=- )
> response time 95th percentile 2603 (OK=2603 KO=- )
> response time 99th percentile 2891 (OK=2891 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
:: Spring Boot :: (v3.0.3) Started DemoApplication in 2.089 seconds (process running for 2.5)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 75 (OK=75 KO=- )
> max response time 3881 (OK=3881 KO=- )
> mean response time 1339 (OK=1339 KO=- )
> std deviation 831 (OK=831 KO=- )
> response time 50th percentile 1079 (OK=1077 KO=- )
> response time 75th percentile 2073 (OK=2074 KO=- )
> response time 95th percentile 2884 (OK=2884 KO=- )
> response time 99th percentile 3156 (OK=3156 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
powered by Quarkus 2.16.3.Final) started in 0.978s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 42 (OK=42 KO=- )
> max response time 3087 (OK=3087 KO=- )
> mean response time 1161 (OK=1161 KO=- )
> std deviation 740 (OK=740 KO=- )
> response time 50th percentile 1074 (OK=1074 KO=- )
> response time 75th percentile 1589 (OK=1589 KO=- )
> response time 95th percentile 2625 (OK=2625 KO=- )
> response time 99th percentile 2878 (OK=2878 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
micronaut version:3.4.3 Startup completed in 945ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 63 (OK=63 KO=- )
> max response time 3005 (OK=3005 KO=- )
> mean response time 1279 (OK=1279 KO=- )
> std deviation 712 (OK=712 KO=- )
> response time 50th percentile 1029 (OK=1028 KO=- )
> response time 75th percentile 1786 (OK=1786 KO=- )
> response time 95th percentile 2574 (OK=2574 KO=- )
> response time 99th percentile 2905 (OK=2905 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1226 (OK=1226 KO=- )
> mean response time 455 (OK=455 KO=- )
> std deviation 331 (OK=331 KO=- )
> response time 50th percentile 394 (OK=394 KO=- )
> response time 75th percentile 734 (OK=734 KO=- )
> response time 95th percentile 1031 (OK=1031 KO=- )
> response time 99th percentile 1176 (OK=1176 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
kumuluz version:4.1.0 Server – Started Server@6ed06f69{STARTING}[10.0.9,sto=0] @3717ms
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 24 (OK=24 KO=- )
> max response time 4513 (OK=4513 KO=- )
> mean response time 1699 (OK=1699 KO=- )
> std deviation 1133 (OK=1133 KO=- )
> response time 50th percentile 1185 (OK=1185 KO=- )
> response time 75th percentile 2689 (OK=2690 KO=- )
> response time 95th percentile 3771 (OK=3773 KO=- )
> response time 99th percentile 4196 (OK=4195 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
Helidon SE 3.1.2 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 74 (OK=74 KO=- )
> max response time 3035 (OK=3035 KO=- )
> mean response time 1434 (OK=1434 KO=- )
> std deviation 674 (OK=674 KO=- )
> response time 50th percentile 1275 (OK=1276 KO=- )
> response time 75th percentile 2020 (OK=2020 KO=- )
> response time 95th percentile 2529 (OK=2529 KO=- )
> response time 99th percentile 2835 (OK=2835 KO=- )
> mean requests/sec 1000 (OK=1000 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 4736 (OK=4736 KO=- )
> mean response time 1749 (OK=1749 KO=- )
> std deviation 1074 (OK=1074 KO=- )
> response time 50th percentile 1511 (OK=1511 KO=- )
> response time 75th percentile 2664 (OK=2664 KO=- )
> response time 95th percentile 3439 (OK=3439 KO=- )
> response time 99th percentile 4435 (OK=4435 KO=- )
> mean requests/sec 888.889 (OK=888.889 KO=- )
Rust rest services #
rustc 1.67.1 (d5a82bbd2 2023-02-07)
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 614 (OK=614 KO=- )
> mean response time 166 (OK=166 KO=- )
> std deviation 163 (OK=163 KO=- )
> response time 50th percentile 138 (OK=138 KO=- )
> response time 75th percentile 281 (OK=281 KO=- )
> response time 95th percentile 473 (OK=473 KO=- )
> response time 99th percentile 544 (OK=544 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 520 (OK=520 KO=- )
> mean response time 167 (OK=167 KO=- )
> std deviation 160 (OK=160 KO=- )
> response time 50th percentile 152 (OK=152 KO=- )
> response time 75th percentile 269 (OK=269 KO=- )
> response time 95th percentile 461 (OK=461 KO=- )
> response time 99th percentile 496 (OK=496 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
rocket = { version = 0.5.0-rc.2, features = [json] }
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 531 (OK=531 KO=- )
> mean response time 154 (OK=154 KO=- )
> std deviation 160 (OK=160 KO=- )
> response time 50th percentile 121 (OK=121 KO=- )
> response time 75th percentile 255 (OK=255 KO=- )
> response time 95th percentile 449 (OK=449 KO=- )
> response time 99th percentile 508 (OK=508 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 518 (OK=518 KO=- )
> mean response time 135 (OK=135 KO=- )
> std deviation 148 (OK=148 KO=- )
> response time 50th percentile 96 (OK=96 KO=- )
> response time 75th percentile 216 (OK=216 KO=- )
> response time 95th percentile 427 (OK=427 KO=- )
> response time 99th percentile 482 (OK=482 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 13 (OK=13 KO=- )
> max response time 1912 (OK=1912 KO=- )
> mean response time 490 (OK=490 KO=- )
> std deviation 327 (OK=327 KO=- )
> response time 50th percentile 405 (OK=405 KO=- )
> response time 75th percentile 678 (OK=678 KO=- )
> response time 95th percentile 1182 (OK=1182 KO=- )
> response time 99th percentile 1442 (OK=1442 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 911 (OK=911 KO=- )
> mean response time 338 (OK=338 KO=- )
> std deviation 243 (OK=243 KO=- )
> response time 50th percentile 274 (OK=274 KO=- )
> response time 75th percentile 525 (OK=525 KO=- )
> response time 95th percentile 785 (OK=785 KO=- )
> response time 99th percentile 858 (OK=858 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 880 (OK=880 KO=- )
> mean response time 245 (OK=245 KO=- )
> std deviation 229 (OK=229 KO=- )
> response time 50th percentile 202 (OK=202 KO=- )
> response time 75th percentile 389 (OK=389 KO=- )
> response time 95th percentile 714 (OK=714 KO=- )
> response time 99th percentile 860 (OK=860 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 889 (OK=889 KO=- )
> mean response time 311 (OK=311 KO=- )
> std deviation 210 (OK=210 KO=- )
> response time 50th percentile 264 (OK=264 KO=- )
> response time 75th percentile 492 (OK=492 KO=- )
> response time 95th percentile 659 (OK=659 KO=- )
> response time 99th percentile 850 (OK=850 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 910 (OK=910 KO=- )
> mean response time 348 (OK=348 KO=- )
> std deviation 235 (OK=235 KO=- )
> response time 50th percentile 306 (OK=306 KO=- )
> response time 75th percentile 515 (OK=515 KO=- )
> response time 95th percentile 774 (OK=774 KO=- )
> response time 99th percentile 803 (OK=803 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 1100 (OK=1100 KO=- )
> mean response time 363 (OK=363 KO=- )
> std deviation 273 (OK=273 KO=- )
> response time 50th percentile 300 (OK=300 KO=- )
> response time 75th percentile 519 (OK=519 KO=- )
> response time 95th percentile 910 (OK=910 KO=- )
> response time 99th percentile 1065 (OK=1065 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 586 (OK=586 KO=- )
> mean response time 164 (OK=164 KO=- )
> std deviation 166 (OK=166 KO=- )
> response time 50th percentile 135 (OK=135 KO=- )
> response time 75th percentile 252 (OK=252 KO=- )
> response time 95th percentile 487 (OK=487 KO=- )
> response time 99th percentile 509 (OK=509 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=8000 KO=0 )
> min response time 0 (OK=0 KO=- )
> max response time 780 (OK=780 KO=- )
> mean response time 293 (OK=293 KO=- )
> std deviation 228 (OK=228 KO=- )
> response time 50th percentile 264 (OK=264 KO=- )
> response time 75th percentile 488 (OK=488 KO=- )
> response time 95th percentile 696 (OK=696 KO=- )
> response time 99th percentile 760 (OK=760 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 8000 (OK=7866 KO=134 )
> min response time 14 (OK=14 KO=198 )
> max response time 1560 (OK=1560 KO=1112 )
> mean response time 468 (OK=463 KO=760 )
> std deviation 257 (OK=256 KO=179 )
> response time 50th percentile 423 (OK=417 KO=809 )
> response time 75th percentile 625 (OK=613 KO=894 )
> response time 95th percentile 912 (OK=905 KO=1004 )
> response time 99th percentile 1054 (OK=1049 KO=1109 )
> mean requests/sec 1333.333 (OK=1311 KO=22.333)
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: