Java microservice framework tests in SB:3.1.2 Q:3.2.2.Final M:4.0.1 V:4.4.4 H:3.2.2 Dotnet:6 openjdk version "20.0.2" 2023-07-18 rustc 1.71.0 (8ede3aae2 2023-07-12)
In Linux fv-az617-42 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux, Below is total package generation times for separate modules,
[INFO] eclipse-microprofile-kumuluz-test 1.0-SNAPSHOT ..... SUCCESS [ 19.925 s]
[INFO] helidon-quickstart-se 1.0-SNAPSHOT ................. SUCCESS [ 26.291 s]
[INFO] ktor-demo 1.0.1-SNAPSHOT ........................... SUCCESS [ 27.357 s]
[INFO] micronaut-demo 0.1 ................................. SUCCESS [ 25.715 s]
[INFO] quarkus-demo 1.0.0-SNAPSHOT ........................ SUCCESS [ 37.072 s]
[INFO] springboot-webflux-demo 0.0.1-SNAPSHOT ............. SUCCESS [ 5.924 s]
[INFO] springboot-demo-web 0.0.1-SNAPSHOT ................. SUCCESS [ 5.912 s]
[INFO] vertx-demo 1.0.0-SNAPSHOT .......................... SUCCESS [ 16.378 s]
Size of created packages:
Size in MB | Name |
---|---|
22M | eclipse-microprofile-kumuluz-test/target/eclipse-microprofile-kumuluz-test-1.0-SNAPSHOT.jar |
7.5M | helidon-se-netty/target/helidon-quickstart-se.jar |
19M | ktor-demo/target/ktor-demo-1.0.1-SNAPSHOT-jar-with-dependencies.jar |
13M | micronaut/target/micronaut-demo-0.1.jar |
17M | quarkus/target/quarkus-demo-1.0.0-SNAPSHOT-runner.jar |
20M | spring-boot-web/target/springboot-demo-web-0.0.1-SNAPSHOT.jar |
23M | spring-boot-webflux/target/springboot-webflux-demo-0.0.1-SNAPSHOT.jar |
7.9M | vertx/target/vertx-demo-1.0.0-SNAPSHOT-fat.jar |
:: Spring Boot :: (v3.1.2) Started DemoWebFluxApplication in 2.584 seconds (process running for 3.285)
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 77 (OK=77 KO=- )
> max response time 5397 (OK=5397 KO=- )
> mean response time 1536 (OK=1536 KO=- )
> std deviation 1005 (OK=1005 KO=- )
> response time 50th percentile 1343 (OK=1342 KO=- )
> response time 75th percentile 1619 (OK=1619 KO=- )
> response time 95th percentile 4170 (OK=4153 KO=- )
> response time 99th percentile 5172 (OK=5172 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
:: Spring Boot :: (v3.1.2) Started DemoApplication in 2.571 seconds (process running for 3.134)
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 86 (OK=86 KO=- )
> max response time 4529 (OK=4529 KO=- )
> mean response time 1607 (OK=1607 KO=- )
> std deviation 939 (OK=939 KO=- )
> response time 50th percentile 1363 (OK=1364 KO=- )
> response time 75th percentile 1730 (OK=1731 KO=- )
> response time 95th percentile 3414 (OK=3415 KO=- )
> response time 99th percentile 4232 (OK=4232 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
powered by Quarkus 3.2.2.Final) started in 1.258s. Listening on: http://0.0.0.0:8080
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 89 (OK=89 KO=- )
> max response time 3666 (OK=3666 KO=- )
> mean response time 1281 (OK=1281 KO=- )
> std deviation 696 (OK=696 KO=- )
> response time 50th percentile 1044 (OK=1044 KO=- )
> response time 75th percentile 1469 (OK=1469 KO=- )
> response time 95th percentile 2830 (OK=2831 KO=- )
> response time 99th percentile 3318 (OK=3318 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
micronaut version:4.0.1 Startup completed in 1235ms. Server Running: http://localhost:8080
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 32 (OK=32 KO=- )
> max response time 4056 (OK=4056 KO=- )
> mean response time 1313 (OK=1313 KO=- )
> std deviation 762 (OK=762 KO=- )
> response time 50th percentile 1076 (OK=1076 KO=- )
> response time 75th percentile 1432 (OK=1432 KO=- )
> response time 95th percentile 2741 (OK=2741 KO=- )
> response time 99th percentile 3926 (OK=3926 KO=- )
> mean requests/sec 1600 (OK=1600 KO=- )
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 28 (OK=28 KO=- )
> max response time 1935 (OK=1935 KO=- )
> mean response time 812 (OK=812 KO=- )
> std deviation 416 (OK=416 KO=- )
> response time 50th percentile 733 (OK=733 KO=- )
> response time 75th percentile 985 (OK=985 KO=- )
> response time 95th percentile 1621 (OK=1621 KO=- )
> response time 99th percentile 1869 (OK=1869 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
kumuluz version:4.1.0 Server – Started Server@2ba33e2c{STARTING}[10.0.9,sto=0] @3768ms
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 112 (OK=112 KO=- )
> max response time 6492 (OK=6492 KO=- )
> mean response time 2142 (OK=2142 KO=- )
> std deviation 1419 (OK=1419 KO=- )
> response time 50th percentile 1642 (OK=1641 KO=- )
> response time 75th percentile 2178 (OK=2178 KO=- )
> response time 95th percentile 5165 (OK=5164 KO=- )
> response time 99th percentile 6107 (OK=6107 KO=- )
> mean requests/sec 1142.857 (OK=1142.857 KO=- )
Helidon SE 3.2.2 features: [Config, Fault Tolerance, Health, Metrics, Tracing, WebServer]
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 61 (OK=61 KO=- )
> max response time 3558 (OK=3558 KO=- )
> mean response time 1849 (OK=1849 KO=- )
> std deviation 668 (OK=668 KO=- )
> response time 50th percentile 1838 (OK=1838 KO=- )
> response time 75th percentile 2074 (OK=2074 KO=- )
> response time 95th percentile 3152 (OK=3152 KO=- )
> response time 99th percentile 3384 (OK=3384 KO=- )
> mean requests/sec 1333.333 (OK=1333.333 KO=- )
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 3 (OK=3 KO=- )
> max response time 6000 (OK=6000 KO=- )
> mean response time 2444 (OK=2444 KO=- )
> std deviation 1446 (OK=1446 KO=- )
> response time 50th percentile 2558 (OK=2558 KO=- )
> response time 75th percentile 3150 (OK=3150 KO=- )
> response time 95th percentile 5021 (OK=5021 KO=- )
> response time 99th percentile 5438 (OK=5438 KO=- )
> mean requests/sec 1066.667 (OK=1066.667 KO=- )
Rust rest services #
rustc 1.71.0 (8ede3aae2 2023-07-12)
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 12 (OK=12 KO=- )
> max response time 1010 (OK=1010 KO=- )
> mean response time 440 (OK=440 KO=- )
> std deviation 235 (OK=235 KO=- )
> response time 50th percentile 395 (OK=395 KO=- )
> response time 75th percentile 489 (OK=489 KO=- )
> response time 95th percentile 914 (OK=914 KO=- )
> response time 99th percentile 951 (OK=951 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 7 (OK=7 KO=- )
> max response time 1230 (OK=1230 KO=- )
> mean response time 468 (OK=468 KO=- )
> std deviation 268 (OK=268 KO=- )
> response time 50th percentile 408 (OK=408 KO=- )
> response time 75th percentile 587 (OK=587 KO=- )
> response time 95th percentile 1038 (OK=1038 KO=- )
> response time 99th percentile 1158 (OK=1158 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
rocket = { version = 0.5.0-rc.3, features = [json] }
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 4 (OK=4 KO=- )
> max response time 1218 (OK=1218 KO=- )
> mean response time 475 (OK=475 KO=- )
> std deviation 257 (OK=257 KO=- )
> response time 50th percentile 413 (OK=413 KO=- )
> response time 75th percentile 561 (OK=561 KO=- )
> response time 95th percentile 1029 (OK=1029 KO=- )
> response time 99th percentile 1121 (OK=1121 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 13 (OK=13 KO=- )
> max response time 1955 (OK=1955 KO=- )
> mean response time 501 (OK=501 KO=- )
> std deviation 282 (OK=282 KO=- )
> response time 50th percentile 450 (OK=450 KO=- )
> response time 75th percentile 607 (OK=607 KO=- )
> response time 95th percentile 1064 (OK=1064 KO=- )
> response time 99th percentile 1192 (OK=1192 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
Dotnet 6 rest service #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 8 (OK=8 KO=- )
> max response time 1939 (OK=1939 KO=- )
> mean response time 868 (OK=868 KO=- )
> std deviation 449 (OK=449 KO=- )
> response time 50th percentile 734 (OK=734 KO=- )
> response time 75th percentile 994 (OK=995 KO=- )
> response time 95th percentile 1740 (OK=1740 KO=- )
> response time 99th percentile 1889 (OK=1889 KO=- )
> mean requests/sec 1777.778 (OK=1777.778 KO=- )
Dotnet 7 rest service #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 6 (OK=6 KO=- )
> max response time 1714 (OK=1714 KO=- )
> mean response time 631 (OK=631 KO=- )
> std deviation 352 (OK=352 KO=- )
> response time 50th percentile 561 (OK=561 KO=- )
> response time 75th percentile 781 (OK=781 KO=- )
> response time 95th percentile 1392 (OK=1392 KO=- )
> response time 99th percentile 1616 (OK=1616 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
graalvm native quarkus #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 22 (OK=22 KO=- )
> max response time 1552 (OK=1552 KO=- )
> mean response time 623 (OK=623 KO=- )
> std deviation 335 (OK=335 KO=- )
> response time 50th percentile 534 (OK=534 KO=- )
> response time 75th percentile 719 (OK=719 KO=- )
> response time 95th percentile 1322 (OK=1322 KO=- )
> response time 99th percentile 1446 (OK=1446 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
graalvm native micronaut #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 17 (OK=17 KO=- )
> max response time 1564 (OK=1564 KO=- )
> mean response time 637 (OK=637 KO=- )
> std deviation 316 (OK=316 KO=- )
> response time 50th percentile 544 (OK=544 KO=- )
> response time 75th percentile 753 (OK=754 KO=- )
> response time 95th percentile 1312 (OK=1312 KO=- )
> response time 99th percentile 1432 (OK=1432 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
graalvm native spring-boot-web #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 11 (OK=11 KO=- )
> max response time 2769 (OK=2769 KO=- )
> mean response time 832 (OK=832 KO=- )
> std deviation 458 (OK=458 KO=- )
> response time 50th percentile 719 (OK=719 KO=- )
> response time 75th percentile 925 (OK=925 KO=- )
> response time 95th percentile 1768 (OK=1768 KO=- )
> response time 99th percentile 1914 (OK=1914 KO=- )
> mean requests/sec 1777.778 (OK=1777.778 KO=- )
graalvm native spring-boot-webflux #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 13 (OK=13 KO=- )
> max response time 1659 (OK=1659 KO=- )
> mean response time 673 (OK=673 KO=- )
> std deviation 335 (OK=335 KO=- )
> response time 50th percentile 598 (OK=598 KO=- )
> response time 75th percentile 766 (OK=766 KO=- )
> response time 95th percentile 1363 (OK=1362 KO=- )
> response time 99th percentile 1495 (OK=1495 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
graalvm native vertx #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 11 (OK=11 KO=- )
> max response time 1180 (OK=1180 KO=- )
> mean response time 491 (OK=491 KO=- )
> std deviation 269 (OK=269 KO=- )
> response time 50th percentile 419 (OK=419 KO=- )
> response time 75th percentile 608 (OK=608 KO=- )
> response time 95th percentile 1039 (OK=1040 KO=- )
> response time 99th percentile 1161 (OK=1161 KO=- )
> mean requests/sec 2285.714 (OK=2285.714 KO=- )
graalvm native helidon #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=16000 KO=0 )
> min response time 1 (OK=1 KO=- )
> max response time 1511 (OK=1511 KO=- )
> mean response time 636 (OK=636 KO=- )
> std deviation 341 (OK=341 KO=- )
> response time 50th percentile 567 (OK=567 KO=- )
> response time 75th percentile 703 (OK=703 KO=- )
> response time 95th percentile 1321 (OK=1321 KO=- )
> response time 99th percentile 1400 (OK=1399 KO=- )
> mean requests/sec 2000 (OK=2000 KO=- )
graalvm native ktor rest service #
---- Global Information --------------------------------------------------------
> request count 16000 (OK=15988 KO=12 )
> min response time 3 (OK=3 KO=948 )
> max response time 3220 (OK=3220 KO=2083 )
> mean response time 851 (OK=851 KO=1715 )
> std deviation 432 (OK=431 KO=368 )
> response time 50th percentile 781 (OK=780 KO=1814 )
> response time 75th percentile 1105 (OK=1104 KO=1898 )
> response time 95th percentile 1651 (OK=1650 KO=2082 )
> response time 99th percentile 1933 (OK=1932 KO=2083 )
> mean requests/sec 1777.778 (OK=1776.444 KO=1.333 )
source code for the java and dotnet tests :point_left: source code for the rust tests :point_left: github action :point_left: