sander/arraybench
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

v1.2 (run from cmdline with verbose gc)

Browse source
This commit is contained in:
Shautvast 2023-08-28 20:35:15 +02:00
parent 3565518131
commit 760b737cf4
1 changed files with 90 additions and 129 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

219
log
View file

@ -1,74 +1,9 @@
➜ java -Djmh.blackhole.mode=COMPILER -verbose:gc -jar target/benchmark.jar com.github.shautvast.benchmarks.loops.LoopBenchmark
MultiDim on  main [⇡] via ☕ v20.0.1 [0.003s][info][gc] Using G1
➜ mvn clean package
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------< org.example:MultiDim >------------------------
[INFO] Building MultiDim 1.0-SNAPSHOT
[INFO] from pom.xml
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- clean:3.2.0:clean (default-clean) @ MultiDim ---
[INFO] Deleting /Users/Shautvast/dev/MultiDim/target
[INFO]
[INFO] --- resources:3.3.0:resources (default-resources) @ MultiDim ---
[INFO] Copying 0 resource
[INFO]
[INFO] --- compiler:3.8.0:compile (default-compile) @ MultiDim ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /Users/Shautvast/dev/MultiDim/target/classes
[INFO]
[INFO] --- resources:3.3.0:testResources (default-testResources) @ MultiDim ---
[INFO] skip non existing resourceDirectory /Users/Shautvast/dev/MultiDim/src/test/resources
[INFO]
[INFO] --- compiler:3.8.0:testCompile (default-testCompile) @ MultiDim ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /Users/Shautvast/dev/MultiDim/target/test-classes
[INFO]
[INFO] --- surefire:3.0.0-M8:test (default-test) @ MultiDim ---
[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running com.github.shautvast.benchmarks.arrays.IntArrayTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 s - in com.github.shautvast.benchmarks.arrays.IntArrayTest
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO]
[INFO] --- jar:3.3.0:jar (default-jar) @ MultiDim ---
[INFO] Building jar: /Users/Shautvast/dev/MultiDim/target/MultiDim-1.0-SNAPSHOT.jar
[INFO]
[INFO] --- shade:3.2.4:shade (default) @ MultiDim ---
[INFO] Including org.openjdk.jmh:jmh-core:jar:1.36 in the shaded jar.
[INFO] Including net.sf.jopt-simple:jopt-simple:jar:5.0.4 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.2 in the shaded jar.
[WARNING] MultiDim-1.0-SNAPSHOT.jar, commons-math3-3.2.jar, jmh-core-1.36.jar, jopt-simple-5.0.4.jar define 1 overlapping resource:
[WARNING] - META-INF/MANIFEST.MF
[WARNING] maven-shade-plugin has detected that some class files are
[WARNING] present in two or more JARs. When this happens, only one
[WARNING] single version of the class is copied to the uber jar.
[WARNING] Usually this is not harmful and you can skip these warnings,
[WARNING] otherwise try to manually exclude artifacts based on
[WARNING] mvn dependency:tree -Ddetail=true and the above output.
[WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
[INFO] Replacing /Users/Shautvast/dev/MultiDim/target/benchmark.jar with /Users/Shautvast/dev/MultiDim/target/MultiDim-1.0-SNAPSHOT-shaded.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.759 s
[INFO] Finished at: 2023-08-28T20:19:01+02:00
[INFO] ------------------------------------------------------------------------
MultiDim on  main [⇡] via ☕ v20.0.1 took 2s
➜ java -Djmh.blackhole.mode=COMPILER -jar target/benchmark.jar com.github.shautvast.benchmarks.loops.LoopBenchmark
# JMH version: 1.36 # JMH version: 1.36
# VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29 # VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29
# VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java # VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java
# VM options: -Djmh.blackhole.mode=COMPILER # VM options: -Djmh.blackhole.mode=COMPILER -verbose:gc
# Blackhole mode: compiler (forced) # Blackhole mode: compiler (forced)
# Warmup: 5 iterations, 10 s each # Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each
@ -79,28 +14,29 @@ MultiDim on  main [⇡] via ☕ v20.0.1 took 2s
# Run progress: 0,00% complete, ETA 00:06:40 # Run progress: 0,00% complete, ETA 00:06:40
# Fork: 1 of 1 # Fork: 1 of 1
# Warmup Iteration 1: 1754,846 ns/op [0.003s][info][gc] Using G1
# Warmup Iteration 2: 1884,679 ns/op # Warmup Iteration 1: 1754,284 ns/op
# Warmup Iteration 3: 1879,891 ns/op # Warmup Iteration 2: 1880,906 ns/op
# Warmup Iteration 4: 1885,271 ns/op # Warmup Iteration 3: 1876,949 ns/op
# Warmup Iteration 5: 1885,652 ns/op # Warmup Iteration 4: 1878,817 ns/op
Iteration 1: 1879,235 ns/op # Warmup Iteration 5: 1878,709 ns/op
Iteration 2: 1881,657 ns/op Iteration 1: 1878,447 ns/op
Iteration 3: 1881,831 ns/op Iteration 2: 1885,419 ns/op
Iteration 4: 1879,397 ns/op Iteration 3: 1875,054 ns/op
Iteration 5: 1879,111 ns/op Iteration 4: 1873,731 ns/op
Iteration 5: 1874,494 ns/op
Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.cStyle": Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.cStyle":
1880,246 ±(99.9%) 5,285 ns/op [Average] 1877,429 ±(99.9%) 18,547 ns/op [Average]
(min, avg, max) = (1879,111, 1880,246, 1881,831), stdev = 1,372 (min, avg, max) = (1873,731, 1877,429, 1885,419), stdev = 4,817
CI (99.9%): [1874,961, 1885,531] (assumes normal distribution) CI (99.9%): [1858,882, 1895,976] (assumes normal distribution)
# JMH version: 1.36 # JMH version: 1.36
# VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29 # VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29
# VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java # VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java
# VM options: -Djmh.blackhole.mode=COMPILER # VM options: -Djmh.blackhole.mode=COMPILER -verbose:gc
# Blackhole mode: compiler (forced) # Blackhole mode: compiler (forced)
# Warmup: 5 iterations, 10 s each # Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each
@ -111,28 +47,29 @@ Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.cStyle":
# Run progress: 25,00% complete, ETA 00:05:00 # Run progress: 25,00% complete, ETA 00:05:00
# Fork: 1 of 1 # Fork: 1 of 1
# Warmup Iteration 1: 1758,171 ns/op [0.003s][info][gc] Using G1
# Warmup Iteration 2: 3555,794 ns/op # Warmup Iteration 1: 1756,742 ns/op
# Warmup Iteration 3: 5447,708 ns/op # Warmup Iteration 2: 3557,042 ns/op
# Warmup Iteration 4: 7102,611 ns/op # Warmup Iteration 3: 5425,266 ns/op
# Warmup Iteration 5: 8883,170 ns/op # Warmup Iteration 4: 7101,989 ns/op
Iteration 1: 10641,709 ns/op # Warmup Iteration 5: 8871,875 ns/op
Iteration 2: 12409,978 ns/op Iteration 1: 10636,875 ns/op
Iteration 3: 14275,489 ns/op Iteration 2: 12417,359 ns/op
Iteration 4: 16068,675 ns/op Iteration 3: 14469,683 ns/op
Iteration 5: 19156,937 ns/op Iteration 4: 16248,110 ns/op
Iteration 5: 17946,403 ns/op
Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.enhancedForLoop": Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.enhancedForLoop":
14510,558 ±(99.9%) 12691,399 ns/op [Average] 14343,686 ±(99.9%) 11238,581 ns/op [Average]
(min, avg, max) = (10641,709, 14510,558, 19156,937), stdev = 3295,916 (min, avg, max) = (10636,875, 14343,686, 17946,403), stdev = 2918,624
CI (99.9%): [1819,158, 27201,957] (assumes normal distribution) CI (99.9%): [3105,105, 25582,267] (assumes normal distribution)
# JMH version: 1.36 # JMH version: 1.36
# VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29 # VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29
# VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java # VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java
# VM options: -Djmh.blackhole.mode=COMPILER # VM options: -Djmh.blackhole.mode=COMPILER -verbose:gc
# Blackhole mode: compiler (forced) # Blackhole mode: compiler (forced)
# Warmup: 5 iterations, 10 s each # Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each
@ -143,28 +80,29 @@ Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.enhancedForLoop":
# Run progress: 50,00% complete, ETA 00:03:20 # Run progress: 50,00% complete, ETA 00:03:20
# Fork: 1 of 1 # Fork: 1 of 1
# Warmup Iteration 1: 1835,952 ns/op [0.003s][info][gc] Using G1
# Warmup Iteration 2: 3563,263 ns/op # Warmup Iteration 1: 1761,563 ns/op
# Warmup Iteration 3: 5335,119 ns/op # Warmup Iteration 2: 3563,533 ns/op
# Warmup Iteration 4: 7131,803 ns/op # Warmup Iteration 3: 5422,159 ns/op
# Warmup Iteration 5: 8904,488 ns/op # Warmup Iteration 4: 7090,576 ns/op
Iteration 1: 10828,723 ns/op # Warmup Iteration 5: 8872,802 ns/op
Iteration 2: 12809,433 ns/op Iteration 1: 10809,548 ns/op
Iteration 3: 14710,805 ns/op Iteration 2: 12595,235 ns/op
Iteration 4: 16240,606 ns/op Iteration 3: 14456,839 ns/op
Iteration 5: 18024,774 ns/op Iteration 4: 16226,710 ns/op
Iteration 5: 18015,564 ns/op
Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.iterator": Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.iterator":
14522,868 ±(99.9%) 10862,615 ns/op [Average] 14420,779 ±(99.9%) 10985,942 ns/op [Average]
(min, avg, max) = (10828,723, 14522,868, 18024,774), stdev = 2820,987 (min, avg, max) = (10809,548, 14420,779, 18015,564), stdev = 2853,014
CI (99.9%): [3660,253, 25385,483] (assumes normal distribution) CI (99.9%): [3434,837, 25406,721] (assumes normal distribution)
# JMH version: 1.36 # JMH version: 1.36
# VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29 # VM version: JDK 20.0.1, OpenJDK 64-Bit Server VM, 20.0.1+9-29
# VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java # VM invoker: /Users/Shautvast/Library/Java/JavaVirtualMachines/openjdk-20.0.1/Contents/Home/bin/java
# VM options: -Djmh.blackhole.mode=COMPILER # VM options: -Djmh.blackhole.mode=COMPILER -verbose:gc
# Blackhole mode: compiler (forced) # Blackhole mode: compiler (forced)
# Warmup: 5 iterations, 10 s each # Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each
@ -175,22 +113,46 @@ Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.iterator":
# Run progress: 75,00% complete, ETA 00:01:40 # Run progress: 75,00% complete, ETA 00:01:40
# Fork: 1 of 1 # Fork: 1 of 1
# Warmup Iteration 1: 687,521 ns/op [0.003s][info][gc] Using G1
# Warmup Iteration 2: 2484,195 ns/op # Warmup Iteration 1: [0.262s][info][gc] GC(0) Pause Young (Normal) (G1 Evacuation Pause) 27M->5M(520M) 1.402ms
# Warmup Iteration 3: 3816,503 ns/op [0.403s][info][gc] GC(1) Pause Young (Normal) (G1 Evacuation Pause) 45M->5M(520M) 0.968ms
# Warmup Iteration 4: 4899,563 ns/op [1.547s][info][gc] GC(2) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.898ms
# Warmup Iteration 5: 6199,629 ns/op [2.638s][info][gc] GC(3) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.976ms
Iteration 1: 7231,628 ns/op [3.697s][info][gc] GC(4) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.873ms
Iteration 2: 8320,882 ns/op [4.757s][info][gc] GC(5) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.908ms
Iteration 3: 9489,397 ns/op [5.820s][info][gc] GC(6) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.862ms
Iteration 4: 10825,228 ns/op [6.886s][info][gc] GC(7) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.891ms
Iteration 5: 12090,832 ns/op [7.941s][info][gc] GC(8) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.886ms
[9.006s][info][gc] GC(9) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.859ms
[10.064s][info][gc] GC(10) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.891ms
690,839 ns/op
# Warmup Iteration 2: [13.586s][info][gc] GC(11) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.895ms
[16.410s][info][gc] GC(12) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.920ms
[19.179s][info][gc] GC(13) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.953ms
2476,292 ns/op
# Warmup Iteration 3: [23.479s][info][gc] GC(14) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 1.045ms
[28.118s][info][gc] GC(15) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 1.149ms
3834,642 ns/op
# Warmup Iteration 4: [33.560s][info][gc] GC(16) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.554ms
[39.269s][info][gc] GC(17) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.602ms
4859,494 ns/op
# Warmup Iteration 5: [46.829s][info][gc] GC(18) Pause Young (Normal) (G1 Evacuation Pause) 305M->5M(520M) 0.605ms
6219,711 ns/op
Iteration 1: [55.043s][info][gc] GC(19) Pause Young (Normal) (G1 Evacuation Pause) 305M->6M(520M) 0.601ms
7151,609 ns/op
Iteration 2: [64.223s][info][gc] GC(20) Pause Young (Normal) (G1 Evacuation Pause) 306M->6M(520M) 0.641ms
8273,040 ns/op
Iteration 3: [74.942s][info][gc] GC(21) Pause Young (Normal) (G1 Evacuation Pause) 306M->6M(520M) 0.580ms
9447,701 ns/op
Iteration 4: [87.347s][info][gc] GC(22) Pause Young (Normal) (G1 Evacuation Pause) 306M->6M(520M) 0.617ms
10760,223 ns/op
Iteration 5: 12082,030 ns/op
Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.stream": Result "com.github.shautvast.benchmarks.loops.LoopBenchmark.stream":
9591,593 ±(99.9%) 7447,447 ns/op [Average] 9542,921 ±(99.9%) 7523,289 ns/op [Average]
(min, avg, max) = (7231,628, 9591,593, 12090,832), stdev = 1934,078 (min, avg, max) = (7151,609, 9542,921, 12082,030), stdev = 1953,774
CI (99.9%): [2144,147, 17039,040] (assumes normal distribution) CI (99.9%): [2019,632, 17066,210] (assumes normal distribution)
# Run complete. Total time: 00:06:40 # Run complete. Total time: 00:06:40
@ -208,11 +170,10 @@ different JVMs are already problematic, the performance difference caused by dif
modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons. modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
Benchmark Mode Cnt Score Error Units Benchmark Mode Cnt Score Error Units
LoopBenchmark.cStyle avgt 5 1880,246 ± 5,285 ns/op LoopBenchmark.cStyle avgt 5 1877,429 ± 18,547 ns/op
LoopBenchmark.enhancedForLoop avgt 5 14510,558 ± 12691,399 ns/op LoopBenchmark.enhancedForLoop avgt 5 14343,686 ± 11238,581 ns/op
LoopBenchmark.iterator avgt 5 14522,868 ± 10862,615 ns/op LoopBenchmark.iterator avgt 5 14420,779 ± 10985,942 ns/op
LoopBenchmark.stream avgt 5 9591,593 ± 7447,447 ns/op LoopBenchmark.stream avgt 5 9542,921 ± 7523,289 ns/op
MultiDim on  main [⇡] via ☕ v20.0.1 took 6m40s MultiDim on  main [⇡] via ☕ v20.0.1 took 6m40s
➜ ➜