Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1136cf17214a9402d00a362e28f1329685f0d0fd (+ 369 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Oz_LTO-build/3/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0003 (llvmorg-16-init-17738-g1136cf17214a) 2023-01-14T22:42:31 0:00:00
Previous 0002 (llvmorg-16-init-17369-gdca40e3288f4) 2023-01-11T00:43:43 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 21
Performance Improvements 74 81
Added Tests 6 6
Unchanged Tests 674 672
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm 6.12% 13316.000 14131.000 - 6.58% -
482.sphinx3 3.40% 26803.000 27713.000 - 3.86% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) 12380.00% 0.050 6.240 - 10300.00% -
444.namd (unexplained diff vs previous) 12050.00% 6.000 729.000 - 9012.50% -
470.lbm (unexplained diff vs previous) 1329.82% 57.000 815.000 - 1.37% -
470.lbm (unexplained diff vs previous) (percentage) 1241.86% 0.430 5.770 - -4.79% -
473.astar (unexplained diff vs previous) (percentage) 533.33% 0.030 0.190 - -5.00% -
473.astar (unexplained diff vs previous) 475.00% 4.000 23.000 - -8.00% -
462.libquantum (unexplained diff vs previous) 325.00% 24.000 102.000 - 10100.00% -
462.libquantum (unexplained diff vs previous) (percentage) 311.76% 0.170 0.700 - 6900.00% -
456.hmmer (unexplained diff vs previous) 78.05% 41.000 73.000 - 58.70% -
456.hmmer (unexplained diff vs previous) (percentage) 74.29% 0.350 0.610 - 56.41% -
450.soplex (unexplained diff vs previous) 40.00% 35.000 49.000 - -28.99% -
450.soplex (unexplained diff vs previous) (percentage) 39.13% 0.230 0.320 - -30.43% -
470.lbm (max) 36.06% 635.000 864.000 - 13.98% -
470.lbm (max) (percentage) 28.30% 4.770 6.120 - 6.99% -
429.mcf (unexplained diff vs previous) 23.08% 26.000 32.000 - 45.45% -
429.mcf (unexplained diff vs previous) (percentage) 21.05% 0.190 0.230 - 43.75% -
470.lbm 14.36% 411.000 470.000 - 6.58% -
470.lbm (avg) 14.36% 411.000 470.000 - 6.58% -
444.namd (avg) (percentage) 13.25% 2.340 2.650 - 3.11% -
470.lbm (avg) (percentage) 7.77% 3.090 3.330 - 0.00% -
444.namd 6.55% 290.000 309.000 - -2.83% -
444.namd (avg) 6.55% 290.000 309.000 - -2.83% -
482.sphinx3 3.43% 466.000 482.000 - 3.88% -
482.sphinx3 (avg) 3.43% 466.000 482.000 - 3.88% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -5.88% 12406.000 11677.000 - -5.83% -
433.milc -1.68% 13611.000 13382.000 - -1.61% -
471.omnetpp -1.37% 10630.000 10484.000 - 0.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (max) -84.34% 913.000 143.000 - -85.29% -
471.omnetpp (max) (percentage) -84.05% 8.590 1.370 - -85.24% -
447.dealII (unexplained diff vs previous) (percentage) -77.91% 0.860 0.190 - -67.24% -
447.dealII (unexplained diff vs previous) -77.50% 80.000 18.000 - -66.67% -
447.dealII (max) -69.90% 196.000 59.000 - -73.54% -
447.dealII (max) (percentage) -69.67% 2.110 0.640 - -73.11% -
401.bzip2 (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 - -90.00% -
401.bzip2 (unexplained diff vs previous) -50.00% 8.000 4.000 - -87.88% -
483.xalancbmk (max) (percentage) -12.52% 12.460 10.900 - -15.50% -
483.xalancbmk (max) -11.88% 1170.000 1031.000 - -14.72% -
444.namd (max) -11.76% 918.000 810.000 - -19.24% -
458.sjeng (max) -10.42% 816.000 731.000 - -16.55% -
464.h264ref (avg) (percentage) -10.34% 0.290 0.260 - -10.34% -
458.sjeng (max) (percentage) -10.33% 4.840 4.340 - -15.56% -
464.h264ref -9.52% 42.000 38.000 - -9.52% -
464.h264ref (avg) -9.52% 42.000 38.000 - -9.52% -
483.xalancbmk (avg) (percentage) -9.43% 2.120 1.920 - -9.43% -
483.xalancbmk -9.05% 199.000 181.000 - -8.59% -
483.xalancbmk (avg) -9.05% 199.000 181.000 - -8.59% -
458.sjeng -8.89% 135.000 123.000 - -9.56% -
458.sjeng (avg) -8.89% 135.000 123.000 - -9.56% -
458.sjeng (avg) (percentage) -8.75% 0.800 0.730 - -8.75% -
401.bzip2 -8.33% 96.000 88.000 - -15.38% -
401.bzip2 (avg) -8.33% 96.000 88.000 - -15.38% -
401.bzip2 (avg) (percentage) -8.33% 0.600 0.550 - -15.38% -
482.sphinx3 (max) (percentage) -7.38% 2.980 2.760 - -16.62% -
429.mcf -7.38% 271.000 251.000 - -15.20% -
429.mcf (avg) -7.38% 271.000 251.000 - -15.20% -
429.mcf (avg) (percentage) -7.22% 1.940 1.800 - -15.09% -
429.mcf (max) -6.90% 2057.000 1915.000 - -16.05% -
447.dealII (avg) (percentage) -6.80% 1.030 0.960 - -8.57% -
429.mcf (max) (percentage) -6.68% 14.680 13.700 - -16.00% -
473.astar (max) -6.43% 731.000 684.000 - -16.79% -
447.dealII -6.32% 95.000 89.000 - -9.18% -
447.dealII (avg) -6.32% 95.000 89.000 - -9.18% -
401.bzip2 (max) -6.28% 541.000 507.000 - -16.75% -
456.hmmer (max) (percentage) -6.26% 9.580 8.980 - -14.31% -
401.bzip2 (max) (percentage) -6.25% 3.360 3.150 - -16.67% -
444.namd (max) (percentage) -6.22% 7.400 6.940 - -14.22% -
473.astar (max) (percentage) -6.21% 5.960 5.590 - -16.57% -
450.soplex (max) (percentage) -6.12% 1.470 1.380 - -16.36% -
403.gcc (max) (percentage) -6.10% 2.130 2.000 - -14.16% -
445.gobmk (max) -6.04% 381.000 358.000 - -13.32% -
473.astar (avg) (percentage) -6.02% 0.830 0.780 - -15.22% -
403.gcc (max) -5.94% 202.000 190.000 - -14.03% -
473.astar -5.94% 101.000 95.000 - -15.18% -
473.astar (avg) -5.94% 101.000 95.000 - -15.18% -
450.soplex (max) -5.88% 221.000 208.000 - -16.47% -
445.gobmk (max) (percentage) -5.80% 3.450 3.250 - -12.87% -
462.libquantum (max) (percentage) -5.75% 5.910 5.570 - -12.70% -
456.hmmer (max) -5.66% 1131.000 1067.000 - -14.09% -
462.libquantum (max) -5.18% 850.000 806.000 - -12.30% -
433.milc (max) -4.72% 106.000 101.000 - -6.48% -
456.hmmer (avg) (percentage) -4.62% 1.300 1.240 - -10.79% -
471.omnetpp (unexplained diff vs previous) -4.58% 153.000 146.000 - 41.75% -
482.sphinx3 (max) -4.26% 798.000 764.000 - -13.48% -
456.hmmer -3.92% 153.000 147.000 - -10.37% -
456.hmmer (avg) -3.92% 153.000 147.000 - -10.37% -
471.omnetpp (unexplained diff vs previous) (percentage) -3.47% 1.440 1.390 - 41.84% -
471.omnetpp -2.96% 169.000 164.000 - -1.80% -
471.omnetpp (avg) -2.96% 169.000 164.000 - -1.80% -
433.milc (max) (percentage) -2.56% 0.780 0.760 - -5.00% -
464.h264ref (max) (percentage) -2.38% 0.420 0.410 - -2.38% -
433.milc -1.89% 106.000 104.000 - -10.34% -
433.milc (avg) -1.89% 106.000 104.000 - -10.34% -
453.povray -1.79% 56.000 55.000 - 0.00% -
453.povray (avg) -1.79% 56.000 55.000 - 0.00% -
464.h264ref (max) -1.64% 61.000 60.000 - 0.00% -
450.soplex -1.43% 70.000 69.000 - -8.00% -
450.soplex (avg) -1.43% 70.000 69.000 - -8.00% -
471.omnetpp (avg) (percentage) -1.26% 1.590 1.570 - -1.88% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm 6.58% 13259.000 14131.000 - 6.12% -
482.sphinx3 3.86% 26682.000 27713.000 - 3.40% -
464.h264ref 1.03% 14498.000 14647.000 - -0.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) (percentage) 10300.00% 0.060 6.240 - 12380.00% -
462.libquantum (unexplained diff vs previous) 10100.00% 1.000 102.000 - 325.00% -
444.namd (unexplained diff vs previous) 9012.50% 8.000 729.000 - 12050.00% -
462.libquantum (unexplained diff vs previous) (percentage) 6900.00% 0.010 0.700 - 311.76% -
456.hmmer (unexplained diff vs previous) 58.70% 46.000 73.000 - 78.05% -
456.hmmer (unexplained diff vs previous) (percentage) 56.41% 0.390 0.610 - 74.29% -
429.mcf (unexplained diff vs previous) 45.45% 22.000 32.000 - 23.08% -
429.mcf (unexplained diff vs previous) (percentage) 43.75% 0.160 0.230 - 21.05% -
471.omnetpp (unexplained diff vs previous) (percentage) 41.84% 0.980 1.390 - -3.47% -
471.omnetpp (unexplained diff vs previous) 41.75% 103.000 146.000 - -4.58% -
470.lbm (max) 13.98% 758.000 864.000 - 36.06% -
470.lbm (max) (percentage) 6.99% 5.720 6.120 - 28.30% -
470.lbm 6.58% 441.000 470.000 - 14.36% -
470.lbm (avg) 6.58% 441.000 470.000 - 14.36% -
482.sphinx3 3.88% 464.000 482.000 - 3.43% -
482.sphinx3 (avg) 3.88% 464.000 482.000 - 3.43% -
444.namd (avg) (percentage) 3.11% 2.570 2.650 - 13.25% -
470.lbm (unexplained diff vs previous) 1.37% 804.000 815.000 - 1329.82% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
444.namd -5.83% 12400.000 11677.000 - -5.88% -
433.milc -1.61% 13601.000 13382.000 - -1.68% -
458.sjeng -1.17% 17055.000 16855.000 - -0.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (unexplained diff vs previous) (percentage) -90.00% 0.200 0.020 - -60.00% -
401.bzip2 (unexplained diff vs previous) -87.88% 33.000 4.000 - -50.00% -
471.omnetpp (max) -85.29% 972.000 143.000 - -84.34% -
471.omnetpp (max) (percentage) -85.24% 9.280 1.370 - -84.05% -
447.dealII (max) -73.54% 223.000 59.000 - -69.90% -
447.dealII (max) (percentage) -73.11% 2.380 0.640 - -69.67% -
447.dealII (unexplained diff vs previous) (percentage) -67.24% 0.580 0.190 - -77.91% -
447.dealII (unexplained diff vs previous) -66.67% 54.000 18.000 - -77.50% -
450.soplex (unexplained diff vs previous) (percentage) -30.43% 0.460 0.320 - 39.13% -
450.soplex (unexplained diff vs previous) -28.99% 69.000 49.000 - 40.00% -
444.namd (max) -19.24% 1003.000 810.000 - -11.76% -
473.astar (max) -16.79% 822.000 684.000 - -6.43% -
401.bzip2 (max) -16.75% 609.000 507.000 - -6.28% -
401.bzip2 (max) (percentage) -16.67% 3.780 3.150 - -6.25% -
482.sphinx3 (max) (percentage) -16.62% 3.310 2.760 - -7.38% -
473.astar (max) (percentage) -16.57% 6.700 5.590 - -6.21% -
458.sjeng (max) -16.55% 876.000 731.000 - -10.42% -
450.soplex (max) -16.47% 249.000 208.000 - -5.88% -
450.soplex (max) (percentage) -16.36% 1.650 1.380 - -6.12% -
429.mcf (max) -16.05% 2281.000 1915.000 - -6.90% -
429.mcf (max) (percentage) -16.00% 16.310 13.700 - -6.68% -
458.sjeng (max) (percentage) -15.56% 5.140 4.340 - -10.33% -
483.xalancbmk (max) (percentage) -15.50% 12.900 10.900 - -12.52% -
401.bzip2 -15.38% 104.000 88.000 - -8.33% -
401.bzip2 (avg) -15.38% 104.000 88.000 - -8.33% -
401.bzip2 (avg) (percentage) -15.38% 0.650 0.550 - -8.33% -
473.astar (avg) (percentage) -15.22% 0.920 0.780 - -6.02% -
429.mcf -15.20% 296.000 251.000 - -7.38% -
429.mcf (avg) -15.20% 296.000 251.000 - -7.38% -
473.astar -15.18% 112.000 95.000 - -5.94% -
473.astar (avg) -15.18% 112.000 95.000 - -5.94% -
429.mcf (avg) (percentage) -15.09% 2.120 1.800 - -7.22% -
483.xalancbmk (max) -14.72% 1209.000 1031.000 - -11.88% -
456.hmmer (max) (percentage) -14.31% 10.480 8.980 - -6.26% -
444.namd (max) (percentage) -14.22% 8.090 6.940 - -6.22% -
403.gcc (max) (percentage) -14.16% 2.330 2.000 - -6.10% -
456.hmmer (max) -14.09% 1242.000 1067.000 - -5.66% -
403.gcc (max) -14.03% 221.000 190.000 - -5.94% -
482.sphinx3 (max) -13.48% 883.000 764.000 - -4.26% -
445.gobmk (max) -13.32% 413.000 358.000 - -6.04% -
445.gobmk (max) (percentage) -12.87% 3.730 3.250 - -5.80% -
462.libquantum (max) (percentage) -12.70% 6.380 5.570 - -5.75% -
462.libquantum (max) -12.30% 919.000 806.000 - -5.18% -
456.hmmer (avg) (percentage) -10.79% 1.390 1.240 - -4.62% -
456.hmmer -10.37% 164.000 147.000 - -3.92% -
456.hmmer (avg) -10.37% 164.000 147.000 - -3.92% -
433.milc -10.34% 116.000 104.000 - -1.89% -
433.milc (avg) -10.34% 116.000 104.000 - -1.89% -
464.h264ref (avg) (percentage) -10.34% 0.290 0.260 - -10.34% -
458.sjeng -9.56% 136.000 123.000 - -8.89% -
458.sjeng (avg) -9.56% 136.000 123.000 - -8.89% -
464.h264ref -9.52% 42.000 38.000 - -9.52% -
464.h264ref (avg) -9.52% 42.000 38.000 - -9.52% -
483.xalancbmk (avg) (percentage) -9.43% 2.120 1.920 - -9.43% -
433.milc (avg) (percentage) -9.30% 0.860 0.780 - 0.00% -
447.dealII -9.18% 98.000 89.000 - -6.32% -
447.dealII (avg) -9.18% 98.000 89.000 - -6.32% -
458.sjeng (avg) (percentage) -8.75% 0.800 0.730 - -8.75% -
483.xalancbmk -8.59% 198.000 181.000 - -9.05% -
483.xalancbmk (avg) -8.59% 198.000 181.000 - -9.05% -
447.dealII (avg) (percentage) -8.57% 1.050 0.960 - -6.80% -
450.soplex -8.00% 75.000 69.000 - -1.43% -
450.soplex (avg) -8.00% 75.000 69.000 - -1.43% -
473.astar (unexplained diff vs previous) -8.00% 25.000 23.000 - 475.00% -
450.soplex (avg) (percentage) -8.00% 0.500 0.460 - -2.13% -
462.libquantum (avg) (percentage) -7.79% 0.770 0.710 - 0.00% -
462.libquantum -7.27% 110.000 102.000 - 0.00% -
462.libquantum (avg) -7.27% 110.000 102.000 - 0.00% -
433.milc (max) -6.48% 108.000 101.000 - -4.72% -
433.milc (max) (percentage) -5.00% 0.800 0.760 - -2.56% -
473.astar (unexplained diff vs previous) (percentage) -5.00% 0.200 0.190 - 533.33% -
470.lbm (unexplained diff vs previous) (percentage) -4.79% 6.060 5.770 - 1241.86% -
444.namd -2.83% 318.000 309.000 - 6.55% -
444.namd (avg) -2.83% 318.000 309.000 - 6.55% -
464.h264ref (max) (percentage) -2.38% 0.420 0.410 - -2.38% -
471.omnetpp (avg) (percentage) -1.88% 1.600 1.570 - -1.26% -
471.omnetpp -1.80% 167.000 164.000 - -2.96% -
471.omnetpp (avg) -1.80% 167.000 164.000 - -2.96% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 16125.000 -
403.gcc 9538.000 -
429.mcf 13982.000 -
433.milc 13382.000 -1.68%
444.namd 11677.000 -5.88%
445.gobmk 11046.000 -
447.dealII 9318.000 -
450.soplex 15126.000 -
453.povray 6987.000 -
456.hmmer 11886.000 -
458.sjeng 16855.000 -
462.libquantum 14487.000 -
464.h264ref 14647.000 -
470.lbm 14131.000 6.12%
471.omnetpp 10484.000 -1.37%
473.astar 12245.000 -
482.sphinx3 27713.000 3.40%
483.xalancbmk 9459.000 -
Geometric Mean 12700.217 -
Name Current %
401.bzip2 33698.000 -
403.gcc 1669360.000 -
429.mcf 7239.000 -
433.milc 47025.000 -
444.namd 124963.000 -
445.gobmk 1260795.000 -
447.dealII 195792.000 -
450.soplex 146765.000 -
453.povray 524461.000 -
456.hmmer 80877.000 -
458.sjeng 80233.000 -
462.libquantum 12504.000 -
464.h264ref 303807.000 -
470.lbm 9338.000 -
471.omnetpp 316668.000 -
473.astar 15470.000 -
482.sphinx3 87927.000 -
483.xalancbmk 1615504.000 -
Geometric Mean 111662.347 -
Name Current %
401.bzip2 88.000 -8.33%
401.bzip2 (avg) 88.000 -8.33%
401.bzip2 (avg) (percentage) 0.550 -8.33%
401.bzip2 (max) 507.000 -6.28%
401.bzip2 (max) (percentage) 3.150 -6.25%
401.bzip2 (unexplained diff vs previous) 4.000 -50.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.020 -60.00%
403.gcc 52.000 -
403.gcc (avg) 52.000 -
403.gcc (avg) (percentage) 0.550 -
403.gcc (max) 190.000 -5.94%
403.gcc (max) (percentage) 2.000 -6.10%
429.mcf 251.000 -7.38%
429.mcf (avg) 251.000 -7.38%
429.mcf (avg) (percentage) 1.800 -7.22%
429.mcf (max) 1915.000 -6.90%
429.mcf (max) (percentage) 13.700 -6.68%
429.mcf (unexplained diff vs previous) 32.000 23.08%
429.mcf (unexplained diff vs previous) (percentage) 0.230 21.05%
433.milc 104.000 -1.89%
433.milc (avg) 104.000 -1.89%
433.milc (avg) (percentage) 0.780 -
433.milc (max) 101.000 -4.72%
433.milc (max) (percentage) 0.760 -2.56%
444.namd 309.000 6.55%
444.namd (avg) 309.000 6.55%
444.namd (avg) (percentage) 2.650 13.25%
444.namd (max) 810.000 -11.76%
444.namd (max) (percentage) 6.940 -6.22%
444.namd (unexplained diff vs previous) 729.000 12050.00%
444.namd (unexplained diff vs previous) (percentage) 6.240 12380.00%
445.gobmk 74.000 -
445.gobmk (avg) 74.000 -
445.gobmk (avg) (percentage) 0.670 -
445.gobmk (max) 358.000 -6.04%
445.gobmk (max) (percentage) 3.250 -5.80%
447.dealII 89.000 -6.32%
447.dealII (avg) 89.000 -6.32%
447.dealII (avg) (percentage) 0.960 -6.80%
447.dealII (max) 59.000 -69.90%
447.dealII (max) (percentage) 0.640 -69.67%
447.dealII (unexplained diff vs previous) 18.000 -77.50%
447.dealII (unexplained diff vs previous) (percentage) 0.190 -77.91%
450.soplex 69.000 -1.43%
450.soplex (avg) 69.000 -1.43%
450.soplex (avg) (percentage) 0.460 -
450.soplex (max) 208.000 -5.88%
450.soplex (max) (percentage) 1.380 -6.12%
450.soplex (unexplained diff vs previous) 49.000 40.00%
450.soplex (unexplained diff vs previous) (percentage) 0.320 39.13%
453.povray 55.000 -1.79%
453.povray (avg) 55.000 -1.79%
453.povray (avg) (percentage) 0.800 -
453.povray (max) 25.000 -
453.povray (max) (percentage) 0.360 -
456.hmmer 147.000 -3.92%
456.hmmer (avg) 147.000 -3.92%
456.hmmer (avg) (percentage) 1.240 -4.62%
456.hmmer (max) 1067.000 -5.66%
456.hmmer (max) (percentage) 8.980 -6.26%
456.hmmer (unexplained diff vs previous) 73.000 78.05%
456.hmmer (unexplained diff vs previous) (percentage) 0.610 74.29%
458.sjeng 123.000 -8.89%
458.sjeng (avg) 123.000 -8.89%
458.sjeng (avg) (percentage) 0.730 -8.75%
458.sjeng (max) 731.000 -10.42%
458.sjeng (max) (percentage) 4.340 -10.33%
458.sjeng (unexplained diff vs previous) 24.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.140 -
462.libquantum 102.000 -
462.libquantum (avg) 102.000 -
462.libquantum (avg) (percentage) 0.710 -
462.libquantum (max) 806.000 -5.18%
462.libquantum (max) (percentage) 5.570 -5.75%
462.libquantum (unexplained diff vs previous) 102.000 325.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.700 311.76%
464.h264ref 38.000 -9.52%
464.h264ref (avg) 38.000 -9.52%
464.h264ref (avg) (percentage) 0.260 -10.34%
464.h264ref (max) 60.000 -1.64%
464.h264ref (max) (percentage) 0.410 -2.38%
464.h264ref (unexplained diff vs previous) 9.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -
470.lbm 470.000 14.36%
470.lbm (avg) 470.000 14.36%
470.lbm (avg) (percentage) 3.330 7.77%
470.lbm (max) 864.000 36.06%
470.lbm (max) (percentage) 6.120 28.30%
470.lbm (unexplained diff vs previous) 815.000 1329.82%
470.lbm (unexplained diff vs previous) (percentage) 5.770 1241.86%
471.omnetpp 164.000 -2.96%
471.omnetpp (avg) 164.000 -2.96%
471.omnetpp (avg) (percentage) 1.570 -1.26%
471.omnetpp (max) 143.000 -84.34%
471.omnetpp (max) (percentage) 1.370 -84.05%
471.omnetpp (unexplained diff vs previous) 146.000 -4.58%
471.omnetpp (unexplained diff vs previous) (percentage) 1.390 -3.47%
473.astar 95.000 -5.94%
473.astar (avg) 95.000 -5.94%
473.astar (avg) (percentage) 0.780 -6.02%
473.astar (max) 684.000 -6.43%
473.astar (max) (percentage) 5.590 -6.21%
473.astar (unexplained diff vs previous) 23.000 475.00%
473.astar (unexplained diff vs previous) (percentage) 0.190 533.33%
482.sphinx3 482.000 3.43%
482.sphinx3 (avg) 482.000 3.43%
482.sphinx3 (avg) (percentage) 1.740 -
482.sphinx3 (max) 764.000 -4.26%
482.sphinx3 (max) (percentage) 2.760 -7.38%
483.xalancbmk 181.000 -9.05%
483.xalancbmk (avg) 181.000 -9.05%
483.xalancbmk (avg) (percentage) 1.920 -9.43%
483.xalancbmk (max) 1031.000 -11.88%
483.xalancbmk (max) (percentage) 10.900 -12.52%
483.xalancbmk (unexplained diff vs previous) 63.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.670 -
Geometric Mean 17.987 -2.69%