Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/88b6186af3908c55b357858eb348b5143f21c289 (+ 288 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/135/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0135 (llvmorg-19-init-09251-g88b6186af390) 2024-04-21T00:29:29 0:00:00
Previous 0134 (llvmorg-19-init-08963-ge32c4dfefcd1) 2024-04-17T19:32:50 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 17
Performance Improvements 69 126
Added Tests 0 6
Unchanged Tests 689 631
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 10.71% 56.000 62.000 - -99.35% -
429.mcf 1.41% 1138.000 1154.000 - -91.75% -
444.namd 1.37% 802.000 813.000 - -93.44% -
462.libquantum 1.09% 184.000 186.000 - -98.71% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 1500.00% 1.000 16.000 - -27.27% -
429.mcf (unexplained diff vs previous) (percentage) 1444.44% 0.090 1.390 - 768.75% -
444.namd (max) 450.00% 2.000 11.000 - -98.90% -
444.namd (max) (percentage) 302.94% 0.340 1.370 - -83.07% -
429.mcf (max) 77.78% 9.000 16.000 - -99.30% -
429.mcf (max) (percentage) 62.07% 0.870 1.410 - -91.35% -
482.sphinx3 (unexplained diff vs previous) (percentage) 60.00% 0.500 0.800 - -76.68% -
482.sphinx3 (unexplained diff vs previous) 60.00% 5.000 8.000 - -99.12% -
403.gcc (max) 33.33% 3.000 4.000 - -98.19% -
401.bzip2 (unexplained diff vs previous) 28.57% 7.000 9.000 - -72.73% -
401.bzip2 (unexplained diff vs previous) (percentage) 24.00% 0.250 0.310 - 55.00% -
444.namd 14.29% 7.000 8.000 - -97.48% -
444.namd (avg) 14.29% 7.000 8.000 - -97.48% -
456.hmmer (unexplained diff vs previous) 9.09% 11.000 12.000 - -73.91% -
456.hmmer (unexplained diff vs previous) (percentage) 6.90% 0.290 0.310 - -20.51% -
429.mcf 5.88% 17.000 18.000 - -93.92% -
429.mcf (avg) 5.88% 17.000 18.000 - -93.92% -
444.namd (avg) (percentage) 1.02% 0.980 0.990 - -61.48% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.57% 508.000 500.000 - -92.84% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (max) -94.12% 34.000 2.000 - -99.83% -
483.xalancbmk (max) (percentage) -93.14% 1.020 0.070 - -99.46% -
464.h264ref (unexplained diff vs previous) -92.31% 13.000 1.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -90.91% 0.220 0.020 - 0.00% -
473.astar (unexplained diff vs previous) -82.14% 28.000 5.000 - -80.00% -
473.astar (unexplained diff vs previous) (percentage) -81.67% 0.600 0.110 - -45.00% -
450.soplex (unexplained diff vs previous) -80.00% 5.000 1.000 - -98.55% -
450.soplex (unexplained diff vs previous) (percentage) -80.00% 0.900 0.180 - -60.87% -
462.libquantum (unexplained diff vs previous) (percentage) -66.87% 3.260 1.080 - 10700.00% -
462.libquantum (unexplained diff vs previous) -66.67% 6.000 2.000 - 100.00% -
483.xalancbmk (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -66.67% 0.090 0.030 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -61.29% 0.310 0.120 - -66.67% -
445.gobmk (unexplained diff vs previous) -60.00% 15.000 6.000 - -85.00% -
450.soplex (max) -50.00% 6.000 3.000 - -98.80% -
458.sjeng (unexplained diff vs previous) -45.45% 33.000 18.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -45.00% 0.400 0.220 - 0.00% -
450.soplex (max) (percentage) -44.72% 1.230 0.680 - -58.79% -
471.omnetpp (unexplained diff vs previous) (percentage) -36.00% 0.500 0.320 - -67.35% -
471.omnetpp (unexplained diff vs previous) -35.71% 14.000 9.000 - -91.26% -
447.dealII (unexplained diff vs previous) -31.82% 22.000 15.000 - -72.22% -
447.dealII (unexplained diff vs previous) (percentage) -31.58% 1.140 0.780 - 34.48% -
464.h264ref (max) (percentage) -24.00% 0.250 0.190 - -54.76% -
471.omnetpp (max) (percentage) -24.00% 0.500 0.380 - -95.91% -
471.omnetpp (max) -23.08% 13.000 10.000 - -98.97% -
464.h264ref (max) -21.43% 14.000 11.000 - -81.67% -
470.lbm (unexplained diff vs previous) -17.39% 23.000 19.000 - -97.64% -
470.lbm (unexplained diff vs previous) (percentage) -15.79% 0.570 0.480 - -92.08% -
453.povray (max) -14.29% 7.000 6.000 - -76.00% -
445.gobmk (max) -13.33% 15.000 13.000 - -96.85% -
470.lbm (max) -13.04% 23.000 20.000 - -97.36% -
445.gobmk (max) (percentage) -12.90% 0.310 0.270 - -92.76% -
458.sjeng (max) (percentage) -12.50% 0.400 0.350 - -93.19% -
458.sjeng (max) -12.50% 32.000 28.000 - -96.80% -
470.lbm (max) (percentage) -12.07% 0.580 0.510 - -91.08% -
433.milc (max) -10.00% 10.000 9.000 - -91.67% -
447.dealII (max) -9.09% 22.000 20.000 - -91.03% -
447.dealII (max) (percentage) -8.70% 1.150 1.050 - -55.88% -
447.dealII -8.33% 12.000 11.000 - -88.78% -
447.dealII (avg) -8.33% 12.000 11.000 - -88.78% -
456.hmmer (max) -7.14% 14.000 13.000 - -98.95% -
462.libquantum (max) (percentage) -6.33% 3.160 2.960 - -53.61% -
473.astar (max) -6.06% 33.000 31.000 - -96.23% -
445.gobmk -5.88% 17.000 16.000 - -78.38% -
445.gobmk (avg) -5.88% 17.000 16.000 - -78.38% -
464.h264ref -5.88% 17.000 16.000 - -61.90% -
464.h264ref (avg) -5.88% 17.000 16.000 - -61.90% -
473.astar (max) (percentage) -5.56% 0.720 0.680 - -89.85% -
456.hmmer (max) (percentage) -5.26% 0.380 0.360 - -96.56% -
401.bzip2 (max) (percentage) -4.55% 0.440 0.420 - -88.89% -
433.milc (max) (percentage) -4.55% 0.880 0.840 - 5.00% -
473.astar -3.23% 31.000 30.000 - -73.21% -
473.astar (avg) -3.23% 31.000 30.000 - -73.21% -
473.astar (avg) (percentage) -2.99% 0.670 0.650 - -29.35% -
453.povray (max) (percentage) -2.86% 1.400 1.360 - 277.78% -
450.soplex (avg) (percentage) -2.31% 1.300 1.270 - 154.00% -
471.omnetpp -2.13% 47.000 46.000 - -72.46% -
471.omnetpp (avg) -2.13% 47.000 46.000 - -72.46% -
401.bzip2 (avg) (percentage) -2.08% 0.480 0.470 - -27.69% -
482.sphinx3 (max) (percentage) -2.02% 0.990 0.970 - -70.69% -
403.gcc (max) (percentage) -2.00% 6.990 6.850 - 193.99% -
483.xalancbmk (avg) (percentage) -2.00% 1.500 1.470 - -30.66% -
483.xalancbmk -2.00% 50.000 49.000 - -75.25% -
483.xalancbmk (avg) -2.00% 50.000 49.000 - -75.25% -
471.omnetpp (avg) (percentage) -1.75% 1.710 1.680 - 5.00% -
456.hmmer (avg) (percentage) -1.74% 1.150 1.130 - -18.71% -
433.milc (avg) (percentage) -1.61% 0.620 0.610 - -29.07% -
470.lbm (avg) (percentage) -1.30% 0.770 0.760 - -77.18% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.96% 146765.000 149644.000 - 0.00% -
471.omnetpp 1.38% 316676.000 321049.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 10700.00% 0.010 1.080 - -66.87% -
444.namd (unexplained diff vs previous) (percentage) 2150.00% 0.060 1.350 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 768.75% 0.160 1.390 - 1444.44% -
403.gcc (avg) (percentage) 372.73% 0.550 2.600 - 0.00% -
453.povray (max) (percentage) 277.78% 0.360 1.360 - -2.86% -
403.gcc (max) (percentage) 193.99% 2.330 6.850 - -2.00% -
450.soplex (avg) (percentage) 154.00% 0.500 1.270 - -2.31% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - -66.67% -
462.libquantum (avg) (percentage) 97.40% 0.770 1.520 - -0.65% -
401.bzip2 (unexplained diff vs previous) (percentage) 55.00% 0.200 0.310 - 24.00% -
444.namd (unexplained diff vs previous) 37.50% 8.000 11.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 34.48% 0.580 0.780 - -31.58% -
453.povray (avg) (percentage) 13.75% 0.800 0.910 - 0.00% -
433.milc (max) (percentage) 5.00% 0.800 0.840 - -4.55% -
471.omnetpp (avg) (percentage) 5.00% 1.600 1.680 - -1.75% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.14% 7239.000 6939.000 - 0.00% -
462.libquantum -3.05% 12504.000 12123.000 - 0.00% -
453.povray -2.18% 524493.000 513063.000 - 0.04% -
464.h264ref -1.87% 303767.000 298095.000 - 0.02% -
433.milc -1.73% 47001.000 46189.000 - 0.00% -
444.namd -1.61% 124963.000 122950.000 - 0.00% -
458.sjeng -1.27% 80297.000 79274.000 - 0.00% -
470.lbm -1.26% 9338.000 9220.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9509.000 62.000 - 10.71% -
462.libquantum -98.71% 14409.000 186.000 - 1.09% -
450.soplex -96.35% 15112.000 552.000 - -0.18% -
482.sphinx3 -96.26% 26682.000 999.000 - 0.81% -
444.namd -93.44% 12400.000 813.000 - 1.37% -
453.povray -92.84% 6987.000 500.000 - -1.57% -
429.mcf -91.75% 13988.000 1154.000 - 1.41% -
433.milc -91.31% 13601.000 1182.000 - 0.08% -
401.bzip2 -82.28% 16137.000 2859.000 - 0.32% -
447.dealII -79.51% 9380.000 1922.000 - -0.77% -
471.omnetpp -73.55% 10477.000 2771.000 - -0.32% -
470.lbm -69.85% 13259.000 3997.000 - -0.47% -
456.hmmer -67.75% 11854.000 3823.000 - 0.31% -
483.xalancbmk -63.79% 9376.000 3395.000 - -0.03% -
473.astar -61.97% 12272.000 4667.000 - -0.11% -
464.h264ref -59.53% 14498.000 5867.000 - -0.02% -
445.gobmk -55.86% 11093.000 4897.000 - -0.12% -
458.sjeng -51.67% 17055.000 8242.000 - 0.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk (max) -99.83% 1209.000 2.000 - -94.12% -
483.xalancbmk (max) (percentage) -99.46% 12.900 0.070 - -93.14% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
429.mcf (max) -99.30% 2281.000 16.000 - 77.78% -
482.sphinx3 (unexplained diff vs previous) -99.12% 914.000 8.000 - 60.00% -
482.sphinx3 (max) -98.98% 883.000 9.000 - 0.00% -
471.omnetpp (max) -98.97% 972.000 10.000 - -23.08% -
456.hmmer (max) -98.95% 1242.000 13.000 - -7.14% -
444.namd (max) -98.90% 1003.000 11.000 - 450.00% -
450.soplex (max) -98.80% 249.000 3.000 - -50.00% -
450.soplex (unexplained diff vs previous) -98.55% 69.000 1.000 - -80.00% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
403.gcc (max) -98.19% 221.000 4.000 - 33.33% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc -98.08% 52.000 1.000 - 0.00% -
403.gcc (avg) -98.08% 52.000 1.000 - 0.00% -
401.bzip2 (max) -98.03% 609.000 12.000 - 0.00% -
470.lbm (unexplained diff vs previous) -97.64% 804.000 19.000 - -17.39% -
444.namd -97.48% 318.000 8.000 - 14.29% -
444.namd (avg) -97.48% 318.000 8.000 - 14.29% -
470.lbm (max) -97.36% 758.000 20.000 - -13.04% -
445.gobmk (max) -96.85% 413.000 13.000 - -13.33% -
458.sjeng (max) -96.80% 876.000 28.000 - -12.50% -
456.hmmer (max) (percentage) -96.56% 10.480 0.360 - -5.26% -
473.astar (max) -96.23% 822.000 31.000 - -6.06% -
471.omnetpp (max) (percentage) -95.91% 9.280 0.380 - -24.00% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf -93.92% 296.000 18.000 - 5.88% -
429.mcf (avg) -93.92% 296.000 18.000 - 5.88% -
470.lbm -93.20% 441.000 30.000 - 0.00% -
470.lbm (avg) -93.20% 441.000 30.000 - 0.00% -
458.sjeng (max) (percentage) -93.19% 5.140 0.350 - -12.50% -
445.gobmk (max) (percentage) -92.76% 3.730 0.270 - -12.90% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
433.milc (unexplained diff vs previous) -92.31% 13.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.08% 6.060 0.480 - -15.79% -
433.milc (max) -91.67% 108.000 9.000 - -10.00% -
429.mcf (max) (percentage) -91.35% 16.310 1.410 - 62.07% -
471.omnetpp (unexplained diff vs previous) -91.26% 103.000 9.000 - -35.71% -
470.lbm (max) (percentage) -91.08% 5.720 0.510 - -12.07% -
447.dealII (max) -91.03% 223.000 20.000 - -9.09% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
473.astar (max) (percentage) -89.85% 6.700 0.680 - -5.56% -
401.bzip2 (max) (percentage) -88.89% 3.780 0.420 - -4.55% -
447.dealII -88.78% 98.000 11.000 - -8.33% -
447.dealII (avg) -88.78% 98.000 11.000 - -8.33% -
401.bzip2 -87.50% 104.000 13.000 - 0.00% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -85.00% 40.000 6.000 - -60.00% -
444.namd (max) (percentage) -83.07% 8.090 1.370 - 302.94% -
464.h264ref (max) -81.67% 60.000 11.000 - -21.43% -
473.astar (unexplained diff vs previous) -80.00% 25.000 5.000 - -82.14% -
445.gobmk -78.38% 74.000 16.000 - -5.88% -
445.gobmk (avg) -78.38% 74.000 16.000 - -5.88% -
470.lbm (avg) (percentage) -77.18% 3.330 0.760 - -1.30% -
482.sphinx3 (unexplained diff vs previous) (percentage) -76.68% 3.430 0.800 - 60.00% -
453.povray (max) -76.00% 25.000 6.000 - -14.29% -
458.sjeng -75.74% 136.000 33.000 - 0.00% -
458.sjeng (avg) -75.74% 136.000 33.000 - 0.00% -
483.xalancbmk -75.25% 198.000 49.000 - -2.00% -
483.xalancbmk (avg) -75.25% 198.000 49.000 - -2.00% -
456.hmmer (unexplained diff vs previous) -73.91% 46.000 12.000 - 9.09% -
456.hmmer -73.78% 164.000 43.000 - 0.00% -
456.hmmer (avg) -73.78% 164.000 43.000 - 0.00% -
473.astar -73.21% 112.000 30.000 - -3.23% -
473.astar (avg) -73.21% 112.000 30.000 - -3.23% -
401.bzip2 (unexplained diff vs previous) -72.73% 33.000 9.000 - 28.57% -
471.omnetpp -72.46% 167.000 46.000 - -2.13% -
471.omnetpp (avg) -72.46% 167.000 46.000 - -2.13% -
447.dealII (unexplained diff vs previous) -72.22% 54.000 15.000 - -31.82% -
482.sphinx3 (max) (percentage) -70.69% 3.310 0.970 - -2.02% -
471.omnetpp (unexplained diff vs previous) (percentage) -67.35% 0.980 0.320 - -36.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.360 0.120 - -61.29% -
464.h264ref -61.90% 42.000 16.000 - -5.88% -
464.h264ref (avg) -61.90% 42.000 16.000 - -5.88% -
444.namd (avg) (percentage) -61.48% 2.570 0.990 - 1.02% -
450.soplex (unexplained diff vs previous) (percentage) -60.87% 0.460 0.180 - -80.00% -
450.soplex (max) (percentage) -58.79% 1.650 0.680 - -44.72% -
447.dealII (max) (percentage) -55.88% 2.380 1.050 - -8.70% -
464.h264ref (max) (percentage) -54.76% 0.420 0.190 - -24.00% -
462.libquantum (max) (percentage) -53.61% 6.380 2.960 - -6.33% -
482.sphinx3 (avg) (percentage) -53.45% 1.740 0.810 - 0.00% -
445.gobmk (avg) (percentage) -49.25% 0.670 0.340 - -2.86% -
458.sjeng (avg) (percentage) -48.75% 0.800 0.410 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 - -81.67% -
447.dealII (avg) (percentage) -40.95% 1.050 0.620 - 0.00% -
483.xalancbmk (avg) (percentage) -30.66% 2.120 1.470 - -2.00% -
473.astar (avg) (percentage) -29.35% 0.920 0.650 - -2.99% -
433.milc (avg) (percentage) -29.07% 0.860 0.610 - -1.61% -
401.bzip2 (avg) (percentage) -27.69% 0.650 0.470 - -2.08% -
429.mcf (unexplained diff vs previous) -27.27% 22.000 16.000 - 1500.00% -
429.mcf (avg) (percentage) -25.94% 2.120 1.570 - -0.63% -
456.hmmer (unexplained diff vs previous) (percentage) -20.51% 0.390 0.310 - 6.90% -
433.milc (unexplained diff vs previous) (percentage) -20.00% 0.100 0.080 - 0.00% -
456.hmmer (avg) (percentage) -18.71% 1.390 1.130 - -1.74% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 2859.000 -
403.gcc 62.000 10.71%
429.mcf 1154.000 1.41%
433.milc 1182.000 -
444.namd 813.000 1.37%
445.gobmk 4897.000 -
447.dealII 1922.000 -
450.soplex 552.000 -
453.povray 500.000 -1.57%
456.hmmer 3823.000 -
458.sjeng 8242.000 -
462.libquantum 186.000 1.09%
464.h264ref 5867.000 -
470.lbm 3997.000 -
471.omnetpp 2771.000 -
473.astar 4667.000 -
482.sphinx3 999.000 -
483.xalancbmk 3395.000 -
Geometric Mean 1562.407 -
Code Size (bytes)
Name Current %
401.bzip2 33549.000 -
403.gcc 1656423.000 -
429.mcf 6939.000 -
433.milc 46189.000 -
444.namd 122950.000 -
445.gobmk 1255997.000 -
447.dealII 196410.000 -
450.soplex 149644.000 -
453.povray 513063.000 -
456.hmmer 80417.000 -
458.sjeng 79274.000 -
462.libquantum 12123.000 -
464.h264ref 298095.000 -
470.lbm 9220.000 -
471.omnetpp 321049.000 -
473.astar 15559.000 -
482.sphinx3 87408.000 -
483.xalancbmk 1611988.000 -
Geometric Mean 110668.570 -
sample variability
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.470 -2.08%
401.bzip2 (max) 12.000 -
401.bzip2 (max) (percentage) 0.420 -4.55%
401.bzip2 (unexplained diff vs previous) 9.000 28.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 24.00%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.600 -
403.gcc (max) 4.000 33.33%
403.gcc (max) (percentage) 6.850 -2.00%
429.mcf 18.000 5.88%
429.mcf (avg) 18.000 5.88%
429.mcf (avg) (percentage) 1.570 -
429.mcf (max) 16.000 77.78%
429.mcf (max) (percentage) 1.410 62.07%
429.mcf (unexplained diff vs previous) 16.000 1500.00%
429.mcf (unexplained diff vs previous) (percentage) 1.390 1444.44%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.610 -1.61%
433.milc (max) 9.000 -10.00%
433.milc (max) (percentage) 0.840 -4.55%
433.milc (unexplained diff vs previous) 1.000 -
433.milc (unexplained diff vs previous) (percentage) 0.080 -
444.namd 8.000 14.29%
444.namd (avg) 8.000 14.29%
444.namd (avg) (percentage) 0.990 1.02%
444.namd (max) 11.000 450.00%
444.namd (max) (percentage) 1.370 302.94%
444.namd (unexplained diff vs previous) 11.000 -
444.namd (unexplained diff vs previous) (percentage) 1.350 -
445.gobmk 16.000 -5.88%
445.gobmk (avg) 16.000 -5.88%
445.gobmk (avg) (percentage) 0.340 -
445.gobmk (max) 13.000 -13.33%
445.gobmk (max) (percentage) 0.270 -12.90%
445.gobmk (unexplained diff vs previous) 6.000 -60.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -61.29%
447.dealII 11.000 -8.33%
447.dealII (avg) 11.000 -8.33%
447.dealII (avg) (percentage) 0.620 -
447.dealII (max) 20.000 -9.09%
447.dealII (max) (percentage) 1.050 -8.70%
447.dealII (unexplained diff vs previous) 15.000 -31.82%
447.dealII (unexplained diff vs previous) (percentage) 0.780 -31.58%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.270 -2.31%
450.soplex (max) 3.000 -50.00%
450.soplex (max) (percentage) 0.680 -44.72%
450.soplex (unexplained diff vs previous) 1.000 -80.00%
450.soplex (unexplained diff vs previous) (percentage) 0.180 -80.00%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.910 -
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.360 -2.86%
456.hmmer 43.000 -
456.hmmer (avg) 43.000 -
456.hmmer (avg) (percentage) 1.130 -1.74%
456.hmmer (max) 13.000 -7.14%
456.hmmer (max) (percentage) 0.360 -5.26%
456.hmmer (unexplained diff vs previous) 12.000 9.09%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 6.90%
458.sjeng 33.000 -
458.sjeng (avg) 33.000 -
458.sjeng (avg) (percentage) 0.410 -
458.sjeng (max) 28.000 -12.50%
458.sjeng (max) (percentage) 0.350 -12.50%
458.sjeng (unexplained diff vs previous) 18.000 -45.45%
458.sjeng (unexplained diff vs previous) (percentage) 0.220 -45.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.520 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.960 -6.33%
462.libquantum (unexplained diff vs previous) 2.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 1.080 -66.87%
464.h264ref 16.000 -5.88%
464.h264ref (avg) 16.000 -5.88%
464.h264ref (avg) (percentage) 0.280 -
464.h264ref (max) 11.000 -21.43%
464.h264ref (max) (percentage) 0.190 -24.00%
464.h264ref (unexplained diff vs previous) 1.000 -92.31%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -90.91%
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.760 -1.30%
470.lbm (max) 20.000 -13.04%
470.lbm (max) (percentage) 0.510 -12.07%
470.lbm (unexplained diff vs previous) 19.000 -17.39%
470.lbm (unexplained diff vs previous) (percentage) 0.480 -15.79%
471.omnetpp 46.000 -2.13%
471.omnetpp (avg) 46.000 -2.13%
471.omnetpp (avg) (percentage) 1.680 -1.75%
471.omnetpp (max) 10.000 -23.08%
471.omnetpp (max) (percentage) 0.380 -24.00%
471.omnetpp (unexplained diff vs previous) 9.000 -35.71%
471.omnetpp (unexplained diff vs previous) (percentage) 0.320 -36.00%
473.astar 30.000 -3.23%
473.astar (avg) 30.000 -3.23%
473.astar (avg) (percentage) 0.650 -2.99%
473.astar (max) 31.000 -6.06%
473.astar (max) (percentage) 0.680 -5.56%
473.astar (unexplained diff vs previous) 5.000 -82.14%
473.astar (unexplained diff vs previous) (percentage) 0.110 -81.67%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.810 -
482.sphinx3 (max) 9.000 -
482.sphinx3 (max) (percentage) 0.970 -2.02%
482.sphinx3 (unexplained diff vs previous) 8.000 60.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.800 60.00%
483.xalancbmk 49.000 -2.00%
483.xalancbmk (avg) 49.000 -2.00%
483.xalancbmk (avg) (percentage) 1.470 -2.00%
483.xalancbmk (max) 2.000 -94.12%
483.xalancbmk (max) (percentage) 0.070 -93.14%
483.xalancbmk (unexplained diff vs previous) 1.000 -66.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.030 -66.67%
Geometric Mean 2.834 1.29%