Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3af9dfe464446da8e9acea45681df28b18583370 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Oz_LTO-build/7/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0007 (no-change) 2023-01-23T20:09:02 0:00:00
Previous 0005 (llvmorg-17-init-00057-g3af9dfe46444) 2023-01-22T02:28:43 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 16 14
Performance Improvements 98 105
Added Tests 0 6
Unchanged Tests 666 655
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 175.00% 0.040 0.110 - -31.25% -
403.gcc (unexplained diff vs previous) (percentage) 160.87% 0.230 0.600 - 400.00% -
403.gcc (unexplained diff vs previous) 159.09% 22.000 57.000 - 418.18% -
429.mcf (unexplained diff vs previous) 150.00% 6.000 15.000 - -31.82% -
433.milc (unexplained diff vs previous) 125.00% 12.000 27.000 - 107.69% -
433.milc (unexplained diff vs previous) (percentage) 122.22% 0.090 0.200 - 100.00% -
445.gobmk (unexplained diff vs previous) (percentage) 120.00% 0.100 0.220 - -38.89% -
445.gobmk (unexplained diff vs previous) 118.18% 11.000 24.000 - -40.00% -
453.povray (unexplained diff vs previous) (percentage) 60.00% 0.100 0.160 - 0.00% -
453.povray (unexplained diff vs previous) 57.14% 7.000 11.000 - 0.00% -
470.lbm (unexplained diff vs previous) 37.50% 8.000 11.000 - -98.63% -
470.lbm (unexplained diff vs previous) (percentage) 33.33% 0.060 0.080 - -98.68% -
471.omnetpp (unexplained diff vs previous) 20.00% 55.000 66.000 - -35.92% -
471.omnetpp (unexplained diff vs previous) (percentage) 19.23% 0.520 0.620 - -36.73% -
464.h264ref 2.04% 49.000 50.000 - 19.05% -
464.h264ref (avg) 2.04% 49.000 50.000 - 19.05% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) -92.59% 675.000 50.000 - -94.29% -
458.sjeng (max) (percentage) -92.48% 3.990 0.300 - -94.16% -
401.bzip2 (unexplained diff vs previous) -80.00% 5.000 1.000 - -96.97% -
482.sphinx3 (unexplained diff vs previous) -67.25% 171.000 56.000 - -93.87% -
482.sphinx3 (unexplained diff vs previous) (percentage) -67.19% 0.640 0.210 - -93.88% -
401.bzip2 (unexplained diff vs previous) (percentage) -66.67% 0.030 0.010 - -95.00% -
462.libquantum (unexplained diff vs previous) -55.17% 29.000 13.000 - 1200.00% -
462.libquantum (unexplained diff vs previous) (percentage) -55.00% 0.200 0.090 - 800.00% -
458.sjeng (unexplained diff vs previous) -41.07% 56.000 33.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -39.39% 0.330 0.200 - 0.00% -
464.h264ref (unexplained diff vs previous) -35.65% 115.000 74.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -35.44% 0.790 0.510 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -32.50% 0.400 0.270 - -41.30% -
450.soplex (unexplained diff vs previous) -31.67% 60.000 41.000 - -40.58% -
450.soplex (max) (percentage) -25.00% 0.400 0.300 - -81.82% -
450.soplex (max) -25.00% 60.000 45.000 - -81.93% -
453.povray (max) -15.38% 13.000 11.000 - -56.00% -
456.hmmer (unexplained diff vs previous) -14.29% 42.000 36.000 - -21.74% -
456.hmmer (unexplained diff vs previous) (percentage) -14.29% 0.350 0.300 - -23.08% -
473.astar (max) -13.64% 22.000 19.000 - -97.69% -
473.astar (max) (percentage) -11.11% 0.180 0.160 - -97.61% -
453.povray (max) (percentage) -10.53% 0.190 0.170 - -52.78% -
470.lbm (max) (percentage) -9.94% 4.830 4.350 - -23.95% -
470.lbm (max) -9.81% 642.000 579.000 - -23.61% -
456.hmmer (max) -9.23% 65.000 59.000 - -95.25% -
456.hmmer (max) (percentage) -9.09% 0.550 0.500 - -95.23% -
462.libquantum (max) (percentage) -8.93% 0.560 0.510 - -92.01% -
462.libquantum (max) -8.75% 80.000 73.000 - -92.06% -
444.namd (max) -8.71% 677.000 618.000 - -38.38% -
453.povray -8.70% 46.000 42.000 - -23.64% -
453.povray (avg) -8.70% 46.000 42.000 - -23.64% -
483.xalancbmk (max) -8.62% 58.000 53.000 - -95.62% -
444.namd (max) (percentage) -8.61% 5.460 4.990 - -38.32% -
482.sphinx3 (avg) (percentage) -8.43% 1.780 1.630 - -6.32% -
482.sphinx3 -8.23% 474.000 435.000 - -6.25% -
482.sphinx3 (avg) -8.23% 474.000 435.000 - -6.25% -
483.xalancbmk (max) (percentage) -8.06% 0.620 0.570 - -95.58% -
483.xalancbmk -7.84% 153.000 141.000 - -28.79% -
483.xalancbmk (avg) -7.84% 153.000 141.000 - -28.79% -
444.namd (avg) (percentage) -7.72% 2.720 2.510 - -2.33% -
444.namd -7.72% 337.000 311.000 - -2.20% -
444.namd (avg) -7.72% 337.000 311.000 - -2.20% -
453.povray (avg) (percentage) -7.58% 0.660 0.610 - -23.75% -
462.libquantum (avg) (percentage) -7.46% 0.670 0.620 - -19.48% -
483.xalancbmk (avg) (percentage) -7.36% 1.630 1.510 - -28.77% -
462.libquantum -7.29% 96.000 89.000 - -19.09% -
462.libquantum (avg) -7.29% 96.000 89.000 - -19.09% -
445.gobmk (avg) (percentage) -7.27% 0.550 0.510 - -23.88% -
429.mcf (avg) (percentage) -7.14% 1.540 1.430 - -32.55% -
470.lbm -7.13% 435.000 404.000 - -8.39% -
470.lbm (avg) -7.13% 435.000 404.000 - -8.39% -
470.lbm (avg) (percentage) -7.03% 3.270 3.040 - -8.71% -
429.mcf -6.98% 215.000 200.000 - -32.43% -
429.mcf (avg) -6.98% 215.000 200.000 - -32.43% -
471.omnetpp (max) (percentage) -6.80% 1.030 0.960 - -89.66% -
445.gobmk -6.67% 60.000 56.000 - -24.32% -
445.gobmk (avg) -6.67% 60.000 56.000 - -24.32% -
433.milc -6.60% 106.000 99.000 - -14.66% -
433.milc (avg) -6.60% 106.000 99.000 - -14.66% -
458.sjeng -6.60% 106.000 99.000 - -27.21% -
458.sjeng (avg) -6.60% 106.000 99.000 - -27.21% -
447.dealII -6.58% 76.000 71.000 - -27.55% -
447.dealII (avg) -6.58% 76.000 71.000 - -27.55% -
471.omnetpp (max) -6.42% 109.000 102.000 - -89.51% -
433.milc (avg) (percentage) -6.41% 0.780 0.730 - -15.12% -
401.bzip2 (avg) (percentage) -6.38% 0.470 0.440 - -32.31% -
458.sjeng (avg) (percentage) -6.35% 0.630 0.590 - -26.25% -
456.hmmer (avg) (percentage) -6.19% 1.130 1.060 - -23.74% -
483.xalancbmk (unexplained diff vs previous) -6.12% 49.000 46.000 - 0.00% -
473.astar -6.10% 82.000 77.000 - -31.25% -
473.astar (avg) -6.10% 82.000 77.000 - -31.25% -
447.dealII (avg) (percentage) -6.10% 0.820 0.770 - -26.67% -
473.astar (avg) (percentage) -5.97% 0.670 0.630 - -31.52% -
456.hmmer -5.97% 134.000 126.000 - -23.17% -
456.hmmer (avg) -5.97% 134.000 126.000 - -23.17% -
429.mcf (max) (percentage) -5.88% 0.170 0.160 - -99.02% -
450.soplex -5.88% 68.000 64.000 - -14.67% -
450.soplex (avg) -5.88% 68.000 64.000 - -14.67% -
483.xalancbmk (unexplained diff vs previous) (percentage) -5.77% 0.520 0.490 - 0.00% -
433.milc (max) -5.70% 193.000 182.000 - 68.52% -
433.milc (max) (percentage) -5.63% 1.420 1.340 - 67.50% -
401.bzip2 -5.33% 75.000 71.000 - -31.73% -
401.bzip2 (avg) -5.33% 75.000 71.000 - -31.73% -
464.h264ref (max) -5.31% 113.000 107.000 - 78.33% -
482.sphinx3 (max) (percentage) -5.26% 3.040 2.880 - -12.99% -
482.sphinx3 (max) -5.19% 810.000 768.000 - -13.02% -
464.h264ref (max) (percentage) -5.13% 0.780 0.740 - 76.19% -
450.soplex (avg) (percentage) -4.44% 0.450 0.430 - -14.00% -
429.mcf (max) -4.35% 23.000 22.000 - -99.04% -
447.dealII (max) -4.08% 49.000 47.000 - -78.92% -
403.gcc (max) -4.00% 175.000 168.000 - -23.98% -
447.dealII (max) (percentage) -3.77% 0.530 0.510 - -78.57% -
471.omnetpp (avg) (percentage) -3.47% 1.440 1.390 - -13.13% -
445.gobmk (max) -3.33% 330.000 319.000 - -22.76% -
403.gcc (max) (percentage) -3.28% 1.830 1.770 - -24.03% -
471.omnetpp -3.27% 153.000 148.000 - -11.38% -
471.omnetpp (avg) -3.27% 153.000 148.000 - -11.38% -
445.gobmk (max) (percentage) -3.01% 2.990 2.900 - -22.25% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 2.04% 10477.000 10691.000 - 0.62% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 1200.00% 1.000 13.000 - -55.17% -
462.libquantum (unexplained diff vs previous) (percentage) 800.00% 0.010 0.090 - -55.00% -
403.gcc (unexplained diff vs previous) 418.18% 11.000 57.000 - 159.09% -
403.gcc (unexplained diff vs previous) (percentage) 400.00% 0.120 0.600 - 160.87% -
433.milc (unexplained diff vs previous) 107.69% 13.000 27.000 - 125.00% -
433.milc (unexplained diff vs previous) (percentage) 100.00% 0.100 0.200 - 122.22% -
464.h264ref (max) 78.33% 60.000 107.000 - -5.31% -
464.h264ref (max) (percentage) 76.19% 0.420 0.740 - -5.13% -
433.milc (max) 68.52% 108.000 182.000 - -5.70% -
433.milc (max) (percentage) 67.50% 0.800 1.340 - -5.63% -
464.h264ref (avg) (percentage) 20.69% 0.290 0.350 - 2.94% -
464.h264ref 19.05% 42.000 50.000 - 2.04% -
464.h264ref (avg) 19.05% 42.000 50.000 - 2.04% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.04% 2281.000 22.000 - -4.35% -
429.mcf (max) (percentage) -99.02% 16.310 0.160 - -5.88% -
470.lbm (unexplained diff vs previous) (percentage) -98.68% 6.060 0.080 - 33.33% -
470.lbm (unexplained diff vs previous) -98.63% 804.000 11.000 - 37.50% -
473.astar (max) -97.69% 822.000 19.000 - -13.64% -
473.astar (max) (percentage) -97.61% 6.700 0.160 - -11.11% -
401.bzip2 (max) -97.37% 609.000 16.000 - 0.00% -
401.bzip2 (max) (percentage) -97.35% 3.780 0.100 - 0.00% -
401.bzip2 (unexplained diff vs previous) -96.97% 33.000 1.000 - -80.00% -
483.xalancbmk (max) -95.62% 1209.000 53.000 - -8.62% -
483.xalancbmk (max) (percentage) -95.58% 12.900 0.570 - -8.06% -
456.hmmer (max) -95.25% 1242.000 59.000 - -9.23% -
456.hmmer (max) (percentage) -95.23% 10.480 0.500 - -9.09% -
401.bzip2 (unexplained diff vs previous) (percentage) -95.00% 0.200 0.010 - -66.67% -
458.sjeng (max) -94.29% 876.000 50.000 - -92.59% -
458.sjeng (max) (percentage) -94.16% 5.140 0.300 - -92.48% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.88% 3.430 0.210 - -67.19% -
482.sphinx3 (unexplained diff vs previous) -93.87% 914.000 56.000 - -67.25% -
462.libquantum (max) -92.06% 919.000 73.000 - -8.75% -
462.libquantum (max) (percentage) -92.01% 6.380 0.510 - -8.93% -
471.omnetpp (max) (percentage) -89.66% 9.280 0.960 - -6.80% -
471.omnetpp (max) -89.51% 972.000 102.000 - -6.42% -
450.soplex (max) -81.93% 249.000 45.000 - -25.00% -
450.soplex (max) (percentage) -81.82% 1.650 0.300 - -25.00% -
447.dealII (max) -78.92% 223.000 47.000 - -4.08% -
447.dealII (max) (percentage) -78.57% 2.380 0.510 - -3.77% -
447.dealII (unexplained diff vs previous) -77.78% 54.000 12.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -77.59% 0.580 0.130 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -66.67% 0.060 0.020 - 0.00% -
444.namd (unexplained diff vs previous) -62.50% 8.000 3.000 - 0.00% -
453.povray (max) -56.00% 25.000 11.000 - -15.38% -
453.povray (max) (percentage) -52.78% 0.360 0.170 - -10.53% -
473.astar (unexplained diff vs previous) -48.00% 25.000 13.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -41.30% 0.460 0.270 - -32.50% -
450.soplex (unexplained diff vs previous) -40.58% 69.000 41.000 - -31.67% -
445.gobmk (unexplained diff vs previous) -40.00% 40.000 24.000 - 118.18% -
445.gobmk (unexplained diff vs previous) (percentage) -38.89% 0.360 0.220 - 120.00% -
444.namd (max) -38.38% 1003.000 618.000 - -8.71% -
444.namd (max) (percentage) -38.32% 8.090 4.990 - -8.61% -
471.omnetpp (unexplained diff vs previous) (percentage) -36.73% 0.980 0.620 - 19.23% -
471.omnetpp (unexplained diff vs previous) -35.92% 103.000 66.000 - 20.00% -
429.mcf (avg) (percentage) -32.55% 2.120 1.430 - -7.14% -
429.mcf -32.43% 296.000 200.000 - -6.98% -
429.mcf (avg) -32.43% 296.000 200.000 - -6.98% -
401.bzip2 (avg) (percentage) -32.31% 0.650 0.440 - -6.38% -
429.mcf (unexplained diff vs previous) -31.82% 22.000 15.000 - 150.00% -
401.bzip2 -31.73% 104.000 71.000 - -5.33% -
401.bzip2 (avg) -31.73% 104.000 71.000 - -5.33% -
473.astar (avg) (percentage) -31.52% 0.920 0.630 - -5.97% -
429.mcf (unexplained diff vs previous) (percentage) -31.25% 0.160 0.110 - 175.00% -
473.astar -31.25% 112.000 77.000 - -6.10% -
473.astar (avg) -31.25% 112.000 77.000 - -6.10% -
483.xalancbmk -28.79% 198.000 141.000 - -7.84% -
483.xalancbmk (avg) -28.79% 198.000 141.000 - -7.84% -
483.xalancbmk (avg) (percentage) -28.77% 2.120 1.510 - -7.36% -
447.dealII -27.55% 98.000 71.000 - -6.58% -
447.dealII (avg) -27.55% 98.000 71.000 - -6.58% -
458.sjeng -27.21% 136.000 99.000 - -6.60% -
458.sjeng (avg) -27.21% 136.000 99.000 - -6.60% -
447.dealII (avg) (percentage) -26.67% 1.050 0.770 - -6.10% -
458.sjeng (avg) (percentage) -26.25% 0.800 0.590 - -6.35% -
445.gobmk -24.32% 74.000 56.000 - -6.67% -
445.gobmk (avg) -24.32% 74.000 56.000 - -6.67% -
403.gcc (max) (percentage) -24.03% 2.330 1.770 - -3.28% -
403.gcc (max) -23.98% 221.000 168.000 - -4.00% -
470.lbm (max) (percentage) -23.95% 5.720 4.350 - -9.94% -
445.gobmk (avg) (percentage) -23.88% 0.670 0.510 - -7.27% -
453.povray (avg) (percentage) -23.75% 0.800 0.610 - -7.58% -
456.hmmer (avg) (percentage) -23.74% 1.390 1.060 - -6.19% -
453.povray -23.64% 55.000 42.000 - -8.70% -
453.povray (avg) -23.64% 55.000 42.000 - -8.70% -
470.lbm (max) -23.61% 758.000 579.000 - -9.81% -
456.hmmer -23.17% 164.000 126.000 - -5.97% -
456.hmmer (avg) -23.17% 164.000 126.000 - -5.97% -
456.hmmer (unexplained diff vs previous) (percentage) -23.08% 0.390 0.300 - -14.29% -
445.gobmk (max) -22.76% 413.000 319.000 - -3.33% -
445.gobmk (max) (percentage) -22.25% 3.730 2.900 - -3.01% -
456.hmmer (unexplained diff vs previous) -21.74% 46.000 36.000 - -14.29% -
462.libquantum (avg) (percentage) -19.48% 0.770 0.620 - -7.46% -
462.libquantum -19.09% 110.000 89.000 - -7.29% -
462.libquantum (avg) -19.09% 110.000 89.000 - -7.29% -
433.milc (avg) (percentage) -15.12% 0.860 0.730 - -6.41% -
450.soplex -14.67% 75.000 64.000 - -5.88% -
450.soplex (avg) -14.67% 75.000 64.000 - -5.88% -
433.milc -14.66% 116.000 99.000 - -6.60% -
433.milc (avg) -14.66% 116.000 99.000 - -6.60% -
450.soplex (avg) (percentage) -14.00% 0.500 0.430 - -4.44% -
471.omnetpp (avg) (percentage) -13.13% 1.600 1.390 - -3.47% -
482.sphinx3 (max) -13.02% 883.000 768.000 - -5.19% -
482.sphinx3 (max) (percentage) -12.99% 3.310 2.880 - -5.26% -
471.omnetpp -11.38% 167.000 148.000 - -3.27% -
471.omnetpp (avg) -11.38% 167.000 148.000 - -3.27% -
470.lbm (avg) (percentage) -8.71% 3.330 3.040 - -7.03% -
470.lbm -8.39% 441.000 404.000 - -7.13% -
470.lbm (avg) -8.39% 441.000 404.000 - -7.13% -
482.sphinx3 (avg) (percentage) -6.32% 1.740 1.630 - -8.43% -
482.sphinx3 -6.25% 464.000 435.000 - -8.23% -
482.sphinx3 (avg) -6.25% 464.000 435.000 - -8.23% -
403.gcc -5.77% 52.000 49.000 - 0.00% -
403.gcc (avg) -5.77% 52.000 49.000 - 0.00% -
403.gcc (avg) (percentage) -5.45% 0.550 0.520 - 0.00% -
444.namd (avg) (percentage) -2.33% 2.570 2.510 - -7.72% -
444.namd -2.20% 318.000 311.000 - -7.72% -
444.namd (avg) -2.20% 318.000 311.000 - -7.72% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 16137.000 -
403.gcc 9526.000 -
429.mcf 14012.000 -
433.milc 13623.000 -
444.namd 12400.000 -
445.gobmk 11021.000 -
447.dealII 9325.000 -
450.soplex 15071.000 -
453.povray 7006.000 -
456.hmmer 11955.000 -
458.sjeng 16903.000 -
462.libquantum 14437.000 -
464.h264ref 14518.000 -
470.lbm 13315.000 -
471.omnetpp 10691.000 -
473.astar 12283.000 -
482.sphinx3 26701.000 -
483.xalancbmk 9395.000 -
Geometric Mean 12695.011 -
Code Size (bytes)
Name Current %
401.bzip2 33698.000 -
403.gcc 1669392.000 -
429.mcf 7239.000 -
433.milc 47025.000 -
444.namd 124963.000 -
445.gobmk 1260795.000 -
447.dealII 195792.000 -
450.soplex 146765.000 -
453.povray 524461.000 -
456.hmmer 80877.000 -
458.sjeng 80233.000 -
462.libquantum 12504.000 -
464.h264ref 303807.000 -
470.lbm 9338.000 -
471.omnetpp 316668.000 -
473.astar 15470.000 -
482.sphinx3 87927.000 -
483.xalancbmk 1615504.000 -
Geometric Mean 111662.466 -
sample variability
Name Current %
401.bzip2 71.000 -5.33%
401.bzip2 (avg) 71.000 -5.33%
401.bzip2 (avg) (percentage) 0.440 -6.38%
401.bzip2 (max) 16.000 -
401.bzip2 (max) (percentage) 0.100 -
401.bzip2 (unexplained diff vs previous) 1.000 -80.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.010 -66.67%
403.gcc 49.000 -
403.gcc (avg) 49.000 -
403.gcc (avg) (percentage) 0.520 -
403.gcc (max) 168.000 -4.00%
403.gcc (max) (percentage) 1.770 -3.28%
403.gcc (unexplained diff vs previous) 57.000 159.09%
403.gcc (unexplained diff vs previous) (percentage) 0.600 160.87%
429.mcf 200.000 -6.98%
429.mcf (avg) 200.000 -6.98%
429.mcf (avg) (percentage) 1.430 -7.14%
429.mcf (max) 22.000 -4.35%
429.mcf (max) (percentage) 0.160 -5.88%
429.mcf (unexplained diff vs previous) 15.000 150.00%
429.mcf (unexplained diff vs previous) (percentage) 0.110 175.00%
433.milc 99.000 -6.60%
433.milc (avg) 99.000 -6.60%
433.milc (avg) (percentage) 0.730 -6.41%
433.milc (max) 182.000 -5.70%
433.milc (max) (percentage) 1.340 -5.63%
433.milc (unexplained diff vs previous) 27.000 125.00%
433.milc (unexplained diff vs previous) (percentage) 0.200 122.22%
444.namd 311.000 -7.72%
444.namd (avg) 311.000 -7.72%
444.namd (avg) (percentage) 2.510 -7.72%
444.namd (max) 618.000 -8.71%
444.namd (max) (percentage) 4.990 -8.61%
444.namd (unexplained diff vs previous) 3.000 -
444.namd (unexplained diff vs previous) (percentage) 0.020 -
445.gobmk 56.000 -6.67%
445.gobmk (avg) 56.000 -6.67%
445.gobmk (avg) (percentage) 0.510 -7.27%
445.gobmk (max) 319.000 -3.33%
445.gobmk (max) (percentage) 2.900 -3.01%
445.gobmk (unexplained diff vs previous) 24.000 118.18%
445.gobmk (unexplained diff vs previous) (percentage) 0.220 120.00%
447.dealII 71.000 -6.58%
447.dealII (avg) 71.000 -6.58%
447.dealII (avg) (percentage) 0.770 -6.10%
447.dealII (max) 47.000 -4.08%
447.dealII (max) (percentage) 0.510 -3.77%
447.dealII (unexplained diff vs previous) 12.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.130 -
450.soplex 64.000 -5.88%
450.soplex (avg) 64.000 -5.88%
450.soplex (avg) (percentage) 0.430 -4.44%
450.soplex (max) 45.000 -25.00%
450.soplex (max) (percentage) 0.300 -25.00%
450.soplex (unexplained diff vs previous) 41.000 -31.67%
450.soplex (unexplained diff vs previous) (percentage) 0.270 -32.50%
453.povray 42.000 -8.70%
453.povray (avg) 42.000 -8.70%
453.povray (avg) (percentage) 0.610 -7.58%
453.povray (max) 11.000 -15.38%
453.povray (max) (percentage) 0.170 -10.53%
453.povray (unexplained diff vs previous) 11.000 57.14%
453.povray (unexplained diff vs previous) (percentage) 0.160 60.00%
456.hmmer 126.000 -5.97%
456.hmmer (avg) 126.000 -5.97%
456.hmmer (avg) (percentage) 1.060 -6.19%
456.hmmer (max) 59.000 -9.23%
456.hmmer (max) (percentage) 0.500 -9.09%
456.hmmer (unexplained diff vs previous) 36.000 -14.29%
456.hmmer (unexplained diff vs previous) (percentage) 0.300 -14.29%
458.sjeng 99.000 -6.60%
458.sjeng (avg) 99.000 -6.60%
458.sjeng (avg) (percentage) 0.590 -6.35%
458.sjeng (max) 50.000 -92.59%
458.sjeng (max) (percentage) 0.300 -92.48%
458.sjeng (unexplained diff vs previous) 33.000 -41.07%
458.sjeng (unexplained diff vs previous) (percentage) 0.200 -39.39%
462.libquantum 89.000 -7.29%
462.libquantum (avg) 89.000 -7.29%
462.libquantum (avg) (percentage) 0.620 -7.46%
462.libquantum (max) 73.000 -8.75%
462.libquantum (max) (percentage) 0.510 -8.93%
462.libquantum (unexplained diff vs previous) 13.000 -55.17%
462.libquantum (unexplained diff vs previous) (percentage) 0.090 -55.00%
464.h264ref 50.000 2.04%
464.h264ref (avg) 50.000 2.04%
464.h264ref (avg) (percentage) 0.350 -
464.h264ref (max) 107.000 -5.31%
464.h264ref (max) (percentage) 0.740 -5.13%
464.h264ref (unexplained diff vs previous) 74.000 -35.65%
464.h264ref (unexplained diff vs previous) (percentage) 0.510 -35.44%
470.lbm 404.000 -7.13%
470.lbm (avg) 404.000 -7.13%
470.lbm (avg) (percentage) 3.040 -7.03%
470.lbm (max) 579.000 -9.81%
470.lbm (max) (percentage) 4.350 -9.94%
470.lbm (unexplained diff vs previous) 11.000 37.50%
470.lbm (unexplained diff vs previous) (percentage) 0.080 33.33%
471.omnetpp 148.000 -3.27%
471.omnetpp (avg) 148.000 -3.27%
471.omnetpp (avg) (percentage) 1.390 -3.47%
471.omnetpp (max) 102.000 -6.42%
471.omnetpp (max) (percentage) 0.960 -6.80%
471.omnetpp (unexplained diff vs previous) 66.000 20.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.620 19.23%
473.astar 77.000 -6.10%
473.astar (avg) 77.000 -6.10%
473.astar (avg) (percentage) 0.630 -5.97%
473.astar (max) 19.000 -13.64%
473.astar (max) (percentage) 0.160 -11.11%
473.astar (unexplained diff vs previous) 13.000 -
473.astar (unexplained diff vs previous) (percentage) 0.110 -
482.sphinx3 435.000 -8.23%
482.sphinx3 (avg) 435.000 -8.23%
482.sphinx3 (avg) (percentage) 1.630 -8.43%
482.sphinx3 (max) 768.000 -5.19%
482.sphinx3 (max) (percentage) 2.880 -5.26%
482.sphinx3 (unexplained diff vs previous) 56.000 -67.25%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.210 -67.19%
483.xalancbmk 141.000 -7.84%
483.xalancbmk (avg) 141.000 -7.84%
483.xalancbmk (avg) (percentage) 1.510 -7.36%
483.xalancbmk (max) 53.000 -8.62%
483.xalancbmk (max) (percentage) 0.570 -8.06%
483.xalancbmk (unexplained diff vs previous) 46.000 -6.12%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.490 -5.77%
Geometric Mean 7.832 5.51%