Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3f0bddb56ac33389e0a02444c6f67c7a42855582 (+ 20 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/70/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0070 (llvmorg-18-init-06703-g3f0bddb56ac3) 2023-09-22T05:14:08 0:00:00
Previous 0069 (llvmorg-18-init-06683-g782f1a0d8956) 2023-09-20T11:01:15 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 13 22
Performance Improvements 83 114
Added Tests 14 10
Unchanged Tests 670 634
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 600.00% 0.010 0.070 - 0.00% -
458.sjeng (unexplained diff vs previous) 500.00% 1.000 6.000 - 0.00% -
462.libquantum (max) (percentage) 463.16% 0.380 2.140 - -66.46% -
482.sphinx3 (unexplained diff vs previous) (percentage) 300.00% 0.100 0.400 - -88.34% -
482.sphinx3 (unexplained diff vs previous) 300.00% 1.000 4.000 - -99.56% -
401.bzip2 (unexplained diff vs previous) 92.31% 13.000 25.000 - -24.24% -
401.bzip2 (unexplained diff vs previous) (percentage) 91.11% 0.450 0.860 - 330.00% -
444.namd (max) 50.00% 4.000 6.000 - -99.40% -
429.mcf (unexplained diff vs previous) 33.33% 6.000 8.000 - -63.64% -
429.mcf (unexplained diff vs previous) (percentage) 32.69% 0.520 0.690 - 331.25% -
444.namd (max) (percentage) 31.58% 0.570 0.750 - -90.73% -
401.bzip2 (max) 25.00% 20.000 25.000 - -95.89% -
401.bzip2 (max) (percentage) 20.83% 0.720 0.870 - -76.98% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.28% 61.000 59.000 - -99.38% -
462.libquantum -2.14% 187.000 183.000 - -98.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -78.26% 23.000 5.000 - -95.15% -
471.omnetpp (unexplained diff vs previous) (percentage) -77.78% 0.810 0.180 - -81.63% -
483.xalancbmk (max) -74.36% 39.000 10.000 - -99.17% -
483.xalancbmk (max) (percentage) -73.28% 1.160 0.310 - -97.60% -
464.h264ref (unexplained diff vs previous) (percentage) -68.00% 0.250 0.080 - 0.00% -
464.h264ref (unexplained diff vs previous) -66.67% 15.000 5.000 - 0.00% -
433.milc (max) -63.64% 11.000 4.000 - -96.30% -
456.hmmer (unexplained diff vs previous) (percentage) -61.76% 0.340 0.130 - -66.67% -
456.hmmer (unexplained diff vs previous) -61.54% 13.000 5.000 - -89.13% -
470.lbm (unexplained diff vs previous) -61.11% 18.000 7.000 - -99.13% -
433.milc (unexplained diff vs previous) (percentage) -60.47% 0.430 0.170 - 70.00% -
433.milc (max) (percentage) -60.42% 0.960 0.380 - -52.50% -
433.milc (unexplained diff vs previous) -60.00% 5.000 2.000 - -84.62% -
470.lbm (unexplained diff vs previous) (percentage) -60.00% 0.450 0.180 - -97.03% -
471.omnetpp (max) (percentage) -47.37% 1.140 0.600 - -93.53% -
471.omnetpp (max) -46.88% 32.000 17.000 - -98.25% -
473.astar (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 - -45.00% -
473.astar (unexplained diff vs previous) -44.44% 9.000 5.000 - -80.00% -
483.xalancbmk (unexplained diff vs previous) -35.71% 14.000 9.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -34.15% 0.410 0.270 - 0.00% -
453.povray (max) -25.00% 8.000 6.000 - -76.00% -
450.soplex -20.00% 5.000 4.000 - -94.67% -
450.soplex (avg) -20.00% 5.000 4.000 - -94.67% -
453.povray (max) (percentage) -18.52% 1.620 1.320 - 266.67% -
433.milc -12.50% 8.000 7.000 - -93.97% -
433.milc (avg) -12.50% 8.000 7.000 - -93.97% -
464.h264ref (max) (percentage) -12.00% 0.250 0.220 - -47.62% -
470.lbm (max) -11.11% 18.000 16.000 - -97.89% -
470.lbm (max) (percentage) -10.87% 0.460 0.410 - -92.83% -
473.astar (max) (percentage) -8.62% 0.580 0.530 - -92.09% -
458.sjeng (max) -8.33% 12.000 11.000 - -98.74% -
429.mcf (max) -7.69% 13.000 12.000 - -99.47% -
473.astar (max) -7.69% 26.000 24.000 - -97.08% -
464.h264ref (max) -7.14% 14.000 13.000 - -78.33% -
450.soplex (max) (percentage) -7.04% 2.840 2.640 - 60.00% -
445.gobmk -6.90% 29.000 27.000 - -63.51% -
445.gobmk (avg) -6.90% 29.000 27.000 - -63.51% -
444.namd -6.67% 15.000 14.000 - -95.60% -
444.namd (avg) -6.67% 15.000 14.000 - -95.60% -
450.soplex (max) -6.67% 15.000 14.000 - -94.38% -
456.hmmer (max) (percentage) -5.88% 0.340 0.320 - -96.95% -
447.dealII (max) -5.56% 18.000 17.000 - -92.38% -
445.gobmk (max) -5.26% 19.000 18.000 - -95.64% -
447.dealII (avg) (percentage) -5.05% 0.990 0.940 - -10.48% -
445.gobmk (avg) (percentage) -5.00% 0.600 0.570 - -14.93% -
447.dealII -5.00% 20.000 19.000 - -80.61% -
447.dealII (avg) -5.00% 20.000 19.000 - -80.61% -
458.sjeng -4.55% 66.000 63.000 - -53.68% -
458.sjeng (avg) -4.55% 66.000 63.000 - -53.68% -
450.soplex (avg) (percentage) -4.30% 0.930 0.890 - 78.00% -
483.xalancbmk (avg) (percentage) -4.25% 3.530 3.380 - 59.43% -
483.xalancbmk -4.20% 119.000 114.000 - -42.42% -
483.xalancbmk (avg) -4.20% 119.000 114.000 - -42.42% -
453.povray (avg) (percentage) -4.08% 0.980 0.940 - 17.50% -
470.lbm -3.90% 77.000 74.000 - -83.22% -
470.lbm (avg) -3.90% 77.000 74.000 - -83.22% -
482.sphinx3 (max) (percentage) -3.77% 0.530 0.510 - -84.59% -
458.sjeng (avg) (percentage) -3.75% 0.800 0.770 - -3.75% -
456.hmmer (avg) (percentage) -3.72% 2.960 2.850 - 105.04% -
473.astar (avg) (percentage) -3.62% 1.380 1.330 - 44.57% -
470.lbm (avg) (percentage) -3.57% 1.960 1.890 - -43.24% -
429.mcf (max) (percentage) -3.57% 1.120 1.080 - -93.38% -
456.hmmer -3.57% 112.000 108.000 - -34.15% -
456.hmmer (avg) -3.57% 112.000 108.000 - -34.15% -
471.omnetpp -3.26% 92.000 89.000 - -46.71% -
471.omnetpp (avg) -3.26% 92.000 89.000 - -46.71% -
473.astar -3.23% 62.000 60.000 - -46.43% -
473.astar (avg) -3.23% 62.000 60.000 - -46.43% -
444.namd (avg) (percentage) -3.14% 1.910 1.850 - -28.02% -
429.mcf -3.12% 32.000 31.000 - -89.53% -
429.mcf (avg) -3.12% 32.000 31.000 - -89.53% -
464.h264ref (avg) (percentage) -3.08% 0.650 0.630 - 117.24% -
471.omnetpp (avg) (percentage) -3.07% 3.260 3.160 - 97.50% -
482.sphinx3 (avg) (percentage) -2.99% 1.340 1.300 - -25.29% -
429.mcf (avg) (percentage) -2.88% 2.780 2.700 - 27.36% -
433.milc (avg) (percentage) -2.82% 0.710 0.690 - -19.77% -
464.h264ref -2.63% 38.000 37.000 - -11.90% -
464.h264ref (avg) -2.63% 38.000 37.000 - -11.90% -
445.gobmk (max) (percentage) -2.56% 0.390 0.380 - -89.81% -
447.dealII (max) (percentage) -2.30% 0.870 0.850 - -64.29% -
403.gcc (max) (percentage) -1.52% 5.280 5.200 - 123.18% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 146765.000 149976.000 - 0.00% -
471.omnetpp 1.52% 316676.000 321493.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21800.00% 0.010 2.190 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 1133.33% 0.060 0.740 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 331.25% 0.160 0.690 - 32.69% -
401.bzip2 (unexplained diff vs previous) (percentage) 330.00% 0.200 0.860 - 91.11% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
453.povray (max) (percentage) 266.67% 0.360 1.320 - -18.52% -
403.gcc (avg) (percentage) 183.64% 0.550 1.560 - 0.00% -
462.libquantum (avg) (percentage) 132.47% 0.770 1.790 - 0.56% -
403.gcc (max) (percentage) 123.18% 2.330 5.200 - -1.52% -
464.h264ref (avg) (percentage) 117.24% 0.290 0.630 - -3.08% -
456.hmmer (avg) (percentage) 105.04% 1.390 2.850 - -3.72% -
471.omnetpp (avg) (percentage) 97.50% 1.600 3.160 - -3.07% -
450.soplex (avg) (percentage) 78.00% 0.500 0.890 - -4.30% -
433.milc (unexplained diff vs previous) (percentage) 70.00% 0.100 0.170 - -60.47% -
450.soplex (max) (percentage) 60.00% 1.650 2.640 - -7.04% -
483.xalancbmk (avg) (percentage) 59.43% 2.120 3.380 - -4.25% -
473.astar (avg) (percentage) 44.57% 0.920 1.330 - -3.62% -
429.mcf (avg) (percentage) 27.36% 2.120 2.700 - -2.88% -
401.bzip2 (avg) (percentage) 21.54% 0.650 0.790 - 0.00% -
453.povray (avg) (percentage) 17.50% 0.800 0.940 - -4.08% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.37% 7239.000 6995.000 - 0.00% -
462.libquantum -1.77% 12504.000 12283.000 - 0.00% -
453.povray -1.77% 524493.000 515235.000 - 0.00% -
433.milc -1.57% 47001.000 46261.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9509.000 59.000 - -3.28% -
462.libquantum -98.73% 14409.000 183.000 - -2.14% -
450.soplex -96.38% 15112.000 547.000 - 0.00% -
482.sphinx3 -96.24% 26682.000 1002.000 - 0.40% -
444.namd -93.47% 12400.000 810.000 - 0.75% -
453.povray -92.87% 6987.000 498.000 - 0.40% -
429.mcf -91.74% 13988.000 1156.000 - -0.69% -
433.milc -91.49% 13601.000 1157.000 - 0.17% -
401.bzip2 -81.98% 16137.000 2908.000 - 0.87% -
447.dealII -77.79% 9380.000 2083.000 - -0.14% -
471.omnetpp -72.83% 10477.000 2847.000 - 0.18% -
470.lbm -70.11% 13259.000 3963.000 - -0.18% -
456.hmmer -67.83% 11854.000 3814.000 - 0.13% -
483.xalancbmk -63.91% 9376.000 3384.000 - -0.27% -
473.astar -62.86% 12272.000 4558.000 - 0.11% -
464.h264ref -58.68% 14498.000 5990.000 - 0.08% -
445.gobmk -55.74% 11093.000 4910.000 - -0.12% -
458.sjeng -51.35% 17055.000 8297.000 - -0.07% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.56% 914.000 4.000 - 300.00% -
429.mcf (max) -99.47% 2281.000 12.000 - -7.69% -
482.sphinx3 (max) -99.43% 883.000 5.000 - 0.00% -
444.namd (max) -99.40% 1003.000 6.000 - 50.00% -
483.xalancbmk (max) -99.17% 1209.000 10.000 - -74.36% -
470.lbm (unexplained diff vs previous) -99.13% 804.000 7.000 - -61.11% -
456.hmmer (max) -99.03% 1242.000 12.000 - 0.00% -
458.sjeng (max) -98.74% 876.000 11.000 - -8.33% -
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
471.omnetpp (max) -98.25% 972.000 17.000 - -46.88% -
470.lbm (max) -97.89% 758.000 16.000 - -11.11% -
483.xalancbmk (max) (percentage) -97.60% 12.900 0.310 - -73.28% -
458.sjeng (max) (percentage) -97.28% 5.140 0.140 - -6.67% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
482.sphinx3 -97.20% 464.000 13.000 - 0.00% -
482.sphinx3 (avg) -97.20% 464.000 13.000 - 0.00% -
473.astar (max) -97.08% 822.000 24.000 - -7.69% -
470.lbm (unexplained diff vs previous) (percentage) -97.03% 6.060 0.180 - -60.00% -
456.hmmer (max) (percentage) -96.95% 10.480 0.320 - -5.88% -
433.milc (max) -96.30% 108.000 4.000 - -63.64% -
401.bzip2 (max) -95.89% 609.000 25.000 - 25.00% -
445.gobmk (max) -95.64% 413.000 18.000 - -5.26% -
444.namd -95.60% 318.000 14.000 - -6.67% -
444.namd (avg) -95.60% 318.000 14.000 - -6.67% -
471.omnetpp (unexplained diff vs previous) -95.15% 103.000 5.000 - -78.26% -
450.soplex -94.67% 75.000 4.000 - -20.00% -
450.soplex (avg) -94.67% 75.000 4.000 - -20.00% -
447.dealII (unexplained diff vs previous) -94.44% 54.000 3.000 - 0.00% -
450.soplex (max) -94.38% 249.000 14.000 - -6.67% -
433.milc -93.97% 116.000 7.000 - -12.50% -
433.milc (avg) -93.97% 116.000 7.000 - -12.50% -
471.omnetpp (max) (percentage) -93.53% 9.280 0.600 - -47.37% -
429.mcf (max) (percentage) -93.38% 16.310 1.080 - -3.57% -
470.lbm (max) (percentage) -92.83% 5.720 0.410 - -10.87% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
447.dealII (max) -92.38% 223.000 17.000 - -5.56% -
473.astar (max) (percentage) -92.09% 6.700 0.530 - -8.62% -
444.namd (max) (percentage) -90.73% 8.090 0.750 - 31.58% -
445.gobmk (max) (percentage) -89.81% 3.730 0.380 - -2.56% -
429.mcf -89.53% 296.000 31.000 - -3.12% -
429.mcf (avg) -89.53% 296.000 31.000 - -3.12% -
456.hmmer (unexplained diff vs previous) -89.13% 46.000 5.000 - -61.54% -
482.sphinx3 (unexplained diff vs previous) (percentage) -88.34% 3.430 0.400 - 300.00% -
445.gobmk (unexplained diff vs previous) -85.00% 40.000 6.000 - 0.00% -
433.milc (unexplained diff vs previous) -84.62% 13.000 2.000 - -60.00% -
482.sphinx3 (max) (percentage) -84.59% 3.310 0.510 - -3.77% -
470.lbm -83.22% 441.000 74.000 - -3.90% -
470.lbm (avg) -83.22% 441.000 74.000 - -3.90% -
471.omnetpp (unexplained diff vs previous) (percentage) -81.63% 0.980 0.180 - -77.78% -
447.dealII -80.61% 98.000 19.000 - -5.00% -
447.dealII (avg) -80.61% 98.000 19.000 - -5.00% -
473.astar (unexplained diff vs previous) -80.00% 25.000 5.000 - -44.44% -
401.bzip2 -78.85% 104.000 22.000 - 0.00% -
401.bzip2 (avg) -78.85% 104.000 22.000 - 0.00% -
464.h264ref (max) -78.33% 60.000 13.000 - -7.14% -
401.bzip2 (max) (percentage) -76.98% 3.780 0.870 - 20.83% -
453.povray (max) -76.00% 25.000 6.000 - -25.00% -
447.dealII (unexplained diff vs previous) (percentage) -75.86% 0.580 0.140 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.360 0.120 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - -61.76% -
462.libquantum (max) (percentage) -66.46% 6.380 2.140 - 463.16% -
447.dealII (max) (percentage) -64.29% 2.380 0.850 - -2.30% -
429.mcf (unexplained diff vs previous) -63.64% 22.000 8.000 - 33.33% -
445.gobmk -63.51% 74.000 27.000 - -6.90% -
445.gobmk (avg) -63.51% 74.000 27.000 - -6.90% -
458.sjeng -53.68% 136.000 63.000 - -4.55% -
458.sjeng (avg) -53.68% 136.000 63.000 - -4.55% -
433.milc (max) (percentage) -52.50% 0.800 0.380 - -60.42% -
464.h264ref (max) (percentage) -47.62% 0.420 0.220 - -12.00% -
471.omnetpp -46.71% 167.000 89.000 - -3.26% -
471.omnetpp (avg) -46.71% 167.000 89.000 - -3.26% -
473.astar -46.43% 112.000 60.000 - -3.23% -
473.astar (avg) -46.43% 112.000 60.000 - -3.23% -
473.astar (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 - -45.00% -
470.lbm (avg) (percentage) -43.24% 3.330 1.890 - -3.57% -
483.xalancbmk -42.42% 198.000 114.000 - -4.20% -
483.xalancbmk (avg) -42.42% 198.000 114.000 - -4.20% -
456.hmmer -34.15% 164.000 108.000 - -3.57% -
456.hmmer (avg) -34.15% 164.000 108.000 - -3.57% -
444.namd (avg) (percentage) -28.02% 2.570 1.850 - -3.14% -
482.sphinx3 (avg) (percentage) -25.29% 1.740 1.300 - -2.99% -
444.namd (unexplained diff vs previous) -25.00% 8.000 6.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -24.24% 33.000 25.000 - 92.31% -
433.milc (avg) (percentage) -19.77% 0.860 0.690 - -2.82% -
445.gobmk (avg) (percentage) -14.93% 0.670 0.570 - -5.00% -
464.h264ref -11.90% 42.000 37.000 - -2.63% -
464.h264ref (avg) -11.90% 42.000 37.000 - -2.63% -
447.dealII (avg) (percentage) -10.48% 1.050 0.940 - -5.05% -
458.sjeng (avg) (percentage) -3.75% 0.800 0.770 - -3.75% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
401.bzip2 2908.000 -
403.gcc 59.000 -3.28%
429.mcf 1156.000 -
433.milc 1157.000 -
444.namd 810.000 -
445.gobmk 4910.000 -
447.dealII 2083.000 -
450.soplex 547.000 -
453.povray 498.000 -
456.hmmer 3814.000 -
458.sjeng 8297.000 -
462.libquantum 183.000 -2.14%
464.h264ref 5990.000 -
470.lbm 3963.000 -
471.omnetpp 2847.000 -
473.astar 4558.000 -
482.sphinx3 1002.000 -
483.xalancbmk 3384.000 -
Geometric Mean 1563.923 -
Code Size (bytes)
Name Current %
401.bzip2 33881.000 -
403.gcc 1667379.000 -
429.mcf 6995.000 -
433.milc 46261.000 -
444.namd 124278.000 -
445.gobmk 1258765.000 -
447.dealII 197510.000 -
450.soplex 149976.000 -
453.povray 515235.000 -
456.hmmer 80429.000 -
458.sjeng 79962.000 -
462.libquantum 12283.000 -
464.h264ref 302071.000 -
470.lbm 9296.000 -
471.omnetpp 321493.000 -
473.astar 15483.000 -
482.sphinx3 87672.000 -
483.xalancbmk 1612456.000 -
Geometric Mean 111248.995 -
sample variability
Name Current %
401.bzip2 22.000 -
401.bzip2 (avg) 22.000 -
401.bzip2 (avg) (percentage) 0.790 -
401.bzip2 (max) 25.000 25.00%
401.bzip2 (max) (percentage) 0.870 20.83%
401.bzip2 (unexplained diff vs previous) 25.000 92.31%
401.bzip2 (unexplained diff vs previous) (percentage) 0.860 91.11%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.560 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.200 -1.52%
429.mcf 31.000 -3.12%
429.mcf (avg) 31.000 -3.12%
429.mcf (avg) (percentage) 2.700 -2.88%
429.mcf (max) 12.000 -7.69%
429.mcf (max) (percentage) 1.080 -3.57%
429.mcf (unexplained diff vs previous) 8.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 0.690 32.69%
433.milc 7.000 -12.50%
433.milc (avg) 7.000 -12.50%
433.milc (avg) (percentage) 0.690 -2.82%
433.milc (max) 4.000 -63.64%
433.milc (max) (percentage) 0.380 -60.42%
433.milc (unexplained diff vs previous) 2.000 -60.00%
433.milc (unexplained diff vs previous) (percentage) 0.170 -60.47%
444.namd 14.000 -6.67%
444.namd (avg) 14.000 -6.67%
444.namd (avg) (percentage) 1.850 -3.14%
444.namd (max) 6.000 50.00%
444.namd (max) (percentage) 0.750 31.58%
444.namd (unexplained diff vs previous) 6.000 -
444.namd (unexplained diff vs previous) (percentage) 0.740 -
445.gobmk 27.000 -6.90%
445.gobmk (avg) 27.000 -6.90%
445.gobmk (avg) (percentage) 0.570 -5.00%
445.gobmk (max) 18.000 -5.26%
445.gobmk (max) (percentage) 0.380 -2.56%
445.gobmk (unexplained diff vs previous) 6.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -
447.dealII 19.000 -5.00%
447.dealII (avg) 19.000 -5.00%
447.dealII (avg) (percentage) 0.940 -5.05%
447.dealII (max) 17.000 -5.56%
447.dealII (max) (percentage) 0.850 -2.30%
447.dealII (unexplained diff vs previous) 3.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.140 -
450.soplex 4.000 -20.00%
450.soplex (avg) 4.000 -20.00%
450.soplex (avg) (percentage) 0.890 -4.30%
450.soplex (max) 14.000 -6.67%
450.soplex (max) (percentage) 2.640 -7.04%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.940 -4.08%
453.povray (max) 6.000 -25.00%
453.povray (max) (percentage) 1.320 -18.52%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.400 -
456.hmmer 108.000 -3.57%
456.hmmer (avg) 108.000 -3.57%
456.hmmer (avg) (percentage) 2.850 -3.72%
456.hmmer (max) 12.000 -
456.hmmer (max) (percentage) 0.320 -5.88%
456.hmmer (unexplained diff vs previous) 5.000 -61.54%
456.hmmer (unexplained diff vs previous) (percentage) 0.130 -61.76%
458.sjeng 63.000 -4.55%
458.sjeng (avg) 63.000 -4.55%
458.sjeng (avg) (percentage) 0.770 -3.75%
458.sjeng (max) 11.000 -8.33%
458.sjeng (max) (percentage) 0.140 -
458.sjeng (unexplained diff vs previous) 6.000 500.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.070 600.00%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.790 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.140 463.16%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.190 -
464.h264ref 37.000 -2.63%
464.h264ref (avg) 37.000 -2.63%
464.h264ref (avg) (percentage) 0.630 -3.08%
464.h264ref (max) 13.000 -7.14%
464.h264ref (max) (percentage) 0.220 -12.00%
464.h264ref (unexplained diff vs previous) 5.000 -66.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.080 -68.00%
470.lbm 74.000 -3.90%
470.lbm (avg) 74.000 -3.90%
470.lbm (avg) (percentage) 1.890 -3.57%
470.lbm (max) 16.000 -11.11%
470.lbm (max) (percentage) 0.410 -10.87%
470.lbm (unexplained diff vs previous) 7.000 -61.11%
470.lbm (unexplained diff vs previous) (percentage) 0.180 -60.00%
471.omnetpp 89.000 -3.26%
471.omnetpp (avg) 89.000 -3.26%
471.omnetpp (avg) (percentage) 3.160 -3.07%
471.omnetpp (max) 17.000 -46.88%
471.omnetpp (max) (percentage) 0.600 -47.37%
471.omnetpp (unexplained diff vs previous) 5.000 -78.26%
471.omnetpp (unexplained diff vs previous) (percentage) 0.180 -77.78%
473.astar 60.000 -3.23%
473.astar (avg) 60.000 -3.23%
473.astar (avg) (percentage) 1.330 -3.62%
473.astar (max) 24.000 -7.69%
473.astar (max) (percentage) 0.530 -8.62%
473.astar (unexplained diff vs previous) 5.000 -44.44%
473.astar (unexplained diff vs previous) (percentage) 0.110 -45.00%
482.sphinx3 13.000 -
482.sphinx3 (avg) 13.000 -
482.sphinx3 (avg) (percentage) 1.300 -2.99%
482.sphinx3 (max) 5.000 -
482.sphinx3 (max) (percentage) 0.510 -3.77%
482.sphinx3 (unexplained diff vs previous) 4.000 300.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.400 300.00%
483.xalancbmk 114.000 -4.20%
483.xalancbmk (avg) 114.000 -4.20%
483.xalancbmk (avg) (percentage) 3.380 -4.25%
483.xalancbmk (max) 10.000 -74.36%
483.xalancbmk (max) (percentage) 0.310 -73.28%
483.xalancbmk (unexplained diff vs previous) 9.000 -35.71%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.270 -34.15%
Geometric Mean 2.521 -35.88%