Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a3093e56fc096f4ed4ea764bf0ee874c1057fc19 (+ 49 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/236/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0236 (llvmorg-21-init-02750-ga3093e56fc09) 2025-02-21T02:49:50 0:00:00
Previous 0235 (llvmorg-21-init-02701-gccad5e77442f) 2025-02-17T23:01:09 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 38 20
Performance Improvements 43 124
Added Tests 2 6
Unchanged Tests 685 618
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.32% 1140.000 1155.000 - -91.74% -
462.libquantum 1.13% 177.000 179.000 - -98.76% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) 1100.00% 0.060 0.720 - 100.00% -
445.gobmk (unexplained diff vs previous) 1066.67% 3.000 35.000 - -12.50% -
429.mcf (unexplained diff vs previous) 650.00% 2.000 15.000 - -31.82% -
429.mcf (unexplained diff vs previous) (percentage) 622.22% 0.180 1.300 - 712.50% -
447.dealII (unexplained diff vs previous) 325.00% 4.000 17.000 - -68.52% -
447.dealII (unexplained diff vs previous) (percentage) 319.05% 0.210 0.880 - 51.72% -
444.namd (unexplained diff vs previous) (percentage) 308.33% 0.120 0.490 - 716.67% -
444.namd (unexplained diff vs previous) 300.00% 1.000 4.000 - -50.00% -
458.sjeng (unexplained diff vs previous) 225.00% 4.000 13.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 220.00% 0.050 0.160 - 0.00% -
433.milc (unexplained diff vs previous) 200.00% 1.000 3.000 - -76.92% -
433.milc (unexplained diff vs previous) (percentage) 188.89% 0.090 0.260 - 160.00% -
445.gobmk (max) 150.00% 14.000 35.000 - -91.53% -
445.gobmk (max) (percentage) 140.00% 0.300 0.720 - -80.70% -
453.povray (unexplained diff vs previous) 100.00% 2.000 4.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 100.00% 0.400 0.800 - 0.00% -
429.mcf (max) 87.50% 8.000 15.000 - -99.34% -
429.mcf (max) (percentage) 73.68% 0.760 1.320 - -91.91% -
450.soplex (unexplained diff vs previous) 50.00% 2.000 3.000 - -95.65% -
450.soplex (unexplained diff vs previous) (percentage) 48.65% 0.370 0.550 - 19.57% -
464.h264ref (max) 31.25% 16.000 21.000 - -65.00% -
464.h264ref (max) (percentage) 25.00% 0.280 0.350 - -16.67% -
464.h264ref (unexplained diff vs previous) (percentage) 25.00% 0.280 0.350 - 0.00% -
464.h264ref (unexplained diff vs previous) 23.53% 17.000 21.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) 14.29% 7.000 8.000 - -75.76% -
470.lbm (max) 13.33% 15.000 17.000 - -97.76% -
401.bzip2 (unexplained diff vs previous) (percentage) 12.00% 0.250 0.280 - 40.00% -
401.bzip2 8.33% 12.000 13.000 - -87.50% -
401.bzip2 (avg) 8.33% 12.000 13.000 - -87.50% -
470.lbm (max) (percentage) 7.50% 0.400 0.430 - -92.48% -
470.lbm (unexplained diff vs previous) (percentage) 7.50% 0.400 0.430 - -92.90% -
470.lbm (unexplained diff vs previous) 6.25% 16.000 17.000 - -97.89% -
473.astar 4.76% 21.000 22.000 - -80.36% -
473.astar (avg) 4.76% 21.000 22.000 - -80.36% -
445.gobmk (avg) (percentage) 4.00% 0.250 0.260 - -61.19% -
447.dealII (avg) (percentage) 1.35% 0.740 0.750 - -28.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -83.33% 6.000 1.000 - -99.89% -
482.sphinx3 (unexplained diff vs previous) (percentage) -83.33% 0.600 0.100 - -97.08% -
456.hmmer (unexplained diff vs previous) -62.86% 35.000 13.000 - -71.74% -
456.hmmer (unexplained diff vs previous) (percentage) -62.64% 0.910 0.340 - -12.82% -
403.gcc -50.00% 2.000 1.000 - -98.08% -
403.gcc (avg) -50.00% 2.000 1.000 - -98.08% -
482.sphinx3 (max) (percentage) -49.47% 2.810 1.420 - -57.10% -
482.sphinx3 (max) -48.15% 27.000 14.000 - -98.41% -
471.omnetpp (unexplained diff vs previous) (percentage) -34.38% 0.320 0.210 - -78.57% -
471.omnetpp (unexplained diff vs previous) -33.33% 9.000 6.000 - -94.17% -
473.astar (max) (percentage) -23.61% 0.720 0.550 - -91.79% -
473.astar (max) -21.88% 32.000 25.000 - -96.96% -
450.soplex (max) -20.00% 5.000 4.000 - -98.39% -
401.bzip2 (max) -14.29% 14.000 12.000 - -98.03% -
403.gcc (max) (percentage) -12.66% 6.320 5.520 - 136.91% -
482.sphinx3 -12.50% 8.000 7.000 - -98.49% -
482.sphinx3 (avg) -12.50% 8.000 7.000 - -98.49% -
456.hmmer (max) -11.43% 35.000 31.000 - -97.50% -
447.dealII (max) -10.53% 19.000 17.000 - -92.38% -
401.bzip2 (max) (percentage) -10.00% 0.500 0.450 - -88.10% -
456.hmmer (max) (percentage) -9.78% 0.920 0.830 - -92.08% -
433.milc (max) (percentage) -9.52% 0.420 0.380 - -52.50% -
471.omnetpp (max) (percentage) -9.52% 0.840 0.760 - -91.81% -
471.omnetpp (max) -8.70% 23.000 21.000 - -97.84% -
462.libquantum (max) (percentage) -7.54% 1.990 1.840 - -71.16% -
447.dealII (max) (percentage) -6.06% 0.990 0.930 - -60.92% -
458.sjeng (max) -5.56% 18.000 17.000 - -98.06% -
403.gcc (avg) (percentage) -5.41% 3.700 3.500 - 536.36% -
473.astar (unexplained diff vs previous) (percentage) -5.26% 0.570 0.540 - 170.00% -
458.sjeng (max) (percentage) -4.35% 0.230 0.220 - -95.72% -
456.hmmer -4.35% 23.000 22.000 - -86.59% -
456.hmmer (avg) -4.35% 23.000 22.000 - -86.59% -
444.namd (max) (percentage) -3.85% 0.520 0.500 - -93.82% -
473.astar (unexplained diff vs previous) -3.85% 26.000 25.000 - 0.00% -
453.povray (max) (percentage) -3.53% 0.850 0.820 - 127.78% -
450.soplex (max) (percentage) -3.16% 0.950 0.920 - -44.24% -
471.omnetpp -2.78% 36.000 35.000 - -79.04% -
471.omnetpp (avg) -2.78% 36.000 35.000 - -79.04% -
456.hmmer (avg) (percentage) -1.64% 0.610 0.600 - -56.83% -
471.omnetpp (avg) (percentage) -1.56% 1.280 1.260 - -21.25% -
433.milc (avg) (percentage) -1.32% 0.760 0.750 - -12.79% -
482.sphinx3 (avg) (percentage) -1.23% 0.810 0.800 - -54.02% -
453.povray (avg) (percentage) -1.01% 0.990 0.980 - 22.50% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.24% 146765.000 150048.000 - 0.00% -
471.omnetpp 2.08% 316676.000 323250.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 11100.00% 0.010 1.120 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 716.67% 0.060 0.490 - 308.33% -
429.mcf (unexplained diff vs previous) (percentage) 712.50% 0.160 1.300 - 622.22% -
403.gcc (avg) (percentage) 536.36% 0.550 3.500 - -5.41% -
473.astar (unexplained diff vs previous) (percentage) 170.00% 0.200 0.540 - -5.26% -
450.soplex (avg) (percentage) 168.00% 0.500 1.340 - -0.74% -
433.milc (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 - 188.89% -
403.gcc (max) (percentage) 136.91% 2.330 5.520 - -12.66% -
453.povray (max) (percentage) 127.78% 0.360 0.820 - -3.53% -
462.libquantum (avg) (percentage) 102.60% 0.770 1.560 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 100.00% 0.360 0.720 - 1100.00% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 51.72% 0.580 0.880 - 319.05% -
401.bzip2 (unexplained diff vs previous) (percentage) 40.00% 0.200 0.280 - 12.00% -
453.povray (avg) (percentage) 22.50% 0.800 0.980 - -1.01% -
450.soplex (unexplained diff vs previous) (percentage) 19.57% 0.460 0.550 - 48.65% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.31% 7239.000 6927.000 - 0.00% -
462.libquantum -3.59% 12504.000 12055.000 - 0.00% -
453.povray -2.37% 524493.000 512068.000 - 0.00% -
433.milc -2.24% 47001.000 45949.000 - 0.00% -
464.h264ref -1.95% 303767.000 297845.000 - 0.01% -
444.namd -1.85% 124963.000 122654.000 - 0.00% -
401.bzip2 -1.68% 33698.000 33133.000 - 0.00% -
458.sjeng -1.49% 80297.000 79098.000 - 0.00% -
456.hmmer -1.22% 80861.000 79873.000 - 0.00% -
470.lbm -1.22% 9338.000 9224.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9509.000 57.000 - 0.00% -
462.libquantum -98.76% 14409.000 179.000 - 1.13% -
450.soplex -96.42% 15112.000 541.000 - -0.55% -
482.sphinx3 -96.28% 26682.000 993.000 - 0.10% -
444.namd -93.48% 12400.000 809.000 - 0.50% -
453.povray -92.84% 6987.000 500.000 - 0.81% -
429.mcf -91.74% 13988.000 1155.000 - 1.32% -
433.milc -91.35% 13601.000 1176.000 - 0.26% -
401.bzip2 -82.46% 16137.000 2830.000 - 0.28% -
447.dealII -79.52% 9380.000 1921.000 - -0.88% -
471.omnetpp -73.00% 10477.000 2829.000 - 0.21% -
470.lbm -70.00% 13259.000 3978.000 - -0.43% -
456.hmmer -67.79% 11854.000 3818.000 - -0.34% -
473.astar -62.49% 12272.000 4603.000 - 0.55% -
464.h264ref -58.42% 14498.000 6028.000 - -0.35% -
445.gobmk -55.93% 11093.000 4889.000 - 0.72% -
458.sjeng -52.37% 17055.000 8123.000 - -0.16% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 914.000 1.000 - -83.33% -
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
444.namd (max) -99.60% 1003.000 4.000 - 0.00% -
429.mcf (max) -99.34% 2281.000 15.000 - 87.50% -
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
482.sphinx3 -98.49% 464.000 7.000 - -12.50% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - -12.50% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
482.sphinx3 (max) -98.41% 883.000 14.000 - -48.15% -
450.soplex (max) -98.39% 249.000 4.000 - -20.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc -98.08% 52.000 1.000 - -50.00% -
403.gcc (avg) -98.08% 52.000 1.000 - -50.00% -
458.sjeng (max) -98.06% 876.000 17.000 - -5.56% -
401.bzip2 (max) -98.03% 609.000 12.000 - -14.29% -
470.lbm (unexplained diff vs previous) -97.89% 804.000 17.000 - 6.25% -
471.omnetpp (max) -97.84% 972.000 21.000 - -8.70% -
470.lbm (max) -97.76% 758.000 17.000 - 13.33% -
456.hmmer (max) -97.50% 1242.000 31.000 - -11.43% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.08% 3.430 0.100 - -83.33% -
473.astar (max) -96.96% 822.000 25.000 - -21.88% -
433.milc (max) -96.30% 108.000 4.000 - 0.00% -
458.sjeng (max) (percentage) -95.72% 5.140 0.220 - -4.35% -
450.soplex (unexplained diff vs previous) -95.65% 69.000 3.000 - 50.00% -
429.mcf -95.27% 296.000 14.000 - 0.00% -
429.mcf (avg) -95.27% 296.000 14.000 - 0.00% -
470.lbm -94.78% 441.000 23.000 - 0.00% -
470.lbm (avg) -94.78% 441.000 23.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -94.17% 103.000 6.000 - -33.33% -
444.namd (max) (percentage) -93.82% 8.090 0.500 - -3.85% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.90% 6.060 0.430 - 7.50% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
470.lbm (max) (percentage) -92.48% 5.720 0.430 - 7.50% -
447.dealII (max) -92.38% 223.000 17.000 - -10.53% -
456.hmmer (max) (percentage) -92.08% 10.480 0.830 - -9.78% -
429.mcf (max) (percentage) -91.91% 16.310 1.320 - 73.68% -
471.omnetpp (max) (percentage) -91.81% 9.280 0.760 - -9.52% -
473.astar (max) (percentage) -91.79% 6.700 0.550 - -23.61% -
445.gobmk (max) -91.53% 413.000 35.000 - 150.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
401.bzip2 (max) (percentage) -88.10% 3.780 0.450 - -10.00% -
401.bzip2 -87.50% 104.000 13.000 - 8.33% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 8.33% -
456.hmmer -86.59% 164.000 22.000 - -4.35% -
456.hmmer (avg) -86.59% 164.000 22.000 - -4.35% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
453.povray (max) -84.00% 25.000 4.000 - 0.00% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -82.58% 3.330 0.580 - 0.00% -
458.sjeng -82.35% 136.000 24.000 - 0.00% -
458.sjeng (avg) -82.35% 136.000 24.000 - 0.00% -
445.gobmk (max) (percentage) -80.70% 3.730 0.720 - 140.00% -
473.astar -80.36% 112.000 22.000 - 4.76% -
473.astar (avg) -80.36% 112.000 22.000 - 4.76% -
471.omnetpp -79.04% 167.000 35.000 - -2.78% -
471.omnetpp (avg) -79.04% 167.000 35.000 - -2.78% -
471.omnetpp (unexplained diff vs previous) (percentage) -78.57% 0.980 0.210 - -34.38% -
433.milc (unexplained diff vs previous) -76.92% 13.000 3.000 - 200.00% -
401.bzip2 (unexplained diff vs previous) -75.76% 33.000 8.000 - 14.29% -
444.namd (avg) (percentage) -73.54% 2.570 0.680 - 0.00% -
456.hmmer (unexplained diff vs previous) -71.74% 46.000 13.000 - -62.86% -
464.h264ref -71.43% 42.000 12.000 - 0.00% -
464.h264ref (avg) -71.43% 42.000 12.000 - 0.00% -
462.libquantum (max) (percentage) -71.16% 6.380 1.840 - -7.54% -
447.dealII (unexplained diff vs previous) -68.52% 54.000 17.000 - 325.00% -
464.h264ref (max) -65.00% 60.000 21.000 - 31.25% -
458.sjeng (avg) (percentage) -62.50% 0.800 0.300 - 0.00% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 4.00% -
447.dealII (max) (percentage) -60.92% 2.380 0.930 - -6.06% -
482.sphinx3 (max) (percentage) -57.10% 3.310 1.420 - -49.47% -
456.hmmer (avg) (percentage) -56.83% 1.390 0.600 - -1.64% -
482.sphinx3 (avg) (percentage) -54.02% 1.740 0.800 - -1.23% -
433.milc (max) (percentage) -52.50% 0.800 0.380 - -9.52% -
444.namd (unexplained diff vs previous) -50.00% 8.000 4.000 - 300.00% -
473.astar (avg) (percentage) -47.83% 0.920 0.480 - 0.00% -
450.soplex (max) (percentage) -44.24% 1.650 0.920 - -3.16% -
429.mcf (avg) (percentage) -39.62% 2.120 1.280 - 0.79% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
429.mcf (unexplained diff vs previous) -31.82% 22.000 15.000 - 650.00% -
401.bzip2 (avg) (percentage) -29.23% 0.650 0.460 - 0.00% -
447.dealII (avg) (percentage) -28.57% 1.050 0.750 - 1.35% -
464.h264ref (avg) (percentage) -27.59% 0.290 0.210 - 0.00% -
471.omnetpp (avg) (percentage) -21.25% 1.600 1.260 - -1.56% -
464.h264ref (max) (percentage) -16.67% 0.420 0.350 - 25.00% -
456.hmmer (unexplained diff vs previous) (percentage) -12.82% 0.390 0.340 - -62.64% -
433.milc (avg) (percentage) -12.79% 0.860 0.750 - -1.32% -
445.gobmk (unexplained diff vs previous) -12.50% 40.000 35.000 - 1066.67% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2830.000 -
403.gcc 57.000 -
429.mcf 1155.000 1.32%
433.milc 1176.000 -
444.namd 809.000 -
445.gobmk 4889.000 -
447.dealII 1921.000 -
450.soplex 541.000 -
453.povray 500.000 -
456.hmmer 3818.000 -
458.sjeng 8123.000 -
462.libquantum 179.000 1.13%
464.h264ref 6028.000 -
470.lbm 3978.000 -
471.omnetpp 2829.000 -
473.astar 4603.000 -
482.sphinx3 993.000 -
Geometric Mean 1478.984 -
Code Size (bytes)
Name Current %
401.bzip2 33133.000 -
403.gcc 1652939.000 -
429.mcf 6927.000 -
433.milc 45949.000 -
444.namd 122654.000 -
445.gobmk 1255453.000 -
447.dealII 193875.000 -
450.soplex 150048.000 -
453.povray 512068.000 -
456.hmmer 79873.000 -
458.sjeng 79098.000 -
462.libquantum 12055.000 -
464.h264ref 297845.000 -
470.lbm 9224.000 -
471.omnetpp 323250.000 -
473.astar 15583.000 -
482.sphinx3 87416.000 -
Geometric Mean 94295.207 -
sample variability
Name Current %
401.bzip2 13.000 8.33%
401.bzip2 (avg) 13.000 8.33%
401.bzip2 (avg) (percentage) 0.460 -
401.bzip2 (max) 12.000 -14.29%
401.bzip2 (max) (percentage) 0.450 -10.00%
401.bzip2 (unexplained diff vs previous) 8.000 14.29%
401.bzip2 (unexplained diff vs previous) (percentage) 0.280 12.00%
403.gcc 1.000 -50.00%
403.gcc (avg) 1.000 -50.00%
403.gcc (avg) (percentage) 3.500 -5.41%
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.520 -12.66%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.280 -
429.mcf (max) 15.000 87.50%
429.mcf (max) (percentage) 1.320 73.68%
429.mcf (unexplained diff vs previous) 15.000 650.00%
429.mcf (unexplained diff vs previous) (percentage) 1.300 622.22%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.750 -1.32%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.380 -9.52%
433.milc (unexplained diff vs previous) 3.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 188.89%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.680 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.500 -3.85%
444.namd (unexplained diff vs previous) 4.000 300.00%
444.namd (unexplained diff vs previous) (percentage) 0.490 308.33%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 4.00%
445.gobmk (max) 35.000 150.00%
445.gobmk (max) (percentage) 0.720 140.00%
445.gobmk (unexplained diff vs previous) 35.000 1066.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.720 1100.00%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.750 1.35%
447.dealII (max) 17.000 -10.53%
447.dealII (max) (percentage) 0.930 -6.06%
447.dealII (unexplained diff vs previous) 17.000 325.00%
447.dealII (unexplained diff vs previous) (percentage) 0.880 319.05%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.340 -
450.soplex (max) 4.000 -20.00%
450.soplex (max) (percentage) 0.920 -3.16%
450.soplex (unexplained diff vs previous) 3.000 50.00%
450.soplex (unexplained diff vs previous) (percentage) 0.550 48.65%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.980 -1.01%
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.820 -3.53%
453.povray (unexplained diff vs previous) 4.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 0.800 100.00%
456.hmmer 22.000 -4.35%
456.hmmer (avg) 22.000 -4.35%
456.hmmer (avg) (percentage) 0.600 -1.64%
456.hmmer (max) 31.000 -11.43%
456.hmmer (max) (percentage) 0.830 -9.78%
456.hmmer (unexplained diff vs previous) 13.000 -62.86%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 -62.64%
458.sjeng 24.000 -
458.sjeng (avg) 24.000 -
458.sjeng (avg) (percentage) 0.300 -
458.sjeng (max) 17.000 -5.56%
458.sjeng (max) (percentage) 0.220 -4.35%
458.sjeng (unexplained diff vs previous) 13.000 225.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.160 220.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.560 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.840 -7.54%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.120 -
464.h264ref 12.000 -
464.h264ref (avg) 12.000 -
464.h264ref (avg) (percentage) 0.210 -
464.h264ref (max) 21.000 31.25%
464.h264ref (max) (percentage) 0.350 25.00%
464.h264ref (unexplained diff vs previous) 21.000 23.53%
464.h264ref (unexplained diff vs previous) (percentage) 0.350 25.00%
470.lbm 23.000 -
470.lbm (avg) 23.000 -
470.lbm (avg) (percentage) 0.580 -
470.lbm (max) 17.000 13.33%
470.lbm (max) (percentage) 0.430 7.50%
470.lbm (unexplained diff vs previous) 17.000 6.25%
470.lbm (unexplained diff vs previous) (percentage) 0.430 7.50%
471.omnetpp 35.000 -2.78%
471.omnetpp (avg) 35.000 -2.78%
471.omnetpp (avg) (percentage) 1.260 -1.56%
471.omnetpp (max) 21.000 -8.70%
471.omnetpp (max) (percentage) 0.760 -9.52%
471.omnetpp (unexplained diff vs previous) 6.000 -33.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.210 -34.38%
473.astar 22.000 4.76%
473.astar (avg) 22.000 4.76%
473.astar (avg) (percentage) 0.480 -
473.astar (max) 25.000 -21.88%
473.astar (max) (percentage) 0.550 -23.61%
473.astar (unexplained diff vs previous) 25.000 -3.85%
473.astar (unexplained diff vs previous) (percentage) 0.540 -5.26%
482.sphinx3 7.000 -12.50%
482.sphinx3 (avg) 7.000 -12.50%
482.sphinx3 (avg) (percentage) 0.800 -1.23%
482.sphinx3 (max) 14.000 -48.15%
482.sphinx3 (max) (percentage) 1.420 -49.47%
482.sphinx3 (unexplained diff vs previous) 1.000 -83.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -83.33%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.394 11.81%