Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7b88e7530d4329ff0c7c8638f69b39fa1e540218 (+ 543 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/194/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0194 (llvmorg-20-init-10159-g7b88e7530d43) 2024-10-19T13:09:38 0:00:00
Previous 0194 (llvmorg-16-init-08515-g1d4fd09c51f2) 2022-10-19T06:41:56 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 20
Performance Improvements 115 119
Unchanged Tests 642 641
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) (percentage) 3416.67% 0.120 4.220 - -33.86% -
403.gcc (max) (percentage) 2735.29% 0.340 9.640 - 313.73% -
462.libquantum (unexplained diff vs previous) (percentage) 2675.00% 0.120 3.330 - 33200.00% -
462.libquantum (avg) (percentage) 1146.15% 0.130 1.620 - 110.39% -
403.gcc (avg) (percentage) 1115.38% 0.260 3.160 - 474.55% -
483.xalancbmk (avg) (percentage) 700.00% 0.180 1.440 - -32.08% -
450.soplex (avg) (percentage) 306.25% 0.320 1.300 - 160.00% -
473.astar (avg) (percentage) 257.14% 0.140 0.500 - -45.65% -
473.astar (unexplained diff vs previous) (percentage) 208.33% 0.120 0.370 - 85.00% -
450.soplex (unexplained diff vs previous) (percentage) 132.14% 0.560 1.300 - 182.61% -
429.mcf (avg) (percentage) 119.64% 0.560 1.230 - -41.98% -
473.astar (max) (percentage) 117.65% 0.170 0.370 - -94.48% -
456.hmmer (avg) (percentage) 82.93% 0.410 0.750 - -46.04% -
458.sjeng (avg) (percentage) 39.13% 0.230 0.320 - -60.00% -
401.bzip2 (avg) (percentage) 33.33% 0.300 0.400 - -38.46% -
458.sjeng (max) (percentage) 28.57% 0.280 0.360 - -93.00% -
473.astar 27.78% 18.000 23.000 - -79.46% -
473.astar (avg) 27.78% 18.000 23.000 - -79.46% -
471.omnetpp (avg) (percentage) 22.94% 1.090 1.340 - -16.25% -
471.omnetpp (unexplained diff vs previous) (percentage) 17.98% 0.890 1.050 - 7.14% -
473.astar (unexplained diff vs previous) 6.25% 16.000 17.000 - -32.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -5.56% 18.000 17.000 - -5.56% -
nb_compile_successful -5.26% 19.000 18.000 - -5.26% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
429.mcf -4.20% 7239.000 6935.000 - -4.20% -
462.libquantum -3.22% 12456.000 12055.000 - -3.59% -
433.milc -2.58% 47209.000 45993.000 - -2.14% -
401.bzip2 -2.53% 34046.000 33185.000 - -1.52% -
458.sjeng -2.17% 80757.000 79002.000 - -1.61% -
453.povray -2.10% 523249.000 512272.000 - -2.33% -
444.namd -2.00% 125071.000 122574.000 - -1.91% -
464.h264ref -1.91% 304623.000 298797.000 - -1.64% -
447.dealII -1.58% 197946.000 194819.000 - -0.50% -
470.lbm -1.30% 9350.000 9228.000 - -1.18% -
456.hmmer -1.16% 80997.000 80057.000 - -0.99% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -99.37% 9774.000 62.000 - -99.35% -
462.libquantum -98.84% 15544.000 180.000 - -98.75% -
482.sphinx3 -96.66% 29375.000 982.000 - -96.32% -
450.soplex -96.49% 15309.000 538.000 - -96.44% -
444.namd -93.70% 12915.000 813.000 - -93.44% -
453.povray -93.05% 7004.000 487.000 - -93.03% -
433.milc -91.56% 13796.000 1164.000 - -91.44% -
429.mcf -90.15% 11581.000 1141.000 - -91.84% -
401.bzip2 -83.06% 16730.000 2834.000 - -82.44% -
447.dealII -81.61% 10489.000 1929.000 - -79.43% -
471.omnetpp -75.50% 11628.000 2849.000 - -72.81% -
470.lbm -74.04% 15330.000 3980.000 - -69.98% -
456.hmmer -71.91% 13493.000 3790.000 - -68.03% -
473.astar -65.83% 13464.000 4600.000 - -62.52% -
464.h264ref -62.37% 15822.000 5954.000 - -58.93% -
445.gobmk -57.61% 11539.000 4891.000 - -55.91% -
458.sjeng -48.42% 15939.000 8221.000 - -51.80% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -99.61% 775.000 3.000 - -62.50% -
444.namd (max) -99.59% 730.000 3.000 - -99.70% -
482.sphinx3 (unexplained diff vs previous) -99.37% 793.000 5.000 - -99.45% -
482.sphinx3 (max) -99.14% 813.000 7.000 - -99.21% -
433.milc (unexplained diff vs previous) -98.89% 359.000 4.000 - -69.23% -
401.bzip2 (unexplained diff vs previous) -98.55% 69.000 1.000 - -96.97% -
482.sphinx3 -98.44% 449.000 7.000 - -98.49% -
482.sphinx3 (avg) -98.44% 449.000 7.000 - -98.49% -
444.namd -98.39% 373.000 6.000 - -98.11% -
444.namd (avg) -98.39% 373.000 6.000 - -98.11% -
453.povray (max) -98.26% 115.000 2.000 - -92.00% -
456.hmmer (unexplained diff vs previous) -97.89% 95.000 2.000 - -95.65% -
470.lbm (max) -97.30% 777.000 21.000 - -97.23% -
450.soplex (max) -97.24% 254.000 7.000 - -97.19% -
433.milc (max) -96.57% 350.000 12.000 - -88.89% -
403.gcc -96.00% 25.000 1.000 - -98.08% -
403.gcc (avg) -96.00% 25.000 1.000 - -98.08% -
470.lbm -95.86% 507.000 21.000 - -95.24% -
470.lbm (avg) -95.86% 507.000 21.000 - -95.24% -
453.povray -95.74% 94.000 4.000 - -92.73% -
453.povray (avg) -95.74% 94.000 4.000 - -92.73% -
433.milc -94.59% 148.000 8.000 - -93.10% -
433.milc (avg) -94.59% 148.000 8.000 - -93.10% -
401.bzip2 (max) -94.12% 68.000 4.000 - -99.34% -
444.namd (unexplained diff vs previous) (percentage) -93.83% 6.000 0.370 - 516.67% -
429.mcf (unexplained diff vs previous) -93.55% 93.000 6.000 - -72.73% -
429.mcf (max) -93.48% 92.000 6.000 - -99.74% -
444.namd (max) (percentage) -93.46% 5.660 0.370 - -95.43% -
456.hmmer (unexplained diff vs previous) (percentage) -92.86% 0.700 0.050 - -87.18% -
450.soplex (unexplained diff vs previous) -91.86% 86.000 7.000 - -89.86% -
401.bzip2 (unexplained diff vs previous) (percentage) -90.24% 0.410 0.040 - -80.00% -
462.libquantum -90.00% 20.000 2.000 - -98.18% -
462.libquantum (avg) -90.00% 20.000 2.000 - -98.18% -
470.lbm (max) (percentage) -89.35% 5.070 0.540 - -90.56% -
447.dealII (max) -88.15% 135.000 16.000 - -92.83% -
450.soplex -87.50% 48.000 6.000 - -92.00% -
450.soplex (avg) -87.50% 48.000 6.000 - -92.00% -
433.milc (unexplained diff vs previous) (percentage) -86.92% 2.600 0.340 - 240.00% -
403.gcc (max) -84.85% 33.000 5.000 - -97.74% -
470.lbm (avg) (percentage) -83.38% 3.310 0.550 - -83.48% -
447.dealII -83.33% 84.000 14.000 - -85.71% -
447.dealII (avg) -83.33% 84.000 14.000 - -85.71% -
483.xalancbmk (max) (percentage) -82.76% 0.290 0.050 - -99.61% -
482.sphinx3 (unexplained diff vs previous) (percentage) -81.11% 2.700 0.510 - -85.13% -
471.omnetpp (max) -78.83% 137.000 29.000 - -97.02% -
445.gobmk (max) -78.18% 55.000 12.000 - -97.09% -
429.mcf -78.12% 64.000 14.000 - -95.27% -
429.mcf (avg) -78.12% 64.000 14.000 - -95.27% -
401.bzip2 -78.00% 50.000 11.000 - -89.42% -
401.bzip2 (avg) -78.00% 50.000 11.000 - -89.42% -
456.hmmer (max) -77.66% 94.000 21.000 - -98.31% -
464.h264ref (max) -74.67% 75.000 19.000 - -68.33% -
444.namd (avg) (percentage) -74.39% 2.890 0.740 - -71.21% -
482.sphinx3 (max) (percentage) -73.65% 2.770 0.730 - -77.95% -
445.gobmk -72.92% 48.000 13.000 - -82.43% -
445.gobmk (avg) -72.92% 48.000 13.000 - -82.43% -
471.omnetpp (unexplained diff vs previous) -70.87% 103.000 30.000 - -70.87% -
471.omnetpp -69.84% 126.000 38.000 - -77.25% -
471.omnetpp (avg) -69.84% 126.000 38.000 - -77.25% -
464.h264ref -69.05% 42.000 13.000 - -69.05% -
464.h264ref (avg) -69.05% 42.000 13.000 - -69.05% -
462.libquantum (unexplained diff vs previous) -66.67% 18.000 6.000 - 500.00% -
453.povray (max) (percentage) -66.06% 1.650 0.560 - 55.56% -
462.libquantum (max) -61.11% 18.000 7.000 - -99.24% -
401.bzip2 (max) (percentage) -60.98% 0.410 0.160 - -95.77% -
433.milc (max) (percentage) -57.87% 2.540 1.070 - 33.75% -
456.hmmer -49.09% 55.000 28.000 - -82.93% -
456.hmmer (avg) -49.09% 55.000 28.000 - -82.93% -
482.sphinx3 (avg) (percentage) -49.02% 1.530 0.780 - -55.17% -
445.gobmk (max) (percentage) -45.83% 0.480 0.260 - -93.03% -
433.milc (avg) (percentage) -36.11% 1.080 0.690 - -19.77% -
447.dealII (max) (percentage) -34.11% 1.290 0.850 - -64.29% -
458.sjeng (max) -34.09% 44.000 29.000 - -96.69% -
429.mcf (max) (percentage) -33.75% 0.800 0.530 - -96.75% -
429.mcf (unexplained diff vs previous) (percentage) -33.75% 0.800 0.530 - 231.25% -
453.povray (avg) (percentage) -33.33% 1.350 0.900 - 12.50% -
445.gobmk (avg) (percentage) -33.33% 0.420 0.280 - -58.21% -
464.h264ref (max) (percentage) -31.25% 0.480 0.330 - -21.43% -
458.sjeng -27.78% 36.000 26.000 - -80.88% -
458.sjeng (avg) -27.78% 36.000 26.000 - -80.88% -
473.astar (max) -22.73% 22.000 17.000 - -97.93% -
456.hmmer (max) (percentage) -18.57% 0.700 0.570 - -94.56% -
464.h264ref (avg) (percentage) -18.52% 0.270 0.220 - -24.14% -
471.omnetpp (max) (percentage) -11.86% 1.180 1.040 - -88.79% -
450.soplex (max) (percentage) -11.45% 1.660 1.470 - -10.91% -
447.dealII (avg) (percentage) -7.41% 0.810 0.750 - -28.57% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 5.26% 19.000 20.000 - 5.26% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.92% 146765.000 149580.000 - -0.79% -
471.omnetpp 1.67% 316676.000 321950.000 - 0.06% -
473.astar 1.04% 15470.000 15631.000 - 0.73% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 33200.00% 0.010 3.330 - 2675.00% -
444.namd (unexplained diff vs previous) (percentage) 516.67% 0.060 0.370 - -93.83% -
462.libquantum (unexplained diff vs previous) 500.00% 1.000 6.000 - -66.67% -
403.gcc (avg) (percentage) 474.55% 0.550 3.160 - 1115.38% -
403.gcc (max) (percentage) 313.73% 2.330 9.640 - 2735.29% -
433.milc (unexplained diff vs previous) (percentage) 240.00% 0.100 0.340 - -86.92% -
429.mcf (unexplained diff vs previous) (percentage) 231.25% 0.160 0.530 - -33.75% -
450.soplex (unexplained diff vs previous) (percentage) 182.61% 0.460 1.300 - 132.14% -
450.soplex (avg) (percentage) 160.00% 0.500 1.300 - 306.25% -
462.libquantum (avg) (percentage) 110.39% 0.770 1.620 - 1146.15% -
473.astar (unexplained diff vs previous) (percentage) 85.00% 0.200 0.370 - 208.33% -
453.povray (max) (percentage) 55.56% 0.360 0.560 - -66.06% -
433.milc (max) (percentage) 33.75% 0.800 1.070 - -57.87% -
453.povray (avg) (percentage) 12.50% 0.800 0.900 - -33.33% -
471.omnetpp (unexplained diff vs previous) (percentage) 7.14% 0.980 1.050 - 17.98% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - -5.56% -
nb_compile_successful -5.26% 19.000 18.000 - -5.26% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.20% 7239.000 6935.000 - -4.20% -
462.libquantum -3.59% 12504.000 12055.000 - -3.22% -
453.povray -2.33% 524493.000 512272.000 - -2.10% -
433.milc -2.14% 47001.000 45993.000 - -2.58% -
444.namd -1.91% 124963.000 122574.000 - -2.00% -
464.h264ref -1.64% 303767.000 298797.000 - -1.91% -
458.sjeng -1.61% 80297.000 79002.000 - -2.17% -
401.bzip2 -1.52% 33698.000 33185.000 - -2.53% -
470.lbm -1.18% 9338.000 9228.000 - -1.30% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9509.000 62.000 - -99.37% -
462.libquantum -98.75% 14409.000 180.000 - -98.84% -
450.soplex -96.44% 15112.000 538.000 - -96.49% -
482.sphinx3 -96.32% 26682.000 982.000 - -96.66% -
444.namd -93.44% 12400.000 813.000 - -93.70% -
453.povray -93.03% 6987.000 487.000 - -93.05% -
429.mcf -91.84% 13988.000 1141.000 - -90.15% -
433.milc -91.44% 13601.000 1164.000 - -91.56% -
401.bzip2 -82.44% 16137.000 2834.000 - -83.06% -
447.dealII -79.43% 9380.000 1929.000 - -81.61% -
471.omnetpp -72.81% 10477.000 2849.000 - -75.50% -
470.lbm -69.98% 13259.000 3980.000 - -74.04% -
456.hmmer -68.03% 11854.000 3790.000 - -71.91% -
473.astar -62.52% 12272.000 4600.000 - -65.83% -
464.h264ref -58.93% 14498.000 5954.000 - -62.37% -
445.gobmk -55.91% 11093.000 4891.000 - -57.61% -
458.sjeng -51.80% 17055.000 8221.000 - -48.42% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.74% 2281.000 6.000 - -93.48% -
444.namd (max) -99.70% 1003.000 3.000 - -99.59% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - -82.76% -
482.sphinx3 (unexplained diff vs previous) -99.45% 914.000 5.000 - -99.37% -
401.bzip2 (max) -99.34% 609.000 4.000 - -94.12% -
462.libquantum (max) -99.24% 919.000 7.000 - -61.11% -
482.sphinx3 (max) -99.21% 883.000 7.000 - -99.14% -
482.sphinx3 -98.49% 464.000 7.000 - -98.44% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - -98.44% -
456.hmmer (max) -98.31% 1242.000 21.000 - -77.66% -
462.libquantum -98.18% 110.000 2.000 - -90.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - -90.00% -
444.namd -98.11% 318.000 6.000 - -98.39% -
444.namd (avg) -98.11% 318.000 6.000 - -98.39% -
403.gcc -98.08% 52.000 1.000 - -96.00% -
403.gcc (avg) -98.08% 52.000 1.000 - -96.00% -
473.astar (max) -97.93% 822.000 17.000 - -22.73% -
403.gcc (max) -97.74% 221.000 5.000 - -84.85% -
470.lbm (max) -97.23% 758.000 21.000 - -97.30% -
450.soplex (max) -97.19% 249.000 7.000 - -97.24% -
445.gobmk (max) -97.09% 413.000 12.000 - -78.18% -
471.omnetpp (max) -97.02% 972.000 29.000 - -78.83% -
401.bzip2 (unexplained diff vs previous) -96.97% 33.000 1.000 - -98.55% -
429.mcf (max) (percentage) -96.75% 16.310 0.530 - -33.75% -
458.sjeng (max) -96.69% 876.000 29.000 - -34.09% -
401.bzip2 (max) (percentage) -95.77% 3.780 0.160 - -60.98% -
456.hmmer (unexplained diff vs previous) -95.65% 46.000 2.000 - -97.89% -
444.namd (max) (percentage) -95.43% 8.090 0.370 - -93.46% -
429.mcf -95.27% 296.000 14.000 - -78.12% -
429.mcf (avg) -95.27% 296.000 14.000 - -78.12% -
470.lbm -95.24% 441.000 21.000 - -95.86% -
470.lbm (avg) -95.24% 441.000 21.000 - -95.86% -
456.hmmer (max) (percentage) -94.56% 10.480 0.570 - -18.57% -
473.astar (max) (percentage) -94.48% 6.700 0.370 - 117.65% -
433.milc -93.10% 116.000 8.000 - -94.59% -
433.milc (avg) -93.10% 116.000 8.000 - -94.59% -
445.gobmk (max) (percentage) -93.03% 3.730 0.260 - -45.83% -
458.sjeng (max) (percentage) -93.00% 5.140 0.360 - 28.57% -
447.dealII (max) -92.83% 223.000 16.000 - -88.15% -
453.povray -92.73% 55.000 4.000 - -95.74% -
453.povray (avg) -92.73% 55.000 4.000 - -95.74% -
450.soplex -92.00% 75.000 6.000 - -87.50% -
450.soplex (avg) -92.00% 75.000 6.000 - -87.50% -
453.povray (max) -92.00% 25.000 2.000 - -98.26% -
470.lbm (max) (percentage) -90.56% 5.720 0.540 - -89.35% -
450.soplex (unexplained diff vs previous) -89.86% 69.000 7.000 - -91.86% -
401.bzip2 -89.42% 104.000 11.000 - -78.00% -
401.bzip2 (avg) -89.42% 104.000 11.000 - -78.00% -
433.milc (max) -88.89% 108.000 12.000 - -96.57% -
471.omnetpp (max) (percentage) -88.79% 9.280 1.040 - -11.86% -
456.hmmer (unexplained diff vs previous) (percentage) -87.18% 0.390 0.050 - -92.86% -
447.dealII -85.71% 98.000 14.000 - -83.33% -
447.dealII (avg) -85.71% 98.000 14.000 - -83.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -85.13% 3.430 0.510 - -81.11% -
470.lbm (avg) (percentage) -83.48% 3.330 0.550 - -83.38% -
456.hmmer -82.93% 164.000 28.000 - -49.09% -
456.hmmer (avg) -82.93% 164.000 28.000 - -49.09% -
445.gobmk -82.43% 74.000 13.000 - -72.92% -
445.gobmk (avg) -82.43% 74.000 13.000 - -72.92% -
458.sjeng -80.88% 136.000 26.000 - -27.78% -
458.sjeng (avg) -80.88% 136.000 26.000 - -27.78% -
401.bzip2 (unexplained diff vs previous) (percentage) -80.00% 0.200 0.040 - -90.24% -
473.astar -79.46% 112.000 23.000 - 27.78% -
473.astar (avg) -79.46% 112.000 23.000 - 27.78% -
482.sphinx3 (max) (percentage) -77.95% 3.310 0.730 - -73.65% -
471.omnetpp -77.25% 167.000 38.000 - -69.84% -
471.omnetpp (avg) -77.25% 167.000 38.000 - -69.84% -
429.mcf (unexplained diff vs previous) -72.73% 22.000 6.000 - -93.55% -
444.namd (avg) (percentage) -71.21% 2.570 0.740 - -74.39% -
471.omnetpp (unexplained diff vs previous) -70.87% 103.000 30.000 - -70.87% -
433.milc (unexplained diff vs previous) -69.23% 13.000 4.000 - -98.89% -
464.h264ref -69.05% 42.000 13.000 - -69.05% -
464.h264ref (avg) -69.05% 42.000 13.000 - -69.05% -
464.h264ref (max) -68.33% 60.000 19.000 - -74.67% -
447.dealII (max) (percentage) -64.29% 2.380 0.850 - -34.11% -
444.namd (unexplained diff vs previous) -62.50% 8.000 3.000 - -99.61% -
458.sjeng (avg) (percentage) -60.00% 0.800 0.320 - 39.13% -
445.gobmk (avg) (percentage) -58.21% 0.670 0.280 - -33.33% -
482.sphinx3 (avg) (percentage) -55.17% 1.740 0.780 - -49.02% -
456.hmmer (avg) (percentage) -46.04% 1.390 0.750 - 82.93% -
473.astar (avg) (percentage) -45.65% 0.920 0.500 - 257.14% -
429.mcf (avg) (percentage) -41.98% 2.120 1.230 - 119.64% -
401.bzip2 (avg) (percentage) -38.46% 0.650 0.400 - 33.33% -
462.libquantum (max) (percentage) -33.86% 6.380 4.220 - 3416.67% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 700.00% -
473.astar (unexplained diff vs previous) -32.00% 25.000 17.000 - 6.25% -
447.dealII (avg) (percentage) -28.57% 1.050 0.750 - -7.41% -
464.h264ref (avg) (percentage) -24.14% 0.290 0.220 - -18.52% -
464.h264ref (max) (percentage) -21.43% 0.420 0.330 - -31.25% -
433.milc (avg) (percentage) -19.77% 0.860 0.690 - -36.11% -
471.omnetpp (avg) (percentage) -16.25% 1.600 1.340 - 22.94% -
450.soplex (max) (percentage) -10.91% 1.650 1.470 - -11.45% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 5.26% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2834.000 -83.06%
403.gcc 62.000 -99.37%
429.mcf 1141.000 -90.15%
433.milc 1164.000 -91.56%
444.namd 813.000 -93.70%
445.gobmk 4891.000 -57.61%
447.dealII 1929.000 -81.61%
450.soplex 538.000 -96.49%
453.povray 487.000 -93.05%
456.hmmer 3790.000 -71.91%
458.sjeng 8221.000 -48.42%
462.libquantum 180.000 -98.84%
464.h264ref 5954.000 -62.37%
470.lbm 3980.000 -74.04%
471.omnetpp 2849.000 -75.50%
473.astar 4600.000 -65.83%
482.sphinx3 982.000 -96.66%
Geometric Mean 1481.967 -89.02%
Code Size (bytes)
Name Current %
401.bzip2 33185.000 -2.53%
403.gcc 1655371.000 -
429.mcf 6935.000 -4.20%
433.milc 45993.000 -2.58%
444.namd 122574.000 -2.00%
445.gobmk 1255433.000 -
447.dealII 194819.000 -1.58%
450.soplex 149580.000 -
453.povray 512272.000 -2.10%
456.hmmer 80057.000 -1.16%
458.sjeng 79002.000 -2.17%
462.libquantum 12055.000 -3.22%
464.h264ref 298797.000 -1.91%
470.lbm 9228.000 -1.30%
471.omnetpp 321950.000 -
473.astar 15631.000 -
482.sphinx3 87620.000 -
Geometric Mean 94365.685 -1.57%
Score
Name Current %
nb_compile_successful 18.000 -5.26%
nb_execution_successful 17.000 -5.56%
nb_total_tests 20.000 5.26%
Geometric Mean 18.292 -1.98%
sample variability
Name Current %
401.bzip2 11.000 -78.00%
401.bzip2 (avg) 11.000 -78.00%
401.bzip2 (avg) (percentage) 0.400 33.33%
401.bzip2 (max) 4.000 -94.12%
401.bzip2 (max) (percentage) 0.160 -60.98%
401.bzip2 (unexplained diff vs previous) 1.000 -98.55%
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -90.24%
403.gcc 1.000 -96.00%
403.gcc (avg) 1.000 -96.00%
403.gcc (avg) (percentage) 3.160 1115.38%
403.gcc (max) 5.000 -84.85%
403.gcc (max) (percentage) 9.640 2735.29%
429.mcf 14.000 -78.12%
429.mcf (avg) 14.000 -78.12%
429.mcf (avg) (percentage) 1.230 119.64%
429.mcf (max) 6.000 -93.48%
429.mcf (max) (percentage) 0.530 -33.75%
429.mcf (unexplained diff vs previous) 6.000 -93.55%
429.mcf (unexplained diff vs previous) (percentage) 0.530 -33.75%
433.milc 8.000 -94.59%
433.milc (avg) 8.000 -94.59%
433.milc (avg) (percentage) 0.690 -36.11%
433.milc (max) 12.000 -96.57%
433.milc (max) (percentage) 1.070 -57.87%
433.milc (unexplained diff vs previous) 4.000 -98.89%
433.milc (unexplained diff vs previous) (percentage) 0.340 -86.92%
444.namd 6.000 -98.39%
444.namd (avg) 6.000 -98.39%
444.namd (avg) (percentage) 0.740 -74.39%
444.namd (max) 3.000 -99.59%
444.namd (max) (percentage) 0.370 -93.46%
444.namd (unexplained diff vs previous) 3.000 -99.61%
444.namd (unexplained diff vs previous) (percentage) 0.370 -93.83%
445.gobmk 13.000 -72.92%
445.gobmk (avg) 13.000 -72.92%
445.gobmk (avg) (percentage) 0.280 -33.33%
445.gobmk (max) 12.000 -78.18%
445.gobmk (max) (percentage) 0.260 -45.83%
447.dealII 14.000 -83.33%
447.dealII (avg) 14.000 -83.33%
447.dealII (avg) (percentage) 0.750 -7.41%
447.dealII (max) 16.000 -88.15%
447.dealII (max) (percentage) 0.850 -34.11%
450.soplex 6.000 -87.50%
450.soplex (avg) 6.000 -87.50%
450.soplex (avg) (percentage) 1.300 306.25%
450.soplex (max) 7.000 -97.24%
450.soplex (max) (percentage) 1.470 -11.45%
450.soplex (unexplained diff vs previous) 7.000 -91.86%
450.soplex (unexplained diff vs previous) (percentage) 1.300 132.14%
453.povray 4.000 -95.74%
453.povray (avg) 4.000 -95.74%
453.povray (avg) (percentage) 0.900 -33.33%
453.povray (max) 2.000 -98.26%
453.povray (max) (percentage) 0.560 -66.06%
456.hmmer 28.000 -49.09%
456.hmmer (avg) 28.000 -49.09%
456.hmmer (avg) (percentage) 0.750 82.93%
456.hmmer (max) 21.000 -77.66%
456.hmmer (max) (percentage) 0.570 -18.57%
456.hmmer (unexplained diff vs previous) 2.000 -97.89%
456.hmmer (unexplained diff vs previous) (percentage) 0.050 -92.86%
458.sjeng 26.000 -27.78%
458.sjeng (avg) 26.000 -27.78%
458.sjeng (avg) (percentage) 0.320 39.13%
458.sjeng (max) 29.000 -34.09%
458.sjeng (max) (percentage) 0.360 28.57%
462.libquantum 2.000 -90.00%
462.libquantum (avg) 2.000 -90.00%
462.libquantum (avg) (percentage) 1.620 1146.15%
462.libquantum (max) 7.000 -61.11%
462.libquantum (max) (percentage) 4.220 3416.67%
462.libquantum (unexplained diff vs previous) 6.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 3.330 2675.00%
464.h264ref 13.000 -69.05%
464.h264ref (avg) 13.000 -69.05%
464.h264ref (avg) (percentage) 0.220 -18.52%
464.h264ref (max) 19.000 -74.67%
464.h264ref (max) (percentage) 0.330 -31.25%
470.lbm 21.000 -95.86%
470.lbm (avg) 21.000 -95.86%
470.lbm (avg) (percentage) 0.550 -83.38%
470.lbm (max) 21.000 -97.30%
470.lbm (max) (percentage) 0.540 -89.35%
471.omnetpp 38.000 -69.84%
471.omnetpp (avg) 38.000 -69.84%
471.omnetpp (avg) (percentage) 1.340 22.94%
471.omnetpp (max) 29.000 -78.83%
471.omnetpp (max) (percentage) 1.040 -11.86%
471.omnetpp (unexplained diff vs previous) 30.000 -70.87%
471.omnetpp (unexplained diff vs previous) (percentage) 1.050 17.98%
473.astar 23.000 27.78%
473.astar (avg) 23.000 27.78%
473.astar (avg) (percentage) 0.500 257.14%
473.astar (max) 17.000 -22.73%
473.astar (max) (percentage) 0.370 117.65%
473.astar (unexplained diff vs previous) 17.000 6.25%
473.astar (unexplained diff vs previous) (percentage) 0.370 208.33%
482.sphinx3 7.000 -98.44%
482.sphinx3 (avg) 7.000 -98.44%
482.sphinx3 (avg) (percentage) 0.780 -49.02%
482.sphinx3 (max) 7.000 -99.14%
482.sphinx3 (max) (percentage) 0.730 -73.65%
482.sphinx3 (unexplained diff vs previous) 5.000 -99.37%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.510 -81.11%
483.xalancbmk (avg) (percentage) 1.440 700.00%
483.xalancbmk (max) (percentage) 0.050 -82.76%
Geometric Mean 2.798 -74.60%