Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1deb6bce8931543bc3649ba5b0e32ae7e044d243 (+ 88 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/222/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0222 (llvmorg-16-init-15661-g1deb6bce8931) 2022-12-14T06:10:43 0:00:00
Previous 0221 (llvmorg-20-init-09394-g5033ea73bb01) 2024-10-12T05:37:48 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 116 34
Performance Improvements 26 86
Added Tests 11 0
Unchanged Tests 627 660
Total Tests 780

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 10.99% 24071.000 26716.000 - -0.15% -
433.milc 2.82% 72918.000 74971.000 - 0.00% -
453.povray 2.39% 579343.000 593161.000 - 0.01% -
447.dealII 2.30% 1738543.000 1778560.000 - 0.03% -
444.namd 1.70% 172253.000 175184.000 - 0.01% -
464.h264ref 1.34% 349828.000 354530.000 - -0.02% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15833.33% 57.000 9082.000 - -0.19% -
462.libquantum 13317.35% 98.000 13149.000 - 0.18% -
482.sphinx3 2914.53% 874.000 26347.000 - 0.14% -
450.soplex 2653.05% 524.000 14426.000 - -0.02% -
444.namd 1802.40% 709.000 13488.000 - -0.05% -
453.povray 1409.83% 458.000 6915.000 - 0.85% -
433.milc 1078.57% 1143.000 13471.000 - -0.08% -
429.mcf 938.30% 1141.000 11847.000 - -1.27% -
401.bzip2 475.71% 2721.000 15665.000 - -0.11% -
447.dealII 355.67% 1798.000 8193.000 - -0.04% -
470.lbm 328.81% 3159.000 13546.000 - -2.42% -
471.omnetpp 277.90% 2828.000 10687.000 - -0.55% -
456.hmmer 276.56% 3562.000 13413.000 - 0.36% -
473.astar 193.91% 4846.000 14243.000 - -0.13% -
464.h264ref 179.43% 5542.000 15486.000 - -0.05% -
445.gobmk 135.80% 5251.000 12382.000 - -0.15% -
458.sjeng 97.84% 8268.000 16357.000 - -0.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) 81700.00% 1.000 818.000 - -1.21% -
482.sphinx3 (unexplained diff vs previous) 26300.00% 3.000 792.000 - -12.39% -
482.sphinx3 (max) 10662.50% 8.000 861.000 - -1.37% -
473.astar (unexplained diff vs previous) 10400.00% 1.000 105.000 - -2.78% -
444.namd (max) 8610.00% 10.000 871.000 - -1.25% -
444.namd 7783.33% 6.000 473.000 - -7.98% -
444.namd (avg) 7783.33% 6.000 473.000 - -7.98% -
482.sphinx3 6371.43% 7.000 453.000 - -7.36% -
482.sphinx3 (avg) 6371.43% 7.000 453.000 - -7.36% -
433.milc (max) 4333.33% 3.000 133.000 - -27.72% -
444.namd (unexplained diff vs previous) (percentage) 4228.57% 0.140 6.060 - -1.30% -
450.soplex (unexplained diff vs previous) 4200.00% 1.000 43.000 - -47.56% -
453.povray (max) 3933.33% 3.000 121.000 - -8.33% -
473.astar (unexplained diff vs previous) (percentage) 3600.00% 0.020 0.740 - -2.63% -
470.lbm (unexplained diff vs previous) 3004.17% 24.000 745.000 - 49.90% -
470.lbm (max) 2837.50% 24.000 705.000 - -8.32% -
445.gobmk (unexplained diff vs previous) 2400.00% 1.000 25.000 - -16.67% -
453.povray 2150.00% 4.000 90.000 - -3.23% -
453.povray (avg) 2150.00% 4.000 90.000 - -3.23% -
403.gcc 2100.00% 2.000 44.000 - 2.33% -
403.gcc (avg) 2100.00% 2.000 44.000 - 2.33% -
433.milc 2016.67% 6.000 127.000 - -6.62% -
433.milc (avg) 2016.67% 6.000 127.000 - -6.62% -
462.libquantum 1800.00% 1.000 19.000 - 0.00% -
462.libquantum (avg) 1800.00% 1.000 19.000 - 0.00% -
450.soplex (max) 1333.33% 3.000 43.000 - -47.56% -
429.mcf (unexplained diff vs previous) 1075.00% 4.000 47.000 - -29.85% -
470.lbm 1072.73% 22.000 258.000 - -19.88% -
470.lbm (avg) 1072.73% 22.000 258.000 - -19.88% -
403.gcc (max) 1050.00% 4.000 46.000 - 35.29% -
471.omnetpp (unexplained diff vs previous) 1020.00% 20.000 224.000 - 143.48% -
462.libquantum (unexplained diff vs previous) 1000.00% 3.000 33.000 - 106.25% -
462.libquantum (max) 966.67% 3.000 32.000 - 23.08% -
445.gobmk (unexplained diff vs previous) (percentage) 900.00% 0.020 0.200 - -16.67% -
447.dealII 891.67% 12.000 119.000 - -0.83% -
447.dealII (avg) 891.67% 12.000 119.000 - -0.83% -
450.soplex 820.00% 5.000 46.000 - -9.80% -
450.soplex (avg) 820.00% 5.000 46.000 - -9.80% -
482.sphinx3 (unexplained diff vs previous) (percentage) 785.29% 0.340 3.010 - -12.50% -
447.dealII (unexplained diff vs previous) 745.00% 20.000 169.000 - 39.67% -
456.hmmer (max) 662.50% 8.000 61.000 - 52.50% -
458.sjeng (unexplained diff vs previous) 645.45% 11.000 82.000 - 100.00% -
470.lbm (unexplained diff vs previous) (percentage) 623.68% 0.760 5.500 - 53.63% -
470.lbm (max) (percentage) 567.95% 0.780 5.210 - -5.96% -
471.omnetpp (max) 476.32% 38.000 219.000 - 15.87% -
456.hmmer (unexplained diff vs previous) 450.00% 2.000 11.000 - 22.22% -
464.h264ref (max) 427.27% 11.000 58.000 - -3.33% -
447.dealII (max) 421.21% 33.000 172.000 - 33.33% -
444.namd (max) (percentage) 345.52% 1.450 6.460 - -1.22% -
429.mcf (max) 293.33% 15.000 59.000 - -11.94% -
458.sjeng (unexplained diff vs previous) (percentage) 284.62% 0.130 0.500 - 100.00% -
444.namd (avg) (percentage) 269.47% 0.950 3.510 - -7.87% -
482.sphinx3 (max) (percentage) 247.87% 0.940 3.270 - -1.51% -
429.mcf 246.67% 15.000 52.000 - -1.89% -
429.mcf (avg) 246.67% 15.000 52.000 - -1.89% -
456.hmmer 231.25% 16.000 53.000 - 10.42% -
456.hmmer (avg) 231.25% 16.000 53.000 - 10.42% -
458.sjeng 230.00% 30.000 99.000 - 4.21% -
458.sjeng (avg) 230.00% 30.000 99.000 - 4.21% -
433.milc (max) (percentage) 219.35% 0.310 0.990 - -27.74% -
471.omnetpp (unexplained diff vs previous) (percentage) 195.77% 0.710 2.100 - 144.19% -
464.h264ref 188.24% 17.000 49.000 - -3.92% -
464.h264ref (avg) 188.24% 17.000 49.000 - -3.92% -
470.lbm (avg) (percentage) 165.28% 0.720 1.910 - -17.67% -
401.bzip2 146.15% 13.000 32.000 - -5.88% -
401.bzip2 (avg) 146.15% 13.000 32.000 - -5.88% -
473.astar (max) 139.53% 43.000 103.000 - -9.65% -
458.sjeng (max) 138.24% 34.000 81.000 - 24.62% -
453.povray (max) (percentage) 130.26% 0.760 1.750 - -9.33% -
445.gobmk (max) 118.18% 11.000 24.000 - -17.24% -
447.dealII (avg) (percentage) 114.71% 0.680 1.460 - -0.68% -
471.omnetpp 105.41% 37.000 76.000 - -8.43% -
471.omnetpp (avg) 105.41% 37.000 76.000 - -8.43% -
482.sphinx3 (avg) (percentage) 104.76% 0.840 1.720 - -7.53% -
456.hmmer (max) (percentage) 100.00% 0.230 0.460 - 53.33% -
447.dealII (unexplained diff vs previous) (percentage) 85.59% 1.110 2.060 - 39.19% -
473.astar 84.85% 33.000 61.000 - -14.08% -
473.astar (avg) 84.85% 33.000 61.000 - -14.08% -
464.h264ref (max) (percentage) 80.95% 0.210 0.380 - -2.56% -
433.milc (avg) (percentage) 79.25% 0.530 0.950 - -5.94% -
458.sjeng (avg) (percentage) 64.86% 0.370 0.610 - 5.17% -
450.soplex (unexplained diff vs previous) (percentage) 57.89% 0.190 0.300 - -47.37% -
471.omnetpp (max) (percentage) 50.74% 1.360 2.050 - 16.48% -
445.gobmk 40.00% 15.000 21.000 - -4.55% -
445.gobmk (avg) 40.00% 15.000 21.000 - -4.55% -
456.hmmer (unexplained diff vs previous) (percentage) 33.33% 0.060 0.080 - 14.29% -
464.h264ref (unexplained diff vs previous) 28.57% 7.000 9.000 - -85.00% -
453.povray (avg) (percentage) 28.43% 1.020 1.310 - -4.38% -
458.sjeng (max) (percentage) 19.05% 0.420 0.500 - 25.00% -
401.bzip2 (max) 15.00% 20.000 23.000 - -52.08% -
447.dealII (max) (percentage) 14.67% 1.840 2.110 - 33.54% -
429.mcf (unexplained diff vs previous) (percentage) 14.29% 0.350 0.400 - -28.57% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -8.96% 43341.000 39458.000 - 0.00% -
450.soplex -1.85% 202447.000 198692.000 - -0.01% -
471.omnetpp -1.09% 377700.000 373579.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) (percentage) -93.44% 7.780 0.510 - 34.21% -
462.libquantum (max) (percentage) -92.09% 3.160 0.250 - 25.00% -
462.libquantum (unexplained diff vs previous) (percentage) -91.83% 3.060 0.250 - 108.33% -
462.libquantum (avg) (percentage) -90.74% 1.620 0.150 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -89.83% 0.590 0.060 - -80.65% -
403.gcc (avg) (percentage) -87.53% 3.930 0.490 - 2.08% -
401.bzip2 (max) (percentage) -80.26% 0.760 0.150 - -51.61% -
450.soplex (avg) (percentage) -70.09% 1.070 0.320 - -11.11% -
429.mcf (avg) (percentage) -67.41% 1.350 0.440 - -2.22% -
483.xalancbmk (avg) (percentage) -63.91% 1.330 0.480 - -4.00% -
429.mcf (max) (percentage) -62.96% 1.350 0.500 - -10.71% -
401.bzip2 (avg) (percentage) -56.25% 0.480 0.210 - -4.55% -
464.h264ref (unexplained diff vs previous) (percentage) -53.85% 0.130 0.060 - -84.62% -
450.soplex (max) (percentage) -51.61% 0.620 0.300 - -47.37% -
471.omnetpp (avg) (percentage) -45.86% 1.330 0.720 - -7.69% -
401.bzip2 (unexplained diff vs previous) -43.75% 16.000 9.000 - -81.63% -
445.gobmk (avg) (percentage) -43.33% 0.300 0.170 - -5.56% -
483.xalancbmk (max) (percentage) -43.28% 0.670 0.380 - -41.54% -
473.astar (avg) (percentage) -37.68% 0.690 0.430 - -14.00% -
473.astar (max) (percentage) -17.98% 0.890 0.730 - -8.75% -
456.hmmer (avg) (percentage) -13.04% 0.460 0.400 - 11.11% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 5.88% 17.000 18.000 - 0.00% -
nb_compile_successful 5.56% 18.000 19.000 - 0.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (unexplained diff vs previous) (percentage) 144.19% 0.860 2.100 - 195.77% -
471.omnetpp (unexplained diff vs previous) 143.48% 92.000 224.000 - 1020.00% -
462.libquantum (unexplained diff vs previous) (percentage) 108.33% 0.120 0.250 - -91.83% -
462.libquantum (unexplained diff vs previous) 106.25% 16.000 33.000 - 1000.00% -
458.sjeng (unexplained diff vs previous) 100.00% 41.000 82.000 - 645.45% -
458.sjeng (unexplained diff vs previous) (percentage) 100.00% 0.250 0.500 - 284.62% -
470.lbm (unexplained diff vs previous) (percentage) 53.63% 3.580 5.500 - 623.68% -
456.hmmer (max) (percentage) 53.33% 0.300 0.460 - 100.00% -
456.hmmer (max) 52.50% 40.000 61.000 - 662.50% -
470.lbm (unexplained diff vs previous) 49.90% 497.000 745.000 - 3004.17% -
403.gcc (unexplained diff vs previous) (percentage) 40.54% 0.370 0.520 - 0.00% -
447.dealII (unexplained diff vs previous) 39.67% 121.000 169.000 - 745.00% -
447.dealII (unexplained diff vs previous) (percentage) 39.19% 1.480 2.060 - 85.59% -
403.gcc (unexplained diff vs previous) 38.24% 34.000 47.000 - 0.00% -
403.gcc (max) 35.29% 34.000 46.000 - 1050.00% -
403.gcc (max) (percentage) 34.21% 0.380 0.510 - -93.44% -
447.dealII (max) (percentage) 33.54% 1.580 2.110 - 14.67% -
447.dealII (max) 33.33% 129.000 172.000 - 421.21% -
458.sjeng (max) (percentage) 25.00% 0.400 0.500 - 19.05% -
462.libquantum (max) (percentage) 25.00% 0.200 0.250 - -92.09% -
458.sjeng (max) 24.62% 65.000 81.000 - 138.24% -
462.libquantum (max) 23.08% 26.000 32.000 - 966.67% -
456.hmmer (unexplained diff vs previous) 22.22% 9.000 11.000 - 450.00% -
471.omnetpp (max) (percentage) 16.48% 1.760 2.050 - 50.74% -
471.omnetpp (max) 15.87% 189.000 219.000 - 476.32% -
456.hmmer (avg) (percentage) 11.11% 0.360 0.400 - -13.04% -
456.hmmer 10.42% 48.000 53.000 - 231.25% -
456.hmmer (avg) 10.42% 48.000 53.000 - 231.25% -
458.sjeng (avg) (percentage) 5.17% 0.580 0.610 - 64.86% -
458.sjeng 4.21% 95.000 99.000 - 230.00% -
458.sjeng (avg) 4.21% 95.000 99.000 - 230.00% -
403.gcc 2.33% 43.000 44.000 - 2100.00% -
403.gcc (avg) 2.33% 43.000 44.000 - 2100.00% -
403.gcc (avg) (percentage) 2.08% 0.480 0.490 - -87.53% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm -2.42% 13882.000 13546.000 - 328.81% -
429.mcf -1.27% 11999.000 11847.000 - 938.30% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
464.h264ref (unexplained diff vs previous) -85.00% 60.000 9.000 - 28.57% -
464.h264ref (unexplained diff vs previous) (percentage) -84.62% 0.390 0.060 - -53.85% -
401.bzip2 (unexplained diff vs previous) -81.63% 49.000 9.000 - -43.75% -
401.bzip2 (unexplained diff vs previous) (percentage) -80.65% 0.310 0.060 - -89.83% -
483.xalancbmk (unexplained diff vs previous) -80.33% 61.000 12.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -80.00% 0.650 0.130 - 0.00% -
401.bzip2 (max) -52.08% 48.000 23.000 - 15.00% -
401.bzip2 (max) (percentage) -51.61% 0.310 0.150 - -80.26% -
450.soplex (max) -47.56% 82.000 43.000 - 1333.33% -
450.soplex (unexplained diff vs previous) -47.56% 82.000 43.000 - 4200.00% -
450.soplex (max) (percentage) -47.37% 0.570 0.300 - -51.61% -
450.soplex (unexplained diff vs previous) (percentage) -47.37% 0.570 0.300 - 57.89% -
483.xalancbmk (max) -42.62% 61.000 35.000 - 0.00% -
483.xalancbmk (max) (percentage) -41.54% 0.650 0.380 - -43.28% -
429.mcf (unexplained diff vs previous) -29.85% 67.000 47.000 - 1075.00% -
429.mcf (unexplained diff vs previous) (percentage) -28.57% 0.560 0.400 - 14.29% -
433.milc (max) (percentage) -27.74% 1.370 0.990 - 219.35% -
433.milc (max) -27.72% 184.000 133.000 - 4333.33% -
433.milc (unexplained diff vs previous) -27.47% 182.000 132.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -27.41% 1.350 0.980 - 0.00% -
470.lbm -19.88% 322.000 258.000 - 1072.73% -
470.lbm (avg) -19.88% 322.000 258.000 - 1072.73% -
470.lbm (avg) (percentage) -17.67% 2.320 1.910 - 165.28% -
445.gobmk (max) -17.24% 29.000 24.000 - 118.18% -
445.gobmk (unexplained diff vs previous) -16.67% 30.000 25.000 - 2400.00% -
445.gobmk (max) (percentage) -16.67% 0.240 0.200 - -4.76% -
445.gobmk (unexplained diff vs previous) (percentage) -16.67% 0.240 0.200 - 900.00% -
473.astar -14.08% 71.000 61.000 - 84.85% -
473.astar (avg) -14.08% 71.000 61.000 - 84.85% -
473.astar (avg) (percentage) -14.00% 0.500 0.430 - -37.68% -
482.sphinx3 (unexplained diff vs previous) (percentage) -12.50% 3.440 3.010 - 785.29% -
482.sphinx3 (unexplained diff vs previous) -12.39% 904.000 792.000 - 26300.00% -
429.mcf (max) -11.94% 67.000 59.000 - 293.33% -
450.soplex (avg) (percentage) -11.11% 0.360 0.320 - -70.09% -
429.mcf (max) (percentage) -10.71% 0.560 0.500 - -62.96% -
450.soplex -9.80% 51.000 46.000 - 820.00% -
450.soplex (avg) -9.80% 51.000 46.000 - 820.00% -
473.astar (max) -9.65% 114.000 103.000 - 139.53% -
453.povray (unexplained diff vs previous) (percentage) -9.47% 1.900 1.720 - 0.00% -
453.povray (max) (percentage) -9.33% 1.930 1.750 - 130.26% -
473.astar (max) (percentage) -8.75% 0.800 0.730 - -17.98% -
453.povray (unexplained diff vs previous) -8.46% 130.000 119.000 - 0.00% -
471.omnetpp -8.43% 83.000 76.000 - 105.41% -
471.omnetpp (avg) -8.43% 83.000 76.000 - 105.41% -
453.povray (max) -8.33% 132.000 121.000 - 3933.33% -
470.lbm (max) -8.32% 769.000 705.000 - 2837.50% -
444.namd -7.98% 514.000 473.000 - 7783.33% -
444.namd (avg) -7.98% 514.000 473.000 - 7783.33% -
444.namd (avg) (percentage) -7.87% 3.810 3.510 - 269.47% -
471.omnetpp (avg) (percentage) -7.69% 0.780 0.720 - -45.86% -
482.sphinx3 (avg) (percentage) -7.53% 1.860 1.720 - 104.76% -
482.sphinx3 -7.36% 489.000 453.000 - 6371.43% -
482.sphinx3 (avg) -7.36% 489.000 453.000 - 6371.43% -
433.milc -6.62% 136.000 127.000 - 2016.67% -
433.milc (avg) -6.62% 136.000 127.000 - 2016.67% -
470.lbm (max) (percentage) -5.96% 5.540 5.210 - 567.95% -
433.milc (avg) (percentage) -5.94% 1.010 0.950 - 79.25% -
401.bzip2 -5.88% 34.000 32.000 - 146.15% -
401.bzip2 (avg) -5.88% 34.000 32.000 - 146.15% -
401.bzip2 (avg) (percentage) -4.55% 0.220 0.210 - -56.25% -
445.gobmk -4.55% 22.000 21.000 - 40.00% -
445.gobmk (avg) -4.55% 22.000 21.000 - 40.00% -
453.povray (avg) (percentage) -4.38% 1.370 1.310 - 28.43% -
483.xalancbmk -4.26% 47.000 45.000 - 0.00% -
483.xalancbmk (avg) -4.26% 47.000 45.000 - 0.00% -
483.xalancbmk (avg) (percentage) -4.00% 0.500 0.480 - -63.91% -
464.h264ref -3.92% 51.000 49.000 - 188.24% -
464.h264ref (avg) -3.92% 51.000 49.000 - 188.24% -
464.h264ref (max) -3.33% 60.000 58.000 - 427.27% -
453.povray -3.23% 93.000 90.000 - 2150.00% -
453.povray (avg) -3.23% 93.000 90.000 - 2150.00% -
464.h264ref (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -
473.astar (unexplained diff vs previous) -2.78% 108.000 105.000 - 10400.00% -
473.astar (unexplained diff vs previous) (percentage) -2.63% 0.760 0.740 - 3600.00% -
464.h264ref (max) (percentage) -2.56% 0.390 0.380 - 80.95% -
429.mcf (avg) (percentage) -2.22% 0.450 0.440 - -67.41% -
429.mcf -1.89% 53.000 52.000 - 246.67% -
429.mcf (avg) -1.89% 53.000 52.000 - 246.67% -
482.sphinx3 (max) (percentage) -1.51% 3.320 3.270 - 247.87% -
482.sphinx3 (max) -1.37% 873.000 861.000 - 10662.50% -
444.namd (unexplained diff vs previous) (percentage) -1.30% 6.140 6.060 - 4228.57% -
444.namd (max) -1.25% 882.000 871.000 - 8610.00% -
444.namd (max) (percentage) -1.22% 6.540 6.460 - 345.52% -
444.namd (unexplained diff vs previous) -1.21% 828.000 818.000 - 81700.00% -


Report Time: 0.41s
Name Current %
401.bzip2 15665.000 475.71%
403.gcc 9082.000 15833.33%
429.mcf 11847.000 938.30%
433.milc 13471.000 1078.57%
444.namd 13488.000 1802.40%
445.gobmk 12382.000 135.80%
447.dealII 8193.000 355.67%
450.soplex 14426.000 2653.05%
453.povray 6915.000 1409.83%
456.hmmer 13413.000 276.56%
458.sjeng 16357.000 97.84%
462.libquantum 13149.000 13317.35%
464.h264ref 15486.000 179.43%
470.lbm 13546.000 328.81%
471.omnetpp 10687.000 277.90%
473.astar 14243.000 193.91%
482.sphinx3 26347.000 2914.53%
483.xalancbmk 9397.000 -
Geometric Mean 12668.883 828.57%
Name Current %
401.bzip2 39458.000 -8.96%
403.gcc 1961098.000 -
429.mcf 7927.000 -
433.milc 74971.000 2.82%
444.namd 175184.000 1.70%
445.gobmk 1312972.000 -
447.dealII 1778560.000 2.30%
450.soplex 198692.000 -1.85%
453.povray 593161.000 2.39%
456.hmmer 168080.000 -
458.sjeng 97766.000 -
462.libquantum 26716.000 10.99%
464.h264ref 354530.000 1.34%
470.lbm 9723.000 -
471.omnetpp 373579.000 -1.09%
473.astar 23216.000 -
482.sphinx3 115752.000 -
483.xalancbmk 2287009.000 -
Geometric Mean 164409.887 17.43%
Name Current %
nb_compile_successful 19.000 5.56%
nb_execution_successful 18.000 5.88%
nb_total_tests 19.000 -5.00%
Geometric Mean 18.661 2.02%
Name Current %
401.bzip2 32.000 146.15%
401.bzip2 (avg) 32.000 146.15%
401.bzip2 (avg) (percentage) 0.210 -56.25%
401.bzip2 (max) 23.000 15.00%
401.bzip2 (max) (percentage) 0.150 -80.26%
401.bzip2 (unexplained diff vs previous) 9.000 -43.75%
401.bzip2 (unexplained diff vs previous) (percentage) 0.060 -89.83%
403.gcc 44.000 2100.00%
403.gcc (avg) 44.000 2100.00%
403.gcc (avg) (percentage) 0.490 -87.53%
403.gcc (max) 46.000 1050.00%
403.gcc (max) (percentage) 0.510 -93.44%
403.gcc (unexplained diff vs previous) 47.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.520 -
429.mcf 52.000 246.67%
429.mcf (avg) 52.000 246.67%
429.mcf (avg) (percentage) 0.440 -67.41%
429.mcf (max) 59.000 293.33%
429.mcf (max) (percentage) 0.500 -62.96%
429.mcf (unexplained diff vs previous) 47.000 1075.00%
429.mcf (unexplained diff vs previous) (percentage) 0.400 14.29%
433.milc 127.000 2016.67%
433.milc (avg) 127.000 2016.67%
433.milc (avg) (percentage) 0.950 79.25%
433.milc (max) 133.000 4333.33%
433.milc (max) (percentage) 0.990 219.35%
433.milc (unexplained diff vs previous) 132.000 -
433.milc (unexplained diff vs previous) (percentage) 0.980 -
444.namd 473.000 7783.33%
444.namd (avg) 473.000 7783.33%
444.namd (avg) (percentage) 3.510 269.47%
444.namd (max) 871.000 8610.00%
444.namd (max) (percentage) 6.460 345.52%
444.namd (unexplained diff vs previous) 818.000 81700.00%
444.namd (unexplained diff vs previous) (percentage) 6.060 4228.57%
445.gobmk 21.000 40.00%
445.gobmk (avg) 21.000 40.00%
445.gobmk (avg) (percentage) 0.170 -43.33%
445.gobmk (max) 24.000 118.18%
445.gobmk (max) (percentage) 0.200 -
445.gobmk (unexplained diff vs previous) 25.000 2400.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.200 900.00%
447.dealII 119.000 891.67%
447.dealII (avg) 119.000 891.67%
447.dealII (avg) (percentage) 1.460 114.71%
447.dealII (max) 172.000 421.21%
447.dealII (max) (percentage) 2.110 14.67%
447.dealII (unexplained diff vs previous) 169.000 745.00%
447.dealII (unexplained diff vs previous) (percentage) 2.060 85.59%
450.soplex 46.000 820.00%
450.soplex (avg) 46.000 820.00%
450.soplex (avg) (percentage) 0.320 -70.09%
450.soplex (max) 43.000 1333.33%
450.soplex (max) (percentage) 0.300 -51.61%
450.soplex (unexplained diff vs previous) 43.000 4200.00%
450.soplex (unexplained diff vs previous) (percentage) 0.300 57.89%
453.povray 90.000 2150.00%
453.povray (avg) 90.000 2150.00%
453.povray (avg) (percentage) 1.310 28.43%
453.povray (max) 121.000 3933.33%
453.povray (max) (percentage) 1.750 130.26%
453.povray (unexplained diff vs previous) 119.000 -
453.povray (unexplained diff vs previous) (percentage) 1.720 -
456.hmmer 53.000 231.25%
456.hmmer (avg) 53.000 231.25%
456.hmmer (avg) (percentage) 0.400 -13.04%
456.hmmer (max) 61.000 662.50%
456.hmmer (max) (percentage) 0.460 100.00%
456.hmmer (unexplained diff vs previous) 11.000 450.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.080 33.33%
458.sjeng 99.000 230.00%
458.sjeng (avg) 99.000 230.00%
458.sjeng (avg) (percentage) 0.610 64.86%
458.sjeng (max) 81.000 138.24%
458.sjeng (max) (percentage) 0.500 19.05%
458.sjeng (unexplained diff vs previous) 82.000 645.45%
458.sjeng (unexplained diff vs previous) (percentage) 0.500 284.62%
462.libquantum 19.000 1800.00%
462.libquantum (avg) 19.000 1800.00%
462.libquantum (avg) (percentage) 0.150 -90.74%
462.libquantum (max) 32.000 966.67%
462.libquantum (max) (percentage) 0.250 -92.09%
462.libquantum (unexplained diff vs previous) 33.000 1000.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.250 -91.83%
464.h264ref 49.000 188.24%
464.h264ref (avg) 49.000 188.24%
464.h264ref (avg) (percentage) 0.320 -
464.h264ref (max) 58.000 427.27%
464.h264ref (max) (percentage) 0.380 80.95%
464.h264ref (unexplained diff vs previous) 9.000 28.57%
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -53.85%
470.lbm 258.000 1072.73%
470.lbm (avg) 258.000 1072.73%
470.lbm (avg) (percentage) 1.910 165.28%
470.lbm (max) 705.000 2837.50%
470.lbm (max) (percentage) 5.210 567.95%
470.lbm (unexplained diff vs previous) 745.000 3004.17%
470.lbm (unexplained diff vs previous) (percentage) 5.500 623.68%
471.omnetpp 76.000 105.41%
471.omnetpp (avg) 76.000 105.41%
471.omnetpp (avg) (percentage) 0.720 -45.86%
471.omnetpp (max) 219.000 476.32%
471.omnetpp (max) (percentage) 2.050 50.74%
471.omnetpp (unexplained diff vs previous) 224.000 1020.00%
471.omnetpp (unexplained diff vs previous) (percentage) 2.100 195.77%
473.astar 61.000 84.85%
473.astar (avg) 61.000 84.85%
473.astar (avg) (percentage) 0.430 -37.68%
473.astar (max) 103.000 139.53%
473.astar (max) (percentage) 0.730 -17.98%
473.astar (unexplained diff vs previous) 105.000 10400.00%
473.astar (unexplained diff vs previous) (percentage) 0.740 3600.00%
482.sphinx3 453.000 6371.43%
482.sphinx3 (avg) 453.000 6371.43%
482.sphinx3 (avg) (percentage) 1.720 104.76%
482.sphinx3 (max) 861.000 10662.50%
482.sphinx3 (max) (percentage) 3.270 247.87%
482.sphinx3 (unexplained diff vs previous) 792.000 26300.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.010 785.29%
483.xalancbmk 45.000 -
483.xalancbmk (avg) 45.000 -
483.xalancbmk (avg) (percentage) 0.480 -63.91%
483.xalancbmk (max) 35.000 -
483.xalancbmk (max) (percentage) 0.380 -43.28%
483.xalancbmk (unexplained diff vs previous) 12.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.130 -
Geometric Mean 10.025 355.85%