Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fe2bd12396580c60aabc08c60eba7e81d29d6cc8 (+ 323 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/99/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0099 (llvmorg-18-init-11778-gfe2bd1239658) 2023-11-11T22:56:57 0:00:00
Previous 0098 (llvmorg-18-init-11455-gf7a759d1b7b8) 2023-11-08T10:18:10 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 32 34
Performance Improvements 60 114
Unchanged Tests 688 632
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 1.83% 712.000 725.000 - -94.63% -
450.soplex 1.53% 522.000 530.000 - -96.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) 2533.33% 0.030 0.790 - -77.93% -
470.lbm (unexplained diff vs previous) 2400.00% 1.000 25.000 - -94.97% -
473.astar (unexplained diff vs previous) (percentage) 987.50% 0.080 0.870 - 14.47% -
473.astar (unexplained diff vs previous) 975.00% 4.000 43.000 - -60.19% -
445.gobmk (unexplained diff vs previous) 475.00% 4.000 23.000 - -23.33% -
445.gobmk (unexplained diff vs previous) (percentage) 450.00% 0.080 0.440 - 83.33% -
458.sjeng (unexplained diff vs previous) 400.00% 3.000 15.000 - -63.41% -
458.sjeng (unexplained diff vs previous) (percentage) 350.00% 0.040 0.180 - -28.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 340.00% 0.050 0.220 - -66.15% -
483.xalancbmk (unexplained diff vs previous) 300.00% 2.000 8.000 - -86.89% -
473.astar (max) 186.67% 15.000 43.000 - -62.28% -
473.astar (max) (percentage) 183.87% 0.310 0.880 - 10.00% -
450.soplex (max) 100.00% 4.000 8.000 - -90.24% -
450.soplex (unexplained diff vs previous) 100.00% 4.000 8.000 - -90.24% -
450.soplex (unexplained diff vs previous) (percentage) 96.10% 0.770 1.510 - 164.91% -
470.lbm (max) (percentage) 88.10% 0.420 0.790 - -85.74% -
445.gobmk (max) (percentage) 86.96% 0.230 0.430 - 79.17% -
450.soplex (max) (percentage) 86.59% 0.820 1.530 - 168.42% -
470.lbm (max) 84.62% 13.000 24.000 - -96.88% -
445.gobmk (max) 83.33% 12.000 22.000 - -24.14% -
458.sjeng (max) (percentage) 80.00% 0.100 0.180 - -55.00% -
458.sjeng (max) 75.00% 8.000 14.000 - -78.46% -
444.namd (unexplained diff vs previous) 18.18% 11.000 13.000 - -98.43% -
401.bzip2 (unexplained diff vs previous) (percentage) 17.91% 0.670 0.790 - 154.84% -
401.bzip2 (unexplained diff vs previous) 16.67% 18.000 21.000 - -57.14% -
401.bzip2 (max) (percentage) 16.42% 0.670 0.780 - 151.61% -
444.namd (unexplained diff vs previous) (percentage) 16.23% 1.540 1.790 - -70.85% -
464.h264ref (unexplained diff vs previous) 13.33% 15.000 17.000 - -71.67% -
401.bzip2 (max) 11.11% 18.000 20.000 - -58.33% -
464.h264ref (unexplained diff vs previous) (percentage) 11.11% 0.270 0.300 - -23.08% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -10.17% 59.000 53.000 - -99.42% -
462.libquantum -1.00% 100.000 99.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -94.21% 1.210 0.070 - -91.86% -
471.omnetpp (unexplained diff vs previous) -94.12% 34.000 2.000 - -97.83% -
453.povray (unexplained diff vs previous) (percentage) -75.58% 0.860 0.210 - -88.95% -
453.povray (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.23% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -66.33% 3.000 1.010 - 741.67% -
429.mcf (unexplained diff vs previous) -60.00% 10.000 4.000 - -94.03% -
429.mcf (unexplained diff vs previous) (percentage) -59.77% 0.870 0.350 - -37.50% -
447.dealII (unexplained diff vs previous) (percentage) -40.48% 0.840 0.500 - -66.22% -
447.dealII (unexplained diff vs previous) -40.00% 15.000 9.000 - -92.56% -
462.libquantum (max) -33.33% 3.000 2.000 - -92.31% -
433.milc (unexplained diff vs previous) (percentage) -25.71% 0.350 0.260 - -80.74% -
433.milc (unexplained diff vs previous) -25.00% 4.000 3.000 - -98.35% -
456.hmmer (unexplained diff vs previous) (percentage) -19.35% 0.310 0.250 - 257.14% -
456.hmmer (max) -18.18% 11.000 9.000 - -77.50% -
456.hmmer (unexplained diff vs previous) -18.18% 11.000 9.000 - 0.00% -
453.povray (max) -16.67% 6.000 5.000 - -96.21% -
471.omnetpp (max) (percentage) -12.20% 1.230 1.080 - -38.64% -
471.omnetpp (max) -11.76% 34.000 30.000 - -84.13% -
429.mcf (max) -11.11% 9.000 8.000 - -88.06% -
429.mcf (max) (percentage) -10.47% 0.860 0.770 - 37.50% -
456.hmmer (max) (percentage) -9.68% 0.310 0.280 - -6.67% -
462.libquantum (max) (percentage) -6.15% 3.090 2.900 - 1350.00% -
447.dealII (max) (percentage) -5.95% 0.840 0.790 - -50.00% -
453.povray (max) (percentage) -5.38% 1.300 1.230 - -36.27% -
456.hmmer -5.26% 38.000 36.000 - -25.00% -
456.hmmer (avg) -5.26% 38.000 36.000 - -25.00% -
433.milc (max) (percentage) -4.65% 0.430 0.410 - -70.07% -
458.sjeng -3.64% 55.000 53.000 - -44.21% -
458.sjeng (avg) -3.64% 55.000 53.000 - -44.21% -
429.mcf -3.23% 31.000 30.000 - -43.40% -
429.mcf (avg) -3.23% 31.000 30.000 - -43.40% -
445.gobmk -3.23% 31.000 30.000 - 36.36% -
445.gobmk (avg) -3.23% 31.000 30.000 - 36.36% -
453.povray (avg) (percentage) -3.17% 1.260 1.220 - -10.95% -
458.sjeng (avg) (percentage) -2.94% 0.680 0.660 - 13.79% -
471.omnetpp -2.90% 69.000 67.000 - -19.28% -
471.omnetpp (avg) -2.90% 69.000 67.000 - -19.28% -
456.hmmer (avg) (percentage) -2.80% 1.070 1.040 - 188.89% -
482.sphinx3 (max) (percentage) -2.63% 0.760 0.740 - -77.71% -
464.h264ref (max) -2.53% 158.000 154.000 - 156.67% -
464.h264ref (max) (percentage) -2.46% 2.840 2.770 - 610.26% -
483.xalancbmk (avg) (percentage) -2.46% 2.440 2.380 - 376.00% -
471.omnetpp (avg) (percentage) -2.42% 2.480 2.420 - 210.26% -
464.h264ref -2.27% 44.000 43.000 - -15.69% -
464.h264ref (avg) -2.27% 44.000 43.000 - -15.69% -
470.lbm -2.27% 44.000 43.000 - -86.65% -
470.lbm (avg) -2.27% 44.000 43.000 - -86.65% -
483.xalancbmk -2.27% 88.000 86.000 - 82.98% -
483.xalancbmk (avg) -2.27% 88.000 86.000 - 82.98% -
429.mcf (avg) (percentage) -2.22% 2.700 2.640 - 486.67% -
403.gcc (max) (percentage) -1.75% 4.010 3.940 - 936.84% -
445.gobmk (avg) (percentage) -1.69% 0.590 0.580 - 222.22% -
433.milc (avg) (percentage) -1.56% 0.640 0.630 - -37.62% -
473.astar (avg) (percentage) -1.50% 2.000 1.970 - 294.00% -
462.libquantum (avg) (percentage) -1.45% 1.380 1.360 - 806.67% -
464.h264ref (avg) (percentage) -1.27% 0.790 0.780 - 136.36% -
447.dealII (avg) (percentage) -1.23% 0.810 0.800 - -45.58% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.51% 198708.000 201706.000 - -0.01% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 1350.00% 0.200 2.900 - -6.15% -
403.gcc (max) (percentage) 936.84% 0.380 3.940 - -1.75% -
462.libquantum (avg) (percentage) 806.67% 0.150 1.360 - -1.45% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - -66.33% -
464.h264ref (max) (percentage) 610.26% 0.390 2.770 - -2.46% -
429.mcf (avg) (percentage) 486.67% 0.450 2.640 - -2.22% -
403.gcc (avg) (percentage) 454.17% 0.480 2.660 - 0.00% -
483.xalancbmk (avg) (percentage) 376.00% 0.500 2.380 - -2.46% -
473.astar (avg) (percentage) 294.00% 0.500 1.970 - -1.50% -
456.hmmer (unexplained diff vs previous) (percentage) 257.14% 0.070 0.250 - -19.35% -
445.gobmk (avg) (percentage) 222.22% 0.180 0.580 - -1.69% -
471.omnetpp (avg) (percentage) 210.26% 0.780 2.420 - -2.42% -
456.hmmer (avg) (percentage) 188.89% 0.360 1.040 - -2.80% -
450.soplex (avg) (percentage) 183.33% 0.360 1.020 - 0.99% -
401.bzip2 (avg) (percentage) 172.73% 0.220 0.600 - 0.00% -
450.soplex (max) (percentage) 168.42% 0.570 1.530 - 86.59% -
450.soplex (unexplained diff vs previous) (percentage) 164.91% 0.570 1.510 - 96.10% -
464.h264ref (max) 156.67% 60.000 154.000 - -2.53% -
401.bzip2 (unexplained diff vs previous) (percentage) 154.84% 0.310 0.790 - 17.91% -
401.bzip2 (max) (percentage) 151.61% 0.310 0.780 - 16.42% -
464.h264ref (avg) (percentage) 136.36% 0.330 0.780 - -1.27% -
445.gobmk (unexplained diff vs previous) (percentage) 83.33% 0.240 0.440 - 450.00% -
483.xalancbmk 82.98% 47.000 86.000 - -2.27% -
483.xalancbmk (avg) 82.98% 47.000 86.000 - -2.27% -
445.gobmk (max) (percentage) 79.17% 0.240 0.430 - 86.96% -
429.mcf (max) (percentage) 37.50% 0.560 0.770 - -10.47% -
473.astar 36.62% 71.000 97.000 - 0.00% -
473.astar (avg) 36.62% 71.000 97.000 - 0.00% -
445.gobmk 36.36% 22.000 30.000 - -3.23% -
445.gobmk (avg) 36.36% 22.000 30.000 - -3.23% -
473.astar (unexplained diff vs previous) (percentage) 14.47% 0.760 0.870 - 987.50% -
458.sjeng (avg) (percentage) 13.79% 0.580 0.660 - -2.94% -
473.astar (max) (percentage) 10.00% 0.800 0.880 - 183.87% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.36% 26756.000 24251.000 - 0.00% -
401.bzip2 -2.82% 39458.000 38345.000 - 0.00% -
453.povray -2.72% 593097.000 576974.000 - 0.00% -
433.milc -2.56% 74971.000 73050.000 - 0.00% -
447.dealII -1.84% 1777992.000 1745295.000 - 0.00% -
444.namd -1.34% 175160.000 172817.000 - 0.00% -
482.sphinx3 -1.25% 115736.000 114291.000 - -0.01% -
456.hmmer -1.06% 168072.000 166294.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.42% 9099.000 53.000 - -10.17% -
462.libquantum -99.25% 13126.000 99.000 - -1.00% -
482.sphinx3 -96.64% 26310.000 885.000 - 0.34% -
450.soplex -96.33% 14429.000 530.000 - 1.53% -
444.namd -94.63% 13495.000 725.000 - 1.83% -
453.povray -93.20% 6857.000 466.000 - 0.22% -
433.milc -91.52% 13482.000 1143.000 - 0.26% -
429.mcf -90.40% 11999.000 1152.000 - -0.35% -
401.bzip2 -82.95% 15683.000 2674.000 - -0.78% -
447.dealII -78.17% 8196.000 1789.000 - 0.51% -
470.lbm -77.27% 13882.000 3156.000 - -0.79% -
471.omnetpp -73.94% 10746.000 2800.000 - -0.07% -
456.hmmer -73.41% 13365.000 3554.000 - -0.25% -
473.astar -65.41% 14262.000 4933.000 - 0.88% -
464.h264ref -64.00% 15493.000 5578.000 - -0.30% -
483.xalancbmk -61.42% 9427.000 3637.000 - -0.22% -
445.gobmk -57.52% 12400.000 5268.000 - -0.43% -
458.sjeng -50.42% 16406.000 8134.000 - 0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (max) -99.31% 873.000 6.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.23% 130.000 1.000 - -75.00% -
444.namd (max) -98.53% 882.000 13.000 - 0.00% -
444.namd (unexplained diff vs previous) -98.43% 828.000 13.000 - 18.18% -
433.milc (unexplained diff vs previous) -98.35% 182.000 3.000 - -25.00% -
433.milc (max) -97.83% 184.000 4.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -97.83% 92.000 2.000 - -94.12% -
482.sphinx3 -97.75% 489.000 11.000 - 0.00% -
482.sphinx3 (avg) -97.75% 489.000 11.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
444.namd -97.47% 514.000 13.000 - 0.00% -
444.namd (avg) -97.47% 514.000 13.000 - 0.00% -
470.lbm (max) -96.88% 769.000 24.000 - 84.62% -
453.povray (max) -96.21% 132.000 5.000 - -16.67% -
470.lbm (unexplained diff vs previous) -94.97% 497.000 25.000 - 2400.00% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) -94.03% 67.000 4.000 - -60.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -66.67% -
447.dealII (unexplained diff vs previous) -92.56% 121.000 9.000 - -40.00% -
462.libquantum (max) -92.31% 26.000 2.000 - -33.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -91.86% 0.860 0.070 - -94.21% -
450.soplex (max) -90.24% 82.000 8.000 - 100.00% -
450.soplex (unexplained diff vs previous) -90.24% 82.000 8.000 - 100.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII (max) -89.15% 129.000 14.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -88.95% 1.900 0.210 - -75.58% -
447.dealII -88.33% 120.000 14.000 - 0.00% -
447.dealII (avg) -88.33% 120.000 14.000 - 0.00% -
429.mcf (max) -88.06% 67.000 8.000 - -11.11% -
483.xalancbmk (unexplained diff vs previous) -86.89% 61.000 8.000 - 300.00% -
470.lbm -86.65% 322.000 43.000 - -2.27% -
470.lbm (avg) -86.65% 322.000 43.000 - -2.27% -
470.lbm (max) (percentage) -85.74% 5.540 0.790 - 88.10% -
471.omnetpp (max) -84.13% 189.000 30.000 - -11.76% -
433.milc (unexplained diff vs previous) (percentage) -80.74% 1.350 0.260 - -25.71% -
458.sjeng (max) -78.46% 65.000 14.000 - 75.00% -
470.lbm (unexplained diff vs previous) (percentage) -77.93% 3.580 0.790 - 2533.33% -
482.sphinx3 (max) (percentage) -77.71% 3.320 0.740 - -2.63% -
456.hmmer (max) -77.50% 40.000 9.000 - -18.18% -
483.xalancbmk (max) -75.41% 61.000 15.000 - 0.00% -
444.namd (max) (percentage) -72.02% 6.540 1.830 - 0.00% -
464.h264ref (unexplained diff vs previous) -71.67% 60.000 17.000 - 13.33% -
444.namd (unexplained diff vs previous) (percentage) -70.85% 6.140 1.790 - 16.23% -
433.milc (max) (percentage) -70.07% 1.370 0.410 - -4.65% -
447.dealII (unexplained diff vs previous) (percentage) -66.22% 1.480 0.500 - -40.48% -
483.xalancbmk (unexplained diff vs previous) (percentage) -66.15% 0.650 0.220 - 340.00% -
458.sjeng (unexplained diff vs previous) -63.41% 41.000 15.000 - 400.00% -
473.astar (max) -62.28% 114.000 43.000 - 186.67% -
473.astar (unexplained diff vs previous) -60.19% 108.000 43.000 - 975.00% -
401.bzip2 (max) -58.33% 48.000 20.000 - 11.11% -
401.bzip2 (unexplained diff vs previous) -57.14% 49.000 21.000 - 16.67% -
458.sjeng (max) (percentage) -55.00% 0.400 0.180 - 80.00% -
401.bzip2 -52.94% 34.000 16.000 - 0.00% -
401.bzip2 (avg) -52.94% 34.000 16.000 - 0.00% -
444.namd (avg) (percentage) -51.18% 3.810 1.860 - 0.00% -
447.dealII (max) (percentage) -50.00% 1.580 0.790 - -5.95% -
447.dealII (avg) (percentage) -45.58% 1.470 0.800 - -1.23% -
458.sjeng -44.21% 95.000 53.000 - -3.64% -
458.sjeng (avg) -44.21% 95.000 53.000 - -3.64% -
429.mcf -43.40% 53.000 30.000 - -3.23% -
429.mcf (avg) -43.40% 53.000 30.000 - -3.23% -
470.lbm (avg) (percentage) -40.52% 2.320 1.380 - -0.72% -
471.omnetpp (max) (percentage) -38.64% 1.760 1.080 - -12.20% -
433.milc (avg) (percentage) -37.62% 1.010 0.630 - -1.56% -
429.mcf (unexplained diff vs previous) (percentage) -37.50% 0.560 0.350 - -59.77% -
453.povray (max) (percentage) -36.27% 1.930 1.230 - -5.38% -
483.xalancbmk (max) (percentage) -35.38% 0.650 0.420 - 0.00% -
482.sphinx3 (avg) (percentage) -30.11% 1.860 1.300 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -28.00% 0.250 0.180 - 350.00% -
456.hmmer -25.00% 48.000 36.000 - -5.26% -
456.hmmer (avg) -25.00% 48.000 36.000 - -5.26% -
445.gobmk (max) -24.14% 29.000 22.000 - 83.33% -
445.gobmk (unexplained diff vs previous) -23.33% 30.000 23.000 - 475.00% -
464.h264ref (unexplained diff vs previous) (percentage) -23.08% 0.390 0.300 - 11.11% -
471.omnetpp -19.28% 83.000 67.000 - -2.90% -
471.omnetpp (avg) -19.28% 83.000 67.000 - -2.90% -
464.h264ref -15.69% 51.000 43.000 - -2.27% -
464.h264ref (avg) -15.69% 51.000 43.000 - -2.27% -
453.povray (avg) (percentage) -10.95% 1.370 1.220 - -3.17% -
456.hmmer (max) (percentage) -6.67% 0.300 0.280 - -9.68% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2674.000 -
403.gcc 53.000 -10.17%
429.mcf 1152.000 -
433.milc 1143.000 -
444.namd 725.000 1.83%
445.gobmk 5268.000 -
447.dealII 1789.000 -
450.soplex 530.000 1.53%
453.povray 466.000 -
456.hmmer 3554.000 -
458.sjeng 8134.000 -
462.libquantum 99.000 -1.00%
464.h264ref 5578.000 -
470.lbm 3156.000 -
471.omnetpp 2800.000 -
473.astar 4933.000 -
482.sphinx3 885.000 -
483.xalancbmk 3637.000 -
Geometric Mean 1439.613 -
Code Size (bytes)
Name Current %
401.bzip2 38345.000 -
403.gcc 1958353.000 -
429.mcf 7842.000 -
433.milc 73050.000 -
444.namd 172817.000 -
445.gobmk 1310272.000 -
447.dealII 1745295.000 -
450.soplex 201706.000 -
453.povray 576974.000 -
456.hmmer 166294.000 -
458.sjeng 96993.000 -
462.libquantum 24251.000 -
464.h264ref 353854.000 -
470.lbm 9702.000 -
471.omnetpp 376715.000 -
473.astar 23375.000 -
482.sphinx3 114291.000 -
483.xalancbmk 2285200.000 -
Geometric Mean 162307.019 -
sample variability
Name Current %
401.bzip2 16.000 -
401.bzip2 (avg) 16.000 -
401.bzip2 (avg) (percentage) 0.600 -
401.bzip2 (max) 20.000 11.11%
401.bzip2 (max) (percentage) 0.780 16.42%
401.bzip2 (unexplained diff vs previous) 21.000 16.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.790 17.91%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.660 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.940 -1.75%
429.mcf 30.000 -3.23%
429.mcf (avg) 30.000 -3.23%
429.mcf (avg) (percentage) 2.640 -2.22%
429.mcf (max) 8.000 -11.11%
429.mcf (max) (percentage) 0.770 -10.47%
429.mcf (unexplained diff vs previous) 4.000 -60.00%
429.mcf (unexplained diff vs previous) (percentage) 0.350 -59.77%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 -1.56%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.410 -4.65%
433.milc (unexplained diff vs previous) 3.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 -25.71%
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.860 -
444.namd (max) 13.000 -
444.namd (max) (percentage) 1.830 -
444.namd (unexplained diff vs previous) 13.000 18.18%
444.namd (unexplained diff vs previous) (percentage) 1.790 16.23%
445.gobmk 30.000 -3.23%
445.gobmk (avg) 30.000 -3.23%
445.gobmk (avg) (percentage) 0.580 -1.69%
445.gobmk (max) 22.000 83.33%
445.gobmk (max) (percentage) 0.430 86.96%
445.gobmk (unexplained diff vs previous) 23.000 475.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.440 450.00%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.800 -1.23%
447.dealII (max) 14.000 -
447.dealII (max) (percentage) 0.790 -5.95%
447.dealII (unexplained diff vs previous) 9.000 -40.00%
447.dealII (unexplained diff vs previous) (percentage) 0.500 -40.48%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.020 -
450.soplex (max) 8.000 100.00%
450.soplex (max) (percentage) 1.530 86.59%
450.soplex (unexplained diff vs previous) 8.000 100.00%
450.soplex (unexplained diff vs previous) (percentage) 1.510 96.10%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.220 -3.17%
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.230 -5.38%
453.povray (unexplained diff vs previous) 1.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.210 -75.58%
456.hmmer 36.000 -5.26%
456.hmmer (avg) 36.000 -5.26%
456.hmmer (avg) (percentage) 1.040 -2.80%
456.hmmer (max) 9.000 -18.18%
456.hmmer (max) (percentage) 0.280 -9.68%
456.hmmer (unexplained diff vs previous) 9.000 -18.18%
456.hmmer (unexplained diff vs previous) (percentage) 0.250 -19.35%
458.sjeng 53.000 -3.64%
458.sjeng (avg) 53.000 -3.64%
458.sjeng (avg) (percentage) 0.660 -2.94%
458.sjeng (max) 14.000 75.00%
458.sjeng (max) (percentage) 0.180 80.00%
458.sjeng (unexplained diff vs previous) 15.000 400.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.180 350.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.360 -1.45%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.900 -6.15%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -66.33%
464.h264ref 43.000 -2.27%
464.h264ref (avg) 43.000 -2.27%
464.h264ref (avg) (percentage) 0.780 -1.27%
464.h264ref (max) 154.000 -2.53%
464.h264ref (max) (percentage) 2.770 -2.46%
464.h264ref (unexplained diff vs previous) 17.000 13.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.300 11.11%
470.lbm 43.000 -2.27%
470.lbm (avg) 43.000 -2.27%
470.lbm (avg) (percentage) 1.380 -
470.lbm (max) 24.000 84.62%
470.lbm (max) (percentage) 0.790 88.10%
470.lbm (unexplained diff vs previous) 25.000 2400.00%
470.lbm (unexplained diff vs previous) (percentage) 0.790 2533.33%
471.omnetpp 67.000 -2.90%
471.omnetpp (avg) 67.000 -2.90%
471.omnetpp (avg) (percentage) 2.420 -2.42%
471.omnetpp (max) 30.000 -11.76%
471.omnetpp (max) (percentage) 1.080 -12.20%
471.omnetpp (unexplained diff vs previous) 2.000 -94.12%
471.omnetpp (unexplained diff vs previous) (percentage) 0.070 -94.21%
473.astar 97.000 -
473.astar (avg) 97.000 -
473.astar (avg) (percentage) 1.970 -1.50%
473.astar (max) 43.000 186.67%
473.astar (max) (percentage) 0.880 183.87%
473.astar (unexplained diff vs previous) 43.000 975.00%
473.astar (unexplained diff vs previous) (percentage) 0.870 987.50%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.300 -
482.sphinx3 (max) 6.000 -
482.sphinx3 (max) (percentage) 0.740 -2.63%
483.xalancbmk 86.000 -2.27%
483.xalancbmk (avg) 86.000 -2.27%
483.xalancbmk (avg) (percentage) 2.380 -2.46%
483.xalancbmk (max) 15.000 -
483.xalancbmk (max) (percentage) 0.420 -
483.xalancbmk (unexplained diff vs previous) 8.000 300.00%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.220 340.00%
Geometric Mean 3.925 11.45%