Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5748ad84e5e8e5621f221199cc290666f00e2a30 (+ 368 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/142/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0142 (llvmorg-19-init-07513-g5748ad84e5e8) 2024-03-31T23:14:05 0:00:00
Previous 0141 (llvmorg-19-init-07145-gb4adb42151bb) 2024-03-27T00:06:54 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 28
Performance Improvements 51 119
Added Tests 22 2
Unchanged Tests 684 631
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 9.09% 55.000 60.000 - -99.34% -
471.omnetpp 1.79% 2733.000 2782.000 - -74.11% -
401.bzip2 1.12% 2690.000 2720.000 - -82.66% -
447.dealII 1.07% 1779.000 1798.000 - -78.06% -
456.hmmer 1.01% 3553.000 3589.000 - -73.15% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (max) 125.00% 16.000 36.000 - -10.00% -
456.hmmer (max) (percentage) 119.57% 0.460 1.010 - 236.67% -
470.lbm (unexplained diff vs previous) 75.00% 4.000 7.000 - -98.59% -
470.lbm (unexplained diff vs previous) (percentage) 69.23% 0.130 0.220 - -93.85% -
401.bzip2 (max) 50.00% 20.000 30.000 - -37.50% -
401.bzip2 (max) (percentage) 47.37% 0.760 1.120 - 261.29% -
447.dealII (max) 35.71% 14.000 19.000 - -85.27% -
447.dealII (max) (percentage) 28.92% 0.830 1.070 - -32.28% -
403.gcc (max) 20.00% 5.000 6.000 - -82.35% -
401.bzip2 6.67% 15.000 16.000 - -52.94% -
401.bzip2 (avg) 6.67% 15.000 16.000 - -52.94% -
456.hmmer 4.35% 23.000 24.000 - -50.00% -
456.hmmer (avg) 4.35% 23.000 24.000 - -50.00% -
471.omnetpp 2.08% 48.000 49.000 - -40.96% -
471.omnetpp (avg) 2.08% 48.000 49.000 - -40.96% -
401.bzip2 (avg) (percentage) 1.72% 0.580 0.590 - 168.18% -
447.dealII (avg) (percentage) 1.59% 0.630 0.640 - -56.46% -
456.hmmer (avg) (percentage) 1.52% 0.660 0.670 - 86.11% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.01% 99.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (unexplained diff vs previous) -89.83% 59.000 6.000 - -90.16% -
483.xalancbmk (unexplained diff vs previous) (percentage) -89.63% 1.640 0.170 - -73.85% -
482.sphinx3 (max) -56.25% 16.000 7.000 - -99.20% -
482.sphinx3 (max) (percentage) -56.02% 1.910 0.840 - -74.70% -
445.gobmk (max) -35.71% 14.000 9.000 - -68.97% -
471.omnetpp (unexplained diff vs previous) (percentage) -34.08% 2.670 1.760 - 104.65% -
471.omnetpp (unexplained diff vs previous) -32.88% 73.000 49.000 - -46.74% -
445.gobmk (max) (percentage) -29.63% 0.270 0.190 - -20.83% -
433.milc (max) (percentage) -27.87% 0.610 0.440 - -67.88% -
458.sjeng (max) -26.67% 15.000 11.000 - -83.08% -
458.sjeng (max) (percentage) -26.32% 0.190 0.140 - -65.00% -
464.h264ref (max) (percentage) -21.57% 0.510 0.400 - 2.56% -
464.h264ref (max) -21.43% 28.000 22.000 - -63.33% -
433.milc (max) -16.67% 6.000 5.000 - -97.28% -
433.milc (unexplained diff vs previous) -16.67% 6.000 5.000 - -97.25% -
471.omnetpp (max) (percentage) -16.54% 2.600 2.170 - 23.30% -
471.omnetpp (max) -15.49% 71.000 60.000 - -68.25% -
433.milc (unexplained diff vs previous) (percentage) -15.38% 0.520 0.440 - -67.41% -
450.soplex (max) -12.50% 8.000 7.000 - -91.46% -
470.lbm (max) -12.50% 16.000 14.000 - -98.18% -
470.lbm (max) (percentage) -11.54% 0.520 0.460 - -91.70% -
444.namd -10.00% 10.000 9.000 - -98.25% -
444.namd (avg) -10.00% 10.000 9.000 - -98.25% -
450.soplex (max) (percentage) -9.88% 1.620 1.460 - 156.14% -
444.namd (max) -9.09% 11.000 10.000 - -98.87% -
462.libquantum (max) (percentage) -8.43% 1.780 1.630 - 715.00% -
429.mcf (max) -7.69% 13.000 12.000 - -82.09% -
483.xalancbmk (max) (percentage) -7.23% 1.660 1.540 - 136.92% -
473.astar (max) -7.14% 14.000 13.000 - -88.60% -
483.xalancbmk (max) -6.78% 59.000 55.000 - -9.84% -
473.astar (max) (percentage) -6.67% 0.300 0.280 - -65.00% -
429.mcf (max) (percentage) -5.88% 1.190 1.120 - 100.00% -
429.mcf -4.17% 24.000 23.000 - -56.60% -
429.mcf (avg) -4.17% 24.000 23.000 - -56.60% -
444.namd (max) (percentage) -3.95% 1.520 1.460 - -77.68% -
483.xalancbmk -3.77% 53.000 51.000 - 8.51% -
483.xalancbmk (avg) -3.77% 53.000 51.000 - 8.51% -
453.povray (avg) (percentage) -2.63% 1.140 1.110 - -18.98% -
429.mcf (avg) (percentage) -2.38% 2.100 2.050 - 355.56% -
445.gobmk (avg) (percentage) -2.33% 0.430 0.420 - 133.33% -
458.sjeng (avg) (percentage) -2.22% 0.450 0.440 - -24.14% -
453.povray (max) (percentage) -2.13% 0.940 0.920 - -52.33% -
483.xalancbmk (avg) (percentage) -2.04% 1.470 1.440 - 188.00% -
470.lbm (avg) (percentage) -1.92% 1.040 1.020 - -56.03% -
464.h264ref (avg) (percentage) -1.82% 0.550 0.540 - 63.64% -
473.astar -1.75% 57.000 56.000 - -21.13% -
473.astar (avg) -1.75% 57.000 56.000 - -21.13% -
473.astar (avg) (percentage) -1.68% 1.190 1.170 - 134.00% -
450.soplex (avg) (percentage) -1.60% 1.250 1.230 - 241.67% -
403.gcc (max) (percentage) -1.06% 10.330 10.220 - 2589.47% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.22% 39458.000 40333.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 2589.47% 0.380 10.220 - -1.06% -
456.hmmer (unexplained diff vs previous) (percentage) 1328.57% 0.070 1.000 - 0.00% -
462.libquantum (avg) (percentage) 773.33% 0.150 1.310 - -0.76% -
462.libquantum (unexplained diff vs previous) (percentage) 750.00% 0.120 1.020 - 0.99% -
462.libquantum (max) (percentage) 715.00% 0.200 1.630 - -8.43% -
403.gcc (avg) (percentage) 689.58% 0.480 3.790 - 0.00% -
429.mcf (avg) (percentage) 355.56% 0.450 2.050 - -2.38% -
456.hmmer (unexplained diff vs previous) 300.00% 9.000 36.000 - 0.00% -
401.bzip2 (max) (percentage) 261.29% 0.310 1.120 - 47.37% -
401.bzip2 (unexplained diff vs previous) (percentage) 254.84% 0.310 1.100 - 0.00% -
450.soplex (avg) (percentage) 241.67% 0.360 1.230 - -1.60% -
456.hmmer (max) (percentage) 236.67% 0.300 1.010 - 119.57% -
483.xalancbmk (avg) (percentage) 188.00% 0.500 1.440 - -2.04% -
401.bzip2 (avg) (percentage) 168.18% 0.220 0.590 - 1.72% -
450.soplex (max) (percentage) 156.14% 0.570 1.460 - -9.88% -
483.xalancbmk (max) (percentage) 136.92% 0.650 1.540 - -7.23% -
473.astar (avg) (percentage) 134.00% 0.500 1.170 - -1.68% -
445.gobmk (avg) (percentage) 133.33% 0.180 0.420 - -2.33% -
471.omnetpp (avg) (percentage) 126.92% 0.780 1.770 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 104.65% 0.860 1.760 - -34.08% -
429.mcf (max) (percentage) 100.00% 0.560 1.120 - -5.88% -
456.hmmer (avg) (percentage) 86.11% 0.360 0.670 - 1.52% -
464.h264ref (avg) (percentage) 63.64% 0.330 0.540 - -1.82% -
471.omnetpp (max) (percentage) 23.30% 1.760 2.170 - -16.54% -
483.xalancbmk 8.51% 47.000 51.000 - -3.77% -
483.xalancbmk (avg) 8.51% 47.000 51.000 - -3.77% -
464.h264ref (max) (percentage) 2.56% 0.390 0.400 - -21.57% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.47% 26756.000 23955.000 - 0.00% -
444.namd -3.21% 175160.000 169537.000 - 0.00% -
447.dealII -2.86% 1777992.000 1727135.000 - 0.00% -
453.povray -2.80% 593097.000 576486.000 - 0.00% -
433.milc -2.77% 74971.000 72898.000 - 0.00% -
464.h264ref -1.44% 354618.000 349518.000 - -0.02% -
482.sphinx3 -1.38% 115736.000 114135.000 - 0.00% -
429.mcf -1.02% 7915.000 7834.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.34% 9099.000 60.000 - 9.09% -
462.libquantum -99.25% 13126.000 98.000 - -1.01% -
482.sphinx3 -96.64% 26310.000 885.000 - 0.80% -
450.soplex -96.38% 14429.000 522.000 - -0.19% -
444.namd -94.61% 13495.000 727.000 - -0.95% -
453.povray -93.23% 6857.000 464.000 - -0.22% -
433.milc -91.48% 13482.000 1148.000 - 0.44% -
429.mcf -90.34% 11999.000 1159.000 - 0.00% -
401.bzip2 -82.66% 15683.000 2720.000 - 1.12% -
447.dealII -78.06% 8196.000 1798.000 - 1.07% -
470.lbm -77.13% 13882.000 3175.000 - 0.22% -
471.omnetpp -74.11% 10746.000 2782.000 - 1.79% -
456.hmmer -73.15% 13365.000 3589.000 - 1.01% -
473.astar -65.93% 14262.000 4859.000 - 0.12% -
464.h264ref -64.12% 15493.000 5559.000 - -0.13% -
483.xalancbmk -61.81% 9427.000 3600.000 - -0.17% -
445.gobmk -57.68% 12400.000 5248.000 - -0.02% -
458.sjeng -49.85% 16406.000 8227.000 - 0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
453.povray (unexplained diff vs previous) -99.23% 130.000 1.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.23% 904.000 7.000 - 0.00% -
482.sphinx3 (max) -99.20% 873.000 7.000 - -56.25% -
444.namd (unexplained diff vs previous) -99.15% 828.000 7.000 - 0.00% -
444.namd (max) -98.87% 882.000 10.000 - -9.09% -
450.soplex (unexplained diff vs previous) -98.78% 82.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.59% 497.000 7.000 - 75.00% -
444.namd -98.25% 514.000 9.000 - -10.00% -
444.namd (avg) -98.25% 514.000 9.000 - -10.00% -
470.lbm (max) -98.18% 769.000 14.000 - -12.50% -
482.sphinx3 -98.16% 489.000 9.000 - 0.00% -
482.sphinx3 (avg) -98.16% 489.000 9.000 - 0.00% -
433.milc (max) -97.28% 184.000 5.000 - -16.67% -
433.milc (unexplained diff vs previous) -97.25% 182.000 5.000 - -16.67% -
453.povray (max) -96.97% 132.000 4.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -96.67% 30.000 1.000 - 0.00% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
473.astar (unexplained diff vs previous) -94.44% 108.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -93.85% 3.580 0.220 - 69.23% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
470.lbm (max) (percentage) -91.70% 5.540 0.460 - -11.54% -
445.gobmk (unexplained diff vs previous) (percentage) -91.67% 0.240 0.020 - 0.00% -
450.soplex (max) -91.46% 82.000 7.000 - -12.50% -
447.dealII -90.83% 120.000 11.000 - 0.00% -
447.dealII (avg) -90.83% 120.000 11.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -90.16% 61.000 6.000 - -89.83% -
470.lbm -90.06% 322.000 32.000 - 0.00% -
470.lbm (avg) -90.06% 322.000 32.000 - 0.00% -
473.astar (max) -88.60% 114.000 13.000 - -7.14% -
453.povray (unexplained diff vs previous) (percentage) -88.42% 1.900 0.220 - 0.00% -
464.h264ref (unexplained diff vs previous) -88.33% 60.000 7.000 - 0.00% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
447.dealII (max) -85.27% 129.000 19.000 - 35.71% -
444.namd (unexplained diff vs previous) (percentage) -84.36% 6.140 0.960 - 0.00% -
447.dealII (unexplained diff vs previous) -84.30% 121.000 19.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -84.21% 0.760 0.120 - 0.00% -
458.sjeng (max) -83.08% 65.000 11.000 - -26.67% -
458.sjeng (unexplained diff vs previous) -82.93% 41.000 7.000 - 0.00% -
403.gcc (max) -82.35% 34.000 6.000 - 20.00% -
429.mcf (max) -82.09% 67.000 12.000 - -7.69% -
444.namd (max) (percentage) -77.68% 6.540 1.460 - -3.95% -
482.sphinx3 (unexplained diff vs previous) (percentage) -77.03% 3.440 0.790 - 0.00% -
482.sphinx3 (max) (percentage) -74.70% 3.320 0.840 - -56.02% -
483.xalancbmk (unexplained diff vs previous) (percentage) -73.85% 0.650 0.170 - -89.63% -
445.gobmk (max) -68.97% 29.000 9.000 - -35.71% -
471.omnetpp (max) -68.25% 189.000 60.000 - -15.49% -
433.milc (max) (percentage) -67.88% 1.370 0.440 - -27.87% -
433.milc (unexplained diff vs previous) (percentage) -67.41% 1.350 0.440 - -15.38% -
450.soplex (unexplained diff vs previous) (percentage) -66.67% 0.570 0.190 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - 0.00% -
458.sjeng (max) (percentage) -65.00% 0.400 0.140 - -26.32% -
473.astar (max) (percentage) -65.00% 0.800 0.280 - -6.67% -
444.namd (avg) (percentage) -64.30% 3.810 1.360 - -0.73% -
458.sjeng (unexplained diff vs previous) (percentage) -64.00% 0.250 0.090 - 0.00% -
464.h264ref (max) -63.33% 60.000 22.000 - -21.43% -
458.sjeng -62.11% 95.000 36.000 - 0.00% -
458.sjeng (avg) -62.11% 95.000 36.000 - 0.00% -
429.mcf -56.60% 53.000 23.000 - -4.17% -
429.mcf (avg) -56.60% 53.000 23.000 - -4.17% -
447.dealII (avg) (percentage) -56.46% 1.470 0.640 - 1.59% -
470.lbm (avg) (percentage) -56.03% 2.320 1.020 - -1.92% -
401.bzip2 -52.94% 34.000 16.000 - 6.67% -
401.bzip2 (avg) -52.94% 34.000 16.000 - 6.67% -
453.povray (max) (percentage) -52.33% 1.930 0.920 - -2.13% -
456.hmmer -50.00% 48.000 24.000 - 4.35% -
456.hmmer (avg) -50.00% 48.000 24.000 - 4.35% -
471.omnetpp (unexplained diff vs previous) -46.74% 92.000 49.000 - -32.88% -
482.sphinx3 (avg) (percentage) -44.09% 1.860 1.040 - 0.00% -
464.h264ref -41.18% 51.000 30.000 - 0.00% -
464.h264ref (avg) -41.18% 51.000 30.000 - 0.00% -
471.omnetpp -40.96% 83.000 49.000 - 2.08% -
471.omnetpp (avg) -40.96% 83.000 49.000 - 2.08% -
401.bzip2 (unexplained diff vs previous) -38.78% 49.000 30.000 - 0.00% -
401.bzip2 (max) -37.50% 48.000 30.000 - 50.00% -
433.milc (avg) (percentage) -36.63% 1.010 0.640 - 0.00% -
447.dealII (max) (percentage) -32.28% 1.580 1.070 - 28.92% -
447.dealII (unexplained diff vs previous) (percentage) -28.38% 1.480 1.060 - 0.00% -
458.sjeng (avg) (percentage) -24.14% 0.580 0.440 - -2.22% -
473.astar -21.13% 71.000 56.000 - -1.75% -
473.astar (avg) -21.13% 71.000 56.000 - -1.75% -
445.gobmk (max) (percentage) -20.83% 0.240 0.190 - -29.63% -
453.povray (avg) (percentage) -18.98% 1.370 1.110 - -2.63% -
456.hmmer (max) -10.00% 40.000 36.000 - 125.00% -
483.xalancbmk (max) -9.84% 61.000 55.000 - -6.78% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2720.000 1.12%
403.gcc 60.000 9.09%
429.mcf 1159.000 -
433.milc 1148.000 -
444.namd 727.000 -
445.gobmk 5248.000 -
447.dealII 1798.000 1.07%
450.soplex 522.000 -
453.povray 464.000 -
456.hmmer 3589.000 1.01%
458.sjeng 8227.000 -
462.libquantum 98.000 -1.01%
464.h264ref 5559.000 -
470.lbm 3175.000 -
471.omnetpp 2782.000 1.79%
473.astar 4859.000 -
482.sphinx3 885.000 -
483.xalancbmk 3600.000 -
Geometric Mean 1449.065 -
Code Size (bytes)
Name Current %
401.bzip2 40333.000 -
403.gcc 1954969.000 -
429.mcf 7834.000 -
433.milc 72898.000 -
444.namd 169537.000 -
445.gobmk 1308216.000 -
447.dealII 1727135.000 -
450.soplex 198335.000 -
453.povray 576486.000 -
456.hmmer 166422.000 -
458.sjeng 96893.000 -
462.libquantum 23955.000 -
464.h264ref 349518.000 -
470.lbm 9702.000 -
471.omnetpp 376219.000 -
473.astar 23315.000 -
482.sphinx3 114135.000 -
483.xalancbmk 2284952.000 -
Geometric Mean 162006.008 -
sample variability
Name Current %
401.bzip2 16.000 6.67%
401.bzip2 (avg) 16.000 6.67%
401.bzip2 (avg) (percentage) 0.590 1.72%
401.bzip2 (max) 30.000 50.00%
401.bzip2 (max) (percentage) 1.120 47.37%
401.bzip2 (unexplained diff vs previous) 30.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.100 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.790 -
403.gcc (max) 6.000 20.00%
403.gcc (max) (percentage) 10.220 -1.06%
429.mcf 23.000 -4.17%
429.mcf (avg) 23.000 -4.17%
429.mcf (avg) (percentage) 2.050 -2.38%
429.mcf (max) 12.000 -7.69%
429.mcf (max) (percentage) 1.120 -5.88%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 -
433.milc (max) 5.000 -16.67%
433.milc (max) (percentage) 0.440 -27.87%
433.milc (unexplained diff vs previous) 5.000 -16.67%
433.milc (unexplained diff vs previous) (percentage) 0.440 -15.38%
444.namd 9.000 -10.00%
444.namd (avg) 9.000 -10.00%
444.namd (avg) (percentage) 1.360 -
444.namd (max) 10.000 -9.09%
444.namd (max) (percentage) 1.460 -3.95%
444.namd (unexplained diff vs previous) 7.000 -
444.namd (unexplained diff vs previous) (percentage) 0.960 -
445.gobmk 22.000 -
445.gobmk (avg) 22.000 -
445.gobmk (avg) (percentage) 0.420 -2.33%
445.gobmk (max) 9.000 -35.71%
445.gobmk (max) (percentage) 0.190 -29.63%
445.gobmk (unexplained diff vs previous) 1.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 0.640 1.59%
447.dealII (max) 19.000 35.71%
447.dealII (max) (percentage) 1.070 28.92%
447.dealII (unexplained diff vs previous) 19.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.060 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.230 -1.60%
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.460 -9.88%
450.soplex (unexplained diff vs previous) 1.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.190 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.110 -2.63%
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.920 -2.13%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.220 -
456.hmmer 24.000 4.35%
456.hmmer (avg) 24.000 4.35%
456.hmmer (avg) (percentage) 0.670 1.52%
456.hmmer (max) 36.000 125.00%
456.hmmer (max) (percentage) 1.010 119.57%
456.hmmer (unexplained diff vs previous) 36.000 -
456.hmmer (unexplained diff vs previous) (percentage) 1.000 -
458.sjeng 36.000 -
458.sjeng (avg) 36.000 -
458.sjeng (avg) (percentage) 0.440 -2.22%
458.sjeng (max) 11.000 -26.67%
458.sjeng (max) (percentage) 0.140 -26.32%
458.sjeng (unexplained diff vs previous) 7.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.310 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.630 -8.43%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.020 -
464.h264ref 30.000 -
464.h264ref (avg) 30.000 -
464.h264ref (avg) (percentage) 0.540 -1.82%
464.h264ref (max) 22.000 -21.43%
464.h264ref (max) (percentage) 0.400 -21.57%
464.h264ref (unexplained diff vs previous) 7.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.130 -
470.lbm 32.000 -
470.lbm (avg) 32.000 -
470.lbm (avg) (percentage) 1.020 -1.92%
470.lbm (max) 14.000 -12.50%
470.lbm (max) (percentage) 0.460 -11.54%
470.lbm (unexplained diff vs previous) 7.000 75.00%
470.lbm (unexplained diff vs previous) (percentage) 0.220 69.23%
471.omnetpp 49.000 2.08%
471.omnetpp (avg) 49.000 2.08%
471.omnetpp (avg) (percentage) 1.770 -
471.omnetpp (max) 60.000 -15.49%
471.omnetpp (max) (percentage) 2.170 -16.54%
471.omnetpp (unexplained diff vs previous) 49.000 -32.88%
471.omnetpp (unexplained diff vs previous) (percentage) 1.760 -34.08%
473.astar 56.000 -1.75%
473.astar (avg) 56.000 -1.75%
473.astar (avg) (percentage) 1.170 -1.68%
473.astar (max) 13.000 -7.14%
473.astar (max) (percentage) 0.280 -6.67%
473.astar (unexplained diff vs previous) 6.000 -
473.astar (unexplained diff vs previous) (percentage) 0.120 -
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.040 -
482.sphinx3 (max) 7.000 -56.25%
482.sphinx3 (max) (percentage) 0.840 -56.02%
482.sphinx3 (unexplained diff vs previous) 7.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.790 -
483.xalancbmk 51.000 -3.77%
483.xalancbmk (avg) 51.000 -3.77%
483.xalancbmk (avg) (percentage) 1.440 -2.04%
483.xalancbmk (max) 55.000 -6.78%
483.xalancbmk (max) (percentage) 1.540 -7.23%
483.xalancbmk (unexplained diff vs previous) 6.000 -89.83%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.170 -89.63%
Geometric Mean 2.840 -33.34%