Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d8d0588f663b37c1c3d95ac8986a2a7a8865ce0b (+ 121 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/72/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0072 (llvmorg-18-init-05974-gd8d0588f663b) 2023-09-16T05:03:06 0:00:00
Previous 0071 (llvmorg-18-init-05853-gcbdccb30c23f) 2023-09-13T20:14:15 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 41
Performance Improvements 64 108
Added Tests 22 0
Unchanged Tests 674 631
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 2.94% 714.000 735.000 - -94.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 615.79% 0.190 1.360 - 138.60% -
444.namd (max) 600.00% 3.000 21.000 - -97.62% -
450.soplex (unexplained diff vs previous) 600.00% 1.000 7.000 - -91.46% -
444.namd (max) (percentage) 553.33% 0.450 2.940 - -55.05% -
445.gobmk (max) (percentage) 41.67% 0.360 0.510 - 112.50% -
445.gobmk (max) 36.84% 19.000 26.000 - -10.34% -
433.milc (max) 33.33% 6.000 8.000 - -95.65% -
433.milc (unexplained diff vs previous) 33.33% 6.000 8.000 - -95.60% -
433.milc (max) (percentage) 32.69% 0.520 0.690 - -49.64% -
433.milc (unexplained diff vs previous) (percentage) 32.69% 0.520 0.690 - -48.89% -
483.xalancbmk (unexplained diff vs previous) (percentage) 23.08% 0.390 0.480 - -26.15% -
483.xalancbmk (unexplained diff vs previous) 21.43% 14.000 17.000 - -72.13% -
401.bzip2 (max) (percentage) 15.09% 0.530 0.610 - 96.77% -
401.bzip2 (max) 14.29% 14.000 16.000 - -66.67% -
444.namd 6.67% 15.000 16.000 - -96.89% -
444.namd (avg) 6.67% 15.000 16.000 - -96.89% -
447.dealII (max) (percentage) 3.70% 0.270 0.280 - -82.28% -
450.soplex (avg) (percentage) 2.25% 0.890 0.910 - 152.78% -
444.namd (avg) (percentage) 1.34% 2.240 2.270 - -40.42% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -4.92% 61.000 58.000 - -99.36% -
450.soplex -1.34% 523.000 516.000 - -96.42% -
462.libquantum -1.00% 100.000 99.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -68.35% 0.790 0.250 - -70.93% -
471.omnetpp (unexplained diff vs previous) -68.18% 22.000 7.000 - -92.39% -
470.lbm (unexplained diff vs previous) -45.45% 22.000 12.000 - -97.59% -
470.lbm (unexplained diff vs previous) (percentage) -44.93% 0.690 0.380 - -89.39% -
464.h264ref (unexplained diff vs previous) -44.44% 9.000 5.000 - -91.67% -
464.h264ref (unexplained diff vs previous) (percentage) -43.75% 0.160 0.090 - -76.92% -
403.gcc (max) -33.33% 3.000 2.000 - -94.12% -
464.h264ref (max) (percentage) -25.00% 0.160 0.120 - -69.23% -
464.h264ref (max) -25.00% 8.000 6.000 - -90.00% -
456.hmmer (max) (percentage) -15.00% 0.400 0.340 - 13.33% -
456.hmmer (max) -14.29% 14.000 12.000 - -70.00% -
470.lbm (max) -13.64% 22.000 19.000 - -97.53% -
482.sphinx3 (max) -11.11% 9.000 8.000 - -99.08% -
471.omnetpp (max) (percentage) -11.02% 1.180 1.050 - -40.34% -
470.lbm (max) (percentage) -10.00% 0.700 0.630 - -88.63% -
471.omnetpp (max) -9.38% 32.000 29.000 - -84.66% -
429.mcf (max) -9.09% 11.000 10.000 - -85.07% -
453.povray (max) -9.09% 11.000 10.000 - -92.42% -
483.xalancbmk (max) -9.09% 33.000 30.000 - -50.82% -
483.xalancbmk (max) (percentage) -8.51% 0.940 0.860 - 32.31% -
429.mcf (max) (percentage) -8.33% 0.960 0.880 - 57.14% -
453.povray (max) (percentage) -6.53% 2.450 2.290 - 18.65% -
482.sphinx3 (max) (percentage) -6.36% 1.100 1.030 - -68.98% -
447.dealII -6.25% 16.000 15.000 - -87.50% -
447.dealII (avg) -6.25% 16.000 15.000 - -87.50% -
447.dealII (avg) (percentage) -5.21% 0.960 0.910 - -38.10% -
473.astar -4.20% 143.000 137.000 - 92.96% -
473.astar (avg) -4.20% 143.000 137.000 - 92.96% -
453.povray (avg) (percentage) -4.11% 1.460 1.400 - 2.19% -
456.hmmer (avg) (percentage) -3.97% 1.510 1.450 - 302.78% -
473.astar (avg) (percentage) -3.97% 3.020 2.900 - 480.00% -
450.soplex (max) (percentage) -3.95% 1.520 1.460 - 156.14% -
456.hmmer -3.77% 53.000 51.000 - 6.25% -
456.hmmer (avg) -3.77% 53.000 51.000 - 6.25% -
483.xalancbmk -3.76% 133.000 128.000 - 172.34% -
483.xalancbmk (avg) -3.76% 133.000 128.000 - 172.34% -
464.h264ref -3.70% 54.000 52.000 - 1.96% -
464.h264ref (avg) -3.70% 54.000 52.000 - 1.96% -
470.lbm -3.28% 61.000 59.000 - -81.68% -
470.lbm (avg) -3.28% 61.000 59.000 - -81.68% -
483.xalancbmk (avg) (percentage) -3.22% 3.730 3.610 - 622.00% -
458.sjeng (avg) (percentage) -3.19% 0.940 0.910 - 56.90% -
464.h264ref (avg) (percentage) -3.03% 0.990 0.960 - 190.91% -
429.mcf (avg) (percentage) -2.89% 3.810 3.700 - 722.22% -
458.sjeng (max) -2.86% 35.000 34.000 - -47.69% -
471.omnetpp (avg) (percentage) -2.71% 3.320 3.230 - 314.10% -
462.libquantum (max) (percentage) -2.67% 1.500 1.460 - 630.00% -
458.sjeng -2.63% 76.000 74.000 - -22.11% -
458.sjeng (avg) -2.63% 76.000 74.000 - -22.11% -
470.lbm (avg) (percentage) -2.58% 1.940 1.890 - -18.53% -
482.sphinx3 (avg) (percentage) -2.41% 1.660 1.620 - -12.90% -
458.sjeng (max) (percentage) -2.33% 0.430 0.420 - 5.00% -
445.gobmk -2.33% 43.000 42.000 - 90.91% -
445.gobmk (avg) -2.33% 43.000 42.000 - 90.91% -
473.astar (max) (percentage) -2.27% 0.440 0.430 - -46.25% -
429.mcf -2.27% 44.000 43.000 - -18.87% -
429.mcf (avg) -2.27% 44.000 43.000 - -18.87% -
471.omnetpp -2.17% 92.000 90.000 - 8.43% -
471.omnetpp (avg) -2.17% 92.000 90.000 - 8.43% -
403.gcc (max) (percentage) -1.57% 5.080 5.000 - 1215.79% -
462.libquantum (avg) (percentage) -1.30% 1.540 1.520 - 913.33% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.98% 39458.000 41817.000 - 0.00% -
450.soplex 1.73% 198708.000 202143.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1215.79% 0.380 5.000 - -1.57% -
462.libquantum (avg) (percentage) 913.33% 0.150 1.520 - -1.30% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - 0.00% -
429.mcf (avg) (percentage) 722.22% 0.450 3.700 - -2.89% -
462.libquantum (max) (percentage) 630.00% 0.200 1.460 - -2.67% -
483.xalancbmk (avg) (percentage) 622.00% 0.500 3.610 - -3.22% -
473.astar (avg) (percentage) 480.00% 0.500 2.900 - -3.97% -
445.gobmk (avg) (percentage) 350.00% 0.180 0.810 - -1.22% -
403.gcc (avg) (percentage) 345.83% 0.480 2.140 - 0.00% -
471.omnetpp (avg) (percentage) 314.10% 0.780 3.230 - -2.71% -
456.hmmer (avg) (percentage) 302.78% 0.360 1.450 - -3.97% -
401.bzip2 (avg) (percentage) 213.64% 0.220 0.690 - 0.00% -
464.h264ref (avg) (percentage) 190.91% 0.330 0.960 - -3.03% -
483.xalancbmk 172.34% 47.000 128.000 - -3.76% -
483.xalancbmk (avg) 172.34% 47.000 128.000 - -3.76% -
450.soplex (max) (percentage) 156.14% 0.570 1.460 - -3.95% -
450.soplex (avg) (percentage) 152.78% 0.360 0.910 - 2.25% -
450.soplex (unexplained diff vs previous) (percentage) 138.60% 0.570 1.360 - 615.79% -
445.gobmk (max) (percentage) 112.50% 0.240 0.510 - 41.67% -
445.gobmk (unexplained diff vs previous) (percentage) 112.50% 0.240 0.510 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 100.00% 0.310 0.620 - 0.00% -
401.bzip2 (max) (percentage) 96.77% 0.310 0.610 - 15.09% -
473.astar 92.96% 71.000 137.000 - -4.20% -
473.astar (avg) 92.96% 71.000 137.000 - -4.20% -
445.gobmk 90.91% 22.000 42.000 - -2.33% -
445.gobmk (avg) 90.91% 22.000 42.000 - -2.33% -
429.mcf (max) (percentage) 57.14% 0.560 0.880 - -8.33% -
458.sjeng (avg) (percentage) 56.90% 0.580 0.910 - -3.19% -
483.xalancbmk (max) (percentage) 32.31% 0.650 0.860 - -8.51% -
453.povray (max) (percentage) 18.65% 1.930 2.290 - -6.53% -
456.hmmer (max) (percentage) 13.33% 0.300 0.340 - -15.00% -
471.omnetpp 8.43% 83.000 90.000 - -2.17% -
471.omnetpp (avg) 8.43% 83.000 90.000 - -2.17% -
456.hmmer 6.25% 48.000 51.000 - -3.77% -
456.hmmer (avg) 6.25% 48.000 51.000 - -3.77% -
458.sjeng (max) (percentage) 5.00% 0.400 0.420 - -2.33% -
453.povray (avg) (percentage) 2.19% 1.370 1.400 - -4.11% -
464.h264ref 1.96% 51.000 52.000 - -3.70% -
464.h264ref (avg) 1.96% 51.000 52.000 - -3.70% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -6.38% 26756.000 25049.000 - 0.00% -
453.povray -3.25% 593097.000 573843.000 - 0.00% -
433.milc -2.79% 74971.000 72883.000 - 0.00% -
447.dealII -2.02% 1777992.000 1742026.000 - 0.00% -
470.lbm -1.65% 9723.000 9563.000 - 0.00% -
482.sphinx3 -1.19% 115736.000 114363.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - -4.92% -
462.libquantum -99.25% 13126.000 99.000 - -1.00% -
482.sphinx3 -96.69% 26310.000 870.000 - -0.68% -
450.soplex -96.42% 14429.000 516.000 - -1.34% -
444.namd -94.55% 13495.000 735.000 - 2.94% -
453.povray -93.28% 6857.000 461.000 - 0.44% -
433.milc -91.37% 13482.000 1163.000 - 0.69% -
429.mcf -90.21% 11999.000 1175.000 - -0.42% -
401.bzip2 -82.41% 15683.000 2759.000 - -0.61% -
447.dealII -78.64% 8196.000 1751.000 - -0.28% -
470.lbm -77.24% 13882.000 3160.000 - -0.38% -
471.omnetpp -74.03% 10746.000 2791.000 - 0.25% -
456.hmmer -73.32% 13365.000 3566.000 - -0.08% -
473.astar -66.67% 14262.000 4754.000 - -0.04% -
464.h264ref -64.38% 15493.000 5518.000 - 0.09% -
483.xalancbmk -62.10% 9427.000 3573.000 - -0.47% -
445.gobmk -57.62% 12400.000 5255.000 - -0.51% -
458.sjeng -50.24% 16406.000 8163.000 - 0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.34% 904.000 6.000 - 0.00% -
482.sphinx3 (max) -99.08% 873.000 8.000 - -11.11% -
453.povray (unexplained diff vs previous) -98.46% 130.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -98.15% 108.000 2.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
444.namd (max) -97.62% 882.000 21.000 - 600.00% -
470.lbm (unexplained diff vs previous) -97.59% 497.000 12.000 - -45.45% -
470.lbm (max) -97.53% 769.000 19.000 - -13.64% -
444.namd (unexplained diff vs previous) -97.46% 828.000 21.000 - 0.00% -
482.sphinx3 -97.14% 489.000 14.000 - 0.00% -
482.sphinx3 (avg) -97.14% 489.000 14.000 - 0.00% -
447.dealII (max) -96.90% 129.000 4.000 - 0.00% -
444.namd -96.89% 514.000 16.000 - 6.67% -
444.namd (avg) -96.89% 514.000 16.000 - 6.67% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
447.dealII (unexplained diff vs previous) -95.87% 121.000 5.000 - 0.00% -
433.milc (max) -95.65% 184.000 8.000 - 33.33% -
433.milc (unexplained diff vs previous) -95.60% 182.000 8.000 - 33.33% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -94.74% 0.760 0.040 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - -33.33% -
433.milc -94.12% 136.000 8.000 - 0.00% -
433.milc (avg) -94.12% 136.000 8.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
453.povray -93.55% 93.000 6.000 - 0.00% -
453.povray (avg) -93.55% 93.000 6.000 - 0.00% -
429.mcf (unexplained diff vs previous) -92.54% 67.000 5.000 - 0.00% -
453.povray (max) -92.42% 132.000 10.000 - -9.09% -
471.omnetpp (unexplained diff vs previous) -92.39% 92.000 7.000 - -68.18% -
450.soplex -92.16% 51.000 4.000 - 0.00% -
450.soplex (avg) -92.16% 51.000 4.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -91.67% 60.000 5.000 - -44.44% -
450.soplex (max) -91.46% 82.000 7.000 - 0.00% -
450.soplex (unexplained diff vs previous) -91.46% 82.000 7.000 - 600.00% -
464.h264ref (max) -90.00% 60.000 6.000 - -25.00% -
470.lbm (unexplained diff vs previous) (percentage) -89.39% 3.580 0.380 - -44.93% -
470.lbm (max) (percentage) -88.63% 5.540 0.630 - -10.00% -
447.dealII -87.50% 120.000 15.000 - -6.25% -
447.dealII (avg) -87.50% 120.000 15.000 - -6.25% -
429.mcf (max) -85.07% 67.000 10.000 - -9.09% -
471.omnetpp (max) -84.66% 189.000 29.000 - -9.38% -
473.astar (max) -82.46% 114.000 20.000 - 0.00% -
447.dealII (max) (percentage) -82.28% 1.580 0.280 - 3.70% -
470.lbm -81.68% 322.000 59.000 - -3.28% -
470.lbm (avg) -81.68% 322.000 59.000 - -3.28% -
447.dealII (unexplained diff vs previous) (percentage) -80.41% 1.480 0.290 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -79.94% 3.440 0.690 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -77.37% 1.900 0.430 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -76.92% 0.390 0.090 - -43.75% -
483.xalancbmk (unexplained diff vs previous) -72.13% 61.000 17.000 - 21.43% -
471.omnetpp (unexplained diff vs previous) (percentage) -70.93% 0.860 0.250 - -68.35% -
456.hmmer (max) -70.00% 40.000 12.000 - -14.29% -
464.h264ref (max) (percentage) -69.23% 0.390 0.120 - -25.00% -
482.sphinx3 (max) (percentage) -68.98% 3.320 1.030 - -6.36% -
401.bzip2 (max) -66.67% 48.000 16.000 - 14.29% -
456.hmmer (unexplained diff vs previous) -66.67% 9.000 3.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -65.31% 49.000 17.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -63.41% 41.000 15.000 - 0.00% -
444.namd (max) (percentage) -55.05% 6.540 2.940 - 553.33% -
444.namd (unexplained diff vs previous) (percentage) -53.42% 6.140 2.860 - 0.00% -
483.xalancbmk (max) -50.82% 61.000 30.000 - -9.09% -
433.milc (max) (percentage) -49.64% 1.370 0.690 - 32.69% -
433.milc (unexplained diff vs previous) (percentage) -48.89% 1.350 0.690 - 32.69% -
458.sjeng (max) -47.69% 65.000 34.000 - -2.86% -
473.astar (max) (percentage) -46.25% 0.800 0.430 - -2.27% -
401.bzip2 -44.12% 34.000 19.000 - 0.00% -
401.bzip2 (avg) -44.12% 34.000 19.000 - 0.00% -
444.namd (avg) (percentage) -40.42% 3.810 2.270 - 1.34% -
471.omnetpp (max) (percentage) -40.34% 1.760 1.050 - -11.02% -
447.dealII (avg) (percentage) -38.10% 1.470 0.910 - -5.21% -
458.sjeng (unexplained diff vs previous) (percentage) -28.00% 0.250 0.180 - 0.00% -
433.milc (avg) (percentage) -27.72% 1.010 0.730 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -26.15% 0.650 0.480 - 23.08% -
429.mcf (unexplained diff vs previous) (percentage) -23.21% 0.560 0.430 - 0.00% -
458.sjeng -22.11% 95.000 74.000 - -2.63% -
458.sjeng (avg) -22.11% 95.000 74.000 - -2.63% -
429.mcf -18.87% 53.000 43.000 - -2.27% -
429.mcf (avg) -18.87% 53.000 43.000 - -2.27% -
470.lbm (avg) (percentage) -18.53% 2.320 1.890 - -2.58% -
482.sphinx3 (avg) (percentage) -12.90% 1.860 1.620 - -2.41% -
445.gobmk (max) -10.34% 29.000 26.000 - 36.84% -
445.gobmk (unexplained diff vs previous) -10.00% 30.000 27.000 - 0.00% -


Report Time: 0.36s
Name Current %
401.bzip2 2759.000 -
403.gcc 58.000 -4.92%
429.mcf 1175.000 -
433.milc 1163.000 -
444.namd 735.000 2.94%
445.gobmk 5255.000 -
447.dealII 1751.000 -
450.soplex 516.000 -1.34%
453.povray 461.000 -
456.hmmer 3566.000 -
458.sjeng 8163.000 -
462.libquantum 99.000 -1.00%
464.h264ref 5518.000 -
470.lbm 3160.000 -
471.omnetpp 2791.000 -
473.astar 4754.000 -
482.sphinx3 870.000 -
483.xalancbmk 3573.000 -
Geometric Mean 1442.263 -
Name Current %
401.bzip2 41817.000 -
403.gcc 1961341.000 -
429.mcf 7922.000 -
433.milc 72883.000 -
444.namd 174634.000 -
445.gobmk 1309912.000 -
447.dealII 1742026.000 -
450.soplex 202143.000 -
453.povray 573843.000 -
456.hmmer 166635.000 -
458.sjeng 97097.000 -
462.libquantum 25049.000 -
464.h264ref 352103.000 -
470.lbm 9563.000 -
471.omnetpp 376599.000 -
473.astar 23051.000 -
482.sphinx3 114363.000 -
483.xalancbmk 2287201.000 -
Geometric Mean 163251.506 -
Name Current %
401.bzip2 19.000 -
401.bzip2 (avg) 19.000 -
401.bzip2 (avg) (percentage) 0.690 -
401.bzip2 (max) 16.000 14.29%
401.bzip2 (max) (percentage) 0.610 15.09%
401.bzip2 (unexplained diff vs previous) 17.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.620 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.140 -
403.gcc (max) 2.000 -33.33%
403.gcc (max) (percentage) 5.000 -1.57%
429.mcf 43.000 -2.27%
429.mcf (avg) 43.000 -2.27%
429.mcf (avg) (percentage) 3.700 -2.89%
429.mcf (max) 10.000 -9.09%
429.mcf (max) (percentage) 0.880 -8.33%
429.mcf (unexplained diff vs previous) 5.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.430 -
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.730 -
433.milc (max) 8.000 33.33%
433.milc (max) (percentage) 0.690 32.69%
433.milc (unexplained diff vs previous) 8.000 33.33%
433.milc (unexplained diff vs previous) (percentage) 0.690 32.69%
444.namd 16.000 6.67%
444.namd (avg) 16.000 6.67%
444.namd (avg) (percentage) 2.270 1.34%
444.namd (max) 21.000 600.00%
444.namd (max) (percentage) 2.940 553.33%
444.namd (unexplained diff vs previous) 21.000 -
444.namd (unexplained diff vs previous) (percentage) 2.860 -
445.gobmk 42.000 -2.33%
445.gobmk (avg) 42.000 -2.33%
445.gobmk (avg) (percentage) 0.810 -
445.gobmk (max) 26.000 36.84%
445.gobmk (max) (percentage) 0.510 41.67%
445.gobmk (unexplained diff vs previous) 27.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.510 -
447.dealII 15.000 -6.25%
447.dealII (avg) 15.000 -6.25%
447.dealII (avg) (percentage) 0.910 -5.21%
447.dealII (max) 4.000 -
447.dealII (max) (percentage) 0.280 3.70%
447.dealII (unexplained diff vs previous) 5.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.290 -
450.soplex 4.000 -
450.soplex (avg) 4.000 -
450.soplex (avg) (percentage) 0.910 2.25%
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.460 -3.95%
450.soplex (unexplained diff vs previous) 7.000 600.00%
450.soplex (unexplained diff vs previous) (percentage) 1.360 615.79%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.400 -4.11%
453.povray (max) 10.000 -9.09%
453.povray (max) (percentage) 2.290 -6.53%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.430 -
456.hmmer 51.000 -3.77%
456.hmmer (avg) 51.000 -3.77%
456.hmmer (avg) (percentage) 1.450 -3.97%
456.hmmer (max) 12.000 -14.29%
456.hmmer (max) (percentage) 0.340 -15.00%
456.hmmer (unexplained diff vs previous) 3.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.080 -
458.sjeng 74.000 -2.63%
458.sjeng (avg) 74.000 -2.63%
458.sjeng (avg) (percentage) 0.910 -3.19%
458.sjeng (max) 34.000 -2.86%
458.sjeng (max) (percentage) 0.420 -2.33%
458.sjeng (unexplained diff vs previous) 15.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.180 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.520 -1.30%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.460 -2.67%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -
464.h264ref 52.000 -3.70%
464.h264ref (avg) 52.000 -3.70%
464.h264ref (avg) (percentage) 0.960 -3.03%
464.h264ref (max) 6.000 -25.00%
464.h264ref (max) (percentage) 0.120 -25.00%
464.h264ref (unexplained diff vs previous) 5.000 -44.44%
464.h264ref (unexplained diff vs previous) (percentage) 0.090 -43.75%
470.lbm 59.000 -3.28%
470.lbm (avg) 59.000 -3.28%
470.lbm (avg) (percentage) 1.890 -2.58%
470.lbm (max) 19.000 -13.64%
470.lbm (max) (percentage) 0.630 -10.00%
470.lbm (unexplained diff vs previous) 12.000 -45.45%
470.lbm (unexplained diff vs previous) (percentage) 0.380 -44.93%
471.omnetpp 90.000 -2.17%
471.omnetpp (avg) 90.000 -2.17%
471.omnetpp (avg) (percentage) 3.230 -2.71%
471.omnetpp (max) 29.000 -9.38%
471.omnetpp (max) (percentage) 1.050 -11.02%
471.omnetpp (unexplained diff vs previous) 7.000 -68.18%
471.omnetpp (unexplained diff vs previous) (percentage) 0.250 -68.35%
473.astar 137.000 -4.20%
473.astar (avg) 137.000 -4.20%
473.astar (avg) (percentage) 2.900 -3.97%
473.astar (max) 20.000 -
473.astar (max) (percentage) 0.430 -2.27%
473.astar (unexplained diff vs previous) 2.000 -
473.astar (unexplained diff vs previous) (percentage) 0.040 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.620 -2.41%
482.sphinx3 (max) 8.000 -11.11%
482.sphinx3 (max) (percentage) 1.030 -6.36%
482.sphinx3 (unexplained diff vs previous) 6.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.690 -
483.xalancbmk 128.000 -3.76%
483.xalancbmk (avg) 128.000 -3.76%
483.xalancbmk (avg) (percentage) 3.610 -3.22%
483.xalancbmk (max) 30.000 -9.09%
483.xalancbmk (max) (percentage) 0.860 -8.51%
483.xalancbmk (unexplained diff vs previous) 17.000 21.43%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.480 23.08%
Geometric Mean 3.949 -17.53%