Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7ec4f6094e54911794c142b5d88496a220d807d6 (+ 825 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/103/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0103 (llvmorg-18-init-13534-g7ec4f6094e54) 2023-11-28T07:09:29 0:00:00
Previous 0102 (llvmorg-18-init-12709-g1a0888778448) 2023-11-23T16:07:46 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 29
Performance Improvements 76 118
Added Tests 4 0
Unchanged Tests 681 633
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.64% 55.000 57.000 - -99.37% -
401.bzip2 1.20% 2657.000 2689.000 - -82.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 220.00% 10.000 32.000 - -34.69% -
401.bzip2 (unexplained diff vs previous) (percentage) 213.16% 0.380 1.190 - 283.87% -
401.bzip2 (max) 88.24% 17.000 32.000 - -33.33% -
401.bzip2 (max) (percentage) 79.10% 0.670 1.200 - 287.10% -
433.milc (unexplained diff vs previous) 50.00% 2.000 3.000 - -98.35% -
433.milc (unexplained diff vs previous) (percentage) 44.44% 0.180 0.260 - -80.74% -
471.omnetpp (unexplained diff vs previous) (percentage) 27.13% 1.290 1.640 - 90.70% -
471.omnetpp (max) (percentage) 25.78% 1.280 1.610 - -8.52% -
471.omnetpp (max) 25.71% 35.000 44.000 - -76.72% -
471.omnetpp (unexplained diff vs previous) 25.00% 36.000 45.000 - -51.09% -
464.h264ref (max) 22.73% 22.000 27.000 - -55.00% -
464.h264ref (max) (percentage) 21.95% 0.410 0.500 - 28.21% -
464.h264ref (unexplained diff vs previous) (percentage) 21.95% 0.410 0.500 - 28.21% -
464.h264ref (unexplained diff vs previous) 21.74% 23.000 28.000 - -53.33% -
401.bzip2 6.67% 15.000 16.000 - -52.94% -
401.bzip2 (avg) 6.67% 15.000 16.000 - -52.94% -
401.bzip2 (avg) (percentage) 3.45% 0.580 0.600 - 172.73% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.61% 2787.000 2742.000 - -74.48% -
453.povray -1.47% 475.000 468.000 - -93.17% -
444.namd -1.25% 721.000 712.000 - -94.72% -
447.dealII -1.05% 1802.000 1783.000 - -78.25% -
462.libquantum -1.00% 100.000 99.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) -94.29% 0.700 0.040 - -94.74% -
473.astar (unexplained diff vs previous) -94.12% 34.000 2.000 - -98.15% -
456.hmmer (unexplained diff vs previous) -90.91% 11.000 1.000 - -88.89% -
456.hmmer (unexplained diff vs previous) (percentage) -90.32% 0.310 0.030 - -57.14% -
482.sphinx3 (unexplained diff vs previous) (percentage) -87.78% 0.900 0.110 - -96.80% -
482.sphinx3 (unexplained diff vs previous) -87.50% 8.000 1.000 - -99.89% -
470.lbm (unexplained diff vs previous) -84.62% 26.000 4.000 - -99.20% -
470.lbm (unexplained diff vs previous) (percentage) -84.15% 0.820 0.130 - -96.37% -
450.soplex (unexplained diff vs previous) -80.00% 5.000 1.000 - -98.78% -
450.soplex (unexplained diff vs previous) (percentage) -80.00% 0.950 0.190 - -66.67% -
429.mcf (max) -66.67% 9.000 3.000 - -95.52% -
429.mcf (max) (percentage) -58.97% 0.780 0.320 - -42.86% -
462.libquantum (max) -50.00% 2.000 1.000 - -96.15% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -49.50% 2.000 1.010 - 741.67% -
473.astar (max) (percentage) -46.94% 0.980 0.520 - -35.00% -
473.astar (max) -46.81% 47.000 25.000 - -78.07% -
429.mcf (unexplained diff vs previous) -40.00% 5.000 3.000 - -95.52% -
429.mcf (unexplained diff vs previous) (percentage) -39.53% 0.430 0.260 - -53.57% -
444.namd (max) -38.46% 13.000 8.000 - -99.09% -
444.namd (max) (percentage) -32.80% 1.860 1.250 - -80.89% -
470.lbm (max) -26.92% 26.000 19.000 - -97.53% -
470.lbm (max) (percentage) -25.61% 0.820 0.610 - -88.99% -
482.sphinx3 (max) (percentage) -25.27% 0.910 0.680 - -79.52% -
462.libquantum (max) (percentage) -25.00% 2.040 1.530 - 665.00% -
482.sphinx3 (max) -25.00% 8.000 6.000 - -99.31% -
456.hmmer (max) -18.18% 11.000 9.000 - -77.50% -
453.povray (max) -16.67% 6.000 5.000 - -96.21% -
450.soplex (max) (percentage) -11.40% 1.140 1.010 - 77.19% -
456.hmmer (max) (percentage) -9.68% 0.310 0.280 - -6.67% -
444.namd -7.69% 13.000 12.000 - -97.67% -
444.namd (avg) -7.69% 13.000 12.000 - -97.67% -
447.dealII -7.14% 14.000 13.000 - -89.17% -
447.dealII (avg) -7.14% 14.000 13.000 - -89.17% -
445.gobmk (max) (percentage) -5.26% 0.380 0.360 - 50.00% -
445.gobmk (max) -5.00% 20.000 19.000 - -34.48% -
453.povray (max) (percentage) -4.58% 1.310 1.250 - -35.23% -
483.xalancbmk (max) (percentage) -4.55% 0.660 0.630 - -3.08% -
483.xalancbmk (max) -4.35% 23.000 22.000 - -63.93% -
483.xalancbmk (unexplained diff vs previous) -4.17% 24.000 23.000 - -62.30% -
458.sjeng -3.85% 52.000 50.000 - -47.37% -
458.sjeng (avg) -3.85% 52.000 50.000 - -47.37% -
445.gobmk (avg) (percentage) -3.45% 0.580 0.560 - 211.11% -
445.gobmk -3.33% 30.000 29.000 - 31.82% -
445.gobmk (avg) -3.33% 30.000 29.000 - 31.82% -
473.astar -3.30% 91.000 88.000 - 23.94% -
473.astar (avg) -3.30% 91.000 88.000 - 23.94% -
458.sjeng (avg) (percentage) -3.13% 0.640 0.620 - 6.90% -
456.hmmer (avg) (percentage) -3.03% 0.990 0.960 - 166.67% -
483.xalancbmk (unexplained diff vs previous) (percentage) -3.03% 0.660 0.640 - -1.54% -
456.hmmer -2.86% 35.000 34.000 - -29.17% -
456.hmmer (avg) -2.86% 35.000 34.000 - -29.17% -
447.dealII (max) (percentage) -2.86% 0.700 0.680 - -56.96% -
473.astar (avg) (percentage) -2.67% 1.870 1.820 - 264.00% -
483.xalancbmk -2.50% 80.000 78.000 - 65.96% -
483.xalancbmk (avg) -2.50% 80.000 78.000 - 65.96% -
482.sphinx3 (avg) (percentage) -2.46% 1.220 1.190 - -36.02% -
429.mcf (avg) (percentage) -2.42% 2.480 2.420 - 437.78% -
464.h264ref -2.38% 42.000 41.000 - -19.61% -
464.h264ref (avg) -2.38% 42.000 41.000 - -19.61% -
470.lbm -2.38% 42.000 41.000 - -87.27% -
470.lbm (avg) -2.38% 42.000 41.000 - -87.27% -
470.lbm (avg) (percentage) -2.26% 1.330 1.300 - -43.97% -
450.soplex (avg) (percentage) -1.98% 1.010 0.990 - 175.00% -
483.xalancbmk (avg) (percentage) -1.80% 2.220 2.180 - 336.00% -
433.milc (avg) (percentage) -1.69% 0.590 0.580 - -42.57% -
471.omnetpp -1.56% 64.000 63.000 - -24.10% -
471.omnetpp (avg) -1.56% 64.000 63.000 - -24.10% -
464.h264ref (avg) (percentage) -1.32% 0.760 0.750 - 127.27% -
444.namd (avg) (percentage) -1.10% 1.820 1.800 - -52.76% -
403.gcc (max) (percentage) -1.06% 3.760 3.720 - 878.95% -

Added Tests - sample variability
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.50% 198708.000 201698.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 878.95% 0.380 3.720 - -1.06% -
462.libquantum (avg) (percentage) 780.00% 0.150 1.320 - -0.75% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - -49.50% -
462.libquantum (max) (percentage) 665.00% 0.200 1.530 - -25.00% -
403.gcc (avg) (percentage) 454.17% 0.480 2.660 - 0.00% -
429.mcf (avg) (percentage) 437.78% 0.450 2.420 - -2.42% -
483.xalancbmk (avg) (percentage) 336.00% 0.500 2.180 - -1.80% -
401.bzip2 (max) (percentage) 287.10% 0.310 1.200 - 79.10% -
401.bzip2 (unexplained diff vs previous) (percentage) 283.87% 0.310 1.190 - 213.16% -
473.astar (avg) (percentage) 264.00% 0.500 1.820 - -2.67% -
445.gobmk (avg) (percentage) 211.11% 0.180 0.560 - -3.45% -
471.omnetpp (avg) (percentage) 196.15% 0.780 2.310 - -0.86% -
450.soplex (avg) (percentage) 175.00% 0.360 0.990 - -1.98% -
401.bzip2 (avg) (percentage) 172.73% 0.220 0.600 - 3.45% -
456.hmmer (avg) (percentage) 166.67% 0.360 0.960 - -3.03% -
464.h264ref (avg) (percentage) 127.27% 0.330 0.750 - -1.32% -
471.omnetpp (unexplained diff vs previous) (percentage) 90.70% 0.860 1.640 - 27.13% -
450.soplex (max) (percentage) 77.19% 0.570 1.010 - -11.40% -
483.xalancbmk 65.96% 47.000 78.000 - -2.50% -
483.xalancbmk (avg) 65.96% 47.000 78.000 - -2.50% -
445.gobmk (max) (percentage) 50.00% 0.240 0.360 - -5.26% -
445.gobmk 31.82% 22.000 29.000 - -3.33% -
445.gobmk (avg) 31.82% 22.000 29.000 - -3.33% -
464.h264ref (max) (percentage) 28.21% 0.390 0.500 - 21.95% -
464.h264ref (unexplained diff vs previous) (percentage) 28.21% 0.390 0.500 - 21.95% -
473.astar 23.94% 71.000 88.000 - -3.30% -
473.astar (avg) 23.94% 71.000 88.000 - -3.30% -
458.sjeng (avg) (percentage) 6.90% 0.580 0.620 - -3.13% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.36% 26756.000 24251.000 - 0.00% -
401.bzip2 -2.82% 39458.000 38345.000 - 0.00% -
453.povray -2.71% 593097.000 577022.000 - 0.00% -
433.milc -2.56% 74971.000 73050.000 - 0.00% -
447.dealII -1.84% 1777992.000 1745287.000 - -0.00% -
444.namd -1.34% 175160.000 172817.000 - 0.00% -
482.sphinx3 -1.25% 115736.000 114291.000 - 0.00% -
456.hmmer -1.05% 168072.000 166310.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.37% 9099.000 57.000 - 3.64% -
462.libquantum -99.25% 13126.000 99.000 - -1.00% -
482.sphinx3 -96.63% 26310.000 887.000 - -0.11% -
450.soplex -96.37% 14429.000 524.000 - -0.19% -
444.namd -94.72% 13495.000 712.000 - -1.25% -
453.povray -93.17% 6857.000 468.000 - -1.47% -
433.milc -91.57% 13482.000 1136.000 - -0.26% -
429.mcf -90.29% 11999.000 1165.000 - 0.26% -
401.bzip2 -82.85% 15683.000 2689.000 - 1.20% -
447.dealII -78.25% 8196.000 1783.000 - -1.05% -
470.lbm -77.09% 13882.000 3180.000 - -0.13% -
471.omnetpp -74.48% 10746.000 2742.000 - -1.61% -
456.hmmer -73.28% 13365.000 3571.000 - -0.03% -
473.astar -65.83% 14262.000 4874.000 - 0.04% -
464.h264ref -63.87% 15493.000 5598.000 - 0.50% -
483.xalancbmk -61.68% 9427.000 3612.000 - -0.63% -
445.gobmk -57.33% 12400.000 5291.000 - -0.08% -
458.sjeng -50.29% 16406.000 8155.000 - 0.01% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 904.000 1.000 - -87.50% -
482.sphinx3 (max) -99.31% 873.000 6.000 - -25.00% -
470.lbm (unexplained diff vs previous) -99.20% 497.000 4.000 - -84.62% -
444.namd (max) -99.09% 882.000 8.000 - -38.46% -
444.namd (unexplained diff vs previous) -98.91% 828.000 9.000 - 0.00% -
450.soplex (unexplained diff vs previous) -98.78% 82.000 1.000 - -80.00% -
433.milc (unexplained diff vs previous) -98.35% 182.000 3.000 - 50.00% -
473.astar (unexplained diff vs previous) -98.15% 108.000 2.000 - -94.12% -
482.sphinx3 -97.96% 489.000 10.000 - 0.00% -
482.sphinx3 (avg) -97.96% 489.000 10.000 - 0.00% -
433.milc (max) -97.83% 184.000 4.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
444.namd -97.67% 514.000 12.000 - -7.69% -
444.namd (avg) -97.67% 514.000 12.000 - -7.69% -
458.sjeng (unexplained diff vs previous) -97.56% 41.000 1.000 - 0.00% -
470.lbm (max) -97.53% 769.000 19.000 - -26.92% -
482.sphinx3 (unexplained diff vs previous) (percentage) -96.80% 3.440 0.110 - -87.78% -
470.lbm (unexplained diff vs previous) (percentage) -96.37% 3.580 0.130 - -84.15% -
453.povray (max) -96.21% 132.000 5.000 - -16.67% -
462.libquantum (max) -96.15% 26.000 1.000 - -50.00% -
458.sjeng (unexplained diff vs previous) (percentage) -96.00% 0.250 0.010 - 0.00% -
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
429.mcf (max) -95.52% 67.000 3.000 - -66.67% -
429.mcf (unexplained diff vs previous) -95.52% 67.000 3.000 - -40.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -94.74% 0.760 0.040 - -94.29% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
450.soplex (max) -93.90% 82.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -50.00% -
447.dealII (max) -90.70% 129.000 12.000 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII -89.17% 120.000 13.000 - -7.14% -
447.dealII (avg) -89.17% 120.000 13.000 - -7.14% -
470.lbm (max) (percentage) -88.99% 5.540 0.610 - -25.61% -
456.hmmer (unexplained diff vs previous) -88.89% 9.000 1.000 - -90.91% -
458.sjeng (max) -87.69% 65.000 8.000 - 0.00% -
470.lbm -87.27% 322.000 41.000 - -2.38% -
470.lbm (avg) -87.27% 322.000 41.000 - -2.38% -
445.gobmk (unexplained diff vs previous) -86.67% 30.000 4.000 - 0.00% -
444.namd (max) (percentage) -80.89% 6.540 1.250 - -32.80% -
433.milc (unexplained diff vs previous) (percentage) -80.74% 1.350 0.260 - 44.44% -
482.sphinx3 (max) (percentage) -79.52% 3.320 0.680 - -25.27% -
444.namd (unexplained diff vs previous) (percentage) -79.48% 6.140 1.260 - 0.80% -
473.astar (max) -78.07% 114.000 25.000 - -46.81% -
456.hmmer (max) -77.50% 40.000 9.000 - -18.18% -
471.omnetpp (max) -76.72% 189.000 44.000 - 25.71% -
433.milc (max) (percentage) -72.99% 1.370 0.370 - 0.00% -
458.sjeng (max) (percentage) -72.50% 0.400 0.110 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.240 0.080 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -66.67% 0.570 0.190 - -80.00% -
483.xalancbmk (max) -63.93% 61.000 22.000 - -4.35% -
483.xalancbmk (unexplained diff vs previous) -62.30% 61.000 23.000 - -4.17% -
456.hmmer (unexplained diff vs previous) (percentage) -57.14% 0.070 0.030 - -90.32% -
447.dealII (max) (percentage) -56.96% 1.580 0.680 - -2.86% -
464.h264ref (max) -55.00% 60.000 27.000 - 22.73% -
429.mcf (unexplained diff vs previous) (percentage) -53.57% 0.560 0.260 - -39.53% -
464.h264ref (unexplained diff vs previous) -53.33% 60.000 28.000 - 21.74% -
401.bzip2 -52.94% 34.000 16.000 - 6.67% -
401.bzip2 (avg) -52.94% 34.000 16.000 - 6.67% -
444.namd (avg) (percentage) -52.76% 3.810 1.800 - -1.10% -
471.omnetpp (unexplained diff vs previous) -51.09% 92.000 45.000 - 25.00% -
458.sjeng -47.37% 95.000 50.000 - -3.85% -
458.sjeng (avg) -47.37% 95.000 50.000 - -3.85% -
429.mcf -47.17% 53.000 28.000 - 0.00% -
429.mcf (avg) -47.17% 53.000 28.000 - 0.00% -
447.dealII (avg) (percentage) -46.94% 1.470 0.780 - 0.00% -
470.lbm (avg) (percentage) -43.97% 2.320 1.300 - -2.26% -
429.mcf (max) (percentage) -42.86% 0.560 0.320 - -58.97% -
433.milc (avg) (percentage) -42.57% 1.010 0.580 - -1.69% -
482.sphinx3 (avg) (percentage) -36.02% 1.860 1.190 - -2.46% -
453.povray (max) (percentage) -35.23% 1.930 1.250 - -4.58% -
473.astar (max) (percentage) -35.00% 0.800 0.520 - -46.94% -
401.bzip2 (unexplained diff vs previous) -34.69% 49.000 32.000 - 220.00% -
445.gobmk (max) -34.48% 29.000 19.000 - -5.00% -
401.bzip2 (max) -33.33% 48.000 32.000 - 88.24% -
456.hmmer -29.17% 48.000 34.000 - -2.86% -
456.hmmer (avg) -29.17% 48.000 34.000 - -2.86% -
471.omnetpp -24.10% 83.000 63.000 - -1.56% -
471.omnetpp (avg) -24.10% 83.000 63.000 - -1.56% -
464.h264ref -19.61% 51.000 41.000 - -2.38% -
464.h264ref (avg) -19.61% 51.000 41.000 - -2.38% -
453.povray (avg) (percentage) -11.68% 1.370 1.210 - 0.00% -
471.omnetpp (max) (percentage) -8.52% 1.760 1.610 - 25.78% -
456.hmmer (max) (percentage) -6.67% 0.300 0.280 - -9.68% -
483.xalancbmk (max) (percentage) -3.08% 0.650 0.630 - -4.55% -
483.xalancbmk (unexplained diff vs previous) (percentage) -1.54% 0.650 0.640 - -3.03% -


Report Time: 0.36s
Name Current %
401.bzip2 2689.000 1.20%
403.gcc 57.000 3.64%
429.mcf 1165.000 -
433.milc 1136.000 -
444.namd 712.000 -1.25%
445.gobmk 5291.000 -
447.dealII 1783.000 -1.05%
450.soplex 524.000 -
453.povray 468.000 -1.47%
456.hmmer 3571.000 -
458.sjeng 8155.000 -
462.libquantum 99.000 -1.00%
464.h264ref 5598.000 -
470.lbm 3180.000 -
471.omnetpp 2742.000 -1.61%
473.astar 4874.000 -
482.sphinx3 887.000 -
483.xalancbmk 3612.000 -
Geometric Mean 1442.826 -
Name Current %
401.bzip2 38345.000 -
403.gcc 1958313.000 -
429.mcf 7842.000 -
433.milc 73050.000 -
444.namd 172817.000 -
445.gobmk 1310240.000 -
447.dealII 1745287.000 -
450.soplex 201698.000 -
453.povray 577022.000 -
456.hmmer 166310.000 -
458.sjeng 97081.000 -
462.libquantum 24251.000 -
464.h264ref 353910.000 -
470.lbm 9702.000 -
471.omnetpp 376707.000 -
473.astar 23375.000 -
482.sphinx3 114291.000 -
483.xalancbmk 2284916.000 -
Geometric Mean 162316.125 -
Name Current %
401.bzip2 16.000 6.67%
401.bzip2 (avg) 16.000 6.67%
401.bzip2 (avg) (percentage) 0.600 3.45%
401.bzip2 (max) 32.000 88.24%
401.bzip2 (max) (percentage) 1.200 79.10%
401.bzip2 (unexplained diff vs previous) 32.000 220.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.190 213.16%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.660 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.720 -1.06%
429.mcf 28.000 -
429.mcf (avg) 28.000 -
429.mcf (avg) (percentage) 2.420 -2.42%
429.mcf (max) 3.000 -66.67%
429.mcf (max) (percentage) 0.320 -58.97%
429.mcf (unexplained diff vs previous) 3.000 -40.00%
429.mcf (unexplained diff vs previous) (percentage) 0.260 -39.53%
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.580 -1.69%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.370 -
433.milc (unexplained diff vs previous) 3.000 50.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 44.44%
444.namd 12.000 -7.69%
444.namd (avg) 12.000 -7.69%
444.namd (avg) (percentage) 1.800 -1.10%
444.namd (max) 8.000 -38.46%
444.namd (max) (percentage) 1.250 -32.80%
444.namd (unexplained diff vs previous) 9.000 -
444.namd (unexplained diff vs previous) (percentage) 1.260 -
445.gobmk 29.000 -3.33%
445.gobmk (avg) 29.000 -3.33%
445.gobmk (avg) (percentage) 0.560 -3.45%
445.gobmk (max) 19.000 -5.00%
445.gobmk (max) (percentage) 0.360 -5.26%
445.gobmk (unexplained diff vs previous) 4.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.080 -
447.dealII 13.000 -7.14%
447.dealII (avg) 13.000 -7.14%
447.dealII (avg) (percentage) 0.780 -
447.dealII (max) 12.000 -
447.dealII (max) (percentage) 0.680 -2.86%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 0.990 -1.98%
450.soplex (max) 5.000 -
450.soplex (max) (percentage) 1.010 -11.40%
450.soplex (unexplained diff vs previous) 1.000 -80.00%
450.soplex (unexplained diff vs previous) (percentage) 0.190 -80.00%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.210 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.250 -4.58%
456.hmmer 34.000 -2.86%
456.hmmer (avg) 34.000 -2.86%
456.hmmer (avg) (percentage) 0.960 -3.03%
456.hmmer (max) 9.000 -18.18%
456.hmmer (max) (percentage) 0.280 -9.68%
456.hmmer (unexplained diff vs previous) 1.000 -90.91%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -90.32%
458.sjeng 50.000 -3.85%
458.sjeng (avg) 50.000 -3.85%
458.sjeng (avg) (percentage) 0.620 -3.13%
458.sjeng (max) 8.000 -
458.sjeng (max) (percentage) 0.110 -
458.sjeng (unexplained diff vs previous) 1.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.320 -
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.530 -25.00%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -49.50%
464.h264ref 41.000 -2.38%
464.h264ref (avg) 41.000 -2.38%
464.h264ref (avg) (percentage) 0.750 -1.32%
464.h264ref (max) 27.000 22.73%
464.h264ref (max) (percentage) 0.500 21.95%
464.h264ref (unexplained diff vs previous) 28.000 21.74%
464.h264ref (unexplained diff vs previous) (percentage) 0.500 21.95%
470.lbm 41.000 -2.38%
470.lbm (avg) 41.000 -2.38%
470.lbm (avg) (percentage) 1.300 -2.26%
470.lbm (max) 19.000 -26.92%
470.lbm (max) (percentage) 0.610 -25.61%
470.lbm (unexplained diff vs previous) 4.000 -84.62%
470.lbm (unexplained diff vs previous) (percentage) 0.130 -84.15%
471.omnetpp 63.000 -1.56%
471.omnetpp (avg) 63.000 -1.56%
471.omnetpp (avg) (percentage) 2.310 -
471.omnetpp (max) 44.000 25.71%
471.omnetpp (max) (percentage) 1.610 25.78%
471.omnetpp (unexplained diff vs previous) 45.000 25.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.640 27.13%
473.astar 88.000 -3.30%
473.astar (avg) 88.000 -3.30%
473.astar (avg) (percentage) 1.820 -2.67%
473.astar (max) 25.000 -46.81%
473.astar (max) (percentage) 0.520 -46.94%
473.astar (unexplained diff vs previous) 2.000 -94.12%
473.astar (unexplained diff vs previous) (percentage) 0.040 -94.29%
482.sphinx3 10.000 -
482.sphinx3 (avg) 10.000 -
482.sphinx3 (avg) (percentage) 1.190 -2.46%
482.sphinx3 (max) 6.000 -25.00%
482.sphinx3 (max) (percentage) 0.680 -25.27%
482.sphinx3 (unexplained diff vs previous) 1.000 -87.50%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -87.78%
483.xalancbmk 78.000 -2.50%
483.xalancbmk (avg) 78.000 -2.50%
483.xalancbmk (avg) (percentage) 2.180 -1.80%
483.xalancbmk (max) 22.000 -4.35%
483.xalancbmk (max) (percentage) 0.630 -4.55%
483.xalancbmk (unexplained diff vs previous) 23.000 -4.17%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.640 -3.03%
Geometric Mean 3.057 -26.85%