Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/011ba725070360341f5473e88ebb4c956574805f (+ 436 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/104/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0104 (llvmorg-18-init-16967-g011ba7250703) 2024-01-05T17:14:19 0:00:00
Previous 0103 (llvmorg-18-init-16531-gaf1fdcc343d1) 2023-12-30T01:55:50 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 32 22
Performance Improvements 54 116
Added Tests 16 8
Unchanged Tests 678 634
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 2.66% 526.000 540.000 - -96.43% -
453.povray 1.81% 496.000 505.000 - -92.77% -
444.namd 1.36% 809.000 820.000 - -93.39% -
433.milc 1.22% 1148.000 1162.000 - -91.46% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) (percentage) 387.50% 0.080 0.390 - 0.00% -
464.h264ref (unexplained diff vs previous) 360.00% 5.000 23.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 264.76% 1.050 3.830 - 38200.00% -
470.lbm (unexplained diff vs previous) (percentage) 258.33% 0.120 0.430 - -92.90% -
433.milc (max) 250.00% 4.000 14.000 - -87.04% -
462.libquantum (unexplained diff vs previous) 250.00% 2.000 7.000 - 600.00% -
470.lbm (unexplained diff vs previous) 240.00% 5.000 17.000 - -97.89% -
470.lbm (max) (percentage) 223.08% 0.130 0.420 - -92.66% -
470.lbm (max) 220.00% 5.000 16.000 - -97.89% -
433.milc (max) (percentage) 190.48% 0.420 1.220 - 52.50% -
473.astar (unexplained diff vs previous) (percentage) 125.00% 0.040 0.090 - -55.00% -
462.libquantum (max) 100.00% 3.000 6.000 - -99.35% -
473.astar (unexplained diff vs previous) 100.00% 2.000 4.000 - -84.00% -
464.h264ref (max) 91.67% 12.000 23.000 - -61.67% -
464.h264ref (max) (percentage) 85.71% 0.210 0.390 - -7.14% -
401.bzip2 (max) 83.33% 12.000 22.000 - -96.39% -
462.libquantum (max) (percentage) 82.18% 2.020 3.680 - -42.32% -
401.bzip2 (max) (percentage) 79.07% 0.430 0.770 - -79.63% -
444.namd (max) 37.50% 8.000 11.000 - -98.90% -
444.namd (max) (percentage) 23.64% 1.100 1.360 - -83.19% -
458.sjeng (max) (percentage) 7.41% 0.270 0.290 - -94.36% -
453.povray (avg) (percentage) 6.82% 0.880 0.940 - 17.50% -
401.bzip2 5.88% 17.000 18.000 - -82.69% -
401.bzip2 (avg) 5.88% 17.000 18.000 - -82.69% -
458.sjeng (max) 4.55% 22.000 23.000 - -97.37% -
462.libquantum (avg) (percentage) 4.52% 1.550 1.620 - 110.39% -
450.soplex (avg) (percentage) 4.35% 1.150 1.200 - 140.00% -
433.milc (avg) (percentage) 3.17% 0.630 0.650 - -24.42% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -3.68% 190.000 183.000 - -98.73% -
403.gcc -1.75% 57.000 56.000 - -99.41% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -89.66% 29.000 3.000 - -97.09% -
471.omnetpp (unexplained diff vs previous) (percentage) -89.32% 1.030 0.110 - -88.78% -
429.mcf (unexplained diff vs previous) -42.86% 7.000 4.000 - -81.82% -
429.mcf (unexplained diff vs previous) (percentage) -42.62% 0.610 0.350 - 118.75% -
483.xalancbmk (unexplained diff vs previous) -40.00% 10.000 6.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -40.00% 0.300 0.180 - 0.00% -
456.hmmer (unexplained diff vs previous) -33.33% 21.000 14.000 - -69.57% -
456.hmmer (unexplained diff vs previous) (percentage) -32.73% 0.550 0.370 - -5.13% -
450.soplex (unexplained diff vs previous) (percentage) -24.27% 3.420 2.590 - 463.04% -
450.soplex (unexplained diff vs previous) -22.22% 18.000 14.000 - -79.71% -
471.omnetpp (max) (percentage) -16.67% 1.020 0.850 - -90.84% -
482.sphinx3 (max) -16.67% 12.000 10.000 - -98.87% -
456.hmmer (max) (percentage) -16.36% 0.550 0.460 - -95.61% -
456.hmmer (max) -15.00% 20.000 17.000 - -98.63% -
471.omnetpp (max) -14.29% 28.000 24.000 - -97.53% -
482.sphinx3 (max) (percentage) -13.93% 1.220 1.050 - -68.28% -
450.soplex (max) (percentage) -12.39% 3.310 2.900 - 75.76% -
450.soplex (max) -11.76% 17.000 15.000 - -93.98% -
429.mcf (max) (percentage) -11.11% 0.990 0.880 - -94.60% -
447.dealII (max) -11.11% 9.000 8.000 - -96.41% -
453.povray (max) -10.00% 10.000 9.000 - -64.00% -
483.xalancbmk (max) -9.52% 21.000 19.000 - -98.43% -
483.xalancbmk (max) (percentage) -9.38% 0.640 0.580 - -95.50% -
429.mcf (max) -9.09% 11.000 10.000 - -99.56% -
445.gobmk (max) -9.09% 11.000 10.000 - -97.58% -
473.astar (max) -5.88% 17.000 16.000 - -98.05% -
473.astar (max) (percentage) -5.41% 0.370 0.350 - -94.78% -
473.astar -4.76% 42.000 40.000 - -64.29% -
473.astar (avg) -4.76% 42.000 40.000 - -64.29% -
445.gobmk (max) (percentage) -4.35% 0.230 0.220 - -94.10% -
447.dealII (max) (percentage) -4.26% 0.470 0.450 - -81.09% -
429.mcf -4.17% 24.000 23.000 - -92.23% -
429.mcf (avg) -4.17% 24.000 23.000 - -92.23% -
453.povray (max) (percentage) -3.41% 2.050 1.980 - 450.00% -
473.astar (avg) (percentage) -3.33% 0.900 0.870 - -5.43% -
482.sphinx3 (avg) (percentage) -3.12% 0.960 0.930 - -46.55% -
471.omnetpp -2.99% 67.000 65.000 - -61.08% -
471.omnetpp (avg) -2.99% 67.000 65.000 - -61.08% -
483.xalancbmk -2.78% 72.000 70.000 - -64.65% -
483.xalancbmk (avg) -2.78% 72.000 70.000 - -64.65% -
483.xalancbmk (avg) (percentage) -2.76% 2.170 2.110 - -0.47% -
471.omnetpp (avg) (percentage) -2.52% 2.380 2.320 - 45.00% -
429.mcf (avg) (percentage) -2.38% 2.100 2.050 - -3.30% -
445.gobmk (avg) (percentage) -2.27% 0.440 0.430 - -35.82% -
458.sjeng -2.13% 47.000 46.000 - -66.18% -
458.sjeng (avg) -2.13% 47.000 46.000 - -66.18% -
470.lbm -2.13% 47.000 46.000 - -89.57% -
470.lbm (avg) -2.13% 47.000 46.000 - -89.57% -
470.lbm (avg) (percentage) -1.69% 1.180 1.160 - -65.17% -
456.hmmer (avg) (percentage) -1.69% 1.770 1.740 - 25.18% -
456.hmmer -1.49% 67.000 66.000 - -59.76% -
456.hmmer (avg) -1.49% 67.000 66.000 - -59.76% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.95% 146765.000 149620.000 - 0.00% -
471.omnetpp 1.37% 316676.000 321017.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 38200.00% 0.010 3.830 - 264.76% -
444.namd (unexplained diff vs previous) (percentage) 2133.33% 0.060 1.340 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 1100.00% 0.100 1.200 - 0.00% -
462.libquantum (unexplained diff vs previous) 600.00% 1.000 7.000 - 250.00% -
450.soplex (unexplained diff vs previous) (percentage) 463.04% 0.460 2.590 - -24.27% -
453.povray (max) (percentage) 450.00% 0.360 1.980 - -3.41% -
401.bzip2 (unexplained diff vs previous) (percentage) 285.00% 0.200 0.770 - 0.00% -
450.soplex (avg) (percentage) 140.00% 0.500 1.200 - 4.35% -
403.gcc (avg) (percentage) 138.18% 0.550 1.310 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 118.75% 0.160 0.350 - -42.62% -
462.libquantum (avg) (percentage) 110.39% 0.770 1.620 - 4.52% -
403.gcc (max) (percentage) 79.83% 2.330 4.190 - -0.95% -
450.soplex (max) (percentage) 75.76% 1.650 2.900 - -12.39% -
433.milc (max) (percentage) 52.50% 0.800 1.220 - 190.48% -
471.omnetpp (avg) (percentage) 45.00% 1.600 2.320 - -2.52% -
464.h264ref (avg) (percentage) 44.83% 0.290 0.420 - 0.00% -
444.namd (unexplained diff vs previous) 37.50% 8.000 11.000 - 0.00% -
456.hmmer (avg) (percentage) 25.18% 1.390 1.740 - -1.69% -
453.povray (avg) (percentage) 17.50% 0.800 0.940 - 6.82% -
433.milc (unexplained diff vs previous) 7.69% 13.000 14.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.15% 7239.000 7011.000 - 0.00% -
453.povray -2.01% 524493.000 513963.000 - 0.00% -
433.milc -1.98% 47001.000 46069.000 - 0.00% -
462.libquantum -1.70% 12504.000 12291.000 - 0.00% -
464.h264ref -1.13% 303767.000 300335.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -
444.namd -1.05% 124963.000 123646.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.41% 9509.000 56.000 - -1.75% -
462.libquantum -98.73% 14409.000 183.000 - -3.68% -
450.soplex -96.43% 15112.000 540.000 - 2.66% -
482.sphinx3 -96.27% 26682.000 996.000 - -0.20% -
444.namd -93.39% 12400.000 820.000 - 1.36% -
453.povray -92.77% 6987.000 505.000 - 1.81% -
429.mcf -91.76% 13988.000 1152.000 - 0.35% -
433.milc -91.46% 13601.000 1162.000 - 1.22% -
401.bzip2 -82.25% 16137.000 2865.000 - 0.77% -
447.dealII -79.02% 9380.000 1968.000 - -0.25% -
471.omnetpp -73.01% 10477.000 2828.000 - 0.11% -
470.lbm -69.93% 13259.000 3987.000 - -0.42% -
456.hmmer -67.76% 11854.000 3822.000 - 0.37% -
483.xalancbmk -64.12% 9376.000 3364.000 - 0.18% -
473.astar -61.88% 12272.000 4678.000 - -0.09% -
464.h264ref -59.20% 14498.000 5915.000 - -0.39% -
445.gobmk -55.95% 11093.000 4886.000 - -0.22% -
458.sjeng -51.48% 17055.000 8275.000 - 0.29% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.78% 914.000 2.000 - 0.00% -
429.mcf (max) -99.56% 2281.000 10.000 - -9.09% -
462.libquantum (max) -99.35% 919.000 6.000 - 100.00% -
403.gcc (max) -99.10% 221.000 2.000 - 0.00% -
444.namd (max) -98.90% 1003.000 11.000 - 37.50% -
482.sphinx3 (max) -98.87% 883.000 10.000 - -16.67% -
456.hmmer (max) -98.63% 1242.000 17.000 - -15.00% -
483.xalancbmk (max) -98.43% 1209.000 19.000 - -9.52% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
482.sphinx3 -98.06% 464.000 9.000 - 0.00% -
482.sphinx3 (avg) -98.06% 464.000 9.000 - 0.00% -
473.astar (max) -98.05% 822.000 16.000 - -5.88% -
470.lbm (max) -97.89% 758.000 16.000 - 220.00% -
470.lbm (unexplained diff vs previous) -97.89% 804.000 17.000 - 240.00% -
445.gobmk (max) -97.58% 413.000 10.000 - -9.09% -
471.omnetpp (max) -97.53% 972.000 24.000 - -14.29% -
458.sjeng (max) -97.37% 876.000 23.000 - 4.55% -
471.omnetpp (unexplained diff vs previous) -97.09% 103.000 3.000 - -89.66% -
444.namd -96.54% 318.000 11.000 - 0.00% -
444.namd (avg) -96.54% 318.000 11.000 - 0.00% -
447.dealII (max) -96.41% 223.000 8.000 - -11.11% -
401.bzip2 (max) -96.39% 609.000 22.000 - 83.33% -
456.hmmer (max) (percentage) -95.61% 10.480 0.460 - -16.36% -
483.xalancbmk (max) (percentage) -95.50% 12.900 0.580 - -9.38% -
473.astar (max) (percentage) -94.78% 6.700 0.350 - -5.41% -
429.mcf (max) (percentage) -94.60% 16.310 0.880 - -11.11% -
458.sjeng (max) (percentage) -94.36% 5.140 0.290 - 7.41% -
482.sphinx3 (unexplained diff vs previous) (percentage) -94.17% 3.430 0.200 - 0.00% -
445.gobmk (max) (percentage) -94.10% 3.730 0.220 - -4.35% -
450.soplex (max) -93.98% 249.000 15.000 - -11.76% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.90% 6.060 0.430 - 258.33% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
470.lbm (max) (percentage) -92.66% 5.720 0.420 - 223.08% -
429.mcf -92.23% 296.000 23.000 - -4.17% -
429.mcf (avg) -92.23% 296.000 23.000 - -4.17% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
471.omnetpp (max) (percentage) -90.84% 9.280 0.850 - -16.67% -
470.lbm -89.57% 441.000 46.000 - -2.13% -
470.lbm (avg) -89.57% 441.000 46.000 - -2.13% -
471.omnetpp (unexplained diff vs previous) (percentage) -88.78% 0.980 0.110 - -89.32% -
433.milc (max) -87.04% 108.000 14.000 - 250.00% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
473.astar (unexplained diff vs previous) -84.00% 25.000 4.000 - 100.00% -
444.namd (max) (percentage) -83.19% 8.090 1.360 - 23.64% -
401.bzip2 -82.69% 104.000 18.000 - 5.88% -
401.bzip2 (avg) -82.69% 104.000 18.000 - 5.88% -
429.mcf (unexplained diff vs previous) -81.82% 22.000 4.000 - -42.86% -
447.dealII (max) (percentage) -81.09% 2.380 0.450 - -4.26% -
450.soplex (unexplained diff vs previous) -79.71% 69.000 14.000 - -22.22% -
401.bzip2 (max) (percentage) -79.63% 3.780 0.770 - 79.07% -
445.gobmk (unexplained diff vs previous) -72.50% 40.000 11.000 - 0.00% -
445.gobmk -71.62% 74.000 21.000 - 0.00% -
445.gobmk (avg) -71.62% 74.000 21.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -69.57% 46.000 14.000 - -33.33% -
482.sphinx3 (max) (percentage) -68.28% 3.310 1.050 - -13.93% -
458.sjeng -66.18% 136.000 46.000 - -2.13% -
458.sjeng (avg) -66.18% 136.000 46.000 - -2.13% -
470.lbm (avg) (percentage) -65.17% 3.330 1.160 - -1.69% -
483.xalancbmk -64.65% 198.000 70.000 - -2.78% -
483.xalancbmk (avg) -64.65% 198.000 70.000 - -2.78% -
473.astar -64.29% 112.000 40.000 - -4.76% -
473.astar (avg) -64.29% 112.000 40.000 - -4.76% -
453.povray (max) -64.00% 25.000 9.000 - -10.00% -
464.h264ref (max) -61.67% 60.000 23.000 - 91.67% -
471.omnetpp -61.08% 167.000 65.000 - -2.99% -
471.omnetpp (avg) -61.08% 167.000 65.000 - -2.99% -
456.hmmer -59.76% 164.000 66.000 - -1.49% -
456.hmmer (avg) -59.76% 164.000 66.000 - -1.49% -
473.astar (unexplained diff vs previous) (percentage) -55.00% 0.200 0.090 - 125.00% -
482.sphinx3 (avg) (percentage) -46.55% 1.740 0.930 - -3.12% -
444.namd (avg) (percentage) -43.19% 2.570 1.460 - -0.68% -
464.h264ref -42.86% 42.000 24.000 - 0.00% -
464.h264ref (avg) -42.86% 42.000 24.000 - 0.00% -
462.libquantum (max) (percentage) -42.32% 6.380 3.680 - 82.18% -
445.gobmk (unexplained diff vs previous) (percentage) -36.11% 0.360 0.230 - 0.00% -
445.gobmk (avg) (percentage) -35.82% 0.670 0.430 - -2.27% -
401.bzip2 (unexplained diff vs previous) -33.33% 33.000 22.000 - 0.00% -
458.sjeng (avg) (percentage) -30.00% 0.800 0.560 - -1.75% -
447.dealII (avg) (percentage) -28.57% 1.050 0.750 - 0.00% -
433.milc (avg) (percentage) -24.42% 0.860 0.650 - 3.17% -
464.h264ref (max) (percentage) -7.14% 0.420 0.390 - 85.71% -
473.astar (avg) (percentage) -5.43% 0.920 0.870 - -3.33% -
456.hmmer (unexplained diff vs previous) (percentage) -5.13% 0.390 0.370 - -32.73% -
429.mcf (avg) (percentage) -3.30% 2.120 2.050 - -2.38% -
401.bzip2 (avg) (percentage) -3.08% 0.650 0.630 - 0.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2865.000 -
403.gcc 56.000 -1.75%
429.mcf 1152.000 -
433.milc 1162.000 1.22%
444.namd 820.000 1.36%
445.gobmk 4886.000 -
447.dealII 1968.000 -
450.soplex 540.000 2.66%
453.povray 505.000 1.81%
456.hmmer 3822.000 -
458.sjeng 8275.000 -
462.libquantum 183.000 -3.68%
464.h264ref 5915.000 -
470.lbm 3987.000 -
471.omnetpp 2828.000 -
473.astar 4678.000 -
482.sphinx3 996.000 -
483.xalancbmk 3364.000 -
Geometric Mean 1554.019 -
Code Size (bytes)
Name Current %
401.bzip2 33717.000 -
403.gcc 1664191.000 -
429.mcf 7011.000 -
433.milc 46069.000 -
444.namd 123646.000 -
445.gobmk 1259121.000 -
447.dealII 196010.000 -
450.soplex 149620.000 -
453.povray 513963.000 -
456.hmmer 80329.000 -
458.sjeng 79874.000 -
462.libquantum 12291.000 -
464.h264ref 300335.000 -
470.lbm 9236.000 -
471.omnetpp 321017.000 -
473.astar 15607.000 -
482.sphinx3 87680.000 -
483.xalancbmk 1611484.000 -
Geometric Mean 111039.813 -
sample variability
Name Current %
401.bzip2 18.000 5.88%
401.bzip2 (avg) 18.000 5.88%
401.bzip2 (avg) (percentage) 0.630 -
401.bzip2 (max) 22.000 83.33%
401.bzip2 (max) (percentage) 0.770 79.07%
401.bzip2 (unexplained diff vs previous) 22.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.770 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.310 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.190 -
429.mcf 23.000 -4.17%
429.mcf (avg) 23.000 -4.17%
429.mcf (avg) (percentage) 2.050 -2.38%
429.mcf (max) 10.000 -9.09%
429.mcf (max) (percentage) 0.880 -11.11%
429.mcf (unexplained diff vs previous) 4.000 -42.86%
429.mcf (unexplained diff vs previous) (percentage) 0.350 -42.62%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.650 3.17%
433.milc (max) 14.000 250.00%
433.milc (max) (percentage) 1.220 190.48%
433.milc (unexplained diff vs previous) 14.000 -
433.milc (unexplained diff vs previous) (percentage) 1.200 -
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.460 -
444.namd (max) 11.000 37.50%
444.namd (max) (percentage) 1.360 23.64%
444.namd (unexplained diff vs previous) 11.000 -
444.namd (unexplained diff vs previous) (percentage) 1.340 -
445.gobmk 21.000 -
445.gobmk (avg) 21.000 -
445.gobmk (avg) (percentage) 0.430 -2.27%
445.gobmk (max) 10.000 -9.09%
445.gobmk (max) (percentage) 0.220 -4.35%
445.gobmk (unexplained diff vs previous) 11.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.230 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.750 -
447.dealII (max) 8.000 -11.11%
447.dealII (max) (percentage) 0.450 -4.26%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.200 4.35%
450.soplex (max) 15.000 -11.76%
450.soplex (max) (percentage) 2.900 -12.39%
450.soplex (unexplained diff vs previous) 14.000 -22.22%
450.soplex (unexplained diff vs previous) (percentage) 2.590 -24.27%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.940 6.82%
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 1.980 -3.41%
453.povray (unexplained diff vs previous) 9.000 -
453.povray (unexplained diff vs previous) (percentage) 1.780 -
456.hmmer 66.000 -1.49%
456.hmmer (avg) 66.000 -1.49%
456.hmmer (avg) (percentage) 1.740 -1.69%
456.hmmer (max) 17.000 -15.00%
456.hmmer (max) (percentage) 0.460 -16.36%
456.hmmer (unexplained diff vs previous) 14.000 -33.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 -32.73%
458.sjeng 46.000 -2.13%
458.sjeng (avg) 46.000 -2.13%
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 23.000 4.55%
458.sjeng (max) (percentage) 0.290 7.41%
458.sjeng (unexplained diff vs previous) 24.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.290 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.620 4.52%
462.libquantum (max) 6.000 100.00%
462.libquantum (max) (percentage) 3.680 82.18%
462.libquantum (unexplained diff vs previous) 7.000 250.00%
462.libquantum (unexplained diff vs previous) (percentage) 3.830 264.76%
464.h264ref 24.000 -
464.h264ref (avg) 24.000 -
464.h264ref (avg) (percentage) 0.420 -
464.h264ref (max) 23.000 91.67%
464.h264ref (max) (percentage) 0.390 85.71%
464.h264ref (unexplained diff vs previous) 23.000 360.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.390 387.50%
470.lbm 46.000 -2.13%
470.lbm (avg) 46.000 -2.13%
470.lbm (avg) (percentage) 1.160 -1.69%
470.lbm (max) 16.000 220.00%
470.lbm (max) (percentage) 0.420 223.08%
470.lbm (unexplained diff vs previous) 17.000 240.00%
470.lbm (unexplained diff vs previous) (percentage) 0.430 258.33%
471.omnetpp 65.000 -2.99%
471.omnetpp (avg) 65.000 -2.99%
471.omnetpp (avg) (percentage) 2.320 -2.52%
471.omnetpp (max) 24.000 -14.29%
471.omnetpp (max) (percentage) 0.850 -16.67%
471.omnetpp (unexplained diff vs previous) 3.000 -89.66%
471.omnetpp (unexplained diff vs previous) (percentage) 0.110 -89.32%
473.astar 40.000 -4.76%
473.astar (avg) 40.000 -4.76%
473.astar (avg) (percentage) 0.870 -3.33%
473.astar (max) 16.000 -5.88%
473.astar (max) (percentage) 0.350 -5.41%
473.astar (unexplained diff vs previous) 4.000 100.00%
473.astar (unexplained diff vs previous) (percentage) 0.090 125.00%
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 0.930 -3.12%
482.sphinx3 (max) 10.000 -16.67%
482.sphinx3 (max) (percentage) 1.050 -13.93%
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.200 -
483.xalancbmk 70.000 -2.78%
483.xalancbmk (avg) 70.000 -2.78%
483.xalancbmk (avg) (percentage) 2.110 -2.76%
483.xalancbmk (max) 19.000 -9.52%
483.xalancbmk (max) (percentage) 0.580 -9.38%
483.xalancbmk (unexplained diff vs previous) 6.000 -40.00%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.180 -40.00%
Geometric Mean 3.330 -14.38%