Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ea2ed80e6dac21bf19d87de8bef1ec01b00dbb8d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Oz_LTO/189/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0189 (no-change) 2022-10-03T01:46:10 0:00:00
Previous 0188 (no-change) 2022-09-30T01:10:53 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 24 38
Performance Improvements 91 99
Added Tests 0 6
Unchanged Tests 665 637
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 1.49% 11470.000 11641.000 - 11.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 90.91% 0.110 0.210 - 0.00% -
471.omnetpp (unexplained diff vs previous) 90.00% 90.000 171.000 - 66.02% -
471.omnetpp (unexplained diff vs previous) (percentage) 88.46% 0.780 1.470 - 50.00% -
458.sjeng (unexplained diff vs previous) 83.33% 18.000 33.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 77.78% 0.090 0.160 - 60.00% -
433.milc (unexplained diff vs previous) 69.23% 13.000 22.000 - 69.23% -
471.omnetpp 64.47% 76.000 125.000 - -25.15% -
471.omnetpp (avg) 64.47% 76.000 125.000 - -25.15% -
471.omnetpp (avg) (percentage) 61.19% 0.670 1.080 - -32.50% -
401.bzip2 (max) 51.52% 33.000 50.000 - -91.79% -
401.bzip2 (unexplained diff vs previous) 51.52% 33.000 50.000 - 51.52% -
401.bzip2 (max) (percentage) 50.00% 0.200 0.300 - -92.06% -
401.bzip2 (unexplained diff vs previous) (percentage) 50.00% 0.200 0.300 - 50.00% -
450.soplex (unexplained diff vs previous) 37.04% 27.000 37.000 - -46.38% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.180 0.240 - -47.83% -
401.bzip2 30.30% 33.000 43.000 - -58.65% -
401.bzip2 (avg) 30.30% 33.000 43.000 - -58.65% -
401.bzip2 (avg) (percentage) 30.00% 0.200 0.260 - -60.00% -
458.sjeng (avg) (percentage) 12.50% 0.160 0.180 - -77.50% -
458.sjeng 12.00% 25.000 28.000 - -79.41% -
458.sjeng (avg) 12.00% 25.000 28.000 - -79.41% -
458.sjeng (max) 6.45% 31.000 33.000 - -96.23% -
471.omnetpp (max) 1.47% 477.000 484.000 - -50.21% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -99.85% 6.740 0.010 - -99.83% -
470.lbm (unexplained diff vs previous) -99.81% 1032.000 2.000 - -99.75% -
444.namd (unexplained diff vs previous) -98.13% 802.000 15.000 - 87.50% -
444.namd (unexplained diff vs previous) (percentage) -98.07% 6.220 0.120 - 100.00% -
482.sphinx3 (unexplained diff vs previous) -88.09% 806.000 96.000 - -89.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) -87.96% 2.740 0.330 - -90.38% -
429.mcf (unexplained diff vs previous) (percentage) -87.34% 0.790 0.100 - -37.50% -
429.mcf (unexplained diff vs previous) -86.96% 92.000 12.000 - -45.45% -
453.povray (unexplained diff vs previous) (percentage) -86.56% 2.530 0.340 - 0.00% -
453.povray (unexplained diff vs previous) -86.36% 176.000 24.000 - 0.00% -
447.dealII (unexplained diff vs previous) -67.12% 146.000 48.000 - -11.11% -
447.dealII (unexplained diff vs previous) (percentage) -66.91% 1.390 0.460 - -20.69% -
462.libquantum (unexplained diff vs previous) (percentage) -61.11% 0.180 0.070 - 600.00% -
462.libquantum (unexplained diff vs previous) -60.71% 28.000 11.000 - 1000.00% -
456.hmmer (unexplained diff vs previous) -60.00% 40.000 16.000 - -65.22% -
456.hmmer (unexplained diff vs previous) (percentage) -58.62% 0.290 0.120 - -69.23% -
453.povray (avg) (percentage) -51.82% 2.470 1.190 - 48.75% -
453.povray -51.46% 171.000 83.000 - 50.91% -
453.povray (avg) -51.46% 171.000 83.000 - 50.91% -
470.lbm -49.82% 833.000 418.000 - -5.22% -
470.lbm (avg) -49.82% 833.000 418.000 - -5.22% -
470.lbm (avg) (percentage) -49.82% 5.440 2.730 - -18.02% -
444.namd (avg) (percentage) -48.34% 3.910 2.020 - -21.40% -
444.namd -48.31% 503.000 260.000 - -18.24% -
444.namd (avg) -48.31% 503.000 260.000 - -18.24% -
445.gobmk (unexplained diff vs previous) (percentage) -43.33% 0.300 0.170 - -52.78% -
483.xalancbmk (unexplained diff vs previous) (percentage) -43.18% 0.440 0.250 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -42.55% 47.000 27.000 - 0.00% -
429.mcf -42.25% 71.000 41.000 - -86.15% -
429.mcf (avg) -42.25% 71.000 41.000 - -86.15% -
429.mcf (avg) (percentage) -41.94% 0.620 0.360 - -83.02% -
482.sphinx3 -41.42% 565.000 331.000 - -28.66% -
482.sphinx3 (avg) -41.42% 565.000 331.000 - -28.66% -
445.gobmk (unexplained diff vs previous) -41.18% 34.000 20.000 - -50.00% -
482.sphinx3 (avg) (percentage) -41.15% 1.920 1.130 - -35.06% -
447.dealII -40.97% 144.000 85.000 - -13.27% -
447.dealII (avg) -40.97% 144.000 85.000 - -13.27% -
447.dealII (avg) (percentage) -40.15% 1.370 0.820 - -21.90% -
456.hmmer -37.10% 62.000 39.000 - -76.22% -
456.hmmer (avg) -37.10% 62.000 39.000 - -76.22% -
456.hmmer (avg) (percentage) -36.96% 0.460 0.290 - -79.14% -
462.libquantum (avg) (percentage) -31.58% 0.190 0.130 - -83.12% -
462.libquantum -31.03% 29.000 20.000 - -81.82% -
462.libquantum (avg) -31.03% 29.000 20.000 - -81.82% -
473.astar (unexplained diff vs previous) -27.78% 18.000 13.000 - -48.00% -
445.gobmk (avg) (percentage) -26.67% 0.300 0.220 - -67.16% -
445.gobmk -26.47% 34.000 25.000 - -66.22% -
445.gobmk (avg) -26.47% 34.000 25.000 - -66.22% -
483.xalancbmk (avg) (percentage) -25.00% 0.440 0.330 - -84.43% -
483.xalancbmk -23.91% 46.000 35.000 - -82.32% -
483.xalancbmk (avg) -23.91% 46.000 35.000 - -82.32% -
473.astar (unexplained diff vs previous) (percentage) -23.08% 0.130 0.100 - -50.00% -
445.gobmk (max) -17.65% 34.000 28.000 - -93.22% -
473.astar -17.65% 17.000 14.000 - -87.50% -
473.astar (avg) -17.65% 17.000 14.000 - -87.50% -
473.astar (max) -17.65% 17.000 14.000 - -98.30% -
447.dealII (max) -17.36% 144.000 119.000 - -46.64% -
482.sphinx3 (max) -17.03% 828.000 687.000 - -22.20% -
447.dealII (max) (percentage) -16.79% 1.370 1.140 - -52.10% -
482.sphinx3 (max) (percentage) -16.73% 2.810 2.340 - -29.31% -
444.namd (max) (percentage) -16.72% 5.860 4.880 - -39.68% -
444.namd (max) -16.69% 755.000 629.000 - -37.29% -
462.libquantum (max) (percentage) -16.67% 0.180 0.150 - -97.65% -
445.gobmk (max) (percentage) -16.67% 0.300 0.250 - -93.30% -
470.lbm (max) -16.65% 1105.000 921.000 - 21.50% -
470.lbm (max) (percentage) -16.62% 7.220 6.020 - 5.24% -
453.povray (max) (percentage) -16.60% 2.470 2.060 - 472.22% -
453.povray (max) -16.37% 171.000 143.000 - 472.00% -
483.xalancbmk (max) (percentage) -15.91% 0.440 0.370 - -97.13% -
473.astar (avg) (percentage) -15.38% 0.130 0.110 - -88.04% -
473.astar (max) (percentage) -15.38% 0.130 0.110 - -98.36% -
483.xalancbmk (max) -15.22% 46.000 39.000 - -96.77% -
433.milc (max) (percentage) -15.00% 0.200 0.170 - -78.75% -
433.milc (max) -14.81% 27.000 23.000 - -78.70% -
462.libquantum (max) -14.81% 27.000 23.000 - -97.50% -
456.hmmer (max) (percentage) -10.34% 0.580 0.520 - -95.04% -
456.hmmer (max) -10.26% 78.000 70.000 - -94.36% -
464.h264ref (max) -9.09% 22.000 20.000 - -66.67% -
450.soplex (avg) (percentage) -7.41% 0.270 0.250 - -50.00% -
450.soplex -7.32% 41.000 38.000 - -49.33% -
450.soplex (avg) -7.32% 41.000 38.000 - -49.33% -
464.h264ref (max) (percentage) -7.14% 0.140 0.130 - -69.05% -
464.h264ref (unexplained diff vs previous) -4.76% 21.000 20.000 - 0.00% -
403.gcc (max) -4.35% 46.000 44.000 - -80.09% -
403.gcc (unexplained diff vs previous) -4.35% 46.000 44.000 - 300.00% -
464.h264ref -4.35% 23.000 22.000 - -47.62% -
464.h264ref (avg) -4.35% 23.000 22.000 - -47.62% -
403.gcc (max) (percentage) -4.26% 0.470 0.450 - -80.69% -
403.gcc (unexplained diff vs previous) (percentage) -4.26% 0.470 0.450 - 275.00% -
403.gcc -2.17% 46.000 45.000 - -13.46% -
403.gcc (avg) -2.17% 46.000 45.000 - -13.46% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.73% 146765.000 150769.000 - 0.00% -
471.omnetpp 1.60% 316676.000 321756.000 - 0.00% -
447.dealII 1.13% 195792.000 198002.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm 15.51% 13259.000 15315.000 - -0.01% -
456.hmmer 14.66% 11854.000 13592.000 - 0.12% -
483.xalancbmk 13.95% 9376.000 10684.000 - 0.25% -
447.dealII 11.65% 9380.000 10473.000 - -0.46% -
471.omnetpp 11.11% 10477.000 11641.000 - 1.49% -
482.sphinx3 10.08% 26682.000 29371.000 - -0.33% -
464.h264ref 9.89% 14498.000 15932.000 - -0.13% -
473.astar 9.58% 12272.000 13448.000 - -0.10% -
462.libquantum 7.65% 14409.000 15511.000 - -0.07% -
444.namd 4.04% 12400.000 12901.000 - 0.12% -
445.gobmk 3.89% 11093.000 11524.000 - 0.17% -
401.bzip2 3.50% 16137.000 16702.000 - 0.30% -
403.gcc 3.22% 9509.000 9815.000 - -0.45% -
433.milc 2.28% 13601.000 13911.000 - -0.16% -
450.soplex 1.28% 15112.000 15306.000 - -0.24% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 1000.00% 1.000 11.000 - -60.71% -
462.libquantum (unexplained diff vs previous) (percentage) 600.00% 0.010 0.070 - -61.11% -
453.povray (max) (percentage) 472.22% 0.360 2.060 - -16.60% -
453.povray (max) 472.00% 25.000 143.000 - -16.37% -
403.gcc (unexplained diff vs previous) 300.00% 11.000 44.000 - -4.35% -
403.gcc (unexplained diff vs previous) (percentage) 275.00% 0.120 0.450 - -4.26% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.060 0.120 - -98.07% -
444.namd (unexplained diff vs previous) 87.50% 8.000 15.000 - -98.13% -
433.milc (unexplained diff vs previous) 69.23% 13.000 22.000 - 69.23% -
471.omnetpp (unexplained diff vs previous) 66.02% 103.000 171.000 - 90.00% -
433.milc (unexplained diff vs previous) (percentage) 60.00% 0.100 0.160 - 77.78% -
401.bzip2 (unexplained diff vs previous) 51.52% 33.000 50.000 - 51.52% -
453.povray 50.91% 55.000 83.000 - -51.46% -
453.povray (avg) 50.91% 55.000 83.000 - -51.46% -
471.omnetpp (unexplained diff vs previous) (percentage) 50.00% 0.980 1.470 - 88.46% -
401.bzip2 (unexplained diff vs previous) (percentage) 50.00% 0.200 0.300 - 50.00% -
453.povray (avg) (percentage) 48.75% 0.800 1.190 - -51.82% -
470.lbm (max) 21.50% 758.000 921.000 - -16.65% -
470.lbm (max) (percentage) 5.24% 5.720 6.020 - -16.62% -
450.soplex (max) 2.01% 249.000 254.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -17.30% 13988.000 11568.000 - -0.10% -
458.sjeng -6.31% 17055.000 15979.000 - 0.21% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) (percentage) -99.83% 6.060 0.010 - -99.85% -
470.lbm (unexplained diff vs previous) -99.75% 804.000 2.000 - -99.81% -
473.astar (max) (percentage) -98.36% 6.700 0.110 - -15.38% -
473.astar (max) -98.30% 822.000 14.000 - -17.65% -
462.libquantum (max) (percentage) -97.65% 6.380 0.150 - -16.67% -
462.libquantum (max) -97.50% 919.000 23.000 - -14.81% -
483.xalancbmk (max) (percentage) -97.13% 12.900 0.370 - -15.91% -
483.xalancbmk (max) -96.77% 1209.000 39.000 - -15.22% -
458.sjeng (max) -96.23% 876.000 33.000 - 6.45% -
458.sjeng (max) (percentage) -95.91% 5.140 0.210 - 5.00% -
456.hmmer (max) (percentage) -95.04% 10.480 0.520 - -10.34% -
456.hmmer (max) -94.36% 1242.000 70.000 - -10.26% -
445.gobmk (max) (percentage) -93.30% 3.730 0.250 - -16.67% -
445.gobmk (max) -93.22% 413.000 28.000 - -17.65% -
401.bzip2 (max) (percentage) -92.06% 3.780 0.300 - 50.00% -
401.bzip2 (max) -91.79% 609.000 50.000 - 51.52% -
482.sphinx3 (unexplained diff vs previous) (percentage) -90.38% 3.430 0.330 - -87.96% -
482.sphinx3 (unexplained diff vs previous) -89.50% 914.000 96.000 - -88.09% -
473.astar (avg) (percentage) -88.04% 0.920 0.110 - -15.38% -
473.astar -87.50% 112.000 14.000 - -17.65% -
473.astar (avg) -87.50% 112.000 14.000 - -17.65% -
429.mcf -86.15% 296.000 41.000 - -42.25% -
429.mcf (avg) -86.15% 296.000 41.000 - -42.25% -
483.xalancbmk (avg) (percentage) -84.43% 2.120 0.330 - -25.00% -
462.libquantum (avg) (percentage) -83.12% 0.770 0.130 - -31.58% -
429.mcf (avg) (percentage) -83.02% 2.120 0.360 - -41.94% -
433.milc -82.76% 116.000 20.000 - 0.00% -
433.milc (avg) -82.76% 116.000 20.000 - 0.00% -
433.milc (avg) (percentage) -82.56% 0.860 0.150 - 0.00% -
483.xalancbmk -82.32% 198.000 35.000 - -23.91% -
483.xalancbmk (avg) -82.32% 198.000 35.000 - -23.91% -
462.libquantum -81.82% 110.000 20.000 - -31.03% -
462.libquantum (avg) -81.82% 110.000 20.000 - -31.03% -
403.gcc (max) (percentage) -80.69% 2.330 0.450 - -4.26% -
403.gcc (max) -80.09% 221.000 44.000 - -4.35% -
458.sjeng -79.41% 136.000 28.000 - 12.00% -
458.sjeng (avg) -79.41% 136.000 28.000 - 12.00% -
456.hmmer (avg) (percentage) -79.14% 1.390 0.290 - -36.96% -
433.milc (max) (percentage) -78.75% 0.800 0.170 - -15.00% -
433.milc (max) -78.70% 108.000 23.000 - -14.81% -
458.sjeng (avg) (percentage) -77.50% 0.800 0.180 - 12.50% -
456.hmmer -76.22% 164.000 39.000 - -37.10% -
456.hmmer (avg) -76.22% 164.000 39.000 - -37.10% -
456.hmmer (unexplained diff vs previous) (percentage) -69.23% 0.390 0.120 - -58.62% -
464.h264ref (max) (percentage) -69.05% 0.420 0.130 - -7.14% -
445.gobmk (avg) (percentage) -67.16% 0.670 0.220 - -26.67% -
464.h264ref (max) -66.67% 60.000 20.000 - -9.09% -
445.gobmk -66.22% 74.000 25.000 - -26.47% -
445.gobmk (avg) -66.22% 74.000 25.000 - -26.47% -
456.hmmer (unexplained diff vs previous) -65.22% 46.000 16.000 - -60.00% -
429.mcf (max) -64.36% 2281.000 813.000 - -0.12% -
401.bzip2 (avg) (percentage) -60.00% 0.650 0.260 - 30.00% -
401.bzip2 -58.65% 104.000 43.000 - 30.30% -
401.bzip2 (avg) -58.65% 104.000 43.000 - 30.30% -
429.mcf (max) (percentage) -56.90% 16.310 7.030 - 0.00% -
471.omnetpp (max) (percentage) -55.17% 9.280 4.160 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -52.78% 0.360 0.170 - -43.33% -
447.dealII (max) (percentage) -52.10% 2.380 1.140 - -16.79% -
464.h264ref (avg) (percentage) -51.72% 0.290 0.140 - -6.67% -
471.omnetpp (max) -50.21% 972.000 484.000 - 1.47% -
445.gobmk (unexplained diff vs previous) -50.00% 40.000 20.000 - -41.18% -
450.soplex (avg) (percentage) -50.00% 0.500 0.250 - -7.41% -
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.200 0.100 - -23.08% -
450.soplex -49.33% 75.000 38.000 - -7.32% -
450.soplex (avg) -49.33% 75.000 38.000 - -7.32% -
473.astar (unexplained diff vs previous) -48.00% 25.000 13.000 - -27.78% -
450.soplex (unexplained diff vs previous) (percentage) -47.83% 0.460 0.240 - 33.33% -
464.h264ref -47.62% 42.000 22.000 - -4.35% -
464.h264ref (avg) -47.62% 42.000 22.000 - -4.35% -
447.dealII (max) -46.64% 223.000 119.000 - -17.36% -
450.soplex (unexplained diff vs previous) -46.38% 69.000 37.000 - 37.04% -
429.mcf (unexplained diff vs previous) -45.45% 22.000 12.000 - -86.96% -
444.namd (max) (percentage) -39.68% 8.090 4.880 - -16.72% -
429.mcf (unexplained diff vs previous) (percentage) -37.50% 0.160 0.100 - -87.34% -
444.namd (max) -37.29% 1003.000 629.000 - -16.69% -
482.sphinx3 (avg) (percentage) -35.06% 1.740 1.130 - -41.15% -
471.omnetpp (avg) (percentage) -32.50% 1.600 1.080 - 61.19% -
482.sphinx3 (max) (percentage) -29.31% 3.310 2.340 - -16.73% -
482.sphinx3 -28.66% 464.000 331.000 - -41.42% -
482.sphinx3 (avg) -28.66% 464.000 331.000 - -41.42% -
471.omnetpp -25.15% 167.000 125.000 - 64.47% -
471.omnetpp (avg) -25.15% 167.000 125.000 - 64.47% -
482.sphinx3 (max) -22.20% 883.000 687.000 - -17.03% -
447.dealII (avg) (percentage) -21.90% 1.050 0.820 - -40.15% -
444.namd (avg) (percentage) -21.40% 2.570 2.020 - -48.34% -
447.dealII (unexplained diff vs previous) (percentage) -20.69% 0.580 0.460 - -66.91% -
444.namd -18.24% 318.000 260.000 - -48.31% -
444.namd (avg) -18.24% 318.000 260.000 - -48.31% -
470.lbm (avg) (percentage) -18.02% 3.330 2.730 - -49.82% -
403.gcc (avg) (percentage) -16.36% 0.550 0.460 - -2.13% -
403.gcc -13.46% 52.000 45.000 - -2.17% -
403.gcc (avg) -13.46% 52.000 45.000 - -2.17% -
447.dealII -13.27% 98.000 85.000 - -40.97% -
447.dealII (avg) -13.27% 98.000 85.000 - -40.97% -
447.dealII (unexplained diff vs previous) -11.11% 54.000 48.000 - -67.12% -
470.lbm -5.22% 441.000 418.000 - -49.82% -
470.lbm (avg) -5.22% 441.000 418.000 - -49.82% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
401.bzip2 16702.000 -
403.gcc 9815.000 -
429.mcf 11568.000 -
433.milc 13911.000 -
444.namd 12901.000 -
445.gobmk 11524.000 -
447.dealII 10473.000 -
450.soplex 15306.000 -
453.povray 6985.000 -
456.hmmer 13592.000 -
458.sjeng 15979.000 -
462.libquantum 15511.000 -
464.h264ref 15932.000 -
470.lbm 15315.000 -
471.omnetpp 11641.000 1.49%
473.astar 13448.000 -
482.sphinx3 29371.000 -
483.xalancbmk 10684.000 -
Geometric Mean 13333.103 -
Code Size (bytes)
Name Current %
401.bzip2 33866.000 -
403.gcc 1669104.000 -
429.mcf 7239.000 -
433.milc 47153.000 -
444.namd 125319.000 -
445.gobmk 1261123.000 -
447.dealII 198002.000 -
450.soplex 150769.000 -
453.povray 523145.000 -
456.hmmer 80989.000 -
458.sjeng 80845.000 -
462.libquantum 12464.000 -
464.h264ref 304327.000 -
470.lbm 9350.000 -
471.omnetpp 321756.000 -
473.astar 15557.000 -
482.sphinx3 88079.000 -
483.xalancbmk 1616924.000 -
Geometric Mean 112154.728 -
sample variability
Name Current %
401.bzip2 43.000 30.30%
401.bzip2 (avg) 43.000 30.30%
401.bzip2 (avg) (percentage) 0.260 30.00%
401.bzip2 (max) 50.000 51.52%
401.bzip2 (max) (percentage) 0.300 50.00%
401.bzip2 (unexplained diff vs previous) 50.000 51.52%
401.bzip2 (unexplained diff vs previous) (percentage) 0.300 50.00%
403.gcc 45.000 -2.17%
403.gcc (avg) 45.000 -2.17%
403.gcc (avg) (percentage) 0.460 -
403.gcc (max) 44.000 -4.35%
403.gcc (max) (percentage) 0.450 -4.26%
403.gcc (unexplained diff vs previous) 44.000 -4.35%
403.gcc (unexplained diff vs previous) (percentage) 0.450 -4.26%
429.mcf 41.000 -42.25%
429.mcf (avg) 41.000 -42.25%
429.mcf (avg) (percentage) 0.360 -41.94%
429.mcf (max) 813.000 -
429.mcf (max) (percentage) 7.030 -
429.mcf (unexplained diff vs previous) 12.000 -86.96%
429.mcf (unexplained diff vs previous) (percentage) 0.100 -87.34%
433.milc 20.000 -
433.milc (avg) 20.000 -
433.milc (avg) (percentage) 0.150 -
433.milc (max) 23.000 -14.81%
433.milc (max) (percentage) 0.170 -15.00%
433.milc (unexplained diff vs previous) 22.000 69.23%
433.milc (unexplained diff vs previous) (percentage) 0.160 77.78%
444.namd 260.000 -48.31%
444.namd (avg) 260.000 -48.31%
444.namd (avg) (percentage) 2.020 -48.34%
444.namd (max) 629.000 -16.69%
444.namd (max) (percentage) 4.880 -16.72%
444.namd (unexplained diff vs previous) 15.000 -98.13%
444.namd (unexplained diff vs previous) (percentage) 0.120 -98.07%
445.gobmk 25.000 -26.47%
445.gobmk (avg) 25.000 -26.47%
445.gobmk (avg) (percentage) 0.220 -26.67%
445.gobmk (max) 28.000 -17.65%
445.gobmk (max) (percentage) 0.250 -16.67%
445.gobmk (unexplained diff vs previous) 20.000 -41.18%
445.gobmk (unexplained diff vs previous) (percentage) 0.170 -43.33%
447.dealII 85.000 -40.97%
447.dealII (avg) 85.000 -40.97%
447.dealII (avg) (percentage) 0.820 -40.15%
447.dealII (max) 119.000 -17.36%
447.dealII (max) (percentage) 1.140 -16.79%
447.dealII (unexplained diff vs previous) 48.000 -67.12%
447.dealII (unexplained diff vs previous) (percentage) 0.460 -66.91%
450.soplex 38.000 -7.32%
450.soplex (avg) 38.000 -7.32%
450.soplex (avg) (percentage) 0.250 -7.41%
450.soplex (max) 254.000 -
450.soplex (max) (percentage) 1.660 -
450.soplex (unexplained diff vs previous) 37.000 37.04%
450.soplex (unexplained diff vs previous) (percentage) 0.240 33.33%
453.povray 83.000 -51.46%
453.povray (avg) 83.000 -51.46%
453.povray (avg) (percentage) 1.190 -51.82%
453.povray (max) 143.000 -16.37%
453.povray (max) (percentage) 2.060 -16.60%
453.povray (unexplained diff vs previous) 24.000 -86.36%
453.povray (unexplained diff vs previous) (percentage) 0.340 -86.56%
456.hmmer 39.000 -37.10%
456.hmmer (avg) 39.000 -37.10%
456.hmmer (avg) (percentage) 0.290 -36.96%
456.hmmer (max) 70.000 -10.26%
456.hmmer (max) (percentage) 0.520 -10.34%
456.hmmer (unexplained diff vs previous) 16.000 -60.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.120 -58.62%
458.sjeng 28.000 12.00%
458.sjeng (avg) 28.000 12.00%
458.sjeng (avg) (percentage) 0.180 12.50%
458.sjeng (max) 33.000 6.45%
458.sjeng (max) (percentage) 0.210 -
458.sjeng (unexplained diff vs previous) 33.000 83.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.210 90.91%
462.libquantum 20.000 -31.03%
462.libquantum (avg) 20.000 -31.03%
462.libquantum (avg) (percentage) 0.130 -31.58%
462.libquantum (max) 23.000 -14.81%
462.libquantum (max) (percentage) 0.150 -16.67%
462.libquantum (unexplained diff vs previous) 11.000 -60.71%
462.libquantum (unexplained diff vs previous) (percentage) 0.070 -61.11%
464.h264ref 22.000 -4.35%
464.h264ref (avg) 22.000 -4.35%
464.h264ref (avg) (percentage) 0.140 -
464.h264ref (max) 20.000 -9.09%
464.h264ref (max) (percentage) 0.130 -7.14%
464.h264ref (unexplained diff vs previous) 20.000 -4.76%
464.h264ref (unexplained diff vs previous) (percentage) 0.130 -
470.lbm 418.000 -49.82%
470.lbm (avg) 418.000 -49.82%
470.lbm (avg) (percentage) 2.730 -49.82%
470.lbm (max) 921.000 -16.65%
470.lbm (max) (percentage) 6.020 -16.62%
470.lbm (unexplained diff vs previous) 2.000 -99.81%
470.lbm (unexplained diff vs previous) (percentage) 0.010 -99.85%
471.omnetpp 125.000 64.47%
471.omnetpp (avg) 125.000 64.47%
471.omnetpp (avg) (percentage) 1.080 61.19%
471.omnetpp (max) 484.000 1.47%
471.omnetpp (max) (percentage) 4.160 -
471.omnetpp (unexplained diff vs previous) 171.000 90.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.470 88.46%
473.astar 14.000 -17.65%
473.astar (avg) 14.000 -17.65%
473.astar (avg) (percentage) 0.110 -15.38%
473.astar (max) 14.000 -17.65%
473.astar (max) (percentage) 0.110 -15.38%
473.astar (unexplained diff vs previous) 13.000 -27.78%
473.astar (unexplained diff vs previous) (percentage) 0.100 -23.08%
482.sphinx3 331.000 -41.42%
482.sphinx3 (avg) 331.000 -41.42%
482.sphinx3 (avg) (percentage) 1.130 -41.15%
482.sphinx3 (max) 687.000 -17.03%
482.sphinx3 (max) (percentage) 2.340 -16.73%
482.sphinx3 (unexplained diff vs previous) 96.000 -88.09%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.330 -87.96%
483.xalancbmk 35.000 -23.91%
483.xalancbmk (avg) 35.000 -23.91%
483.xalancbmk (avg) (percentage) 0.330 -25.00%
483.xalancbmk (max) 39.000 -15.22%
483.xalancbmk (max) (percentage) 0.370 -15.91%
483.xalancbmk (unexplained diff vs previous) 27.000 -42.55%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.250 -43.18%
Geometric Mean 6.220 -34.66%