Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3bb89b6bfbb549a4b129698b0e56d758a1dcd8df (+ 293 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/71/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0071 (llvmorg-18-init-06996-g3bb89b6bfbb5) 2023-09-24T15:13:55 0:00:00
Previous 0070 (llvmorg-18-init-06703-g3f0bddb56ac3) 2023-09-22T05:14:08 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 28 24
Performance Improvements 65 110
Added Tests 2 6
Unchanged Tests 685 640
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.19% 183.000 187.000 - -98.70% -
433.milc 1.21% 1157.000 1171.000 - -91.39% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 605.88% 0.170 1.200 - 1100.00% -
433.milc (unexplained diff vs previous) 600.00% 2.000 14.000 - 7.69% -
483.xalancbmk (unexplained diff vs previous) 266.67% 9.000 33.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 259.26% 0.270 0.970 - 0.00% -
433.milc (max) 250.00% 4.000 14.000 - -87.04% -
483.xalancbmk (max) 230.00% 10.000 33.000 - -97.27% -
471.omnetpp (unexplained diff vs previous) 220.00% 5.000 16.000 - -84.47% -
433.milc (max) (percentage) 218.42% 0.380 1.210 - 51.25% -
471.omnetpp (unexplained diff vs previous) (percentage) 216.67% 0.180 0.570 - -41.84% -
483.xalancbmk (max) (percentage) 216.13% 0.310 0.980 - -92.40% -
456.hmmer (unexplained diff vs previous) (percentage) 161.54% 0.130 0.340 - -12.82% -
456.hmmer (unexplained diff vs previous) 160.00% 5.000 13.000 - -71.74% -
447.dealII (unexplained diff vs previous) (percentage) 107.14% 0.140 0.290 - -50.00% -
447.dealII (unexplained diff vs previous) 100.00% 3.000 6.000 - -88.89% -
429.mcf (unexplained diff vs previous) 37.50% 8.000 11.000 - -50.00% -
429.mcf (unexplained diff vs previous) (percentage) 36.23% 0.690 0.940 - 487.50% -
462.libquantum (max) 33.33% 3.000 4.000 - -99.56% -
464.h264ref (unexplained diff vs previous) (percentage) 25.00% 0.080 0.100 - 0.00% -
464.h264ref (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
433.milc 14.29% 7.000 8.000 - -93.10% -
433.milc (avg) 14.29% 7.000 8.000 - -93.10% -
456.hmmer (max) 8.33% 12.000 13.000 - -98.95% -
456.hmmer (max) (percentage) 6.25% 0.320 0.340 - -96.76% -
433.milc (avg) (percentage) 2.90% 0.690 0.710 - -17.44% -
462.libquantum (max) (percentage) 2.34% 2.140 2.190 - -65.67% -
462.libquantum (avg) (percentage) 1.12% 1.790 1.810 - 135.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.69% 59.000 58.000 - -99.39% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -75.00% 0.400 0.100 - -97.08% -
482.sphinx3 (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.89% -
444.namd (unexplained diff vs previous) -66.67% 6.000 2.000 - -75.00% -
444.namd (unexplained diff vs previous) (percentage) -66.22% 0.740 0.250 - 316.67% -
401.bzip2 (unexplained diff vs previous) -64.00% 25.000 9.000 - -72.73% -
401.bzip2 (unexplained diff vs previous) (percentage) -63.95% 0.860 0.310 - 55.00% -
470.lbm (unexplained diff vs previous) (percentage) -44.44% 0.180 0.100 - -98.35% -
470.lbm (unexplained diff vs previous) -42.86% 7.000 4.000 - -99.50% -
473.astar (unexplained diff vs previous) -40.00% 5.000 3.000 - -88.00% -
482.sphinx3 (max) -40.00% 5.000 3.000 - -99.66% -
473.astar (unexplained diff vs previous) (percentage) -36.36% 0.110 0.070 - -65.00% -
403.gcc (max) -33.33% 3.000 2.000 - -99.10% -
482.sphinx3 (max) (percentage) -29.41% 0.510 0.360 - -89.12% -
401.bzip2 (max) -28.00% 25.000 18.000 - -97.04% -
401.bzip2 (max) (percentage) -25.29% 0.870 0.650 - -82.80% -
444.namd (max) -16.67% 6.000 5.000 - -99.50% -
464.h264ref (max) -15.38% 13.000 11.000 - -81.67% -
471.omnetpp (max) -11.76% 17.000 15.000 - -98.46% -
458.sjeng (max) -9.09% 11.000 10.000 - -98.86% -
464.h264ref (max) (percentage) -9.09% 0.220 0.200 - -52.38% -
473.astar (max) -8.33% 24.000 22.000 - -97.32% -
482.sphinx3 -7.69% 13.000 12.000 - -97.41% -
482.sphinx3 (avg) -7.69% 13.000 12.000 - -97.41% -
458.sjeng (max) (percentage) -7.14% 0.140 0.130 - -97.47% -
450.soplex (max) -7.14% 14.000 13.000 - -94.78% -
471.omnetpp (max) (percentage) -6.67% 0.600 0.560 - -93.97% -
470.lbm (max) -6.25% 16.000 15.000 - -98.02% -
450.soplex (max) (percentage) -6.06% 2.640 2.480 - 50.30% -
473.astar (max) (percentage) -5.66% 0.530 0.500 - -92.54% -
464.h264ref -5.41% 37.000 35.000 - -16.67% -
464.h264ref (avg) -5.41% 37.000 35.000 - -16.67% -
447.dealII -5.26% 19.000 18.000 - -81.63% -
447.dealII (avg) -5.26% 19.000 18.000 - -81.63% -
470.lbm (max) (percentage) -4.88% 0.410 0.390 - -93.18% -
464.h264ref (avg) (percentage) -4.76% 0.630 0.600 - 106.90% -
482.sphinx3 (avg) (percentage) -4.62% 1.300 1.240 - -28.74% -
444.namd (avg) (percentage) -4.32% 1.850 1.770 - -31.13% -
447.dealII (avg) (percentage) -4.26% 0.940 0.900 - -14.29% -
444.namd (max) (percentage) -4.00% 0.750 0.720 - -91.10% -
473.astar (avg) (percentage) -3.76% 1.330 1.280 - 39.13% -
470.lbm (avg) (percentage) -3.70% 1.890 1.820 - -45.35% -
473.astar -3.33% 60.000 58.000 - -48.21% -
473.astar (avg) -3.33% 60.000 58.000 - -48.21% -
429.mcf -3.23% 31.000 30.000 - -89.86% -
429.mcf (avg) -3.23% 31.000 30.000 - -89.86% -
456.hmmer (avg) (percentage) -3.16% 2.850 2.760 - 98.56% -
483.xalancbmk (avg) (percentage) -2.96% 3.380 3.280 - 54.72% -
456.hmmer -2.78% 108.000 105.000 - -35.98% -
456.hmmer (avg) -2.78% 108.000 105.000 - -35.98% -
470.lbm -2.70% 74.000 72.000 - -83.67% -
470.lbm (avg) -2.70% 74.000 72.000 - -83.67% -
445.gobmk (max) (percentage) -2.63% 0.380 0.370 - -90.08% -
471.omnetpp (avg) (percentage) -2.53% 3.160 3.080 - 92.50% -
447.dealII (max) (percentage) -2.35% 0.850 0.830 - -65.13% -
462.libquantum (unexplained diff vs previous) (percentage) -2.28% 2.190 2.140 - 21300.00% -
453.povray (max) (percentage) -2.27% 1.320 1.290 - 258.33% -
471.omnetpp -2.25% 89.000 87.000 - -47.90% -
471.omnetpp (avg) -2.25% 89.000 87.000 - -47.90% -
429.mcf (avg) (percentage) -2.22% 2.700 2.640 - 24.53% -
429.mcf (max) (percentage) -1.85% 1.080 1.060 - -93.50% -
483.xalancbmk -1.75% 114.000 112.000 - -43.43% -
483.xalancbmk (avg) -1.75% 114.000 112.000 - -43.43% -
403.gcc (max) (percentage) -1.54% 5.200 5.120 - 119.74% -
401.bzip2 (avg) (percentage) -1.27% 0.790 0.780 - 20.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.21% 146765.000 150008.000 - 0.02% -
471.omnetpp 1.52% 316676.000 321493.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21300.00% 0.010 2.140 - -2.28% -
433.milc (unexplained diff vs previous) (percentage) 1100.00% 0.100 1.200 - 605.88% -
429.mcf (unexplained diff vs previous) (percentage) 487.50% 0.160 0.940 - 36.23% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - -66.22% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
453.povray (max) (percentage) 258.33% 0.360 1.290 - -2.27% -
403.gcc (avg) (percentage) 183.64% 0.550 1.560 - 0.00% -
462.libquantum (avg) (percentage) 135.06% 0.770 1.810 - 1.12% -
403.gcc (max) (percentage) 119.74% 2.330 5.120 - -1.54% -
464.h264ref (avg) (percentage) 106.90% 0.290 0.600 - -4.76% -
456.hmmer (avg) (percentage) 98.56% 1.390 2.760 - -3.16% -
471.omnetpp (avg) (percentage) 92.50% 1.600 3.080 - -2.53% -
450.soplex (avg) (percentage) 78.00% 0.500 0.890 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 55.00% 0.200 0.310 - -63.95% -
483.xalancbmk (avg) (percentage) 54.72% 2.120 3.280 - -2.96% -
433.milc (max) (percentage) 51.25% 0.800 1.210 - 218.42% -
450.soplex (max) (percentage) 50.30% 1.650 2.480 - -6.06% -
473.astar (avg) (percentage) 39.13% 0.920 1.280 - -3.76% -
429.mcf (avg) (percentage) 24.53% 2.120 2.640 - -2.22% -
401.bzip2 (avg) (percentage) 20.00% 0.650 0.780 - -1.27% -
453.povray (avg) (percentage) 17.50% 0.800 0.940 - 0.00% -
433.milc (unexplained diff vs previous) 7.69% 13.000 14.000 - 600.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.37% 7239.000 6995.000 - 0.00% -
462.libquantum -1.77% 12504.000 12283.000 - 0.00% -
453.povray -1.77% 524493.000 515227.000 - -0.00% -
433.milc -1.57% 47001.000 46261.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.39% 9509.000 58.000 - -1.69% -
462.libquantum -98.70% 14409.000 187.000 - 2.19% -
450.soplex -96.37% 15112.000 548.000 - 0.18% -
482.sphinx3 -96.25% 26682.000 1001.000 - -0.10% -
444.namd -93.48% 12400.000 808.000 - -0.25% -
453.povray -92.82% 6987.000 502.000 - 0.80% -
429.mcf -91.66% 13988.000 1167.000 - 0.95% -
433.milc -91.39% 13601.000 1171.000 - 1.21% -
401.bzip2 -82.04% 16137.000 2899.000 - -0.31% -
447.dealII -77.86% 9380.000 2077.000 - -0.29% -
471.omnetpp -72.98% 10477.000 2831.000 - -0.56% -
470.lbm -70.08% 13259.000 3967.000 - 0.10% -
456.hmmer -67.72% 11854.000 3827.000 - 0.34% -
483.xalancbmk -63.56% 9376.000 3417.000 - 0.98% -
473.astar -62.83% 12272.000 4561.000 - 0.07% -
464.h264ref -58.73% 14498.000 5984.000 - -0.10% -
445.gobmk -55.76% 11093.000 4908.000 - -0.04% -
458.sjeng -51.44% 17055.000 8282.000 - -0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 914.000 1.000 - -75.00% -
482.sphinx3 (max) -99.66% 883.000 3.000 - -40.00% -
462.libquantum (max) -99.56% 919.000 4.000 - 33.33% -
470.lbm (unexplained diff vs previous) -99.50% 804.000 4.000 - -42.86% -
444.namd (max) -99.50% 1003.000 5.000 - -16.67% -
429.mcf (max) -99.47% 2281.000 12.000 - 0.00% -
403.gcc (max) -99.10% 221.000 2.000 - -33.33% -
456.hmmer (max) -98.95% 1242.000 13.000 - 8.33% -
458.sjeng (max) -98.86% 876.000 10.000 - -9.09% -
471.omnetpp (max) -98.46% 972.000 15.000 - -11.76% -
470.lbm (unexplained diff vs previous) (percentage) -98.35% 6.060 0.100 - -44.44% -
470.lbm (max) -98.02% 758.000 15.000 - -6.25% -
458.sjeng (max) (percentage) -97.47% 5.140 0.130 - -7.14% -
482.sphinx3 -97.41% 464.000 12.000 - -7.69% -
482.sphinx3 (avg) -97.41% 464.000 12.000 - -7.69% -
473.astar (max) -97.32% 822.000 22.000 - -8.33% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
483.xalancbmk (max) -97.27% 1209.000 33.000 - 230.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.08% 3.430 0.100 - -75.00% -
401.bzip2 (max) -97.04% 609.000 18.000 - -28.00% -
456.hmmer (max) (percentage) -96.76% 10.480 0.340 - 6.25% -
445.gobmk (max) -95.64% 413.000 18.000 - 0.00% -
444.namd -95.60% 318.000 14.000 - 0.00% -
444.namd (avg) -95.60% 318.000 14.000 - 0.00% -
450.soplex (max) -94.78% 249.000 13.000 - -7.14% -
450.soplex -94.67% 75.000 4.000 - 0.00% -
450.soplex (avg) -94.67% 75.000 4.000 - 0.00% -
471.omnetpp (max) (percentage) -93.97% 9.280 0.560 - -6.67% -
429.mcf (max) (percentage) -93.50% 16.310 1.060 - -1.85% -
470.lbm (max) (percentage) -93.18% 5.720 0.390 - -4.88% -
433.milc -93.10% 116.000 8.000 - 14.29% -
433.milc (avg) -93.10% 116.000 8.000 - 14.29% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
473.astar (max) (percentage) -92.54% 6.700 0.500 - -5.66% -
483.xalancbmk (max) (percentage) -92.40% 12.900 0.980 - 216.13% -
447.dealII (max) -92.38% 223.000 17.000 - 0.00% -
444.namd (max) (percentage) -91.10% 8.090 0.720 - -4.00% -
445.gobmk (max) (percentage) -90.08% 3.730 0.370 - -2.63% -
429.mcf -89.86% 296.000 30.000 - -3.23% -
429.mcf (avg) -89.86% 296.000 30.000 - -3.23% -
482.sphinx3 (max) (percentage) -89.12% 3.310 0.360 - -29.41% -
447.dealII (unexplained diff vs previous) -88.89% 54.000 6.000 - 100.00% -
473.astar (unexplained diff vs previous) -88.00% 25.000 3.000 - -40.00% -
433.milc (max) -87.04% 108.000 14.000 - 250.00% -
471.omnetpp (unexplained diff vs previous) -84.47% 103.000 16.000 - 220.00% -
470.lbm -83.67% 441.000 72.000 - -2.70% -
470.lbm (avg) -83.67% 441.000 72.000 - -2.70% -
401.bzip2 (max) (percentage) -82.80% 3.780 0.650 - -25.29% -
464.h264ref (max) -81.67% 60.000 11.000 - -15.38% -
447.dealII -81.63% 98.000 18.000 - -5.26% -
447.dealII (avg) -81.63% 98.000 18.000 - -5.26% -
401.bzip2 -78.85% 104.000 22.000 - 0.00% -
401.bzip2 (avg) -78.85% 104.000 22.000 - 0.00% -
453.povray (max) -76.00% 25.000 6.000 - 0.00% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - -66.67% -
401.bzip2 (unexplained diff vs previous) -72.73% 33.000 9.000 - -64.00% -
456.hmmer (unexplained diff vs previous) -71.74% 46.000 13.000 - 160.00% -
462.libquantum (max) (percentage) -65.67% 6.380 2.190 - 2.34% -
447.dealII (max) (percentage) -65.13% 2.380 0.830 - -2.35% -
473.astar (unexplained diff vs previous) (percentage) -65.00% 0.200 0.070 - -36.36% -
445.gobmk -63.51% 74.000 27.000 - 0.00% -
445.gobmk (avg) -63.51% 74.000 27.000 - 0.00% -
458.sjeng -53.68% 136.000 63.000 - 0.00% -
458.sjeng (avg) -53.68% 136.000 63.000 - 0.00% -
464.h264ref (max) (percentage) -52.38% 0.420 0.200 - -9.09% -
429.mcf (unexplained diff vs previous) -50.00% 22.000 11.000 - 37.50% -
447.dealII (unexplained diff vs previous) (percentage) -50.00% 0.580 0.290 - 107.14% -
473.astar -48.21% 112.000 58.000 - -3.33% -
473.astar (avg) -48.21% 112.000 58.000 - -3.33% -
471.omnetpp -47.90% 167.000 87.000 - -2.25% -
471.omnetpp (avg) -47.90% 167.000 87.000 - -2.25% -
470.lbm (avg) (percentage) -45.35% 3.330 1.820 - -3.70% -
483.xalancbmk -43.43% 198.000 112.000 - -1.75% -
483.xalancbmk (avg) -43.43% 198.000 112.000 - -1.75% -
471.omnetpp (unexplained diff vs previous) (percentage) -41.84% 0.980 0.570 - 216.67% -
456.hmmer -35.98% 164.000 105.000 - -2.78% -
456.hmmer (avg) -35.98% 164.000 105.000 - -2.78% -
444.namd (avg) (percentage) -31.13% 2.570 1.770 - -4.32% -
482.sphinx3 (avg) (percentage) -28.74% 1.740 1.240 - -4.62% -
433.milc (avg) (percentage) -17.44% 0.860 0.710 - 2.90% -
464.h264ref -16.67% 42.000 35.000 - -5.41% -
464.h264ref (avg) -16.67% 42.000 35.000 - -5.41% -
445.gobmk (avg) (percentage) -14.93% 0.670 0.570 - 0.00% -
447.dealII (avg) (percentage) -14.29% 1.050 0.900 - -4.26% -
456.hmmer (unexplained diff vs previous) (percentage) -12.82% 0.390 0.340 - 161.54% -
458.sjeng (avg) (percentage) -3.75% 0.800 0.770 - 0.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2899.000 -
403.gcc 58.000 -1.69%
429.mcf 1167.000 -
433.milc 1171.000 1.21%
444.namd 808.000 -
445.gobmk 4908.000 -
447.dealII 2077.000 -
450.soplex 548.000 -
453.povray 502.000 -
456.hmmer 3827.000 -
458.sjeng 8282.000 -
462.libquantum 187.000 2.19%
464.h264ref 5984.000 -
470.lbm 3967.000 -
471.omnetpp 2831.000 -
473.astar 4561.000 -
482.sphinx3 1001.000 -
483.xalancbmk 3417.000 -
Geometric Mean 1566.733 -
Code Size (bytes)
Name Current %
401.bzip2 33881.000 -
403.gcc 1667379.000 -
429.mcf 6995.000 -
433.milc 46261.000 -
444.namd 124278.000 -
445.gobmk 1258757.000 -
447.dealII 197510.000 -
450.soplex 150008.000 -
453.povray 515227.000 -
456.hmmer 80445.000 -
458.sjeng 79882.000 -
462.libquantum 12283.000 -
464.h264ref 302151.000 -
470.lbm 9296.000 -
471.omnetpp 321493.000 -
473.astar 15483.000 -
482.sphinx3 87672.000 -
483.xalancbmk 1612464.000 -
Geometric Mean 111246.889 -
sample variability
Name Current %
401.bzip2 22.000 -
401.bzip2 (avg) 22.000 -
401.bzip2 (avg) (percentage) 0.780 -1.27%
401.bzip2 (max) 18.000 -28.00%
401.bzip2 (max) (percentage) 0.650 -25.29%
401.bzip2 (unexplained diff vs previous) 9.000 -64.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 -63.95%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.560 -
403.gcc (max) 2.000 -33.33%
403.gcc (max) (percentage) 5.120 -1.54%
429.mcf 30.000 -3.23%
429.mcf (avg) 30.000 -3.23%
429.mcf (avg) (percentage) 2.640 -2.22%
429.mcf (max) 12.000 -
429.mcf (max) (percentage) 1.060 -1.85%
429.mcf (unexplained diff vs previous) 11.000 37.50%
429.mcf (unexplained diff vs previous) (percentage) 0.940 36.23%
433.milc 8.000 14.29%
433.milc (avg) 8.000 14.29%
433.milc (avg) (percentage) 0.710 2.90%
433.milc (max) 14.000 250.00%
433.milc (max) (percentage) 1.210 218.42%
433.milc (unexplained diff vs previous) 14.000 600.00%
433.milc (unexplained diff vs previous) (percentage) 1.200 605.88%
444.namd 14.000 -
444.namd (avg) 14.000 -
444.namd (avg) (percentage) 1.770 -4.32%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.720 -4.00%
444.namd (unexplained diff vs previous) 2.000 -66.67%
444.namd (unexplained diff vs previous) (percentage) 0.250 -66.22%
445.gobmk 27.000 -
445.gobmk (avg) 27.000 -
445.gobmk (avg) (percentage) 0.570 -
445.gobmk (max) 18.000 -
445.gobmk (max) (percentage) 0.370 -2.63%
447.dealII 18.000 -5.26%
447.dealII (avg) 18.000 -5.26%
447.dealII (avg) (percentage) 0.900 -4.26%
447.dealII (max) 17.000 -
447.dealII (max) (percentage) 0.830 -2.35%
447.dealII (unexplained diff vs previous) 6.000 100.00%
447.dealII (unexplained diff vs previous) (percentage) 0.290 107.14%
450.soplex 4.000 -
450.soplex (avg) 4.000 -
450.soplex (avg) (percentage) 0.890 -
450.soplex (max) 13.000 -7.14%
450.soplex (max) (percentage) 2.480 -6.06%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.940 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.290 -2.27%
456.hmmer 105.000 -2.78%
456.hmmer (avg) 105.000 -2.78%
456.hmmer (avg) (percentage) 2.760 -3.16%
456.hmmer (max) 13.000 8.33%
456.hmmer (max) (percentage) 0.340 6.25%
456.hmmer (unexplained diff vs previous) 13.000 160.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 161.54%
458.sjeng 63.000 -
458.sjeng (avg) 63.000 -
458.sjeng (avg) (percentage) 0.770 -
458.sjeng (max) 10.000 -9.09%
458.sjeng (max) (percentage) 0.130 -7.14%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.810 1.12%
462.libquantum (max) 4.000 33.33%
462.libquantum (max) (percentage) 2.190 2.34%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.140 -2.28%
464.h264ref 35.000 -5.41%
464.h264ref (avg) 35.000 -5.41%
464.h264ref (avg) (percentage) 0.600 -4.76%
464.h264ref (max) 11.000 -15.38%
464.h264ref (max) (percentage) 0.200 -9.09%
464.h264ref (unexplained diff vs previous) 6.000 20.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.100 25.00%
470.lbm 72.000 -2.70%
470.lbm (avg) 72.000 -2.70%
470.lbm (avg) (percentage) 1.820 -3.70%
470.lbm (max) 15.000 -6.25%
470.lbm (max) (percentage) 0.390 -4.88%
470.lbm (unexplained diff vs previous) 4.000 -42.86%
470.lbm (unexplained diff vs previous) (percentage) 0.100 -44.44%
471.omnetpp 87.000 -2.25%
471.omnetpp (avg) 87.000 -2.25%
471.omnetpp (avg) (percentage) 3.080 -2.53%
471.omnetpp (max) 15.000 -11.76%
471.omnetpp (max) (percentage) 0.560 -6.67%
471.omnetpp (unexplained diff vs previous) 16.000 220.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.570 216.67%
473.astar 58.000 -3.33%
473.astar (avg) 58.000 -3.33%
473.astar (avg) (percentage) 1.280 -3.76%
473.astar (max) 22.000 -8.33%
473.astar (max) (percentage) 0.500 -5.66%
473.astar (unexplained diff vs previous) 3.000 -40.00%
473.astar (unexplained diff vs previous) (percentage) 0.070 -36.36%
482.sphinx3 12.000 -7.69%
482.sphinx3 (avg) 12.000 -7.69%
482.sphinx3 (avg) (percentage) 1.240 -4.62%
482.sphinx3 (max) 3.000 -40.00%
482.sphinx3 (max) (percentage) 0.360 -29.41%
482.sphinx3 (unexplained diff vs previous) 1.000 -75.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -75.00%
483.xalancbmk 112.000 -1.75%
483.xalancbmk (avg) 112.000 -1.75%
483.xalancbmk (avg) (percentage) 3.280 -2.96%
483.xalancbmk (max) 33.000 230.00%
483.xalancbmk (max) (percentage) 0.980 216.13%
483.xalancbmk (unexplained diff vs previous) 33.000 266.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.970 259.26%
Geometric Mean 3.335 -12.80%