Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c609211d912dfa9849c5ca873d40d10e32e0a975 (+ 160 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/114/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0114 (llvmorg-19-init-02418-gc609211d912d) 2024-02-12T14:39:20 0:00:00
Previous 0113 (llvmorg-19-init-02258-gb9567bc78f42) 2024-02-09T15:23:15 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 8 16
Performance Improvements 67 121
Added Tests 21 13
Unchanged Tests 684 630
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.06% 1133.000 1145.000 - -91.81% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (max) 72.73% 11.000 19.000 - -92.37% -
450.soplex (max) (percentage) 71.56% 2.110 3.620 - 119.39% -
429.mcf (unexplained diff vs previous) 33.33% 9.000 12.000 - -45.45% -
429.mcf (unexplained diff vs previous) (percentage) 32.91% 0.790 1.050 - 556.25% -
429.mcf (max) 9.09% 11.000 12.000 - -99.47% -
450.soplex (avg) (percentage) 6.72% 1.190 1.270 - 154.00% -
429.mcf (max) (percentage) 1.92% 1.040 1.060 - -93.50% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -3.62% 552.000 532.000 - -96.48% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) -96.49% 0.570 0.020 - -90.00% -
473.astar (unexplained diff vs previous) -96.30% 27.000 1.000 - -96.00% -
464.h264ref (unexplained diff vs previous) -90.00% 10.000 1.000 - 0.00% -
470.lbm (max) -90.00% 10.000 1.000 - -99.87% -
464.h264ref (unexplained diff vs previous) (percentage) -88.24% 0.170 0.020 - 0.00% -
482.sphinx3 (max) -87.50% 8.000 1.000 - -99.89% -
470.lbm (max) (percentage) -85.19% 0.270 0.040 - -99.30% -
482.sphinx3 (max) (percentage) -76.83% 0.820 0.190 - -94.26% -
483.xalancbmk (unexplained diff vs previous) (percentage) -67.42% 0.890 0.290 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -66.67% 30.000 10.000 - 0.00% -
403.gcc (max) (percentage) -66.17% 3.990 1.350 - -42.06% -
471.omnetpp (unexplained diff vs previous) -63.64% 33.000 12.000 - -88.35% -
471.omnetpp (unexplained diff vs previous) (percentage) -63.56% 1.180 0.430 - -56.12% -
470.lbm (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 - -99.67% -
470.lbm (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.88% -
473.astar (max) -25.93% 27.000 20.000 - -97.57% -
473.astar (max) (percentage) -24.14% 0.580 0.440 - -93.43% -
445.gobmk (max) -17.24% 29.000 24.000 - -94.19% -
483.xalancbmk (max) -17.24% 29.000 24.000 - -98.01% -
483.xalancbmk (max) (percentage) -17.05% 0.880 0.730 - -94.34% -
445.gobmk (max) (percentage) -15.00% 0.600 0.510 - -86.33% -
456.hmmer (max) -14.29% 14.000 12.000 - -99.03% -
447.dealII (max) -12.50% 8.000 7.000 - -96.86% -
401.bzip2 (max) -11.11% 18.000 16.000 - -97.37% -
464.h264ref (max) -11.11% 18.000 16.000 - -73.33% -
471.omnetpp (max) (percentage) -11.03% 1.360 1.210 - -86.96% -
401.bzip2 (max) (percentage) -10.94% 0.640 0.570 - -84.92% -
471.omnetpp (max) -10.53% 38.000 34.000 - -96.50% -
403.gcc (avg) (percentage) -9.92% 1.310 1.180 - 114.55% -
464.h264ref (max) (percentage) -9.68% 0.310 0.280 - -33.33% -
447.dealII (max) (percentage) -9.52% 0.420 0.380 - -84.03% -
456.hmmer (unexplained diff vs previous) -8.33% 12.000 11.000 - -76.09% -
456.hmmer (max) (percentage) -8.11% 0.370 0.340 - -96.76% -
447.dealII -7.69% 13.000 12.000 - -87.76% -
447.dealII (avg) -7.69% 13.000 12.000 - -87.76% -
456.hmmer (unexplained diff vs previous) (percentage) -6.45% 0.310 0.290 - -25.64% -
458.sjeng (max) -5.26% 19.000 18.000 - -97.95% -
458.sjeng -4.76% 42.000 40.000 - -70.59% -
458.sjeng (avg) -4.76% 42.000 40.000 - -70.59% -
453.povray (max) (percentage) -4.43% 1.580 1.510 - 319.44% -
433.milc (max) (percentage) -4.35% 0.460 0.440 - -45.00% -
458.sjeng (avg) (percentage) -3.92% 0.510 0.490 - -38.75% -
433.milc (avg) (percentage) -3.17% 0.630 0.610 - -29.07% -
470.lbm (avg) (percentage) -3.09% 0.970 0.940 - -71.77% -
444.namd (avg) (percentage) -3.08% 1.300 1.260 - -50.97% -
447.dealII (avg) (percentage) -2.90% 0.690 0.670 - -36.19% -
473.astar -2.78% 36.000 35.000 - -68.75% -
473.astar (avg) -2.78% 36.000 35.000 - -68.75% -
464.h264ref (avg) (percentage) -2.70% 0.370 0.360 - 24.14% -
483.xalancbmk (avg) (percentage) -2.66% 1.880 1.830 - -13.68% -
470.lbm -2.63% 38.000 37.000 - -91.61% -
470.lbm (avg) -2.63% 38.000 37.000 - -91.61% -
482.sphinx3 (avg) (percentage) -2.60% 0.770 0.750 - -56.90% -
473.astar (avg) (percentage) -2.56% 0.780 0.760 - -17.39% -
462.libquantum (max) (percentage) -2.06% 1.940 1.900 - -70.22% -
456.hmmer (avg) (percentage) -1.99% 1.510 1.480 - 6.47% -
456.hmmer -1.75% 57.000 56.000 - -65.85% -
456.hmmer (avg) -1.75% 57.000 56.000 - -65.85% -
471.omnetpp -1.75% 57.000 56.000 - -66.47% -
471.omnetpp (avg) -1.75% 57.000 56.000 - -66.47% -
401.bzip2 (avg) (percentage) -1.72% 0.580 0.570 - -12.31% -
483.xalancbmk -1.59% 63.000 62.000 - -68.69% -
483.xalancbmk (avg) -1.59% 63.000 62.000 - -68.69% -
471.omnetpp (avg) (percentage) -1.46% 2.050 2.020 - 26.25% -
462.libquantum (avg) (percentage) -1.32% 1.510 1.490 - 93.51% -
429.mcf (avg) (percentage) -1.10% 1.820 1.800 - -15.09% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.98% 146765.000 149668.000 - 0.00% -
471.omnetpp 1.38% 316676.000 321037.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 5400.00% 0.010 0.550 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 717.39% 0.460 3.760 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 556.25% 0.160 1.050 - 32.91% -
453.povray (max) (percentage) 319.44% 0.360 1.510 - -4.43% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - 0.00% -
450.soplex (avg) (percentage) 154.00% 0.500 1.270 - 6.72% -
450.soplex (max) (percentage) 119.39% 1.650 3.620 - 71.56% -
403.gcc (avg) (percentage) 114.55% 0.550 1.180 - -9.92% -
462.libquantum (avg) (percentage) 93.51% 0.770 1.490 - -1.32% -
433.milc (unexplained diff vs previous) (percentage) 70.00% 0.100 0.170 - 0.00% -
471.omnetpp (avg) (percentage) 26.25% 1.600 2.020 - -1.46% -
464.h264ref (avg) (percentage) 24.14% 0.290 0.360 - -2.70% -
453.povray (avg) (percentage) 21.25% 0.800 0.970 - 0.00% -
456.hmmer (avg) (percentage) 6.47% 1.390 1.480 - -1.99% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.92% 7239.000 6955.000 - 0.00% -
453.povray -2.14% 524493.000 513251.000 - -0.00% -
433.milc -2.14% 47001.000 45997.000 - 0.00% -
464.h264ref -1.83% 303767.000 298207.000 - 0.00% -
462.libquantum -1.64% 12504.000 12299.000 - 0.00% -
444.namd -1.57% 124963.000 123006.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9509.000 57.000 - 0.00% -
462.libquantum -98.73% 14409.000 183.000 - -0.54% -
450.soplex -96.48% 15112.000 532.000 - -3.62% -
482.sphinx3 -96.28% 26682.000 992.000 - 0.00% -
444.namd -93.52% 12400.000 804.000 - 0.25% -
453.povray -92.79% 6987.000 504.000 - 0.80% -
429.mcf -91.81% 13988.000 1145.000 - 1.06% -
433.milc -91.36% 13601.000 1175.000 - 0.17% -
401.bzip2 -82.27% 16137.000 2861.000 - -0.03% -
447.dealII -79.50% 9380.000 1923.000 - 0.21% -
471.omnetpp -73.18% 10477.000 2810.000 - 0.43% -
470.lbm -69.76% 13259.000 4009.000 - 0.02% -
456.hmmer -67.94% 11854.000 3800.000 - -0.29% -
483.xalancbmk -63.84% 9376.000 3390.000 - 0.30% -
473.astar -61.61% 12272.000 4711.000 - -0.02% -
464.h264ref -59.50% 14498.000 5871.000 - 0.02% -
445.gobmk -56.18% 11093.000 4861.000 - -0.21% -
458.sjeng -51.65% 17055.000 8246.000 - 0.08% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (max) -99.89% 883.000 1.000 - -87.50% -
470.lbm (unexplained diff vs previous) -99.88% 804.000 1.000 - -50.00% -
470.lbm (max) -99.87% 758.000 1.000 - -90.00% -
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.67% 6.060 0.020 - -60.00% -
444.namd (max) -99.50% 1003.000 5.000 - 0.00% -
429.mcf (max) -99.47% 2281.000 12.000 - 9.09% -
470.lbm (max) (percentage) -99.30% 5.720 0.040 - -85.19% -
456.hmmer (max) -99.03% 1242.000 12.000 - -14.29% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
483.xalancbmk (max) -98.01% 1209.000 24.000 - -17.24% -
458.sjeng (max) -97.95% 876.000 18.000 - -5.26% -
473.astar (max) -97.57% 822.000 20.000 - -25.93% -
401.bzip2 (max) -97.37% 609.000 16.000 - -11.11% -
401.bzip2 (unexplained diff vs previous) -96.97% 33.000 1.000 - 0.00% -
447.dealII (max) -96.86% 223.000 7.000 - -12.50% -
444.namd -96.86% 318.000 10.000 - 0.00% -
444.namd (avg) -96.86% 318.000 10.000 - 0.00% -
456.hmmer (max) (percentage) -96.76% 10.480 0.340 - -8.11% -
471.omnetpp (max) -96.50% 972.000 34.000 - -10.53% -
473.astar (unexplained diff vs previous) -96.00% 25.000 1.000 - -96.30% -
458.sjeng (max) (percentage) -95.53% 5.140 0.230 - -4.17% -
433.milc (max) -95.37% 108.000 5.000 - 0.00% -
483.xalancbmk (max) (percentage) -94.34% 12.900 0.730 - -17.05% -
482.sphinx3 (max) (percentage) -94.26% 3.310 0.190 - -76.83% -
445.gobmk (max) -94.19% 413.000 24.000 - -17.24% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf (max) (percentage) -93.50% 16.310 1.060 - 1.92% -
473.astar (max) (percentage) -93.43% 6.700 0.440 - -24.14% -
429.mcf -93.24% 296.000 20.000 - 0.00% -
429.mcf (avg) -93.24% 296.000 20.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
447.dealII (unexplained diff vs previous) -92.59% 54.000 4.000 - 0.00% -
450.soplex (max) -92.37% 249.000 19.000 - 72.73% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
444.namd (max) (percentage) -91.72% 8.090 0.670 - 0.00% -
470.lbm -91.61% 441.000 37.000 - -2.63% -
470.lbm (avg) -91.61% 441.000 37.000 - -2.63% -
473.astar (unexplained diff vs previous) (percentage) -90.00% 0.200 0.020 - -96.49% -
471.omnetpp (unexplained diff vs previous) -88.35% 103.000 12.000 - -63.64% -
447.dealII -87.76% 98.000 12.000 - -7.69% -
447.dealII (avg) -87.76% 98.000 12.000 - -7.69% -
471.omnetpp (max) (percentage) -86.96% 9.280 1.210 - -11.03% -
445.gobmk (max) (percentage) -86.33% 3.730 0.510 - -15.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -85.00% 0.200 0.030 - 0.00% -
401.bzip2 (max) (percentage) -84.92% 3.780 0.570 - -10.94% -
401.bzip2 -84.62% 104.000 16.000 - 0.00% -
401.bzip2 (avg) -84.62% 104.000 16.000 - 0.00% -
433.milc (unexplained diff vs previous) -84.62% 13.000 2.000 - 0.00% -
447.dealII (max) (percentage) -84.03% 2.380 0.380 - -9.52% -
456.hmmer (unexplained diff vs previous) -76.09% 46.000 11.000 - -8.33% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -75.00% 40.000 10.000 - 0.00% -
445.gobmk -74.32% 74.000 19.000 - 0.00% -
445.gobmk (avg) -74.32% 74.000 19.000 - 0.00% -
464.h264ref (max) -73.33% 60.000 16.000 - -11.11% -
453.povray (max) -72.00% 25.000 7.000 - 0.00% -
470.lbm (avg) (percentage) -71.77% 3.330 0.940 - -3.09% -
450.soplex (unexplained diff vs previous) -71.01% 69.000 20.000 - 0.00% -
458.sjeng -70.59% 136.000 40.000 - -4.76% -
458.sjeng (avg) -70.59% 136.000 40.000 - -4.76% -
462.libquantum (max) (percentage) -70.22% 6.380 1.900 - -2.06% -
473.astar -68.75% 112.000 35.000 - -2.78% -
473.astar (avg) -68.75% 112.000 35.000 - -2.78% -
483.xalancbmk -68.69% 198.000 62.000 - -1.59% -
483.xalancbmk (avg) -68.69% 198.000 62.000 - -1.59% -
471.omnetpp -66.47% 167.000 56.000 - -1.75% -
471.omnetpp (avg) -66.47% 167.000 56.000 - -1.75% -
456.hmmer -65.85% 164.000 56.000 - -1.75% -
456.hmmer (avg) -65.85% 164.000 56.000 - -1.75% -
447.dealII (unexplained diff vs previous) (percentage) -63.79% 0.580 0.210 - 0.00% -
482.sphinx3 (avg) (percentage) -56.90% 1.740 0.750 - -2.60% -
471.omnetpp (unexplained diff vs previous) (percentage) -56.12% 0.980 0.430 - -63.56% -
444.namd (avg) (percentage) -50.97% 2.570 1.260 - -3.08% -
464.h264ref -50.00% 42.000 21.000 - 0.00% -
464.h264ref (avg) -50.00% 42.000 21.000 - 0.00% -
429.mcf (unexplained diff vs previous) -45.45% 22.000 12.000 - 33.33% -
433.milc (max) (percentage) -45.00% 0.800 0.440 - -4.35% -
403.gcc (max) (percentage) -42.06% 2.330 1.350 - -66.17% -
445.gobmk (unexplained diff vs previous) (percentage) -41.67% 0.360 0.210 - 0.00% -
445.gobmk (avg) (percentage) -40.30% 0.670 0.400 - -2.44% -
458.sjeng (avg) (percentage) -38.75% 0.800 0.490 - -3.92% -
447.dealII (avg) (percentage) -36.19% 1.050 0.670 - -2.90% -
464.h264ref (max) (percentage) -33.33% 0.420 0.280 - -9.68% -
433.milc (avg) (percentage) -29.07% 0.860 0.610 - -3.17% -
456.hmmer (unexplained diff vs previous) (percentage) -25.64% 0.390 0.290 - -6.45% -
473.astar (avg) (percentage) -17.39% 0.920 0.760 - -2.56% -
429.mcf (avg) (percentage) -15.09% 2.120 1.800 - -1.10% -
483.xalancbmk (avg) (percentage) -13.68% 2.120 1.830 - -2.66% -
401.bzip2 (avg) (percentage) -12.31% 0.650 0.570 - -1.72% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2861.000 -
403.gcc 57.000 -
429.mcf 1145.000 1.06%
433.milc 1175.000 -
444.namd 804.000 -
445.gobmk 4861.000 -
447.dealII 1923.000 -
450.soplex 532.000 -3.62%
453.povray 504.000 -
456.hmmer 3800.000 -
458.sjeng 8246.000 -
462.libquantum 183.000 -
464.h264ref 5871.000 -
470.lbm 4009.000 -
471.omnetpp 2810.000 -
473.astar 4711.000 -
482.sphinx3 992.000 -
483.xalancbmk 3390.000 -
Geometric Mean 1549.668 -
Code Size (bytes)
Name Current %
401.bzip2 33597.000 -
403.gcc 1661939.000 -
429.mcf 6955.000 -
433.milc 45997.000 -
444.namd 123006.000 -
445.gobmk 1256561.000 -
447.dealII 196418.000 -
450.soplex 149668.000 -
453.povray 513251.000 -
456.hmmer 80393.000 -
458.sjeng 79906.000 -
462.libquantum 12299.000 -
464.h264ref 298207.000 -
470.lbm 9236.000 -
471.omnetpp 321037.000 -
473.astar 15571.000 -
482.sphinx3 87440.000 -
483.xalancbmk 1610600.000 -
Geometric Mean 110845.579 -
sample variability
Name Current %
401.bzip2 16.000 -
401.bzip2 (avg) 16.000 -
401.bzip2 (avg) (percentage) 0.570 -1.72%
401.bzip2 (max) 16.000 -11.11%
401.bzip2 (max) (percentage) 0.570 -10.94%
401.bzip2 (unexplained diff vs previous) 1.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.030 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.180 -9.92%
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 1.350 -66.17%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
429.mcf 20.000 -
429.mcf (avg) 20.000 -
429.mcf (avg) (percentage) 1.800 -1.10%
429.mcf (max) 12.000 9.09%
429.mcf (max) (percentage) 1.060 1.92%
429.mcf (unexplained diff vs previous) 12.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 1.050 32.91%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.610 -3.17%
433.milc (max) 5.000 -
433.milc (max) (percentage) 0.440 -4.35%
433.milc (unexplained diff vs previous) 2.000 -
433.milc (unexplained diff vs previous) (percentage) 0.170 -
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.260 -3.08%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.670 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.250 -
445.gobmk 19.000 -
445.gobmk (avg) 19.000 -
445.gobmk (avg) (percentage) 0.400 -
445.gobmk (max) 24.000 -17.24%
445.gobmk (max) (percentage) 0.510 -15.00%
445.gobmk (unexplained diff vs previous) 10.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.210 -
447.dealII 12.000 -7.69%
447.dealII (avg) 12.000 -7.69%
447.dealII (avg) (percentage) 0.670 -2.90%
447.dealII (max) 7.000 -12.50%
447.dealII (max) (percentage) 0.380 -9.52%
447.dealII (unexplained diff vs previous) 4.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.210 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.270 6.72%
450.soplex (max) 19.000 72.73%
450.soplex (max) (percentage) 3.620 71.56%
450.soplex (unexplained diff vs previous) 20.000 -
450.soplex (unexplained diff vs previous) (percentage) 3.760 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.970 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.510 -4.43%
456.hmmer 56.000 -1.75%
456.hmmer (avg) 56.000 -1.75%
456.hmmer (avg) (percentage) 1.480 -1.99%
456.hmmer (max) 12.000 -14.29%
456.hmmer (max) (percentage) 0.340 -8.11%
456.hmmer (unexplained diff vs previous) 11.000 -8.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.290 -6.45%
458.sjeng 40.000 -4.76%
458.sjeng (avg) 40.000 -4.76%
458.sjeng (avg) (percentage) 0.490 -3.92%
458.sjeng (max) 18.000 -5.26%
458.sjeng (max) (percentage) 0.230 -
458.sjeng (unexplained diff vs previous) 7.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.080 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.490 -1.32%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.900 -2.06%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.550 -
464.h264ref 21.000 -
464.h264ref (avg) 21.000 -
464.h264ref (avg) (percentage) 0.360 -2.70%
464.h264ref (max) 16.000 -11.11%
464.h264ref (max) (percentage) 0.280 -9.68%
464.h264ref (unexplained diff vs previous) 1.000 -90.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -88.24%
470.lbm 37.000 -2.63%
470.lbm (avg) 37.000 -2.63%
470.lbm (avg) (percentage) 0.940 -3.09%
470.lbm (max) 1.000 -90.00%
470.lbm (max) (percentage) 0.040 -85.19%
470.lbm (unexplained diff vs previous) 1.000 -50.00%
470.lbm (unexplained diff vs previous) (percentage) 0.020 -60.00%
471.omnetpp 56.000 -1.75%
471.omnetpp (avg) 56.000 -1.75%
471.omnetpp (avg) (percentage) 2.020 -1.46%
471.omnetpp (max) 34.000 -10.53%
471.omnetpp (max) (percentage) 1.210 -11.03%
471.omnetpp (unexplained diff vs previous) 12.000 -63.64%
471.omnetpp (unexplained diff vs previous) (percentage) 0.430 -63.56%
473.astar 35.000 -2.78%
473.astar (avg) 35.000 -2.78%
473.astar (avg) (percentage) 0.760 -2.56%
473.astar (max) 20.000 -25.93%
473.astar (max) (percentage) 0.440 -24.14%
473.astar (unexplained diff vs previous) 1.000 -96.30%
473.astar (unexplained diff vs previous) (percentage) 0.020 -96.49%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.750 -2.60%
482.sphinx3 (max) 1.000 -87.50%
482.sphinx3 (max) (percentage) 0.190 -76.83%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
483.xalancbmk 62.000 -1.59%
483.xalancbmk (avg) 62.000 -1.59%
483.xalancbmk (avg) (percentage) 1.830 -2.66%
483.xalancbmk (max) 24.000 -17.24%
483.xalancbmk (max) (percentage) 0.730 -17.05%
483.xalancbmk (unexplained diff vs previous) 10.000 -66.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.290 -67.42%
Geometric Mean 1.484 -55.59%