Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/55a02d10d9819b485f67546c6c1aee856a3cd62c (+ 209 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/124/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0124 (llvmorg-19-init-05594-g55a02d10d981) 2024-03-14T23:31:38 0:00:00
Previous 0123 (llvmorg-19-init-05385-gabe292f9f8d0) 2024-03-11T18:25:45 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 19
Performance Improvements 59 120
Added Tests 13 9
Unchanged Tests 685 632
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.70% 185.000 190.000 - -98.68% -
429.mcf 1.48% 1145.000 1162.000 - -91.69% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 2000.00% 0.010 0.210 - 0.00% -
458.sjeng (unexplained diff vs previous) 1600.00% 1.000 17.000 - 0.00% -
433.milc (unexplained diff vs previous) 400.00% 2.000 10.000 - -23.08% -
433.milc (unexplained diff vs previous) (percentage) 400.00% 0.170 0.850 - 750.00% -
464.h264ref (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) 88.89% 9.000 17.000 - -22.73% -
429.mcf (unexplained diff vs previous) (percentage) 84.81% 0.790 1.460 - 812.50% -
462.libquantum 50.00% 2.000 3.000 - -97.27% -
462.libquantum (avg) 50.00% 2.000 3.000 - -97.27% -
444.namd (max) 33.33% 6.000 8.000 - -99.20% -
444.namd (max) (percentage) 16.28% 0.860 1.000 - -87.64% -
444.namd (unexplained diff vs previous) 14.29% 7.000 8.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 13.79% 0.870 0.990 - 1550.00% -
473.astar (max) 8.11% 37.000 40.000 - -95.13% -
473.astar (max) (percentage) 6.25% 0.800 0.850 - -87.31% -
429.mcf 5.26% 19.000 20.000 - -93.24% -
429.mcf (avg) 5.26% 19.000 20.000 - -93.24% -
473.astar (unexplained diff vs previous) 5.26% 38.000 40.000 - 60.00% -
473.astar (unexplained diff vs previous) (percentage) 4.94% 0.810 0.850 - 325.00% -
462.libquantum (avg) (percentage) 1.92% 1.560 1.590 - 106.49% -
433.milc (avg) (percentage) 1.59% 0.630 0.640 - -25.58% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -9.84% 61.000 55.000 - -99.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (unexplained diff vs previous) -90.70% 43.000 4.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -90.63% 1.280 0.120 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -76.67% 0.600 0.140 - -85.71% -
471.omnetpp (unexplained diff vs previous) -76.47% 17.000 4.000 - -96.12% -
450.soplex (unexplained diff vs previous) -55.56% 9.000 4.000 - -94.20% -
450.soplex (unexplained diff vs previous) (percentage) -55.09% 1.670 0.750 - 63.04% -
447.dealII (max) -50.00% 12.000 6.000 - -97.31% -
482.sphinx3 (unexplained diff vs previous) -50.00% 12.000 6.000 - -99.34% -
482.sphinx3 (unexplained diff vs previous) (percentage) -50.00% 1.200 0.600 - -82.51% -
447.dealII (max) (percentage) -47.69% 0.650 0.340 - -85.71% -
456.hmmer (unexplained diff vs previous) -45.45% 11.000 6.000 - -86.96% -
401.bzip2 (unexplained diff vs previous) (percentage) -45.16% 0.310 0.170 - -15.00% -
456.hmmer (unexplained diff vs previous) (percentage) -44.83% 0.290 0.160 - -58.97% -
401.bzip2 (unexplained diff vs previous) -44.44% 9.000 5.000 - -84.85% -
401.bzip2 (max) -38.46% 13.000 8.000 - -98.69% -
401.bzip2 (max) (percentage) -38.30% 0.470 0.290 - -92.33% -
456.hmmer (max) -27.27% 11.000 8.000 - -99.36% -
483.xalancbmk (max) -26.19% 42.000 31.000 - -97.44% -
483.xalancbmk (max) (percentage) -25.40% 1.260 0.940 - -92.71% -
470.lbm (max) -25.00% 4.000 3.000 - -99.60% -
456.hmmer (max) (percentage) -24.14% 0.290 0.220 - -97.90% -
470.lbm (max) (percentage) -10.00% 0.100 0.090 - -98.43% -
429.mcf (max) (percentage) -8.72% 2.180 1.990 - -87.80% -
482.sphinx3 (max) -8.33% 24.000 22.000 - -97.51% -
471.omnetpp (max) -7.84% 51.000 47.000 - -95.16% -
482.sphinx3 (max) (percentage) -7.26% 2.480 2.300 - -30.51% -
471.omnetpp (max) (percentage) -6.59% 1.820 1.700 - -81.68% -
458.sjeng (max) -6.45% 31.000 29.000 - -96.69% -
450.soplex (max) -5.56% 18.000 17.000 - -93.17% -
458.sjeng (max) (percentage) -5.26% 0.380 0.360 - -93.00% -
445.gobmk (max) -5.26% 19.000 18.000 - -95.64% -
445.gobmk (max) (percentage) -5.00% 0.400 0.380 - -89.81% -
429.mcf (max) -4.17% 24.000 23.000 - -98.99% -
453.povray (avg) (percentage) -4.17% 0.960 0.920 - 15.00% -
456.hmmer -3.92% 51.000 49.000 - -70.12% -
456.hmmer (avg) -3.92% 51.000 49.000 - -70.12% -
433.milc (max) (percentage) -3.74% 1.070 1.030 - 28.75% -
450.soplex (max) (percentage) -3.24% 3.390 3.280 - 98.79% -
447.dealII (avg) (percentage) -3.08% 0.650 0.630 - -40.00% -
470.lbm -2.94% 34.000 33.000 - -92.52% -
470.lbm (avg) -2.94% 34.000 33.000 - -92.52% -
458.sjeng -2.78% 36.000 35.000 - -74.26% -
458.sjeng (avg) -2.78% 36.000 35.000 - -74.26% -
453.povray (max) (percentage) -2.52% 1.190 1.160 - 222.22% -
483.xalancbmk (avg) (percentage) -2.34% 1.710 1.670 - -21.23% -
470.lbm (avg) (percentage) -2.33% 0.860 0.840 - -74.77% -
458.sjeng (avg) (percentage) -2.27% 0.440 0.430 - -46.25% -
456.hmmer (avg) (percentage) -2.24% 1.340 1.310 - -5.76% -
471.omnetpp (avg) (percentage) -2.06% 1.940 1.900 - 18.75% -
401.bzip2 (avg) (percentage) -1.96% 0.510 0.500 - -23.08% -
471.omnetpp -1.85% 54.000 53.000 - -68.26% -
471.omnetpp (avg) -1.85% 54.000 53.000 - -68.26% -
483.xalancbmk -1.75% 57.000 56.000 - -71.72% -
483.xalancbmk (avg) -1.75% 57.000 56.000 - -71.72% -
403.gcc (max) (percentage) -1.57% 1.270 1.250 - -46.35% -
450.soplex (avg) (percentage) -1.42% 1.410 1.390 - 178.00% -
482.sphinx3 (avg) (percentage) -1.16% 0.860 0.850 - -51.15% -
462.libquantum (max) (percentage) -1.10% 2.730 2.700 - -57.68% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.97% 146765.000 149660.000 - 0.00% -
471.omnetpp 1.38% 316676.000 321037.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 26200.00% 0.010 2.630 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 1550.00% 0.060 0.990 - 13.79% -
429.mcf (unexplained diff vs previous) (percentage) 812.50% 0.160 1.460 - 84.81% -
433.milc (unexplained diff vs previous) (percentage) 750.00% 0.100 0.850 - 400.00% -
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 325.00% 0.200 0.850 - 4.94% -
453.povray (max) (percentage) 222.22% 0.360 1.160 - -2.52% -
450.soplex (avg) (percentage) 178.00% 0.500 1.390 - -1.42% -
403.gcc (avg) (percentage) 114.55% 0.550 1.180 - 0.00% -
462.libquantum (avg) (percentage) 106.49% 0.770 1.590 - 1.92% -
450.soplex (max) (percentage) 98.79% 1.650 3.280 - -3.24% -
450.soplex (unexplained diff vs previous) (percentage) 63.04% 0.460 0.750 - -55.09% -
473.astar (unexplained diff vs previous) 60.00% 25.000 40.000 - 5.26% -
433.milc (max) (percentage) 28.75% 0.800 1.030 - -3.74% -
471.omnetpp (avg) (percentage) 18.75% 1.600 1.900 - -2.06% -
453.povray (avg) (percentage) 15.00% 0.800 0.920 - -4.17% -
464.h264ref (avg) (percentage) 10.34% 0.290 0.320 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.92% 7239.000 6955.000 - 0.00% -
462.libquantum -2.98% 12504.000 12131.000 - 0.00% -
453.povray -2.16% 524493.000 513187.000 - 0.00% -
433.milc -2.14% 47001.000 45997.000 - 0.00% -
464.h264ref -1.82% 303767.000 298231.000 - -0.00% -
444.namd -1.57% 124963.000 123006.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.42% 9509.000 55.000 - -9.84% -
462.libquantum -98.68% 14409.000 190.000 - 2.70% -
450.soplex -96.47% 15112.000 534.000 - -0.74% -
482.sphinx3 -96.27% 26682.000 994.000 - -0.60% -
444.namd -93.46% 12400.000 811.000 - 1.00% -
453.povray -92.82% 6987.000 502.000 - 0.20% -
429.mcf -91.69% 13988.000 1162.000 - 1.48% -
433.milc -91.31% 13601.000 1182.000 - 0.85% -
401.bzip2 -82.18% 16137.000 2876.000 - 0.17% -
447.dealII -78.98% 9380.000 1972.000 - -0.30% -
471.omnetpp -73.20% 10477.000 2808.000 - -0.14% -
470.lbm -69.77% 13259.000 4008.000 - -0.07% -
456.hmmer -67.84% 11854.000 3812.000 - 0.16% -
483.xalancbmk -64.09% 9376.000 3367.000 - 0.12% -
473.astar -61.51% 12272.000 4723.000 - 0.85% -
464.h264ref -59.52% 14498.000 5869.000 - 0.03% -
445.gobmk -55.93% 11093.000 4889.000 - 0.33% -
458.sjeng -51.59% 17055.000 8257.000 - 0.21% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.63% 804.000 3.000 - 0.00% -
470.lbm (max) -99.60% 758.000 3.000 - -25.00% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
456.hmmer (max) -99.36% 1242.000 8.000 - -27.27% -
482.sphinx3 (unexplained diff vs previous) -99.34% 914.000 6.000 - -50.00% -
444.namd (max) -99.20% 1003.000 8.000 - 33.33% -
429.mcf (max) -98.99% 2281.000 23.000 - -4.17% -
470.lbm (unexplained diff vs previous) (percentage) -98.84% 6.060 0.070 - 0.00% -
401.bzip2 (max) -98.69% 609.000 8.000 - -38.46% -
470.lbm (max) (percentage) -98.43% 5.720 0.090 - -10.00% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
456.hmmer (max) (percentage) -97.90% 10.480 0.220 - -24.14% -
482.sphinx3 (max) -97.51% 883.000 22.000 - -8.33% -
483.xalancbmk (max) -97.44% 1209.000 31.000 - -26.19% -
447.dealII (max) -97.31% 223.000 6.000 - -50.00% -
462.libquantum -97.27% 110.000 3.000 - 50.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 50.00% -
444.namd -97.17% 318.000 9.000 - 0.00% -
444.namd (avg) -97.17% 318.000 9.000 - 0.00% -
458.sjeng (max) -96.69% 876.000 29.000 - -6.45% -
471.omnetpp (unexplained diff vs previous) -96.12% 103.000 4.000 - -76.47% -
445.gobmk (max) -95.64% 413.000 18.000 - -5.26% -
471.omnetpp (max) -95.16% 972.000 47.000 - -7.84% -
473.astar (max) -95.13% 822.000 40.000 - 8.11% -
450.soplex (unexplained diff vs previous) -94.20% 69.000 4.000 - -55.56% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf -93.24% 296.000 20.000 - 5.26% -
429.mcf (avg) -93.24% 296.000 20.000 - 5.26% -
450.soplex (max) -93.17% 249.000 17.000 - -5.56% -
458.sjeng (max) (percentage) -93.00% 5.140 0.360 - -5.26% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
483.xalancbmk (max) (percentage) -92.71% 12.900 0.940 - -25.40% -
470.lbm -92.52% 441.000 33.000 - -2.94% -
470.lbm (avg) -92.52% 441.000 33.000 - -2.94% -
401.bzip2 (max) (percentage) -92.33% 3.780 0.290 - -38.30% -
464.h264ref (max) -91.67% 60.000 5.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
445.gobmk (max) (percentage) -89.81% 3.730 0.380 - -5.00% -
433.milc (max) -88.89% 108.000 12.000 - 0.00% -
447.dealII (unexplained diff vs previous) -88.89% 54.000 6.000 - 0.00% -
429.mcf (max) (percentage) -87.80% 16.310 1.990 - -8.72% -
447.dealII -87.76% 98.000 12.000 - 0.00% -
447.dealII (avg) -87.76% 98.000 12.000 - 0.00% -
444.namd (max) (percentage) -87.64% 8.090 1.000 - 16.28% -
473.astar (max) (percentage) -87.31% 6.700 0.850 - 6.25% -
456.hmmer (unexplained diff vs previous) -86.96% 46.000 6.000 - -45.45% -
401.bzip2 -86.54% 104.000 14.000 - 0.00% -
401.bzip2 (avg) -86.54% 104.000 14.000 - 0.00% -
447.dealII (max) (percentage) -85.71% 2.380 0.340 - -47.69% -
471.omnetpp (unexplained diff vs previous) (percentage) -85.71% 0.980 0.140 - -76.67% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 - -44.44% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.51% 3.430 0.600 - -50.00% -
471.omnetpp (max) (percentage) -81.68% 9.280 1.700 - -6.59% -
453.povray (max) -80.00% 25.000 5.000 - 0.00% -
464.h264ref (max) (percentage) -78.57% 0.420 0.090 - 0.00% -
445.gobmk -75.68% 74.000 18.000 - 0.00% -
445.gobmk (avg) -75.68% 74.000 18.000 - 0.00% -
470.lbm (avg) (percentage) -74.77% 3.330 0.840 - -2.33% -
458.sjeng -74.26% 136.000 35.000 - -2.78% -
458.sjeng (avg) -74.26% 136.000 35.000 - -2.78% -
483.xalancbmk -71.72% 198.000 56.000 - -1.75% -
483.xalancbmk (avg) -71.72% 198.000 56.000 - -1.75% -
473.astar -70.54% 112.000 33.000 - 0.00% -
473.astar (avg) -70.54% 112.000 33.000 - 0.00% -
456.hmmer -70.12% 164.000 49.000 - -3.92% -
456.hmmer (avg) -70.12% 164.000 49.000 - -3.92% -
471.omnetpp -68.26% 167.000 53.000 - -1.85% -
471.omnetpp (avg) -68.26% 167.000 53.000 - -1.85% -
445.gobmk (unexplained diff vs previous) -60.00% 40.000 16.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -58.97% 0.390 0.160 - -44.83% -
462.libquantum (max) (percentage) -57.68% 6.380 2.700 - -1.10% -
464.h264ref -57.14% 42.000 18.000 - 0.00% -
464.h264ref (avg) -57.14% 42.000 18.000 - 0.00% -
444.namd (avg) (percentage) -55.64% 2.570 1.140 - -0.87% -
482.sphinx3 (avg) (percentage) -51.15% 1.740 0.850 - -1.16% -
447.dealII (unexplained diff vs previous) (percentage) -48.28% 0.580 0.300 - 0.00% -
403.gcc (max) (percentage) -46.35% 2.330 1.250 - -1.57% -
458.sjeng (avg) (percentage) -46.25% 0.800 0.430 - -2.27% -
445.gobmk (avg) (percentage) -43.28% 0.670 0.380 - 0.00% -
447.dealII (avg) (percentage) -40.00% 1.050 0.630 - -3.08% -
482.sphinx3 (max) (percentage) -30.51% 3.310 2.300 - -7.26% -
433.milc (avg) (percentage) -25.58% 0.860 0.640 - 1.59% -
401.bzip2 (avg) (percentage) -23.08% 0.650 0.500 - -1.96% -
433.milc (unexplained diff vs previous) -23.08% 13.000 10.000 - 400.00% -
473.astar (avg) (percentage) -22.83% 0.920 0.710 - 0.00% -
429.mcf (unexplained diff vs previous) -22.73% 22.000 17.000 - 88.89% -
483.xalancbmk (avg) (percentage) -21.23% 2.120 1.670 - -2.34% -
429.mcf (avg) (percentage) -18.40% 2.120 1.730 - -0.57% -
401.bzip2 (unexplained diff vs previous) (percentage) -15.00% 0.200 0.170 - -45.16% -
445.gobmk (unexplained diff vs previous) (percentage) -8.33% 0.360 0.330 - 0.00% -
456.hmmer (avg) (percentage) -5.76% 1.390 1.310 - -2.24% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2876.000 -
403.gcc 55.000 -9.84%
429.mcf 1162.000 1.48%
433.milc 1182.000 -
444.namd 811.000 -
445.gobmk 4889.000 -
447.dealII 1972.000 -
450.soplex 534.000 -
453.povray 502.000 -
456.hmmer 3812.000 -
458.sjeng 8257.000 -
462.libquantum 190.000 2.70%
464.h264ref 5869.000 -
470.lbm 4008.000 -
471.omnetpp 2808.000 -
473.astar 4723.000 -
482.sphinx3 994.000 -
483.xalancbmk 3367.000 -
Geometric Mean 1555.535 -
Code Size (bytes)
Name Current %
401.bzip2 33589.000 -
403.gcc 1661723.000 -
429.mcf 6955.000 -
433.milc 45997.000 -
444.namd 123006.000 -
445.gobmk 1256521.000 -
447.dealII 196398.000 -
450.soplex 149660.000 -
453.povray 513187.000 -
456.hmmer 80393.000 -
458.sjeng 79906.000 -
462.libquantum 12131.000 -
464.h264ref 298231.000 -
470.lbm 9236.000 -
471.omnetpp 321037.000 -
473.astar 15571.000 -
482.sphinx3 87456.000 -
483.xalancbmk 1610384.000 -
Geometric Mean 110757.526 -
sample variability
Name Current %
401.bzip2 14.000 -
401.bzip2 (avg) 14.000 -
401.bzip2 (avg) (percentage) 0.500 -1.96%
401.bzip2 (max) 8.000 -38.46%
401.bzip2 (max) (percentage) 0.290 -38.30%
401.bzip2 (unexplained diff vs previous) 5.000 -44.44%
401.bzip2 (unexplained diff vs previous) (percentage) 0.170 -45.16%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.180 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 1.250 -1.57%
429.mcf 20.000 5.26%
429.mcf (avg) 20.000 5.26%
429.mcf (avg) (percentage) 1.730 -
429.mcf (max) 23.000 -4.17%
429.mcf (max) (percentage) 1.990 -8.72%
429.mcf (unexplained diff vs previous) 17.000 88.89%
429.mcf (unexplained diff vs previous) (percentage) 1.460 84.81%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 1.59%
433.milc (max) 12.000 -
433.milc (max) (percentage) 1.030 -3.74%
433.milc (unexplained diff vs previous) 10.000 400.00%
433.milc (unexplained diff vs previous) (percentage) 0.850 400.00%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.140 -
444.namd (max) 8.000 33.33%
444.namd (max) (percentage) 1.000 16.28%
444.namd (unexplained diff vs previous) 8.000 14.29%
444.namd (unexplained diff vs previous) (percentage) 0.990 13.79%
445.gobmk 18.000 -
445.gobmk (avg) 18.000 -
445.gobmk (avg) (percentage) 0.380 -
445.gobmk (max) 18.000 -5.26%
445.gobmk (max) (percentage) 0.380 -5.00%
445.gobmk (unexplained diff vs previous) 16.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.330 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.630 -3.08%
447.dealII (max) 6.000 -50.00%
447.dealII (max) (percentage) 0.340 -47.69%
447.dealII (unexplained diff vs previous) 6.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.300 -
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.390 -1.42%
450.soplex (max) 17.000 -5.56%
450.soplex (max) (percentage) 3.280 -3.24%
450.soplex (unexplained diff vs previous) 4.000 -55.56%
450.soplex (unexplained diff vs previous) (percentage) 0.750 -55.09%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.920 -4.17%
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.160 -2.52%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.200 -
456.hmmer 49.000 -3.92%
456.hmmer (avg) 49.000 -3.92%
456.hmmer (avg) (percentage) 1.310 -2.24%
456.hmmer (max) 8.000 -27.27%
456.hmmer (max) (percentage) 0.220 -24.14%
456.hmmer (unexplained diff vs previous) 6.000 -45.45%
456.hmmer (unexplained diff vs previous) (percentage) 0.160 -44.83%
458.sjeng 35.000 -2.78%
458.sjeng (avg) 35.000 -2.78%
458.sjeng (avg) (percentage) 0.430 -2.27%
458.sjeng (max) 29.000 -6.45%
458.sjeng (max) (percentage) 0.360 -5.26%
458.sjeng (unexplained diff vs previous) 17.000 1600.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.210 2000.00%
462.libquantum 3.000 50.00%
462.libquantum (avg) 3.000 50.00%
462.libquantum (avg) (percentage) 1.590 1.92%
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.700 -1.10%
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.630 -
464.h264ref 18.000 -
464.h264ref (avg) 18.000 -
464.h264ref (avg) (percentage) 0.320 -
464.h264ref (max) 5.000 -
464.h264ref (max) (percentage) 0.090 -
464.h264ref (unexplained diff vs previous) 2.000 100.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.030 -
470.lbm 33.000 -2.94%
470.lbm (avg) 33.000 -2.94%
470.lbm (avg) (percentage) 0.840 -2.33%
470.lbm (max) 3.000 -25.00%
470.lbm (max) (percentage) 0.090 -10.00%
470.lbm (unexplained diff vs previous) 3.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.070 -
471.omnetpp 53.000 -1.85%
471.omnetpp (avg) 53.000 -1.85%
471.omnetpp (avg) (percentage) 1.900 -2.06%
471.omnetpp (max) 47.000 -7.84%
471.omnetpp (max) (percentage) 1.700 -6.59%
471.omnetpp (unexplained diff vs previous) 4.000 -76.47%
471.omnetpp (unexplained diff vs previous) (percentage) 0.140 -76.67%
473.astar 33.000 -
473.astar (avg) 33.000 -
473.astar (avg) (percentage) 0.710 -
473.astar (max) 40.000 8.11%
473.astar (max) (percentage) 0.850 6.25%
473.astar (unexplained diff vs previous) 40.000 5.26%
473.astar (unexplained diff vs previous) (percentage) 0.850 4.94%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.850 -1.16%
482.sphinx3 (max) 22.000 -8.33%
482.sphinx3 (max) (percentage) 2.300 -7.26%
482.sphinx3 (unexplained diff vs previous) 6.000 -50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.600 -50.00%
483.xalancbmk 56.000 -1.75%
483.xalancbmk (avg) 56.000 -1.75%
483.xalancbmk (avg) (percentage) 1.670 -2.34%
483.xalancbmk (max) 31.000 -26.19%
483.xalancbmk (max) (percentage) 0.940 -25.40%
483.xalancbmk (unexplained diff vs previous) 4.000 -90.70%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.120 -90.63%
Geometric Mean 2.478 -31.96%