Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d08833f23fc8b25e1c3ef88274aa12f330601932 (+ 709 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/255/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0255 (llvmorg-21-init-12350-gd08833f23fc8) 2025-05-10T17:54:16 0:00:00
Previous 0254 (llvmorg-21-init-11641-g980a7e75bcc0) 2025-05-03T11:05:04 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 33 16
Performance Improvements 44 126
Added Tests 0 4
Unchanged Tests 691 622
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.22% 180.000 184.000 - -98.72% -
450.soplex 1.65% 546.000 555.000 - -96.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 422.64% 0.530 2.770 - 182.65% -
471.omnetpp (unexplained diff vs previous) 406.67% 15.000 76.000 - -26.21% -
450.soplex (unexplained diff vs previous) 350.00% 2.000 9.000 - -86.96% -
450.soplex (unexplained diff vs previous) (percentage) 337.84% 0.370 1.620 - 252.17% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 300.00% -
462.libquantum (unexplained diff vs previous) (percentage) 287.50% 0.560 2.170 - 21600.00% -
456.hmmer (unexplained diff vs previous) (percentage) 270.00% 0.100 0.370 - -5.13% -
456.hmmer (unexplained diff vs previous) 250.00% 4.000 14.000 - -69.57% -
482.sphinx3 (unexplained diff vs previous) (percentage) 156.67% 0.600 1.540 - -55.10% -
482.sphinx3 (unexplained diff vs previous) 150.00% 6.000 15.000 - -98.36% -
482.sphinx3 (max) (percentage) 106.85% 0.730 1.510 - -54.38% -
401.bzip2 (unexplained diff vs previous) 100.00% 3.000 6.000 - -81.82% -
482.sphinx3 (max) 100.00% 7.000 14.000 - -98.41% -
471.omnetpp (max) (percentage) 97.79% 1.360 2.690 - -71.01% -
471.omnetpp (max) 92.11% 38.000 73.000 - -92.49% -
401.bzip2 (unexplained diff vs previous) (percentage) 90.91% 0.110 0.210 - 5.00% -
453.povray (unexplained diff vs previous) (percentage) 70.00% 1.200 2.040 - 0.00% -
453.povray (unexplained diff vs previous) 66.67% 6.000 10.000 - 0.00% -
453.povray (max) (percentage) 65.29% 1.210 2.000 - 455.56% -
456.hmmer (max) 55.56% 9.000 14.000 - -98.87% -
453.povray (max) 50.00% 6.000 9.000 - -64.00% -
456.hmmer (max) (percentage) 42.31% 0.260 0.370 - -96.47% -
444.namd (unexplained diff vs previous) (percentage) 30.59% 0.850 1.110 - 1750.00% -
444.namd (unexplained diff vs previous) 28.57% 7.000 9.000 - 12.50% -
450.soplex 16.67% 6.000 7.000 - -90.67% -
450.soplex (avg) 16.67% 6.000 7.000 - -90.67% -
450.soplex (max) 12.50% 8.000 9.000 - -96.39% -
450.soplex (max) (percentage) 6.45% 1.550 1.650 - 0.00% -
453.povray (avg) (percentage) 3.00% 1.000 1.030 - 28.75% -
471.omnetpp (avg) (percentage) 1.63% 1.230 1.250 - -21.88% -
482.sphinx3 (avg) (percentage) 1.28% 0.780 0.790 - -54.60% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -2.69% 2824.000 2748.000 - -73.77% -
453.povray -2.00% 501.000 491.000 - -92.97% -
482.sphinx3 -1.51% 992.000 977.000 - -96.34% -
444.namd -1.10% 819.000 810.000 - -93.47% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) -83.33% 12.000 2.000 - -99.75% -
470.lbm (unexplained diff vs previous) (percentage) -83.33% 0.300 0.050 - -99.17% -
458.sjeng (unexplained diff vs previous) (percentage) -81.82% 0.110 0.020 - 0.00% -
458.sjeng (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
447.dealII (unexplained diff vs previous) -66.67% 12.000 4.000 - -92.59% -
473.astar (unexplained diff vs previous) -66.67% 12.000 4.000 - -84.00% -
447.dealII (unexplained diff vs previous) (percentage) -65.57% 0.610 0.210 - -63.79% -
473.astar (unexplained diff vs previous) (percentage) -65.38% 0.260 0.090 - -55.00% -
433.milc (max) -60.00% 10.000 4.000 - -96.30% -
433.milc (max) (percentage) -59.34% 0.910 0.370 - -53.75% -
429.mcf (unexplained diff vs previous) (percentage) -58.33% 1.680 0.700 - 337.50% -
429.mcf (unexplained diff vs previous) -57.89% 19.000 8.000 - -63.64% -
433.milc (unexplained diff vs previous) -40.00% 5.000 3.000 - -76.92% -
433.milc (unexplained diff vs previous) (percentage) -39.53% 0.430 0.260 - 160.00% -
464.h264ref (unexplained diff vs previous) -30.77% 26.000 18.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -30.23% 0.430 0.300 - 0.00% -
458.sjeng (max) (percentage) -28.57% 0.140 0.100 - -98.05% -
458.sjeng (max) -27.27% 11.000 8.000 - -99.09% -
429.mcf (max) (percentage) -24.85% 1.650 1.240 - -92.40% -
473.astar (max) (percentage) -23.08% 0.260 0.200 - -97.01% -
429.mcf (max) -22.22% 18.000 14.000 - -99.39% -
470.lbm (max) -18.75% 16.000 13.000 - -98.28% -
473.astar (max) -18.18% 11.000 9.000 - -98.91% -
470.lbm (max) (percentage) -16.67% 0.420 0.350 - -93.88% -
464.h264ref (max) (percentage) -9.30% 0.430 0.390 - -7.14% -
444.namd (max) -9.09% 11.000 10.000 - -99.00% -
447.dealII (max) -8.33% 12.000 11.000 - -95.07% -
464.h264ref (max) -8.00% 25.000 23.000 - -61.67% -
444.namd (max) (percentage) -6.67% 1.350 1.260 - -84.43% -
445.gobmk (max) -6.67% 15.000 14.000 - -96.61% -
447.dealII (max) (percentage) -6.45% 0.620 0.580 - -75.63% -
445.gobmk (max) (percentage) -6.25% 0.320 0.300 - -91.96% -
473.astar -4.76% 21.000 20.000 - -82.14% -
473.astar (avg) -4.76% 21.000 20.000 - -82.14% -
401.bzip2 (max) (percentage) -3.57% 0.280 0.270 - -92.86% -
403.gcc (max) (percentage) -3.29% 11.540 11.160 - 378.97% -
447.dealII (avg) (percentage) -2.70% 0.740 0.720 - -31.43% -
473.astar (avg) (percentage) -2.17% 0.460 0.450 - -51.09% -
462.libquantum (max) (percentage) -1.77% 2.260 2.220 - -65.20% -
433.milc (avg) (percentage) -1.35% 0.740 0.730 - -15.12% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21600.00% 0.010 2.170 - 287.50% -
444.namd (unexplained diff vs previous) (percentage) 1750.00% 0.060 1.110 - 30.59% -
403.gcc (avg) (percentage) 609.09% 0.550 3.900 - 0.00% -
453.povray (max) (percentage) 455.56% 0.360 2.000 - 65.29% -
403.gcc (max) (percentage) 378.97% 2.330 11.160 - -3.29% -
429.mcf (unexplained diff vs previous) (percentage) 337.50% 0.160 0.700 - -58.33% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 300.00% -
450.soplex (unexplained diff vs previous) (percentage) 252.17% 0.460 1.620 - 337.84% -
471.omnetpp (unexplained diff vs previous) (percentage) 182.65% 0.980 2.770 - 422.64% -
433.milc (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 - -39.53% -
450.soplex (avg) (percentage) 156.00% 0.500 1.280 - 0.79% -
462.libquantum (avg) (percentage) 98.70% 0.770 1.530 - 0.66% -
453.povray (avg) (percentage) 28.75% 0.800 1.030 - 3.00% -
444.namd (unexplained diff vs previous) 12.50% 8.000 9.000 - 28.57% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.48% 7239.000 6915.000 - 0.00% -
462.libquantum -2.95% 12504.000 12135.000 - 0.00% -
433.milc -2.41% 47001.000 45869.000 - 0.00% -
453.povray -2.35% 524493.000 512190.000 - 0.00% -
447.dealII -2.22% 195792.000 191446.000 - 0.00% -
444.namd -1.86% 124963.000 122635.000 - 0.00% -
464.h264ref -1.79% 303767.000 298329.000 - 0.00% -
401.bzip2 -1.59% 33698.000 33161.000 - 0.00% -
456.hmmer -1.35% 80861.000 79769.000 - 0.00% -
470.lbm -1.35% 9338.000 9212.000 - 0.00% -
458.sjeng -1.23% 80297.000 79307.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.39% 9509.000 58.000 - 0.00% -
462.libquantum -98.72% 14409.000 184.000 - 2.22% -
482.sphinx3 -96.34% 26682.000 977.000 - -1.51% -
450.soplex -96.33% 15112.000 555.000 - 1.65% -
444.namd -93.47% 12400.000 810.000 - -1.10% -
453.povray -92.97% 6987.000 491.000 - -2.00% -
429.mcf -91.86% 13988.000 1138.000 - 0.71% -
433.milc -91.41% 13601.000 1169.000 - -0.26% -
401.bzip2 -82.39% 16137.000 2841.000 - -0.21% -
447.dealII -79.22% 9380.000 1949.000 - -0.20% -
471.omnetpp -73.77% 10477.000 2748.000 - -2.69% -
470.lbm -69.87% 13259.000 3995.000 - 0.05% -
456.hmmer -67.72% 11854.000 3826.000 - 0.37% -
473.astar -62.47% 12272.000 4606.000 - -0.09% -
464.h264ref -58.55% 14498.000 6010.000 - 0.30% -
445.gobmk -56.17% 11093.000 4862.000 - 0.25% -
458.sjeng -52.13% 17055.000 8165.000 - -0.02% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.75% 804.000 2.000 - -83.33% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
462.libquantum (max) -99.56% 919.000 4.000 - 0.00% -
429.mcf (max) -99.39% 2281.000 14.000 - -22.22% -
470.lbm (unexplained diff vs previous) (percentage) -99.17% 6.060 0.050 - -83.33% -
458.sjeng (max) -99.09% 876.000 8.000 - -27.27% -
444.namd (max) -99.00% 1003.000 10.000 - -9.09% -
473.astar (max) -98.91% 822.000 9.000 - -18.18% -
456.hmmer (max) -98.87% 1242.000 14.000 - 55.56% -
401.bzip2 (max) -98.85% 609.000 7.000 - 0.00% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
482.sphinx3 (max) -98.41% 883.000 14.000 - 100.00% -
482.sphinx3 (unexplained diff vs previous) -98.36% 914.000 15.000 - 150.00% -
470.lbm (max) -98.28% 758.000 13.000 - -18.75% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
458.sjeng (max) (percentage) -98.05% 5.140 0.100 - -28.57% -
403.gcc (max) -97.29% 221.000 6.000 - 0.00% -
473.astar (max) (percentage) -97.01% 6.700 0.200 - -23.08% -
445.gobmk (max) -96.61% 413.000 14.000 - -6.67% -
456.hmmer (max) (percentage) -96.47% 10.480 0.370 - 42.31% -
450.soplex (max) -96.39% 249.000 9.000 - 12.50% -
433.milc (max) -96.30% 108.000 4.000 - -60.00% -
403.gcc -96.15% 52.000 2.000 - 0.00% -
403.gcc (avg) -96.15% 52.000 2.000 - 0.00% -
429.mcf -95.27% 296.000 14.000 - 0.00% -
429.mcf (avg) -95.27% 296.000 14.000 - 0.00% -
447.dealII (max) -95.07% 223.000 11.000 - -8.33% -
470.lbm -95.01% 441.000 22.000 - 0.00% -
470.lbm (avg) -95.01% 441.000 22.000 - 0.00% -
470.lbm (max) (percentage) -93.88% 5.720 0.350 - -16.67% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
401.bzip2 (max) (percentage) -92.86% 3.780 0.270 - -3.57% -
447.dealII (unexplained diff vs previous) -92.59% 54.000 4.000 - -66.67% -
471.omnetpp (max) -92.49% 972.000 73.000 - 92.11% -
429.mcf (max) (percentage) -92.40% 16.310 1.240 - -24.85% -
445.gobmk (max) (percentage) -91.96% 3.730 0.300 - -6.25% -
453.povray -90.91% 55.000 5.000 - 0.00% -
453.povray (avg) -90.91% 55.000 5.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 16.67% -
450.soplex (avg) -90.67% 75.000 7.000 - 16.67% -
401.bzip2 -88.46% 104.000 12.000 - 0.00% -
401.bzip2 (avg) -88.46% 104.000 12.000 - 0.00% -
456.hmmer -87.20% 164.000 21.000 - 0.00% -
456.hmmer (avg) -87.20% 164.000 21.000 - 0.00% -
450.soplex (unexplained diff vs previous) -86.96% 69.000 9.000 - 350.00% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
444.namd (max) (percentage) -84.43% 8.090 1.260 - -6.67% -
473.astar (unexplained diff vs previous) -84.00% 25.000 4.000 - -66.67% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -83.18% 3.330 0.560 - 0.00% -
458.sjeng -83.09% 136.000 23.000 - 0.00% -
458.sjeng (avg) -83.09% 136.000 23.000 - 0.00% -
473.astar -82.14% 112.000 20.000 - -4.76% -
473.astar (avg) -82.14% 112.000 20.000 - -4.76% -
401.bzip2 (unexplained diff vs previous) -81.82% 33.000 6.000 - 100.00% -
471.omnetpp -79.64% 167.000 34.000 - 0.00% -
471.omnetpp (avg) -79.64% 167.000 34.000 - 0.00% -
433.milc (unexplained diff vs previous) -76.92% 13.000 3.000 - -40.00% -
447.dealII (max) (percentage) -75.63% 2.380 0.580 - -6.45% -
444.namd (avg) (percentage) -73.15% 2.570 0.690 - 1.47% -
471.omnetpp (max) (percentage) -71.01% 9.280 2.690 - 97.79% -
445.gobmk (unexplained diff vs previous) -70.00% 40.000 12.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -69.57% 46.000 14.000 - 250.00% -
464.h264ref -69.05% 42.000 13.000 - 0.00% -
464.h264ref (avg) -69.05% 42.000 13.000 - 0.00% -
462.libquantum (max) (percentage) -65.20% 6.380 2.220 - -1.77% -
453.povray (max) -64.00% 25.000 9.000 - 50.00% -
447.dealII (unexplained diff vs previous) (percentage) -63.79% 0.580 0.210 - -65.57% -
458.sjeng (avg) (percentage) -63.75% 0.800 0.290 - 0.00% -
429.mcf (unexplained diff vs previous) -63.64% 22.000 8.000 - -57.89% -
464.h264ref (max) -61.67% 60.000 23.000 - -8.00% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 0.00% -
456.hmmer (avg) (percentage) -58.99% 1.390 0.570 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -55.10% 3.430 1.540 - 156.67% -
473.astar (unexplained diff vs previous) (percentage) -55.00% 0.200 0.090 - -65.38% -
482.sphinx3 (avg) (percentage) -54.60% 1.740 0.790 - 1.28% -
482.sphinx3 (max) (percentage) -54.38% 3.310 1.510 - 106.85% -
433.milc (max) (percentage) -53.75% 0.800 0.370 - -59.34% -
473.astar (avg) (percentage) -51.09% 0.920 0.450 - -2.17% -
429.mcf (avg) (percentage) -41.04% 2.120 1.250 - 0.00% -
401.bzip2 (avg) (percentage) -32.31% 0.650 0.440 - 0.00% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
447.dealII (avg) (percentage) -31.43% 1.050 0.720 - -2.70% -
445.gobmk (unexplained diff vs previous) (percentage) -30.56% 0.360 0.250 - 0.00% -
471.omnetpp (unexplained diff vs previous) -26.21% 103.000 76.000 - 406.67% -
464.h264ref (avg) (percentage) -24.14% 0.290 0.220 - 0.00% -
471.omnetpp (avg) (percentage) -21.88% 1.600 1.250 - 1.63% -
433.milc (avg) (percentage) -15.12% 0.860 0.730 - -1.35% -
464.h264ref (max) (percentage) -7.14% 0.420 0.390 - -9.30% -
456.hmmer (unexplained diff vs previous) (percentage) -5.13% 0.390 0.370 - 270.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
401.bzip2 2841.000 -
403.gcc 58.000 -
429.mcf 1138.000 -
433.milc 1169.000 -
444.namd 810.000 -1.10%
445.gobmk 4862.000 -
447.dealII 1949.000 -
450.soplex 555.000 1.65%
453.povray 491.000 -2.00%
456.hmmer 3826.000 -
458.sjeng 8165.000 -
462.libquantum 184.000 2.22%
464.h264ref 6010.000 -
470.lbm 3995.000 -
471.omnetpp 2748.000 -2.69%
473.astar 4606.000 -
482.sphinx3 977.000 -1.51%
Geometric Mean 1479.807 -
Code Size (bytes)
Name Current %
401.bzip2 33161.000 -
403.gcc 1653492.000 -
429.mcf 6915.000 -
433.milc 45869.000 -
444.namd 122635.000 -
445.gobmk 1255985.000 -
447.dealII 191446.000 -
450.soplex 146436.000 -
453.povray 512190.000 -
456.hmmer 79769.000 -
458.sjeng 79307.000 -
462.libquantum 12135.000 -
464.h264ref 298329.000 -
470.lbm 9212.000 -
471.omnetpp 317466.000 -
473.astar 15583.000 -
482.sphinx3 87400.000 -
Geometric Mean 94025.294 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.440 -
401.bzip2 (max) 7.000 -
401.bzip2 (max) (percentage) 0.270 -3.57%
401.bzip2 (unexplained diff vs previous) 6.000 100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.210 90.91%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.900 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 11.160 -3.29%
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.250 -
429.mcf (max) 14.000 -22.22%
429.mcf (max) (percentage) 1.240 -24.85%
429.mcf (unexplained diff vs previous) 8.000 -57.89%
429.mcf (unexplained diff vs previous) (percentage) 0.700 -58.33%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.730 -1.35%
433.milc (max) 4.000 -60.00%
433.milc (max) (percentage) 0.370 -59.34%
433.milc (unexplained diff vs previous) 3.000 -40.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 -39.53%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.690 -
444.namd (max) 10.000 -9.09%
444.namd (max) (percentage) 1.260 -6.67%
444.namd (unexplained diff vs previous) 9.000 28.57%
444.namd (unexplained diff vs previous) (percentage) 1.110 30.59%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 -
445.gobmk (max) 14.000 -6.67%
445.gobmk (max) (percentage) 0.300 -6.25%
445.gobmk (unexplained diff vs previous) 12.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.250 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.720 -2.70%
447.dealII (max) 11.000 -8.33%
447.dealII (max) (percentage) 0.580 -6.45%
447.dealII (unexplained diff vs previous) 4.000 -66.67%
447.dealII (unexplained diff vs previous) (percentage) 0.210 -65.57%
450.soplex 7.000 16.67%
450.soplex (avg) 7.000 16.67%
450.soplex (avg) (percentage) 1.280 -
450.soplex (max) 9.000 12.50%
450.soplex (max) (percentage) 1.650 6.45%
450.soplex (unexplained diff vs previous) 9.000 350.00%
450.soplex (unexplained diff vs previous) (percentage) 1.620 337.84%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.030 3.00%
453.povray (max) 9.000 50.00%
453.povray (max) (percentage) 2.000 65.29%
453.povray (unexplained diff vs previous) 10.000 66.67%
453.povray (unexplained diff vs previous) (percentage) 2.040 70.00%
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.570 -
456.hmmer (max) 14.000 55.56%
456.hmmer (max) (percentage) 0.370 42.31%
456.hmmer (unexplained diff vs previous) 14.000 250.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 270.00%
458.sjeng 23.000 -
458.sjeng (avg) 23.000 -
458.sjeng (avg) (percentage) 0.290 -
458.sjeng (max) 8.000 -27.27%
458.sjeng (max) (percentage) 0.100 -28.57%
458.sjeng (unexplained diff vs previous) 2.000 -77.78%
458.sjeng (unexplained diff vs previous) (percentage) 0.020 -81.82%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.530 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 2.220 -1.77%
462.libquantum (unexplained diff vs previous) 4.000 300.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.170 287.50%
464.h264ref 13.000 -
464.h264ref (avg) 13.000 -
464.h264ref (avg) (percentage) 0.220 -
464.h264ref (max) 23.000 -8.00%
464.h264ref (max) (percentage) 0.390 -9.30%
464.h264ref (unexplained diff vs previous) 18.000 -30.77%
464.h264ref (unexplained diff vs previous) (percentage) 0.300 -30.23%
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.560 -
470.lbm (max) 13.000 -18.75%
470.lbm (max) (percentage) 0.350 -16.67%
470.lbm (unexplained diff vs previous) 2.000 -83.33%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -83.33%
471.omnetpp 34.000 -
471.omnetpp (avg) 34.000 -
471.omnetpp (avg) (percentage) 1.250 1.63%
471.omnetpp (max) 73.000 92.11%
471.omnetpp (max) (percentage) 2.690 97.79%
471.omnetpp (unexplained diff vs previous) 76.000 406.67%
471.omnetpp (unexplained diff vs previous) (percentage) 2.770 422.64%
473.astar 20.000 -4.76%
473.astar (avg) 20.000 -4.76%
473.astar (avg) (percentage) 0.450 -2.17%
473.astar (max) 9.000 -18.18%
473.astar (max) (percentage) 0.200 -23.08%
473.astar (unexplained diff vs previous) 4.000 -66.67%
473.astar (unexplained diff vs previous) (percentage) 0.090 -65.38%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.790 1.28%
482.sphinx3 (max) 14.000 100.00%
482.sphinx3 (max) (percentage) 1.510 106.85%
482.sphinx3 (unexplained diff vs previous) 15.000 150.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.540 156.67%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.834 1.71%