Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/deaf2537c29a8973dd34ca551913681ae9c49c3c (+ 424 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/260/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0260 (llvmorg-21-init-14501-gdeaf2537c29a) 2025-06-01T15:20:23 0:00:00
Previous 0259 (llvmorg-21-init-14077-g6f64a600649a) 2025-05-28T05:17:41 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 17
Performance Improvements 51 125
Added Tests 4 4
Unchanged Tests 679 610
Total Tests 756

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15.38% 52.000 60.000 - -99.37% -
462.libquantum 2.75% 182.000 187.000 - -98.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) 600.00% 1.000 7.000 - -46.15% -
433.milc (unexplained diff vs previous) (percentage) 566.67% 0.090 0.600 - 500.00% -
429.mcf (unexplained diff vs previous) 300.00% 1.000 4.000 - -81.82% -
429.mcf (unexplained diff vs previous) (percentage) 288.89% 0.090 0.350 - 118.75% -
450.soplex (unexplained diff vs previous) (percentage) 286.11% 0.720 2.780 - 504.35% -
450.soplex (unexplained diff vs previous) 275.00% 4.000 15.000 - -78.26% -
444.namd (unexplained diff vs previous) (percentage) 208.33% 0.120 0.370 - 516.67% -
444.namd (unexplained diff vs previous) 200.00% 1.000 3.000 - -62.50% -
433.milc (max) 133.33% 3.000 7.000 - -93.52% -
450.soplex (max) 133.33% 6.000 14.000 - -94.38% -
450.soplex (max) (percentage) 132.76% 1.160 2.700 - 63.64% -
433.milc (max) (percentage) 100.00% 0.300 0.600 - -25.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 70.00% 0.300 0.510 - -85.13% -
482.sphinx3 (unexplained diff vs previous) 66.67% 3.000 5.000 - -99.45% -
471.omnetpp (unexplained diff vs previous) (percentage) 52.11% 0.710 1.080 - 10.20% -
445.gobmk (max) 50.00% 12.000 18.000 - -95.64% -
445.gobmk (max) (percentage) 50.00% 0.260 0.390 - -89.54% -
471.omnetpp (unexplained diff vs previous) 50.00% 20.000 30.000 - -70.87% -
450.soplex (avg) (percentage) 1.59% 1.260 1.280 - 156.00% -
462.libquantum (avg) (percentage) 1.27% 1.580 1.600 - 107.79% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -2.70% 555.000 540.000 - -96.43% -
453.povray -1.20% 501.000 495.000 - -92.92% -
471.omnetpp -1.07% 2806.000 2776.000 - -73.50% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) -91.67% 0.240 0.020 - -90.00% -
473.astar (unexplained diff vs previous) -90.91% 11.000 1.000 - -96.00% -
464.h264ref (max) (percentage) -53.12% 0.320 0.150 - -64.29% -
464.h264ref (max) -52.63% 19.000 9.000 - -85.00% -
447.dealII (unexplained diff vs previous) -50.00% 12.000 6.000 - -88.89% -
447.dealII (unexplained diff vs previous) (percentage) -50.00% 0.620 0.310 - -46.55% -
456.hmmer (max) -50.00% 12.000 6.000 - -99.52% -
456.hmmer (max) (percentage) -50.00% 0.320 0.160 - -98.47% -
456.hmmer (unexplained diff vs previous) (percentage) -38.10% 0.210 0.130 - -66.67% -
456.hmmer (unexplained diff vs previous) -37.50% 8.000 5.000 - -89.13% -
470.lbm (unexplained diff vs previous) -28.57% 14.000 10.000 - -98.76% -
470.lbm (unexplained diff vs previous) (percentage) -28.57% 0.350 0.250 - -95.87% -
473.astar (max) -27.27% 11.000 8.000 - -99.03% -
470.lbm (max) (percentage) -25.71% 0.350 0.260 - -95.45% -
464.h264ref (unexplained diff vs previous) -25.00% 8.000 6.000 - 0.00% -
473.astar (max) (percentage) -25.00% 0.240 0.180 - -97.31% -
470.lbm (max) -23.08% 13.000 10.000 - -98.68% -
464.h264ref (unexplained diff vs previous) (percentage) -23.08% 0.130 0.100 - 0.00% -
453.povray -20.00% 5.000 4.000 - -92.73% -
453.povray (avg) -20.00% 5.000 4.000 - -92.73% -
444.namd (max) -16.67% 6.000 5.000 - -99.50% -
429.mcf (max) -14.29% 7.000 6.000 - -99.74% -
453.povray (max) -12.50% 8.000 7.000 - -72.00% -
447.dealII (max) (percentage) -11.48% 0.610 0.540 - -77.31% -
447.dealII (max) -9.09% 11.000 10.000 - -95.52% -
401.bzip2 -8.33% 12.000 11.000 - -89.42% -
401.bzip2 (avg) -8.33% 12.000 11.000 - -89.42% -
458.sjeng (max) -8.33% 24.000 22.000 - -97.49% -
447.dealII -7.14% 14.000 13.000 - -86.73% -
447.dealII (avg) -7.14% 14.000 13.000 - -86.73% -
444.namd (max) (percentage) -6.76% 0.740 0.690 - -91.47% -
458.sjeng (max) (percentage) -6.67% 0.300 0.280 - -94.55% -
482.sphinx3 (max) (percentage) -6.40% 1.720 1.610 - -51.36% -
482.sphinx3 (max) -6.25% 16.000 15.000 - -98.30% -
429.mcf (max) (percentage) -6.15% 0.650 0.610 - -96.26% -
462.libquantum (max) (percentage) -5.82% 2.920 2.750 - -56.90% -
471.omnetpp (max) -5.77% 52.000 49.000 - -94.96% -
471.omnetpp (max) (percentage) -4.79% 1.880 1.790 - -80.71% -
456.hmmer -4.76% 21.000 20.000 - -87.80% -
456.hmmer (avg) -4.76% 21.000 20.000 - -87.80% -
453.povray (max) (percentage) -4.19% 1.670 1.600 - 344.44% -
403.gcc (max) (percentage) -2.97% 9.770 9.480 - 306.87% -
462.libquantum (unexplained diff vs previous) (percentage) -2.91% 2.750 2.670 - 26600.00% -
401.bzip2 (avg) (percentage) -2.33% 0.430 0.420 - -35.38% -
470.lbm (avg) (percentage) -1.82% 0.550 0.540 - -83.78% -
456.hmmer (avg) (percentage) -1.79% 0.560 0.550 - -60.43% -
447.dealII (avg) (percentage) -1.39% 0.720 0.710 - -32.38% -
482.sphinx3 (avg) (percentage) -1.23% 0.810 0.800 - -54.02% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 26600.00% 0.010 2.670 - -2.91% -
403.gcc (avg) (percentage) 607.27% 0.550 3.890 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 516.67% 0.060 0.370 - 208.33% -
450.soplex (unexplained diff vs previous) (percentage) 504.35% 0.460 2.780 - 286.11% -
433.milc (unexplained diff vs previous) (percentage) 500.00% 0.100 0.600 - 566.67% -
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
453.povray (max) (percentage) 344.44% 0.360 1.600 - -4.19% -
403.gcc (max) (percentage) 306.87% 2.330 9.480 - -2.97% -
450.soplex (avg) (percentage) 156.00% 0.500 1.280 - 1.59% -
429.mcf (unexplained diff vs previous) (percentage) 118.75% 0.160 0.350 - 288.89% -
462.libquantum (avg) (percentage) 107.79% 0.770 1.600 - 1.27% -
450.soplex (max) (percentage) 63.64% 1.650 2.700 - 132.76% -
453.povray (avg) (percentage) 25.00% 0.800 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 10.20% 0.980 1.080 - 52.11% -
445.gobmk (unexplained diff vs previous) (percentage) 8.33% 0.360 0.390 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.48% 7239.000 6915.000 - 0.00% -
462.libquantum -2.95% 12504.000 12135.000 - 0.00% -
433.milc -2.41% 47001.000 45869.000 - 0.00% -
453.povray -2.34% 524493.000 512198.000 - 0.00% -
447.dealII -2.23% 195792.000 191430.000 - 0.00% -
444.namd -1.86% 124963.000 122635.000 - 0.00% -
464.h264ref -1.75% 303767.000 298465.000 - 0.05% -
401.bzip2 -1.59% 33698.000 33161.000 - 0.00% -
456.hmmer -1.35% 80861.000 79769.000 - 0.00% -
470.lbm -1.35% 9338.000 9212.000 - 0.00% -
458.sjeng -1.24% 80297.000 79299.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.37% 9509.000 60.000 - 15.38% -
462.libquantum -98.70% 14409.000 187.000 - 2.75% -
450.soplex -96.43% 15112.000 540.000 - -2.70% -
482.sphinx3 -96.29% 26682.000 990.000 - 0.51% -
444.namd -93.44% 12400.000 814.000 - 0.37% -
453.povray -92.92% 6987.000 495.000 - -1.20% -
429.mcf -91.81% 13988.000 1146.000 - 0.35% -
433.milc -91.36% 13601.000 1175.000 - 0.60% -
401.bzip2 -82.36% 16137.000 2846.000 - 0.00% -
447.dealII -79.15% 9380.000 1956.000 - 0.31% -
471.omnetpp -73.50% 10477.000 2776.000 - -1.07% -
470.lbm -69.92% 13259.000 3988.000 - 0.25% -
456.hmmer -67.88% 11854.000 3808.000 - -0.13% -
473.astar -62.46% 12272.000 4607.000 - 0.02% -
464.h264ref -58.52% 14498.000 6014.000 - 0.10% -
445.gobmk -56.17% 11093.000 4862.000 - 0.39% -
458.sjeng -52.25% 17055.000 8143.000 - 0.07% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.74% 2281.000 6.000 - -14.29% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
456.hmmer (max) -99.52% 1242.000 6.000 - -50.00% -
444.namd (max) -99.50% 1003.000 5.000 - -16.67% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.45% 914.000 5.000 - 66.67% -
401.bzip2 (max) -99.18% 609.000 5.000 - 0.00% -
473.astar (max) -99.03% 822.000 8.000 - -27.27% -
470.lbm (unexplained diff vs previous) -98.76% 804.000 10.000 - -28.57% -
470.lbm (max) -98.68% 758.000 10.000 - -23.08% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
456.hmmer (max) (percentage) -98.47% 10.480 0.160 - -50.00% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
482.sphinx3 (max) -98.30% 883.000 15.000 - -6.25% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc (max) -97.74% 221.000 5.000 - 0.00% -
458.sjeng (max) -97.49% 876.000 22.000 - -8.33% -
473.astar (max) (percentage) -97.31% 6.700 0.180 - -25.00% -
429.mcf (max) (percentage) -96.26% 16.310 0.610 - -6.15% -
403.gcc -96.15% 52.000 2.000 - 0.00% -
403.gcc (avg) -96.15% 52.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -96.00% 25.000 1.000 - -90.91% -
470.lbm (unexplained diff vs previous) (percentage) -95.87% 6.060 0.250 - -28.57% -
445.gobmk (max) -95.64% 413.000 18.000 - 50.00% -
429.mcf -95.61% 296.000 13.000 - 0.00% -
429.mcf (avg) -95.61% 296.000 13.000 - 0.00% -
447.dealII (max) -95.52% 223.000 10.000 - -9.09% -
470.lbm (max) (percentage) -95.45% 5.720 0.260 - -25.71% -
470.lbm -95.24% 441.000 21.000 - 0.00% -
470.lbm (avg) -95.24% 441.000 21.000 - 0.00% -
471.omnetpp (max) -94.96% 972.000 49.000 - -5.77% -
458.sjeng (max) (percentage) -94.55% 5.140 0.280 - -6.67% -
401.bzip2 (max) (percentage) -94.44% 3.780 0.210 - 0.00% -
450.soplex (max) -94.38% 249.000 14.000 - 133.33% -
433.milc (max) -93.52% 108.000 7.000 - 133.33% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - -20.00% -
453.povray (avg) -92.73% 55.000 4.000 - -20.00% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
444.namd (max) (percentage) -91.47% 8.090 0.690 - -6.76% -
473.astar (unexplained diff vs previous) (percentage) -90.00% 0.200 0.020 - -91.67% -
445.gobmk (max) (percentage) -89.54% 3.730 0.390 - 50.00% -
401.bzip2 -89.42% 104.000 11.000 - -8.33% -
401.bzip2 (avg) -89.42% 104.000 11.000 - -8.33% -
456.hmmer (unexplained diff vs previous) -89.13% 46.000 5.000 - -37.50% -
447.dealII (unexplained diff vs previous) -88.89% 54.000 6.000 - -50.00% -
456.hmmer -87.80% 164.000 20.000 - -4.76% -
456.hmmer (avg) -87.80% 164.000 20.000 - -4.76% -
447.dealII -86.73% 98.000 13.000 - -7.14% -
447.dealII (avg) -86.73% 98.000 13.000 - -7.14% -
482.sphinx3 (unexplained diff vs previous) (percentage) -85.13% 3.430 0.510 - 70.00% -
464.h264ref (max) -85.00% 60.000 9.000 - -52.63% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -83.78% 3.330 0.540 - -1.82% -
458.sjeng -83.09% 136.000 23.000 - 0.00% -
458.sjeng (avg) -83.09% 136.000 23.000 - 0.00% -
473.astar -82.14% 112.000 20.000 - 0.00% -
473.astar (avg) -82.14% 112.000 20.000 - 0.00% -
429.mcf (unexplained diff vs previous) -81.82% 22.000 4.000 - 300.00% -
471.omnetpp (max) (percentage) -80.71% 9.280 1.790 - -4.79% -
471.omnetpp -79.64% 167.000 34.000 - 0.00% -
471.omnetpp (avg) -79.64% 167.000 34.000 - 0.00% -
450.soplex (unexplained diff vs previous) -78.26% 69.000 15.000 - 275.00% -
447.dealII (max) (percentage) -77.31% 2.380 0.540 - -11.48% -
444.namd (avg) (percentage) -73.54% 2.570 0.680 - 0.00% -
453.povray (max) -72.00% 25.000 7.000 - -12.50% -
464.h264ref -71.43% 42.000 12.000 - 0.00% -
464.h264ref (avg) -71.43% 42.000 12.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -70.87% 103.000 30.000 - 50.00% -
456.hmmer (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - -38.10% -
464.h264ref (max) (percentage) -64.29% 0.420 0.150 - -53.12% -
458.sjeng (avg) (percentage) -63.75% 0.800 0.290 - 0.00% -
444.namd (unexplained diff vs previous) -62.50% 8.000 3.000 - 200.00% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 0.00% -
456.hmmer (avg) (percentage) -60.43% 1.390 0.550 - -1.79% -
462.libquantum (max) (percentage) -56.90% 6.380 2.750 - -5.82% -
482.sphinx3 (avg) (percentage) -54.02% 1.740 0.800 - -1.23% -
445.gobmk (unexplained diff vs previous) -52.50% 40.000 19.000 - 0.00% -
473.astar (avg) (percentage) -52.17% 0.920 0.440 - 0.00% -
482.sphinx3 (max) (percentage) -51.36% 3.310 1.610 - -6.40% -
447.dealII (unexplained diff vs previous) (percentage) -46.55% 0.580 0.310 - -50.00% -
433.milc (unexplained diff vs previous) -46.15% 13.000 7.000 - 600.00% -
429.mcf (avg) (percentage) -42.92% 2.120 1.210 - -0.82% -
401.bzip2 (avg) (percentage) -35.38% 0.650 0.420 - -2.33% -
447.dealII (avg) (percentage) -32.38% 1.050 0.710 - -1.39% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
464.h264ref (avg) (percentage) -27.59% 0.290 0.210 - 0.00% -
433.milc (max) (percentage) -25.00% 0.800 0.600 - 100.00% -
471.omnetpp (avg) (percentage) -22.50% 1.600 1.240 - 0.00% -
433.milc (avg) (percentage) -17.44% 0.860 0.710 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.47s
Execution (seconds)
Name Current %
401.bzip2 2846.000 -
403.gcc 60.000 15.38%
429.mcf 1146.000 -
433.milc 1175.000 -
444.namd 814.000 -
445.gobmk 4862.000 -
447.dealII 1956.000 -
450.soplex 540.000 -2.70%
453.povray 495.000 -1.20%
456.hmmer 3808.000 -
458.sjeng 8143.000 -
462.libquantum 187.000 2.75%
464.h264ref 6014.000 -
470.lbm 3988.000 -
471.omnetpp 2776.000 -1.07%
473.astar 4607.000 -
482.sphinx3 990.000 -
Geometric Mean 1485.761 -
Code Size (bytes)
Name Current %
401.bzip2 33161.000 -
403.gcc 1653220.000 -
429.mcf 6915.000 -
433.milc 45869.000 -
444.namd 122635.000 -
445.gobmk 1255937.000 -
447.dealII 191430.000 -
450.soplex 146412.000 -
453.povray 512198.000 -
456.hmmer 79769.000 -
458.sjeng 79299.000 -
462.libquantum 12135.000 -
464.h264ref 298465.000 -
470.lbm 9212.000 -
471.omnetpp 317466.000 -
473.astar 15583.000 -
482.sphinx3 87400.000 -
Geometric Mean 94024.853 -
sample variability
Name Current %
401.bzip2 11.000 -8.33%
401.bzip2 (avg) 11.000 -8.33%
401.bzip2 (avg) (percentage) 0.420 -2.33%
401.bzip2 (max) 5.000 -
401.bzip2 (max) (percentage) 0.210 -
401.bzip2 (unexplained diff vs previous) 0.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.000 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.890 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 9.480 -2.97%
429.mcf 13.000 -
429.mcf (avg) 13.000 -
429.mcf (avg) (percentage) 1.210 -
429.mcf (max) 6.000 -14.29%
429.mcf (max) (percentage) 0.610 -6.15%
429.mcf (unexplained diff vs previous) 4.000 300.00%
429.mcf (unexplained diff vs previous) (percentage) 0.350 288.89%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.710 -
433.milc (max) 7.000 133.33%
433.milc (max) (percentage) 0.600 100.00%
433.milc (unexplained diff vs previous) 7.000 600.00%
433.milc (unexplained diff vs previous) (percentage) 0.600 566.67%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.680 -
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.690 -6.76%
444.namd (unexplained diff vs previous) 3.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 0.370 208.33%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 -
445.gobmk (max) 18.000 50.00%
445.gobmk (max) (percentage) 0.390 50.00%
445.gobmk (unexplained diff vs previous) 19.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.390 -
447.dealII 13.000 -7.14%
447.dealII (avg) 13.000 -7.14%
447.dealII (avg) (percentage) 0.710 -1.39%
447.dealII (max) 10.000 -9.09%
447.dealII (max) (percentage) 0.540 -11.48%
447.dealII (unexplained diff vs previous) 6.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.310 -50.00%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.280 1.59%
450.soplex (max) 14.000 133.33%
450.soplex (max) (percentage) 2.700 132.76%
450.soplex (unexplained diff vs previous) 15.000 275.00%
450.soplex (unexplained diff vs previous) (percentage) 2.780 286.11%
453.povray 4.000 -20.00%
453.povray (avg) 4.000 -20.00%
453.povray (avg) (percentage) 1.000 -
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.600 -4.19%
456.hmmer 20.000 -4.76%
456.hmmer (avg) 20.000 -4.76%
456.hmmer (avg) (percentage) 0.550 -1.79%
456.hmmer (max) 6.000 -50.00%
456.hmmer (max) (percentage) 0.160 -50.00%
456.hmmer (unexplained diff vs previous) 5.000 -37.50%
456.hmmer (unexplained diff vs previous) (percentage) 0.130 -38.10%
458.sjeng 23.000 -
458.sjeng (avg) 23.000 -
458.sjeng (avg) (percentage) 0.290 -
458.sjeng (max) 22.000 -8.33%
458.sjeng (max) (percentage) 0.280 -6.67%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.600 1.27%
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.750 -5.82%
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.670 -2.91%
464.h264ref 12.000 -
464.h264ref (avg) 12.000 -
464.h264ref (avg) (percentage) 0.210 -
464.h264ref (max) 9.000 -52.63%
464.h264ref (max) (percentage) 0.150 -53.12%
464.h264ref (unexplained diff vs previous) 6.000 -25.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.100 -23.08%
470.lbm 21.000 -
470.lbm (avg) 21.000 -
470.lbm (avg) (percentage) 0.540 -1.82%
470.lbm (max) 10.000 -23.08%
470.lbm (max) (percentage) 0.260 -25.71%
470.lbm (unexplained diff vs previous) 10.000 -28.57%
470.lbm (unexplained diff vs previous) (percentage) 0.250 -28.57%
471.omnetpp 34.000 -
471.omnetpp (avg) 34.000 -
471.omnetpp (avg) (percentage) 1.240 -
471.omnetpp (max) 49.000 -5.77%
471.omnetpp (max) (percentage) 1.790 -4.79%
471.omnetpp (unexplained diff vs previous) 30.000 50.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.080 52.11%
473.astar 20.000 -
473.astar (avg) 20.000 -
473.astar (avg) (percentage) 0.440 -
473.astar (max) 8.000 -27.27%
473.astar (max) (percentage) 0.180 -25.00%
473.astar (unexplained diff vs previous) 1.000 -90.91%
473.astar (unexplained diff vs previous) (percentage) 0.020 -91.67%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.800 -1.23%
482.sphinx3 (max) 15.000 -6.25%
482.sphinx3 (max) (percentage) 1.610 -6.40%
482.sphinx3 (unexplained diff vs previous) 5.000 66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.510 70.00%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.234 -14.23%