Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d1a7225076218ce224cd29c74259b715b393dc9d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/214/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0214 (no-change) 2024-12-13T06:47:51 0:00:00
Previous 0212 (llvmorg-20-init-15550-gd1a722507621) 2024-12-09T21:34:21 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 19
Performance Improvements 47 121
Added Tests 2 4
Unchanged Tests 696 624
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 1.44% 486.000 493.000 - -92.94% -
447.dealII 1.20% 1909.000 1932.000 - -79.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) 241.67% 12.000 41.000 - -95.01% -
473.astar (max) (percentage) 228.57% 0.280 0.920 - -86.27% -
473.astar (unexplained diff vs previous) (percentage) 228.57% 0.280 0.920 - 360.00% -
473.astar (unexplained diff vs previous) 223.08% 13.000 42.000 - 68.00% -
433.milc (unexplained diff vs previous) 200.00% 1.000 3.000 - -76.92% -
433.milc (unexplained diff vs previous) (percentage) 188.89% 0.090 0.260 - 160.00% -
401.bzip2 (unexplained diff vs previous) 80.00% 5.000 9.000 - -72.73% -
401.bzip2 (unexplained diff vs previous) (percentage) 77.78% 0.180 0.320 - 60.00% -
450.soplex (max) 60.00% 5.000 8.000 - -96.79% -
450.soplex (max) (percentage) 55.14% 1.070 1.660 - 0.61% -
433.milc (max) 50.00% 2.000 3.000 - -97.22% -
453.povray (max) 40.00% 5.000 7.000 - -72.00% -
458.sjeng (unexplained diff vs previous) (percentage) 35.71% 0.280 0.380 - 0.00% -
458.sjeng (unexplained diff vs previous) 34.78% 23.000 31.000 - 0.00% -
433.milc (max) (percentage) 30.00% 0.200 0.260 - -67.50% -
453.povray (max) (percentage) 18.03% 1.220 1.440 - 300.00% -
453.povray (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 15.45% 1.230 1.420 - 0.00% -
453.povray (avg) (percentage) 2.15% 0.930 0.950 - 18.75% -
447.dealII (avg) (percentage) 1.32% 0.760 0.770 - -26.67% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -4.76% 21.000 20.000 - 5.26% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -1.66% 542.000 533.000 - -96.47% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) -93.75% 16.000 1.000 - -99.88% -
470.lbm (unexplained diff vs previous) (percentage) -92.50% 0.400 0.030 - -99.50% -
464.h264ref (unexplained diff vs previous) (percentage) -86.36% 0.220 0.030 - 0.00% -
464.h264ref (unexplained diff vs previous) -84.62% 13.000 2.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -55.17% 29.000 13.000 - -87.38% -
471.omnetpp (unexplained diff vs previous) (percentage) -54.81% 1.040 0.470 - -52.04% -
429.mcf (unexplained diff vs previous) (percentage) -53.91% 1.150 0.530 - 231.25% -
429.mcf (unexplained diff vs previous) -53.85% 13.000 6.000 - -72.73% -
482.sphinx3 (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -40.00% 0.500 0.300 - -91.25% -
429.mcf (max) -38.89% 18.000 11.000 - -99.52% -
429.mcf (max) (percentage) -36.81% 1.630 1.030 - -93.68% -
464.h264ref (max) -31.25% 16.000 11.000 - -81.67% -
464.h264ref (max) (percentage) -25.93% 0.270 0.200 - -52.38% -
470.lbm (max) (percentage) -17.39% 0.460 0.380 - -93.36% -
470.lbm (max) -16.67% 18.000 15.000 - -98.02% -
482.sphinx3 (max) -16.67% 6.000 5.000 - -99.43% -
450.soplex -14.29% 7.000 6.000 - -92.00% -
450.soplex (avg) -14.29% 7.000 6.000 - -92.00% -
444.namd (max) -10.00% 10.000 9.000 - -99.10% -
445.gobmk (max) -10.00% 10.000 9.000 - -97.82% -
464.h264ref -7.69% 13.000 12.000 - -71.43% -
464.h264ref (avg) -7.69% 13.000 12.000 - -71.43% -
458.sjeng (max) (percentage) -6.67% 0.450 0.420 - -91.83% -
401.bzip2 (max) (percentage) -5.71% 0.350 0.330 - -91.27% -
462.libquantum (max) (percentage) -5.67% 1.410 1.330 - -79.15% -
447.dealII (unexplained diff vs previous) (percentage) -5.56% 1.260 1.190 - 105.17% -
458.sjeng (max) -5.56% 36.000 34.000 - -96.12% -
470.lbm -4.76% 21.000 20.000 - -95.46% -
470.lbm (avg) -4.76% 21.000 20.000 - -95.46% -
444.namd (max) (percentage) -4.72% 1.270 1.210 - -85.04% -
464.h264ref (avg) (percentage) -4.55% 0.220 0.210 - -27.59% -
473.astar -4.55% 22.000 21.000 - -81.25% -
473.astar (avg) -4.55% 22.000 21.000 - -81.25% -
447.dealII (unexplained diff vs previous) -4.17% 24.000 23.000 - -57.41% -
471.omnetpp (max) (percentage) -3.88% 2.320 2.230 - -75.97% -
482.sphinx3 (max) (percentage) -3.28% 0.610 0.590 - -82.18% -
447.dealII (max) (percentage) -3.23% 1.240 1.200 - -49.58% -
471.omnetpp (max) -3.12% 64.000 62.000 - -93.62% -
401.bzip2 (avg) (percentage) -2.50% 0.400 0.390 - -40.00% -
470.lbm (avg) (percentage) -1.89% 0.530 0.520 - -84.38% -
433.milc (avg) (percentage) -1.56% 0.640 0.630 - -26.74% -
456.hmmer (avg) (percentage) -1.43% 0.700 0.690 - -50.36% -
444.namd (avg) (percentage) -1.30% 0.770 0.760 - -70.43% -
482.sphinx3 (avg) (percentage) -1.30% 0.770 0.760 - -56.32% -
462.libquantum (avg) (percentage) -1.29% 1.550 1.530 - 98.70% -

Added Tests - sample variability
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.23% 146765.000 150036.000 - 0.00% -
471.omnetpp 2.08% 316676.000 323250.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 5500.00% 0.010 0.560 - 0.00% -
403.gcc (avg) (percentage) 474.55% 0.550 3.160 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 360.00% 0.200 0.920 - 228.57% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - 0.00% -
453.povray (max) (percentage) 300.00% 0.360 1.440 - 18.03% -
403.gcc (max) (percentage) 279.40% 2.330 8.840 - -0.90% -
450.soplex (unexplained diff vs previous) (percentage) 267.39% 0.460 1.690 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 231.25% 0.160 0.530 - -53.91% -
450.soplex (avg) (percentage) 160.00% 0.500 1.300 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 - 188.89% -
447.dealII (unexplained diff vs previous) (percentage) 105.17% 0.580 1.190 - -5.56% -
462.libquantum (avg) (percentage) 98.70% 0.770 1.530 - -1.29% -
473.astar (unexplained diff vs previous) 68.00% 25.000 42.000 - 223.08% -
401.bzip2 (unexplained diff vs previous) (percentage) 60.00% 0.200 0.320 - 77.78% -
453.povray (avg) (percentage) 18.75% 0.800 0.950 - 2.15% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -11.11% 18.000 16.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.31% 7239.000 6927.000 - 0.00% -
462.libquantum -3.59% 12504.000 12055.000 - 0.00% -
453.povray -2.38% 524493.000 512012.000 - 0.00% -
433.milc -2.24% 47001.000 45949.000 - 0.00% -
444.namd -1.85% 124963.000 122654.000 - 0.00% -
464.h264ref -1.80% 303767.000 298309.000 - 0.00% -
401.bzip2 -1.65% 33698.000 33141.000 - 0.00% -
458.sjeng -1.57% 80297.000 79034.000 - 0.00% -
456.hmmer -1.25% 80861.000 79849.000 - 0.00% -
470.lbm -1.22% 9338.000 9224.000 - 0.00% -
447.dealII -1.05% 195792.000 193739.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.76% 14409.000 179.000 - 0.56% -
450.soplex -96.47% 15112.000 533.000 - -1.66% -
482.sphinx3 -96.30% 26682.000 988.000 - -0.30% -
444.namd -93.45% 12400.000 812.000 - 0.25% -
453.povray -92.94% 6987.000 493.000 - 1.44% -
429.mcf -91.88% 13988.000 1136.000 - 0.53% -
433.milc -91.40% 13601.000 1170.000 - 0.26% -
401.bzip2 -82.51% 16137.000 2823.000 - -0.32% -
447.dealII -79.40% 9380.000 1932.000 - 1.20% -
471.omnetpp -73.45% 10477.000 2782.000 - -0.47% -
470.lbm -70.06% 13259.000 3970.000 - -0.03% -
456.hmmer -67.84% 11854.000 3812.000 - 0.13% -
473.astar -62.98% 12272.000 4543.000 - -0.92% -
464.h264ref -59.09% 14498.000 5931.000 - 0.03% -
445.gobmk -56.39% 11093.000 4838.000 - -0.19% -
458.sjeng -52.16% 17055.000 8159.000 - 0.38% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.88% 804.000 1.000 - -93.75% -
462.libquantum (max) -99.78% 919.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.67% 914.000 3.000 - -40.00% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
429.mcf (max) -99.52% 2281.000 11.000 - -38.89% -
470.lbm (unexplained diff vs previous) (percentage) -99.50% 6.060 0.030 - -92.50% -
482.sphinx3 (max) -99.43% 883.000 5.000 - -16.67% -
456.hmmer (max) -99.28% 1242.000 9.000 - 0.00% -
444.namd (max) -99.10% 1003.000 9.000 - -10.00% -
401.bzip2 (max) -98.52% 609.000 9.000 - 0.00% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
444.namd -98.11% 318.000 6.000 - 0.00% -
444.namd (avg) -98.11% 318.000 6.000 - 0.00% -
470.lbm (max) -98.02% 758.000 15.000 - -16.67% -
445.gobmk (max) -97.82% 413.000 9.000 - -10.00% -
456.hmmer (max) (percentage) -97.52% 10.480 0.260 - 0.00% -
433.milc (max) -97.22% 108.000 3.000 - 50.00% -
450.soplex (max) -96.79% 249.000 8.000 - 60.00% -
458.sjeng (max) -96.12% 876.000 34.000 - -5.56% -
429.mcf -95.61% 296.000 13.000 - 0.00% -
429.mcf (avg) -95.61% 296.000 13.000 - 0.00% -
470.lbm -95.46% 441.000 20.000 - -4.76% -
470.lbm (avg) -95.46% 441.000 20.000 - -4.76% -
473.astar (max) -95.01% 822.000 41.000 - 241.67% -
445.gobmk (max) (percentage) -94.64% 3.730 0.200 - -4.76% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf (max) (percentage) -93.68% 16.310 1.030 - -36.81% -
471.omnetpp (max) -93.62% 972.000 62.000 - -3.12% -
470.lbm (max) (percentage) -93.36% 5.720 0.380 - -17.39% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
450.soplex -92.00% 75.000 6.000 - -14.29% -
450.soplex (avg) -92.00% 75.000 6.000 - -14.29% -
458.sjeng (max) (percentage) -91.83% 5.140 0.420 - -6.67% -
401.bzip2 (max) (percentage) -91.27% 3.780 0.330 - -5.71% -
482.sphinx3 (unexplained diff vs previous) (percentage) -91.25% 3.430 0.300 - -40.00% -
447.dealII (max) -89.69% 223.000 23.000 - 0.00% -
401.bzip2 -89.42% 104.000 11.000 - 0.00% -
401.bzip2 (avg) -89.42% 104.000 11.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -89.13% 46.000 5.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -87.38% 103.000 13.000 - -55.17% -
450.soplex (unexplained diff vs previous) -86.96% 69.000 9.000 - 0.00% -
473.astar (max) (percentage) -86.27% 6.700 0.920 - 228.57% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
444.namd (max) (percentage) -85.04% 8.090 1.210 - -4.72% -
470.lbm (avg) (percentage) -84.38% 3.330 0.520 - -1.89% -
456.hmmer -84.15% 164.000 26.000 - 0.00% -
456.hmmer (avg) -84.15% 164.000 26.000 - 0.00% -
445.gobmk -82.43% 74.000 13.000 - 0.00% -
445.gobmk (avg) -82.43% 74.000 13.000 - 0.00% -
482.sphinx3 (max) (percentage) -82.18% 3.310 0.590 - -3.28% -
464.h264ref (max) -81.67% 60.000 11.000 - -31.25% -
473.astar -81.25% 112.000 21.000 - -4.55% -
473.astar (avg) -81.25% 112.000 21.000 - -4.55% -
458.sjeng -80.88% 136.000 26.000 - 0.00% -
458.sjeng (avg) -80.88% 136.000 26.000 - 0.00% -
462.libquantum (max) (percentage) -79.15% 6.380 1.330 - -5.67% -
445.gobmk (unexplained diff vs previous) -77.50% 40.000 9.000 - 0.00% -
471.omnetpp -77.25% 167.000 38.000 - 0.00% -
471.omnetpp (avg) -77.25% 167.000 38.000 - 0.00% -
433.milc (unexplained diff vs previous) -76.92% 13.000 3.000 - 200.00% -
471.omnetpp (max) (percentage) -75.97% 9.280 2.230 - -3.88% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -72.73% 33.000 9.000 - 80.00% -
429.mcf (unexplained diff vs previous) -72.73% 22.000 6.000 - -53.85% -
453.povray (max) -72.00% 25.000 7.000 - 40.00% -
464.h264ref -71.43% 42.000 12.000 - -7.69% -
464.h264ref (avg) -71.43% 42.000 12.000 - -7.69% -
444.namd (avg) (percentage) -70.43% 2.570 0.760 - -1.30% -
433.milc (max) (percentage) -67.50% 0.800 0.260 - 30.00% -
456.hmmer (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - 0.00% -
445.gobmk (avg) (percentage) -59.70% 0.670 0.270 - 0.00% -
458.sjeng (avg) (percentage) -58.75% 0.800 0.330 - 0.00% -
447.dealII (unexplained diff vs previous) -57.41% 54.000 23.000 - -4.17% -
482.sphinx3 (avg) (percentage) -56.32% 1.740 0.760 - -1.30% -
464.h264ref (max) (percentage) -52.38% 0.420 0.200 - -25.93% -
471.omnetpp (unexplained diff vs previous) (percentage) -52.04% 0.980 0.470 - -54.81% -
456.hmmer (avg) (percentage) -50.36% 1.390 0.690 - -1.43% -
447.dealII (max) (percentage) -49.58% 2.380 1.200 - -3.23% -
473.astar (avg) (percentage) -47.83% 0.920 0.480 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -47.22% 0.360 0.190 - 0.00% -
429.mcf (avg) (percentage) -42.92% 2.120 1.210 - -0.82% -
401.bzip2 (avg) (percentage) -40.00% 0.650 0.390 - -2.50% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
464.h264ref (avg) (percentage) -27.59% 0.290 0.210 - -4.55% -
433.milc (avg) (percentage) -26.74% 0.860 0.630 - -1.56% -
447.dealII (avg) (percentage) -26.67% 1.050 0.770 - 1.32% -
471.omnetpp (avg) (percentage) -14.37% 1.600 1.370 - -0.72% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - -4.76% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
401.bzip2 2823.000 -
429.mcf 1136.000 -
433.milc 1170.000 -
444.namd 812.000 -
445.gobmk 4838.000 -
447.dealII 1932.000 1.20%
450.soplex 533.000 -1.66%
453.povray 493.000 1.44%
456.hmmer 3812.000 -
458.sjeng 8159.000 -
462.libquantum 179.000 -
464.h264ref 5931.000 -
470.lbm 3970.000 -
471.omnetpp 2782.000 -
473.astar 4543.000 -
482.sphinx3 988.000 -
Geometric Mean 1800.968 -
Code Size (bytes)
Name Current %
401.bzip2 33141.000 -
429.mcf 6927.000 -
433.milc 45949.000 -
444.namd 122654.000 -
445.gobmk 1255493.000 -
447.dealII 193739.000 -
450.soplex 150036.000 -
453.povray 512012.000 -
456.hmmer 79849.000 -
458.sjeng 79034.000 -
462.libquantum 12055.000 -
464.h264ref 298309.000 -
470.lbm 9224.000 -
471.omnetpp 323250.000 -
473.astar 15607.000 -
482.sphinx3 87440.000 -
Geometric Mean 78849.465 -
Score
Name Current %
nb_compile_successful 18.000 -
nb_execution_successful 16.000 -
nb_total_tests 20.000 -4.76%
Geometric Mean 17.926 -1.61%
sample variability
Name Current %
401.bzip2 11.000 -
401.bzip2 (avg) 11.000 -
401.bzip2 (avg) (percentage) 0.390 -2.50%
401.bzip2 (max) 9.000 -
401.bzip2 (max) (percentage) 0.330 -5.71%
401.bzip2 (unexplained diff vs previous) 9.000 80.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.320 77.78%
403.gcc (avg) (percentage) 3.160 -
403.gcc (max) (percentage) 8.840 -
429.mcf 13.000 -
429.mcf (avg) 13.000 -
429.mcf (avg) (percentage) 1.210 -
429.mcf (max) 11.000 -38.89%
429.mcf (max) (percentage) 1.030 -36.81%
429.mcf (unexplained diff vs previous) 6.000 -53.85%
429.mcf (unexplained diff vs previous) (percentage) 0.530 -53.91%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 -1.56%
433.milc (max) 3.000 50.00%
433.milc (max) (percentage) 0.260 30.00%
433.milc (unexplained diff vs previous) 3.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 188.89%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.760 -1.30%
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.210 -4.72%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.250 -
445.gobmk 13.000 -
445.gobmk (avg) 13.000 -
445.gobmk (avg) (percentage) 0.270 -
445.gobmk (max) 9.000 -10.00%
445.gobmk (max) (percentage) 0.200 -
445.gobmk (unexplained diff vs previous) 9.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.190 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.770 1.32%
447.dealII (max) 23.000 -
447.dealII (max) (percentage) 1.200 -3.23%
447.dealII (unexplained diff vs previous) 23.000 -4.17%
447.dealII (unexplained diff vs previous) (percentage) 1.190 -5.56%
450.soplex 6.000 -14.29%
450.soplex (avg) 6.000 -14.29%
450.soplex (avg) (percentage) 1.300 -
450.soplex (max) 8.000 60.00%
450.soplex (max) (percentage) 1.660 55.14%
450.soplex (unexplained diff vs previous) 9.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.690 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.950 2.15%
453.povray (max) 7.000 40.00%
453.povray (max) (percentage) 1.440 18.03%
453.povray (unexplained diff vs previous) 7.000 16.67%
453.povray (unexplained diff vs previous) (percentage) 1.420 15.45%
456.hmmer 26.000 -
456.hmmer (avg) 26.000 -
456.hmmer (avg) (percentage) 0.690 -1.43%
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.260 -
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.130 -
458.sjeng 26.000 -
458.sjeng (avg) 26.000 -
458.sjeng (avg) (percentage) 0.330 -
458.sjeng (max) 34.000 -5.56%
458.sjeng (max) (percentage) 0.420 -6.67%
458.sjeng (unexplained diff vs previous) 31.000 34.78%
458.sjeng (unexplained diff vs previous) (percentage) 0.380 35.71%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.530 -1.29%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.330 -5.67%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.560 -
464.h264ref 12.000 -7.69%
464.h264ref (avg) 12.000 -7.69%
464.h264ref (avg) (percentage) 0.210 -4.55%
464.h264ref (max) 11.000 -31.25%
464.h264ref (max) (percentage) 0.200 -25.93%
464.h264ref (unexplained diff vs previous) 2.000 -84.62%
464.h264ref (unexplained diff vs previous) (percentage) 0.030 -86.36%
470.lbm 20.000 -4.76%
470.lbm (avg) 20.000 -4.76%
470.lbm (avg) (percentage) 0.520 -1.89%
470.lbm (max) 15.000 -16.67%
470.lbm (max) (percentage) 0.380 -17.39%
470.lbm (unexplained diff vs previous) 1.000 -93.75%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -92.50%
471.omnetpp 38.000 -
471.omnetpp (avg) 38.000 -
471.omnetpp (avg) (percentage) 1.370 -
471.omnetpp (max) 62.000 -3.12%
471.omnetpp (max) (percentage) 2.230 -3.88%
471.omnetpp (unexplained diff vs previous) 13.000 -55.17%
471.omnetpp (unexplained diff vs previous) (percentage) 0.470 -54.81%
473.astar 21.000 -4.55%
473.astar (avg) 21.000 -4.55%
473.astar (avg) (percentage) 0.480 -
473.astar (max) 41.000 241.67%
473.astar (max) (percentage) 0.920 228.57%
473.astar (unexplained diff vs previous) 42.000 223.08%
473.astar (unexplained diff vs previous) (percentage) 0.920 228.57%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.760 -1.30%
482.sphinx3 (max) 5.000 -16.67%
482.sphinx3 (max) (percentage) 0.590 -3.28%
482.sphinx3 (unexplained diff vs previous) 3.000 -40.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.300 -40.00%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.636 32.00%