Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0b3912622ed4f3cdd311b02798f8689d52ed4602 (+ 682 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/255/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0255 (llvmorg-20-init-17829-g0b3912622ed4) 2025-01-09T16:19:21 0:00:00
Previous 0253 (llvmorg-20-init-17147-g2b26ee6e7905) 2025-01-04T09:57:11 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 33
Performance Improvements 41 106
Added Tests 7 5
Unchanged Tests 709 636
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 5.15% 97.000 102.000 - -99.22% -
450.soplex 3.65% 520.000 539.000 - -96.26% -
453.povray 1.09% 457.000 462.000 - -93.26% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 95.70% 0.930 1.820 - 111.63% -
471.omnetpp (unexplained diff vs previous) 92.31% 26.000 50.000 - -45.65% -
462.libquantum (max) 66.67% 3.000 5.000 - -80.77% -
450.soplex (max) 35.71% 14.000 19.000 - -76.83% -
450.soplex (unexplained diff vs previous) 35.71% 14.000 19.000 - -76.83% -
450.soplex (max) (percentage) 31.77% 2.770 3.650 - 540.35% -
450.soplex (unexplained diff vs previous) (percentage) 31.23% 2.690 3.530 - 519.30% -
462.libquantum (max) (percentage) 30.05% 3.960 5.150 - 2475.00% -
462.libquantum (unexplained diff vs previous) 25.00% 4.000 5.000 - -68.75% -
433.milc (unexplained diff vs previous) (percentage) 20.45% 0.440 0.530 - -60.74% -
433.milc (unexplained diff vs previous) 20.00% 5.000 6.000 - -96.70% -
444.namd (max) 20.00% 5.000 6.000 - -99.32% -
450.soplex 20.00% 5.000 6.000 - -88.24% -
450.soplex (avg) 20.00% 5.000 6.000 - -88.24% -
462.libquantum (unexplained diff vs previous) (percentage) 18.93% 4.120 4.900 - 3983.33% -
444.namd (max) (percentage) 8.97% 0.780 0.850 - -87.00% -
450.soplex (avg) (percentage) 2.75% 1.090 1.120 - 211.11% -
462.libquantum (avg) (percentage) 2.41% 1.660 1.700 - 1033.33% -
471.omnetpp (max) (percentage) 2.29% 1.750 1.790 - 1.70% -
471.omnetpp (max) 2.08% 48.000 49.000 - -74.07% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -4.84% 62.000 59.000 - -99.35% -
471.omnetpp -1.79% 2796.000 2746.000 - -74.45% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -79.31% 0.290 0.060 - -98.32% -
470.lbm (unexplained diff vs previous) -77.78% 9.000 2.000 - -99.60% -
447.dealII (max) -73.33% 30.000 8.000 - -93.80% -
447.dealII (max) (percentage) -72.46% 1.670 0.460 - -70.89% -
482.sphinx3 (max) -54.55% 11.000 5.000 - -99.43% -
482.sphinx3 (max) (percentage) -52.63% 1.330 0.630 - -81.02% -
464.h264ref (unexplained diff vs previous) -42.42% 33.000 19.000 - -68.33% -
464.h264ref (unexplained diff vs previous) (percentage) -42.37% 0.590 0.340 - -12.82% -
447.dealII (unexplained diff vs previous) (percentage) -27.87% 0.610 0.440 - -70.27% -
456.hmmer (max) -27.78% 18.000 13.000 - -67.50% -
447.dealII (unexplained diff vs previous) -27.27% 11.000 8.000 - -93.39% -
473.astar (unexplained diff vs previous) -26.67% 15.000 11.000 - -89.81% -
473.astar (unexplained diff vs previous) (percentage) -25.81% 0.310 0.230 - -69.74% -
456.hmmer (max) (percentage) -23.53% 0.510 0.390 - 30.00% -
456.hmmer (unexplained diff vs previous) -22.22% 18.000 14.000 - 55.56% -
456.hmmer (unexplained diff vs previous) (percentage) -22.00% 0.500 0.390 - 457.14% -
453.povray (max) -16.67% 12.000 10.000 - -92.42% -
473.astar (max) -13.33% 15.000 13.000 - -88.60% -
401.bzip2 (unexplained diff vs previous) (percentage) -13.33% 0.600 0.520 - 67.74% -
453.povray (max) (percentage) -12.92% 2.710 2.360 - 22.28% -
401.bzip2 (unexplained diff vs previous) -12.50% 16.000 14.000 - -71.43% -
458.sjeng (max) -12.50% 24.000 21.000 - -67.69% -
401.bzip2 (max) (percentage) -11.67% 0.600 0.530 - 70.97% -
458.sjeng (max) (percentage) -10.34% 0.290 0.260 - -35.00% -
473.astar (max) (percentage) -9.68% 0.310 0.280 - -65.00% -
429.mcf (unexplained diff vs previous) (percentage) -9.37% 0.960 0.870 - 55.36% -
429.mcf (unexplained diff vs previous) -9.09% 11.000 10.000 - -85.07% -
464.h264ref (max) -9.09% 33.000 30.000 - -50.00% -
464.h264ref (max) (percentage) -8.33% 0.600 0.550 - 41.03% -
470.lbm (max) -8.00% 25.000 23.000 - -97.01% -
470.lbm (max) (percentage) -7.50% 0.800 0.740 - -86.64% -
433.milc (max) (percentage) -6.78% 0.590 0.550 - -59.85% -
401.bzip2 (max) -6.67% 15.000 14.000 - -70.83% -
429.mcf (max) (percentage) -6.32% 0.950 0.890 - 58.93% -
470.lbm -4.76% 21.000 20.000 - -93.79% -
470.lbm (avg) -4.76% 21.000 20.000 - -93.79% -
445.gobmk (max) (percentage) -1.96% 0.510 0.500 - 108.33% -
473.astar (avg) (percentage) -1.59% 0.630 0.620 - 24.00% -
470.lbm (avg) (percentage) -1.49% 0.670 0.660 - -71.55% -

Added Tests - sample variability
445.gobmk
445.gobmk (avg)
445.gobmk (max)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.10% 39458.000 40285.000 - 0.00% -
450.soplex 1.89% 198708.000 202463.000 - 0.00% -
471.omnetpp 1.08% 373579.000 377596.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 3983.33% 0.120 4.900 - 18.93% -
462.libquantum (max) (percentage) 2475.00% 0.200 5.150 - 30.05% -
462.libquantum (avg) (percentage) 1033.33% 0.150 1.700 - 2.41% -
403.gcc (avg) (percentage) 650.00% 0.480 3.600 - 0.00% -
450.soplex (max) (percentage) 540.35% 0.570 3.650 - 31.77% -
450.soplex (unexplained diff vs previous) (percentage) 519.30% 0.570 3.530 - 31.23% -
403.gcc (max) (percentage) 457.89% 0.380 2.120 - -0.93% -
456.hmmer (unexplained diff vs previous) (percentage) 457.14% 0.070 0.390 - -22.00% -
450.soplex (avg) (percentage) 211.11% 0.360 1.120 - 2.75% -
429.mcf (avg) (percentage) 175.56% 0.450 1.240 - 0.00% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 111.63% 0.860 1.820 - 95.70% -
401.bzip2 (avg) (percentage) 109.09% 0.220 0.460 - 0.00% -
445.gobmk (max) (percentage) 108.33% 0.240 0.500 - -1.96% -
401.bzip2 (max) (percentage) 70.97% 0.310 0.530 - -11.67% -
471.omnetpp (avg) (percentage) 70.51% 0.780 1.330 - 0.76% -
401.bzip2 (unexplained diff vs previous) (percentage) 67.74% 0.310 0.520 - -13.33% -
445.gobmk (avg) (percentage) 66.67% 0.180 0.300 - 0.00% -
429.mcf (max) (percentage) 58.93% 0.560 0.890 - -6.32% -
456.hmmer (unexplained diff vs previous) 55.56% 9.000 14.000 - -22.22% -
429.mcf (unexplained diff vs previous) (percentage) 55.36% 0.560 0.870 - -9.37% -
464.h264ref (max) (percentage) 41.03% 0.390 0.550 - -8.33% -
456.hmmer (max) (percentage) 30.00% 0.300 0.390 - -23.53% -
473.astar (avg) (percentage) 24.00% 0.500 0.620 - -1.59% -
453.povray (max) (percentage) 22.28% 1.930 2.360 - -12.92% -
456.hmmer (avg) (percentage) 22.22% 0.360 0.440 - 0.00% -
471.omnetpp (max) (percentage) 1.70% 1.760 1.790 - 2.29% -
483.xalancbmk (max) (percentage) 1.54% 0.650 0.660 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -11.11% 18.000 16.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.12% 26756.000 24047.000 - 0.00% -
433.milc -2.85% 74971.000 72834.000 - 0.00% -
447.dealII -2.40% 1777992.000 1735367.000 - 0.00% -
453.povray -2.36% 593097.000 579071.000 - 0.00% -
444.namd -2.15% 175160.000 171389.000 - 0.00% -
464.h264ref -1.43% 354618.000 349548.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.98% 12400.000 2.000 - 0.00% -
403.gcc -99.35% 9099.000 59.000 - -4.84% -
462.libquantum -99.22% 13126.000 102.000 - 5.15% -
482.sphinx3 -96.66% 26310.000 879.000 - 0.00% -
450.soplex -96.26% 14429.000 539.000 - 3.65% -
444.namd -94.71% 13495.000 714.000 - 0.85% -
453.povray -93.26% 6857.000 462.000 - 1.09% -
433.milc -91.57% 13482.000 1136.000 - -0.53% -
429.mcf -90.41% 11999.000 1151.000 - 0.88% -
401.bzip2 -82.92% 15683.000 2678.000 - 0.53% -
447.dealII -77.90% 8196.000 1811.000 - 0.44% -
470.lbm -77.30% 13882.000 3151.000 - 0.06% -
471.omnetpp -74.45% 10746.000 2746.000 - -1.79% -
456.hmmer -73.20% 13365.000 3582.000 - 0.39% -
473.astar -65.92% 14262.000 4860.000 - 0.23% -
464.h264ref -64.19% 15493.000 5548.000 - -0.34% -
458.sjeng -49.37% 16406.000 8306.000 - 0.29% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.60% 497.000 2.000 - -77.78% -
482.sphinx3 (max) -99.43% 873.000 5.000 - -54.55% -
444.namd (max) -99.32% 882.000 6.000 - 20.00% -
444.namd (unexplained diff vs previous) -99.28% 828.000 6.000 - 0.00% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.32% 3.580 0.060 - -79.31% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
470.lbm (max) -97.01% 769.000 23.000 - -8.00% -
433.milc (max) -96.74% 184.000 6.000 - 0.00% -
433.milc (unexplained diff vs previous) -96.70% 182.000 6.000 - 20.00% -
433.milc -96.32% 136.000 5.000 - 0.00% -
433.milc (avg) -96.32% 136.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) -96.15% 130.000 5.000 - 0.00% -
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
447.dealII (max) -93.80% 129.000 8.000 - -73.33% -
470.lbm -93.79% 322.000 20.000 - -4.76% -
470.lbm (avg) -93.79% 322.000 20.000 - -4.76% -
447.dealII (unexplained diff vs previous) -93.39% 121.000 8.000 - -27.27% -
453.povray (max) -92.42% 132.000 10.000 - -16.67% -
447.dealII -90.00% 120.000 12.000 - 0.00% -
447.dealII (avg) -90.00% 120.000 12.000 - 0.00% -
473.astar (unexplained diff vs previous) -89.81% 108.000 11.000 - -26.67% -
473.astar (max) -88.60% 114.000 13.000 - -13.33% -
450.soplex -88.24% 51.000 6.000 - 20.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 20.00% -
444.namd (max) (percentage) -87.00% 6.540 0.850 - 8.97% -
470.lbm (max) (percentage) -86.64% 5.540 0.740 - -7.50% -
444.namd (unexplained diff vs previous) (percentage) -86.32% 6.140 0.840 - 0.00% -
429.mcf (max) -85.07% 67.000 10.000 - 0.00% -
429.mcf (unexplained diff vs previous) -85.07% 67.000 10.000 - -9.09% -
482.sphinx3 (max) (percentage) -81.02% 3.320 0.630 - -52.63% -
462.libquantum (max) -80.77% 26.000 5.000 - 66.67% -
450.soplex (max) -76.83% 82.000 19.000 - 35.71% -
450.soplex (unexplained diff vs previous) -76.83% 82.000 19.000 - 35.71% -
444.namd (avg) (percentage) -76.64% 3.810 0.890 - 0.00% -
471.omnetpp (max) -74.07% 189.000 49.000 - 2.08% -
429.mcf -73.58% 53.000 14.000 - 0.00% -
429.mcf (avg) -73.58% 53.000 14.000 - 0.00% -
470.lbm (avg) (percentage) -71.55% 2.320 0.660 - -1.49% -
401.bzip2 (unexplained diff vs previous) -71.43% 49.000 14.000 - -12.50% -
447.dealII (max) (percentage) -70.89% 1.580 0.460 - -72.46% -
401.bzip2 (max) -70.83% 48.000 14.000 - -6.67% -
447.dealII (unexplained diff vs previous) (percentage) -70.27% 1.480 0.440 - -27.87% -
473.astar (unexplained diff vs previous) (percentage) -69.74% 0.760 0.230 - -25.81% -
458.sjeng -69.47% 95.000 29.000 - 0.00% -
458.sjeng (avg) -69.47% 95.000 29.000 - 0.00% -
456.hmmer -68.75% 48.000 15.000 - 0.00% -
456.hmmer (avg) -68.75% 48.000 15.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -68.75% 16.000 5.000 - 25.00% -
464.h264ref (unexplained diff vs previous) -68.33% 60.000 19.000 - -42.42% -
458.sjeng (max) -67.69% 65.000 21.000 - -12.50% -
456.hmmer (max) -67.50% 40.000 13.000 - -27.78% -
464.h264ref -66.67% 51.000 17.000 - 0.00% -
464.h264ref (avg) -66.67% 51.000 17.000 - 0.00% -
473.astar (max) (percentage) -65.00% 0.800 0.280 - -9.68% -
401.bzip2 -64.71% 34.000 12.000 - 0.00% -
401.bzip2 (avg) -64.71% 34.000 12.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -60.74% 1.350 0.530 - 20.45% -
433.milc (max) (percentage) -59.85% 1.370 0.550 - -6.78% -
473.astar -57.75% 71.000 30.000 - 0.00% -
473.astar (avg) -57.75% 71.000 30.000 - 0.00% -
471.omnetpp -56.63% 83.000 36.000 - 0.00% -
471.omnetpp (avg) -56.63% 83.000 36.000 - 0.00% -
482.sphinx3 (avg) (percentage) -56.45% 1.860 0.810 - -1.22% -
447.dealII (avg) (percentage) -54.42% 1.470 0.670 - 0.00% -
464.h264ref (max) -50.00% 60.000 30.000 - -9.09% -
433.milc (avg) (percentage) -49.50% 1.010 0.510 - 0.00% -
471.omnetpp (unexplained diff vs previous) -45.65% 92.000 50.000 - 92.31% -
453.povray (unexplained diff vs previous) (percentage) -43.16% 1.900 1.080 - 0.00% -
458.sjeng (avg) (percentage) -37.93% 0.580 0.360 - 0.00% -
458.sjeng (max) (percentage) -35.00% 0.400 0.260 - -10.34% -
453.povray (avg) (percentage) -22.63% 1.370 1.060 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -12.82% 0.390 0.340 - -42.37% -
464.h264ref (avg) (percentage) -6.06% 0.330 0.310 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
445.gobmk
445.gobmk (avg)
445.gobmk (max)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2678.000 -
403.gcc 59.000 -4.84%
429.mcf 1151.000 -
433.milc 1136.000 -
444.namd 714.000 -
445.gobmk 2.000 -
447.dealII 1811.000 -
450.soplex 539.000 3.65%
453.povray 462.000 1.09%
456.hmmer 3582.000 -
458.sjeng 8306.000 -
462.libquantum 102.000 5.15%
464.h264ref 5548.000 -
470.lbm 3151.000 -
471.omnetpp 2746.000 -1.79%
473.astar 4860.000 -
482.sphinx3 879.000 -
Geometric Mean 863.685 -
Code Size (bytes)
Name Current %
401.bzip2 40285.000 -
403.gcc 1953341.000 -
429.mcf 7942.000 -
433.milc 72834.000 -
444.namd 171389.000 -
447.dealII 1735367.000 -
450.soplex 202463.000 -
453.povray 579071.000 -
456.hmmer 166662.000 -
458.sjeng 96993.000 -
462.libquantum 24047.000 -
464.h264ref 349548.000 -
470.lbm 9778.000 -
471.omnetpp 377596.000 -
473.astar 23295.000 -
482.sphinx3 114715.000 -
Geometric Mean 121058.808 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.460 -
401.bzip2 (max) 14.000 -6.67%
401.bzip2 (max) (percentage) 0.530 -11.67%
401.bzip2 (unexplained diff vs previous) 14.000 -12.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.520 -13.33%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.600 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.120 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.240 -
429.mcf (max) 10.000 -
429.mcf (max) (percentage) 0.890 -6.32%
429.mcf (unexplained diff vs previous) 10.000 -9.09%
429.mcf (unexplained diff vs previous) (percentage) 0.870 -9.37%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.510 -
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.550 -6.78%
433.milc (unexplained diff vs previous) 6.000 20.00%
433.milc (unexplained diff vs previous) (percentage) 0.530 20.45%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.890 -
444.namd (max) 6.000 20.00%
444.namd (max) (percentage) 0.850 8.97%
444.namd (unexplained diff vs previous) 6.000 -
444.namd (unexplained diff vs previous) (percentage) 0.840 -
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 0.300 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 0.500 -1.96%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.670 -
447.dealII (max) 8.000 -73.33%
447.dealII (max) (percentage) 0.460 -72.46%
447.dealII (unexplained diff vs previous) 8.000 -27.27%
447.dealII (unexplained diff vs previous) (percentage) 0.440 -27.87%
450.soplex 6.000 20.00%
450.soplex (avg) 6.000 20.00%
450.soplex (avg) (percentage) 1.120 2.75%
450.soplex (max) 19.000 35.71%
450.soplex (max) (percentage) 3.650 31.77%
450.soplex (unexplained diff vs previous) 19.000 35.71%
450.soplex (unexplained diff vs previous) (percentage) 3.530 31.23%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.060 -
453.povray (max) 10.000 -16.67%
453.povray (max) (percentage) 2.360 -12.92%
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 1.080 -
456.hmmer 15.000 -
456.hmmer (avg) 15.000 -
456.hmmer (avg) (percentage) 0.440 -
456.hmmer (max) 13.000 -27.78%
456.hmmer (max) (percentage) 0.390 -23.53%
456.hmmer (unexplained diff vs previous) 14.000 -22.22%
456.hmmer (unexplained diff vs previous) (percentage) 0.390 -22.00%
458.sjeng 29.000 -
458.sjeng (avg) 29.000 -
458.sjeng (avg) (percentage) 0.360 -
458.sjeng (max) 21.000 -12.50%
458.sjeng (max) (percentage) 0.260 -10.34%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.700 2.41%
462.libquantum (max) 5.000 66.67%
462.libquantum (max) (percentage) 5.150 30.05%
462.libquantum (unexplained diff vs previous) 5.000 25.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.900 18.93%
464.h264ref 17.000 -
464.h264ref (avg) 17.000 -
464.h264ref (avg) (percentage) 0.310 -
464.h264ref (max) 30.000 -9.09%
464.h264ref (max) (percentage) 0.550 -8.33%
464.h264ref (unexplained diff vs previous) 19.000 -42.42%
464.h264ref (unexplained diff vs previous) (percentage) 0.340 -42.37%
470.lbm 20.000 -4.76%
470.lbm (avg) 20.000 -4.76%
470.lbm (avg) (percentage) 0.660 -1.49%
470.lbm (max) 23.000 -8.00%
470.lbm (max) (percentage) 0.740 -7.50%
470.lbm (unexplained diff vs previous) 2.000 -77.78%
470.lbm (unexplained diff vs previous) (percentage) 0.060 -79.31%
471.omnetpp 36.000 -
471.omnetpp (avg) 36.000 -
471.omnetpp (avg) (percentage) 1.330 -
471.omnetpp (max) 49.000 2.08%
471.omnetpp (max) (percentage) 1.790 2.29%
471.omnetpp (unexplained diff vs previous) 50.000 92.31%
471.omnetpp (unexplained diff vs previous) (percentage) 1.820 95.70%
473.astar 30.000 -
473.astar (avg) 30.000 -
473.astar (avg) (percentage) 0.620 -1.59%
473.astar (max) 13.000 -13.33%
473.astar (max) (percentage) 0.280 -9.68%
473.astar (unexplained diff vs previous) 11.000 -26.67%
473.astar (unexplained diff vs previous) (percentage) 0.230 -25.81%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.810 -
482.sphinx3 (max) 5.000 -54.55%
482.sphinx3 (max) (percentage) 0.630 -52.63%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.660 -
Geometric Mean 1.996 -29.14%