Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6f241e36831927e3aea113cfc017c34fdeda340a (+ 1569 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz-build/229/
View Options
Report
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0229 (llvmorg-21-init-01194-g6f241e368319) 2025-01-27T08:20:25 0:00:00
Previous 0228 (llvmorg-16-init-04084-g85b289377bff) 2022-09-06T19:36:24 0:00:00
Baseline 0014 (no-change) 2023-02-19T08:08:29 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 32 13
Performance Improvements 72 95
Added Tests 18 12
Unchanged Tests 622 624
Total Tests 744

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (avg) (percentage) 8900.00% 0.010 0.900 - -43.75% -
403.gcc (max) (percentage) 2468.97% 0.290 7.450 - -35.89% -
450.soplex (avg) (percentage) 1971.43% 0.070 1.450 - 119.70% -
403.gcc (avg) (percentage) 1815.79% 0.190 3.640 - 109.20% -
450.soplex (max) (percentage) 1555.00% 0.200 3.310 - 148.87% -
462.libquantum (max) (percentage) 1300.00% 0.040 0.560 - -90.44% -
473.astar (avg) (percentage) 1275.00% 0.040 0.550 - -89.04% -
444.namd (avg) (percentage) 1150.00% 0.060 0.750 - -82.39% -
453.povray (avg) (percentage) 620.00% 0.100 0.720 - -52.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 562.50% 0.240 1.590 - 0.00% -
483.xalancbmk (avg) (percentage) 497.67% 0.430 2.570 - -62.26% -
473.astar 440.00% 5.000 27.000 - -89.11% -
473.astar (avg) 440.00% 5.000 27.000 - -89.11% -
429.mcf (avg) (percentage) 436.84% 0.190 1.020 - -78.62% -
445.gobmk (avg) (percentage) 366.67% 0.060 0.280 - -78.63% -
482.sphinx3 (avg) (percentage) 311.76% 0.170 0.700 - -79.77% -
473.astar (unexplained diff vs previous) (percentage) 300.00% 0.030 0.120 - -99.93% -
471.omnetpp (avg) (percentage) 258.06% 0.310 1.110 - -68.64% -
458.sjeng (max) (percentage) 240.00% 0.150 0.510 - -94.47% -
429.mcf (max) (percentage) 202.78% 0.360 1.090 - -94.18% -
471.omnetpp (max) (percentage) 153.06% 0.980 2.480 - -84.77% -
447.dealII (avg) (percentage) 152.38% 0.210 0.530 - -53.51% -
458.sjeng (avg) (percentage) 131.25% 0.160 0.370 - -77.58% -
445.gobmk (max) (percentage) 116.67% 0.240 0.520 - -84.48% -
445.gobmk 100.00% 7.000 14.000 - -80.28% -
445.gobmk (avg) 100.00% 7.000 14.000 - -80.28% -
471.omnetpp (unexplained diff vs previous) 78.57% 28.000 50.000 - 0.00% -
458.sjeng (max) 54.84% 31.000 48.000 - -94.60% -
473.astar (unexplained diff vs previous) 20.00% 5.000 6.000 - -99.93% -
447.dealII (max) (percentage) 3.92% 0.510 0.530 - -88.87% -
458.sjeng 3.03% 33.000 34.000 - -78.62% -
458.sjeng (avg) 3.03% 33.000 34.000 - -78.62% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum -11.73% 23543.000 20782.000 - -5.82% -
429.mcf -9.92% 8279.000 7458.000 - -0.43% -
470.lbm -6.34% 10355.000 9698.000 - -0.21% -
433.milc -2.61% 70934.000 69085.000 - -0.55% -
458.sjeng -2.29% 91914.000 89813.000 - -0.65% -
464.h264ref -2.21% 338148.000 330678.000 - -1.28% -
444.namd -1.97% 155940.000 152863.000 - -1.29% -
453.povray -1.83% 551972.000 541851.000 - -1.44% -
482.sphinx3 -1.83% 109584.000 107575.000 - -0.46% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -99.37% 9411.000 59.000 - -1.67% -
462.libquantum -98.82% 15211.000 180.000 - -2.17% -
482.sphinx3 -96.54% 28544.000 987.000 - -0.50% -
450.soplex -96.36% 14954.000 544.000 - -1.98% -
444.namd -93.78% 12919.000 803.000 - 0.50% -
453.povray -92.77% 7132.000 516.000 - -2.46% -
433.milc -91.40% 13656.000 1174.000 - 1.03% -
429.mcf -89.88% 11483.000 1162.000 - 0.61% -
447.dealII -79.78% 12130.000 2453.000 - 0.86% -
470.lbm -74.09% 15136.000 3921.000 - -0.18% -
471.omnetpp -73.20% 11758.000 3151.000 - 1.12% -
473.astar -65.12% 14397.000 5021.000 - 1.33% -
464.h264ref -63.33% 16295.000 5976.000 - -1.11% -
445.gobmk -57.82% 12673.000 5346.000 - -1.71% -
458.sjeng -54.40% 20741.000 9458.000 - -1.87% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) -99.47% 379.000 2.000 - -98.08% -
482.sphinx3 (max) -98.18% 439.000 8.000 - -94.37% -
453.povray (max) -97.96% 49.000 1.000 - -96.00% -
433.milc (unexplained diff vs previous) -96.88% 96.000 3.000 - 0.00% -
470.lbm (max) -96.74% 429.000 14.000 - -96.84% -
433.milc (max) -94.59% 111.000 6.000 - -96.08% -
433.milc -92.92% 113.000 8.000 - -65.22% -
433.milc (avg) -92.92% 113.000 8.000 - -65.22% -
444.namd (max) (percentage) -89.12% 2.940 0.320 - -97.56% -
403.gcc -88.24% 17.000 2.000 - 100.00% -
403.gcc (avg) -88.24% 17.000 2.000 - 100.00% -
482.sphinx3 -87.50% 48.000 6.000 - -82.35% -
482.sphinx3 (avg) -87.50% 48.000 6.000 - -82.35% -
470.lbm (max) (percentage) -87.32% 2.840 0.360 - -96.81% -
403.gcc (max) -85.19% 27.000 4.000 - -33.33% -
462.libquantum (max) -83.33% 6.000 1.000 - -90.00% -
447.dealII (max) -78.69% 61.000 13.000 - -88.70% -
464.h264ref (max) -74.00% 50.000 13.000 - -95.55% -
429.mcf (max) -70.73% 41.000 12.000 - -94.44% -
464.h264ref -63.46% 52.000 19.000 - -84.17% -
464.h264ref (avg) -63.46% 52.000 19.000 - -84.17% -
433.milc (unexplained diff vs previous) (percentage) -62.86% 0.700 0.260 - 0.00% -
473.astar (max) -60.00% 15.000 6.000 - -99.81% -
453.povray -57.14% 7.000 3.000 - -57.14% -
453.povray (avg) -57.14% 7.000 3.000 - -57.14% -
458.sjeng (unexplained diff vs previous) -54.84% 31.000 14.000 - 0.00% -
483.xalancbmk (max) (percentage) -53.12% 0.640 0.300 - -99.36% -
453.povray (max) (percentage) -50.00% 0.700 0.350 - -92.75% -
447.dealII -48.00% 25.000 13.000 - -51.85% -
447.dealII (avg) -48.00% 25.000 13.000 - -51.85% -
429.mcf -47.62% 21.000 11.000 - -80.00% -
429.mcf (avg) -47.62% 21.000 11.000 - -80.00% -
482.sphinx3 (max) (percentage) -42.86% 1.540 0.880 - -93.87% -
450.soplex (max) -37.93% 29.000 18.000 - 157.14% -
471.omnetpp (max) -32.17% 115.000 78.000 - -84.62% -
450.soplex -30.00% 10.000 7.000 - 133.33% -
450.soplex (avg) -30.00% 10.000 7.000 - 133.33% -
433.milc (max) (percentage) -29.27% 0.820 0.580 - -95.62% -
464.h264ref (max) (percentage) -25.81% 0.310 0.230 - -95.25% -
444.namd -14.29% 7.000 6.000 - -82.35% -
444.namd (avg) -14.29% 7.000 6.000 - -82.35% -
433.milc (avg) (percentage) -13.25% 0.830 0.720 - -64.71% -
445.gobmk (max) -10.00% 30.000 27.000 - -85.16% -
471.omnetpp -5.56% 36.000 34.000 - -69.09% -
471.omnetpp (avg) -5.56% 36.000 34.000 - -69.09% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 6.25% 16.000 17.000 - -5.56% -
nb_compile_successful 5.88% 17.000 18.000 - -5.26% -
nb_total_tests 5.26% 19.000 20.000 - 5.26% -

Added Tests - Code Size
401.bzip2
456.hmmer

Added Tests - Execution
401.bzip2
456.hmmer

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
473.astar 1.33% 4955.000 5021.000 - -65.12% -
471.omnetpp 1.12% 3116.000 3151.000 - -73.20% -
433.milc 1.03% 1162.000 1174.000 - -91.40% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex (max) 157.14% 7.000 18.000 - -37.93% -
450.soplex (max) (percentage) 148.87% 1.330 3.310 - 1555.00% -
450.soplex 133.33% 3.000 7.000 - -30.00% -
450.soplex (avg) 133.33% 3.000 7.000 - -30.00% -
450.soplex (avg) (percentage) 119.70% 0.660 1.450 - 1971.43% -
403.gcc (avg) (percentage) 109.20% 1.740 3.640 - 1815.79% -
403.gcc 100.00% 1.000 2.000 - -88.24% -
403.gcc (avg) 100.00% 1.000 2.000 - -88.24% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 6.25% -
nb_compile_successful -5.26% 19.000 18.000 - 5.88% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.82% 22066.000 20782.000 - -11.73% -
401.bzip2 -2.12% 35781.000 35021.000 - 0.00% -
453.povray -1.44% 549774.000 541851.000 - -1.83% -
444.namd -1.29% 154855.000 152863.000 - -1.97% -
464.h264ref -1.28% 334968.000 330678.000 - -2.21% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
453.povray -2.46% 529.000 516.000 - -92.77% -
462.libquantum -2.17% 184.000 180.000 - -98.82% -
450.soplex -1.98% 555.000 544.000 - -96.36% -
458.sjeng -1.87% 9638.000 9458.000 - -54.40% -
445.gobmk -1.71% 5439.000 5346.000 - -57.82% -
403.gcc -1.67% 60.000 59.000 - -99.37% -
401.bzip2 -1.63% 3014.000 2965.000 - 0.00% -
464.h264ref -1.11% 6043.000 5976.000 - -63.33% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) -99.93% 173.660 0.120 - 300.00% -
473.astar (unexplained diff vs previous) -99.93% 8605.000 6.000 - 20.00% -
473.astar (max) (percentage) -99.81% 63.460 0.120 - 9.09% -
473.astar (max) -99.81% 3144.000 6.000 - -60.00% -
483.xalancbmk (max) (percentage) -99.36% 47.200 0.300 - -53.12% -
444.namd (max) -98.08% 104.000 2.000 - -99.47% -
444.namd (max) (percentage) -97.56% 13.140 0.320 - -89.12% -
470.lbm (max) -96.84% 443.000 14.000 - -96.74% -
470.lbm (max) (percentage) -96.81% 11.290 0.360 - -87.32% -
433.milc (max) -96.08% 153.000 6.000 - -94.59% -
453.povray (max) -96.00% 25.000 1.000 - -97.96% -
433.milc (max) (percentage) -95.62% 13.240 0.580 - -29.27% -
464.h264ref (max) -95.55% 292.000 13.000 - -74.00% -
464.h264ref (max) (percentage) -95.25% 4.840 0.230 - -25.81% -
458.sjeng (max) -94.60% 889.000 48.000 - 54.84% -
458.sjeng (max) (percentage) -94.47% 9.230 0.510 - 240.00% -
429.mcf (max) -94.44% 216.000 12.000 - -70.73% -
482.sphinx3 (max) -94.37% 142.000 8.000 - -98.18% -
429.mcf (max) (percentage) -94.18% 18.730 1.090 - 202.78% -
401.bzip2 (max) -94.12% 85.000 5.000 - 0.00% -
482.sphinx3 (max) (percentage) -93.87% 14.360 0.880 - -42.86% -
401.bzip2 (max) (percentage) -93.66% 2.840 0.180 - 0.00% -
456.hmmer (max) -92.86% 322.000 23.000 - 0.00% -
453.povray (max) (percentage) -92.75% 4.830 0.350 - -50.00% -
456.hmmer (max) (percentage) -92.70% 8.910 0.650 - 0.00% -
462.libquantum (max) (percentage) -90.44% 5.860 0.560 - 1300.00% -
462.libquantum (max) -90.00% 10.000 1.000 - -83.33% -
473.astar -89.11% 248.000 27.000 - 440.00% -
473.astar (avg) -89.11% 248.000 27.000 - 440.00% -
473.astar (avg) (percentage) -89.04% 5.020 0.550 - 1275.00% -
447.dealII (max) (percentage) -88.87% 4.760 0.530 - 3.92% -
447.dealII (max) -88.70% 115.000 13.000 - -78.69% -
470.lbm -87.82% 156.000 19.000 - 0.00% -
470.lbm (avg) -87.82% 156.000 19.000 - 0.00% -
470.lbm (avg) (percentage) -87.19% 3.980 0.510 - 0.00% -
456.hmmer -87.02% 131.000 17.000 - 0.00% -
456.hmmer (avg) -87.02% 131.000 17.000 - 0.00% -
456.hmmer (avg) (percentage) -86.81% 3.640 0.480 - 0.00% -
445.gobmk (max) -85.16% 182.000 27.000 - -10.00% -
471.omnetpp (max) (percentage) -84.77% 16.280 2.480 - 153.06% -
471.omnetpp (max) -84.62% 507.000 78.000 - -32.17% -
445.gobmk (max) (percentage) -84.48% 3.350 0.520 - 116.67% -
464.h264ref -84.17% 120.000 19.000 - -63.46% -
464.h264ref (avg) -84.17% 120.000 19.000 - -63.46% -
464.h264ref (avg) (percentage) -84.00% 2.000 0.320 - 0.00% -
444.namd (avg) (percentage) -82.39% 4.260 0.750 - 1150.00% -
444.namd -82.35% 34.000 6.000 - -14.29% -
444.namd (avg) -82.35% 34.000 6.000 - -14.29% -
482.sphinx3 -82.35% 34.000 6.000 - -87.50% -
482.sphinx3 (avg) -82.35% 34.000 6.000 - -87.50% -
445.gobmk -80.28% 71.000 14.000 - 100.00% -
445.gobmk (avg) -80.28% 71.000 14.000 - 100.00% -
429.mcf -80.00% 55.000 11.000 - -47.62% -
429.mcf (avg) -80.00% 55.000 11.000 - -47.62% -
482.sphinx3 (avg) (percentage) -79.77% 3.460 0.700 - 311.76% -
445.gobmk (avg) (percentage) -78.63% 1.310 0.280 - 366.67% -
458.sjeng -78.62% 159.000 34.000 - 3.03% -
458.sjeng (avg) -78.62% 159.000 34.000 - 3.03% -
429.mcf (avg) (percentage) -78.62% 4.770 1.020 - 436.84% -
458.sjeng (avg) (percentage) -77.58% 1.650 0.370 - 131.25% -
401.bzip2 -70.59% 34.000 10.000 - 0.00% -
401.bzip2 (avg) -70.59% 34.000 10.000 - 0.00% -
471.omnetpp -69.09% 110.000 34.000 - -5.56% -
471.omnetpp (avg) -69.09% 110.000 34.000 - -5.56% -
471.omnetpp (avg) (percentage) -68.64% 3.540 1.110 - 258.06% -
401.bzip2 (avg) (percentage) -68.10% 1.160 0.370 - 0.00% -
433.milc -65.22% 23.000 8.000 - -92.92% -
433.milc (avg) -65.22% 23.000 8.000 - -92.92% -
433.milc (avg) (percentage) -64.71% 2.040 0.720 - -13.25% -
483.xalancbmk (avg) (percentage) -62.26% 6.810 2.570 - 497.67% -
453.povray -57.14% 7.000 3.000 - -57.14% -
453.povray (avg) -57.14% 7.000 3.000 - -57.14% -
447.dealII (avg) (percentage) -53.51% 1.140 0.530 - 152.38% -
453.povray (avg) (percentage) -52.00% 1.500 0.720 - 620.00% -
447.dealII -51.85% 27.000 13.000 - -48.00% -
447.dealII (avg) -51.85% 27.000 13.000 - -48.00% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) (percentage) -43.75% 1.600 0.900 - 8900.00% -
403.gcc (max) (percentage) -35.89% 11.620 7.450 - 2468.97% -
403.gcc (max) -33.33% 6.000 4.000 - -85.19% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 5.26% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2965.000 -
403.gcc 59.000 -99.37%
429.mcf 1162.000 -89.88%
433.milc 1174.000 -91.40%
444.namd 803.000 -93.78%
445.gobmk 5346.000 -57.82%
447.dealII 2453.000 -79.78%
450.soplex 544.000 -96.36%
453.povray 516.000 -92.77%
456.hmmer 3609.000 -
458.sjeng 9458.000 -54.40%
462.libquantum 180.000 -98.82%
464.h264ref 5976.000 -63.33%
470.lbm 3921.000 -74.09%
471.omnetpp 3151.000 -73.20%
473.astar 5021.000 -65.12%
482.sphinx3 987.000 -96.54%
Geometric Mean 1542.591 -88.77%
Code Size (bytes)
Name Current %
401.bzip2 35021.000 -
403.gcc 1836957.000 -
429.mcf 7458.000 -9.92%
433.milc 69085.000 -2.61%
444.namd 152863.000 -1.97%
445.gobmk 1288994.000 -
447.dealII 1471339.000 -
450.soplex 180006.000 -
453.povray 541851.000 -1.83%
456.hmmer 155754.000 -
458.sjeng 89813.000 -2.29%
462.libquantum 20782.000 -11.73%
464.h264ref 330678.000 -2.21%
470.lbm 9698.000 -6.34%
471.omnetpp 363135.000 -
473.astar 21331.000 -
482.sphinx3 107575.000 -1.83%
Geometric Mean 128689.109 -9.84%
Score
Name Current %
nb_compile_successful 18.000 5.88%
nb_execution_successful 17.000 6.25%
nb_total_tests 20.000 5.26%
Geometric Mean 18.292 5.80%
sample variability
Name Current %
401.bzip2 10.000 -
401.bzip2 (avg) 10.000 -
401.bzip2 (avg) (percentage) 0.370 -
401.bzip2 (max) 5.000 -
401.bzip2 (max) (percentage) 0.180 -
403.gcc 2.000 -88.24%
403.gcc (avg) 2.000 -88.24%
403.gcc (avg) (percentage) 3.640 1815.79%
403.gcc (max) 4.000 -85.19%
403.gcc (max) (percentage) 7.450 2468.97%
429.mcf 11.000 -47.62%
429.mcf (avg) 11.000 -47.62%
429.mcf (avg) (percentage) 1.020 436.84%
429.mcf (max) 12.000 -70.73%
429.mcf (max) (percentage) 1.090 202.78%
433.milc 8.000 -92.92%
433.milc (avg) 8.000 -92.92%
433.milc (avg) (percentage) 0.720 -13.25%
433.milc (max) 6.000 -94.59%
433.milc (max) (percentage) 0.580 -29.27%
433.milc (unexplained diff vs previous) 3.000 -96.88%
433.milc (unexplained diff vs previous) (percentage) 0.260 -62.86%
444.namd 6.000 -14.29%
444.namd (avg) 6.000 -14.29%
444.namd (avg) (percentage) 0.750 1150.00%
444.namd (max) 2.000 -99.47%
444.namd (max) (percentage) 0.320 -89.12%
445.gobmk 14.000 100.00%
445.gobmk (avg) 14.000 100.00%
445.gobmk (avg) (percentage) 0.280 366.67%
445.gobmk (max) 27.000 -10.00%
445.gobmk (max) (percentage) 0.520 116.67%
447.dealII 13.000 -48.00%
447.dealII (avg) 13.000 -48.00%
447.dealII (avg) (percentage) 0.530 152.38%
447.dealII (max) 13.000 -78.69%
447.dealII (max) (percentage) 0.530 3.92%
450.soplex 7.000 -30.00%
450.soplex (avg) 7.000 -30.00%
450.soplex (avg) (percentage) 1.450 1971.43%
450.soplex (max) 18.000 -37.93%
450.soplex (max) (percentage) 3.310 1555.00%
453.povray 3.000 -57.14%
453.povray (avg) 3.000 -57.14%
453.povray (avg) (percentage) 0.720 620.00%
453.povray (max) 1.000 -97.96%
453.povray (max) (percentage) 0.350 -50.00%
456.hmmer 17.000 -
456.hmmer (avg) 17.000 -
456.hmmer (avg) (percentage) 0.480 -
456.hmmer (max) 23.000 -
456.hmmer (max) (percentage) 0.650 -
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -
458.sjeng 34.000 3.03%
458.sjeng (avg) 34.000 3.03%
458.sjeng (avg) (percentage) 0.370 131.25%
458.sjeng (max) 48.000 54.84%
458.sjeng (max) (percentage) 0.510 240.00%
458.sjeng (unexplained diff vs previous) 14.000 -54.84%
458.sjeng (unexplained diff vs previous) (percentage) 0.150 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 0.900 8900.00%
462.libquantum (max) 1.000 -83.33%
462.libquantum (max) (percentage) 0.560 1300.00%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.560 -
464.h264ref 19.000 -63.46%
464.h264ref (avg) 19.000 -63.46%
464.h264ref (avg) (percentage) 0.320 -
464.h264ref (max) 13.000 -74.00%
464.h264ref (max) (percentage) 0.230 -25.81%
470.lbm 19.000 -
470.lbm (avg) 19.000 -
470.lbm (avg) (percentage) 0.510 -
470.lbm (max) 14.000 -96.74%
470.lbm (max) (percentage) 0.360 -87.32%
470.lbm (unexplained diff vs previous) 14.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.360 -
471.omnetpp 34.000 -5.56%
471.omnetpp (avg) 34.000 -5.56%
471.omnetpp (avg) (percentage) 1.110 258.06%
471.omnetpp (max) 78.000 -32.17%
471.omnetpp (max) (percentage) 2.480 153.06%
471.omnetpp (unexplained diff vs previous) 50.000 78.57%
471.omnetpp (unexplained diff vs previous) (percentage) 1.590 562.50%
473.astar 27.000 440.00%
473.astar (avg) 27.000 440.00%
473.astar (avg) (percentage) 0.550 1275.00%
473.astar (max) 6.000 -60.00%
473.astar (max) (percentage) 0.120 -
473.astar (unexplained diff vs previous) 6.000 20.00%
473.astar (unexplained diff vs previous) (percentage) 0.120 300.00%
482.sphinx3 6.000 -87.50%
482.sphinx3 (avg) 6.000 -87.50%
482.sphinx3 (avg) (percentage) 0.700 311.76%
482.sphinx3 (max) 8.000 -98.18%
482.sphinx3 (max) (percentage) 0.880 -42.86%
483.xalancbmk (avg) (percentage) 2.570 497.67%
483.xalancbmk (max) (percentage) 0.300 -53.12%
Geometric Mean 2.807 49.75%