Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4cff320e0d4574d5084ad751f9ee3ca22c08afa1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz-build/152/
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0152 (no-change) 2024-06-07T20:35:39 0:00:00
Previous 0150 (llvmorg-19-init-14000-g4cff320e0d45) 2024-06-04T10:02:50 0:00:00
Baseline 0014 (no-change) 2023-02-19T08:08:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 8
Performance Improvements 59 96
Added Tests 8 32
Unchanged Tests 691 644
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 2.14% 515.000 526.000 - -0.57% -
403.gcc 1.64% 61.000 62.000 - 3.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 400.00% 2.000 10.000 - -90.38% -
444.namd (max) (percentage) 288.57% 0.350 1.360 - -89.65% -
453.povray (unexplained diff vs previous) 266.67% 3.000 11.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) 260.34% 0.580 2.090 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 144.44% 0.090 0.220 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 140.00% 5.000 12.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 127.27% 0.110 0.250 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) 125.00% 4.000 9.000 0.000 0.00% 0.000
453.povray (max) 83.33% 6.000 11.000 - -56.00% -
453.povray (max) (percentage) 68.50% 1.270 2.140 - -55.69% -
482.sphinx3 (unexplained diff vs previous) (percentage) 55.00% 0.200 0.310 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 52.73% 1.100 1.680 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) 48.65% 1.110 1.650 - -71.84% -
456.hmmer (max) 12.50% 8.000 9.000 - -97.20% -
456.hmmer (max) (percentage) 8.70% 0.230 0.250 - -97.19% -
453.povray (avg) (percentage) 5.81% 0.860 0.910 - -39.33% -
462.libquantum (avg) (percentage) 3.39% 0.590 0.610 - -61.88% -
444.namd (avg) (percentage) 1.09% 0.920 0.930 - -78.17% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.65% 182.000 179.000 - -2.72% -
444.namd -1.36% 807.000 796.000 - -0.38% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) -80.95% 0.420 0.080 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -80.22% 0.910 0.180 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -80.00% 5.000 1.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -80.00% 5.000 1.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) -66.67% 9.000 3.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -66.67% 0.150 0.050 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -60.87% 23.000 9.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -60.80% 1.990 0.780 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -60.68% 1.170 0.460 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -60.53% 38.000 15.000 0.000 0.00% 0.000
403.gcc -50.00% 2.000 1.000 - 0.00% -
403.gcc (avg) -50.00% 2.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -35.00% 0.400 0.260 0.000 -99.85% 0.000
473.astar (unexplained diff vs previous) -35.00% 20.000 13.000 0.000 -99.85% 0.000
470.lbm (unexplained diff vs previous) -30.77% 13.000 9.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -30.30% 0.330 0.230 0.000 0.00% 0.000
473.astar (max) -20.00% 20.000 16.000 - -99.49% -
470.lbm (max) (percentage) -18.18% 0.330 0.270 - -97.61% -
473.astar (max) (percentage) -17.50% 0.400 0.330 - -99.48% -
470.lbm (max) -16.67% 12.000 10.000 - -97.74% -
464.h264ref (max) -15.79% 19.000 16.000 - -94.52% -
471.omnetpp (max) -13.16% 38.000 33.000 - -93.49% -
429.mcf (max) -13.04% 23.000 20.000 - -90.74% -
471.omnetpp (max) (percentage) -12.61% 1.190 1.040 - -93.61% -
433.milc (max) -12.50% 8.000 7.000 - -95.42% -
464.h264ref (max) (percentage) -12.50% 0.320 0.280 - -94.21% -
429.mcf (max) (percentage) -12.32% 2.030 1.780 - -90.50% -
433.milc (max) (percentage) -11.43% 0.700 0.620 - -95.32% -
458.sjeng (max) -11.36% 44.000 39.000 - -95.61% -
458.sjeng (max) (percentage) -10.64% 0.470 0.420 - -95.45% -
401.bzip2 (max) -9.09% 11.000 10.000 - -88.24% -
450.soplex (max) (percentage) -7.78% 0.900 0.830 - -37.59% -
401.bzip2 -7.69% 13.000 12.000 - -64.71% -
401.bzip2 (avg) -7.69% 13.000 12.000 - -64.71% -
482.sphinx3 (max) -7.69% 13.000 12.000 - -91.55% -
447.dealII (max) -7.14% 28.000 26.000 - -77.39% -
447.dealII (max) (percentage) -6.90% 1.160 1.080 - -77.31% -
445.gobmk (max) -5.88% 17.000 16.000 - -91.21% -
401.bzip2 (max) (percentage) -5.26% 0.380 0.360 - -87.32% -
403.gcc (avg) (percentage) -4.76% 3.360 3.200 - 83.91% -
464.h264ref -4.00% 25.000 24.000 - -80.00% -
464.h264ref (avg) -4.00% 25.000 24.000 - -80.00% -
482.sphinx3 (max) (percentage) -3.76% 1.330 1.280 - -91.09% -
445.gobmk (max) (percentage) -3.13% 0.320 0.310 - -90.75% -
447.dealII (avg) (percentage) -2.90% 0.690 0.670 - -41.23% -
471.omnetpp -2.50% 40.000 39.000 - -64.55% -
471.omnetpp (avg) -2.50% 40.000 39.000 - -64.55% -
464.h264ref (avg) (percentage) -2.38% 0.420 0.410 - -79.50% -
473.astar -2.33% 43.000 42.000 - -83.06% -
473.astar (avg) -2.33% 43.000 42.000 - -83.06% -
401.bzip2 (avg) (percentage) -2.27% 0.440 0.430 - -62.93% -
471.omnetpp (avg) (percentage) -1.61% 1.240 1.220 - -65.54% -
403.gcc (max) (percentage) -1.57% 3.180 3.130 - -73.06% -
456.hmmer (avg) (percentage) -1.54% 0.650 0.640 - -82.42% -
450.soplex (avg) (percentage) -1.50% 1.330 1.310 - 98.48% -
482.sphinx3 (avg) (percentage) -1.19% 0.840 0.830 - -76.01% -
473.astar (avg) (percentage) -1.16% 0.860 0.850 - -83.07% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 4.40% 3116.000 3253.000 - 0.46% -
403.gcc 3.33% 60.000 62.000 - 1.64% -
473.astar 1.76% 4955.000 5042.000 - -0.26% -
433.milc 1.55% 1162.000 1180.000 - 0.08% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex 133.33% 3.000 7.000 - 0.00% -
450.soplex (avg) 133.33% 3.000 7.000 - 0.00% -
450.soplex (avg) (percentage) 98.48% 0.660 1.310 - -1.50% -
403.gcc (avg) (percentage) 83.91% 1.740 3.200 - -4.76% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.24% 22066.000 20910.000 - 0.00% -
401.bzip2 -1.64% 35781.000 35193.000 - 0.00% -
453.povray -1.18% 549774.000 543267.000 - 0.00% -
464.h264ref -1.10% 334968.000 331298.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -2.72% 184.000 179.000 - -1.65% -
458.sjeng -1.71% 9638.000 9473.000 - -0.07% -
445.gobmk -1.51% 5439.000 5357.000 - 0.22% -
464.h264ref -1.47% 6043.000 5954.000 - -0.05% -
482.sphinx3 -1.21% 992.000 980.000 - -0.31% -
401.bzip2 -1.16% 3014.000 2979.000 - 0.20% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) -99.85% 173.660 0.260 0.000 -35.00% 0.000
473.astar (unexplained diff vs previous) -99.85% 8605.000 13.000 0.000 -35.00% 0.000
473.astar (max) -99.49% 3144.000 16.000 - -20.00% -
473.astar (max) (percentage) -99.48% 63.460 0.330 - -17.50% -
483.xalancbmk (max) (percentage) -99.22% 47.200 0.370 - 0.00% -
470.lbm (max) -97.74% 443.000 10.000 - -16.67% -
470.lbm (max) (percentage) -97.61% 11.290 0.270 - -18.18% -
456.hmmer (max) -97.20% 322.000 9.000 - 12.50% -
456.hmmer (max) (percentage) -97.19% 8.910 0.250 - 8.70% -
458.sjeng (max) -95.61% 889.000 39.000 - -11.36% -
458.sjeng (max) (percentage) -95.45% 9.230 0.420 - -10.64% -
433.milc (max) -95.42% 153.000 7.000 - -12.50% -
433.milc (max) (percentage) -95.32% 13.240 0.620 - -11.43% -
464.h264ref (max) -94.52% 292.000 16.000 - -15.79% -
464.h264ref (max) (percentage) -94.21% 4.840 0.280 - -12.50% -
471.omnetpp (max) (percentage) -93.61% 16.280 1.040 - -12.61% -
471.omnetpp (max) -93.49% 507.000 33.000 - -13.16% -
482.sphinx3 (max) -91.55% 142.000 12.000 - -7.69% -
445.gobmk (max) -91.21% 182.000 16.000 - -5.88% -
482.sphinx3 (max) (percentage) -91.09% 14.360 1.280 - -3.76% -
445.gobmk (max) (percentage) -90.75% 3.350 0.310 - -3.13% -
429.mcf (max) -90.74% 216.000 20.000 - -13.04% -
429.mcf (max) (percentage) -90.50% 18.730 1.780 - -12.32% -
444.namd (max) -90.38% 104.000 10.000 - 400.00% -
444.namd (max) (percentage) -89.65% 13.140 1.360 - 288.57% -
401.bzip2 (max) -88.24% 85.000 10.000 - -9.09% -
401.bzip2 (max) (percentage) -87.32% 2.840 0.360 - -5.26% -
403.gcc (max) -83.33% 6.000 1.000 - 0.00% -
470.lbm -83.33% 156.000 26.000 - 0.00% -
470.lbm (avg) -83.33% 156.000 26.000 - 0.00% -
473.astar (avg) (percentage) -83.07% 5.020 0.850 - -1.16% -
473.astar -83.06% 248.000 42.000 - -2.33% -
473.astar (avg) -83.06% 248.000 42.000 - -2.33% -
470.lbm (avg) (percentage) -82.91% 3.980 0.680 - -1.45% -
456.hmmer -82.44% 131.000 23.000 - 0.00% -
456.hmmer (avg) -82.44% 131.000 23.000 - 0.00% -
456.hmmer (avg) (percentage) -82.42% 3.640 0.640 - -1.54% -
462.libquantum (max) -80.00% 10.000 2.000 - 0.00% -
464.h264ref -80.00% 120.000 24.000 - -4.00% -
464.h264ref (avg) -80.00% 120.000 24.000 - -4.00% -
464.h264ref (avg) (percentage) -79.50% 2.000 0.410 - -2.38% -
444.namd -79.41% 34.000 7.000 - 0.00% -
444.namd (avg) -79.41% 34.000 7.000 - 0.00% -
444.namd (avg) (percentage) -78.17% 4.260 0.930 - 1.09% -
447.dealII (max) -77.39% 115.000 26.000 - -7.14% -
447.dealII (max) (percentage) -77.31% 4.760 1.080 - -6.90% -
482.sphinx3 -76.47% 34.000 8.000 - 0.00% -
482.sphinx3 (avg) -76.47% 34.000 8.000 - 0.00% -
445.gobmk -76.06% 71.000 17.000 - 0.00% -
445.gobmk (avg) -76.06% 71.000 17.000 - 0.00% -
482.sphinx3 (avg) (percentage) -76.01% 3.460 0.830 - -1.19% -
445.gobmk (avg) (percentage) -75.57% 1.310 0.320 - 0.00% -
429.mcf -74.55% 55.000 14.000 - 0.00% -
429.mcf (avg) -74.55% 55.000 14.000 - 0.00% -
458.sjeng -73.58% 159.000 42.000 - 0.00% -
458.sjeng (avg) -73.58% 159.000 42.000 - 0.00% -
429.mcf (avg) (percentage) -73.38% 4.770 1.270 - -0.78% -
403.gcc (max) (percentage) -73.06% 11.620 3.130 - -1.57% -
458.sjeng (avg) (percentage) -72.73% 1.650 0.450 - 0.00% -
462.libquantum (max) (percentage) -71.84% 5.860 1.650 - 48.65% -
471.omnetpp (avg) (percentage) -65.54% 3.540 1.220 - -1.61% -
401.bzip2 -64.71% 34.000 12.000 - -7.69% -
401.bzip2 (avg) -64.71% 34.000 12.000 - -7.69% -
471.omnetpp -64.55% 110.000 39.000 - -2.50% -
471.omnetpp (avg) -64.55% 110.000 39.000 - -2.50% -
401.bzip2 (avg) (percentage) -62.93% 1.160 0.430 - -2.27% -
483.xalancbmk (avg) (percentage) -62.26% 6.810 2.570 - 0.00% -
462.libquantum (avg) (percentage) -61.88% 1.600 0.610 - 3.39% -
433.milc -60.87% 23.000 9.000 - 0.00% -
433.milc (avg) -60.87% 23.000 9.000 - 0.00% -
433.milc (avg) (percentage) -60.29% 2.040 0.810 - -1.22% -
453.povray (max) -56.00% 25.000 11.000 - 83.33% -
453.povray (max) (percentage) -55.69% 4.830 2.140 - 68.50% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
450.soplex (max) -42.86% 7.000 4.000 - 0.00% -
453.povray -42.86% 7.000 4.000 - 0.00% -
453.povray (avg) -42.86% 7.000 4.000 - 0.00% -
447.dealII (avg) (percentage) -41.23% 1.140 0.670 - -2.90% -
447.dealII -40.74% 27.000 16.000 - 0.00% -
447.dealII (avg) -40.74% 27.000 16.000 - 0.00% -
453.povray (avg) (percentage) -39.33% 1.500 0.910 - 5.81% -
450.soplex (max) (percentage) -37.59% 1.330 0.830 - -7.78% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2979.000 -
403.gcc 62.000 1.64%
429.mcf 1148.000 -
433.milc 1180.000 -
444.namd 796.000 -1.36%
445.gobmk 5357.000 -
447.dealII 2441.000 -
450.soplex 552.000 -
453.povray 526.000 2.14%
456.hmmer 3617.000 -
458.sjeng 9473.000 -
462.libquantum 179.000 -1.65%
464.h264ref 5954.000 -
470.lbm 3918.000 -
471.omnetpp 3253.000 -
473.astar 5042.000 -
482.sphinx3 980.000 -
Geometric Mean 1550.977 -
Name Current %
401.bzip2 35193.000 -
403.gcc 1839529.000 -
429.mcf 7466.000 -
433.milc 69169.000 -
444.namd 153571.000 -
445.gobmk 1289058.000 -
447.dealII 1472735.000 -
450.soplex 180022.000 -
453.povray 543267.000 -
456.hmmer 156046.000 -
458.sjeng 89917.000 -
462.libquantum 20910.000 -
464.h264ref 331298.000 -
470.lbm 9706.000 -
471.omnetpp 363435.000 -
473.astar 21359.000 -
482.sphinx3 107743.000 -
Geometric Mean 128935.138 -
Name Current %
401.bzip2 12.000 -7.69%
401.bzip2 (avg) 12.000 -7.69%
401.bzip2 (avg) (percentage) 0.430 -2.27%
401.bzip2 (max) 10.000 -9.09%
401.bzip2 (max) (percentage) 0.360 -5.26%
401.bzip2 (unexplained diff vs previous) 6.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.200 -
403.gcc 1.000 -50.00%
403.gcc (avg) 1.000 -50.00%
403.gcc (avg) (percentage) 3.200 -4.76%
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.130 -1.57%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.610 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.270 -
429.mcf (max) 20.000 -13.04%
429.mcf (max) (percentage) 1.780 -12.32%
429.mcf (unexplained diff vs previous) 9.000 -60.87%
429.mcf (unexplained diff vs previous) (percentage) 0.780 -60.80%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.810 -
433.milc (max) 7.000 -12.50%
433.milc (max) (percentage) 0.620 -11.43%
433.milc (unexplained diff vs previous) 1.000 -80.00%
433.milc (unexplained diff vs previous) (percentage) 0.080 -80.95%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 0.930 1.09%
444.namd (max) 10.000 400.00%
444.namd (max) (percentage) 1.360 288.57%
444.namd (unexplained diff vs previous) 11.000 -
444.namd (unexplained diff vs previous) (percentage) 1.380 -
445.gobmk 17.000 -
445.gobmk (avg) 17.000 -
445.gobmk (avg) (percentage) 0.320 -
445.gobmk (max) 16.000 -5.88%
445.gobmk (max) (percentage) 0.310 -3.13%
445.gobmk (unexplained diff vs previous) 12.000 140.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.220 144.44%
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 0.670 -2.90%
447.dealII (max) 26.000 -7.14%
447.dealII (max) (percentage) 1.080 -6.90%
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.040 -
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.310 -1.50%
450.soplex (max) 4.000 -
450.soplex (max) (percentage) 0.830 -7.78%
450.soplex (unexplained diff vs previous) 1.000 -80.00%
450.soplex (unexplained diff vs previous) (percentage) 0.180 -80.22%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.910 5.81%
453.povray (max) 11.000 83.33%
453.povray (max) (percentage) 2.140 68.50%
453.povray (unexplained diff vs previous) 11.000 266.67%
453.povray (unexplained diff vs previous) (percentage) 2.090 260.34%
456.hmmer 23.000 -
456.hmmer (avg) 23.000 -
456.hmmer (avg) (percentage) 0.640 -1.54%
456.hmmer (max) 9.000 12.50%
456.hmmer (max) (percentage) 0.250 8.70%
456.hmmer (unexplained diff vs previous) 9.000 125.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.250 127.27%
458.sjeng 42.000 -
458.sjeng (avg) 42.000 -
458.sjeng (avg) (percentage) 0.450 -
458.sjeng (max) 39.000 -11.36%
458.sjeng (max) (percentage) 0.420 -10.64%
458.sjeng (unexplained diff vs previous) 7.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.070 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 0.610 3.39%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.650 48.65%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.680 52.73%
464.h264ref 24.000 -4.00%
464.h264ref (avg) 24.000 -4.00%
464.h264ref (avg) (percentage) 0.410 -2.38%
464.h264ref (max) 16.000 -15.79%
464.h264ref (max) (percentage) 0.280 -12.50%
464.h264ref (unexplained diff vs previous) 3.000 -66.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -66.67%
470.lbm 26.000 -
470.lbm (avg) 26.000 -
470.lbm (avg) (percentage) 0.680 -
470.lbm (max) 10.000 -16.67%
470.lbm (max) (percentage) 0.270 -18.18%
470.lbm (unexplained diff vs previous) 9.000 -30.77%
470.lbm (unexplained diff vs previous) (percentage) 0.230 -30.30%
471.omnetpp 39.000 -2.50%
471.omnetpp (avg) 39.000 -2.50%
471.omnetpp (avg) (percentage) 1.220 -1.61%
471.omnetpp (max) 33.000 -13.16%
471.omnetpp (max) (percentage) 1.040 -12.61%
471.omnetpp (unexplained diff vs previous) 15.000 -60.53%
471.omnetpp (unexplained diff vs previous) (percentage) 0.460 -60.68%
473.astar 42.000 -2.33%
473.astar (avg) 42.000 -2.33%
473.astar (avg) (percentage) 0.850 -1.16%
473.astar (max) 16.000 -20.00%
473.astar (max) (percentage) 0.330 -17.50%
473.astar (unexplained diff vs previous) 13.000 -35.00%
473.astar (unexplained diff vs previous) (percentage) 0.260 -35.00%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.830 -1.19%
482.sphinx3 (max) 12.000 -7.69%
482.sphinx3 (max) (percentage) 1.280 -3.76%
482.sphinx3 (unexplained diff vs previous) 3.000 50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.310 55.00%
483.xalancbmk (avg) (percentage) 2.570 -
483.xalancbmk (max) (percentage) 0.370 -
Geometric Mean 2.649 3.43%