Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/265d6bda95b1dc84fb37ac8a5f18d2b283a7aa3f (+ 283 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/59/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0059 (llvmorg-18-init-03592-g265d6bda95b1) 2023-08-12T03:01:57 0:00:00
Previous 0058 (llvmorg-18-init-03309-g1654634f6f8b) 2023-07-28T05:07:35 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 12 28
Performance Improvements 69 106
Added Tests 22 8
Unchanged Tests 677 638
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 1.41% 498.000 505.000 - -92.77% -
450.soplex 1.29% 542.000 549.000 - -96.37% -
447.dealII 1.23% 2027.000 2052.000 - -78.12% -
433.milc 1.21% 1154.000 1168.000 - -91.41% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (max) 316.67% 6.000 25.000 - -88.79% -
447.dealII (max) (percentage) 284.37% 0.320 1.230 - -48.32% -
464.h264ref (max) (percentage) 152.94% 0.170 0.430 - 2.38% -
464.h264ref (max) 150.00% 10.000 25.000 - -58.33% -
482.sphinx3 (max) (percentage) 74.51% 0.510 0.890 - -73.11% -
482.sphinx3 (max) 60.00% 5.000 8.000 - -99.09% -
433.milc (avg) (percentage) 2.82% 0.710 0.730 - -15.12% -
450.soplex (avg) (percentage) 2.60% 0.770 0.790 - 58.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.17% 58.000 55.000 - -99.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -80.00% 5.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -79.78% 2.670 0.540 - 5300.00% -
471.omnetpp (unexplained diff vs previous) -63.93% 61.000 22.000 - -78.64% -
471.omnetpp (unexplained diff vs previous) (percentage) -63.72% 2.150 0.780 - -20.41% -
456.hmmer (max) -53.85% 13.000 6.000 - -99.52% -
456.hmmer (max) (percentage) -51.43% 0.350 0.170 - -98.38% -
473.astar (max) -48.15% 27.000 14.000 - -98.30% -
473.astar (max) (percentage) -46.67% 0.600 0.320 - -95.22% -
483.xalancbmk (unexplained diff vs previous) -31.71% 41.000 28.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -30.83% 1.200 0.830 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -29.73% 0.370 0.260 - 30.00% -
473.astar (unexplained diff vs previous) -29.41% 17.000 12.000 - -52.00% -
444.namd (max) -28.57% 7.000 5.000 - -99.50% -
444.namd (max) (percentage) -25.84% 0.890 0.660 - -91.84% -
471.omnetpp (max) -25.81% 62.000 46.000 - -95.27% -
471.omnetpp (max) (percentage) -25.00% 2.200 1.650 - -82.22% -
456.hmmer (unexplained diff vs previous) -25.00% 8.000 6.000 - -86.96% -
456.hmmer (unexplained diff vs previous) (percentage) -23.81% 0.210 0.160 - -58.97% -
458.sjeng (max) -23.08% 39.000 30.000 - -96.58% -
458.sjeng (max) (percentage) -21.28% 0.470 0.370 - -92.80% -
462.libquantum (max) -20.00% 5.000 4.000 - -99.56% -
433.milc (max) (percentage) -17.20% 1.570 1.300 - 62.50% -
433.milc (max) -16.67% 18.000 15.000 - -86.11% -
401.bzip2 (max) -12.50% 40.000 35.000 - -94.25% -
401.bzip2 (max) (percentage) -12.14% 1.400 1.230 - -67.46% -
462.libquantum (max) (percentage) -9.82% 2.750 2.480 - -61.13% -
482.sphinx3 -6.67% 15.000 14.000 - -96.98% -
482.sphinx3 (avg) -6.67% 15.000 14.000 - -96.98% -
429.mcf (max) (percentage) -6.48% 2.160 2.020 - -87.61% -
444.namd -5.88% 17.000 16.000 - -94.97% -
444.namd (avg) -5.88% 17.000 16.000 - -94.97% -
458.sjeng -5.75% 87.000 82.000 - -39.71% -
458.sjeng (avg) -5.75% 87.000 82.000 - -39.71% -
483.xalancbmk (max) -5.66% 53.000 50.000 - -95.86% -
483.xalancbmk -5.52% 163.000 154.000 - -22.22% -
483.xalancbmk (avg) -5.52% 163.000 154.000 - -22.22% -
429.mcf -5.26% 38.000 36.000 - -87.84% -
429.mcf (avg) -5.26% 38.000 36.000 - -87.84% -
483.xalancbmk (max) (percentage) -5.06% 1.580 1.500 - -88.37% -
470.lbm (max) (percentage) -5.00% 0.600 0.570 - -90.03% -
458.sjeng (avg) (percentage) -4.76% 1.050 1.000 - 25.00% -
483.xalancbmk (avg) (percentage) -4.58% 4.800 4.580 - 116.04% -
470.lbm -4.49% 89.000 85.000 - -80.73% -
470.lbm (avg) -4.49% 89.000 85.000 - -80.73% -
470.lbm (max) -4.35% 23.000 22.000 - -97.10% -
444.namd (avg) (percentage) -4.21% 2.140 2.050 - -20.23% -
401.bzip2 -4.17% 24.000 23.000 - -77.88% -
401.bzip2 (avg) -4.17% 24.000 23.000 - -77.88% -
429.mcf (max) -4.17% 24.000 23.000 - -98.99% -
473.astar (avg) (percentage) -4.17% 1.680 1.610 - 75.00% -
473.astar -3.95% 76.000 73.000 - -34.82% -
473.astar (avg) -3.95% 76.000 73.000 - -34.82% -
456.hmmer -3.85% 130.000 125.000 - -23.78% -
456.hmmer (avg) -3.85% 130.000 125.000 - -23.78% -
429.mcf (avg) (percentage) -3.65% 3.290 3.170 - 49.53% -
450.soplex (max) (percentage) -3.65% 1.920 1.850 - 12.12% -
462.libquantum (avg) (percentage) -3.57% 1.960 1.890 - 145.45% -
471.omnetpp -3.57% 112.000 108.000 - -35.33% -
471.omnetpp (avg) -3.57% 112.000 108.000 - -35.33% -
470.lbm (avg) (percentage) -3.56% 2.250 2.170 - -34.83% -
401.bzip2 (avg) (percentage) -3.53% 0.850 0.820 - 26.15% -
456.hmmer (avg) (percentage) -3.52% 3.410 3.290 - 136.69% -
471.omnetpp (avg) (percentage) -2.78% 3.960 3.850 - 140.62% -
453.povray (max) (percentage) -2.69% 1.860 1.810 - 402.78% -
464.h264ref (avg) (percentage) -2.44% 0.820 0.800 - 175.86% -
464.h264ref -2.04% 49.000 48.000 - 14.29% -
464.h264ref (avg) -2.04% 49.000 48.000 - 14.29% -
482.sphinx3 (avg) (percentage) -1.97% 1.520 1.490 - -14.37% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.17% 146765.000 149952.000 - 0.00% -
471.omnetpp 1.49% 316676.000 321389.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 5300.00% 0.010 0.540 - -79.78% -
433.milc (unexplained diff vs previous) (percentage) 1100.00% 0.100 1.200 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 733.33% 0.060 0.500 - 0.00% -
453.povray (max) (percentage) 402.78% 0.360 1.810 - -2.69% -
450.soplex (unexplained diff vs previous) (percentage) 178.26% 0.460 1.280 - 0.00% -
464.h264ref (avg) (percentage) 175.86% 0.290 0.800 - -2.44% -
462.libquantum (avg) (percentage) 145.45% 0.770 1.890 - -3.57% -
471.omnetpp (avg) (percentage) 140.62% 1.600 3.850 - -2.78% -
456.hmmer (avg) (percentage) 136.69% 1.390 3.290 - -3.52% -
429.mcf (unexplained diff vs previous) (percentage) 118.75% 0.160 0.350 - 0.00% -
483.xalancbmk (avg) (percentage) 116.04% 2.120 4.580 - -4.58% -
447.dealII (unexplained diff vs previous) (percentage) 110.34% 0.580 1.220 - 0.00% -
473.astar (avg) (percentage) 75.00% 0.920 1.610 - -4.17% -
433.milc (max) (percentage) 62.50% 0.800 1.300 - -17.20% -
450.soplex (avg) (percentage) 58.00% 0.500 0.790 - 2.60% -
429.mcf (avg) (percentage) 49.53% 2.120 3.170 - -3.65% -
403.gcc (avg) (percentage) 36.36% 0.550 0.750 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 30.00% 0.200 0.260 - -29.73% -
401.bzip2 (avg) (percentage) 26.15% 0.650 0.820 - -3.53% -
458.sjeng (avg) (percentage) 25.00% 0.800 1.000 - -4.76% -
453.povray (avg) (percentage) 16.25% 0.800 0.930 - 0.00% -
464.h264ref 14.29% 42.000 48.000 - -2.04% -
464.h264ref (avg) 14.29% 42.000 48.000 - -2.04% -
450.soplex (max) (percentage) 12.12% 1.650 1.850 - -3.65% -
433.milc (unexplained diff vs previous) 7.69% 13.000 14.000 - 0.00% -
464.h264ref (max) (percentage) 2.38% 0.420 0.430 - 152.94% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.37% 7239.000 6995.000 - 0.00% -
453.povray -1.85% 524493.000 514779.000 - -0.01% -
462.libquantum -1.58% 12504.000 12306.000 - 0.00% -
433.milc -1.42% 47001.000 46333.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.42% 9509.000 55.000 - -5.17% -
462.libquantum -98.71% 14409.000 186.000 - -0.53% -
450.soplex -96.37% 15112.000 549.000 - 1.29% -
482.sphinx3 -96.25% 26682.000 1001.000 - -0.89% -
444.namd -93.52% 12400.000 804.000 - -0.50% -
453.povray -92.77% 6987.000 505.000 - 1.41% -
429.mcf -91.76% 13988.000 1152.000 - -0.35% -
433.milc -91.41% 13601.000 1168.000 - 1.21% -
401.bzip2 -82.26% 16137.000 2863.000 - -0.17% -
447.dealII -78.12% 9380.000 2052.000 - 1.23% -
471.omnetpp -73.19% 10477.000 2809.000 - -0.78% -
470.lbm -70.14% 13259.000 3959.000 - -0.48% -
456.hmmer -67.77% 11854.000 3820.000 - 0.16% -
483.xalancbmk -64.00% 9376.000 3375.000 - -0.82% -
473.astar -62.88% 12272.000 4555.000 - -0.26% -
464.h264ref -58.55% 14498.000 6010.000 - 0.43% -
445.gobmk -55.89% 11093.000 4893.000 - 0.04% -
458.sjeng -51.36% 17055.000 8296.000 - -0.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) -99.56% 919.000 4.000 - -20.00% -
403.gcc (max) -99.55% 221.000 1.000 - 0.00% -
456.hmmer (max) -99.52% 1242.000 6.000 - -53.85% -
444.namd (max) -99.50% 1003.000 5.000 - -28.57% -
482.sphinx3 (max) -99.09% 883.000 8.000 - 60.00% -
482.sphinx3 (unexplained diff vs previous) -99.02% 914.000 9.000 - 0.00% -
429.mcf (max) -98.99% 2281.000 23.000 - -4.17% -
445.gobmk (max) -98.55% 413.000 6.000 - 0.00% -
456.hmmer (max) (percentage) -98.38% 10.480 0.170 - -51.43% -
473.astar (max) -98.30% 822.000 14.000 - -48.15% -
470.lbm (unexplained diff vs previous) -97.64% 804.000 19.000 - 0.00% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
470.lbm (max) -97.10% 758.000 22.000 - -4.35% -
482.sphinx3 -96.98% 464.000 14.000 - -6.67% -
482.sphinx3 (avg) -96.98% 464.000 14.000 - -6.67% -
458.sjeng (max) -96.58% 876.000 30.000 - -23.08% -
445.gobmk (max) (percentage) -96.51% 3.730 0.130 - 0.00% -
450.soplex (max) -95.98% 249.000 10.000 - 0.00% -
483.xalancbmk (max) -95.86% 1209.000 50.000 - -5.66% -
471.omnetpp (max) -95.27% 972.000 46.000 - -25.81% -
473.astar (max) (percentage) -95.22% 6.700 0.320 - -46.67% -
444.namd -94.97% 318.000 16.000 - -5.88% -
444.namd (avg) -94.97% 318.000 16.000 - -5.88% -
450.soplex -94.67% 75.000 4.000 - 0.00% -
450.soplex (avg) -94.67% 75.000 4.000 - 0.00% -
401.bzip2 (max) -94.25% 609.000 35.000 - -12.50% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
458.sjeng (max) (percentage) -92.80% 5.140 0.370 - -21.28% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.08% 6.060 0.480 - 0.00% -
444.namd (max) (percentage) -91.84% 8.090 0.660 - -25.84% -
470.lbm (max) (percentage) -90.03% 5.720 0.570 - -5.00% -
450.soplex (unexplained diff vs previous) -89.86% 69.000 7.000 - 0.00% -
447.dealII (max) -88.79% 223.000 25.000 - 316.67% -
483.xalancbmk (max) (percentage) -88.37% 12.900 1.500 - -5.06% -
429.mcf -87.84% 296.000 36.000 - -5.26% -
429.mcf (avg) -87.84% 296.000 36.000 - -5.26% -
429.mcf (max) (percentage) -87.61% 16.310 2.020 - -6.48% -
456.hmmer (unexplained diff vs previous) -86.96% 46.000 6.000 - -25.00% -
433.milc (max) -86.11% 108.000 15.000 - -16.67% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 - 0.00% -
471.omnetpp (max) (percentage) -82.22% 9.280 1.650 - -25.00% -
429.mcf (unexplained diff vs previous) -81.82% 22.000 4.000 - 0.00% -
470.lbm -80.73% 441.000 85.000 - -4.49% -
470.lbm (avg) -80.73% 441.000 85.000 - -4.49% -
447.dealII -79.59% 98.000 20.000 - 0.00% -
447.dealII (avg) -79.59% 98.000 20.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -78.64% 103.000 22.000 - -63.93% -
401.bzip2 -77.88% 104.000 23.000 - -4.17% -
401.bzip2 (avg) -77.88% 104.000 23.000 - -4.17% -
482.sphinx3 (unexplained diff vs previous) (percentage) -73.76% 3.430 0.900 - 0.00% -
482.sphinx3 (max) (percentage) -73.11% 3.310 0.890 - 74.51% -
401.bzip2 (max) (percentage) -67.46% 3.780 1.230 - -12.14% -
453.povray (max) -64.00% 25.000 9.000 - 0.00% -
462.libquantum (max) (percentage) -61.13% 6.380 2.480 - -9.82% -
456.hmmer (unexplained diff vs previous) (percentage) -58.97% 0.390 0.160 - -23.81% -
464.h264ref (max) -58.33% 60.000 25.000 - 150.00% -
445.gobmk -56.76% 74.000 32.000 - 0.00% -
445.gobmk (avg) -56.76% 74.000 32.000 - 0.00% -
447.dealII (unexplained diff vs previous) -53.70% 54.000 25.000 - 0.00% -
473.astar (unexplained diff vs previous) -52.00% 25.000 12.000 - -29.41% -
444.namd (unexplained diff vs previous) -50.00% 8.000 4.000 - 0.00% -
447.dealII (max) (percentage) -48.32% 2.380 1.230 - 284.37% -
458.sjeng -39.71% 136.000 82.000 - -5.75% -
458.sjeng (avg) -39.71% 136.000 82.000 - -5.75% -
471.omnetpp -35.33% 167.000 108.000 - -3.57% -
471.omnetpp (avg) -35.33% 167.000 108.000 - -3.57% -
470.lbm (avg) (percentage) -34.83% 3.330 2.170 - -3.56% -
473.astar -34.82% 112.000 73.000 - -3.95% -
473.astar (avg) -34.82% 112.000 73.000 - -3.95% -
456.hmmer -23.78% 164.000 125.000 - -3.85% -
456.hmmer (avg) -23.78% 164.000 125.000 - -3.85% -
483.xalancbmk -22.22% 198.000 154.000 - -5.52% -
483.xalancbmk (avg) -22.22% 198.000 154.000 - -5.52% -
471.omnetpp (unexplained diff vs previous) (percentage) -20.41% 0.980 0.780 - -63.72% -
444.namd (avg) (percentage) -20.23% 2.570 2.050 - -4.21% -
403.gcc (max) (percentage) -20.17% 2.330 1.860 - -0.53% -
433.milc (avg) (percentage) -15.12% 0.860 0.730 - 2.82% -
401.bzip2 (unexplained diff vs previous) (percentage) -15.00% 0.200 0.170 - 0.00% -
482.sphinx3 (avg) (percentage) -14.37% 1.740 1.490 - -1.97% -
447.dealII (avg) (percentage) -2.86% 1.050 1.020 - 0.99% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2863.000 -
403.gcc 55.000 -5.17%
429.mcf 1152.000 -
433.milc 1168.000 1.21%
444.namd 804.000 -
445.gobmk 4893.000 -
447.dealII 2052.000 1.23%
450.soplex 549.000 1.29%
453.povray 505.000 1.41%
456.hmmer 3820.000 -
458.sjeng 8296.000 -
462.libquantum 186.000 -
464.h264ref 6010.000 -
470.lbm 3959.000 -
471.omnetpp 2809.000 -
473.astar 4555.000 -
482.sphinx3 1001.000 -
483.xalancbmk 3375.000 -
Geometric Mean 1556.484 -
Code Size (bytes)
Name Current %
401.bzip2 33881.000 -
403.gcc 1665823.000 -
429.mcf 6995.000 -
433.milc 46333.000 -
444.namd 124390.000 -
445.gobmk 1258873.000 -
447.dealII 197102.000 -
450.soplex 149952.000 -
453.povray 514779.000 -
456.hmmer 80417.000 -
458.sjeng 79922.000 -
462.libquantum 12306.000 -
464.h264ref 301655.000 -
470.lbm 9280.000 -
471.omnetpp 321389.000 -
473.astar 15415.000 -
482.sphinx3 87672.000 -
483.xalancbmk 1612032.000 -
Geometric Mean 111197.259 -
sample variability
Name Current %
401.bzip2 23.000 -4.17%
401.bzip2 (avg) 23.000 -4.17%
401.bzip2 (avg) (percentage) 0.820 -3.53%
401.bzip2 (max) 35.000 -12.50%
401.bzip2 (max) (percentage) 1.230 -12.14%
401.bzip2 (unexplained diff vs previous) 5.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.170 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.750 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 1.860 -
429.mcf 36.000 -5.26%
429.mcf (avg) 36.000 -5.26%
429.mcf (avg) (percentage) 3.170 -3.65%
429.mcf (max) 23.000 -4.17%
429.mcf (max) (percentage) 2.020 -6.48%
429.mcf (unexplained diff vs previous) 4.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.350 -
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.730 2.82%
433.milc (max) 15.000 -16.67%
433.milc (max) (percentage) 1.300 -17.20%
433.milc (unexplained diff vs previous) 14.000 -
433.milc (unexplained diff vs previous) (percentage) 1.200 -
444.namd 16.000 -5.88%
444.namd (avg) 16.000 -5.88%
444.namd (avg) (percentage) 2.050 -4.21%
444.namd (max) 5.000 -28.57%
444.namd (max) (percentage) 0.660 -25.84%
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.500 -
445.gobmk 32.000 -
445.gobmk (avg) 32.000 -
445.gobmk (avg) (percentage) 0.670 -
445.gobmk (max) 6.000 -
445.gobmk (max) (percentage) 0.130 -
447.dealII 20.000 -
447.dealII (avg) 20.000 -
447.dealII (avg) (percentage) 1.020 -
447.dealII (max) 25.000 316.67%
447.dealII (max) (percentage) 1.230 284.37%
447.dealII (unexplained diff vs previous) 25.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.220 -
450.soplex 4.000 -
450.soplex (avg) 4.000 -
450.soplex (avg) (percentage) 0.790 2.60%
450.soplex (max) 10.000 -
450.soplex (max) (percentage) 1.850 -3.65%
450.soplex (unexplained diff vs previous) 7.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.280 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.930 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.810 -2.69%
456.hmmer 125.000 -3.85%
456.hmmer (avg) 125.000 -3.85%
456.hmmer (avg) (percentage) 3.290 -3.52%
456.hmmer (max) 6.000 -53.85%
456.hmmer (max) (percentage) 0.170 -51.43%
456.hmmer (unexplained diff vs previous) 6.000 -25.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.160 -23.81%
458.sjeng 82.000 -5.75%
458.sjeng (avg) 82.000 -5.75%
458.sjeng (avg) (percentage) 1.000 -4.76%
458.sjeng (max) 30.000 -23.08%
458.sjeng (max) (percentage) 0.370 -21.28%
458.sjeng (unexplained diff vs previous) 18.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.220 -
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.890 -3.57%
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 2.480 -9.82%
462.libquantum (unexplained diff vs previous) 1.000 -80.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.540 -79.78%
464.h264ref 48.000 -2.04%
464.h264ref (avg) 48.000 -2.04%
464.h264ref (avg) (percentage) 0.800 -2.44%
464.h264ref (max) 25.000 150.00%
464.h264ref (max) (percentage) 0.430 152.94%
464.h264ref (unexplained diff vs previous) 26.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.430 -
470.lbm 85.000 -4.49%
470.lbm (avg) 85.000 -4.49%
470.lbm (avg) (percentage) 2.170 -3.56%
470.lbm (max) 22.000 -4.35%
470.lbm (max) (percentage) 0.570 -5.00%
470.lbm (unexplained diff vs previous) 19.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.480 -
471.omnetpp 108.000 -3.57%
471.omnetpp (avg) 108.000 -3.57%
471.omnetpp (avg) (percentage) 3.850 -2.78%
471.omnetpp (max) 46.000 -25.81%
471.omnetpp (max) (percentage) 1.650 -25.00%
471.omnetpp (unexplained diff vs previous) 22.000 -63.93%
471.omnetpp (unexplained diff vs previous) (percentage) 0.780 -63.72%
473.astar 73.000 -3.95%
473.astar (avg) 73.000 -3.95%
473.astar (avg) (percentage) 1.610 -4.17%
473.astar (max) 14.000 -48.15%
473.astar (max) (percentage) 0.320 -46.67%
473.astar (unexplained diff vs previous) 12.000 -29.41%
473.astar (unexplained diff vs previous) (percentage) 0.260 -29.73%
482.sphinx3 14.000 -6.67%
482.sphinx3 (avg) 14.000 -6.67%
482.sphinx3 (avg) (percentage) 1.490 -1.97%
482.sphinx3 (max) 8.000 60.00%
482.sphinx3 (max) (percentage) 0.890 74.51%
482.sphinx3 (unexplained diff vs previous) 9.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.900 -
483.xalancbmk 154.000 -5.52%
483.xalancbmk (avg) 154.000 -5.52%
483.xalancbmk (avg) (percentage) 4.580 -4.58%
483.xalancbmk (max) 50.000 -5.66%
483.xalancbmk (max) (percentage) 1.500 -5.06%
483.xalancbmk (unexplained diff vs previous) 28.000 -31.71%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.830 -30.83%
Geometric Mean 4.027 -33.89%