Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fb9a82b0235713782c1cf9d1eba20ce8d95766f7 (+ 820 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/108/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0108 (llvmorg-19-init-00036-gfb9a82b02357) 2024-01-19T10:08:22 0:00:00
Previous 0106 (llvmorg-18-init-17576-g9096bcc7c894) 2024-01-14T09:31:40 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 23 17
Performance Improvements 64 123
Added Tests 4 8
Unchanged Tests 689 632
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.27% 55.000 59.000 - -99.38% -
453.povray 1.20% 502.000 508.000 - -92.73% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) 700.00% 1.000 8.000 - -38.46% -
470.lbm (unexplained diff vs previous) 700.00% 2.000 16.000 - -98.01% -
470.lbm (unexplained diff vs previous) (percentage) 700.00% 0.050 0.400 - -93.40% -
433.milc (unexplained diff vs previous) (percentage) 666.67% 0.090 0.690 - 590.00% -
429.mcf (unexplained diff vs previous) 300.00% 1.000 4.000 - -81.82% -
429.mcf (unexplained diff vs previous) (percentage) 288.89% 0.090 0.350 - 118.75% -
458.sjeng (unexplained diff vs previous) 275.00% 8.000 30.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 260.00% 0.100 0.360 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 157.14% 0.070 0.180 - -10.00% -
401.bzip2 (unexplained diff vs previous) 150.00% 2.000 5.000 - -84.85% -
458.sjeng (max) (percentage) 56.52% 0.230 0.360 - -93.00% -
458.sjeng (max) 52.63% 19.000 29.000 - -96.69% -
470.lbm (max) 33.33% 12.000 16.000 - -97.89% -
470.lbm (max) (percentage) 25.00% 0.320 0.400 - -93.01% -
456.hmmer (unexplained diff vs previous) (percentage) 23.08% 0.260 0.320 - -17.95% -
456.hmmer (unexplained diff vs previous) 20.00% 10.000 12.000 - -73.91% -
483.xalancbmk (unexplained diff vs previous) (percentage) 12.50% 0.480 0.540 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 12.50% 16.000 18.000 - 0.00% -
483.xalancbmk (max) (percentage) 5.88% 0.510 0.540 - -95.81% -
483.xalancbmk (max) 5.88% 17.000 18.000 - -98.51% -
453.povray (avg) (percentage) 1.10% 0.910 0.920 - 15.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -83.28% 3.230 0.540 - 5300.00% -
471.omnetpp (max) -80.00% 20.000 4.000 - -99.59% -
471.omnetpp (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.03% -
471.omnetpp (max) (percentage) -78.87% 0.710 0.150 - -98.38% -
471.omnetpp (unexplained diff vs previous) (percentage) -77.78% 0.180 0.040 - -95.92% -
450.soplex (unexplained diff vs previous) -71.43% 7.000 2.000 - -97.10% -
450.soplex (unexplained diff vs previous) (percentage) -71.32% 1.290 0.370 - -19.57% -
447.dealII (unexplained diff vs previous) (percentage) -51.22% 0.410 0.200 - -65.52% -
447.dealII (unexplained diff vs previous) -50.00% 8.000 4.000 - -92.59% -
473.astar (unexplained diff vs previous) -44.44% 9.000 5.000 - -80.00% -
473.astar (unexplained diff vs previous) (percentage) -42.11% 0.190 0.110 - -45.00% -
462.libquantum (max) -33.33% 6.000 4.000 - -99.56% -
462.libquantum (max) (percentage) -24.92% 3.330 2.500 - -60.82% -
473.astar (max) -12.50% 8.000 7.000 - -99.15% -
444.namd (max) -11.11% 9.000 8.000 - -99.20% -
482.sphinx3 (max) -11.11% 9.000 8.000 - -99.09% -
473.astar (max) (percentage) -10.53% 0.190 0.170 - -97.46% -
433.milc (max) -10.00% 10.000 9.000 - -91.67% -
444.namd (max) (percentage) -8.55% 1.170 1.070 - -86.77% -
464.h264ref (max) (percentage) -7.69% 0.260 0.240 - -42.86% -
450.soplex (max) -7.69% 13.000 12.000 - -95.18% -
433.milc (max) (percentage) -7.61% 0.920 0.850 - 6.25% -
447.dealII -7.14% 14.000 13.000 - -86.73% -
447.dealII (avg) -7.14% 14.000 13.000 - -86.73% -
464.h264ref (max) -6.67% 15.000 14.000 - -76.67% -
453.povray (max) (percentage) -6.62% 1.360 1.270 - 252.78% -
401.bzip2 -5.88% 17.000 16.000 - -84.62% -
401.bzip2 (avg) -5.88% 17.000 16.000 - -84.62% -
401.bzip2 (max) -5.56% 18.000 17.000 - -97.21% -
450.soplex (max) (percentage) -4.84% 2.480 2.360 - 43.03% -
447.dealII (max) (percentage) -4.65% 0.430 0.410 - -82.77% -
401.bzip2 (max) (percentage) -4.55% 0.660 0.630 - -83.33% -
429.mcf -4.55% 22.000 21.000 - -92.91% -
429.mcf (avg) -4.55% 22.000 21.000 - -92.91% -
482.sphinx3 (max) (percentage) -4.26% 0.940 0.900 - -72.81% -
471.omnetpp -3.23% 62.000 60.000 - -64.07% -
471.omnetpp (avg) -3.23% 62.000 60.000 - -64.07% -
483.xalancbmk -2.99% 67.000 65.000 - -67.17% -
483.xalancbmk (avg) -2.99% 67.000 65.000 - -67.17% -
444.namd (avg) (percentage) -2.84% 1.410 1.370 - -46.69% -
429.mcf (max) (percentage) -2.78% 0.360 0.350 - -97.85% -
447.dealII (avg) (percentage) -2.78% 0.720 0.700 - -33.33% -
471.omnetpp (avg) (percentage) -2.71% 2.210 2.150 - 34.37% -
456.hmmer (max) (percentage) -2.63% 0.380 0.370 - -96.47% -
473.astar -2.63% 38.000 37.000 - -66.96% -
473.astar (avg) -2.63% 38.000 37.000 - -66.96% -
445.gobmk (avg) (percentage) -2.50% 0.400 0.390 - -41.79% -
464.h264ref (avg) (percentage) -2.50% 0.400 0.390 - 34.48% -
450.soplex (avg) (percentage) -2.48% 1.210 1.180 - 136.00% -
473.astar (avg) (percentage) -2.41% 0.830 0.810 - -11.96% -
462.libquantum (avg) (percentage) -2.38% 1.680 1.640 - 112.99% -
458.sjeng -2.33% 43.000 42.000 - -69.12% -
458.sjeng (avg) -2.33% 43.000 42.000 - -69.12% -
470.lbm -2.33% 43.000 42.000 - -90.48% -
470.lbm (avg) -2.33% 43.000 42.000 - -90.48% -
482.sphinx3 (avg) (percentage) -2.30% 0.870 0.850 - -51.15% -
429.mcf (avg) (percentage) -2.05% 1.950 1.910 - -9.91% -
483.xalancbmk (avg) (percentage) -1.99% 2.010 1.970 - -7.08% -
470.lbm (avg) (percentage) -1.83% 1.090 1.070 - -67.87% -
456.hmmer (avg) (percentage) -1.81% 1.660 1.630 - 17.27% -
401.bzip2 (avg) (percentage) -1.67% 0.600 0.590 - -9.23% -
456.hmmer -1.59% 63.000 62.000 - -62.20% -
456.hmmer (avg) -1.59% 63.000 62.000 - -62.20% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.95% 146765.000 149620.000 - 0.00% -
471.omnetpp 1.37% 316676.000 321017.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 5300.00% 0.010 0.540 - -83.28% -
433.milc (unexplained diff vs previous) (percentage) 590.00% 0.100 0.690 - 666.67% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - 0.00% -
453.povray (max) (percentage) 252.78% 0.360 1.270 - -6.62% -
403.gcc (avg) (percentage) 138.18% 0.550 1.310 - 0.00% -
450.soplex (avg) (percentage) 136.00% 0.500 1.180 - -2.48% -
429.mcf (unexplained diff vs previous) (percentage) 118.75% 0.160 0.350 - 288.89% -
462.libquantum (avg) (percentage) 112.99% 0.770 1.640 - -2.38% -
403.gcc (max) (percentage) 75.97% 2.330 4.100 - -0.73% -
450.soplex (max) (percentage) 43.03% 1.650 2.360 - -4.84% -
464.h264ref (avg) (percentage) 34.48% 0.290 0.390 - -2.50% -
471.omnetpp (avg) (percentage) 34.37% 1.600 2.150 - -2.71% -
456.hmmer (avg) (percentage) 17.27% 1.390 1.630 - -1.81% -
453.povray (avg) (percentage) 15.00% 0.800 0.920 - 1.10% -
433.milc (max) (percentage) 6.25% 0.800 0.850 - -7.61% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.15% 7239.000 7011.000 - 0.00% -
453.povray -2.01% 524493.000 513971.000 - 0.00% -
433.milc -1.98% 47001.000 46069.000 - 0.00% -
462.libquantum -1.70% 12504.000 12291.000 - 0.00% -
464.h264ref -1.13% 303767.000 300335.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -
444.namd -1.05% 124963.000 123646.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9509.000 59.000 - 7.27% -
462.libquantum -98.72% 14409.000 185.000 - -0.54% -
450.soplex -96.41% 15112.000 543.000 - 0.37% -
482.sphinx3 -96.27% 26682.000 994.000 - 0.10% -
444.namd -93.46% 12400.000 811.000 - 0.25% -
453.povray -92.73% 6987.000 508.000 - 1.20% -
429.mcf -91.82% 13988.000 1144.000 - -0.35% -
433.milc -91.43% 13601.000 1165.000 - 0.69% -
401.bzip2 -82.33% 16137.000 2851.000 - -0.18% -
447.dealII -78.97% 9380.000 1973.000 - 0.20% -
471.omnetpp -73.06% 10477.000 2823.000 - -0.04% -
470.lbm -69.80% 13259.000 4004.000 - 0.40% -
456.hmmer -67.89% 11854.000 3806.000 - -0.31% -
483.xalancbmk -64.32% 9376.000 3345.000 - -0.54% -
473.astar -61.85% 12272.000 4682.000 - 0.11% -
464.h264ref -59.04% 14498.000 5939.000 - 0.15% -
445.gobmk -55.95% 11093.000 4887.000 - 0.25% -
458.sjeng -51.60% 17055.000 8255.000 - -0.36% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 914.000 1.000 - 0.00% -
429.mcf (max) -99.82% 2281.000 4.000 - 0.00% -
471.omnetpp (max) -99.59% 972.000 4.000 - -80.00% -
462.libquantum (max) -99.56% 919.000 4.000 - -33.33% -
444.namd (max) -99.20% 1003.000 8.000 - -11.11% -
473.astar (max) -99.15% 822.000 7.000 - -12.50% -
403.gcc (max) -99.10% 221.000 2.000 - 0.00% -
482.sphinx3 (max) -99.09% 883.000 8.000 - -11.11% -
471.omnetpp (unexplained diff vs previous) -99.03% 103.000 1.000 - -80.00% -
456.hmmer (max) -98.87% 1242.000 14.000 - 0.00% -
483.xalancbmk (max) -98.51% 1209.000 18.000 - 5.88% -
471.omnetpp (max) (percentage) -98.38% 9.280 0.150 - -78.87% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.01% 804.000 16.000 - 700.00% -
470.lbm (max) -97.89% 758.000 16.000 - 33.33% -
429.mcf (max) (percentage) -97.85% 16.310 0.350 - -2.78% -
473.astar (max) (percentage) -97.46% 6.700 0.170 - -10.53% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
401.bzip2 (max) -97.21% 609.000 17.000 - -5.56% -
450.soplex (unexplained diff vs previous) -97.10% 69.000 2.000 - -71.43% -
445.gobmk (max) -97.09% 413.000 12.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.08% 3.430 0.100 - 0.00% -
458.sjeng (max) -96.69% 876.000 29.000 - 52.63% -
444.namd -96.54% 318.000 11.000 - 0.00% -
444.namd (avg) -96.54% 318.000 11.000 - 0.00% -
456.hmmer (max) (percentage) -96.47% 10.480 0.370 - -2.63% -
447.dealII (max) -96.41% 223.000 8.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -95.92% 0.980 0.040 - -77.78% -
483.xalancbmk (max) (percentage) -95.81% 12.900 0.540 - 5.88% -
450.soplex (max) -95.18% 249.000 12.000 - -7.69% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -93.40% 6.060 0.400 - 700.00% -
445.gobmk (max) (percentage) -93.30% 3.730 0.250 - 0.00% -
470.lbm (max) (percentage) -93.01% 5.720 0.400 - 25.00% -
458.sjeng (max) (percentage) -93.00% 5.140 0.360 - 56.52% -
429.mcf -92.91% 296.000 21.000 - -4.55% -
429.mcf (avg) -92.91% 296.000 21.000 - -4.55% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
447.dealII (unexplained diff vs previous) -92.59% 54.000 4.000 - -50.00% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
433.milc (max) -91.67% 108.000 9.000 - -10.00% -
470.lbm -90.48% 441.000 42.000 - -2.33% -
470.lbm (avg) -90.48% 441.000 42.000 - -2.33% -
444.namd (max) (percentage) -86.77% 8.090 1.070 - -8.55% -
447.dealII -86.73% 98.000 13.000 - -7.14% -
447.dealII (avg) -86.73% 98.000 13.000 - -7.14% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 - 150.00% -
401.bzip2 -84.62% 104.000 16.000 - -5.88% -
401.bzip2 (avg) -84.62% 104.000 16.000 - -5.88% -
401.bzip2 (max) (percentage) -83.33% 3.780 0.630 - -4.55% -
447.dealII (max) (percentage) -82.77% 2.380 0.410 - -4.65% -
429.mcf (unexplained diff vs previous) -81.82% 22.000 4.000 - 300.00% -
473.astar (unexplained diff vs previous) -80.00% 25.000 5.000 - -44.44% -
464.h264ref (max) -76.67% 60.000 14.000 - -6.67% -
453.povray (max) -76.00% 25.000 6.000 - 0.00% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
445.gobmk -74.32% 74.000 19.000 - 0.00% -
445.gobmk (avg) -74.32% 74.000 19.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -73.91% 46.000 12.000 - 20.00% -
482.sphinx3 (max) (percentage) -72.81% 3.310 0.900 - -4.26% -
445.gobmk (unexplained diff vs previous) -70.00% 40.000 12.000 - 0.00% -
458.sjeng -69.12% 136.000 42.000 - -2.33% -
458.sjeng (avg) -69.12% 136.000 42.000 - -2.33% -
470.lbm (avg) (percentage) -67.87% 3.330 1.070 - -1.83% -
483.xalancbmk -67.17% 198.000 65.000 - -2.99% -
483.xalancbmk (avg) -67.17% 198.000 65.000 - -2.99% -
473.astar -66.96% 112.000 37.000 - -2.63% -
473.astar (avg) -66.96% 112.000 37.000 - -2.63% -
447.dealII (unexplained diff vs previous) (percentage) -65.52% 0.580 0.200 - -51.22% -
471.omnetpp -64.07% 167.000 60.000 - -3.23% -
471.omnetpp (avg) -64.07% 167.000 60.000 - -3.23% -
456.hmmer -62.20% 164.000 62.000 - -1.59% -
456.hmmer (avg) -62.20% 164.000 62.000 - -1.59% -
462.libquantum (max) (percentage) -60.82% 6.380 2.500 - -24.92% -
482.sphinx3 (avg) (percentage) -51.15% 1.740 0.850 - -2.30% -
444.namd (avg) (percentage) -46.69% 2.570 1.370 - -2.84% -
464.h264ref -45.24% 42.000 23.000 - 0.00% -
464.h264ref (avg) -45.24% 42.000 23.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 - -42.11% -
464.h264ref (max) (percentage) -42.86% 0.420 0.240 - -7.69% -
445.gobmk (avg) (percentage) -41.79% 0.670 0.390 - -2.50% -
433.milc (unexplained diff vs previous) -38.46% 13.000 8.000 - 700.00% -
458.sjeng (avg) (percentage) -35.00% 0.800 0.520 - 0.00% -
447.dealII (avg) (percentage) -33.33% 1.050 0.700 - -2.78% -
445.gobmk (unexplained diff vs previous) (percentage) -30.56% 0.360 0.250 - 0.00% -
433.milc (avg) (percentage) -26.74% 0.860 0.630 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -19.57% 0.460 0.370 - -71.32% -
456.hmmer (unexplained diff vs previous) (percentage) -17.95% 0.390 0.320 - 23.08% -
473.astar (avg) (percentage) -11.96% 0.920 0.810 - -2.41% -
401.bzip2 (unexplained diff vs previous) (percentage) -10.00% 0.200 0.180 - 157.14% -
429.mcf (avg) (percentage) -9.91% 2.120 1.910 - -2.05% -
401.bzip2 (avg) (percentage) -9.23% 0.650 0.590 - -1.67% -
483.xalancbmk (avg) (percentage) -7.08% 2.120 1.970 - -1.99% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)


Report Time: 0.35s
Name Current %
401.bzip2 2851.000 -
403.gcc 59.000 7.27%
429.mcf 1144.000 -
433.milc 1165.000 -
444.namd 811.000 -
445.gobmk 4887.000 -
447.dealII 1973.000 -
450.soplex 543.000 -
453.povray 508.000 1.20%
456.hmmer 3806.000 -
458.sjeng 8255.000 -
462.libquantum 185.000 -
464.h264ref 5939.000 -
470.lbm 4004.000 -
471.omnetpp 2823.000 -
473.astar 4682.000 -
482.sphinx3 994.000 -
483.xalancbmk 3345.000 -
Geometric Mean 1558.345 -
Name Current %
401.bzip2 33717.000 -
403.gcc 1664207.000 -
429.mcf 7011.000 -
433.milc 46069.000 -
444.namd 123646.000 -
445.gobmk 1259121.000 -
447.dealII 196010.000 -
450.soplex 149620.000 -
453.povray 513971.000 -
456.hmmer 80441.000 -
458.sjeng 79874.000 -
462.libquantum 12291.000 -
464.h264ref 300335.000 -
470.lbm 9236.000 -
471.omnetpp 321017.000 -
473.astar 15607.000 -
482.sphinx3 87680.000 -
483.xalancbmk 1611492.000 -
Geometric Mean 111048.595 -
Name Current %
401.bzip2 16.000 -5.88%
401.bzip2 (avg) 16.000 -5.88%
401.bzip2 (avg) (percentage) 0.590 -1.67%
401.bzip2 (max) 17.000 -5.56%
401.bzip2 (max) (percentage) 0.630 -4.55%
401.bzip2 (unexplained diff vs previous) 5.000 150.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.180 157.14%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.310 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.100 -
429.mcf 21.000 -4.55%
429.mcf (avg) 21.000 -4.55%
429.mcf (avg) (percentage) 1.910 -2.05%
429.mcf (max) 4.000 -
429.mcf (max) (percentage) 0.350 -2.78%
429.mcf (unexplained diff vs previous) 4.000 300.00%
429.mcf (unexplained diff vs previous) (percentage) 0.350 288.89%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 -
433.milc (max) 9.000 -10.00%
433.milc (max) (percentage) 0.850 -7.61%
433.milc (unexplained diff vs previous) 8.000 700.00%
433.milc (unexplained diff vs previous) (percentage) 0.690 666.67%
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.370 -2.84%
444.namd (max) 8.000 -11.11%
444.namd (max) (percentage) 1.070 -8.55%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.250 -
445.gobmk 19.000 -
445.gobmk (avg) 19.000 -
445.gobmk (avg) (percentage) 0.390 -2.50%
445.gobmk (max) 12.000 -
445.gobmk (max) (percentage) 0.250 -
445.gobmk (unexplained diff vs previous) 12.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.250 -
447.dealII 13.000 -7.14%
447.dealII (avg) 13.000 -7.14%
447.dealII (avg) (percentage) 0.700 -2.78%
447.dealII (max) 8.000 -
447.dealII (max) (percentage) 0.410 -4.65%
447.dealII (unexplained diff vs previous) 4.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.200 -51.22%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.180 -2.48%
450.soplex (max) 12.000 -7.69%
450.soplex (max) (percentage) 2.360 -4.84%
450.soplex (unexplained diff vs previous) 2.000 -71.43%
450.soplex (unexplained diff vs previous) (percentage) 0.370 -71.32%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.920 1.10%
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.270 -6.62%
453.povray (unexplained diff vs previous) 6.000 -
453.povray (unexplained diff vs previous) (percentage) 1.180 -
456.hmmer 62.000 -1.59%
456.hmmer (avg) 62.000 -1.59%
456.hmmer (avg) (percentage) 1.630 -1.81%
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.370 -2.63%
456.hmmer (unexplained diff vs previous) 12.000 20.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.320 23.08%
458.sjeng 42.000 -2.33%
458.sjeng (avg) 42.000 -2.33%
458.sjeng (avg) (percentage) 0.520 -
458.sjeng (max) 29.000 52.63%
458.sjeng (max) (percentage) 0.360 56.52%
458.sjeng (unexplained diff vs previous) 30.000 275.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.360 260.00%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.640 -2.38%
462.libquantum (max) 4.000 -33.33%
462.libquantum (max) (percentage) 2.500 -24.92%
462.libquantum (unexplained diff vs previous) 1.000 -83.33%
462.libquantum (unexplained diff vs previous) (percentage) 0.540 -83.28%
464.h264ref 23.000 -
464.h264ref (avg) 23.000 -
464.h264ref (avg) (percentage) 0.390 -2.50%
464.h264ref (max) 14.000 -6.67%
464.h264ref (max) (percentage) 0.240 -7.69%
464.h264ref (unexplained diff vs previous) 9.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.150 -
470.lbm 42.000 -2.33%
470.lbm (avg) 42.000 -2.33%
470.lbm (avg) (percentage) 1.070 -1.83%
470.lbm (max) 16.000 33.33%
470.lbm (max) (percentage) 0.400 25.00%
470.lbm (unexplained diff vs previous) 16.000 700.00%
470.lbm (unexplained diff vs previous) (percentage) 0.400 700.00%
471.omnetpp 60.000 -3.23%
471.omnetpp (avg) 60.000 -3.23%
471.omnetpp (avg) (percentage) 2.150 -2.71%
471.omnetpp (max) 4.000 -80.00%
471.omnetpp (max) (percentage) 0.150 -78.87%
471.omnetpp (unexplained diff vs previous) 1.000 -80.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.040 -77.78%
473.astar 37.000 -2.63%
473.astar (avg) 37.000 -2.63%
473.astar (avg) (percentage) 0.810 -2.41%
473.astar (max) 7.000 -12.50%
473.astar (max) (percentage) 0.170 -10.53%
473.astar (unexplained diff vs previous) 5.000 -44.44%
473.astar (unexplained diff vs previous) (percentage) 0.110 -42.11%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.850 -2.30%
482.sphinx3 (max) 8.000 -11.11%
482.sphinx3 (max) (percentage) 0.900 -4.26%
482.sphinx3 (unexplained diff vs previous) 1.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -
483.xalancbmk 65.000 -2.99%
483.xalancbmk (avg) 65.000 -2.99%
483.xalancbmk (avg) (percentage) 1.970 -1.99%
483.xalancbmk (max) 18.000 5.88%
483.xalancbmk (max) (percentage) 0.540 5.88%
483.xalancbmk (unexplained diff vs previous) 18.000 12.50%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.540 12.50%
Geometric Mean 2.499 14.25%