Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/466d554dcab39c3d42fe0c5b588b795e0e4b9d0d (+ 179 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/18/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0018 (llvmorg-17-init-06725-g466d554dcab3) 2023-03-30T02:34:10 0:00:00
Previous 0017 (llvmorg-17-init-06546-ge8bc77ec085c) 2023-03-27T21:42:50 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 42
Performance Improvements 82 75
Added Tests 11 23
Unchanged Tests 729 688
Total Tests 828

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.70% 528.000 537.000 - -96.16% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) 14.29% 21.000 24.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 13.64% 0.660 0.750 - 0.00% -
471.omnetpp 5.88% 17.000 18.000 - -74.65% -
471.omnetpp (avg) 5.88% 17.000 18.000 - -74.65% -
471.omnetpp (avg) (percentage) 1.69% 0.590 0.600 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.33% 75.000 71.000 - -99.30% -
483.xalancbmk -1.19% 5115.000 5054.000 - -47.53% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -99.62% 13.050 0.050 - 0.00% -
429.mcf (unexplained diff vs previous) -99.59% 242.000 1.000 - 0.00% -
401.bzip2 (max) -97.52% 161.000 4.000 - -33.33% -
473.astar (unexplained diff vs previous) -97.39% 115.000 3.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -97.36% 2.270 0.060 - 0.00% -
401.bzip2 (max) (percentage) -97.17% 6.370 0.180 - 260.00% -
458.sjeng (unexplained diff vs previous) (percentage) -93.33% 0.600 0.040 - 0.00% -
458.sjeng (unexplained diff vs previous) -93.18% 44.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -92.23% 2.060 0.160 - 700.00% -
433.milc (unexplained diff vs previous) -92.00% 25.000 2.000 - -33.33% -
482.sphinx3 (max) -87.04% 162.000 21.000 - -87.20% -
482.sphinx3 (max) (percentage) -86.81% 19.870 2.620 - 279.71% -
482.sphinx3 (unexplained diff vs previous) -77.27% 22.000 5.000 - -96.91% -
482.sphinx3 (unexplained diff vs previous) (percentage) -77.04% 2.700 0.620 - -8.82% -
444.namd (max) -76.92% 13.000 3.000 - -99.38% -
444.namd (max) (percentage) -75.00% 1.960 0.490 - -90.54% -
462.libquantum (unexplained diff vs previous) (percentage) -66.97% 2.210 0.730 - 0.00% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
433.milc (max) -51.16% 43.000 21.000 - -92.19% -
433.milc (max) (percentage) -50.84% 3.580 1.760 - -4.86% -
401.bzip2 (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -50.00% 0.160 0.080 - 0.00% -
462.libquantum -50.00% 2.000 1.000 - -90.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - -90.00% -
447.dealII (max) -45.16% 31.000 17.000 - -86.51% -
447.dealII (max) (percentage) -43.71% 1.670 0.940 - -32.37% -
458.sjeng (max) -42.86% 63.000 36.000 - 2.86% -
458.sjeng (max) (percentage) -41.86% 0.860 0.500 - 117.39% -
473.astar (max) -41.01% 178.000 105.000 - 950.00% -
473.astar (max) (percentage) -40.63% 3.520 2.090 - 2512.50% -
456.hmmer (max) -36.36% 22.000 14.000 - -79.41% -
456.hmmer (max) (percentage) -36.25% 0.800 0.510 - -32.00% -
462.libquantum (max) -33.33% 3.000 2.000 - -33.33% -
456.hmmer (unexplained diff vs previous) -23.53% 17.000 13.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -22.95% 0.610 0.470 - 0.00% -
444.namd -12.50% 8.000 7.000 - -96.71% -
444.namd (avg) -12.50% 8.000 7.000 - -96.71% -
462.libquantum (max) (percentage) -12.39% 2.260 1.980 - 4850.00% -
447.dealII -11.11% 18.000 16.000 - -80.49% -
447.dealII (avg) -11.11% 18.000 16.000 - -80.49% -
401.bzip2 (avg) (percentage) -8.67% 1.960 1.790 - 1690.00% -
429.mcf (max) (percentage) -8.33% 15.000 13.750 - 3719.44% -
429.mcf (max) -8.27% 278.000 255.000 - 275.00% -
447.dealII (avg) (percentage) -8.25% 0.970 0.890 - -2.20% -
401.bzip2 -8.16% 49.000 45.000 - 246.15% -
401.bzip2 (avg) -8.16% 49.000 45.000 - 246.15% -
458.sjeng -8.11% 37.000 34.000 - -2.86% -
458.sjeng (avg) -8.11% 37.000 34.000 - -2.86% -
458.sjeng (avg) (percentage) -7.84% 0.510 0.470 - 104.35% -
433.milc -7.69% 13.000 12.000 - -90.08% -
433.milc (avg) -7.69% 13.000 12.000 - -90.08% -
482.sphinx3 (avg) (percentage) -7.67% 3.650 3.370 - 270.33% -
429.mcf (avg) (percentage) -6.96% 5.170 4.810 - 1200.00% -
482.sphinx3 -6.90% 29.000 27.000 - -87.50% -
482.sphinx3 (avg) -6.90% 29.000 27.000 - -87.50% -
444.namd (avg) (percentage) -6.45% 1.240 1.160 - -49.12% -
429.mcf -6.32% 95.000 89.000 - 28.99% -
429.mcf (avg) -6.32% 95.000 89.000 - 28.99% -
433.milc (avg) (percentage) -6.14% 1.140 1.070 - 28.92% -
473.astar (avg) (percentage) -6.13% 1.630 1.530 - 2085.71% -
470.lbm (avg) (percentage) -6.13% 4.240 3.980 - 586.21% -
473.astar -6.10% 82.000 77.000 - 755.56% -
473.astar (avg) -6.10% 82.000 77.000 - 755.56% -
470.lbm -5.97% 134.000 126.000 - 96.88% -
470.lbm (avg) -5.97% 134.000 126.000 - 96.88% -
450.soplex (max) -5.26% 19.000 18.000 - -88.24% -
450.soplex (max) (percentage) -4.68% 3.630 3.460 - 214.55% -
450.soplex (avg) (percentage) -4.67% 4.500 4.290 - 694.44% -
456.hmmer -4.55% 22.000 21.000 - -73.75% -
456.hmmer (avg) -4.55% 22.000 21.000 - -73.75% -
462.libquantum (avg) (percentage) -3.36% 1.490 1.440 - 1209.09% -
403.gcc (max) (percentage) -2.94% 0.340 0.330 - -17.50% -
464.h264ref (max) (percentage) -2.94% 1.020 0.990 - 266.67% -
445.gobmk (max) -2.75% 109.000 106.000 - 51.43% -
471.omnetpp (max) -2.70% 37.000 36.000 - -69.75% -
456.hmmer (avg) (percentage) -2.53% 0.790 0.770 - -12.50% -
445.gobmk (max) (percentage) -2.48% 2.020 1.970 - 228.33% -
471.omnetpp (max) (percentage) -2.42% 1.240 1.210 - 21.00% -
464.h264ref (max) -2.27% 44.000 43.000 - 34.38% -
453.povray (max) (percentage) -1.41% 1.420 1.400 - 32.08% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.25% 224407.000 231694.000 - 0.00% -
447.dealII 1.44% 325219.000 329903.000 - 0.00% -
471.omnetpp 1.24% 490147.000 496249.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (max) (percentage) 12666.67% 0.060 7.660 - 0.00% -
462.libquantum (max) (percentage) 4850.00% 0.040 1.980 - -12.39% -
470.lbm (max) 3966.67% 6.000 244.000 - 0.83% -
429.mcf (max) (percentage) 3719.44% 0.360 13.750 - -8.33% -
473.astar (max) (percentage) 2512.50% 0.080 2.090 - -40.63% -
473.astar (avg) (percentage) 2085.71% 0.070 1.530 - -6.13% -
401.bzip2 (avg) (percentage) 1690.00% 0.100 1.790 - -8.67% -
462.libquantum (avg) (percentage) 1209.09% 0.110 1.440 - -3.36% -
429.mcf (avg) (percentage) 1200.00% 0.370 4.810 - -6.96% -
473.astar (max) 950.00% 10.000 105.000 - -41.01% -
473.astar 755.56% 9.000 77.000 - -6.10% -
473.astar (avg) 755.56% 9.000 77.000 - -6.10% -
433.milc (unexplained diff vs previous) (percentage) 700.00% 0.020 0.160 - -92.23% -
450.soplex (avg) (percentage) 694.44% 0.540 4.290 - -4.67% -
470.lbm (avg) (percentage) 586.21% 0.580 3.980 - -6.13% -
482.sphinx3 (max) (percentage) 279.71% 0.690 2.620 - -86.81% -
429.mcf (max) 275.00% 68.000 255.000 - -8.27% -
482.sphinx3 (avg) (percentage) 270.33% 0.910 3.370 - -7.67% -
464.h264ref (max) (percentage) 266.67% 0.270 0.990 - -2.94% -
401.bzip2 (max) (percentage) 260.00% 0.050 0.180 - -97.17% -
401.bzip2 246.15% 13.000 45.000 - -8.16% -
401.bzip2 (avg) 246.15% 13.000 45.000 - -8.16% -
445.gobmk (max) (percentage) 228.33% 0.600 1.970 - -2.48% -
450.soplex (max) (percentage) 214.55% 1.100 3.460 - -4.68% -
458.sjeng (max) (percentage) 117.39% 0.230 0.500 - -41.86% -
458.sjeng (avg) (percentage) 104.35% 0.230 0.470 - -7.84% -
470.lbm 96.88% 64.000 126.000 - -5.97% -
470.lbm (avg) 96.88% 64.000 126.000 - -5.97% -
445.gobmk (avg) (percentage) 78.12% 0.320 0.570 - 0.00% -
445.gobmk (max) 51.43% 70.000 106.000 - -2.75% -
464.h264ref (max) 34.38% 32.000 43.000 - -2.27% -
453.povray (max) (percentage) 32.08% 1.060 1.400 - -1.41% -
429.mcf 28.99% 69.000 89.000 - -6.32% -
429.mcf (avg) 28.99% 69.000 89.000 - -6.32% -
433.milc (avg) (percentage) 28.92% 0.830 1.070 - -6.14% -
471.omnetpp (max) (percentage) 21.00% 1.000 1.210 - -2.42% -
453.povray (avg) (percentage) 20.55% 0.730 0.880 - 0.00% -
464.h264ref (avg) (percentage) 18.92% 0.370 0.440 - 0.00% -
458.sjeng (max) 2.86% 35.000 36.000 - -42.86% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.30% 10150.000 71.000 - -5.33% -
462.libquantum -98.58% 9659.000 137.000 - 0.74% -
482.sphinx3 -96.59% 23779.000 811.000 - -0.61% -
450.soplex -96.16% 13988.000 537.000 - 1.70% -
453.povray -92.73% 7301.000 531.000 - 0.57% -
444.namd -92.68% 9377.000 686.000 - -0.15% -
433.milc -91.69% 14590.000 1213.000 - 0.17% -
429.mcf -90.18% 18905.000 1856.000 - 0.05% -
400.perlbench -83.16% 11085.000 1867.000 - 0.86% -
401.bzip2 -81.85% 13962.000 2534.000 - -0.08% -
447.dealII -79.22% 9102.000 1891.000 - 0.27% -
471.omnetpp -74.74% 11917.000 3010.000 - -0.69% -
470.lbm -71.14% 11046.000 3188.000 - 0.76% -
456.hmmer -69.55% 9122.000 2778.000 - -0.47% -
464.h264ref -63.92% 12142.000 4381.000 - 0.23% -
473.astar -61.88% 13301.000 5071.000 - -0.06% -
445.gobmk -53.82% 11668.000 5388.000 - -0.35% -
458.sjeng -51.79% 15282.000 7368.000 - 0.04% -
483.xalancbmk -47.53% 9633.000 5054.000 - -1.19% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.38% 485.000 3.000 - -76.92% -
482.sphinx3 (unexplained diff vs previous) -96.91% 162.000 5.000 - -77.27% -
444.namd -96.71% 213.000 7.000 - -12.50% -
444.namd (avg) -96.71% 213.000 7.000 - -12.50% -
453.povray -92.45% 53.000 4.000 - 0.00% -
453.povray (avg) -92.45% 53.000 4.000 - 0.00% -
433.milc (max) -92.19% 269.000 21.000 - -51.16% -
453.povray (max) -90.91% 77.000 7.000 - 0.00% -
444.namd (max) (percentage) -90.54% 5.180 0.490 - -75.00% -
433.milc -90.08% 121.000 12.000 - -7.69% -
433.milc (avg) -90.08% 121.000 12.000 - -7.69% -
462.libquantum -90.00% 10.000 1.000 - -50.00% -
462.libquantum (avg) -90.00% 10.000 1.000 - -50.00% -
400.perlbench (max) -88.31% 77.000 9.000 - 0.00% -
450.soplex (max) -88.24% 153.000 18.000 - -5.26% -
482.sphinx3 -87.50% 216.000 27.000 - -6.90% -
482.sphinx3 (avg) -87.50% 216.000 27.000 - -6.90% -
482.sphinx3 (max) -87.20% 164.000 21.000 - -87.04% -
447.dealII (max) -86.51% 126.000 17.000 - -45.16% -
400.perlbench -83.93% 56.000 9.000 - 0.00% -
400.perlbench (avg) -83.93% 56.000 9.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -82.50% 120.000 21.000 - 0.00% -
447.dealII -80.49% 82.000 16.000 - -11.11% -
447.dealII (avg) -80.49% 82.000 16.000 - -11.11% -
456.hmmer (max) -79.41% 68.000 14.000 - -36.36% -
471.omnetpp -74.65% 71.000 18.000 - 5.88% -
471.omnetpp (avg) -74.65% 71.000 18.000 - 5.88% -
456.hmmer -73.75% 80.000 21.000 - -4.55% -
456.hmmer (avg) -73.75% 80.000 21.000 - -4.55% -
471.omnetpp (max) -69.75% 119.000 36.000 - -2.70% -
450.soplex -69.33% 75.000 23.000 - 0.00% -
450.soplex (avg) -69.33% 75.000 23.000 - 0.00% -
483.xalancbmk (max) -59.18% 49.000 20.000 - 0.00% -
464.h264ref -56.82% 44.000 19.000 - 0.00% -
464.h264ref (avg) -56.82% 44.000 19.000 - 0.00% -
444.namd (avg) (percentage) -49.12% 2.280 1.160 - -6.45% -
483.xalancbmk -48.78% 41.000 21.000 - 0.00% -
483.xalancbmk (avg) -48.78% 41.000 21.000 - 0.00% -
401.bzip2 (max) -33.33% 6.000 4.000 - -97.52% -
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 - -92.00% -
462.libquantum (max) -33.33% 3.000 2.000 - -33.33% -
447.dealII (max) (percentage) -32.37% 1.390 0.940 - -43.71% -
456.hmmer (max) (percentage) -32.00% 0.750 0.510 - -36.25% -
471.omnetpp (unexplained diff vs previous) (percentage) -30.69% 1.010 0.700 - 0.00% -
400.perlbench (max) (percentage) -24.29% 0.700 0.530 - 0.00% -
483.xalancbmk (max) (percentage) -21.57% 0.510 0.400 - 0.00% -
445.gobmk -18.92% 37.000 30.000 - 0.00% -
445.gobmk (avg) -18.92% 37.000 30.000 - 0.00% -
403.gcc (max) (percentage) -17.50% 0.400 0.330 - -2.94% -
456.hmmer (avg) (percentage) -12.50% 0.880 0.770 - -2.53% -
482.sphinx3 (unexplained diff vs previous) (percentage) -8.82% 0.680 0.620 - -77.04% -
433.milc (max) (percentage) -4.86% 1.850 1.760 - -50.84% -
458.sjeng -2.86% 35.000 34.000 - -8.11% -
458.sjeng (avg) -2.86% 35.000 34.000 - -8.11% -
447.dealII (avg) (percentage) -2.20% 0.910 0.890 - -8.25% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 52.63% 19.000 29.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1867.000 -
401.bzip2 2534.000 -
403.gcc 71.000 -5.33%
429.mcf 1856.000 -
433.milc 1213.000 -
444.namd 686.000 -
445.gobmk 5388.000 -
447.dealII 1891.000 -
450.soplex 537.000 1.70%
453.povray 531.000 -
456.hmmer 2778.000 -
458.sjeng 7368.000 -
462.libquantum 137.000 -
464.h264ref 4381.000 -
470.lbm 3188.000 -
471.omnetpp 3010.000 -
473.astar 5071.000 -
482.sphinx3 811.000 -
483.xalancbmk 5054.000 -1.19%
Geometric Mean 1540.836 -
Name Current %
400.perlbench 899110.000 -
401.bzip2 43928.000 -
403.gcc 2484716.000 -
429.mcf 9248.000 -
433.milc 62842.000 -
444.namd 143376.000 -
445.gobmk 1852158.000 -
447.dealII 329903.000 -
450.soplex 231694.000 -
453.povray 691761.000 -
456.hmmer 113556.000 -
458.sjeng 106791.000 -
462.libquantum 16876.000 -
464.h264ref 400017.000 -
470.lbm 10320.000 -
471.omnetpp 496249.000 -
473.astar 23784.000 -
482.sphinx3 120117.000 -
483.xalancbmk 2533814.000 -
Geometric Mean 170147.309 -
Name Current %
400.perlbench 9.000 -
400.perlbench (avg) 9.000 -
400.perlbench (avg) (percentage) 0.510 -
400.perlbench (max) 9.000 -
400.perlbench (max) (percentage) 0.530 -
401.bzip2 45.000 -8.16%
401.bzip2 (avg) 45.000 -8.16%
401.bzip2 (avg) (percentage) 1.790 -8.67%
401.bzip2 (max) 4.000 -97.52%
401.bzip2 (max) (percentage) 0.180 -97.17%
401.bzip2 (unexplained diff vs previous) 2.000 -50.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.080 -50.00%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.310 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.330 -2.94%
429.mcf 89.000 -6.32%
429.mcf (avg) 89.000 -6.32%
429.mcf (avg) (percentage) 4.810 -6.96%
429.mcf (max) 255.000 -8.27%
429.mcf (max) (percentage) 13.750 -8.33%
429.mcf (unexplained diff vs previous) 1.000 -99.59%
429.mcf (unexplained diff vs previous) (percentage) 0.050 -99.62%
433.milc 12.000 -7.69%
433.milc (avg) 12.000 -7.69%
433.milc (avg) (percentage) 1.070 -6.14%
433.milc (max) 21.000 -51.16%
433.milc (max) (percentage) 1.760 -50.84%
433.milc (unexplained diff vs previous) 2.000 -92.00%
433.milc (unexplained diff vs previous) (percentage) 0.160 -92.23%
444.namd 7.000 -12.50%
444.namd (avg) 7.000 -12.50%
444.namd (avg) (percentage) 1.160 -6.45%
444.namd (max) 3.000 -76.92%
444.namd (max) (percentage) 0.490 -75.00%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.150 -
445.gobmk 30.000 -
445.gobmk (avg) 30.000 -
445.gobmk (avg) (percentage) 0.570 -
445.gobmk (max) 106.000 -2.75%
445.gobmk (max) (percentage) 1.970 -2.48%
447.dealII 16.000 -11.11%
447.dealII (avg) 16.000 -11.11%
447.dealII (avg) (percentage) 0.890 -8.25%
447.dealII (max) 17.000 -45.16%
447.dealII (max) (percentage) 0.940 -43.71%
447.dealII (unexplained diff vs previous) 5.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.260 -
450.soplex 23.000 -
450.soplex (avg) 23.000 -
450.soplex (avg) (percentage) 4.290 -4.67%
450.soplex (max) 18.000 -5.26%
450.soplex (max) (percentage) 3.460 -4.68%
450.soplex (unexplained diff vs previous) 9.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.680 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.880 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.400 -1.41%
456.hmmer 21.000 -4.55%
456.hmmer (avg) 21.000 -4.55%
456.hmmer (avg) (percentage) 0.770 -2.53%
456.hmmer (max) 14.000 -36.36%
456.hmmer (max) (percentage) 0.510 -36.25%
456.hmmer (unexplained diff vs previous) 13.000 -23.53%
456.hmmer (unexplained diff vs previous) (percentage) 0.470 -22.95%
458.sjeng 34.000 -8.11%
458.sjeng (avg) 34.000 -8.11%
458.sjeng (avg) (percentage) 0.470 -7.84%
458.sjeng (max) 36.000 -42.86%
458.sjeng (max) (percentage) 0.500 -41.86%
458.sjeng (unexplained diff vs previous) 3.000 -93.18%
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -93.33%
462.libquantum 1.000 -50.00%
462.libquantum (avg) 1.000 -50.00%
462.libquantum (avg) (percentage) 1.440 -3.36%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 1.980 -12.39%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 0.730 -66.97%
464.h264ref 19.000 -
464.h264ref (avg) 19.000 -
464.h264ref (avg) (percentage) 0.440 -
464.h264ref (max) 43.000 -2.27%
464.h264ref (max) (percentage) 0.990 -2.94%
470.lbm 126.000 -5.97%
470.lbm (avg) 126.000 -5.97%
470.lbm (avg) (percentage) 3.980 -6.13%
470.lbm (max) 244.000 -
470.lbm (max) (percentage) 7.660 -
470.lbm (unexplained diff vs previous) 24.000 14.29%
470.lbm (unexplained diff vs previous) (percentage) 0.750 13.64%
471.omnetpp 18.000 5.88%
471.omnetpp (avg) 18.000 5.88%
471.omnetpp (avg) (percentage) 0.600 1.69%
471.omnetpp (max) 36.000 -2.70%
471.omnetpp (max) (percentage) 1.210 -2.42%
471.omnetpp (unexplained diff vs previous) 21.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.700 -
473.astar 77.000 -6.10%
473.astar (avg) 77.000 -6.10%
473.astar (avg) (percentage) 1.530 -6.13%
473.astar (max) 105.000 -41.01%
473.astar (max) (percentage) 2.090 -40.63%
473.astar (unexplained diff vs previous) 3.000 -97.39%
473.astar (unexplained diff vs previous) (percentage) 0.060 -97.36%
482.sphinx3 27.000 -6.90%
482.sphinx3 (avg) 27.000 -6.90%
482.sphinx3 (avg) (percentage) 3.370 -7.67%
482.sphinx3 (max) 21.000 -87.04%
482.sphinx3 (max) (percentage) 2.620 -86.81%
482.sphinx3 (unexplained diff vs previous) 5.000 -77.27%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.620 -77.04%
483.xalancbmk 21.000 -
483.xalancbmk (avg) 21.000 -
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) 20.000 -
483.xalancbmk (max) (percentage) 0.400 -
Geometric Mean 3.178 -58.48%