Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c01ea0515f15064e4bcec601f9290854429b8666 (+ 312 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/32/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0032 (llvmorg-17-init-11098-gc01ea0515f15) 2023-05-08T21:36:21 0:00:00
Previous 0031 (llvmorg-17-init-10786-gfa1f88cdeca2) 2023-05-04T11:50:38 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 17 39
Performance Improvements 57 77
Added Tests 27 27
Unchanged Tests 727 685
Total Tests 828

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
433.milc 1.32% 1208.000 1224.000 - -91.61% -
429.mcf 1.07% 1864.000 1884.000 - -90.03% -
471.omnetpp 1.03% 2921.000 2951.000 - -75.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 190.91% 0.110 0.320 - 0.00% -
444.namd (max) 150.00% 2.000 5.000 - -98.97% -
429.mcf (unexplained diff vs previous) 122.22% 9.000 20.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 120.83% 0.480 1.060 - 0.00% -
433.milc (max) 100.00% 8.000 16.000 - -94.05% -
444.namd (max) (percentage) 87.18% 0.390 0.730 - -85.91% -
433.milc (max) (percentage) 78.38% 0.740 1.320 - -28.65% -
433.milc (unexplained diff vs previous) 77.78% 9.000 16.000 - 433.33% -
433.milc (unexplained diff vs previous) (percentage) 74.67% 0.750 1.310 - 6450.00% -
429.mcf (max) 42.86% 14.000 20.000 - -70.59% -
429.mcf (max) (percentage) 35.44% 0.790 1.070 - 197.22% -
433.milc (avg) (percentage) 3.19% 0.940 0.970 - 16.87% -
471.omnetpp (avg) (percentage) 2.53% 0.790 0.810 - 35.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.12% 535.000 529.000 - -92.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) -47.06% 17.000 9.000 - -94.51% -
482.sphinx3 (max) (percentage) -43.40% 2.120 1.200 - 73.91% -
450.soplex (max) -25.00% 16.000 12.000 - -92.16% -
450.soplex (max) (percentage) -22.44% 3.030 2.350 - 113.64% -
464.h264ref (max) (percentage) -17.05% 0.880 0.730 - 170.37% -
458.sjeng (max) -15.79% 19.000 16.000 - -54.29% -
464.h264ref (max) -15.79% 38.000 32.000 - 0.00% -
458.sjeng (max) (percentage) -14.81% 0.270 0.230 - 0.00% -
445.gobmk (avg) (percentage) -11.54% 0.520 0.460 - 43.75% -
445.gobmk -11.11% 27.000 24.000 - -35.14% -
445.gobmk (avg) -11.11% 27.000 24.000 - -35.14% -
450.soplex -9.09% 22.000 20.000 - -73.33% -
450.soplex (avg) -9.09% 22.000 20.000 - -73.33% -
470.lbm (max) -8.33% 12.000 11.000 - 83.33% -
482.sphinx3 (avg) (percentage) -8.00% 3.250 2.990 - 228.57% -
482.sphinx3 -7.69% 26.000 24.000 - -88.89% -
482.sphinx3 (avg) -7.69% 26.000 24.000 - -88.89% -
464.h264ref (avg) (percentage) -6.82% 0.440 0.410 - 10.81% -
447.dealII -6.67% 15.000 14.000 - -82.93% -
447.dealII (avg) -6.67% 15.000 14.000 - -82.93% -
462.libquantum (avg) (percentage) -6.43% 1.400 1.310 - 1090.91% -
450.soplex (avg) (percentage) -6.40% 4.220 3.950 - 631.48% -
447.dealII (avg) (percentage) -6.17% 0.810 0.760 - -16.48% -
456.hmmer (avg) (percentage) -5.97% 0.670 0.630 - -28.41% -
473.astar (max) -5.88% 17.000 16.000 - 60.00% -
470.lbm (avg) (percentage) -5.83% 3.090 2.910 - 401.72% -
473.astar (avg) (percentage) -5.80% 1.380 1.300 - 1757.14% -
456.hmmer -5.56% 18.000 17.000 - -78.75% -
456.hmmer (avg) -5.56% 18.000 17.000 - -78.75% -
401.bzip2 (max) -5.26% 19.000 18.000 - 200.00% -
464.h264ref -5.26% 19.000 18.000 - -59.09% -
464.h264ref (avg) -5.26% 19.000 18.000 - -59.09% -
458.sjeng (avg) (percentage) -5.13% 0.390 0.370 - 60.87% -
470.lbm -5.10% 98.000 93.000 - 45.31% -
470.lbm (avg) -5.10% 98.000 93.000 - 45.31% -
401.bzip2 (avg) (percentage) -4.93% 1.420 1.350 - 1250.00% -
473.astar -4.35% 69.000 66.000 - 633.33% -
473.astar (avg) -4.35% 69.000 66.000 - 633.33% -
401.bzip2 (max) (percentage) -3.90% 0.770 0.740 - 1380.00% -
429.mcf (avg) (percentage) -3.88% 3.610 3.470 - 837.84% -
458.sjeng -3.57% 28.000 27.000 - -22.86% -
458.sjeng (avg) -3.57% 28.000 27.000 - -22.86% -
429.mcf -2.99% 67.000 65.000 - -5.80% -
429.mcf (avg) -2.99% 67.000 65.000 - -5.80% -
473.astar (max) (percentage) -2.94% 0.340 0.330 - 312.50% -
401.bzip2 -2.86% 35.000 34.000 - 161.54% -
401.bzip2 (avg) -2.86% 35.000 34.000 - 161.54% -
444.namd (avg) (percentage) -2.75% 1.090 1.060 - -53.51% -
445.gobmk (max) (percentage) -2.70% 1.480 1.440 - 140.00% -
470.lbm (max) (percentage) -2.63% 0.380 0.370 - 516.67% -
471.omnetpp (max) (percentage) -2.63% 1.900 1.850 - 85.00% -
445.gobmk (max) -2.53% 79.000 77.000 - 10.00% -
462.libquantum (max) (percentage) -2.34% 1.280 1.250 - 3025.00% -
400.perlbench (max) (percentage) -1.96% 0.510 0.500 - -28.57% -
471.omnetpp (max) -1.82% 55.000 54.000 - -54.62% -
453.povray (max) (percentage) -1.55% 1.290 1.270 - 19.81% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.12% 224407.000 231402.000 - 0.00% -
447.dealII 1.44% 325219.000 329891.000 - 0.00% -
471.omnetpp 1.18% 490147.000 495909.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) 6450.00% 0.020 1.310 - 74.67% -
462.libquantum (max) (percentage) 3025.00% 0.040 1.250 - -2.34% -
473.astar (avg) (percentage) 1757.14% 0.070 1.300 - -5.80% -
401.bzip2 (max) (percentage) 1380.00% 0.050 0.740 - -3.90% -
401.bzip2 (avg) (percentage) 1250.00% 0.100 1.350 - -4.93% -
462.libquantum (avg) (percentage) 1090.91% 0.110 1.310 - -6.43% -
429.mcf (avg) (percentage) 837.84% 0.370 3.470 - -3.88% -
473.astar 633.33% 9.000 66.000 - -4.35% -
473.astar (avg) 633.33% 9.000 66.000 - -4.35% -
450.soplex (avg) (percentage) 631.48% 0.540 3.950 - -6.40% -
470.lbm (max) (percentage) 516.67% 0.060 0.370 - -2.63% -
433.milc (unexplained diff vs previous) 433.33% 3.000 16.000 - 77.78% -
470.lbm (avg) (percentage) 401.72% 0.580 2.910 - -5.83% -
473.astar (max) (percentage) 312.50% 0.080 0.330 - -2.94% -
482.sphinx3 (avg) (percentage) 228.57% 0.910 2.990 - -8.00% -
401.bzip2 (max) 200.00% 6.000 18.000 - -5.26% -
429.mcf (max) (percentage) 197.22% 0.360 1.070 - 35.44% -
464.h264ref (max) (percentage) 170.37% 0.270 0.730 - -17.05% -
401.bzip2 161.54% 13.000 34.000 - -2.86% -
401.bzip2 (avg) 161.54% 13.000 34.000 - -2.86% -
445.gobmk (max) (percentage) 140.00% 0.600 1.440 - -2.70% -
450.soplex (max) (percentage) 113.64% 1.100 2.350 - -22.44% -
471.omnetpp (max) (percentage) 85.00% 1.000 1.850 - -2.63% -
470.lbm (max) 83.33% 6.000 11.000 - -8.33% -
482.sphinx3 (max) (percentage) 73.91% 0.690 1.200 - -43.40% -
458.sjeng (avg) (percentage) 60.87% 0.230 0.370 - -5.13% -
473.astar (max) 60.00% 10.000 16.000 - -5.88% -
470.lbm 45.31% 64.000 93.000 - -5.10% -
470.lbm (avg) 45.31% 64.000 93.000 - -5.10% -
445.gobmk (avg) (percentage) 43.75% 0.320 0.460 - -11.54% -
471.omnetpp (avg) (percentage) 35.00% 0.600 0.810 - 2.53% -
453.povray (avg) (percentage) 20.55% 0.730 0.880 - 0.00% -
453.povray (max) (percentage) 19.81% 1.060 1.270 - -1.55% -
433.milc (avg) (percentage) 16.87% 0.830 0.970 - 3.19% -
464.h264ref (avg) (percentage) 10.81% 0.370 0.410 - -6.82% -
445.gobmk (max) 10.00% 70.000 77.000 - -2.53% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 -1.17% 44357.000 43840.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.28% 10150.000 73.000 - 0.00% -
462.libquantum -98.60% 9659.000 135.000 - 0.00% -
482.sphinx3 -96.61% 23779.000 805.000 - -0.37% -
450.soplex -96.22% 13988.000 529.000 - -0.75% -
453.povray -92.75% 7301.000 529.000 - -1.12% -
444.namd -92.62% 9377.000 692.000 - 0.73% -
433.milc -91.61% 14590.000 1224.000 - 1.32% -
429.mcf -90.03% 18905.000 1884.000 - 1.07% -
400.perlbench -83.04% 11085.000 1880.000 - 0.80% -
401.bzip2 -81.94% 13962.000 2522.000 - -0.36% -
447.dealII -79.20% 9102.000 1893.000 - 0.32% -
471.omnetpp -75.24% 11917.000 2951.000 - 1.03% -
470.lbm -71.00% 11046.000 3203.000 - 0.31% -
456.hmmer -69.51% 9122.000 2781.000 - 0.14% -
464.h264ref -63.55% 12142.000 4426.000 - 0.20% -
473.astar -61.78% 13301.000 5083.000 - 0.22% -
445.gobmk -54.04% 11668.000 5363.000 - -0.02% -
458.sjeng -51.81% 15282.000 7364.000 - -0.09% -
483.xalancbmk -47.85% 9633.000 5024.000 - 0.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -98.97% 485.000 5.000 - 150.00% -
482.sphinx3 (unexplained diff vs previous) -98.15% 162.000 3.000 - 0.00% -
444.namd -96.71% 213.000 7.000 - 0.00% -
444.namd (avg) -96.71% 213.000 7.000 - 0.00% -
482.sphinx3 (max) -94.51% 164.000 9.000 - -47.06% -
433.milc (max) -94.05% 269.000 16.000 - 100.00% -
453.povray -92.45% 53.000 4.000 - 0.00% -
453.povray (avg) -92.45% 53.000 4.000 - 0.00% -
453.povray (max) -92.21% 77.000 6.000 - 0.00% -
450.soplex (max) -92.16% 153.000 12.000 - -25.00% -
433.milc -90.91% 121.000 11.000 - 0.00% -
433.milc (avg) -90.91% 121.000 11.000 - 0.00% -
462.libquantum -90.00% 10.000 1.000 - 0.00% -
462.libquantum (avg) -90.00% 10.000 1.000 - 0.00% -
482.sphinx3 -88.89% 216.000 24.000 - -7.69% -
482.sphinx3 (avg) -88.89% 216.000 24.000 - -7.69% -
400.perlbench (max) -88.31% 77.000 9.000 - 0.00% -
447.dealII (max) -86.51% 126.000 17.000 - 0.00% -
444.namd (max) (percentage) -85.91% 5.180 0.730 - 87.18% -
456.hmmer (max) -85.29% 68.000 10.000 - 0.00% -
400.perlbench -83.93% 56.000 9.000 - 0.00% -
400.perlbench (avg) -83.93% 56.000 9.000 - 0.00% -
447.dealII -82.93% 82.000 14.000 - -6.67% -
447.dealII (avg) -82.93% 82.000 14.000 - -6.67% -
456.hmmer -78.75% 80.000 17.000 - -5.56% -
456.hmmer (avg) -78.75% 80.000 17.000 - -5.56% -
471.omnetpp (unexplained diff vs previous) -75.00% 120.000 30.000 - 0.00% -
450.soplex -73.33% 75.000 20.000 - -9.09% -
450.soplex (avg) -73.33% 75.000 20.000 - -9.09% -
429.mcf (max) -70.59% 68.000 20.000 - 42.86% -
471.omnetpp -67.61% 71.000 23.000 - 0.00% -
471.omnetpp (avg) -67.61% 71.000 23.000 - 0.00% -
462.libquantum (max) -66.67% 3.000 1.000 - 0.00% -
483.xalancbmk (max) -61.22% 49.000 19.000 - 0.00% -
464.h264ref -59.09% 44.000 18.000 - -5.26% -
464.h264ref (avg) -59.09% 44.000 18.000 - -5.26% -
471.omnetpp (max) -54.62% 119.000 54.000 - -1.82% -
458.sjeng (max) -54.29% 35.000 16.000 - -15.79% -
444.namd (avg) (percentage) -53.51% 2.280 1.060 - -2.75% -
456.hmmer (max) (percentage) -50.67% 0.750 0.370 - 0.00% -
483.xalancbmk -48.78% 41.000 21.000 - 0.00% -
483.xalancbmk (avg) -48.78% 41.000 21.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -45.59% 0.680 0.370 - 0.00% -
445.gobmk -35.14% 37.000 24.000 - -11.11% -
445.gobmk (avg) -35.14% 37.000 24.000 - -11.11% -
447.dealII (max) (percentage) -33.81% 1.390 0.920 - 0.00% -
433.milc (max) (percentage) -28.65% 1.850 1.320 - 78.38% -
400.perlbench (max) (percentage) -28.57% 0.700 0.500 - -1.96% -
456.hmmer (avg) (percentage) -28.41% 0.880 0.630 - -5.97% -
483.xalancbmk (max) (percentage) -23.53% 0.510 0.390 - 0.00% -
458.sjeng -22.86% 35.000 27.000 - -3.57% -
458.sjeng (avg) -22.86% 35.000 27.000 - -3.57% -
403.gcc (max) (percentage) -17.50% 0.400 0.330 - 0.00% -
447.dealII (avg) (percentage) -16.48% 0.910 0.760 - -6.17% -
429.mcf -5.80% 69.000 65.000 - -2.99% -
429.mcf (avg) -5.80% 69.000 65.000 - -2.99% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 52.63% 19.000 29.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1880.000 -
401.bzip2 2522.000 -
403.gcc 73.000 -
429.mcf 1884.000 1.07%
433.milc 1224.000 1.32%
444.namd 692.000 -
445.gobmk 5363.000 -
447.dealII 1893.000 -
450.soplex 529.000 -
453.povray 529.000 -1.12%
456.hmmer 2781.000 -
458.sjeng 7364.000 -
462.libquantum 135.000 -
464.h264ref 4426.000 -
470.lbm 3203.000 -
471.omnetpp 2951.000 1.03%
473.astar 5083.000 -
482.sphinx3 805.000 -
483.xalancbmk 5024.000 -
Geometric Mean 1541.666 -
Name Current %
400.perlbench 898414.000 -
401.bzip2 43840.000 -
403.gcc 2485260.000 -
429.mcf 9240.000 -
433.milc 62502.000 -
444.namd 142552.000 -
445.gobmk 1851818.000 -
447.dealII 329891.000 -
450.soplex 231402.000 -
453.povray 684709.000 -
456.hmmer 113308.000 -
458.sjeng 106627.000 -
462.libquantum 16828.000 -
464.h264ref 398457.000 -
470.lbm 10268.000 -
471.omnetpp 495909.000 -
473.astar 23716.000 -
482.sphinx3 119733.000 -
483.xalancbmk 2534086.000 -
Geometric Mean 169713.394 -
Name Current %
400.perlbench 9.000 -
400.perlbench (avg) 9.000 -
400.perlbench (avg) (percentage) 0.510 -
400.perlbench (max) 9.000 -
400.perlbench (max) (percentage) 0.500 -1.96%
401.bzip2 34.000 -2.86%
401.bzip2 (avg) 34.000 -2.86%
401.bzip2 (avg) (percentage) 1.350 -4.93%
401.bzip2 (max) 18.000 -5.26%
401.bzip2 (max) (percentage) 0.740 -3.90%
401.bzip2 (unexplained diff vs previous) 9.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.360 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.310 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.330 -
429.mcf 65.000 -2.99%
429.mcf (avg) 65.000 -2.99%
429.mcf (avg) (percentage) 3.470 -3.88%
429.mcf (max) 20.000 42.86%
429.mcf (max) (percentage) 1.070 35.44%
429.mcf (unexplained diff vs previous) 20.000 122.22%
429.mcf (unexplained diff vs previous) (percentage) 1.060 120.83%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 0.970 3.19%
433.milc (max) 16.000 100.00%
433.milc (max) (percentage) 1.320 78.38%
433.milc (unexplained diff vs previous) 16.000 77.78%
433.milc (unexplained diff vs previous) (percentage) 1.310 74.67%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.060 -2.75%
444.namd (max) 5.000 150.00%
444.namd (max) (percentage) 0.730 87.18%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.720 -
445.gobmk 24.000 -11.11%
445.gobmk (avg) 24.000 -11.11%
445.gobmk (avg) (percentage) 0.460 -11.54%
445.gobmk (max) 77.000 -2.53%
445.gobmk (max) (percentage) 1.440 -2.70%
445.gobmk (unexplained diff vs previous) 1.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -
447.dealII 14.000 -6.67%
447.dealII (avg) 14.000 -6.67%
447.dealII (avg) (percentage) 0.760 -6.17%
447.dealII (max) 17.000 -
447.dealII (max) (percentage) 0.920 -
447.dealII (unexplained diff vs previous) 6.000 200.00%
447.dealII (unexplained diff vs previous) (percentage) 0.320 190.91%
450.soplex 20.000 -9.09%
450.soplex (avg) 20.000 -9.09%
450.soplex (avg) (percentage) 3.950 -6.40%
450.soplex (max) 12.000 -25.00%
450.soplex (max) (percentage) 2.350 -22.44%
450.soplex (unexplained diff vs previous) 4.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.760 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.880 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.270 -1.55%
456.hmmer 17.000 -5.56%
456.hmmer (avg) 17.000 -5.56%
456.hmmer (avg) (percentage) 0.630 -5.97%
456.hmmer (max) 10.000 -
456.hmmer (max) (percentage) 0.370 -
456.hmmer (unexplained diff vs previous) 4.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -
458.sjeng 27.000 -3.57%
458.sjeng (avg) 27.000 -3.57%
458.sjeng (avg) (percentage) 0.370 -5.13%
458.sjeng (max) 16.000 -15.79%
458.sjeng (max) (percentage) 0.230 -14.81%
458.sjeng (unexplained diff vs previous) 7.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.100 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.310 -6.43%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.250 -2.34%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 18.000 -5.26%
464.h264ref (avg) 18.000 -5.26%
464.h264ref (avg) (percentage) 0.410 -6.82%
464.h264ref (max) 32.000 -15.79%
464.h264ref (max) (percentage) 0.730 -17.05%
464.h264ref (unexplained diff vs previous) 9.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.200 -
470.lbm 93.000 -5.10%
470.lbm (avg) 93.000 -5.10%
470.lbm (avg) (percentage) 2.910 -5.83%
470.lbm (max) 11.000 -8.33%
470.lbm (max) (percentage) 0.370 -2.63%
470.lbm (unexplained diff vs previous) 10.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.310 -
471.omnetpp 23.000 -
471.omnetpp (avg) 23.000 -
471.omnetpp (avg) (percentage) 0.810 2.53%
471.omnetpp (max) 54.000 -1.82%
471.omnetpp (max) (percentage) 1.850 -2.63%
471.omnetpp (unexplained diff vs previous) 30.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.020 -
473.astar 66.000 -4.35%
473.astar (avg) 66.000 -4.35%
473.astar (avg) (percentage) 1.300 -5.80%
473.astar (max) 16.000 -5.88%
473.astar (max) (percentage) 0.330 -2.94%
473.astar (unexplained diff vs previous) 11.000 -
473.astar (unexplained diff vs previous) (percentage) 0.220 -
482.sphinx3 24.000 -7.69%
482.sphinx3 (avg) 24.000 -7.69%
482.sphinx3 (avg) (percentage) 2.990 -8.00%
482.sphinx3 (max) 9.000 -47.06%
482.sphinx3 (max) (percentage) 1.200 -43.40%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.370 -
483.xalancbmk 21.000 -
483.xalancbmk (avg) 21.000 -
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) 19.000 -
483.xalancbmk (max) (percentage) 0.390 -
Geometric Mean 2.394 -46.55%