Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/416884544e0210c32c113f02c3d3881e78aac6a4 (+ 488 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/87/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0087 (llvmorg-18-init-08936-g416884544e02) 2023-10-05T13:10:32 0:00:00
Previous 0085 (llvmorg-18-init-08448-g187e02fa2ded) 2023-09-21T18:49:05 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 34
Performance Improvements 45 92
Added Tests 32 26
Unchanged Tests 744 688
Total Tests 840

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.68% 2909.000 2987.000 - -74.93% -
483.xalancbmk 1.83% 5127.000 5221.000 - -45.80% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) 233.33% 3.000 10.000 - 66.67% -
401.bzip2 (max) (percentage) 166.67% 0.150 0.400 - 700.00% -
433.milc (max) 140.00% 5.000 12.000 - -95.54% -
433.milc (max) (percentage) 102.04% 0.490 0.990 - -46.49% -
471.omnetpp (max) 86.05% 43.000 80.000 - -32.77% -
471.omnetpp (max) (percentage) 79.87% 1.490 2.680 - 168.00% -
473.astar (max) (percentage) 22.92% 0.480 0.590 - 637.50% -
473.astar (max) 21.74% 23.000 28.000 - 180.00% -
471.omnetpp 13.33% 30.000 34.000 - -52.11% -
471.omnetpp (avg) 13.33% 30.000 34.000 - -52.11% -
400.perlbench (max) 12.50% 8.000 9.000 - -88.31% -
470.lbm (max) 12.50% 8.000 9.000 - 50.00% -
471.omnetpp (avg) (percentage) 10.38% 1.060 1.170 - 95.00% -
447.dealII (max) (percentage) 9.37% 0.640 0.700 - -49.64% -
447.dealII (max) 9.09% 11.000 12.000 - -90.48% -
483.xalancbmk (max) 5.26% 19.000 20.000 - -59.18% -
433.milc (avg) (percentage) 1.30% 0.770 0.780 - -6.02% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.49% 67.000 66.000 - -99.35% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (max) -37.93% 29.000 18.000 - -43.75% -
464.h264ref (max) (percentage) -37.50% 0.640 0.400 - 48.15% -
453.povray (max) (percentage) -28.40% 0.810 0.580 - -45.28% -
453.povray (max) -25.00% 4.000 3.000 - -96.10% -
482.sphinx3 (max) -25.00% 4.000 3.000 - -98.17% -
482.sphinx3 (max) (percentage) -18.33% 0.600 0.490 - -28.99% -
444.namd (max) (percentage) -17.43% 1.090 0.900 - -82.63% -
444.namd -16.67% 6.000 5.000 - -97.65% -
444.namd (avg) -16.67% 6.000 5.000 - -97.65% -
456.hmmer (max) -14.81% 27.000 23.000 - -66.18% -
456.hmmer (max) (percentage) -14.74% 0.950 0.810 - 8.00% -
444.namd (max) -14.29% 7.000 6.000 - -98.76% -
450.soplex -7.14% 14.000 13.000 - -82.67% -
450.soplex (avg) -7.14% 14.000 13.000 - -82.67% -
482.sphinx3 -6.67% 15.000 14.000 - -93.52% -
482.sphinx3 (avg) -6.67% 15.000 14.000 - -93.52% -
456.hmmer (avg) (percentage) -6.56% 0.610 0.570 - -35.23% -
450.soplex (avg) (percentage) -5.90% 3.050 2.870 - 431.48% -
456.hmmer -5.88% 17.000 16.000 - -80.00% -
456.hmmer (avg) -5.88% 17.000 16.000 - -80.00% -
464.h264ref -5.56% 18.000 17.000 - -61.36% -
464.h264ref (avg) -5.56% 18.000 17.000 - -61.36% -
444.namd (avg) (percentage) -5.49% 0.910 0.860 - -62.28% -
482.sphinx3 (avg) (percentage) -5.21% 1.920 1.820 - 100.00% -
462.libquantum (avg) (percentage) -5.08% 1.180 1.120 - 918.18% -
464.h264ref (avg) (percentage) -4.88% 0.410 0.390 - 5.41% -
470.lbm -4.76% 63.000 60.000 - -6.25% -
470.lbm (avg) -4.76% 63.000 60.000 - -6.25% -
429.mcf (avg) (percentage) -4.74% 2.530 2.410 - 551.35% -
401.bzip2 -4.55% 22.000 21.000 - 61.54% -
401.bzip2 (avg) -4.55% 22.000 21.000 - 61.54% -
470.lbm (avg) (percentage) -4.43% 2.030 1.940 - 234.48% -
473.astar -4.00% 50.000 48.000 - 433.33% -
473.astar (avg) -4.00% 50.000 48.000 - 433.33% -
450.soplex (max) (percentage) -3.51% 1.140 1.100 - 0.00% -
462.libquantum (max) (percentage) -2.94% 1.020 0.990 - 2375.00% -
473.astar (avg) (percentage) -2.91% 1.030 1.000 - 1328.57% -
458.sjeng (max) (percentage) -2.78% 0.360 0.350 - 52.17% -
453.povray (avg) (percentage) -2.67% 0.750 0.730 - 0.00% -
429.mcf -2.56% 39.000 38.000 - -44.93% -
429.mcf (avg) -2.56% 39.000 38.000 - -44.93% -
401.bzip2 (avg) (percentage) -2.25% 0.890 0.870 - 770.00% -
445.gobmk (max) -1.52% 66.000 65.000 - -7.14% -
403.gcc (max) (percentage) -1.11% 8.120 8.030 - 1907.50% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.17% 224407.000 229286.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) 4800.00% 0.020 0.980 - 0.00% -
462.libquantum (max) (percentage) 2375.00% 0.040 0.990 - -2.94% -
403.gcc (max) (percentage) 1907.50% 0.400 8.030 - -1.11% -
473.astar (avg) (percentage) 1328.57% 0.070 1.000 - -2.91% -
462.libquantum (avg) (percentage) 918.18% 0.110 1.120 - -5.08% -
403.gcc (avg) (percentage) 829.03% 0.310 2.880 - 0.00% -
401.bzip2 (avg) (percentage) 770.00% 0.100 0.870 - -2.25% -
401.bzip2 (max) (percentage) 700.00% 0.050 0.400 - 166.67% -
473.astar (max) (percentage) 637.50% 0.080 0.590 - 22.92% -
429.mcf (avg) (percentage) 551.35% 0.370 2.410 - -4.74% -
473.astar 433.33% 9.000 48.000 - -4.00% -
473.astar (avg) 433.33% 9.000 48.000 - -4.00% -
450.soplex (avg) (percentage) 431.48% 0.540 2.870 - -5.90% -
470.lbm (max) (percentage) 383.33% 0.060 0.290 - 3.57% -
433.milc (unexplained diff vs previous) 300.00% 3.000 12.000 - 0.00% -
470.lbm (avg) (percentage) 234.48% 0.580 1.940 - -4.43% -
473.astar (max) 180.00% 10.000 28.000 - 21.74% -
471.omnetpp (max) (percentage) 168.00% 1.000 2.680 - 79.87% -
471.omnetpp (unexplained diff vs previous) (percentage) 158.42% 1.010 2.610 - 0.00% -
445.gobmk (max) (percentage) 108.33% 0.600 1.250 - -0.79% -
482.sphinx3 (avg) (percentage) 100.00% 0.910 1.820 - -5.21% -
471.omnetpp (avg) (percentage) 95.00% 0.600 1.170 - 10.38% -
401.bzip2 (max) 66.67% 6.000 10.000 - 233.33% -
401.bzip2 61.54% 13.000 21.000 - -4.55% -
401.bzip2 (avg) 61.54% 13.000 21.000 - -4.55% -
458.sjeng (max) (percentage) 52.17% 0.230 0.350 - -2.78% -
470.lbm (max) 50.00% 6.000 9.000 - 12.50% -
464.h264ref (max) (percentage) 48.15% 0.270 0.400 - -37.50% -
458.sjeng (avg) (percentage) 30.43% 0.230 0.300 - 0.00% -
429.mcf (max) (percentage) 27.78% 0.360 0.460 - 0.00% -
445.gobmk (avg) (percentage) 12.50% 0.320 0.360 - 0.00% -
456.hmmer (max) (percentage) 8.00% 0.750 0.810 - -14.74% -
464.h264ref (avg) (percentage) 5.41% 0.370 0.390 - -4.88% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -4.84% 143421.000 136484.000 - 0.00% -
453.povray -1.70% 691522.000 679749.000 - 0.00% -
473.astar -1.32% 23789.000 23476.000 - 0.00% -
464.h264ref -1.27% 399974.000 394901.000 - 0.00% -
429.mcf -1.27% 9249.000 9132.000 - 0.00% -
401.bzip2 -1.26% 44357.000 43796.000 - 0.00% -
433.milc -1.10% 62863.000 62170.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 10150.000 66.000 - -1.49% -
462.libquantum -98.62% 9659.000 133.000 - 0.00% -
482.sphinx3 -96.64% 23779.000 799.000 - 0.25% -
450.soplex -96.58% 13988.000 479.000 - -0.21% -
453.povray -92.91% 7301.000 518.000 - 0.58% -
444.namd -92.84% 9377.000 671.000 - 0.00% -
433.milc -91.64% 14590.000 1220.000 - 0.99% -
429.mcf -91.64% 18905.000 1581.000 - 0.06% -
400.perlbench -83.06% 11085.000 1878.000 - 0.70% -
401.bzip2 -81.97% 13962.000 2517.000 - -0.40% -
447.dealII -79.86% 9102.000 1833.000 - -0.70% -
471.omnetpp -74.93% 11917.000 2987.000 - 2.68% -
470.lbm -71.59% 11046.000 3138.000 - -0.29% -
456.hmmer -67.97% 9122.000 2922.000 - 0.07% -
473.astar -63.22% 13301.000 4892.000 - -0.59% -
464.h264ref -62.39% 12142.000 4567.000 - -0.24% -
445.gobmk -55.20% 11668.000 5227.000 - -0.32% -
458.sjeng -51.31% 15282.000 7441.000 - 0.24% -
483.xalancbmk -45.80% 9633.000 5221.000 - 1.83% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -98.77% 162.000 2.000 - 0.00% -
444.namd (max) -98.76% 485.000 6.000 - -14.29% -
482.sphinx3 (max) -98.17% 164.000 3.000 - -25.00% -
444.namd -97.65% 213.000 5.000 - -16.67% -
444.namd (avg) -97.65% 213.000 5.000 - -16.67% -
403.gcc -96.77% 31.000 1.000 - 0.00% -
403.gcc (avg) -96.77% 31.000 1.000 - 0.00% -
450.soplex (max) -96.73% 153.000 5.000 - 0.00% -
453.povray (max) -96.10% 77.000 3.000 - -25.00% -
433.milc (max) -95.54% 269.000 12.000 - 140.00% -
453.povray -94.34% 53.000 3.000 - 0.00% -
453.povray (avg) -94.34% 53.000 3.000 - 0.00% -
482.sphinx3 -93.52% 216.000 14.000 - -6.67% -
482.sphinx3 (avg) -93.52% 216.000 14.000 - -6.67% -
433.milc -92.56% 121.000 9.000 - 0.00% -
433.milc (avg) -92.56% 121.000 9.000 - 0.00% -
400.perlbench -91.07% 56.000 5.000 - 0.00% -
400.perlbench (avg) -91.07% 56.000 5.000 - 0.00% -
447.dealII (max) -90.48% 126.000 12.000 - 9.09% -
462.libquantum -90.00% 10.000 1.000 - 0.00% -
462.libquantum (avg) -90.00% 10.000 1.000 - 0.00% -
429.mcf (max) -89.71% 68.000 7.000 - 0.00% -
400.perlbench (max) -88.31% 77.000 9.000 - 12.50% -
403.gcc (max) -87.50% 40.000 5.000 - 0.00% -
447.dealII -85.37% 82.000 12.000 - 0.00% -
447.dealII (avg) -85.37% 82.000 12.000 - 0.00% -
450.soplex -82.67% 75.000 13.000 - -7.14% -
450.soplex (avg) -82.67% 75.000 13.000 - -7.14% -
444.namd (max) (percentage) -82.63% 5.180 0.900 - -17.43% -
456.hmmer -80.00% 80.000 16.000 - -5.88% -
456.hmmer (avg) -80.00% 80.000 16.000 - -5.88% -
462.libquantum (max) -66.67% 3.000 1.000 - 0.00% -
456.hmmer (max) -66.18% 68.000 23.000 - -14.81% -
482.sphinx3 (unexplained diff vs previous) (percentage) -63.24% 0.680 0.250 - 0.00% -
444.namd (avg) (percentage) -62.28% 2.280 0.860 - -5.49% -
464.h264ref -61.36% 44.000 17.000 - -5.56% -
464.h264ref (avg) -61.36% 44.000 17.000 - -5.56% -
483.xalancbmk (max) -59.18% 49.000 20.000 - 5.26% -
471.omnetpp -52.11% 71.000 34.000 - 13.33% -
471.omnetpp (avg) -52.11% 71.000 34.000 - 13.33% -
445.gobmk -51.35% 37.000 18.000 - 0.00% -
445.gobmk (avg) -51.35% 37.000 18.000 - 0.00% -
447.dealII (max) (percentage) -49.64% 1.390 0.700 - 9.37% -
400.perlbench (avg) (percentage) -47.06% 0.510 0.270 - 0.00% -
433.milc (max) (percentage) -46.49% 1.850 0.990 - 102.04% -
483.xalancbmk -46.34% 41.000 22.000 - 0.00% -
483.xalancbmk (avg) -46.34% 41.000 22.000 - 0.00% -
453.povray (max) (percentage) -45.28% 1.060 0.580 - -28.40% -
429.mcf -44.93% 69.000 38.000 - -2.56% -
429.mcf (avg) -44.93% 69.000 38.000 - -2.56% -
464.h264ref (max) -43.75% 32.000 18.000 - -37.93% -
458.sjeng -37.14% 35.000 22.000 - 0.00% -
458.sjeng (avg) -37.14% 35.000 22.000 - 0.00% -
456.hmmer (avg) (percentage) -35.23% 0.880 0.570 - -6.56% -
471.omnetpp (unexplained diff vs previous) -35.00% 120.000 78.000 - 0.00% -
471.omnetpp (max) -32.77% 119.000 80.000 - 86.05% -
400.perlbench (max) (percentage) -31.43% 0.700 0.480 - 0.00% -
482.sphinx3 (max) (percentage) -28.99% 0.690 0.490 - -18.33% -
458.sjeng (max) -25.71% 35.000 26.000 - 0.00% -
483.xalancbmk (max) (percentage) -23.53% 0.510 0.390 - 0.00% -
447.dealII (avg) (percentage) -23.08% 0.910 0.700 - 0.00% -
445.gobmk (max) -7.14% 70.000 65.000 - -1.52% -
470.lbm -6.25% 64.000 60.000 - -4.76% -
470.lbm (avg) -6.25% 64.000 60.000 - -4.76% -
433.milc (avg) (percentage) -6.02% 0.830 0.780 - 1.30% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 52.63% 19.000 29.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1878.000 -
401.bzip2 2517.000 -
403.gcc 66.000 -1.49%
429.mcf 1581.000 -
433.milc 1220.000 -
444.namd 671.000 -
445.gobmk 5227.000 -
447.dealII 1833.000 -
450.soplex 479.000 -
453.povray 518.000 -
456.hmmer 2922.000 -
458.sjeng 7441.000 -
462.libquantum 133.000 -
464.h264ref 4567.000 -
470.lbm 3138.000 -
471.omnetpp 2987.000 2.68%
473.astar 4892.000 -
482.sphinx3 799.000 -
483.xalancbmk 5221.000 1.83%
Geometric Mean 1507.098 -
Name Current %
400.perlbench 892198.000 -
401.bzip2 43796.000 -
403.gcc 2471664.000 -
429.mcf 9132.000 -
433.milc 62170.000 -
444.namd 136484.000 -
445.gobmk 1849554.000 -
447.dealII 327919.000 -
450.soplex 229286.000 -
453.povray 679749.000 -
456.hmmer 112884.000 -
458.sjeng 106207.000 -
462.libquantum 16836.000 -
464.h264ref 394901.000 -
470.lbm 10300.000 -
471.omnetpp 491197.000 -
473.astar 23476.000 -
482.sphinx3 119537.000 -
483.xalancbmk 2522862.000 -
Geometric Mean 168497.973 -
Name Current %
400.perlbench 5.000 -
400.perlbench (avg) 5.000 -
400.perlbench (avg) (percentage) 0.270 -
400.perlbench (max) 9.000 12.50%
400.perlbench (max) (percentage) 0.480 -
401.bzip2 21.000 -4.55%
401.bzip2 (avg) 21.000 -4.55%
401.bzip2 (avg) (percentage) 0.870 -2.25%
401.bzip2 (max) 10.000 233.33%
401.bzip2 (max) (percentage) 0.400 166.67%
401.bzip2 (unexplained diff vs previous) 10.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.400 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.880 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 8.030 -1.11%
429.mcf 38.000 -2.56%
429.mcf (avg) 38.000 -2.56%
429.mcf (avg) (percentage) 2.410 -4.74%
429.mcf (max) 7.000 -
429.mcf (max) (percentage) 0.460 -
429.mcf (unexplained diff vs previous) 1.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.060 -
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.780 1.30%
433.milc (max) 12.000 140.00%
433.milc (max) (percentage) 0.990 102.04%
433.milc (unexplained diff vs previous) 12.000 -
433.milc (unexplained diff vs previous) (percentage) 0.980 -
444.namd 5.000 -16.67%
444.namd (avg) 5.000 -16.67%
444.namd (avg) (percentage) 0.860 -5.49%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.900 -17.43%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 18.000 -
445.gobmk (avg) 18.000 -
445.gobmk (avg) (percentage) 0.360 -
445.gobmk (max) 65.000 -1.52%
445.gobmk (max) (percentage) 1.250 -
445.gobmk (unexplained diff vs previous) 17.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.330 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.700 -
447.dealII (max) 12.000 9.09%
447.dealII (max) (percentage) 0.700 9.37%
447.dealII (unexplained diff vs previous) 13.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.710 -
450.soplex 13.000 -7.14%
450.soplex (avg) 13.000 -7.14%
450.soplex (avg) (percentage) 2.870 -5.90%
450.soplex (max) 5.000 -
450.soplex (max) (percentage) 1.100 -3.51%
450.soplex (unexplained diff vs previous) 1.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.210 -
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.730 -2.67%
453.povray (max) 3.000 -25.00%
453.povray (max) (percentage) 0.580 -28.40%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.580 -
456.hmmer 16.000 -5.88%
456.hmmer (avg) 16.000 -5.88%
456.hmmer (avg) (percentage) 0.570 -6.56%
456.hmmer (max) 23.000 -14.81%
456.hmmer (max) (percentage) 0.810 -14.74%
456.hmmer (unexplained diff vs previous) 2.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.070 -
458.sjeng 22.000 -
458.sjeng (avg) 22.000 -
458.sjeng (avg) (percentage) 0.300 -
458.sjeng (max) 26.000 -
458.sjeng (max) (percentage) 0.350 -2.78%
458.sjeng (unexplained diff vs previous) 18.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.240 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.120 -5.08%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.990 -2.94%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 17.000 -5.56%
464.h264ref (avg) 17.000 -5.56%
464.h264ref (avg) (percentage) 0.390 -4.88%
464.h264ref (max) 18.000 -37.93%
464.h264ref (max) (percentage) 0.400 -37.50%
464.h264ref (unexplained diff vs previous) 11.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.240 -
470.lbm 60.000 -4.76%
470.lbm (avg) 60.000 -4.76%
470.lbm (avg) (percentage) 1.940 -4.43%
470.lbm (max) 9.000 12.50%
470.lbm (max) (percentage) 0.290 -
470.lbm (unexplained diff vs previous) 9.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.290 -
471.omnetpp 34.000 13.33%
471.omnetpp (avg) 34.000 13.33%
471.omnetpp (avg) (percentage) 1.170 10.38%
471.omnetpp (max) 80.000 86.05%
471.omnetpp (max) (percentage) 2.680 79.87%
471.omnetpp (unexplained diff vs previous) 78.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.610 -
473.astar 48.000 -4.00%
473.astar (avg) 48.000 -4.00%
473.astar (avg) (percentage) 1.000 -2.91%
473.astar (max) 28.000 21.74%
473.astar (max) (percentage) 0.590 22.92%
473.astar (unexplained diff vs previous) 29.000 -
473.astar (unexplained diff vs previous) (percentage) 0.590 -
482.sphinx3 14.000 -6.67%
482.sphinx3 (avg) 14.000 -6.67%
482.sphinx3 (avg) (percentage) 1.820 -5.21%
482.sphinx3 (max) 3.000 -25.00%
482.sphinx3 (max) (percentage) 0.490 -18.33%
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.250 -
483.xalancbmk 22.000 -
483.xalancbmk (avg) 22.000 -
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) 20.000 5.26%
483.xalancbmk (max) (percentage) 0.390 -
Geometric Mean 2.320 -40.45%