Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c27a0b21c5782d61c3c3125571239d08085565da (+ 210 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/35/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0035 (llvmorg-17-init-12016-gc27a0b21c578) 2023-05-19T05:53:37 0:00:00
Previous 0034 (llvmorg-17-init-11806-gcde9d41d87aa) 2023-05-15T22:51:45 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 36
Performance Improvements 58 84
Added Tests 15 25
Unchanged Tests 725 671
Total Tests 816

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.52% 525.000 533.000 - -96.19% -
429.mcf 1.14% 1849.000 1870.000 - -90.11% -
400.perlbench 1.10% 1820.000 1840.000 - -83.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (max) 280.00% 5.000 19.000 - -84.92% -
447.dealII (max) (percentage) 262.07% 0.290 1.050 - -24.46% -
473.astar (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 200.00% 0.040 0.120 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 100.00% 2.000 4.000 - -97.53% -
482.sphinx3 (unexplained diff vs previous) (percentage) 100.00% 0.250 0.500 - -26.47% -
453.povray (max) (percentage) 40.30% 0.670 0.940 - -11.32% -
453.povray (max) 33.33% 3.000 4.000 - -94.81% -
429.mcf (max) 31.25% 16.000 21.000 - -69.12% -
429.mcf (max) (percentage) 28.09% 0.890 1.140 - 216.67% -
458.sjeng (max) 6.67% 15.000 16.000 - -54.29% -
458.sjeng (max) (percentage) 4.76% 0.210 0.220 - -4.35% -
447.dealII (avg) (percentage) 4.35% 0.690 0.720 - -20.88% -
453.povray (avg) (percentage) 4.17% 0.720 0.750 - 2.74% -
462.libquantum (unexplained diff vs previous) (percentage) 1.37% 0.730 0.740 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -2.78% 72.000 70.000 - -99.31% -
447.dealII -1.05% 1900.000 1880.000 - -79.35% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -84.03% 1.440 0.230 - -77.23% -
471.omnetpp (unexplained diff vs previous) -83.72% 43.000 7.000 - -94.17% -
401.bzip2 (max) -58.82% 17.000 7.000 - 16.67% -
401.bzip2 (max) (percentage) -57.97% 0.690 0.290 - 480.00% -
433.milc (unexplained diff vs previous) -50.00% 2.000 1.000 - -66.67% -
433.milc (unexplained diff vs previous) (percentage) -50.00% 0.160 0.080 - 300.00% -
470.lbm (unexplained diff vs previous) (percentage) -45.71% 0.350 0.190 - 0.00% -
470.lbm (unexplained diff vs previous) -45.45% 11.000 6.000 - 0.00% -
470.lbm (max) (percentage) -23.53% 0.340 0.260 - 333.33% -
470.lbm (max) -20.00% 10.000 8.000 - 33.33% -
401.bzip2 (unexplained diff vs previous) -12.50% 8.000 7.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -12.50% 0.320 0.280 - 0.00% -
433.milc -9.09% 11.000 10.000 - -91.74% -
433.milc (avg) -9.09% 11.000 10.000 - -91.74% -
456.hmmer (max) -9.09% 11.000 10.000 - -85.29% -
473.astar -6.90% 58.000 54.000 - 500.00% -
473.astar (avg) -6.90% 58.000 54.000 - 500.00% -
482.sphinx3 (max) (percentage) -6.90% 0.580 0.540 - -21.74% -
401.bzip2 -6.67% 30.000 28.000 - 115.38% -
401.bzip2 (avg) -6.67% 30.000 28.000 - 115.38% -
471.omnetpp (max) (percentage) -6.59% 2.580 2.410 - 141.00% -
471.omnetpp (max) -6.49% 77.000 72.000 - -39.50% -
482.sphinx3 (avg) (percentage) -6.23% 2.570 2.410 - 164.84% -
473.astar (avg) (percentage) -6.09% 1.150 1.080 - 1442.86% -
471.omnetpp (avg) (percentage) -6.00% 1.000 0.940 - 56.67% -
456.hmmer -5.88% 17.000 16.000 - -80.00% -
456.hmmer (avg) -5.88% 17.000 16.000 - -80.00% -
462.libquantum (max) (percentage) -5.83% 2.060 1.940 - 4750.00% -
444.namd (max) (percentage) -5.71% 1.400 1.320 - -74.52% -
433.milc (avg) (percentage) -5.49% 0.910 0.860 - 3.61% -
470.lbm (avg) (percentage) -5.38% 2.600 2.460 - 324.14% -
433.milc (max) (percentage) -5.31% 1.130 1.070 - -42.16% -
450.soplex -5.26% 19.000 18.000 - -76.00% -
450.soplex (avg) -5.26% 19.000 18.000 - -76.00% -
401.bzip2 (avg) (percentage) -5.00% 1.200 1.140 - 1040.00% -
482.sphinx3 -5.00% 20.000 19.000 - -91.20% -
482.sphinx3 (avg) -5.00% 20.000 19.000 - -91.20% -
470.lbm -4.88% 82.000 78.000 - 21.88% -
470.lbm (avg) -4.88% 82.000 78.000 - 21.88% -
456.hmmer (max) (percentage) -4.88% 0.410 0.390 - -48.00% -
444.namd (avg) (percentage) -4.59% 1.090 1.040 - -54.39% -
450.soplex (avg) (percentage) -4.34% 3.690 3.530 - 553.70% -
458.sjeng -4.00% 25.000 24.000 - -31.43% -
458.sjeng (avg) -4.00% 25.000 24.000 - -31.43% -
429.mcf (avg) (percentage) -3.66% 3.280 3.160 - 754.05% -
471.omnetpp -3.45% 29.000 28.000 - -60.56% -
471.omnetpp (avg) -3.45% 29.000 28.000 - -60.56% -
456.hmmer (avg) (percentage) -3.23% 0.620 0.600 - -31.82% -
462.libquantum (avg) (percentage) -3.01% 1.330 1.290 - 1072.73% -
400.perlbench (max) (percentage) -2.00% 0.500 0.490 - -30.00% -
450.soplex (max) (percentage) -1.79% 2.230 2.190 - 99.09% -
429.mcf -1.67% 60.000 59.000 - -14.49% -
429.mcf (avg) -1.67% 60.000 59.000 - -14.49% -
445.gobmk (max) (percentage) -1.44% 1.390 1.370 - 128.33% -
464.h264ref (max) (percentage) -1.43% 0.700 0.690 - 155.56% -
445.gobmk (max) -1.35% 74.000 73.000 - 4.29% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.12% 224407.000 231398.000 - 0.00% -
447.dealII 1.44% 325219.000 329907.000 - 0.00% -
471.omnetpp 1.18% 490147.000 495909.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 4750.00% 0.040 1.940 - -5.83% -
473.astar (avg) (percentage) 1442.86% 0.070 1.080 - -6.09% -
462.libquantum (avg) (percentage) 1072.73% 0.110 1.290 - -3.01% -
401.bzip2 (avg) (percentage) 1040.00% 0.100 1.140 - -5.00% -
429.mcf (avg) (percentage) 754.05% 0.370 3.160 - -3.66% -
450.soplex (avg) (percentage) 553.70% 0.540 3.530 - -4.34% -
473.astar 500.00% 9.000 54.000 - -6.90% -
473.astar (avg) 500.00% 9.000 54.000 - -6.90% -
401.bzip2 (max) (percentage) 480.00% 0.050 0.290 - -57.97% -
470.lbm (max) (percentage) 333.33% 0.060 0.260 - -23.53% -
470.lbm (avg) (percentage) 324.14% 0.580 2.460 - -5.38% -
433.milc (unexplained diff vs previous) (percentage) 300.00% 0.020 0.080 - -50.00% -
473.astar (max) (percentage) 287.50% 0.080 0.310 - 0.00% -
429.mcf (max) (percentage) 216.67% 0.360 1.140 - 28.09% -
482.sphinx3 (avg) (percentage) 164.84% 0.910 2.410 - -6.23% -
464.h264ref (max) (percentage) 155.56% 0.270 0.690 - -1.43% -
471.omnetpp (max) (percentage) 141.00% 1.000 2.410 - -6.59% -
445.gobmk (max) (percentage) 128.33% 0.600 1.370 - -1.44% -
401.bzip2 115.38% 13.000 28.000 - -6.67% -
401.bzip2 (avg) 115.38% 13.000 28.000 - -6.67% -
450.soplex (max) (percentage) 99.09% 1.100 2.190 - -1.79% -
471.omnetpp (avg) (percentage) 56.67% 0.600 0.940 - -6.00% -
473.astar (max) 50.00% 10.000 15.000 - 0.00% -
458.sjeng (avg) (percentage) 47.83% 0.230 0.340 - -2.86% -
470.lbm (max) 33.33% 6.000 8.000 - -20.00% -
445.gobmk (avg) (percentage) 31.25% 0.320 0.420 - 0.00% -
470.lbm 21.88% 64.000 78.000 - -4.88% -
470.lbm (avg) 21.88% 64.000 78.000 - -4.88% -
401.bzip2 (max) 16.67% 6.000 7.000 - -58.82% -
464.h264ref (avg) (percentage) 10.81% 0.370 0.410 - 0.00% -
445.gobmk (max) 4.29% 70.000 73.000 - -1.35% -
433.milc (avg) (percentage) 3.61% 0.830 0.860 - -5.49% -
453.povray (avg) (percentage) 2.74% 0.730 0.750 - 4.17% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 -1.17% 44357.000 43840.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.31% 10150.000 70.000 - -2.78% -
462.libquantum -98.59% 9659.000 136.000 - -0.73% -
482.sphinx3 -96.62% 23779.000 804.000 - -0.50% -
450.soplex -96.19% 13988.000 533.000 - 1.52% -
453.povray -92.78% 7301.000 527.000 - -0.94% -
444.namd -92.68% 9377.000 686.000 - -0.44% -
433.milc -91.66% 14590.000 1217.000 - 0.08% -
429.mcf -90.11% 18905.000 1870.000 - 1.14% -
400.perlbench -83.40% 11085.000 1840.000 - 1.10% -
401.bzip2 -81.90% 13962.000 2527.000 - -0.28% -
447.dealII -79.35% 9102.000 1880.000 - -1.05% -
471.omnetpp -74.84% 11917.000 2998.000 - 0.23% -
470.lbm -71.12% 11046.000 3190.000 - 0.19% -
456.hmmer -69.66% 9122.000 2768.000 - -0.36% -
464.h264ref -63.77% 12142.000 4399.000 - -0.27% -
473.astar -61.79% 13301.000 5082.000 - 0.12% -
445.gobmk -53.92% 11668.000 5377.000 - 0.02% -
458.sjeng -51.96% 15282.000 7342.000 - -0.22% -
483.xalancbmk -48.27% 9633.000 4983.000 - -0.38% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -98.14% 485.000 9.000 - 0.00% -
482.sphinx3 (max) -97.56% 164.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -97.53% 162.000 4.000 - 100.00% -
444.namd -96.71% 213.000 7.000 - 0.00% -
444.namd (avg) -96.71% 213.000 7.000 - 0.00% -
433.milc (max) -95.17% 269.000 13.000 - 0.00% -
453.povray (max) -94.81% 77.000 4.000 - 33.33% -
453.povray -94.34% 53.000 3.000 - 0.00% -
453.povray (avg) -94.34% 53.000 3.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -94.17% 120.000 7.000 - -83.72% -
400.perlbench -92.86% 56.000 4.000 - 0.00% -
400.perlbench (avg) -92.86% 56.000 4.000 - 0.00% -
450.soplex (max) -92.81% 153.000 11.000 - 0.00% -
433.milc -91.74% 121.000 10.000 - -9.09% -
433.milc (avg) -91.74% 121.000 10.000 - -9.09% -
482.sphinx3 -91.20% 216.000 19.000 - -5.00% -
482.sphinx3 (avg) -91.20% 216.000 19.000 - -5.00% -
462.libquantum -90.00% 10.000 1.000 - 0.00% -
462.libquantum (avg) -90.00% 10.000 1.000 - 0.00% -
400.perlbench (max) -88.31% 77.000 9.000 - 0.00% -
456.hmmer (max) -85.29% 68.000 10.000 - -9.09% -
447.dealII (max) -84.92% 126.000 19.000 - 280.00% -
447.dealII -84.15% 82.000 13.000 - 0.00% -
447.dealII (avg) -84.15% 82.000 13.000 - 0.00% -
456.hmmer -80.00% 80.000 16.000 - -5.88% -
456.hmmer (avg) -80.00% 80.000 16.000 - -5.88% -
471.omnetpp (unexplained diff vs previous) (percentage) -77.23% 1.010 0.230 - -84.03% -
450.soplex -76.00% 75.000 18.000 - -5.26% -
450.soplex (avg) -76.00% 75.000 18.000 - -5.26% -
444.namd (max) (percentage) -74.52% 5.180 1.320 - -5.71% -
429.mcf (max) -69.12% 68.000 21.000 - 31.25% -
433.milc (unexplained diff vs previous) -66.67% 3.000 1.000 - -50.00% -
483.xalancbmk (max) -61.22% 49.000 19.000 - 0.00% -
471.omnetpp -60.56% 71.000 28.000 - -3.45% -
471.omnetpp (avg) -60.56% 71.000 28.000 - -3.45% -
464.h264ref -59.09% 44.000 18.000 - 0.00% -
464.h264ref (avg) -59.09% 44.000 18.000 - 0.00% -
444.namd (avg) (percentage) -54.39% 2.280 1.040 - -4.59% -
458.sjeng (max) -54.29% 35.000 16.000 - 6.67% -
483.xalancbmk -48.78% 41.000 21.000 - 0.00% -
483.xalancbmk (avg) -48.78% 41.000 21.000 - 0.00% -
456.hmmer (max) (percentage) -48.00% 0.750 0.390 - -4.88% -
400.perlbench (avg) (percentage) -47.06% 0.510 0.270 - 0.00% -
433.milc (max) (percentage) -42.16% 1.850 1.070 - -5.31% -
445.gobmk -40.54% 37.000 22.000 - 0.00% -
445.gobmk (avg) -40.54% 37.000 22.000 - 0.00% -
471.omnetpp (max) -39.50% 119.000 72.000 - -6.49% -
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
456.hmmer (avg) (percentage) -31.82% 0.880 0.600 - -3.23% -
458.sjeng -31.43% 35.000 24.000 - -4.00% -
458.sjeng (avg) -31.43% 35.000 24.000 - -4.00% -
400.perlbench (max) (percentage) -30.00% 0.700 0.490 - -2.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -26.47% 0.680 0.500 - 100.00% -
447.dealII (max) (percentage) -24.46% 1.390 1.050 - 262.07% -
483.xalancbmk (max) (percentage) -23.53% 0.510 0.390 - 0.00% -
482.sphinx3 (max) (percentage) -21.74% 0.690 0.540 - -6.90% -
447.dealII (avg) (percentage) -20.88% 0.910 0.720 - 4.35% -
403.gcc (max) (percentage) -17.50% 0.400 0.330 - 0.00% -
429.mcf -14.49% 69.000 59.000 - -1.67% -
429.mcf (avg) -14.49% 69.000 59.000 - -1.67% -
453.povray (max) (percentage) -11.32% 1.060 0.940 - 40.30% -
464.h264ref (max) -6.25% 32.000 30.000 - 0.00% -
458.sjeng (max) (percentage) -4.35% 0.230 0.220 - 4.76% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 52.63% 19.000 29.000 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1840.000 1.10%
401.bzip2 2527.000 -
403.gcc 70.000 -2.78%
429.mcf 1870.000 1.14%
433.milc 1217.000 -
444.namd 686.000 -
445.gobmk 5377.000 -
447.dealII 1880.000 -1.05%
450.soplex 533.000 1.52%
453.povray 527.000 -
456.hmmer 2768.000 -
458.sjeng 7342.000 -
462.libquantum 136.000 -
464.h264ref 4399.000 -
470.lbm 3190.000 -
471.omnetpp 2998.000 -
473.astar 5082.000 -
482.sphinx3 804.000 -
483.xalancbmk 4983.000 -
Geometric Mean 1534.522 -
Name Current %
400.perlbench 898158.000 -
401.bzip2 43840.000 -
403.gcc 2485236.000 -
429.mcf 9236.000 -
433.milc 62502.000 -
444.namd 142304.000 -
445.gobmk 1851922.000 -
447.dealII 329907.000 -
450.soplex 231398.000 -
453.povray 684709.000 -
456.hmmer 113308.000 -
458.sjeng 106627.000 -
462.libquantum 16828.000 -
464.h264ref 396877.000 -
470.lbm 10268.000 -
471.omnetpp 495909.000 -
473.astar 23716.000 -
482.sphinx3 119733.000 -
483.xalancbmk 2534090.000 -
Geometric Mean 169656.656 -
Name Current %
400.perlbench 4.000 -
400.perlbench (avg) 4.000 -
400.perlbench (avg) (percentage) 0.270 -
400.perlbench (max) 9.000 -
400.perlbench (max) (percentage) 0.490 -2.00%
401.bzip2 28.000 -6.67%
401.bzip2 (avg) 28.000 -6.67%
401.bzip2 (avg) (percentage) 1.140 -5.00%
401.bzip2 (max) 7.000 -58.82%
401.bzip2 (max) (percentage) 0.290 -57.97%
401.bzip2 (unexplained diff vs previous) 7.000 -12.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.280 -12.50%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.310 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.330 -
429.mcf 59.000 -1.67%
429.mcf (avg) 59.000 -1.67%
429.mcf (avg) (percentage) 3.160 -3.66%
429.mcf (max) 21.000 31.25%
429.mcf (max) (percentage) 1.140 28.09%
429.mcf (unexplained diff vs previous) 21.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.120 -
433.milc 10.000 -9.09%
433.milc (avg) 10.000 -9.09%
433.milc (avg) (percentage) 0.860 -5.49%
433.milc (max) 13.000 -
433.milc (max) (percentage) 1.070 -5.31%
433.milc (unexplained diff vs previous) 1.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.080 -50.00%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.040 -4.59%
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.320 -5.71%
444.namd (unexplained diff vs previous) 3.000 -
444.namd (unexplained diff vs previous) (percentage) 0.440 -
445.gobmk 22.000 -
445.gobmk (avg) 22.000 -
445.gobmk (avg) (percentage) 0.420 -
445.gobmk (max) 73.000 -1.35%
445.gobmk (max) (percentage) 1.370 -1.44%
447.dealII 13.000 -
447.dealII (avg) 13.000 -
447.dealII (avg) (percentage) 0.720 4.35%
447.dealII (max) 19.000 280.00%
447.dealII (max) (percentage) 1.050 262.07%
447.dealII (unexplained diff vs previous) 20.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.060 -
450.soplex 18.000 -5.26%
450.soplex (avg) 18.000 -5.26%
450.soplex (avg) (percentage) 3.530 -4.34%
450.soplex (max) 11.000 -
450.soplex (max) (percentage) 2.190 -1.79%
450.soplex (unexplained diff vs previous) 8.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.500 -
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.750 4.17%
453.povray (max) 4.000 33.33%
453.povray (max) (percentage) 0.940 40.30%
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 0.950 -
456.hmmer 16.000 -5.88%
456.hmmer (avg) 16.000 -5.88%
456.hmmer (avg) (percentage) 0.600 -3.23%
456.hmmer (max) 10.000 -9.09%
456.hmmer (max) (percentage) 0.390 -4.88%
456.hmmer (unexplained diff vs previous) 10.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.360 -
458.sjeng 24.000 -4.00%
458.sjeng (avg) 24.000 -4.00%
458.sjeng (avg) (percentage) 0.340 -
458.sjeng (max) 16.000 6.67%
458.sjeng (max) (percentage) 0.220 4.76%
458.sjeng (unexplained diff vs previous) 16.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.220 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.290 -3.01%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.940 -5.83%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.740 1.37%
464.h264ref 18.000 -
464.h264ref (avg) 18.000 -
464.h264ref (avg) (percentage) 0.410 -
464.h264ref (max) 30.000 -
464.h264ref (max) (percentage) 0.690 -1.43%
470.lbm 78.000 -4.88%
470.lbm (avg) 78.000 -4.88%
470.lbm (avg) (percentage) 2.460 -5.38%
470.lbm (max) 8.000 -20.00%
470.lbm (max) (percentage) 0.260 -23.53%
470.lbm (unexplained diff vs previous) 6.000 -45.45%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -45.71%
471.omnetpp 28.000 -3.45%
471.omnetpp (avg) 28.000 -3.45%
471.omnetpp (avg) (percentage) 0.940 -6.00%
471.omnetpp (max) 72.000 -6.49%
471.omnetpp (max) (percentage) 2.410 -6.59%
471.omnetpp (unexplained diff vs previous) 7.000 -83.72%
471.omnetpp (unexplained diff vs previous) (percentage) 0.230 -84.03%
473.astar 54.000 -6.90%
473.astar (avg) 54.000 -6.90%
473.astar (avg) (percentage) 1.080 -6.09%
473.astar (max) 15.000 -
473.astar (max) (percentage) 0.310 -
473.astar (unexplained diff vs previous) 6.000 200.00%
473.astar (unexplained diff vs previous) (percentage) 0.120 200.00%
482.sphinx3 19.000 -5.00%
482.sphinx3 (avg) 19.000 -5.00%
482.sphinx3 (avg) (percentage) 2.410 -6.23%
482.sphinx3 (max) 4.000 -
482.sphinx3 (max) (percentage) 0.540 -6.90%
482.sphinx3 (unexplained diff vs previous) 4.000 100.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.500 100.00%
483.xalancbmk 21.000 -
483.xalancbmk (avg) 21.000 -
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) 19.000 -
483.xalancbmk (max) (percentage) 0.390 -
Geometric Mean 2.621 -12.21%