Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fbade95ebf2bc959fada5206e47f792a2090d72e (+ 219 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/351/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0351 (llvmorg-21-init-15553-gfbade95ebf2b) 2025-06-14T06:44:59 0:00:00
Previous 0350 (llvmorg-21-init-15334-g058602372e2b) 2025-06-12T05:34:13 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 89 52
Performance Improvements 60 82
Added Tests 0 101
Unchanged Tests 1015 929
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 19.22% 1504.000 1793.000 - -90.52% -
436.cactusADM 1.40% 1994.000 2022.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) (percentage) 19400.00% 0.010 1.950 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 13000.00% 1.000 131.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 9133.33% 0.030 2.770 - 0.00% -
470.lbm (unexplained diff vs previous) 8600.00% 1.000 87.000 - 0.00% -
429.mcf (unexplained diff vs previous) 5680.00% 5.000 289.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 4784.85% 0.330 16.120 - 0.00% -
429.mcf (max) 4200.00% 8.000 344.000 - 405.88% -
429.mcf (max) (percentage) 3459.26% 0.540 19.220 - 5238.89% -
473.astar (unexplained diff vs previous) (percentage) 1890.48% 0.210 4.180 - 0.00% -
473.astar (unexplained diff vs previous) 1772.73% 11.000 206.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 1043.48% 0.460 5.260 - 420.79% -
471.omnetpp (unexplained diff vs previous) 978.57% 14.000 151.000 - 25.83% -
471.omnetpp (max) (percentage) 557.89% 0.760 5.000 - 400.00% -
471.omnetpp (max) 550.00% 22.000 143.000 - 20.17% -
470.lbm (max) 500.00% 14.000 84.000 - 1300.00% -
470.lbm (max) (percentage) 486.96% 0.460 2.700 - 4400.00% -
450.soplex (unexplained diff vs previous) (percentage) 458.54% 1.640 9.160 - 0.00% -
450.soplex (unexplained diff vs previous) 411.11% 9.000 46.000 - 0.00% -
450.soplex (max) (percentage) 402.40% 1.670 8.390 - 662.73% -
434.zeusmp (unexplained diff vs previous) (percentage) 378.38% 0.370 1.770 - 0.00% -
434.zeusmp (unexplained diff vs previous) 371.43% 7.000 33.000 - 0.00% -
434.zeusmp (max) (percentage) 370.27% 0.370 1.740 - 0.00% -
450.soplex (max) 366.67% 9.000 42.000 - -72.55% -
464.h264ref (unexplained diff vs previous) (percentage) 362.79% 0.430 1.990 - 0.00% -
464.h264ref (unexplained diff vs previous) 357.89% 19.000 87.000 - 0.00% -
434.zeusmp (max) 357.14% 7.000 32.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 255.17% 0.290 1.030 - 0.00% -
401.bzip2 (unexplained diff vs previous) 250.00% 8.000 28.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 210.53% 0.950 2.950 - 14650.00% -
433.milc (unexplained diff vs previous) 200.00% 12.000 36.000 - 1100.00% -
433.milc (max) (percentage) 194.85% 0.970 2.860 - 54.59% -
433.milc (max) 183.33% 12.000 34.000 - -87.36% -
453.povray (unexplained diff vs previous) (percentage) 120.74% 1.350 2.980 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 115.04% 1.330 2.860 - 320.59% -
453.povray (unexplained diff vs previous) 114.29% 7.000 15.000 - 0.00% -
453.povray (max) (percentage) 110.95% 1.370 2.890 - 172.64% -
482.sphinx3 (unexplained diff vs previous) 109.09% 11.000 23.000 - -85.80% -
453.povray (max) 100.00% 7.000 14.000 - -81.82% -
456.hmmer (unexplained diff vs previous) 100.00% 2.000 4.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 100.00% 0.070 0.140 - 0.00% -
459.GemsFDTD (max) (percentage) 87.25% 1.020 1.910 - 0.00% -
459.GemsFDTD (max) 85.51% 69.000 128.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 72.60% 0.730 1.260 - 0.00% -
445.gobmk (unexplained diff vs previous) 70.00% 40.000 68.000 - 0.00% -
473.astar (max) (percentage) 62.35% 2.470 4.010 - 4912.50% -
435.gromacs (unexplained diff vs previous) (percentage) 60.32% 3.780 6.060 - 0.00% -
464.h264ref (max) (percentage) 57.26% 1.240 1.950 - 622.22% -
445.gobmk (max) (percentage) 56.96% 0.790 1.240 - 106.67% -
473.astar (max) 56.35% 126.000 197.000 - 1870.00% -
445.gobmk (max) 55.81% 43.000 67.000 - -4.29% -
464.h264ref (max) 54.55% 55.000 85.000 - 165.62% -
435.gromacs (unexplained diff vs previous) 50.91% 165.000 249.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 49.59% 1.210 1.810 - 0.00% -
437.leslie3d (unexplained diff vs previous) 47.34% 207.000 305.000 - 0.00% -
435.gromacs (max) (percentage) 45.29% 3.930 5.710 - 0.00% -
482.sphinx3 (max) (percentage) 38.31% 2.010 2.780 - 302.90% -
401.bzip2 (max) (percentage) 37.84% 0.740 1.020 - 1940.00% -
482.sphinx3 (max) 37.50% 16.000 22.000 - -86.59% -
435.gromacs (max) 36.84% 171.000 234.000 - 0.00% -
401.bzip2 (max) 35.00% 20.000 27.000 - 350.00% -
444.namd (unexplained diff vs previous) (percentage) 34.83% 0.890 1.200 - 0.00% -
444.namd (unexplained diff vs previous) 33.33% 6.000 8.000 - 0.00% -
444.namd (max) (percentage) 32.22% 0.900 1.190 - -77.03% -
429.mcf 21.21% 99.000 120.000 - 73.91% -
429.mcf (avg) 21.21% 99.000 120.000 - 73.91% -
437.leslie3d (max) (percentage) 19.46% 1.490 1.780 - 0.00% -
437.leslie3d (max) 17.25% 255.000 299.000 - 0.00% -
444.namd (max) 16.67% 6.000 7.000 - -98.56% -
481.wrf (unexplained diff vs previous) (percentage) 5.28% 2.840 2.990 - 0.00% -
481.wrf (avg) (percentage) 2.72% 1.840 1.890 - 0.00% -
450.soplex (avg) (percentage) 2.66% 3.010 3.090 - 472.22% -
453.povray (avg) (percentage) 2.40% 1.250 1.280 - 75.34% -
459.GemsFDTD (avg) (percentage) 2.25% 0.890 0.910 - 0.00% -
481.wrf (unexplained diff vs previous) 2.17% 92.000 94.000 - 0.00% -
429.mcf (avg) (percentage) 2.12% 6.600 6.740 - 1721.62% -
434.zeusmp (avg) (percentage) 2.08% 0.960 0.980 - 0.00% -
435.gromacs (avg) (percentage) 1.99% 3.010 3.070 - 0.00% -
470.lbm (avg) (percentage) 1.90% 1.050 1.070 - 84.48% -
433.milc (avg) (percentage) 1.87% 1.070 1.090 - 31.33% -
473.astar (avg) (percentage) 1.70% 1.760 1.790 - 2457.14% -
459.GemsFDTD 1.67% 60.000 61.000 - 0.00% -
459.GemsFDTD (avg) 1.67% 60.000 61.000 - 0.00% -
471.omnetpp (avg) (percentage) 1.59% 1.890 1.920 - 220.00% -
444.namd (avg) (percentage) 1.32% 0.760 0.770 - -66.23% -
445.gobmk (avg) (percentage) 1.30% 0.770 0.780 - 143.75% -
436.cactusADM (avg) (percentage) 1.16% 0.860 0.870 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1.02% 0.980 0.990 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -8.39% 548.000 502.000 - -96.41% -
435.gromacs -5.71% 4360.000 4111.000 - 0.00% -
403.gcc -5.19% 77.000 73.000 - -99.28% -
471.omnetpp -5.00% 3023.000 2872.000 - -75.90% -
473.astar -4.01% 5138.000 4932.000 - -62.92% -
481.wrf -2.90% 3240.000 3146.000 - 0.00% -
453.povray -2.89% 519.000 504.000 - -93.10% -
433.milc -2.86% 1257.000 1221.000 - -91.63% -
482.sphinx3 -2.78% 828.000 805.000 - -96.61% -
470.lbm -2.70% 3223.000 3136.000 - -71.61% -
400.perlbench -2.60% 1962.000 1911.000 - -82.76% -
458.sjeng -2.14% 7530.000 7369.000 - -51.78% -
464.h264ref -1.95% 4457.000 4370.000 - -64.01% -
459.GemsFDTD -1.91% 6851.000 6720.000 - 0.00% -
437.leslie3d -1.78% 17155.000 16850.000 - 0.00% -
434.zeusmp -1.74% 1902.000 1869.000 - 0.00% -
445.gobmk -1.24% 5473.000 5405.000 - -53.68% -
444.namd -1.19% 675.000 667.000 - -92.89% -
410.bwaves -1.13% 4585.000 4533.000 - 0.00% -
401.bzip2 -1.02% 2742.000 2714.000 - -80.56% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) -33.33% 3.000 2.000 - -33.33% -
436.cactusADM (unexplained diff vs previous) (percentage) -10.97% 1.550 1.380 - 0.00% -
436.cactusADM (unexplained diff vs previous) -9.68% 31.000 28.000 - 0.00% -
456.hmmer -9.09% 11.000 10.000 - -87.50% -
456.hmmer (avg) -9.09% 11.000 10.000 - -87.50% -
436.cactusADM (max) (percentage) -8.50% 1.530 1.400 - 0.00% -
462.libquantum (max) (percentage) -6.73% 2.970 2.770 - 6825.00% -
436.cactusADM (max) -6.67% 30.000 28.000 - 0.00% -
450.soplex -6.25% 16.000 15.000 - -80.00% -
450.soplex (avg) -6.25% 16.000 15.000 - -80.00% -
482.sphinx3 -6.25% 16.000 15.000 - -93.06% -
482.sphinx3 (avg) -6.25% 16.000 15.000 - -93.06% -
416.gamess (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
416.gamess (max) -4.35% 23.000 22.000 - 0.00% -
401.bzip2 -4.17% 24.000 23.000 - 76.92% -
401.bzip2 (avg) -4.17% 24.000 23.000 - 76.92% -
481.wrf (max) -4.07% 123.000 118.000 - 0.00% -
435.gromacs -3.82% 131.000 126.000 - 0.00% -
435.gromacs (avg) -3.82% 131.000 126.000 - 0.00% -
410.bwaves (max) -3.77% 53.000 51.000 - 0.00% -
456.hmmer (max) (percentage) -3.70% 0.270 0.260 - -65.33% -
410.bwaves (unexplained diff vs previous) -3.70% 54.000 52.000 - 0.00% -
458.sjeng (max) -3.70% 27.000 26.000 - -25.71% -
471.omnetpp -3.51% 57.000 55.000 - -22.54% -
471.omnetpp (avg) -3.51% 57.000 55.000 - -22.54% -
400.perlbench (max) -3.08% 65.000 63.000 - -18.18% -
456.hmmer (avg) (percentage) -2.63% 0.380 0.370 - -57.95% -
447.dealII (max) (percentage) -2.60% 0.770 0.750 - -46.04% -
410.bwaves (max) (percentage) -2.59% 1.160 1.130 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -2.54% 1.180 1.150 - 0.00% -
458.sjeng -2.50% 40.000 39.000 - 11.43% -
458.sjeng (avg) -2.50% 40.000 39.000 - 11.43% -
473.astar -2.22% 90.000 88.000 - 877.78% -
473.astar (avg) -2.22% 90.000 88.000 - 877.78% -
465.tonto (max) -2.16% 231.000 226.000 - 0.00% -
410.bwaves -2.04% 49.000 48.000 - 0.00% -
410.bwaves (avg) -2.04% 49.000 48.000 - 0.00% -
400.perlbench -1.96% 51.000 50.000 - -10.71% -
400.perlbench (avg) -1.96% 51.000 50.000 - -10.71% -
465.tonto (max) (percentage) -1.25% 0.800 0.790 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) 14650.00% 0.020 2.950 - 210.53% -
462.libquantum (max) (percentage) 6825.00% 0.040 2.770 - -6.73% -
429.mcf (max) (percentage) 5238.89% 0.360 19.220 - 3459.26% -
473.astar (max) (percentage) 4912.50% 0.080 4.010 - 62.35% -
470.lbm (max) (percentage) 4400.00% 0.060 2.700 - 486.96% -
473.astar (avg) (percentage) 2457.14% 0.070 1.790 - 1.70% -
462.libquantum (avg) (percentage) 2445.45% 0.110 2.800 - -0.71% -
401.bzip2 (max) (percentage) 1940.00% 0.050 1.020 - 37.84% -
473.astar (max) 1870.00% 10.000 197.000 - 56.35% -
429.mcf (avg) (percentage) 1721.62% 0.370 6.740 - 2.12% -
470.lbm (max) 1300.00% 6.000 84.000 - 500.00% -
433.milc (unexplained diff vs previous) 1100.00% 3.000 36.000 - 200.00% -
473.astar 877.78% 9.000 88.000 - -2.22% -
473.astar (avg) 877.78% 9.000 88.000 - -2.22% -
401.bzip2 (avg) (percentage) 780.00% 0.100 0.880 - 0.00% -
403.gcc (avg) (percentage) 729.03% 0.310 2.570 - 0.00% -
403.gcc (max) (percentage) 685.00% 0.400 3.140 - -0.63% -
450.soplex (max) (percentage) 662.73% 1.100 8.390 - 402.40% -
464.h264ref (max) (percentage) 622.22% 0.270 1.950 - 57.26% -
450.soplex (avg) (percentage) 472.22% 0.540 3.090 - 2.66% -
471.omnetpp (unexplained diff vs previous) (percentage) 420.79% 1.010 5.260 - 1043.48% -
400.perlbench (avg) (percentage) 419.61% 0.510 2.650 - 0.00% -
429.mcf (max) 405.88% 68.000 344.000 - 4200.00% -
471.omnetpp (max) (percentage) 400.00% 1.000 5.000 - 557.89% -
400.perlbench (max) (percentage) 377.14% 0.700 3.340 - 0.00% -
401.bzip2 (max) 350.00% 6.000 27.000 - 35.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 320.59% 0.680 2.860 - 115.04% -
482.sphinx3 (max) (percentage) 302.90% 0.690 2.780 - 38.31% -
471.omnetpp (avg) (percentage) 220.00% 0.600 1.920 - 1.59% -
453.povray (max) (percentage) 172.64% 1.060 2.890 - 110.95% -
464.h264ref (max) 165.62% 32.000 85.000 - 54.55% -
464.h264ref (avg) (percentage) 154.05% 0.370 0.940 - 1.08% -
445.gobmk (avg) (percentage) 143.75% 0.320 0.780 - 1.30% -
458.sjeng (avg) (percentage) 134.78% 0.230 0.540 - 0.00% -
482.sphinx3 (avg) (percentage) 117.58% 0.910 1.980 - 0.51% -
445.gobmk (max) (percentage) 106.67% 0.600 1.240 - 56.96% -
470.lbm (avg) (percentage) 84.48% 0.580 1.070 - 1.90% -
401.bzip2 76.92% 13.000 23.000 - -4.17% -
401.bzip2 (avg) 76.92% 13.000 23.000 - -4.17% -
453.povray (avg) (percentage) 75.34% 0.730 1.280 - 2.40% -
429.mcf 73.91% 69.000 120.000 - 21.21% -
429.mcf (avg) 73.91% 69.000 120.000 - 21.21% -
458.sjeng (max) (percentage) 56.52% 0.230 0.360 - 0.00% -
433.milc (max) (percentage) 54.59% 1.850 2.860 - 194.85% -
433.milc (avg) (percentage) 31.33% 0.830 1.090 - 1.87% -
471.omnetpp (unexplained diff vs previous) 25.83% 120.000 151.000 - 978.57% -
471.omnetpp (max) 20.17% 119.000 143.000 - 550.00% -
445.gobmk 13.51% 37.000 42.000 - 0.00% -
445.gobmk (avg) 13.51% 37.000 42.000 - 0.00% -
458.sjeng 11.43% 35.000 39.000 - -2.50% -
458.sjeng (avg) 11.43% 35.000 39.000 - -2.50% -
447.dealII (avg) (percentage) 3.30% 0.910 0.940 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -6.03% 143421.000 134775.000 - 0.00% -
464.h264ref -3.78% 399974.000 384851.000 - 0.00% -
447.dealII -3.13% 325219.000 315034.000 - 0.00% -
403.gcc -2.93% 2486993.000 2414001.000 - 0.00% -
453.povray -2.86% 691522.000 671739.000 - 0.00% -
482.sphinx3 -2.13% 120254.000 117689.000 - 0.00% -
458.sjeng -2.11% 106872.000 104620.000 - -0.47% -
462.libquantum -1.98% 16989.000 16652.000 - 0.00% -
400.perlbench -1.92% 900243.000 882950.000 - -0.00% -
456.hmmer -1.74% 113613.000 111632.000 - 0.00% -
471.omnetpp -1.69% 490147.000 481844.000 - 0.00% -
470.lbm -1.64% 10313.000 10144.000 - 0.00% -
445.gobmk -1.57% 1850383.000 1821251.000 - 0.00% -
401.bzip2 -1.49% 44357.000 43696.000 - 0.00% -
450.soplex -1.29% 224407.000 221518.000 - 0.00% -
433.milc -1.24% 62863.000 62086.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.28% 10150.000 73.000 - -5.19% -
462.libquantum -98.95% 9659.000 101.000 - -0.98% -
482.sphinx3 -96.61% 23779.000 805.000 - -2.78% -
450.soplex -96.41% 13988.000 502.000 - -8.39% -
453.povray -93.10% 7301.000 504.000 - -2.89% -
444.namd -92.89% 9377.000 667.000 - -1.19% -
433.milc -91.63% 14590.000 1221.000 - -2.86% -
429.mcf -90.52% 18905.000 1793.000 - 19.22% -
400.perlbench -82.76% 11085.000 1911.000 - -2.60% -
401.bzip2 -80.56% 13962.000 2714.000 - -1.02% -
447.dealII -78.87% 9102.000 1923.000 - -0.57% -
471.omnetpp -75.90% 11917.000 2872.000 - -5.00% -
470.lbm -71.61% 11046.000 3136.000 - -2.70% -
456.hmmer -67.84% 9122.000 2934.000 - 0.14% -
464.h264ref -64.01% 12142.000 4370.000 - -1.95% -
473.astar -62.92% 13301.000 4932.000 - -4.01% -
445.gobmk -53.68% 11668.000 5405.000 - -1.24% -
458.sjeng -51.78% 15282.000 7369.000 - -2.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -98.56% 485.000 7.000 - 16.67% -
444.namd -97.65% 213.000 5.000 - 0.00% -
444.namd (avg) -97.65% 213.000 5.000 - 0.00% -
403.gcc -96.77% 31.000 1.000 - 0.00% -
403.gcc (avg) -96.77% 31.000 1.000 - 0.00% -
403.gcc (max) -95.00% 40.000 2.000 - 0.00% -
482.sphinx3 -93.06% 216.000 15.000 - -6.25% -
482.sphinx3 (avg) -93.06% 216.000 15.000 - -6.25% -
456.hmmer (max) -89.71% 68.000 7.000 - 0.00% -
433.milc -89.26% 121.000 13.000 - 0.00% -
433.milc (avg) -89.26% 121.000 13.000 - 0.00% -
447.dealII (max) -88.89% 126.000 14.000 - 0.00% -
453.povray -88.68% 53.000 6.000 - 0.00% -
453.povray (avg) -88.68% 53.000 6.000 - 0.00% -
456.hmmer -87.50% 80.000 10.000 - -9.09% -
456.hmmer (avg) -87.50% 80.000 10.000 - -9.09% -
433.milc (max) -87.36% 269.000 34.000 - 183.33% -
482.sphinx3 (max) -86.59% 164.000 22.000 - 37.50% -
482.sphinx3 (unexplained diff vs previous) -85.80% 162.000 23.000 - 109.09% -
453.povray (max) -81.82% 77.000 14.000 - 100.00% -
450.soplex -80.00% 75.000 15.000 - -6.25% -
450.soplex (avg) -80.00% 75.000 15.000 - -6.25% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
447.dealII -78.05% 82.000 18.000 - 0.00% -
447.dealII (avg) -78.05% 82.000 18.000 - 0.00% -
444.namd (max) (percentage) -77.03% 5.180 1.190 - 32.22% -
450.soplex (max) -72.55% 153.000 42.000 - 366.67% -
444.namd (avg) (percentage) -66.23% 2.280 0.770 - 1.32% -
456.hmmer (max) (percentage) -65.33% 0.750 0.260 - -3.70% -
456.hmmer (avg) (percentage) -57.95% 0.880 0.370 - -2.63% -
470.lbm -48.44% 64.000 33.000 - 0.00% -
470.lbm (avg) -48.44% 64.000 33.000 - 0.00% -
447.dealII (max) (percentage) -46.04% 1.390 0.750 - -2.60% -
462.libquantum (max) -33.33% 3.000 2.000 - -33.33% -
483.xalancbmk (max) (percentage) -27.45% 0.510 0.370 - 0.00% -
458.sjeng (max) -25.71% 35.000 26.000 - -3.70% -
471.omnetpp -22.54% 71.000 55.000 - -3.51% -
471.omnetpp (avg) -22.54% 71.000 55.000 - -3.51% -
400.perlbench (max) -18.18% 77.000 63.000 - -3.08% -
400.perlbench -10.71% 56.000 50.000 - -1.96% -
400.perlbench (avg) -10.71% 56.000 50.000 - -1.96% -
464.h264ref -6.82% 44.000 41.000 - 0.00% -
464.h264ref (avg) -6.82% 44.000 41.000 - 0.00% -
445.gobmk (max) -4.29% 70.000 67.000 - 55.81% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 63.16% 19.000 31.000 - 0.00% -
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 42.11% 19.000 27.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)


Report Time: 0.39s
Name Current %
400.perlbench 1911.000 -2.60%
401.bzip2 2714.000 -1.02%
403.gcc 73.000 -5.19%
410.bwaves 4533.000 -1.13%
416.gamess 11898.000 -
429.mcf 1793.000 19.22%
433.milc 1221.000 -2.86%
434.zeusmp 1869.000 -1.74%
435.gromacs 4111.000 -5.71%
436.cactusADM 2022.000 1.40%
437.leslie3d 16850.000 -1.78%
444.namd 667.000 -1.19%
445.gobmk 5405.000 -1.24%
447.dealII 1923.000 -
450.soplex 502.000 -8.39%
453.povray 504.000 -2.89%
456.hmmer 2934.000 -
458.sjeng 7369.000 -2.14%
459.GemsFDTD 6720.000 -1.91%
462.libquantum 101.000 -
464.h264ref 4370.000 -1.95%
465.tonto 28675.000 -
470.lbm 3136.000 -2.70%
471.omnetpp 2872.000 -5.00%
473.astar 4932.000 -4.01%
481.wrf 3146.000 -2.90%
482.sphinx3 805.000 -2.78%
Geometric Mean 2272.965 -1.62%
Name Current %
400.perlbench 882950.000 -
401.bzip2 43696.000 -
403.gcc 2414001.000 -
410.bwaves 796829.000 -
416.gamess 7564751.000 -
429.mcf 9200.000 -
433.milc 62086.000 -
434.zeusmp 1159944.000 -
435.gromacs 498530.000 -
436.cactusADM 1161465.000 -
437.leslie3d 1036477.000 -
444.namd 134775.000 -
445.gobmk 1821251.000 -
447.dealII 315034.000 -
450.soplex 221518.000 -
453.povray 671739.000 -
456.hmmer 111632.000 -
458.sjeng 104620.000 -
459.GemsFDTD 2468651.000 -
462.libquantum 16652.000 -
464.h264ref 384851.000 -
465.tonto 9506672.000 -
470.lbm 10144.000 -
471.omnetpp 481844.000 -
473.astar 23628.000 -
481.wrf 6715808.000 -
482.sphinx3 117689.000 -
Geometric Mean 347765.170 -
Name Current %
400.perlbench 50.000 -1.96%
400.perlbench (avg) 50.000 -1.96%
400.perlbench (avg) (percentage) 2.650 -
400.perlbench (max) 63.000 -3.08%
400.perlbench (max) (percentage) 3.340 -
401.bzip2 23.000 -4.17%
401.bzip2 (avg) 23.000 -4.17%
401.bzip2 (avg) (percentage) 0.880 -
401.bzip2 (max) 27.000 35.00%
401.bzip2 (max) (percentage) 1.020 37.84%
401.bzip2 (unexplained diff vs previous) 28.000 250.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.030 255.17%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.570 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.140 -
410.bwaves 48.000 -2.04%
410.bwaves (avg) 48.000 -2.04%
410.bwaves (avg) (percentage) 1.080 -
410.bwaves (max) 51.000 -3.77%
410.bwaves (max) (percentage) 1.130 -2.59%
410.bwaves (unexplained diff vs previous) 52.000 -3.70%
410.bwaves (unexplained diff vs previous) (percentage) 1.150 -2.54%
416.gamess 15.000 -
416.gamess (avg) 15.000 -
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) 22.000 -4.35%
416.gamess (max) (percentage) 0.190 -5.00%
429.mcf 120.000 21.21%
429.mcf (avg) 120.000 21.21%
429.mcf (avg) (percentage) 6.740 2.12%
429.mcf (max) 344.000 4200.00%
429.mcf (max) (percentage) 19.220 3459.26%
429.mcf (unexplained diff vs previous) 289.000 5680.00%
429.mcf (unexplained diff vs previous) (percentage) 16.120 4784.85%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.090 1.87%
433.milc (max) 34.000 183.33%
433.milc (max) (percentage) 2.860 194.85%
433.milc (unexplained diff vs previous) 36.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 2.950 210.53%
434.zeusmp 18.000 -
434.zeusmp (avg) 18.000 -
434.zeusmp (avg) (percentage) 0.980 2.08%
434.zeusmp (max) 32.000 357.14%
434.zeusmp (max) (percentage) 1.740 370.27%
434.zeusmp (unexplained diff vs previous) 33.000 371.43%
434.zeusmp (unexplained diff vs previous) (percentage) 1.770 378.38%
435.gromacs 126.000 -3.82%
435.gromacs (avg) 126.000 -3.82%
435.gromacs (avg) (percentage) 3.070 1.99%
435.gromacs (max) 234.000 36.84%
435.gromacs (max) (percentage) 5.710 45.29%
435.gromacs (unexplained diff vs previous) 249.000 50.91%
435.gromacs (unexplained diff vs previous) (percentage) 6.060 60.32%
436.cactusADM 17.000 -
436.cactusADM (avg) 17.000 -
436.cactusADM (avg) (percentage) 0.870 1.16%
436.cactusADM (max) 28.000 -6.67%
436.cactusADM (max) (percentage) 1.400 -8.50%
436.cactusADM (unexplained diff vs previous) 28.000 -9.68%
436.cactusADM (unexplained diff vs previous) (percentage) 1.380 -10.97%
437.leslie3d 192.000 -
437.leslie3d (avg) 192.000 -
437.leslie3d (avg) (percentage) 1.140 -
437.leslie3d (max) 299.000 17.25%
437.leslie3d (max) (percentage) 1.780 19.46%
437.leslie3d (unexplained diff vs previous) 305.000 47.34%
437.leslie3d (unexplained diff vs previous) (percentage) 1.810 49.59%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.770 1.32%
444.namd (max) 7.000 16.67%
444.namd (max) (percentage) 1.190 32.22%
444.namd (unexplained diff vs previous) 8.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 1.200 34.83%
445.gobmk 42.000 -
445.gobmk (avg) 42.000 -
445.gobmk (avg) (percentage) 0.780 1.30%
445.gobmk (max) 67.000 55.81%
445.gobmk (max) (percentage) 1.240 56.96%
445.gobmk (unexplained diff vs previous) 68.000 70.00%
445.gobmk (unexplained diff vs previous) (percentage) 1.260 72.60%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 0.940 -
447.dealII (max) 14.000 -
447.dealII (max) (percentage) 0.750 -2.60%
447.dealII (unexplained diff vs previous) 11.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.570 -
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 3.090 2.66%
450.soplex (max) 42.000 366.67%
450.soplex (max) (percentage) 8.390 402.40%
450.soplex (unexplained diff vs previous) 46.000 411.11%
450.soplex (unexplained diff vs previous) (percentage) 9.160 458.54%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.280 2.40%
453.povray (max) 14.000 100.00%
453.povray (max) (percentage) 2.890 110.95%
453.povray (unexplained diff vs previous) 15.000 114.29%
453.povray (unexplained diff vs previous) (percentage) 2.980 120.74%
456.hmmer 10.000 -9.09%
456.hmmer (avg) 10.000 -9.09%
456.hmmer (avg) (percentage) 0.370 -2.63%
456.hmmer (max) 7.000 -
456.hmmer (max) (percentage) 0.260 -3.70%
456.hmmer (unexplained diff vs previous) 4.000 100.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 100.00%
458.sjeng 39.000 -2.50%
458.sjeng (avg) 39.000 -2.50%
458.sjeng (avg) (percentage) 0.540 -
458.sjeng (max) 26.000 -3.70%
458.sjeng (max) (percentage) 0.360 -
459.GemsFDTD 61.000 1.67%
459.GemsFDTD (avg) 61.000 1.67%
459.GemsFDTD (avg) (percentage) 0.910 2.25%
459.GemsFDTD (max) 128.000 85.51%
459.GemsFDTD (max) (percentage) 1.910 87.25%
459.GemsFDTD (unexplained diff vs previous) 131.000 13000.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.950 19400.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.800 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.770 -6.73%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.990 1.02%
464.h264ref 41.000 -
464.h264ref (avg) 41.000 -
464.h264ref (avg) (percentage) 0.940 -
464.h264ref (max) 85.000 54.55%
464.h264ref (max) (percentage) 1.950 57.26%
464.h264ref (unexplained diff vs previous) 87.000 357.89%
464.h264ref (unexplained diff vs previous) (percentage) 1.990 362.79%
465.tonto 100.000 -
465.tonto (avg) 100.000 -
465.tonto (avg) (percentage) 0.350 -
465.tonto (max) 226.000 -2.16%
465.tonto (max) (percentage) 0.790 -1.25%
470.lbm 33.000 -
470.lbm (avg) 33.000 -
470.lbm (avg) (percentage) 1.070 1.90%
470.lbm (max) 84.000 500.00%
470.lbm (max) (percentage) 2.700 486.96%
470.lbm (unexplained diff vs previous) 87.000 8600.00%
470.lbm (unexplained diff vs previous) (percentage) 2.770 9133.33%
471.omnetpp 55.000 -3.51%
471.omnetpp (avg) 55.000 -3.51%
471.omnetpp (avg) (percentage) 1.920 1.59%
471.omnetpp (max) 143.000 550.00%
471.omnetpp (max) (percentage) 5.000 557.89%
471.omnetpp (unexplained diff vs previous) 151.000 978.57%
471.omnetpp (unexplained diff vs previous) (percentage) 5.260 1043.48%
473.astar 88.000 -2.22%
473.astar (avg) 88.000 -2.22%
473.astar (avg) (percentage) 1.790 1.70%
473.astar (max) 197.000 56.35%
473.astar (max) (percentage) 4.010 62.35%
473.astar (unexplained diff vs previous) 206.000 1772.73%
473.astar (unexplained diff vs previous) (percentage) 4.180 1890.48%
481.wrf 59.000 -
481.wrf (avg) 59.000 -
481.wrf (avg) (percentage) 1.890 2.72%
481.wrf (max) 118.000 -4.07%
481.wrf (max) (percentage) 3.780 -
481.wrf (unexplained diff vs previous) 94.000 2.17%
481.wrf (unexplained diff vs previous) (percentage) 2.990 5.28%
482.sphinx3 15.000 -6.25%
482.sphinx3 (avg) 15.000 -6.25%
482.sphinx3 (avg) (percentage) 1.980 -
482.sphinx3 (max) 22.000 37.50%
482.sphinx3 (max) (percentage) 2.780 38.31%
482.sphinx3 (unexplained diff vs previous) 23.000 109.09%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.860 115.04%
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) (percentage) 0.370 -
Geometric Mean 8.860 64.01%