Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ecc8b29eda2acc517170e9dde212986ad677cc68 (+ 218 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/347/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0347 (llvmorg-21-init-14870-gecc8b29eda2a) 2025-06-07T06:17:32 0:00:00
Previous 0345 (llvmorg-21-init-14652-geec9431d37e2) 2025-06-04T05:08:56 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 47
Performance Improvements 79 85
Added Tests 10 91
Unchanged Tests 984 869
Total Tests 1092

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 1.08% 2976.000 3008.000 - -74.76% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) (percentage) 128.21% 0.390 0.890 - 0.00% -
436.cactusADM (unexplained diff vs previous) 125.00% 8.000 18.000 - 0.00% -
410.bwaves (unexplained diff vs previous) 75.00% 4.000 7.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 66.67% 0.090 0.150 - 0.00% -
429.mcf (unexplained diff vs previous) 62.50% 8.000 13.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 59.26% 0.540 0.860 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 57.14% 0.070 0.110 - 0.00% -
401.bzip2 (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 38.46% 2.860 3.960 - 0.00% -
462.libquantum (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 27.40% 0.730 0.930 - 0.00% -
450.soplex (unexplained diff vs previous) 25.00% 4.000 5.000 - 0.00% -
436.cactusADM (max) (percentage) 21.92% 0.730 0.890 - 0.00% -
436.cactusADM (max) 21.43% 14.000 17.000 - 0.00% -
400.perlbench 1.96% 51.000 52.000 - -7.14% -
400.perlbench (avg) 1.96% 51.000 52.000 - -7.14% -
471.omnetpp 1.75% 57.000 58.000 - -18.31% -
471.omnetpp (avg) 1.75% 57.000 58.000 - -18.31% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -6.76% 74.000 69.000 - -99.32% -
462.libquantum -3.81% 105.000 101.000 - -98.95% -
435.gromacs -1.22% 4278.000 4226.000 - 0.00% -
481.wrf -1.19% 3273.000 3234.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) -82.22% 45.000 8.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -81.71% 0.820 0.150 - 0.00% -
453.povray (max) (percentage) -70.30% 2.020 0.600 - -43.40% -
453.povray (max) -70.00% 10.000 3.000 - -96.10% -
470.lbm (unexplained diff vs previous) (percentage) -67.57% 0.370 0.120 - 0.00% -
470.lbm (unexplained diff vs previous) -66.67% 12.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) -50.00% 6.000 3.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -50.00% 0.900 0.450 0.000 0.00% 0.000
435.gromacs (max) -36.04% 197.000 126.000 - 0.00% -
435.gromacs (max) (percentage) -34.92% 4.610 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -33.33% 3.000 2.000 - -98.77% -
482.sphinx3 (unexplained diff vs previous) (percentage) -33.33% 0.360 0.240 - -64.71% -
445.gobmk (max) -23.21% 56.000 43.000 - -38.57% -
445.gobmk (max) (percentage) -22.33% 1.030 0.800 - 33.33% -
473.astar (max) (percentage) -22.31% 3.630 2.820 - 3425.00% -
473.astar (max) -22.04% 186.000 145.000 - 1350.00% -
462.libquantum (max) -20.00% 5.000 4.000 - 33.33% -
433.milc (max) -12.50% 24.000 21.000 - -92.19% -
464.h264ref (max) -12.50% 72.000 63.000 - 96.88% -
464.h264ref (max) (percentage) -12.27% 1.630 1.430 - 429.63% -
410.bwaves (max) (percentage) -11.36% 1.760 1.560 - 0.00% -
410.bwaves (max) -11.25% 80.000 71.000 - 0.00% -
447.dealII (max) -10.53% 19.000 17.000 - -86.51% -
482.sphinx3 (max) (percentage) -10.00% 2.600 2.340 - 239.13% -
456.hmmer (unexplained diff vs previous) -10.00% 10.000 9.000 - 0.00% -
447.dealII (max) (percentage) -10.00% 1.000 0.900 - -35.25% -
462.libquantum (max) (percentage) -9.98% 5.210 4.690 - 11625.00% -
433.milc (max) (percentage) -9.84% 1.930 1.740 - -5.95% -
470.lbm (max) (percentage) -9.72% 1.440 1.300 - 2066.67% -
482.sphinx3 (max) -9.52% 21.000 19.000 - -88.41% -
456.hmmer (max) (percentage) -8.82% 0.340 0.310 - -58.67% -
456.hmmer (unexplained diff vs previous) (percentage) -8.82% 0.340 0.310 - 0.00% -
470.lbm (max) -8.70% 46.000 42.000 - 600.00% -
401.bzip2 (max) -8.00% 25.000 23.000 - 283.33% -
444.namd (max) (percentage) -7.87% 0.890 0.820 - -84.17% -
401.bzip2 (max) (percentage) -7.53% 0.930 0.860 - 1620.00% -
429.mcf (max) (percentage) -7.37% 15.340 14.210 - 3847.22% -
450.soplex (max) -6.67% 30.000 28.000 - -81.70% -
429.mcf (max) -6.55% 229.000 214.000 - 214.71% -
436.cactusADM -5.88% 17.000 16.000 - 0.00% -
436.cactusADM (avg) -5.88% 17.000 16.000 - 0.00% -
450.soplex (max) (percentage) -5.84% 5.650 5.320 - 383.64% -
471.omnetpp (max) (percentage) -4.32% 3.470 3.320 - 232.00% -
471.omnetpp (max) -3.88% 103.000 99.000 - -16.81% -
434.zeusmp (max) -3.12% 32.000 31.000 - 0.00% -
435.gromacs -3.10% 129.000 125.000 - 0.00% -
435.gromacs (avg) -3.10% 129.000 125.000 - 0.00% -
470.lbm -2.86% 35.000 34.000 - -46.88% -
470.lbm (avg) -2.86% 35.000 34.000 - -46.88% -
464.h264ref -2.38% 42.000 41.000 - -6.82% -
464.h264ref (avg) -2.38% 42.000 41.000 - -6.82% -
445.gobmk -2.33% 43.000 42.000 - 13.51% -
445.gobmk (avg) -2.33% 43.000 42.000 - 13.51% -
437.leslie3d (max) -2.17% 277.000 271.000 - 0.00% -
464.h264ref (avg) (percentage) -2.08% 0.960 0.940 - 154.05% -
410.bwaves -2.00% 50.000 49.000 - 0.00% -
410.bwaves (avg) -2.00% 50.000 49.000 - 0.00% -
437.leslie3d (max) (percentage) -1.86% 1.610 1.580 - 0.00% -
434.zeusmp (max) (percentage) -1.79% 1.680 1.650 - 0.00% -
481.wrf -1.69% 59.000 58.000 - 0.00% -
481.wrf (avg) -1.69% 59.000 58.000 - 0.00% -
435.gromacs (avg) (percentage) -1.66% 3.020 2.970 - 0.00% -
481.wrf (max) -1.55% 129.000 127.000 - 0.00% -
453.povray (avg) (percentage) -1.54% 1.300 1.280 - 75.34% -
450.soplex (avg) (percentage) -1.29% 3.100 3.060 - 466.67% -
444.namd (avg) (percentage) -1.28% 0.780 0.770 - -66.23% -
445.gobmk (avg) (percentage) -1.27% 0.790 0.780 - 143.75% -
401.bzip2 (avg) (percentage) -1.11% 0.900 0.890 - 790.00% -
473.astar (avg) (percentage) -1.10% 1.820 1.800 - 2471.43% -
473.astar -1.08% 93.000 92.000 - 922.22% -
473.astar (avg) -1.08% 93.000 92.000 - 922.22% -
429.mcf (avg) (percentage) -1.03% 6.810 6.740 - 1721.62% -
481.wrf (max) (percentage) -1.01% 3.970 3.930 - 0.00% -
482.sphinx3 (avg) (percentage) -1.00% 2.000 1.980 - 117.58% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 9.68% 31.000 34.000 - 78.95% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 11625.00% 0.040 4.690 - -9.98% -
429.mcf (max) (percentage) 3847.22% 0.360 14.210 - -7.37% -
473.astar (max) (percentage) 3425.00% 0.080 2.820 - -22.31% -
462.libquantum (avg) (percentage) 2481.82% 0.110 2.840 - 0.35% -
473.astar (avg) (percentage) 2471.43% 0.070 1.800 - -1.10% -
433.milc (unexplained diff vs previous) (percentage) 2300.00% 0.020 0.480 - 0.00% -
470.lbm (max) (percentage) 2066.67% 0.060 1.300 - -9.72% -
429.mcf (avg) (percentage) 1721.62% 0.370 6.740 - -1.03% -
401.bzip2 (max) (percentage) 1620.00% 0.050 0.860 - -7.53% -
473.astar (max) 1350.00% 10.000 145.000 - -22.04% -
473.astar 922.22% 9.000 92.000 - -1.08% -
473.astar (avg) 922.22% 9.000 92.000 - -1.08% -
401.bzip2 (avg) (percentage) 790.00% 0.100 0.890 - -1.11% -
403.gcc (avg) (percentage) 729.03% 0.310 2.570 - 0.00% -
403.gcc (max) (percentage) 705.00% 0.400 3.220 - -0.62% -
470.lbm (max) 600.00% 6.000 42.000 - -8.70% -
450.soplex (avg) (percentage) 466.67% 0.540 3.060 - -1.29% -
464.h264ref (max) (percentage) 429.63% 0.270 1.430 - -12.27% -
400.perlbench (avg) (percentage) 419.61% 0.510 2.650 - 0.00% -
450.soplex (max) (percentage) 383.64% 1.100 5.320 - -5.84% -
400.perlbench (max) (percentage) 380.00% 0.700 3.360 - -0.30% -
401.bzip2 (max) 283.33% 6.000 23.000 - -8.00% -
482.sphinx3 (max) (percentage) 239.13% 0.690 2.340 - -10.00% -
471.omnetpp (max) (percentage) 232.00% 1.000 3.320 - -4.32% -
471.omnetpp (avg) (percentage) 221.67% 0.600 1.930 - 0.00% -
429.mcf (max) 214.71% 68.000 214.000 - -6.55% -
464.h264ref (avg) (percentage) 154.05% 0.370 0.940 - -2.08% -
445.gobmk (avg) (percentage) 143.75% 0.320 0.780 - -1.27% -
458.sjeng (avg) (percentage) 134.78% 0.230 0.540 - 0.00% -
482.sphinx3 (avg) (percentage) 117.58% 0.910 1.980 - -1.00% -
433.milc (unexplained diff vs previous) 100.00% 3.000 6.000 - 0.00% -
464.h264ref (max) 96.88% 32.000 63.000 - -12.50% -
470.lbm (avg) (percentage) 86.21% 0.580 1.080 - -0.92% -
401.bzip2 84.62% 13.000 24.000 - 0.00% -
401.bzip2 (avg) 84.62% 13.000 24.000 - 0.00% -
453.povray (avg) (percentage) 75.34% 0.730 1.280 - -1.54% -
458.sjeng (max) (percentage) 56.52% 0.230 0.360 - 0.00% -
429.mcf 46.38% 69.000 101.000 - 0.00% -
429.mcf (avg) 46.38% 69.000 101.000 - 0.00% -
445.gobmk (max) (percentage) 33.33% 0.600 0.800 - -22.33% -
462.libquantum (max) 33.33% 3.000 4.000 - -20.00% -
433.milc (avg) (percentage) 28.92% 0.830 1.070 - 0.00% -
458.sjeng 14.29% 35.000 40.000 - 0.00% -
458.sjeng (avg) 14.29% 35.000 40.000 - 0.00% -
445.gobmk 13.51% 37.000 42.000 - -2.33% -
445.gobmk (avg) 13.51% 37.000 42.000 - -2.33% -
447.dealII (avg) (percentage) 5.49% 0.910 0.960 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -6.03% 143421.000 134775.000 - 0.00% -
464.h264ref -3.78% 399974.000 384843.000 - 0.00% -
447.dealII -3.13% 325219.000 315034.000 - 0.01% -
403.gcc -2.93% 2486993.000 2414021.000 - 0.00% -
453.povray -2.86% 691522.000 671739.000 - 0.00% -
482.sphinx3 -2.21% 120254.000 117601.000 - 0.00% -
462.libquantum -1.98% 16989.000 16652.000 - 0.00% -
400.perlbench -1.92% 900243.000 882994.000 - 0.00% -
456.hmmer -1.74% 113613.000 111632.000 - 0.00% -
471.omnetpp -1.69% 490147.000 481844.000 - -0.01% -
470.lbm -1.64% 10313.000 10144.000 - 0.00% -
458.sjeng -1.62% 106872.000 105140.000 - 0.01% -
445.gobmk -1.57% 1850383.000 1821251.000 - 0.00% -
401.bzip2 -1.49% 44357.000 43696.000 - 0.00% -
450.soplex -1.29% 224407.000 221510.000 - 0.00% -
433.milc -1.27% 62863.000 62066.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.32% 10150.000 69.000 - -6.76% -
462.libquantum -98.95% 9659.000 101.000 - -3.81% -
482.sphinx3 -96.53% 23779.000 824.000 - 0.24% -
450.soplex -96.14% 13988.000 540.000 - -0.92% -
453.povray -92.99% 7301.000 512.000 - -0.58% -
444.namd -92.82% 9377.000 673.000 - 0.45% -
429.mcf -92.02% 18905.000 1508.000 - 0.87% -
433.milc -91.43% 14590.000 1250.000 - 0.48% -
400.perlbench -82.26% 11085.000 1967.000 - 0.31% -
401.bzip2 -80.39% 13962.000 2738.000 - -0.11% -
447.dealII -78.74% 9102.000 1935.000 - -0.67% -
471.omnetpp -74.76% 11917.000 3008.000 - 1.08% -
470.lbm -70.69% 11046.000 3238.000 - -0.12% -
456.hmmer -67.91% 9122.000 2927.000 - -0.31% -
464.h264ref -63.56% 12142.000 4425.000 - -0.16% -
473.astar -61.32% 13301.000 5145.000 - 0.35% -
445.gobmk -52.91% 11668.000 5494.000 - 0.15% -
458.sjeng -50.87% 15282.000 7508.000 - 0.05% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -98.97% 485.000 5.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -98.77% 162.000 2.000 - -33.33% -
444.namd -97.65% 213.000 5.000 - 0.00% -
444.namd (avg) -97.65% 213.000 5.000 - 0.00% -
403.gcc -96.77% 31.000 1.000 - 0.00% -
403.gcc (avg) -96.77% 31.000 1.000 - 0.00% -
453.povray (max) -96.10% 77.000 3.000 - -70.00% -
403.gcc (max) -95.00% 40.000 2.000 - 0.00% -
482.sphinx3 -92.59% 216.000 16.000 - 0.00% -
482.sphinx3 (avg) -92.59% 216.000 16.000 - 0.00% -
433.milc (max) -92.19% 269.000 21.000 - -12.50% -
433.milc -89.26% 121.000 13.000 - 0.00% -
433.milc (avg) -89.26% 121.000 13.000 - 0.00% -
453.povray -88.68% 53.000 6.000 - 0.00% -
453.povray (avg) -88.68% 53.000 6.000 - 0.00% -
482.sphinx3 (max) -88.41% 164.000 19.000 - -9.52% -
456.hmmer (max) -86.76% 68.000 9.000 - 0.00% -
447.dealII (max) -86.51% 126.000 17.000 - -10.53% -
456.hmmer -86.25% 80.000 11.000 - 0.00% -
456.hmmer (avg) -86.25% 80.000 11.000 - 0.00% -
444.namd (max) (percentage) -84.17% 5.180 0.820 - -7.87% -
450.soplex (max) -81.70% 153.000 28.000 - -6.67% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
450.soplex -78.67% 75.000 16.000 - 0.00% -
450.soplex (avg) -78.67% 75.000 16.000 - 0.00% -
447.dealII -78.05% 82.000 18.000 - 0.00% -
447.dealII (avg) -78.05% 82.000 18.000 - 0.00% -
444.namd (avg) (percentage) -66.23% 2.280 0.770 - -1.28% -
482.sphinx3 (unexplained diff vs previous) (percentage) -64.71% 0.680 0.240 - -33.33% -
456.hmmer (max) (percentage) -58.67% 0.750 0.310 - -8.82% -
456.hmmer (avg) (percentage) -55.68% 0.880 0.390 - 0.00% -
470.lbm -46.88% 64.000 34.000 - -2.86% -
470.lbm (avg) -46.88% 64.000 34.000 - -2.86% -
453.povray (max) (percentage) -43.40% 1.060 0.600 - -70.30% -
445.gobmk (max) -38.57% 70.000 43.000 - -23.21% -
447.dealII (max) (percentage) -35.25% 1.390 0.900 - -10.00% -
483.xalancbmk (max) (percentage) -27.45% 0.510 0.370 - 0.00% -
458.sjeng (max) -22.86% 35.000 27.000 - 0.00% -
471.omnetpp -18.31% 71.000 58.000 - 1.75% -
471.omnetpp (avg) -18.31% 71.000 58.000 - 1.75% -
471.omnetpp (max) -16.81% 119.000 99.000 - -3.88% -
400.perlbench (max) -14.29% 77.000 66.000 - 0.00% -
400.perlbench -7.14% 56.000 52.000 - 1.96% -
400.perlbench (avg) -7.14% 56.000 52.000 - 1.96% -
464.h264ref -6.82% 44.000 41.000 - -2.38% -
464.h264ref (avg) -6.82% 44.000 41.000 - -2.38% -
433.milc (max) (percentage) -5.95% 1.850 1.740 - -9.84% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 78.95% 19.000 34.000 - 9.68% -
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 42.11% 19.000 27.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1967.000 -
401.bzip2 2738.000 -
403.gcc 69.000 -6.76%
410.bwaves 4584.000 -
416.gamess 11908.000 -
429.mcf 1508.000 -
433.milc 1250.000 -
434.zeusmp 1908.000 -
435.gromacs 4226.000 -1.22%
436.cactusADM 2014.000 -
437.leslie3d 17209.000 -
444.namd 673.000 -
445.gobmk 5494.000 -
447.dealII 1935.000 -
450.soplex 540.000 -
453.povray 512.000 -
456.hmmer 2927.000 -
458.sjeng 7508.000 -
459.GemsFDTD 6835.000 -
462.libquantum 101.000 -3.81%
464.h264ref 4425.000 -
465.tonto 28844.000 -
470.lbm 3238.000 -
471.omnetpp 3008.000 1.08%
473.astar 5145.000 -
481.wrf 3234.000 -1.19%
482.sphinx3 824.000 -
Geometric Mean 2294.316 -
Name Current %
400.perlbench 882994.000 -
401.bzip2 43696.000 -
403.gcc 2414021.000 -
410.bwaves 796765.000 -
416.gamess 7564059.000 -
429.mcf 9204.000 -
433.milc 62066.000 -
434.zeusmp 1159880.000 -
435.gromacs 498530.000 -
436.cactusADM 1161401.000 -
437.leslie3d 1036413.000 -
444.namd 134775.000 -
445.gobmk 1821251.000 -
447.dealII 315034.000 -
450.soplex 221510.000 -
453.povray 671739.000 -
456.hmmer 111632.000 -
458.sjeng 105140.000 -
459.GemsFDTD 2468555.000 -
462.libquantum 16652.000 -
464.h264ref 384843.000 -
465.tonto 9506592.000 -
470.lbm 10144.000 -
471.omnetpp 481844.000 -
473.astar 23628.000 -
481.wrf 6715784.000 -
482.sphinx3 117601.000 -
Geometric Mean 347815.781 -
Name Current %
nb_compile_successful 27.000 -
nb_execution_successful 27.000 -
nb_total_tests 34.000 9.68%
Geometric Mean 29.157 3.13%
Name Current %
400.perlbench 52.000 1.96%
400.perlbench (avg) 52.000 1.96%
400.perlbench (avg) (percentage) 2.650 -
400.perlbench (max) 66.000 -
400.perlbench (max) (percentage) 3.360 -
401.bzip2 24.000 -
401.bzip2 (avg) 24.000 -
401.bzip2 (avg) (percentage) 0.890 -1.11%
401.bzip2 (max) 23.000 -8.00%
401.bzip2 (max) (percentage) 0.860 -7.53%
401.bzip2 (unexplained diff vs previous) 3.000 50.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 57.14%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.570 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.220 -
410.bwaves 49.000 -2.00%
410.bwaves (avg) 49.000 -2.00%
410.bwaves (avg) (percentage) 1.090 -
410.bwaves (max) 71.000 -11.25%
410.bwaves (max) (percentage) 1.560 -11.36%
410.bwaves (unexplained diff vs previous) 7.000 75.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.150 66.67%
416.gamess 15.000 -
416.gamess (avg) 15.000 -
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) 32.000 -
416.gamess (max) (percentage) 0.270 -
429.mcf 101.000 -
429.mcf (avg) 101.000 -
429.mcf (avg) (percentage) 6.740 -1.03%
429.mcf (max) 214.000 -6.55%
429.mcf (max) (percentage) 14.210 -7.37%
429.mcf (unexplained diff vs previous) 13.000 62.50%
429.mcf (unexplained diff vs previous) (percentage) 0.860 59.26%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.070 -
433.milc (max) 21.000 -12.50%
433.milc (max) (percentage) 1.740 -9.84%
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.480 -
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.000 -
434.zeusmp (max) 31.000 -3.12%
434.zeusmp (max) (percentage) 1.650 -1.79%
435.gromacs 125.000 -3.10%
435.gromacs (avg) 125.000 -3.10%
435.gromacs (avg) (percentage) 2.970 -1.66%
435.gromacs (max) 126.000 -36.04%
435.gromacs (max) (percentage) 3.000 -34.92%
435.gromacs (unexplained diff vs previous) 52.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.230 -
436.cactusADM 16.000 -5.88%
436.cactusADM (avg) 16.000 -5.88%
436.cactusADM (avg) (percentage) 0.840 -
436.cactusADM (max) 17.000 21.43%
436.cactusADM (max) (percentage) 0.890 21.92%
436.cactusADM (unexplained diff vs previous) 18.000 125.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.890 128.21%
437.leslie3d 197.000 -
437.leslie3d (avg) 197.000 -
437.leslie3d (avg) (percentage) 1.150 -
437.leslie3d (max) 271.000 -2.17%
437.leslie3d (max) (percentage) 1.580 -1.86%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.770 -1.28%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.820 -7.87%
444.namd (unexplained diff vs previous) 3.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.450 -50.00%
445.gobmk 42.000 -2.33%
445.gobmk (avg) 42.000 -2.33%
445.gobmk (avg) (percentage) 0.780 -1.27%
445.gobmk (max) 43.000 -23.21%
445.gobmk (max) (percentage) 0.800 -22.33%
445.gobmk (unexplained diff vs previous) 8.000 -82.22%
445.gobmk (unexplained diff vs previous) (percentage) 0.150 -81.71%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 0.960 -
447.dealII (max) 17.000 -10.53%
447.dealII (max) (percentage) 0.900 -10.00%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 3.060 -1.29%
450.soplex (max) 28.000 -6.67%
450.soplex (max) (percentage) 5.320 -5.84%
450.soplex (unexplained diff vs previous) 5.000 25.00%
450.soplex (unexplained diff vs previous) (percentage) 0.930 27.40%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.280 -1.54%
453.povray (max) 3.000 -70.00%
453.povray (max) (percentage) 0.600 -70.30%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.590 -
456.hmmer 11.000 -
456.hmmer (avg) 11.000 -
456.hmmer (avg) (percentage) 0.390 -
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.310 -8.82%
456.hmmer (unexplained diff vs previous) 9.000 -10.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 -8.82%
458.sjeng 40.000 -
458.sjeng (avg) 40.000 -
458.sjeng (avg) (percentage) 0.540 -
458.sjeng (max) 27.000 -
458.sjeng (max) (percentage) 0.360 -
459.GemsFDTD 63.000 -
459.GemsFDTD (avg) 63.000 -
459.GemsFDTD (avg) (percentage) 0.930 -
459.GemsFDTD (max) 71.000 -
459.GemsFDTD (max) (percentage) 1.040 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.840 -
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 4.690 -9.98%
462.libquantum (unexplained diff vs previous) 4.000 33.33%
462.libquantum (unexplained diff vs previous) (percentage) 3.960 38.46%
464.h264ref 41.000 -2.38%
464.h264ref (avg) 41.000 -2.38%
464.h264ref (avg) (percentage) 0.940 -2.08%
464.h264ref (max) 63.000 -12.50%
464.h264ref (max) (percentage) 1.430 -12.27%
464.h264ref (unexplained diff vs previous) 7.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.160 -
465.tonto 95.000 -
465.tonto (avg) 95.000 -
465.tonto (avg) (percentage) 0.330 -
465.tonto (max) 86.000 -
465.tonto (max) (percentage) 0.300 -
470.lbm 34.000 -2.86%
470.lbm (avg) 34.000 -2.86%
470.lbm (avg) (percentage) 1.080 -
470.lbm (max) 42.000 -8.70%
470.lbm (max) (percentage) 1.300 -9.72%
470.lbm (unexplained diff vs previous) 4.000 -66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.120 -67.57%
471.omnetpp 58.000 1.75%
471.omnetpp (avg) 58.000 1.75%
471.omnetpp (avg) (percentage) 1.930 -
471.omnetpp (max) 99.000 -3.88%
471.omnetpp (max) (percentage) 3.320 -4.32%
473.astar 92.000 -1.08%
473.astar (avg) 92.000 -1.08%
473.astar (avg) (percentage) 1.800 -1.10%
473.astar (max) 145.000 -22.04%
473.astar (max) (percentage) 2.820 -22.31%
473.astar (unexplained diff vs previous) 18.000 -
473.astar (unexplained diff vs previous) (percentage) 0.350 -
481.wrf 58.000 -1.69%
481.wrf (avg) 58.000 -1.69%
481.wrf (avg) (percentage) 1.810 -
481.wrf (max) 127.000 -1.55%
481.wrf (max) (percentage) 3.930 -1.01%
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 1.980 -1.00%
482.sphinx3 (max) 19.000 -9.52%
482.sphinx3 (max) (percentage) 2.340 -10.00%
482.sphinx3 (unexplained diff vs previous) 2.000 -33.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.240 -33.33%
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) (percentage) 0.370 -
Geometric Mean 5.867 -11.46%