Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/eec9431d37e22a627c78e2f345d41a9a40e0c1c0 (+ 407 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/345/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0345 (llvmorg-21-init-14652-geec9431d37e2) 2025-06-04T05:08:56 0:00:00
Previous 0344 (llvmorg-21-init-14245-g11a9dad1a5d1) 2025-06-01T02:22:13 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 47
Performance Improvements 75 83
Added Tests 6 87
Unchanged Tests 975 851
Total Tests 1068

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.94% 102.000 105.000 - -98.91% -
437.leslie3d 1.80% 16957.000 17263.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 42.86% 7.000 10.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 41.67% 0.240 0.340 - 0.00% -
456.hmmer (max) (percentage) 13.33% 0.300 0.340 - -54.67% -
456.hmmer (max) 12.50% 8.000 9.000 - -86.76% -
481.wrf 1.72% 58.000 59.000 - 0.00% -
481.wrf (avg) 1.72% 58.000 59.000 - 0.00% -
437.leslie3d 1.54% 195.000 198.000 - 0.00% -
437.leslie3d (avg) 1.54% 195.000 198.000 - 0.00% -
444.namd (avg) (percentage) 1.30% 0.770 0.780 - -65.79% -
444.namd (unexplained diff vs previous) (percentage) 1.12% 0.890 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -3.21% 2026.000 1961.000 - -82.31% -
453.povray -1.34% 522.000 515.000 - -92.95% -
471.omnetpp -1.16% 3011.000 2976.000 - -75.03% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -97.41% 309.000 8.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -97.37% 20.560 0.540 - 0.00% -
410.bwaves (unexplained diff vs previous) -96.19% 105.000 4.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -96.07% 2.290 0.090 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -93.14% 1.020 0.070 - 0.00% -
401.bzip2 (unexplained diff vs previous) -92.86% 28.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -88.12% 3.030 0.360 - -47.06% -
482.sphinx3 (unexplained diff vs previous) -88.00% 25.000 3.000 - -98.15% -
450.soplex (unexplained diff vs previous) (percentage) -87.26% 5.730 0.730 - 0.00% -
450.soplex (unexplained diff vs previous) -87.10% 31.000 4.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -78.24% 1.700 0.370 - 0.00% -
470.lbm (unexplained diff vs previous) -78.18% 55.000 12.000 - 0.00% -
401.bzip2 (max) -76.64% 107.000 25.000 - 316.67% -
401.bzip2 (max) (percentage) -76.40% 3.940 0.930 - 1760.00% -
447.dealII (unexplained diff vs previous) (percentage) -61.34% 1.190 0.460 - 0.00% -
447.dealII (unexplained diff vs previous) -60.87% 23.000 9.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -51.36% 5.880 2.860 - 0.00% -
462.libquantum (unexplained diff vs previous) -50.00% 6.000 3.000 - 0.00% -
447.dealII (max) -38.71% 31.000 19.000 - -84.92% -
447.dealII (max) (percentage) -38.65% 1.630 1.000 - -28.06% -
410.bwaves (max) -25.23% 107.000 80.000 - 0.00% -
410.bwaves (max) (percentage) -24.79% 2.340 1.760 - 0.00% -
470.lbm (max) (percentage) -16.76% 1.730 1.440 - 2300.00% -
444.namd (max) -16.67% 6.000 5.000 - -98.97% -
462.libquantum (max) -16.67% 6.000 5.000 - 66.67% -
482.sphinx3 (max) (percentage) -16.67% 3.120 2.600 - 276.81% -
462.libquantum (max) (percentage) -16.64% 6.250 5.210 - 12925.00% -
470.lbm (max) -16.36% 55.000 46.000 - 666.67% -
482.sphinx3 (max) -16.00% 25.000 21.000 - -87.20% -
436.cactusADM (max) -12.50% 16.000 14.000 - 0.00% -
436.cactusADM (max) (percentage) -12.05% 0.830 0.730 - 0.00% -
429.mcf (max) -10.55% 256.000 229.000 - 236.76% -
429.mcf (max) (percentage) -10.03% 17.050 15.340 - 4161.11% -
450.soplex (max) (percentage) -7.07% 6.080 5.650 - 413.64% -
450.soplex (max) -6.25% 32.000 30.000 - -80.39% -
471.omnetpp (max) -5.50% 109.000 103.000 - -13.45% -
464.h264ref (max) -5.26% 76.000 72.000 - 125.00% -
464.h264ref (max) (percentage) -5.23% 1.720 1.630 - 503.70% -
471.omnetpp (max) (percentage) -4.93% 3.650 3.470 - 247.00% -
433.milc (max) (percentage) -4.93% 2.030 1.930 - 4.32% -
433.milc (max) -4.00% 25.000 24.000 - -91.08% -
400.perlbench -3.77% 53.000 51.000 - -8.93% -
400.perlbench (avg) -3.77% 53.000 51.000 - -8.93% -
416.gamess (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
465.tonto (max) -3.37% 89.000 86.000 - 0.00% -
465.tonto (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
416.gamess (max) -3.03% 33.000 32.000 - 0.00% -
400.perlbench (max) -2.94% 68.000 66.000 - -14.29% -
434.zeusmp (max) (percentage) -2.89% 1.730 1.680 - 0.00% -
473.astar (max) (percentage) -2.68% 3.730 3.630 - 4437.50% -
458.sjeng -2.44% 41.000 40.000 - 14.29% -
458.sjeng (avg) -2.44% 41.000 40.000 - 14.29% -
437.leslie3d (max) (percentage) -2.42% 1.650 1.610 - 0.00% -
473.astar (max) -2.11% 190.000 186.000 - 1760.00% -
410.bwaves -1.96% 51.000 50.000 - 0.00% -
410.bwaves (avg) -1.96% 51.000 50.000 - 0.00% -
429.mcf -1.94% 103.000 101.000 - 46.38% -
429.mcf (avg) -1.94% 103.000 101.000 - 46.38% -
458.sjeng (avg) (percentage) -1.82% 0.550 0.540 - 134.78% -
445.gobmk (max) -1.75% 57.000 56.000 - -20.00% -
471.omnetpp -1.72% 58.000 57.000 - -19.72% -
471.omnetpp (avg) -1.72% 58.000 57.000 - -19.72% -
482.sphinx3 (avg) (percentage) -1.48% 2.030 2.000 - 119.78% -
453.povray (max) (percentage) -1.46% 2.050 2.020 - 90.57% -
459.GemsFDTD (max) -1.39% 72.000 71.000 - 0.00% -
481.wrf (max) (percentage) -1.24% 4.020 3.970 - 0.00% -
436.cactusADM (avg) (percentage) -1.18% 0.850 0.840 - 0.00% -
444.namd (max) (percentage) -1.11% 0.900 0.890 - -82.82% -
401.bzip2 (avg) (percentage) -1.10% 0.910 0.900 - 800.00% -
435.gromacs (max) (percentage) -1.07% 4.660 4.610 - 0.00% -
447.dealII (avg) (percentage) -1.03% 0.970 0.960 - 5.49% -
429.mcf (avg) (percentage) -1.02% 6.880 6.810 - 1740.54% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 12925.00% 0.040 5.210 - -16.64% -
473.astar (max) (percentage) 4437.50% 0.080 3.630 - -2.68% -
429.mcf (max) (percentage) 4161.11% 0.360 15.340 - -10.03% -
473.astar (avg) (percentage) 2500.00% 0.070 1.820 - 0.00% -
462.libquantum (avg) (percentage) 2472.73% 0.110 2.830 - 0.00% -
470.lbm (max) (percentage) 2300.00% 0.060 1.440 - -16.76% -
473.astar (max) 1760.00% 10.000 186.000 - -2.11% -
401.bzip2 (max) (percentage) 1760.00% 0.050 0.930 - -76.40% -
429.mcf (avg) (percentage) 1740.54% 0.370 6.810 - -1.02% -
473.astar 933.33% 9.000 93.000 - 0.00% -
473.astar (avg) 933.33% 9.000 93.000 - 0.00% -
401.bzip2 (avg) (percentage) 800.00% 0.100 0.900 - -1.10% -
403.gcc (avg) (percentage) 729.03% 0.310 2.570 - 0.00% -
403.gcc (max) (percentage) 710.00% 0.400 3.240 - -0.61% -
470.lbm (max) 666.67% 6.000 46.000 - -16.36% -
464.h264ref (max) (percentage) 503.70% 0.270 1.630 - -5.23% -
450.soplex (avg) (percentage) 474.07% 0.540 3.100 - -0.96% -
400.perlbench (avg) (percentage) 419.61% 0.510 2.650 - 0.00% -
450.soplex (max) (percentage) 413.64% 1.100 5.650 - -7.07% -
400.perlbench (max) (percentage) 381.43% 0.700 3.370 - -0.30% -
401.bzip2 (max) 316.67% 6.000 25.000 - -76.64% -
482.sphinx3 (max) (percentage) 276.81% 0.690 2.600 - -16.67% -
471.omnetpp (max) (percentage) 247.00% 1.000 3.470 - -4.93% -
429.mcf (max) 236.76% 68.000 229.000 - -10.55% -
471.omnetpp (avg) (percentage) 221.67% 0.600 1.930 - 0.00% -
464.h264ref (avg) (percentage) 159.46% 0.370 0.960 - 0.00% -
445.gobmk (avg) (percentage) 146.88% 0.320 0.790 - 0.00% -
458.sjeng (avg) (percentage) 134.78% 0.230 0.540 - -1.82% -
464.h264ref (max) 125.00% 32.000 72.000 - -5.26% -
482.sphinx3 (avg) (percentage) 119.78% 0.910 2.000 - -1.48% -
453.povray (max) (percentage) 90.57% 1.060 2.020 - -1.46% -
470.lbm (avg) (percentage) 87.93% 0.580 1.090 - -0.91% -
401.bzip2 84.62% 13.000 24.000 - 0.00% -
401.bzip2 (avg) 84.62% 13.000 24.000 - 0.00% -
453.povray (avg) (percentage) 78.08% 0.730 1.300 - 0.00% -
445.gobmk (max) (percentage) 71.67% 0.600 1.030 - -0.96% -
462.libquantum (max) 66.67% 3.000 5.000 - -16.67% -
458.sjeng (max) (percentage) 56.52% 0.230 0.360 - 0.00% -
429.mcf 46.38% 69.000 101.000 - -1.94% -
429.mcf (avg) 46.38% 69.000 101.000 - -1.94% -
433.milc (avg) (percentage) 28.92% 0.830 1.070 - 0.00% -
445.gobmk 16.22% 37.000 43.000 - 0.00% -
445.gobmk (avg) 16.22% 37.000 43.000 - 0.00% -
458.sjeng 14.29% 35.000 40.000 - -2.44% -
458.sjeng (avg) 14.29% 35.000 40.000 - -2.44% -
447.dealII (avg) (percentage) 5.49% 0.910 0.960 - -1.03% -
433.milc (max) (percentage) 4.32% 1.850 1.930 - -4.93% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -6.03% 143421.000 134775.000 - 0.00% -
464.h264ref -3.78% 399974.000 384843.000 - -0.00% -
447.dealII -3.14% 325219.000 315014.000 - 0.00% -
403.gcc -2.93% 2486993.000 2414009.000 - -0.01% -
453.povray -2.86% 691522.000 671739.000 - -0.00% -
482.sphinx3 -2.21% 120254.000 117601.000 - 0.00% -
462.libquantum -1.98% 16989.000 16652.000 - 0.00% -
400.perlbench -1.92% 900243.000 882994.000 - 0.00% -
456.hmmer -1.74% 113613.000 111632.000 - 0.00% -
471.omnetpp -1.68% 490147.000 481912.000 - -0.00% -
470.lbm -1.64% 10313.000 10144.000 - 0.00% -
458.sjeng -1.63% 106872.000 105132.000 - 0.00% -
445.gobmk -1.57% 1850383.000 1821251.000 - 0.00% -
401.bzip2 -1.49% 44357.000 43696.000 - 0.00% -
450.soplex -1.29% 224407.000 221510.000 - 0.00% -
433.milc -1.27% 62863.000 62066.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.27% 10150.000 74.000 - 0.00% -
462.libquantum -98.91% 9659.000 105.000 - 2.94% -
482.sphinx3 -96.54% 23779.000 822.000 - -0.36% -
450.soplex -96.10% 13988.000 545.000 - 0.74% -
453.povray -92.95% 7301.000 515.000 - -1.34% -
444.namd -92.85% 9377.000 670.000 - -0.89% -
429.mcf -92.09% 18905.000 1495.000 - -0.53% -
433.milc -91.47% 14590.000 1244.000 - -0.80% -
400.perlbench -82.31% 11085.000 1961.000 - -3.21% -
401.bzip2 -80.37% 13962.000 2741.000 - 0.07% -
447.dealII -78.60% 9102.000 1948.000 - 0.46% -
471.omnetpp -75.03% 11917.000 2976.000 - -1.16% -
470.lbm -70.65% 11046.000 3242.000 - 0.37% -
456.hmmer -67.81% 9122.000 2936.000 - 0.34% -
464.h264ref -63.50% 12142.000 4432.000 - -0.05% -
473.astar -61.45% 13301.000 5127.000 - 0.18% -
445.gobmk -52.98% 11668.000 5486.000 - -0.81% -
458.sjeng -50.90% 15282.000 7504.000 - 0.04% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -98.97% 485.000 5.000 - -16.67% -
482.sphinx3 (unexplained diff vs previous) -98.15% 162.000 3.000 - -88.00% -
444.namd -97.65% 213.000 5.000 - 0.00% -
444.namd (avg) -97.65% 213.000 5.000 - 0.00% -
403.gcc -96.77% 31.000 1.000 - 0.00% -
403.gcc (avg) -96.77% 31.000 1.000 - 0.00% -
403.gcc (max) -95.00% 40.000 2.000 - 0.00% -
482.sphinx3 -92.59% 216.000 16.000 - 0.00% -
482.sphinx3 (avg) -92.59% 216.000 16.000 - 0.00% -
433.milc (max) -91.08% 269.000 24.000 - -4.00% -
433.milc -89.26% 121.000 13.000 - 0.00% -
433.milc (avg) -89.26% 121.000 13.000 - 0.00% -
453.povray -88.68% 53.000 6.000 - 0.00% -
453.povray (avg) -88.68% 53.000 6.000 - 0.00% -
482.sphinx3 (max) -87.20% 164.000 21.000 - -16.00% -
453.povray (max) -87.01% 77.000 10.000 - 0.00% -
456.hmmer (max) -86.76% 68.000 9.000 - 12.50% -
456.hmmer -86.25% 80.000 11.000 - 0.00% -
456.hmmer (avg) -86.25% 80.000 11.000 - 0.00% -
447.dealII (max) -84.92% 126.000 19.000 - -38.71% -
444.namd (max) (percentage) -82.82% 5.180 0.890 - -1.11% -
450.soplex (max) -80.39% 153.000 30.000 - -6.25% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
450.soplex -78.67% 75.000 16.000 - 0.00% -
450.soplex (avg) -78.67% 75.000 16.000 - 0.00% -
447.dealII -78.05% 82.000 18.000 - 0.00% -
447.dealII (avg) -78.05% 82.000 18.000 - 0.00% -
444.namd (avg) (percentage) -65.79% 2.280 0.780 - 1.30% -
456.hmmer (avg) (percentage) -55.68% 0.880 0.390 - 0.00% -
456.hmmer (max) (percentage) -54.67% 0.750 0.340 - 13.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -47.06% 0.680 0.360 - -88.12% -
470.lbm -45.31% 64.000 35.000 - 0.00% -
470.lbm (avg) -45.31% 64.000 35.000 - 0.00% -
447.dealII (max) (percentage) -28.06% 1.390 1.000 - -38.65% -
483.xalancbmk (max) (percentage) -27.45% 0.510 0.370 - 0.00% -
458.sjeng (max) -22.86% 35.000 27.000 - 0.00% -
445.gobmk (max) -20.00% 70.000 56.000 - -1.75% -
471.omnetpp -19.72% 71.000 57.000 - -1.72% -
471.omnetpp (avg) -19.72% 71.000 57.000 - -1.72% -
400.perlbench (max) -14.29% 77.000 66.000 - -2.94% -
471.omnetpp (max) -13.45% 119.000 103.000 - -5.50% -
400.perlbench -8.93% 56.000 51.000 - -3.77% -
400.perlbench (avg) -8.93% 56.000 51.000 - -3.77% -
464.h264ref -4.55% 44.000 42.000 - 0.00% -
464.h264ref (avg) -4.55% 44.000 42.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 63.16% 19.000 31.000 - 0.00% -
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 42.11% 19.000 27.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1961.000 -3.21%
401.bzip2 2741.000 -
403.gcc 74.000 -
410.bwaves 4591.000 -
416.gamess 11925.000 -
429.mcf 1495.000 -
433.milc 1244.000 -
434.zeusmp 1920.000 -
435.gromacs 4278.000 -
436.cactusADM 2032.000 -
437.leslie3d 17263.000 1.80%
444.namd 670.000 -
445.gobmk 5486.000 -
447.dealII 1948.000 -
450.soplex 545.000 -
453.povray 515.000 -1.34%
456.hmmer 2936.000 -
458.sjeng 7504.000 -
459.GemsFDTD 6838.000 -
462.libquantum 105.000 2.94%
464.h264ref 4432.000 -
465.tonto 28950.000 -
470.lbm 3242.000 -
471.omnetpp 2976.000 -1.16%
473.astar 5127.000 -
481.wrf 3273.000 -
482.sphinx3 822.000 -
Geometric Mean 2306.884 -
Name Current %
400.perlbench 882994.000 -
401.bzip2 43696.000 -
403.gcc 2414009.000 -
410.bwaves 796733.000 -
416.gamess 7564071.000 -
429.mcf 9204.000 -
433.milc 62066.000 -
434.zeusmp 1159848.000 -
435.gromacs 498530.000 -
436.cactusADM 1161385.000 -
437.leslie3d 1036381.000 -
444.namd 134775.000 -
445.gobmk 1821251.000 -
447.dealII 315014.000 -
450.soplex 221510.000 -
453.povray 671739.000 -
456.hmmer 111632.000 -
458.sjeng 105132.000 -
459.GemsFDTD 2468523.000 -
462.libquantum 16652.000 -
464.h264ref 384843.000 -
465.tonto 9506560.000 -
470.lbm 10144.000 -
471.omnetpp 481912.000 -
473.astar 23628.000 -
481.wrf 6715796.000 -
482.sphinx3 117601.000 -
Geometric Mean 347814.121 -
Name Current %
400.perlbench 51.000 -3.77%
400.perlbench (avg) 51.000 -3.77%
400.perlbench (avg) (percentage) 2.650 -
400.perlbench (max) 66.000 -2.94%
400.perlbench (max) (percentage) 3.370 -
401.bzip2 24.000 -
401.bzip2 (avg) 24.000 -
401.bzip2 (avg) (percentage) 0.900 -1.10%
401.bzip2 (max) 25.000 -76.64%
401.bzip2 (max) (percentage) 0.930 -76.40%
401.bzip2 (unexplained diff vs previous) 2.000 -92.86%
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -93.14%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.570 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.240 -
410.bwaves 50.000 -1.96%
410.bwaves (avg) 50.000 -1.96%
410.bwaves (avg) (percentage) 1.100 -
410.bwaves (max) 80.000 -25.23%
410.bwaves (max) (percentage) 1.760 -24.79%
410.bwaves (unexplained diff vs previous) 4.000 -96.19%
410.bwaves (unexplained diff vs previous) (percentage) 0.090 -96.07%
416.gamess 15.000 -
416.gamess (avg) 15.000 -
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) 32.000 -3.03%
416.gamess (max) (percentage) 0.270 -3.57%
429.mcf 101.000 -1.94%
429.mcf (avg) 101.000 -1.94%
429.mcf (avg) (percentage) 6.810 -1.02%
429.mcf (max) 229.000 -10.55%
429.mcf (max) (percentage) 15.340 -10.03%
429.mcf (unexplained diff vs previous) 8.000 -97.41%
429.mcf (unexplained diff vs previous) (percentage) 0.540 -97.37%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.070 -
433.milc (max) 24.000 -4.00%
433.milc (max) (percentage) 1.930 -4.93%
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.000 -
434.zeusmp (max) 32.000 -
434.zeusmp (max) (percentage) 1.680 -2.89%
435.gromacs 129.000 -
435.gromacs (avg) 129.000 -
435.gromacs (avg) (percentage) 3.020 -
435.gromacs (max) 197.000 -
435.gromacs (max) (percentage) 4.610 -1.07%
436.cactusADM 17.000 -
436.cactusADM (avg) 17.000 -
436.cactusADM (avg) (percentage) 0.840 -1.18%
436.cactusADM (max) 14.000 -12.50%
436.cactusADM (max) (percentage) 0.730 -12.05%
436.cactusADM (unexplained diff vs previous) 8.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.390 -
437.leslie3d 198.000 1.54%
437.leslie3d (avg) 198.000 1.54%
437.leslie3d (avg) (percentage) 1.150 -
437.leslie3d (max) 277.000 -
437.leslie3d (max) (percentage) 1.610 -2.42%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.780 1.30%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.890 -1.11%
444.namd (unexplained diff vs previous) 6.000 -
444.namd (unexplained diff vs previous) (percentage) 0.900 1.12%
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.790 -
445.gobmk (max) 56.000 -1.75%
445.gobmk (max) (percentage) 1.030 -
445.gobmk (unexplained diff vs previous) 45.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.820 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 0.960 -1.03%
447.dealII (max) 19.000 -38.71%
447.dealII (max) (percentage) 1.000 -38.65%
447.dealII (unexplained diff vs previous) 9.000 -60.87%
447.dealII (unexplained diff vs previous) (percentage) 0.460 -61.34%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 3.100 -
450.soplex (max) 30.000 -6.25%
450.soplex (max) (percentage) 5.650 -7.07%
450.soplex (unexplained diff vs previous) 4.000 -87.10%
450.soplex (unexplained diff vs previous) (percentage) 0.730 -87.26%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.300 -
453.povray (max) 10.000 -
453.povray (max) (percentage) 2.020 -1.46%
456.hmmer 11.000 -
456.hmmer (avg) 11.000 -
456.hmmer (avg) (percentage) 0.390 -
456.hmmer (max) 9.000 12.50%
456.hmmer (max) (percentage) 0.340 13.33%
456.hmmer (unexplained diff vs previous) 10.000 42.86%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 41.67%
458.sjeng 40.000 -2.44%
458.sjeng (avg) 40.000 -2.44%
458.sjeng (avg) (percentage) 0.540 -1.82%
458.sjeng (max) 27.000 -
458.sjeng (max) (percentage) 0.360 -
458.sjeng (unexplained diff vs previous) 3.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -
459.GemsFDTD 63.000 -
459.GemsFDTD (avg) 63.000 -
459.GemsFDTD (avg) (percentage) 0.930 -
459.GemsFDTD (max) 71.000 -1.39%
459.GemsFDTD (max) (percentage) 1.050 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.830 -
462.libquantum (max) 5.000 -16.67%
462.libquantum (max) (percentage) 5.210 -16.64%
462.libquantum (unexplained diff vs previous) 3.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.860 -51.36%
464.h264ref 42.000 -
464.h264ref (avg) 42.000 -
464.h264ref (avg) (percentage) 0.960 -
464.h264ref (max) 72.000 -5.26%
464.h264ref (max) (percentage) 1.630 -5.23%
465.tonto 95.000 -
465.tonto (avg) 95.000 -
465.tonto (avg) (percentage) 0.330 -
465.tonto (max) 86.000 -3.37%
465.tonto (max) (percentage) 0.300 -3.23%
470.lbm 35.000 -
470.lbm (avg) 35.000 -
470.lbm (avg) (percentage) 1.090 -
470.lbm (max) 46.000 -16.36%
470.lbm (max) (percentage) 1.440 -16.76%
470.lbm (unexplained diff vs previous) 12.000 -78.18%
470.lbm (unexplained diff vs previous) (percentage) 0.370 -78.24%
471.omnetpp 57.000 -1.72%
471.omnetpp (avg) 57.000 -1.72%
471.omnetpp (avg) (percentage) 1.930 -
471.omnetpp (max) 103.000 -5.50%
471.omnetpp (max) (percentage) 3.470 -4.93%
473.astar 93.000 -
473.astar (avg) 93.000 -
473.astar (avg) (percentage) 1.820 -
473.astar (max) 186.000 -2.11%
473.astar (max) (percentage) 3.630 -2.68%
481.wrf 59.000 1.72%
481.wrf (avg) 59.000 1.72%
481.wrf (avg) (percentage) 1.810 -
481.wrf (max) 129.000 -
481.wrf (max) (percentage) 3.970 -1.24%
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.000 -1.48%
482.sphinx3 (max) 21.000 -16.00%
482.sphinx3 (max) (percentage) 2.600 -16.67%
482.sphinx3 (unexplained diff vs previous) 3.000 -88.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -88.12%
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) (percentage) 0.370 -
Geometric Mean 6.299 -26.61%