Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=154f2735ad4c2eb0985086b113825e6f4f3abcf1 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/4fbe3e6aa74dae5c75a73c46ae6683fdecd1a75d (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=89d40cacd0aed35e2546513ce01924b879523e46 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=73c242518a8bc77e7e4ae4f4e49ce08b63bd2741 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/293/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0293 (-00000-) 2022-09-01T22:11:33 0:00:00
Previous 0292 (basepoints/gcc-13-02266-g8bb1df032cc) 2022-09-06T21:34:33 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 77
Performance Improvements 11 120
Added Tests 173 8
Unchanged Tests 1045 1031
Total Tests 1236

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.98% 206984.000 211092.000 - 2.93% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm 3.98% 12303.000 12793.000 - 237.72% -
482.sphinx3 3.76% 29315.000 30416.000 - 3118.62% -
481.wrf 3.74% 16248.000 16855.000 - 204.57% -
453.povray 2.62% 6340.000 6506.000 - 1089.40% -
459.GemsFDTD 1.57% 23245.000 23611.000 - 282.49% -
483.xalancbmk 1.34% 11505.000 11659.000 - 205.37% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -7.20% 9723.000 9023.000 - 1107.90% -
437.leslie3d -3.78% 14718.000 14161.000 - 21.66% -
416.gamess -3.00% 21236.000 20598.000 - 65.25% -
436.cactusADM -2.81% 18198.000 17687.000 - 749.11% -
433.milc -2.65% 13267.000 12916.000 - 1022.15% -
435.gromacs -2.62% 15675.000 15264.000 - 109.99% -
450.soplex -2.15% 16113.000 15767.000 - 2680.78% -
434.zeusmp -2.13% 13777.000 13483.000 - 436.32% -
400.perlbench -2.12% 11184.000 10947.000 - 558.27% -
447.dealII -2.10% 8984.000 8795.000 - 410.15% -
445.gobmk -1.20% 11681.000 11541.000 - 129.76% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.93% 205081.000 211092.000 - 1.98% -
459.GemsFDTD 1.31% 244728.000 247940.000 - 0.00% -
434.zeusmp 1.22% 152037.000 153897.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 43930.65% 62.000 27299.000 - 0.91% -
403.gcc 16141.07% 56.000 9095.000 - 0.35% -
462.libquantum 8138.57% 140.000 11534.000 - 0.04% -
482.sphinx3 3118.62% 945.000 30416.000 - 3.76% -
450.soplex 2680.78% 567.000 15767.000 - -2.15% -
429.mcf 1110.74% 1424.000 17241.000 - -0.09% -
444.namd 1107.90% 747.000 9023.000 - -7.20% -
453.povray 1089.40% 547.000 6506.000 - 2.62% -
433.milc 1022.15% 1151.000 12916.000 - -2.65% -
436.cactusADM 749.11% 2083.000 17687.000 - -2.81% -
400.perlbench 558.27% 1663.000 10947.000 - -2.12% -
434.zeusmp 436.32% 2514.000 13483.000 - -2.13% -
447.dealII 410.15% 1724.000 8795.000 - -2.10% -
401.bzip2 407.85% 2941.000 14936.000 - 0.03% -
471.omnetpp 292.07% 2724.000 10680.000 - 0.62% -
456.hmmer 284.46% 2882.000 11080.000 - 0.30% -
459.GemsFDTD 282.49% 6173.000 23611.000 - 1.57% -
470.lbm 237.72% 3788.000 12793.000 - 3.98% -
483.xalancbmk 205.37% 3818.000 11659.000 - 1.34% -
481.wrf 204.57% 5534.000 16855.000 - 3.74% -
473.astar 176.21% 5128.000 14164.000 - 0.23% -
410.bwaves 147.86% 5652.000 14009.000 - 0.37% -
464.h264ref 139.32% 5761.000 13787.000 - -0.19% -
445.gobmk 129.76% 5023.000 11541.000 - -1.20% -
435.gromacs 109.99% 7269.000 15264.000 - -2.62% -
458.sjeng 85.05% 7567.000 14003.000 - -0.34% -
416.gamess 65.25% 12465.000 20598.000 - -3.00% -
437.leslie3d 21.66% 11640.000 14161.000 - -3.78% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 11700.00% 4.000 472.000 - 0.00% -
454.calculix (avg) 11700.00% 4.000 472.000 - 0.00% -
462.libquantum 5740.00% 10.000 584.000 - 0.00% -
462.libquantum (avg) 5740.00% 10.000 584.000 - 0.00% -
450.soplex 3033.33% 36.000 1128.000 - 0.00% -
450.soplex (avg) 3033.33% 36.000 1128.000 - 0.00% -
482.sphinx3 2209.46% 74.000 1709.000 - 0.00% -
482.sphinx3 (avg) 2209.46% 74.000 1709.000 - 0.00% -
453.povray 1133.33% 42.000 518.000 - 0.00% -
453.povray (avg) 1133.33% 42.000 518.000 - 0.00% -
462.libquantum (max) 848.55% 138.000 1309.000 - 0.00% -
444.namd 800.00% 68.000 612.000 - 0.00% -
444.namd (avg) 800.00% 68.000 612.000 - 0.00% -
429.mcf 693.58% 109.000 865.000 - 0.00% -
429.mcf (avg) 693.58% 109.000 865.000 - 0.00% -
403.gcc 675.00% 4.000 31.000 - 0.00% -
403.gcc (avg) 675.00% 4.000 31.000 - 0.00% -
454.calculix (max) 480.33% 61.000 354.000 - 0.00% -
433.milc 423.19% 69.000 361.000 - 0.00% -
433.milc (avg) 423.19% 69.000 361.000 - 0.00% -
436.cactusADM 379.03% 124.000 594.000 - 0.00% -
436.cactusADM (avg) 379.03% 124.000 594.000 - 0.00% -
447.dealII 337.37% 99.000 433.000 - 0.00% -
447.dealII (avg) 337.37% 99.000 433.000 - 0.00% -
471.omnetpp 267.26% 223.000 819.000 - 0.00% -
471.omnetpp (avg) 267.26% 223.000 819.000 - 0.00% -
470.lbm 223.43% 239.000 773.000 - 0.00% -
470.lbm (avg) 223.43% 239.000 773.000 - 0.00% -
434.zeusmp 169.39% 147.000 396.000 - 0.00% -
434.zeusmp (avg) 169.39% 147.000 396.000 - 0.00% -
459.GemsFDTD 159.44% 360.000 934.000 - 0.00% -
459.GemsFDTD (avg) 159.44% 360.000 934.000 - 0.00% -
482.sphinx3 (max) 134.03% 911.000 2132.000 - 0.00% -
401.bzip2 126.71% 161.000 365.000 - 0.00% -
401.bzip2 (avg) 126.71% 161.000 365.000 - 0.00% -
400.perlbench 120.95% 105.000 232.000 - 0.00% -
400.perlbench (avg) 120.95% 105.000 232.000 - 0.00% -
437.leslie3d 97.75% 355.000 702.000 - 0.00% -
437.leslie3d (avg) 97.75% 355.000 702.000 - 0.00% -
437.leslie3d (avg) (percentage) 62.62% 3.050 4.960 - 0.00% -
450.soplex (max) 55.23% 545.000 846.000 - 0.00% -
473.astar 46.01% 213.000 311.000 - 0.00% -
473.astar (avg) 46.01% 213.000 311.000 - 0.00% -
429.mcf (max) 45.61% 1322.000 1925.000 - 0.00% -
450.soplex (avg) (percentage) 11.35% 6.430 7.160 - 0.00% -
453.povray (avg) (percentage) 2.05% 7.810 7.970 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -20.01% 10941.000 8752.000 - 0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.040 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -100.00% 15435.710 0.350 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.090 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.99% 368.340 0.030 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.95% 10833.000 5.000 - 0.00% -
429.mcf (unexplained diff vs previous) -99.92% 18593.000 15.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.89% 278.630 0.300 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.88% 197.850 0.230 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.87% 2759.050 3.620 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.84% 391.300 0.620 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.84% 118.780 0.190 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.74% 137.900 0.360 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.72% 980.800 2.720 - 0.00% -
473.astar (unexplained diff vs previous) -99.67% 10146.000 33.000 - 0.00% -
465.tonto (max) -99.67% 2112.000 7.000 - 0.00% -
464.h264ref (max) (percentage) -99.65% 54.290 0.190 - 0.00% -
403.gcc (max) (percentage) -99.65% 99.360 0.350 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.63% 787.130 2.890 - 0.00% -
403.gcc (unexplained diff vs previous) -99.63% 8644.000 32.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.63% 90.870 0.340 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.62% 6843.000 26.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.59% 527.480 2.160 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.59% 8030.000 33.000 - 0.00% -
465.tonto (unexplained diff vs previous) -99.55% 1771.000 8.000 - 0.00% -
465.tonto (max) (percentage) -99.53% 19.310 0.090 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.51% 448.690 2.180 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.44% 16.190 0.090 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.38% 250.410 1.550 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.38% 10659.000 66.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.35% 7794.000 51.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.31% 1118.610 7.760 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.30% 6876.000 48.000 - 0.00% -
458.sjeng (max) (percentage) -99.29% 47.610 0.340 - 0.00% -
445.gobmk (max) (percentage) -99.28% 52.630 0.380 - 0.00% -
464.h264ref (max) -99.17% 3127.000 26.000 - 0.00% -
454.calculix (max) (percentage) -98.70% 99.730 1.300 - 0.00% -
458.sjeng (max) -98.70% 3602.000 47.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.55% 263.730 3.830 - 0.00% -
410.bwaves (max) (percentage) -98.41% 57.970 0.920 - 0.00% -
445.gobmk (max) -98.37% 2643.000 43.000 - 0.00% -
456.hmmer (max) (percentage) -98.29% 73.590 1.260 - 0.00% -
465.tonto -98.08% 365.000 7.000 - 0.00% -
465.tonto (avg) -98.08% 365.000 7.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -97.63% 15458.000 366.000 - 0.00% -
400.perlbench (max) (percentage) -97.48% 84.060 2.120 - 0.00% -
434.zeusmp (unexplained diff vs previous) -97.39% 11280.000 294.000 - 0.00% -
465.tonto (avg) (percentage) -97.31% 3.340 0.090 - 0.00% -
400.perlbench (unexplained diff vs previous) -97.30% 8772.000 237.000 - 0.00% -
433.milc (max) (percentage) -97.08% 90.750 2.650 - 0.00% -
433.milc (unexplained diff vs previous) -96.89% 11289.000 351.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -96.88% 16396.000 511.000 - 0.00% -
464.h264ref (avg) (percentage) -96.27% 5.090 0.190 - 0.00% -
436.cactusADM (max) (percentage) -96.22% 88.730 3.350 - 0.00% -
410.bwaves (max) -96.09% 3276.000 128.000 - 0.00% -
434.zeusmp (max) (percentage) -95.83% 81.770 3.410 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -95.78% 26073.000 1101.000 - 0.00% -
447.dealII (max) (percentage) -95.39% 80.280 3.700 - 0.00% -
403.gcc (avg) (percentage) -95.22% 7.320 0.350 - 0.00% -
470.lbm (unexplained diff vs previous) -95.10% 9990.000 490.000 - 0.00% -
450.soplex (max) (percentage) -94.42% 96.240 5.370 - 0.00% -
453.povray (max) (percentage) -93.45% 91.250 5.980 - 0.00% -
456.hmmer (max) -93.44% 2120.000 139.000 - 0.00% -
473.astar (max) (percentage) -93.08% 66.430 4.600 - 0.00% -
401.bzip2 (max) (percentage) -93.03% 78.650 5.480 - 0.00% -
482.sphinx3 (max) (percentage) -92.74% 96.500 7.010 - 0.00% -
444.namd (max) (percentage) -92.16% 91.790 7.200 - 0.00% -
444.namd (unexplained diff vs previous) -91.62% 8356.000 700.000 - 0.00% -
464.h264ref -91.13% 293.000 26.000 - 0.00% -
464.h264ref (avg) -91.13% 293.000 26.000 - 0.00% -
459.GemsFDTD (max) (percentage) -90.82% 71.460 6.560 - 0.00% -
470.lbm (max) (percentage) -89.45% 72.510 7.650 - 0.00% -
458.sjeng (avg) (percentage) -89.34% 3.190 0.340 - 0.00% -
462.libquantum (max) (percentage) -88.53% 98.970 11.350 - 0.00% -
429.mcf (max) (percentage) -87.98% 92.890 11.170 - 0.00% -
445.gobmk (avg) (percentage) -86.96% 3.910 0.510 - 0.00% -
410.bwaves (avg) (percentage) -85.26% 4.410 0.650 - 0.00% -
400.perlbench (max) -83.39% 1397.000 232.000 - 0.00% -
456.hmmer (avg) (percentage) -82.77% 4.410 0.760 - 0.00% -
473.astar (max) -80.89% 3406.000 651.000 - 0.00% -
458.sjeng -80.50% 241.000 47.000 - 0.00% -
458.sjeng (avg) -80.50% 241.000 47.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -80.23% 19.880 3.930 - 0.00% -
471.omnetpp (max) (percentage) -79.51% 79.650 16.320 - 0.00% -
454.calculix (avg) (percentage) -78.43% 8.020 1.730 - 0.00% -
434.zeusmp (max) -77.66% 2055.000 459.000 - 0.00% -
447.dealII (max) -76.52% 1384.000 325.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -75.93% 2314.000 557.000 - 0.00% -
445.gobmk -70.41% 196.000 58.000 - 0.00% -
445.gobmk (avg) -70.41% 196.000 58.000 - 0.00% -
436.cactusADM (max) -67.97% 1848.000 592.000 - 0.00% -
433.milc (max) -67.24% 1044.000 342.000 - 0.00% -
437.leslie3d (max) (percentage) -66.95% 16.580 5.480 - 0.00% -
400.perlbench (avg) (percentage) -66.61% 6.350 2.120 - 0.00% -
459.GemsFDTD (max) -64.91% 4411.000 1548.000 - 0.00% -
401.bzip2 (max) -64.63% 2313.000 818.000 - 0.00% -
470.lbm (max) -64.38% 2746.000 978.000 - 0.00% -
410.bwaves -63.45% 249.000 91.000 - 0.00% -
410.bwaves (avg) -63.45% 249.000 91.000 - 0.00% -
437.leslie3d (max) -59.77% 1929.000 776.000 - 0.00% -
401.bzip2 (avg) (percentage) -55.29% 5.480 2.450 - 0.00% -
433.milc (avg) (percentage) -53.72% 6.050 2.800 - 0.00% -
434.zeusmp (avg) (percentage) -49.74% 5.850 2.940 - 0.00% -
473.astar (avg) (percentage) -47.12% 4.160 2.200 - 0.00% -
436.cactusADM (avg) (percentage) -43.81% 5.980 3.360 - 0.00% -
403.gcc (max) -43.64% 55.000 31.000 - 0.00% -
429.mcf (avg) (percentage) -34.55% 7.670 5.020 - 0.00% -
456.hmmer -33.86% 127.000 84.000 - 0.00% -
456.hmmer (avg) -33.86% 127.000 84.000 - 0.00% -
462.libquantum (avg) (percentage) -33.81% 7.660 5.070 - 0.00% -
459.GemsFDTD (avg) (percentage) -32.19% 5.840 3.960 - 0.00% -
482.sphinx3 (avg) (percentage) -29.13% 7.930 5.620 - 0.00% -
444.namd (avg) (percentage) -26.36% 9.220 6.790 - 0.00% -
453.povray (max) -22.04% 499.000 389.000 - 0.00% -
471.omnetpp (max) -19.69% 2169.000 1742.000 - 0.00% -
447.dealII (avg) (percentage) -14.56% 5.770 4.930 - 0.00% -
471.omnetpp (avg) (percentage) -6.46% 8.200 7.670 - 0.00% -
444.namd (max) -5.26% 685.000 649.000 - 0.00% -
470.lbm (avg) (percentage) -4.42% 6.330 6.050 - 0.00% -

Added Tests - sample variability
416.gamess (max)
416.gamess (max) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 10947.000 -2.12%
401.bzip2 14936.000 -
403.gcc 9095.000 -
410.bwaves 14009.000 -
416.gamess 20598.000 -3.00%
429.mcf 17241.000 -
433.milc 12916.000 -2.65%
434.zeusmp 13483.000 -2.13%
435.gromacs 15264.000 -2.62%
436.cactusADM 17687.000 -2.81%
437.leslie3d 14161.000 -3.78%
444.namd 9023.000 -7.20%
445.gobmk 11541.000 -1.20%
447.dealII 8795.000 -2.10%
450.soplex 15767.000 -2.15%
453.povray 6506.000 2.62%
454.calculix 27299.000 -
456.hmmer 11080.000 -
458.sjeng 14003.000 -
459.GemsFDTD 23611.000 1.57%
462.libquantum 11534.000 -
464.h264ref 13787.000 -
465.tonto 8752.000 -
470.lbm 12793.000 3.98%
471.omnetpp 10680.000 -
473.astar 14164.000 -
481.wrf 16855.000 3.74%
482.sphinx3 30416.000 3.76%
483.xalancbmk 11659.000 1.34%
Geometric Mean 13599.486 -
Name Current %
400.perlbench 897104.000 -
401.bzip2 44221.000 -
403.gcc 2460192.000 -
410.bwaves 16768.000 -
416.gamess 5738253.000 -
429.mcf 9123.000 -
433.milc 61230.000 -
434.zeusmp 153897.000 -
435.gromacs 500203.000 -
436.cactusADM 352831.000 -
437.leslie3d 59403.000 -
444.namd 188301.000 -
445.gobmk 1377602.000 -
447.dealII 312944.000 -
450.soplex 211092.000 1.98%
453.povray 661959.000 -
454.calculix 844607.000 -
456.hmmer 108631.000 -
458.sjeng 104028.000 -
459.GemsFDTD 247940.000 -
462.libquantum 16045.000 -
464.h264ref 387228.000 -
465.tonto 1945443.000 -
470.lbm 9711.000 -
471.omnetpp 482480.000 -
473.astar 22952.000 -
481.wrf 1958192.000 -
482.sphinx3 112831.000 -
483.xalancbmk 2342185.000 -
Geometric Mean 224480.851 -
Name Current %
400.perlbench 232.000 -
400.perlbench (avg) 232.000 -
400.perlbench (avg) (percentage) 2.120 -
400.perlbench (max) 232.000 -
400.perlbench (max) (percentage) 2.120 -
400.perlbench (unexplained diff vs previous) 237.000 -
400.perlbench (unexplained diff vs previous) (percentage) 2.160 -
401.bzip2 365.000 -
401.bzip2 (avg) 365.000 -
401.bzip2 (avg) (percentage) 2.450 -
401.bzip2 (max) 818.000 -
401.bzip2 (max) (percentage) 5.480 -
401.bzip2 (unexplained diff vs previous) 5.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.030 -
403.gcc 31.000 -
403.gcc (avg) 31.000 -
403.gcc (avg) (percentage) 0.350 -
403.gcc (max) 31.000 -
403.gcc (max) (percentage) 0.350 -
403.gcc (unexplained diff vs previous) 32.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.350 -
410.bwaves 91.000 -
410.bwaves (avg) 91.000 -
410.bwaves (avg) (percentage) 0.650 -
410.bwaves (max) 128.000 -
410.bwaves (max) (percentage) 0.920 -
410.bwaves (unexplained diff vs previous) 51.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.360 -
416.gamess (max) 0.000 -
416.gamess (max) (percentage) 0.000 -
429.mcf 865.000 -
429.mcf (avg) 865.000 -
429.mcf (avg) (percentage) 5.020 -
429.mcf (max) 1925.000 -
429.mcf (max) (percentage) 11.170 -
429.mcf (unexplained diff vs previous) 15.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.090 -
433.milc 361.000 -
433.milc (avg) 361.000 -
433.milc (avg) (percentage) 2.800 -
433.milc (max) 342.000 -
433.milc (max) (percentage) 2.650 -
433.milc (unexplained diff vs previous) 351.000 -
433.milc (unexplained diff vs previous) (percentage) 2.720 -
434.zeusmp 396.000 -
434.zeusmp (avg) 396.000 -
434.zeusmp (avg) (percentage) 2.940 -
434.zeusmp (max) 459.000 -
434.zeusmp (max) (percentage) 3.410 -
434.zeusmp (unexplained diff vs previous) 294.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 2.180 -
435.gromacs (max) 0.000 -
435.gromacs (max) (percentage) 0.000 -
436.cactusADM 594.000 -
436.cactusADM (avg) 594.000 -
436.cactusADM (avg) (percentage) 3.360 -
436.cactusADM (max) 592.000 -
436.cactusADM (max) (percentage) 3.350 -
436.cactusADM (unexplained diff vs previous) 511.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 2.890 -
437.leslie3d 702.000 -
437.leslie3d (avg) 702.000 -
437.leslie3d (avg) (percentage) 4.960 -
437.leslie3d (max) 776.000 -
437.leslie3d (max) (percentage) 5.480 -
437.leslie3d (unexplained diff vs previous) 557.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 3.930 -
444.namd 612.000 -
444.namd (avg) 612.000 -
444.namd (avg) (percentage) 6.790 -
444.namd (max) 649.000 -
444.namd (max) (percentage) 7.200 -
444.namd (unexplained diff vs previous) 700.000 -
444.namd (unexplained diff vs previous) (percentage) 7.760 -
445.gobmk 58.000 -
445.gobmk (avg) 58.000 -
445.gobmk (avg) (percentage) 0.510 -
445.gobmk (max) 43.000 -
445.gobmk (max) (percentage) 0.380 -
447.dealII 433.000 -
447.dealII (avg) 433.000 -
447.dealII (avg) (percentage) 4.930 -
447.dealII (max) 325.000 -
447.dealII (max) (percentage) 3.700 -
450.soplex 1128.000 -
450.soplex (avg) 1128.000 -
450.soplex (avg) (percentage) 7.160 -
450.soplex (max) 846.000 -
450.soplex (max) (percentage) 5.370 -
453.povray 518.000 -
453.povray (avg) 518.000 -
453.povray (avg) (percentage) 7.970 -
453.povray (max) 389.000 -
453.povray (max) (percentage) 5.980 -
454.calculix 472.000 -
454.calculix (avg) 472.000 -
454.calculix (avg) (percentage) 1.730 -
454.calculix (max) 354.000 -
454.calculix (max) (percentage) 1.300 -
456.hmmer 84.000 -
456.hmmer (avg) 84.000 -
456.hmmer (avg) (percentage) 0.760 -
456.hmmer (max) 139.000 -
456.hmmer (max) (percentage) 1.260 -
456.hmmer (unexplained diff vs previous) 33.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.300 -
458.sjeng 47.000 -
458.sjeng (avg) 47.000 -
458.sjeng (avg) (percentage) 0.340 -
458.sjeng (max) 47.000 -
458.sjeng (max) (percentage) 0.340 -
458.sjeng (unexplained diff vs previous) 48.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.340 -
459.GemsFDTD 934.000 -
459.GemsFDTD (avg) 934.000 -
459.GemsFDTD (avg) (percentage) 3.960 -
459.GemsFDTD (max) 1548.000 -
459.GemsFDTD (max) (percentage) 6.560 -
459.GemsFDTD (unexplained diff vs previous) 366.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.550 -
462.libquantum 584.000 -
462.libquantum (avg) 584.000 -
462.libquantum (avg) (percentage) 5.070 -
462.libquantum (max) 1309.000 -
462.libquantum (max) (percentage) 11.350 -
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.040 -
464.h264ref 26.000 -
464.h264ref (avg) 26.000 -
464.h264ref (avg) (percentage) 0.190 -
464.h264ref (max) 26.000 -
464.h264ref (max) (percentage) 0.190 -
464.h264ref (unexplained diff vs previous) 26.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.190 -
465.tonto 7.000 -
465.tonto (avg) 7.000 -
465.tonto (avg) (percentage) 0.090 -
465.tonto (max) 7.000 -
465.tonto (max) (percentage) 0.090 -
465.tonto (unexplained diff vs previous) 8.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.090 -
470.lbm 773.000 -
470.lbm (avg) 773.000 -
470.lbm (avg) (percentage) 6.050 -
470.lbm (max) 978.000 -
470.lbm (max) (percentage) 7.650 -
470.lbm (unexplained diff vs previous) 490.000 -
470.lbm (unexplained diff vs previous) (percentage) 3.830 -
471.omnetpp 819.000 -
471.omnetpp (avg) 819.000 -
471.omnetpp (avg) (percentage) 7.670 -
471.omnetpp (max) 1742.000 -
471.omnetpp (max) (percentage) 16.320 -
471.omnetpp (unexplained diff vs previous) 66.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.620 -
473.astar 311.000 -
473.astar (avg) 311.000 -
473.astar (avg) (percentage) 2.200 -
473.astar (max) 651.000 -
473.astar (max) (percentage) 4.600 -
473.astar (unexplained diff vs previous) 33.000 -
473.astar (unexplained diff vs previous) (percentage) 0.230 -
481.wrf (max) 0.000 -
481.wrf (max) (percentage) 0.000 -
482.sphinx3 1709.000 -
482.sphinx3 (avg) 1709.000 -
482.sphinx3 (avg) (percentage) 5.620 -
482.sphinx3 (max) 2132.000 -
482.sphinx3 (max) (percentage) 7.010 -
482.sphinx3 (unexplained diff vs previous) 1101.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 3.620 -
483.xalancbmk (max) 0.000 -
483.xalancbmk (max) (percentage) 0.000 -
Geometric Mean 15.244 -