Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=31ee179e275a25625f66e7045a651433f9856087 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/95ba31bc4f88a0a2ff9f0ed41f3478cafcb9e040 (+ 96 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9cc9d61ee12f2f8620d8e0ea3c42af02bf07fe1e (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=42a734d19dbe4dcf194201c26051f5ce6a22cde3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/324/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0324 (-00000-) 2022-11-03T20:15:13 0:00:00
Previous 0323 (basepoints/gcc-13-03596-ge7310e24b1c) 2022-11-02T16:30:06 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 145 56
Performance Improvements 27 161
Added Tests 30 0
Unchanged Tests 1034 1019
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 8.33% 8989.000 9738.000 - 1203.61% -
437.leslie3d 4.04% 14151.000 14723.000 - 26.49% -
400.perlbench 3.53% 10734.000 11113.000 - 568.25% -
416.gamess 3.35% 20556.000 21244.000 - 70.43% -
435.gromacs 3.04% 15281.000 15745.000 - 116.60% -
436.cactusADM 2.84% 17684.000 18187.000 - 773.12% -
434.zeusmp 2.68% 13441.000 13801.000 - 448.97% -
433.milc 2.62% 12892.000 13230.000 - 1049.44% -
450.soplex 1.96% 15801.000 16110.000 - 2741.27% -
447.dealII 1.53% 9022.000 9160.000 - 431.32% -
445.gobmk 1.28% 11530.000 11678.000 - 132.49% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 3955.00% 20.000 811.000 - 18.39% -
444.namd (max) (percentage) 3521.74% 0.230 8.330 - -90.92% -
454.calculix (max) (percentage) 1964.71% 0.170 3.510 - -96.48% -
454.calculix (max) 1900.00% 38.000 760.000 - 1145.90% -
470.lbm (unexplained diff vs previous) (percentage) 1794.74% 0.190 3.600 - -98.63% -
483.xalancbmk (max) 1754.84% 31.000 575.000 - -78.06% -
470.lbm (unexplained diff vs previous) 1754.17% 24.000 445.000 - -95.55% -
483.xalancbmk (max) (percentage) 1734.48% 0.290 5.320 - -92.25% -
444.namd 1308.00% 25.000 352.000 - 417.65% -
444.namd (avg) 1308.00% 25.000 352.000 - 417.65% -
444.namd (avg) (percentage) 1192.86% 0.280 3.620 - -60.74% -
445.gobmk (max) 1046.15% 13.000 149.000 - -94.36% -
445.gobmk (max) (percentage) 966.67% 0.120 1.280 - -97.57% -
416.gamess (max) 926.53% 49.000 503.000 - -89.53% -
416.gamess (max) (percentage) 887.50% 0.240 2.370 - -93.85% -
435.gromacs (max) 825.00% 24.000 222.000 - -93.79% -
435.gromacs (max) (percentage) 781.25% 0.160 1.410 - -97.13% -
462.libquantum (unexplained diff vs previous) (percentage) 725.00% 0.040 0.330 - -100.00% -
462.libquantum (unexplained diff vs previous) 660.00% 5.000 38.000 - -99.72% -
435.gromacs 600.00% 29.000 203.000 - -44.69% -
435.gromacs (avg) 600.00% 29.000 203.000 - -44.69% -
435.gromacs (avg) (percentage) 578.95% 0.190 1.290 - -74.51% -
436.cactusADM (unexplained diff vs previous) 561.84% 76.000 503.000 - -96.93% -
436.cactusADM (unexplained diff vs previous) (percentage) 544.19% 0.430 2.770 - -99.65% -
416.gamess 508.47% 59.000 359.000 - -34.73% -
416.gamess (avg) 508.47% 59.000 359.000 - -34.73% -
416.gamess (avg) (percentage) 482.76% 0.290 1.690 - -61.76% -
465.tonto (max) 465.22% 23.000 130.000 - -93.84% -
465.tonto (max) (percentage) 460.71% 0.280 1.570 - -91.87% -
483.xalancbmk (avg) (percentage) 295.83% 0.240 0.950 - -85.38% -
483.xalancbmk 292.31% 26.000 102.000 - -58.87% -
483.xalancbmk (avg) 292.31% 26.000 102.000 - -58.87% -
454.calculix (avg) (percentage) 257.14% 0.210 0.750 - -90.65% -
445.gobmk 256.25% 16.000 57.000 - -70.92% -
445.gobmk (avg) 256.25% 16.000 57.000 - -70.92% -
445.gobmk (avg) (percentage) 250.00% 0.140 0.490 - -87.47% -
454.calculix 244.68% 47.000 162.000 - 3950.00% -
454.calculix (avg) 244.68% 47.000 162.000 - 3950.00% -
473.astar (avg) (percentage) 220.00% 0.050 0.160 - -96.15% -
473.astar 214.29% 7.000 22.000 - -89.67% -
473.astar (avg) 214.29% 7.000 22.000 - -89.67% -
465.tonto (avg) (percentage) 197.06% 0.340 1.010 - -69.76% -
465.tonto 196.43% 28.000 83.000 - -77.26% -
465.tonto (avg) 196.43% 28.000 83.000 - -77.26% -
459.GemsFDTD (avg) (percentage) 193.55% 0.310 0.910 - -84.42% -
459.GemsFDTD 191.78% 73.000 213.000 - -40.83% -
459.GemsFDTD (avg) 191.78% 73.000 213.000 - -40.83% -
462.libquantum 168.42% 19.000 51.000 - 410.00% -
462.libquantum (avg) 168.42% 19.000 51.000 - 410.00% -
462.libquantum (avg) (percentage) 164.71% 0.170 0.450 - -94.13% -
400.perlbench (max) 152.90% 155.000 392.000 - -71.94% -
400.perlbench (max) (percentage) 143.45% 1.450 3.530 - -95.80% -
456.hmmer 111.11% 27.000 57.000 - -55.12% -
456.hmmer (avg) 111.11% 27.000 57.000 - -55.12% -
456.hmmer (avg) (percentage) 108.00% 0.250 0.520 - -88.21% -
470.lbm (avg) (percentage) 101.12% 0.890 1.790 - -71.72% -
470.lbm 93.86% 114.000 221.000 - -7.53% -
470.lbm (avg) 93.86% 114.000 221.000 - -7.53% -
436.cactusADM 88.11% 143.000 269.000 - 116.94% -
436.cactusADM (avg) 88.11% 143.000 269.000 - 116.94% -
434.zeusmp (max) 86.36% 198.000 369.000 - -82.04% -
401.bzip2 (max) (percentage) 85.11% 0.470 0.870 - -98.89% -
401.bzip2 (max) 84.29% 70.000 129.000 - -94.42% -
436.cactusADM (avg) (percentage) 82.72% 0.810 1.480 - -75.25% -
434.zeusmp (max) (percentage) 81.08% 1.480 2.680 - -96.72% -
456.hmmer (max) 72.41% 29.000 50.000 - -97.64% -
456.hmmer (max) (percentage) 70.37% 0.270 0.460 - -99.37% -
437.leslie3d 66.67% 165.000 275.000 - -22.54% -
437.leslie3d (avg) 66.67% 165.000 275.000 - -22.54% -
400.perlbench 65.04% 123.000 203.000 - 93.33% -
400.perlbench (avg) 65.04% 123.000 203.000 - 93.33% -
458.sjeng 61.90% 21.000 34.000 - -85.89% -
458.sjeng (avg) 61.90% 21.000 34.000 - -85.89% -
458.sjeng (avg) (percentage) 60.00% 0.150 0.240 - -92.48% -
437.leslie3d (avg) (percentage) 59.83% 1.170 1.870 - -38.69% -
400.perlbench (avg) (percentage) 59.13% 1.150 1.830 - -71.18% -
482.sphinx3 (avg) (percentage) 58.93% 1.120 1.780 - -77.55% -
436.cactusADM (max) 57.80% 327.000 516.000 - -72.08% -
453.povray (max) (percentage) 57.74% 1.680 2.650 - -97.10% -
433.milc 57.45% 141.000 222.000 - 221.74% -
433.milc (avg) 57.45% 141.000 222.000 - 221.74% -
482.sphinx3 56.68% 337.000 528.000 - 613.51% -
482.sphinx3 (avg) 56.68% 337.000 528.000 - 613.51% -
403.gcc (max) (percentage) 56.25% 0.320 0.500 - -99.50% -
403.gcc (max) 55.17% 29.000 45.000 - -18.18% -
453.povray (max) 53.70% 108.000 166.000 - -66.73% -
436.cactusADM (max) (percentage) 53.51% 1.850 2.840 - -96.80% -
433.milc (avg) (percentage) 52.73% 1.100 1.680 - -72.23% -
471.omnetpp (avg) (percentage) 51.22% 0.820 1.240 - -84.88% -
458.sjeng (max) (percentage) 48.78% 0.410 0.610 - -98.72% -
458.sjeng (max) 48.28% 58.000 86.000 - -97.61% -
471.omnetpp 47.73% 88.000 130.000 - -41.70% -
471.omnetpp (avg) 47.73% 88.000 130.000 - -41.70% -
464.h264ref 40.62% 32.000 45.000 - -84.64% -
464.h264ref (avg) 40.62% 32.000 45.000 - -84.64% -
453.povray (avg) (percentage) 40.45% 0.890 1.250 - -83.99% -
471.omnetpp (unexplained diff vs previous) (percentage) 38.71% 1.240 1.720 - -99.56% -
464.h264ref (avg) (percentage) 37.50% 0.240 0.330 - -93.52% -
453.povray 36.84% 57.000 78.000 - 85.71% -
453.povray (avg) 36.84% 57.000 78.000 - 85.71% -
471.omnetpp (unexplained diff vs previous) 36.84% 133.000 182.000 - -98.29% -
471.omnetpp (max) (percentage) 35.20% 1.250 1.690 - -97.88% -
471.omnetpp (max) 32.84% 134.000 178.000 - -91.79% -
470.lbm (max) (percentage) 32.44% 2.620 3.470 - -95.21% -
459.GemsFDTD (max) (percentage) 32.43% 0.370 0.490 - -99.31% -
433.milc (max) 32.06% 262.000 346.000 - -66.86% -
459.GemsFDTD (max) 31.03% 87.000 114.000 - -97.42% -
433.milc (max) (percentage) 28.43% 2.040 2.620 - -97.11% -
470.lbm (max) 28.06% 335.000 429.000 - -84.38% -
464.h264ref (max) 27.78% 54.000 69.000 - -97.79% -
450.soplex 27.50% 120.000 153.000 - 325.00% -
450.soplex (avg) 27.50% 120.000 153.000 - 325.00% -
464.h264ref (max) (percentage) 27.50% 0.400 0.510 - -99.06% -
450.soplex (avg) (percentage) 25.00% 0.760 0.950 - -85.23% -
434.zeusmp 21.66% 157.000 191.000 - 29.93% -
434.zeusmp (avg) 21.66% 157.000 191.000 - 29.93% -
462.libquantum (max) (percentage) 20.29% 0.690 0.830 - -99.16% -
462.libquantum (max) 20.25% 79.000 95.000 - -31.16% -
434.zeusmp (avg) (percentage) 18.80% 1.170 1.390 - -76.24% -
481.wrf (avg) (percentage) 18.12% 1.490 1.760 - -71.79% -
437.leslie3d (max) 17.15% 309.000 362.000 - -81.23% -
482.sphinx3 (max) (percentage) 16.26% 1.230 1.430 - -98.52% -
401.bzip2 (avg) (percentage) 15.56% 0.450 0.520 - -90.51% -
401.bzip2 14.93% 67.000 77.000 - -52.17% -
401.bzip2 (avg) 14.93% 67.000 77.000 - -52.17% -
450.soplex (max) 14.61% 219.000 251.000 - -53.94% -
482.sphinx3 (max) 14.59% 370.000 424.000 - -53.46% -
481.wrf 13.55% 251.000 285.000 - -17.39% -
481.wrf (avg) 13.55% 251.000 285.000 - -17.39% -
481.wrf (max) (percentage) 12.45% 2.490 2.800 - -95.92% -
437.leslie3d (max) (percentage) 12.33% 2.190 2.460 - -85.16% -
450.soplex (max) (percentage) 12.23% 1.390 1.560 - -98.38% -
481.wrf (max) 8.11% 419.000 453.000 - -88.08% -
447.dealII (max) 1.90% 158.000 161.000 - -88.37% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD -1.64% 252128.000 247992.000 - 1.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
481.wrf -3.84% 16848.000 16201.000 - 192.75% -
454.calculix -3.51% 22468.000 21679.000 - 34866.13% -
470.lbm -3.47% 12809.000 12364.000 - 226.40% -
453.povray -2.65% 6463.000 6292.000 - 1050.27% -
410.bwaves -2.31% 14253.000 13924.000 - 146.36% -
471.omnetpp -1.69% 10744.000 10562.000 - 287.74% -
482.sphinx3 -1.43% 30101.000 29670.000 - 3039.68% -
465.tonto -1.34% 8402.000 8289.000 - -24.24% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) (percentage) -68.75% 0.160 0.050 - -99.92% -
473.astar (max) -68.18% 22.000 7.000 - -99.79% -
429.mcf -60.19% 103.000 41.000 - -62.39% -
429.mcf (avg) -60.19% 103.000 41.000 - -62.39% -
429.mcf (avg) (percentage) -60.00% 0.600 0.240 - -96.87% -
447.dealII (avg) (percentage) -47.02% 1.510 0.800 - -86.14% -
447.dealII -46.32% 136.000 73.000 - -26.26% -
447.dealII (avg) -46.32% 136.000 73.000 - -26.26% -
410.bwaves -29.26% 352.000 249.000 - 0.00% -
410.bwaves (avg) -29.26% 352.000 249.000 - 0.00% -
410.bwaves (avg) (percentage) -27.53% 2.470 1.790 - -59.41% -
473.astar (unexplained diff vs previous) -12.50% 8.000 7.000 - -99.93% -
403.gcc -11.76% 34.000 30.000 - 650.00% -
403.gcc (avg) -11.76% 34.000 30.000 - 650.00% -
403.gcc (avg) (percentage) -10.53% 0.380 0.340 - -95.36% -
429.mcf (max) (percentage) -10.00% 0.500 0.450 - -99.52% -
429.mcf (max) -9.41% 85.000 77.000 - -94.18% -
410.bwaves (max) -2.73% 330.000 321.000 - -90.20% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.93% 205081.000 211096.000 - 0.00% -
459.GemsFDTD 1.33% 244728.000 247992.000 - -1.64% -
434.zeusmp 1.10% 152037.000 153713.000 - 0.00% -
435.gromacs 1.04% 499261.000 504431.000 - 0.82% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 34866.13% 62.000 21679.000 - -3.51% -
403.gcc 16096.43% 56.000 9070.000 - 0.04% -
462.libquantum 8112.86% 140.000 11498.000 - -0.33% -
482.sphinx3 3039.68% 945.000 29670.000 - -1.43% -
450.soplex 2741.27% 567.000 16110.000 - 1.96% -
444.namd 1203.61% 747.000 9738.000 - 8.33% -
429.mcf 1109.34% 1424.000 17221.000 - 0.17% -
453.povray 1050.27% 547.000 6292.000 - -2.65% -
433.milc 1049.44% 1151.000 13230.000 - 2.62% -
436.cactusADM 773.12% 2083.000 18187.000 - 2.84% -
400.perlbench 568.25% 1663.000 11113.000 - 3.53% -
434.zeusmp 448.97% 2514.000 13801.000 - 2.68% -
447.dealII 431.32% 1724.000 9160.000 - 1.53% -
401.bzip2 406.80% 2941.000 14905.000 - -0.87% -
471.omnetpp 287.74% 2724.000 10562.000 - -1.69% -
456.hmmer 282.86% 2882.000 11034.000 - -0.46% -
459.GemsFDTD 279.20% 6173.000 23408.000 - -0.94% -
470.lbm 226.40% 3788.000 12364.000 - -3.47% -
481.wrf 192.75% 5534.000 16201.000 - -3.84% -
483.xalancbmk 183.47% 3818.000 10823.000 - -0.54% -
473.astar 176.44% 5128.000 14176.000 - -0.05% -
410.bwaves 146.36% 5652.000 13924.000 - -2.31% -
464.h264ref 137.39% 5761.000 13676.000 - -0.06% -
445.gobmk 132.49% 5023.000 11678.000 - 1.28% -
435.gromacs 116.60% 7269.000 15745.000 - 3.04% -
458.sjeng 87.83% 7567.000 14213.000 - -0.01% -
416.gamess 70.43% 12465.000 21244.000 - 3.35% -
437.leslie3d 26.49% 11640.000 14723.000 - 4.04% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 3950.00% 4.000 162.000 - 244.68% -
454.calculix (avg) 3950.00% 4.000 162.000 - 244.68% -
454.calculix (max) 1145.90% 61.000 760.000 - 1900.00% -
403.gcc 650.00% 4.000 30.000 - -11.76% -
403.gcc (avg) 650.00% 4.000 30.000 - -11.76% -
482.sphinx3 613.51% 74.000 528.000 - 56.68% -
482.sphinx3 (avg) 613.51% 74.000 528.000 - 56.68% -
444.namd 417.65% 68.000 352.000 - 1308.00% -
444.namd (avg) 417.65% 68.000 352.000 - 1308.00% -
462.libquantum 410.00% 10.000 51.000 - 168.42% -
462.libquantum (avg) 410.00% 10.000 51.000 - 168.42% -
450.soplex 325.00% 36.000 153.000 - 27.50% -
450.soplex (avg) 325.00% 36.000 153.000 - 27.50% -
433.milc 221.74% 69.000 222.000 - 57.45% -
433.milc (avg) 221.74% 69.000 222.000 - 57.45% -
436.cactusADM 116.94% 124.000 269.000 - 88.11% -
436.cactusADM (avg) 116.94% 124.000 269.000 - 88.11% -
400.perlbench 93.33% 105.000 203.000 - 65.04% -
400.perlbench (avg) 93.33% 105.000 203.000 - 65.04% -
453.povray 85.71% 42.000 78.000 - 36.84% -
453.povray (avg) 85.71% 42.000 78.000 - 36.84% -
434.zeusmp 29.93% 147.000 191.000 - 21.66% -
434.zeusmp (avg) 29.93% 147.000 191.000 - 21.66% -
444.namd (max) 18.39% 685.000 811.000 - 3955.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383420.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -24.24% 10941.000 8289.000 - -1.34% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.330 - 725.00% -
454.calculix (unexplained diff vs previous) (percentage) -99.99% 37020.970 3.640 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.99% 90.870 0.010 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.170 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.97% 197.850 0.050 - -16.67% -
458.sjeng (unexplained diff vs previous) -99.97% 6876.000 2.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.95% 118.780 0.060 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.450 - 0.00% -
473.astar (unexplained diff vs previous) -99.93% 10146.000 7.000 - -12.50% -
473.astar (max) (percentage) -99.92% 66.430 0.050 - -68.75% -
464.h264ref (unexplained diff vs previous) -99.88% 6843.000 8.000 - 0.00% -
429.mcf (unexplained diff vs previous) -99.84% 18593.000 29.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.83% 278.630 0.460 - 0.00% -
473.astar (max) -99.79% 3406.000 7.000 - -68.18% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.76% 368.340 0.880 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.74% 980.800 2.550 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.74% 1043.330 2.720 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.72% 13518.000 38.000 - 660.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.65% 787.130 2.770 - 544.19% -
447.dealII (unexplained diff vs previous) (percentage) -99.63% 407.020 1.510 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.56% 391.300 1.720 - 38.71% -
429.mcf (max) (percentage) -99.52% 92.890 0.450 - -10.00% -
403.gcc (max) (percentage) -99.50% 99.360 0.500 - 56.25% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.42% 448.690 2.610 - 0.00% -
456.hmmer (max) (percentage) -99.37% 73.590 0.460 - 70.37% -
456.hmmer (unexplained diff vs previous) -99.36% 8030.000 51.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.35% 527.480 3.410 - 0.00% -
459.GemsFDTD (max) (percentage) -99.31% 71.460 0.490 - 32.43% -
444.namd (unexplained diff vs previous) (percentage) -99.31% 1118.610 7.690 - 0.00% -
462.libquantum (max) (percentage) -99.16% 98.970 0.830 - 20.29% -
464.h264ref (max) (percentage) -99.06% 54.290 0.510 - 27.50% -
401.bzip2 (max) (percentage) -98.89% 78.650 0.870 - 85.11% -
445.gobmk (unexplained diff vs previous) (percentage) -98.86% 111.110 1.270 - 0.00% -
401.bzip2 (unexplained diff vs previous) -98.79% 10833.000 131.000 - 0.00% -
458.sjeng (max) (percentage) -98.72% 47.610 0.610 - 48.78% -
470.lbm (unexplained diff vs previous) (percentage) -98.63% 263.730 3.600 - 1794.74% -
482.sphinx3 (max) (percentage) -98.52% 96.500 1.430 - 16.26% -
450.soplex (max) (percentage) -98.38% 96.240 1.560 - 12.23% -
482.sphinx3 (unexplained diff vs previous) -98.35% 26073.000 431.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -98.29% 10659.000 182.000 - 36.84% -
410.bwaves (unexplained diff vs previous) (percentage) -98.29% 137.900 2.360 - 0.00% -
447.dealII (unexplained diff vs previous) -98.03% 7017.000 138.000 - 0.00% -
471.omnetpp (max) (percentage) -97.88% 79.650 1.690 - 35.20% -
447.dealII (max) (percentage) -97.81% 80.280 1.760 - 0.00% -
464.h264ref (max) -97.79% 3127.000 69.000 - 27.78% -
456.hmmer (max) -97.64% 2120.000 50.000 - 72.41% -
458.sjeng (max) -97.61% 3602.000 86.000 - 48.28% -
445.gobmk (max) (percentage) -97.57% 52.630 1.280 - 966.67% -
459.GemsFDTD (max) -97.42% 4411.000 114.000 - 31.03% -
445.gobmk (unexplained diff vs previous) -97.35% 5581.000 148.000 - 0.00% -
435.gromacs (max) (percentage) -97.13% 49.160 1.410 - 781.25% -
433.milc (max) (percentage) -97.11% 90.750 2.620 - 28.43% -
453.povray (max) (percentage) -97.10% 91.250 2.650 - 57.74% -
433.milc (unexplained diff vs previous) -97.01% 11289.000 338.000 - 0.00% -
453.povray (unexplained diff vs previous) -97.00% 5707.000 171.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -96.93% 16396.000 503.000 - 561.84% -
429.mcf (avg) (percentage) -96.87% 7.670 0.240 - -60.00% -
434.zeusmp (unexplained diff vs previous) -96.81% 11280.000 360.000 - 0.00% -
436.cactusADM (max) (percentage) -96.80% 88.730 2.840 - 53.51% -
434.zeusmp (max) (percentage) -96.72% 81.770 2.680 - 81.08% -
454.calculix (unexplained diff vs previous) -96.56% 22953.000 789.000 - 0.00% -
454.calculix (max) (percentage) -96.48% 99.730 3.510 - 1964.71% -
473.astar (avg) (percentage) -96.15% 4.160 0.160 - 220.00% -
410.bwaves (max) (percentage) -96.02% 57.970 2.310 - -0.43% -
481.wrf (max) (percentage) -95.92% 68.700 2.800 - 12.45% -
400.perlbench (max) (percentage) -95.80% 84.060 3.530 - 143.45% -
410.bwaves (unexplained diff vs previous) -95.78% 7794.000 329.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -95.68% 8772.000 379.000 - 0.00% -
470.lbm (unexplained diff vs previous) -95.55% 9990.000 445.000 - 1754.17% -
403.gcc (avg) (percentage) -95.36% 7.320 0.340 - -10.53% -
470.lbm (max) (percentage) -95.21% 72.510 3.470 - 32.44% -
401.bzip2 (max) -94.42% 2313.000 129.000 - 84.29% -
445.gobmk (max) -94.36% 2643.000 149.000 - 1046.15% -
429.mcf (max) -94.18% 1322.000 77.000 - -9.41% -
462.libquantum (avg) (percentage) -94.13% 7.660 0.450 - 164.71% -
416.gamess (max) (percentage) -93.85% 38.550 2.370 - 887.50% -
465.tonto (max) -93.84% 2112.000 130.000 - 465.22% -
435.gromacs (max) -93.79% 3573.000 222.000 - 825.00% -
464.h264ref (avg) (percentage) -93.52% 5.090 0.330 - 37.50% -
458.sjeng (avg) (percentage) -92.48% 3.190 0.240 - 60.00% -
483.xalancbmk (max) (percentage) -92.25% 68.670 5.320 - 1734.48% -
465.tonto (max) (percentage) -91.87% 19.310 1.570 - 460.71% -
471.omnetpp (max) -91.79% 2169.000 178.000 - 32.84% -
444.namd (unexplained diff vs previous) -91.04% 8356.000 749.000 - 0.00% -
444.namd (max) (percentage) -90.92% 91.790 8.330 - 3521.74% -
454.calculix (avg) (percentage) -90.65% 8.020 0.750 - 257.14% -
401.bzip2 (avg) (percentage) -90.51% 5.480 0.520 - 15.56% -
410.bwaves (max) -90.20% 3276.000 321.000 - -2.73% -
473.astar -89.67% 213.000 22.000 - 214.29% -
473.astar (avg) -89.67% 213.000 22.000 - 214.29% -
416.gamess (max) -89.53% 4805.000 503.000 - 926.53% -
447.dealII (max) -88.37% 1384.000 161.000 - 1.90% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 108.00% -
481.wrf (max) -88.08% 3801.000 453.000 - 8.11% -
445.gobmk (avg) (percentage) -87.47% 3.910 0.490 - 250.00% -
447.dealII (avg) (percentage) -86.14% 5.770 0.800 - -47.02% -
458.sjeng -85.89% 241.000 34.000 - 61.90% -
458.sjeng (avg) -85.89% 241.000 34.000 - 61.90% -
483.xalancbmk (avg) (percentage) -85.38% 6.500 0.950 - 295.83% -
450.soplex (avg) (percentage) -85.23% 6.430 0.950 - 25.00% -
437.leslie3d (max) (percentage) -85.16% 16.580 2.460 - 12.33% -
471.omnetpp (avg) (percentage) -84.88% 8.200 1.240 - 51.22% -
464.h264ref -84.64% 293.000 45.000 - 40.62% -
464.h264ref (avg) -84.64% 293.000 45.000 - 40.62% -
459.GemsFDTD (avg) (percentage) -84.42% 5.840 0.910 - 193.55% -
470.lbm (max) -84.38% 2746.000 429.000 - 28.06% -
453.povray (avg) (percentage) -83.99% 7.810 1.250 - 40.45% -
434.zeusmp (max) -82.04% 2055.000 369.000 - 86.36% -
437.leslie3d (max) -81.23% 1929.000 362.000 - 17.15% -
483.xalancbmk (max) -78.06% 2621.000 575.000 - 1754.84% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - 58.93% -
465.tonto -77.26% 365.000 83.000 - 196.43% -
465.tonto (avg) -77.26% 365.000 83.000 - 196.43% -
434.zeusmp (avg) (percentage) -76.24% 5.850 1.390 - 18.80% -
436.cactusADM (avg) (percentage) -75.25% 5.980 1.480 - 82.72% -
435.gromacs (avg) (percentage) -74.51% 5.060 1.290 - 578.95% -
433.milc (avg) (percentage) -72.23% 6.050 1.680 - 52.73% -
436.cactusADM (max) -72.08% 1848.000 516.000 - 57.80% -
400.perlbench (max) -71.94% 1397.000 392.000 - 152.90% -
481.wrf (avg) (percentage) -71.79% 6.240 1.760 - 18.12% -
470.lbm (avg) (percentage) -71.72% 6.330 1.790 - 101.12% -
400.perlbench (avg) (percentage) -71.18% 6.350 1.830 - 59.13% -
445.gobmk -70.92% 196.000 57.000 - 256.25% -
445.gobmk (avg) -70.92% 196.000 57.000 - 256.25% -
465.tonto (avg) (percentage) -69.76% 3.340 1.010 - 197.06% -
433.milc (max) -66.86% 1044.000 346.000 - 32.06% -
453.povray (max) -66.73% 499.000 166.000 - 53.70% -
429.mcf -62.39% 109.000 41.000 - -60.19% -
429.mcf (avg) -62.39% 109.000 41.000 - -60.19% -
416.gamess (avg) (percentage) -61.76% 4.420 1.690 - 482.76% -
444.namd (avg) (percentage) -60.74% 9.220 3.620 - 1192.86% -
410.bwaves (avg) (percentage) -59.41% 4.410 1.790 - -27.53% -
483.xalancbmk -58.87% 248.000 102.000 - 292.31% -
483.xalancbmk (avg) -58.87% 248.000 102.000 - 292.31% -
456.hmmer -55.12% 127.000 57.000 - 111.11% -
456.hmmer (avg) -55.12% 127.000 57.000 - 111.11% -
450.soplex (max) -53.94% 545.000 251.000 - 14.61% -
482.sphinx3 (max) -53.46% 911.000 424.000 - 14.59% -
401.bzip2 -52.17% 161.000 77.000 - 14.93% -
401.bzip2 (avg) -52.17% 161.000 77.000 - 14.93% -
435.gromacs -44.69% 367.000 203.000 - 600.00% -
435.gromacs (avg) -44.69% 367.000 203.000 - 600.00% -
471.omnetpp -41.70% 223.000 130.000 - 47.73% -
471.omnetpp (avg) -41.70% 223.000 130.000 - 47.73% -
459.GemsFDTD -40.83% 360.000 213.000 - 191.78% -
459.GemsFDTD (avg) -40.83% 360.000 213.000 - 191.78% -
437.leslie3d (avg) (percentage) -38.69% 3.050 1.870 - 59.83% -
416.gamess -34.73% 550.000 359.000 - 508.47% -
416.gamess (avg) -34.73% 550.000 359.000 - 508.47% -
462.libquantum (max) -31.16% 138.000 95.000 - 20.25% -
447.dealII -26.26% 99.000 73.000 - -46.32% -
447.dealII (avg) -26.26% 99.000 73.000 - -46.32% -
437.leslie3d -22.54% 355.000 275.000 - 66.67% -
437.leslie3d (avg) -22.54% 355.000 275.000 - 66.67% -
403.gcc (max) -18.18% 55.000 45.000 - 55.17% -
481.wrf -17.39% 345.000 285.000 - 13.55% -
481.wrf (avg) -17.39% 345.000 285.000 - 13.55% -
470.lbm -7.53% 239.000 221.000 - 93.86% -
470.lbm (avg) -7.53% 239.000 221.000 - 93.86% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 11113.000 3.53%
401.bzip2 14905.000 -
403.gcc 9070.000 -
410.bwaves 13924.000 -2.31%
416.gamess 21244.000 3.35%
429.mcf 17221.000 -
433.milc 13230.000 2.62%
434.zeusmp 13801.000 2.68%
435.gromacs 15745.000 3.04%
436.cactusADM 18187.000 2.84%
437.leslie3d 14723.000 4.04%
444.namd 9738.000 8.33%
445.gobmk 11678.000 1.28%
447.dealII 9160.000 1.53%
450.soplex 16110.000 1.96%
453.povray 6292.000 -2.65%
454.calculix 21679.000 -3.51%
456.hmmer 11034.000 -
458.sjeng 14213.000 -
459.GemsFDTD 23408.000 -
462.libquantum 11498.000 -
464.h264ref 13676.000 -
465.tonto 8289.000 -1.34%
470.lbm 12364.000 -3.47%
471.omnetpp 10562.000 -1.69%
473.astar 14176.000 -
481.wrf 16201.000 -3.84%
482.sphinx3 29670.000 -1.43%
483.xalancbmk 10823.000 -
Geometric Mean 13514.704 -
Code Size (bytes)
Name Current %
400.perlbench 888800.000 -
401.bzip2 44241.000 -
403.gcc 2442040.000 -
410.bwaves 16748.000 -
416.gamess 5736417.000 -
429.mcf 9123.000 -
433.milc 61222.000 -
434.zeusmp 153713.000 -
435.gromacs 504431.000 -
436.cactusADM 352867.000 -
437.leslie3d 59467.000 -
444.namd 188373.000 -
445.gobmk 1377618.000 -
447.dealII 312852.000 -
450.soplex 211096.000 -
453.povray 657739.000 -
454.calculix 845155.000 -
456.hmmer 108679.000 -
458.sjeng 104004.000 -
459.GemsFDTD 247992.000 -1.64%
462.libquantum 16117.000 -
464.h264ref 383420.000 -
465.tonto 1944567.000 -
470.lbm 9687.000 -
471.omnetpp 482484.000 -
473.astar 22944.000 -
481.wrf 1969996.000 -
482.sphinx3 112835.000 -
483.xalancbmk 2341626.000 -
Geometric Mean 224344.898 -
sample variability
Name Current %
400.perlbench 203.000 65.04%
400.perlbench (avg) 203.000 65.04%
400.perlbench (avg) (percentage) 1.830 59.13%
400.perlbench (max) 392.000 152.90%
400.perlbench (max) (percentage) 3.530 143.45%
400.perlbench (unexplained diff vs previous) 379.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.410 -
401.bzip2 77.000 14.93%
401.bzip2 (avg) 77.000 14.93%
401.bzip2 (avg) (percentage) 0.520 15.56%
401.bzip2 (max) 129.000 84.29%
401.bzip2 (max) (percentage) 0.870 85.11%
401.bzip2 (unexplained diff vs previous) 131.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.880 -
403.gcc 30.000 -11.76%
403.gcc (avg) 30.000 -11.76%
403.gcc (avg) (percentage) 0.340 -10.53%
403.gcc (max) 45.000 55.17%
403.gcc (max) (percentage) 0.500 56.25%
410.bwaves 249.000 -29.26%
410.bwaves (avg) 249.000 -29.26%
410.bwaves (avg) (percentage) 1.790 -27.53%
410.bwaves (max) 321.000 -2.73%
410.bwaves (max) (percentage) 2.310 -
410.bwaves (unexplained diff vs previous) 329.000 -
410.bwaves (unexplained diff vs previous) (percentage) 2.360 -
416.gamess 359.000 508.47%
416.gamess (avg) 359.000 508.47%
416.gamess (avg) (percentage) 1.690 482.76%
416.gamess (max) 503.000 926.53%
416.gamess (max) (percentage) 2.370 887.50%
429.mcf 41.000 -60.19%
429.mcf (avg) 41.000 -60.19%
429.mcf (avg) (percentage) 0.240 -60.00%
429.mcf (max) 77.000 -9.41%
429.mcf (max) (percentage) 0.450 -10.00%
429.mcf (unexplained diff vs previous) 29.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.170 -
433.milc 222.000 57.45%
433.milc (avg) 222.000 57.45%
433.milc (avg) (percentage) 1.680 52.73%
433.milc (max) 346.000 32.06%
433.milc (max) (percentage) 2.620 28.43%
433.milc (unexplained diff vs previous) 338.000 -
433.milc (unexplained diff vs previous) (percentage) 2.550 -
434.zeusmp 191.000 21.66%
434.zeusmp (avg) 191.000 21.66%
434.zeusmp (avg) (percentage) 1.390 18.80%
434.zeusmp (max) 369.000 86.36%
434.zeusmp (max) (percentage) 2.680 81.08%
434.zeusmp (unexplained diff vs previous) 360.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 2.610 -
435.gromacs 203.000 600.00%
435.gromacs (avg) 203.000 600.00%
435.gromacs (avg) (percentage) 1.290 578.95%
435.gromacs (max) 222.000 825.00%
435.gromacs (max) (percentage) 1.410 781.25%
436.cactusADM 269.000 88.11%
436.cactusADM (avg) 269.000 88.11%
436.cactusADM (avg) (percentage) 1.480 82.72%
436.cactusADM (max) 516.000 57.80%
436.cactusADM (max) (percentage) 2.840 53.51%
436.cactusADM (unexplained diff vs previous) 503.000 561.84%
436.cactusADM (unexplained diff vs previous) (percentage) 2.770 544.19%
437.leslie3d 275.000 66.67%
437.leslie3d (avg) 275.000 66.67%
437.leslie3d (avg) (percentage) 1.870 59.83%
437.leslie3d (max) 362.000 17.15%
437.leslie3d (max) (percentage) 2.460 12.33%
444.namd 352.000 1308.00%
444.namd (avg) 352.000 1308.00%
444.namd (avg) (percentage) 3.620 1192.86%
444.namd (max) 811.000 3955.00%
444.namd (max) (percentage) 8.330 3521.74%
444.namd (unexplained diff vs previous) 749.000 -
444.namd (unexplained diff vs previous) (percentage) 7.690 -
445.gobmk 57.000 256.25%
445.gobmk (avg) 57.000 256.25%
445.gobmk (avg) (percentage) 0.490 250.00%
445.gobmk (max) 149.000 1046.15%
445.gobmk (max) (percentage) 1.280 966.67%
445.gobmk (unexplained diff vs previous) 148.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.270 -
447.dealII 73.000 -46.32%
447.dealII (avg) 73.000 -46.32%
447.dealII (avg) (percentage) 0.800 -47.02%
447.dealII (max) 161.000 1.90%
447.dealII (max) (percentage) 1.760 -
447.dealII (unexplained diff vs previous) 138.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.510 -
450.soplex 153.000 27.50%
450.soplex (avg) 153.000 27.50%
450.soplex (avg) (percentage) 0.950 25.00%
450.soplex (max) 251.000 14.61%
450.soplex (max) (percentage) 1.560 12.23%
453.povray 78.000 36.84%
453.povray (avg) 78.000 36.84%
453.povray (avg) (percentage) 1.250 40.45%
453.povray (max) 166.000 53.70%
453.povray (max) (percentage) 2.650 57.74%
453.povray (unexplained diff vs previous) 171.000 -
453.povray (unexplained diff vs previous) (percentage) 2.720 -
454.calculix 162.000 244.68%
454.calculix (avg) 162.000 244.68%
454.calculix (avg) (percentage) 0.750 257.14%
454.calculix (max) 760.000 1900.00%
454.calculix (max) (percentage) 3.510 1964.71%
454.calculix (unexplained diff vs previous) 789.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.640 -
456.hmmer 57.000 111.11%
456.hmmer (avg) 57.000 111.11%
456.hmmer (avg) (percentage) 0.520 108.00%
456.hmmer (max) 50.000 72.41%
456.hmmer (max) (percentage) 0.460 70.37%
456.hmmer (unexplained diff vs previous) 51.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.460 -
458.sjeng 34.000 61.90%
458.sjeng (avg) 34.000 61.90%
458.sjeng (avg) (percentage) 0.240 60.00%
458.sjeng (max) 86.000 48.28%
458.sjeng (max) (percentage) 0.610 48.78%
458.sjeng (unexplained diff vs previous) 2.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -
459.GemsFDTD 213.000 191.78%
459.GemsFDTD (avg) 213.000 191.78%
459.GemsFDTD (avg) (percentage) 0.910 193.55%
459.GemsFDTD (max) 114.000 31.03%
459.GemsFDTD (max) (percentage) 0.490 32.43%
462.libquantum 51.000 168.42%
462.libquantum (avg) 51.000 168.42%
462.libquantum (avg) (percentage) 0.450 164.71%
462.libquantum (max) 95.000 20.25%
462.libquantum (max) (percentage) 0.830 20.29%
462.libquantum (unexplained diff vs previous) 38.000 660.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.330 725.00%
464.h264ref 45.000 40.62%
464.h264ref (avg) 45.000 40.62%
464.h264ref (avg) (percentage) 0.330 37.50%
464.h264ref (max) 69.000 27.78%
464.h264ref (max) (percentage) 0.510 27.50%
464.h264ref (unexplained diff vs previous) 8.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -
465.tonto 83.000 196.43%
465.tonto (avg) 83.000 196.43%
465.tonto (avg) (percentage) 1.010 197.06%
465.tonto (max) 130.000 465.22%
465.tonto (max) (percentage) 1.570 460.71%
470.lbm 221.000 93.86%
470.lbm (avg) 221.000 93.86%
470.lbm (avg) (percentage) 1.790 101.12%
470.lbm (max) 429.000 28.06%
470.lbm (max) (percentage) 3.470 32.44%
470.lbm (unexplained diff vs previous) 445.000 1754.17%
470.lbm (unexplained diff vs previous) (percentage) 3.600 1794.74%
471.omnetpp 130.000 47.73%
471.omnetpp (avg) 130.000 47.73%
471.omnetpp (avg) (percentage) 1.240 51.22%
471.omnetpp (max) 178.000 32.84%
471.omnetpp (max) (percentage) 1.690 35.20%
471.omnetpp (unexplained diff vs previous) 182.000 36.84%
471.omnetpp (unexplained diff vs previous) (percentage) 1.720 38.71%
473.astar 22.000 214.29%
473.astar (avg) 22.000 214.29%
473.astar (avg) (percentage) 0.160 220.00%
473.astar (max) 7.000 -68.18%
473.astar (max) (percentage) 0.050 -68.75%
473.astar (unexplained diff vs previous) 7.000 -12.50%
473.astar (unexplained diff vs previous) (percentage) 0.050 -
481.wrf 285.000 13.55%
481.wrf (avg) 285.000 13.55%
481.wrf (avg) (percentage) 1.760 18.12%
481.wrf (max) 453.000 8.11%
481.wrf (max) (percentage) 2.800 12.45%
482.sphinx3 528.000 56.68%
482.sphinx3 (avg) 528.000 56.68%
482.sphinx3 (avg) (percentage) 1.780 58.93%
482.sphinx3 (max) 424.000 14.59%
482.sphinx3 (max) (percentage) 1.430 16.26%
482.sphinx3 (unexplained diff vs previous) 431.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.450 -
483.xalancbmk 102.000 292.31%
483.xalancbmk (avg) 102.000 292.31%
483.xalancbmk (avg) (percentage) 0.950 295.83%
483.xalancbmk (max) 575.000 1754.84%
483.xalancbmk (max) (percentage) 5.320 1734.48%
Geometric Mean 17.761 93.85%