Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0f2cd53cf4f730136e2b275e8279d8bc348a9a88 (+ 28 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4c5b1160776382772fc0a33130dfaf621699fdbf (+ 44 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a35c960dbb1d7c7cf25905514f5f9d5e99cf6160 (+ 6 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=03f5126405a3dbba616ed615fd885761d1d74bec (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/317/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0317 (3-changed-components) 2022-10-20T22:53:26 0:00:00
Previous 0316 (4-changed-components) 2022-10-16T09:32:18 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 64 54
Performance Improvements 77 142
Added Tests 4 0
Unchanged Tests 1091 1040
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 7.98% 9009.000 9728.000 - 1202.28% -
437.leslie3d 3.22% 14179.000 14636.000 - 25.74% -
416.gamess 3.10% 20548.000 21186.000 - 69.96% -
433.milc 2.94% 12904.000 13283.000 - 1054.04% -
436.cactusADM 2.86% 17678.000 18183.000 - 772.92% -
434.zeusmp 2.63% 13414.000 13767.000 - 447.61% -
450.soplex 2.04% 15769.000 16090.000 - 2737.74% -
400.perlbench 1.83% 10906.000 11106.000 - 567.83% -
435.gromacs 1.67% 15407.000 15664.000 - 115.49% -
447.dealII 1.42% 8960.000 9087.000 - 427.09% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 4566.67% 0.030 1.400 - -99.99% -
462.libquantum (unexplained diff vs previous) 3925.00% 4.000 161.000 - -98.81% -
436.cactusADM (unexplained diff vs previous) 3507.14% 14.000 505.000 - -96.92% -
436.cactusADM (unexplained diff vs previous) (percentage) 3375.00% 0.080 2.780 - -99.65% -
459.GemsFDTD (unexplained diff vs previous) 188.52% 61.000 176.000 - -98.86% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 188.46% 0.260 0.750 - -99.70% -
471.omnetpp (unexplained diff vs previous) (percentage) 171.43% 0.070 0.190 - -99.95% -
471.omnetpp (unexplained diff vs previous) 150.00% 8.000 20.000 - -99.81% -
473.astar (unexplained diff vs previous) (percentage) 106.67% 0.150 0.310 - -99.84% -
473.astar (unexplained diff vs previous) 100.00% 22.000 44.000 - -99.57% -
458.sjeng (max) 93.33% 60.000 116.000 - -96.78% -
458.sjeng (max) (percentage) 90.70% 0.430 0.820 - -98.28% -
462.libquantum (max) (percentage) 64.29% 0.840 1.380 - -98.61% -
436.cactusADM (max) 63.52% 318.000 520.000 - -71.86% -
462.libquantum (max) 62.89% 97.000 158.000 - 14.49% -
436.cactusADM (max) (percentage) 58.89% 1.800 2.860 - -96.78% -
410.bwaves (unexplained diff vs previous) (percentage) 38.17% 1.310 1.810 - -98.69% -
410.bwaves (unexplained diff vs previous) 35.33% 184.000 249.000 - -96.81% -
458.sjeng 34.48% 29.000 39.000 - -83.82% -
458.sjeng (avg) 34.48% 29.000 39.000 - -83.82% -
458.sjeng (avg) (percentage) 33.33% 0.210 0.280 - -91.22% -
473.astar (max) (percentage) 29.17% 0.240 0.310 - -99.53% -
473.astar (max) 26.47% 34.000 43.000 - -98.74% -
462.libquantum (avg) (percentage) 20.93% 0.430 0.520 - -93.21% -
462.libquantum 18.00% 50.000 59.000 - 490.00% -
462.libquantum (avg) 18.00% 50.000 59.000 - 490.00% -
436.cactusADM 16.22% 222.000 258.000 - 108.06% -
436.cactusADM (avg) 16.22% 222.000 258.000 - 108.06% -
436.cactusADM (avg) (percentage) 12.70% 1.260 1.420 - -76.25% -
456.hmmer (unexplained diff vs previous) (percentage) 12.50% 0.480 0.540 - -99.81% -
456.hmmer (unexplained diff vs previous) 11.11% 54.000 60.000 - -99.25% -
444.namd 7.87% 305.000 329.000 - 383.82% -
444.namd (avg) 7.87% 305.000 329.000 - 383.82% -
482.sphinx3 (max) (percentage) 5.97% 2.010 2.130 - -97.79% -
482.sphinx3 (max) 3.80% 605.000 628.000 - -31.06% -
473.astar 3.57% 28.000 29.000 - -86.38% -
473.astar (avg) 3.57% 28.000 29.000 - -86.38% -
437.leslie3d 3.31% 272.000 281.000 - -20.85% -
437.leslie3d (avg) 3.31% 272.000 281.000 - -20.85% -
416.gamess 3.19% 439.000 453.000 - -17.64% -
416.gamess (avg) 3.19% 439.000 453.000 - -17.64% -
434.zeusmp 3.05% 164.000 169.000 - 14.97% -
434.zeusmp (avg) 3.05% 164.000 169.000 - 14.97% -
433.milc 2.93% 205.000 211.000 - 205.80% -
433.milc (avg) 2.93% 205.000 211.000 - 205.80% -
450.soplex 2.07% 145.000 148.000 - 311.11% -
450.soplex (avg) 2.07% 145.000 148.000 - 311.11% -
400.perlbench 1.72% 174.000 177.000 - 68.57% -
400.perlbench (avg) 1.72% 174.000 177.000 - 68.57% -
444.namd (max) 1.38% 436.000 442.000 - -35.47% -
435.gromacs 1.32% 228.000 231.000 - -37.06% -
435.gromacs (avg) 1.32% 228.000 231.000 - -37.06% -
410.bwaves (avg) (percentage) 1.24% 1.610 1.630 - -63.04% -
482.sphinx3 (avg) (percentage) 1.05% 1.910 1.930 - -75.66% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -21.05% 27299.000 21552.000 - 34661.29% -
481.wrf -3.85% 16852.000 16203.000 - 192.79% -
470.lbm -3.61% 12814.000 12352.000 - 226.08% -
482.sphinx3 -2.13% 30140.000 29498.000 - 3021.48% -
453.povray -1.99% 6471.000 6342.000 - 1059.41% -
465.tonto -1.93% 8406.000 8244.000 - -24.65% -
410.bwaves -1.78% 13996.000 13747.000 - 143.22% -
462.libquantum -1.38% 11633.000 11472.000 - 8094.29% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -85.37% 41.000 6.000 - -99.55% -
429.mcf (max) (percentage) -83.33% 0.240 0.040 - -99.96% -
429.mcf (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 - -100.00% -
429.mcf (unexplained diff vs previous) -50.00% 8.000 4.000 - -99.98% -
454.calculix (max) -25.47% 106.000 79.000 - 29.51% -
454.calculix -20.65% 92.000 73.000 - 1725.00% -
454.calculix (avg) -20.65% 92.000 73.000 - 1725.00% -
410.bwaves (max) -12.93% 348.000 303.000 - -90.75% -
471.omnetpp (max) -11.68% 137.000 121.000 - -94.42% -
410.bwaves (max) (percentage) -11.24% 2.490 2.210 - -96.19% -
471.omnetpp (max) (percentage) -10.94% 1.280 1.140 - -98.57% -
456.hmmer (max) -10.84% 83.000 74.000 - -96.51% -
456.hmmer (max) (percentage) -10.67% 0.750 0.670 - -99.09% -
470.lbm (max) -9.59% 344.000 311.000 - -88.67% -
429.mcf (avg) (percentage) -8.70% 0.230 0.210 - -97.26% -
471.omnetpp -8.23% 158.000 145.000 - -34.98% -
471.omnetpp (avg) -8.23% 158.000 145.000 - -34.98% -
471.omnetpp (avg) (percentage) -8.11% 1.480 1.360 - -83.41% -
429.mcf -7.69% 39.000 36.000 - -66.97% -
429.mcf (avg) -7.69% 39.000 36.000 - -66.97% -
481.wrf (max) -7.43% 579.000 536.000 - -85.90% -
453.povray (max) -7.19% 139.000 129.000 - -74.15% -
447.dealII (max) (percentage) -6.49% 0.770 0.720 - -99.10% -
470.lbm (max) (percentage) -6.32% 2.690 2.520 - -96.52% -
437.leslie3d (max) (percentage) -6.29% 2.860 2.680 - -83.84% -
434.zeusmp (max) (percentage) -6.25% 1.280 1.200 - -98.53% -
444.namd (max) (percentage) -6.19% 4.850 4.550 - -95.04% -
464.h264ref (max) -6.12% 49.000 46.000 - -98.53% -
433.milc (max) (percentage) -6.11% 1.800 1.690 - -98.14% -
450.soplex (max) (percentage) -6.06% 0.990 0.930 - -99.03% -
445.gobmk (max) (percentage) -6.02% 0.830 0.780 - -98.52% -
401.bzip2 (max) -5.98% 184.000 173.000 - -92.52% -
401.bzip2 (max) (percentage) -5.69% 1.230 1.160 - -98.53% -
403.gcc (max) -5.66% 53.000 50.000 - -9.09% -
459.GemsFDTD (max) -5.66% 530.000 500.000 - -88.66% -
464.h264ref (max) (percentage) -5.56% 0.360 0.340 - -99.37% -
465.tonto (max) -5.36% 168.000 159.000 - -92.47% -
445.gobmk (max) -5.26% 95.000 90.000 - -96.59% -
454.calculix (max) (percentage) -5.13% 0.390 0.370 - -99.63% -
435.gromacs (max) (percentage) -5.12% 2.150 2.040 - -95.85% -
453.povray (max) (percentage) -5.12% 2.150 2.040 - -97.76% -
403.gcc (max) (percentage) -5.08% 0.590 0.560 - -99.44% -
459.GemsFDTD (max) (percentage) -4.91% 2.240 2.130 - -97.02% -
459.GemsFDTD -4.65% 258.000 246.000 - -31.67% -
459.GemsFDTD (avg) -4.65% 258.000 246.000 - -31.67% -
450.soplex (max) -4.49% 156.000 149.000 - -72.66% -
447.dealII (max) -4.41% 68.000 65.000 - -95.30% -
400.perlbench (max) (percentage) -4.09% 3.910 3.750 - -95.54% -
465.tonto (max) (percentage) -3.98% 2.010 1.930 - -90.01% -
481.wrf -3.96% 278.000 267.000 - -22.61% -
481.wrf (avg) -3.96% 278.000 267.000 - -22.61% -
481.wrf (max) (percentage) -3.78% 3.440 3.310 - -95.18% -
470.lbm -3.70% 216.000 208.000 - -12.97% -
470.lbm (avg) -3.70% 216.000 208.000 - -12.97% -
459.GemsFDTD (avg) (percentage) -3.67% 1.090 1.050 - -82.02% -
435.gromacs (max) -3.63% 331.000 319.000 - -91.07% -
434.zeusmp (max) -3.51% 171.000 165.000 - -91.97% -
483.xalancbmk (max) -3.48% 718.000 693.000 - -73.56% -
433.milc (max) -3.45% 232.000 224.000 - -78.54% -
437.leslie3d (max) -3.21% 405.000 392.000 - -79.68% -
483.xalancbmk (max) (percentage) -3.15% 6.660 6.450 - -90.61% -
416.gamess (max) (percentage) -3.14% 2.870 2.780 - -92.79% -
453.povray -3.03% 66.000 64.000 - 52.38% -
453.povray (avg) -3.03% 66.000 64.000 - 52.38% -
400.perlbench (max) -2.35% 426.000 416.000 - -70.22% -
465.tonto -2.08% 96.000 94.000 - -74.25% -
465.tonto (avg) -2.08% 96.000 94.000 - -74.25% -
482.sphinx3 -1.04% 575.000 569.000 - 668.92% -
482.sphinx3 (avg) -1.04% 575.000 569.000 - 668.92% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 1.31% 244728.000 247936.000 - 0.00% -
434.zeusmp 1.08% 152037.000 153681.000 - -0.14% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 34661.29% 62.000 21552.000 - -21.05% -
403.gcc 16078.57% 56.000 9060.000 - 0.13% -
462.libquantum 8094.29% 140.000 11472.000 - -1.38% -
482.sphinx3 3021.48% 945.000 29498.000 - -2.13% -
450.soplex 2737.74% 567.000 16090.000 - 2.04% -
444.namd 1202.28% 747.000 9728.000 - 7.98% -
429.mcf 1109.48% 1424.000 17223.000 - -0.02% -
453.povray 1059.41% 547.000 6342.000 - -1.99% -
433.milc 1054.04% 1151.000 13283.000 - 2.94% -
436.cactusADM 772.92% 2083.000 18183.000 - 2.86% -
400.perlbench 567.83% 1663.000 11106.000 - 1.83% -
434.zeusmp 447.61% 2514.000 13767.000 - 2.63% -
447.dealII 427.09% 1724.000 9087.000 - 1.42% -
401.bzip2 407.68% 2941.000 14931.000 - -0.42% -
471.omnetpp 292.69% 2724.000 10697.000 - -0.19% -
456.hmmer 284.35% 2882.000 11077.000 - -0.54% -
459.GemsFDTD 280.84% 6173.000 23509.000 - -0.74% -
470.lbm 226.08% 3788.000 12352.000 - -3.61% -
481.wrf 192.79% 5534.000 16203.000 - -3.85% -
483.xalancbmk 181.59% 3818.000 10751.000 - -0.34% -
473.astar 176.54% 5128.000 14181.000 - -0.31% -
410.bwaves 143.22% 5652.000 13747.000 - -1.78% -
464.h264ref 139.02% 5761.000 13770.000 - 0.69% -
445.gobmk 132.13% 5023.000 11660.000 - 0.83% -
435.gromacs 115.49% 7269.000 15664.000 - 1.67% -
458.sjeng 87.37% 7567.000 14178.000 - 0.82% -
416.gamess 69.96% 12465.000 21186.000 - 3.10% -
437.leslie3d 25.74% 11640.000 14636.000 - 3.22% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 1725.00% 4.000 73.000 - -20.65% -
454.calculix (avg) 1725.00% 4.000 73.000 - -20.65% -
482.sphinx3 668.92% 74.000 569.000 - -1.04% -
482.sphinx3 (avg) 668.92% 74.000 569.000 - -1.04% -
403.gcc 625.00% 4.000 29.000 - 0.00% -
403.gcc (avg) 625.00% 4.000 29.000 - 0.00% -
462.libquantum 490.00% 10.000 59.000 - 18.00% -
462.libquantum (avg) 490.00% 10.000 59.000 - 18.00% -
444.namd 383.82% 68.000 329.000 - 7.87% -
444.namd (avg) 383.82% 68.000 329.000 - 7.87% -
450.soplex 311.11% 36.000 148.000 - 2.07% -
450.soplex (avg) 311.11% 36.000 148.000 - 2.07% -
433.milc 205.80% 69.000 211.000 - 2.93% -
433.milc (avg) 205.80% 69.000 211.000 - 2.93% -
436.cactusADM 108.06% 124.000 258.000 - 16.22% -
436.cactusADM (avg) 108.06% 124.000 258.000 - 16.22% -
400.perlbench 68.57% 105.000 177.000 - 1.72% -
400.perlbench (avg) 68.57% 105.000 177.000 - 1.72% -
453.povray 52.38% 42.000 64.000 - -3.03% -
453.povray (avg) 52.38% 42.000 64.000 - -3.03% -
454.calculix (max) 29.51% 61.000 79.000 - -25.47% -
434.zeusmp 14.97% 147.000 169.000 - 3.05% -
434.zeusmp (avg) 14.97% 147.000 169.000 - 3.05% -
462.libquantum (max) 14.49% 138.000 158.000 - 62.89% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -24.65% 10941.000 8244.000 - -1.93% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) -100.00% 1305.690 0.020 - -60.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.400 - 4566.67% -
429.mcf (unexplained diff vs previous) -99.98% 18593.000 4.000 - -50.00% -
429.mcf (max) (percentage) -99.96% 92.890 0.040 - -83.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.95% 391.300 0.190 - 171.43% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.92% 2759.050 2.180 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.84% 197.850 0.310 - 106.67% -
471.omnetpp (unexplained diff vs previous) -99.81% 10659.000 20.000 - 150.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.81% 278.630 0.540 - 12.50% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.70% 250.410 0.750 - 188.46% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.65% 787.130 2.780 - 3375.00% -
454.calculix (max) (percentage) -99.63% 99.730 0.370 - -5.13% -
473.astar (unexplained diff vs previous) -99.57% 10146.000 44.000 - 100.00% -
429.mcf (max) -99.55% 1322.000 6.000 - -85.37% -
473.astar (max) (percentage) -99.53% 66.430 0.310 - 29.17% -
403.gcc (max) (percentage) -99.44% 99.360 0.560 - -5.08% -
464.h264ref (max) (percentage) -99.37% 54.290 0.340 - -5.56% -
456.hmmer (unexplained diff vs previous) -99.25% 8030.000 60.000 - 11.11% -
447.dealII (max) (percentage) -99.10% 80.280 0.720 - -6.49% -
458.sjeng (unexplained diff vs previous) (percentage) -99.10% 90.870 0.820 - 0.00% -
456.hmmer (max) (percentage) -99.09% 73.590 0.670 - -10.67% -
450.soplex (max) (percentage) -99.03% 96.240 0.930 - -6.06% -
459.GemsFDTD (unexplained diff vs previous) -98.86% 15458.000 176.000 - 188.52% -
462.libquantum (unexplained diff vs previous) -98.81% 13518.000 161.000 - 3925.00% -
473.astar (max) -98.74% 3406.000 43.000 - 26.47% -
410.bwaves (unexplained diff vs previous) (percentage) -98.69% 137.900 1.810 - 38.17% -
462.libquantum (max) (percentage) -98.61% 98.970 1.380 - 64.29% -
471.omnetpp (max) (percentage) -98.57% 79.650 1.140 - -10.94% -
434.zeusmp (max) (percentage) -98.53% 81.770 1.200 - -6.25% -
464.h264ref (max) -98.53% 3127.000 46.000 - -6.12% -
401.bzip2 (max) (percentage) -98.53% 78.650 1.160 - -5.69% -
445.gobmk (max) (percentage) -98.52% 52.630 0.780 - -6.02% -
458.sjeng (unexplained diff vs previous) -98.31% 6876.000 116.000 - 0.00% -
458.sjeng (max) (percentage) -98.28% 47.610 0.820 - 90.70% -
433.milc (max) (percentage) -98.14% 90.750 1.690 - -6.11% -
482.sphinx3 (max) (percentage) -97.79% 96.500 2.130 - 5.97% -
453.povray (max) (percentage) -97.76% 91.250 2.040 - -5.12% -
482.sphinx3 (unexplained diff vs previous) -97.54% 26073.000 642.000 - 0.00% -
429.mcf (avg) (percentage) -97.26% 7.670 0.210 - -8.70% -
459.GemsFDTD (max) (percentage) -97.02% 71.460 2.130 - -4.91% -
436.cactusADM (unexplained diff vs previous) -96.92% 16396.000 505.000 - 3507.14% -
410.bwaves (unexplained diff vs previous) -96.81% 7794.000 249.000 - 35.33% -
458.sjeng (max) -96.78% 3602.000 116.000 - 93.33% -
436.cactusADM (max) (percentage) -96.78% 88.730 2.860 - 58.89% -
445.gobmk (max) -96.59% 2643.000 90.000 - -5.26% -
470.lbm (max) (percentage) -96.52% 72.510 2.520 - -6.32% -
456.hmmer (max) -96.51% 2120.000 74.000 - -10.84% -
410.bwaves (max) (percentage) -96.19% 57.970 2.210 - -11.24% -
435.gromacs (max) (percentage) -95.85% 49.160 2.040 - -5.12% -
454.calculix (avg) (percentage) -95.76% 8.020 0.340 - 0.00% -
400.perlbench (max) (percentage) -95.54% 84.060 3.750 - -4.09% -
403.gcc (avg) (percentage) -95.49% 7.320 0.330 - 0.00% -
447.dealII (max) -95.30% 1384.000 65.000 - -4.41% -
481.wrf (max) (percentage) -95.18% 68.700 3.310 - -3.78% -
444.namd (max) (percentage) -95.04% 91.790 4.550 - -6.19% -
473.astar (avg) (percentage) -94.95% 4.160 0.210 - 5.00% -
471.omnetpp (max) -94.42% 2169.000 121.000 - -11.68% -
462.libquantum (avg) (percentage) -93.21% 7.660 0.520 - 20.93% -
416.gamess (max) (percentage) -92.79% 38.550 2.780 - -3.14% -
464.h264ref (avg) (percentage) -92.73% 5.090 0.370 - 0.00% -
401.bzip2 (max) -92.52% 2313.000 173.000 - -5.98% -
465.tonto (max) -92.47% 2112.000 159.000 - -5.36% -
434.zeusmp (max) -91.97% 2055.000 165.000 - -3.51% -
458.sjeng (avg) (percentage) -91.22% 3.190 0.280 - 33.33% -
435.gromacs (max) -91.07% 3573.000 319.000 - -3.63% -
410.bwaves (max) -90.75% 3276.000 303.000 - -12.93% -
401.bzip2 (avg) (percentage) -90.69% 5.480 0.510 - 0.00% -
483.xalancbmk (max) (percentage) -90.61% 68.670 6.450 - -3.15% -
447.dealII (avg) (percentage) -90.12% 5.770 0.570 - 0.00% -
465.tonto (max) (percentage) -90.01% 19.310 1.930 - -3.98% -
445.gobmk (avg) (percentage) -89.51% 3.910 0.410 - 0.00% -
470.lbm (max) -88.67% 2746.000 311.000 - -9.59% -
459.GemsFDTD (max) -88.66% 4411.000 500.000 - -5.66% -
416.gamess (max) -87.76% 4805.000 588.000 - -0.17% -
453.povray (avg) (percentage) -86.94% 7.810 1.020 - 0.00% -
456.hmmer (avg) (percentage) -86.62% 4.410 0.590 - 0.00% -
473.astar -86.38% 213.000 29.000 - 3.57% -
473.astar (avg) -86.38% 213.000 29.000 - 3.57% -
481.wrf (max) -85.90% 3801.000 536.000 - -7.43% -
450.soplex (avg) (percentage) -85.69% 6.430 0.920 - 0.00% -
437.leslie3d (max) (percentage) -83.84% 16.580 2.680 - -6.29% -
458.sjeng -83.82% 241.000 39.000 - 34.48% -
458.sjeng (avg) -83.82% 241.000 39.000 - 34.48% -
471.omnetpp (avg) (percentage) -83.41% 8.200 1.360 - -8.11% -
464.h264ref -82.94% 293.000 50.000 - 0.00% -
464.h264ref (avg) -82.94% 293.000 50.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -82.02% 5.840 1.050 - -3.67% -
483.xalancbmk (avg) (percentage) -81.69% 6.500 1.190 - 0.00% -
437.leslie3d (max) -79.68% 1929.000 392.000 - -3.21% -
434.zeusmp (avg) (percentage) -78.97% 5.850 1.230 - 0.00% -
433.milc (max) -78.54% 1044.000 224.000 - -3.45% -
436.cactusADM (avg) (percentage) -76.25% 5.980 1.420 - 12.70% -
445.gobmk -76.02% 196.000 47.000 - 0.00% -
445.gobmk (avg) -76.02% 196.000 47.000 - 0.00% -
482.sphinx3 (avg) (percentage) -75.66% 7.930 1.930 - 1.05% -
400.perlbench (avg) (percentage) -74.80% 6.350 1.600 - 0.00% -
465.tonto -74.25% 365.000 94.000 - -2.08% -
465.tonto (avg) -74.25% 365.000 94.000 - -2.08% -
453.povray (max) -74.15% 499.000 129.000 - -7.19% -
433.milc (avg) (percentage) -73.72% 6.050 1.590 - 0.00% -
483.xalancbmk (max) -73.56% 2621.000 693.000 - -3.48% -
481.wrf (avg) (percentage) -73.56% 6.240 1.650 - 0.00% -
470.lbm (avg) (percentage) -73.30% 6.330 1.690 - 0.00% -
450.soplex (max) -72.66% 545.000 149.000 - -4.49% -
436.cactusADM (max) -71.86% 1848.000 520.000 - 63.52% -
435.gromacs (avg) (percentage) -70.75% 5.060 1.480 - 0.00% -
400.perlbench (max) -70.22% 1397.000 416.000 - -2.35% -
429.mcf -66.97% 109.000 36.000 - -7.69% -
429.mcf (avg) -66.97% 109.000 36.000 - -7.69% -
465.tonto (avg) (percentage) -65.57% 3.340 1.150 - 0.00% -
444.namd (avg) (percentage) -63.23% 9.220 3.390 - 0.00% -
410.bwaves (avg) (percentage) -63.04% 4.410 1.630 - 1.24% -
401.bzip2 -52.80% 161.000 76.000 - 0.00% -
401.bzip2 (avg) -52.80% 161.000 76.000 - 0.00% -
416.gamess (avg) (percentage) -51.58% 4.420 2.140 - 0.00% -
456.hmmer -48.82% 127.000 65.000 - 0.00% -
456.hmmer (avg) -48.82% 127.000 65.000 - 0.00% -
483.xalancbmk -48.79% 248.000 127.000 - -0.78% -
483.xalancbmk (avg) -48.79% 248.000 127.000 - -0.78% -
447.dealII -48.48% 99.000 51.000 - 0.00% -
447.dealII (avg) -48.48% 99.000 51.000 - 0.00% -
435.gromacs -37.06% 367.000 231.000 - 1.32% -
435.gromacs (avg) -37.06% 367.000 231.000 - 1.32% -
437.leslie3d (avg) (percentage) -37.05% 3.050 1.920 - 0.00% -
444.namd (max) -35.47% 685.000 442.000 - 1.38% -
471.omnetpp -34.98% 223.000 145.000 - -8.23% -
471.omnetpp (avg) -34.98% 223.000 145.000 - -8.23% -
459.GemsFDTD -31.67% 360.000 246.000 - -4.65% -
459.GemsFDTD (avg) -31.67% 360.000 246.000 - -4.65% -
482.sphinx3 (max) -31.06% 911.000 628.000 - 3.80% -
481.wrf -22.61% 345.000 267.000 - -3.96% -
481.wrf (avg) -22.61% 345.000 267.000 - -3.96% -
437.leslie3d -20.85% 355.000 281.000 - 3.31% -
437.leslie3d (avg) -20.85% 355.000 281.000 - 3.31% -
416.gamess -17.64% 550.000 453.000 - 3.19% -
416.gamess (avg) -17.64% 550.000 453.000 - 3.19% -
470.lbm -12.97% 239.000 208.000 - -3.70% -
470.lbm (avg) -12.97% 239.000 208.000 - -3.70% -
410.bwaves -10.04% 249.000 224.000 - -0.44% -
410.bwaves (avg) -10.04% 249.000 224.000 - -0.44% -
403.gcc (max) -9.09% 55.000 50.000 - -5.66% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 11106.000 1.83%
401.bzip2 14931.000 -
403.gcc 9060.000 -
410.bwaves 13747.000 -1.78%
416.gamess 21186.000 3.10%
429.mcf 17223.000 -
433.milc 13283.000 2.94%
434.zeusmp 13767.000 2.63%
435.gromacs 15664.000 1.67%
436.cactusADM 18183.000 2.86%
437.leslie3d 14636.000 3.22%
444.namd 9728.000 7.98%
445.gobmk 11660.000 -
447.dealII 9087.000 1.42%
450.soplex 16090.000 2.04%
453.povray 6342.000 -1.99%
454.calculix 21552.000 -21.05%
456.hmmer 11077.000 -
458.sjeng 14178.000 -
459.GemsFDTD 23509.000 -
462.libquantum 11472.000 -1.38%
464.h264ref 13770.000 -
465.tonto 8244.000 -1.93%
470.lbm 12352.000 -3.61%
471.omnetpp 10697.000 -
473.astar 14181.000 -
481.wrf 16203.000 -3.85%
482.sphinx3 29498.000 -2.13%
483.xalancbmk 10751.000 -
Geometric Mean 13500.563 -
Code Size (bytes)
Name Current %
400.perlbench 897072.000 -
401.bzip2 44221.000 -
403.gcc 2437964.000 -
410.bwaves 16768.000 -
416.gamess 5737029.000 -
429.mcf 9123.000 -
433.milc 61238.000 -
434.zeusmp 153681.000 -
435.gromacs 500311.000 -
436.cactusADM 352719.000 -
437.leslie3d 59487.000 -
444.namd 188357.000 -
445.gobmk 1377522.000 -
447.dealII 312832.000 -
450.soplex 207008.000 -
453.povray 661983.000 -
454.calculix 844823.000 -
456.hmmer 108623.000 -
458.sjeng 104004.000 -
459.GemsFDTD 247936.000 -
462.libquantum 16117.000 -
464.h264ref 387436.000 -
465.tonto 1944471.000 -
470.lbm 9687.000 -
471.omnetpp 482480.000 -
473.astar 22952.000 -
481.wrf 1966036.000 -
482.sphinx3 112803.000 -
483.xalancbmk 2341486.000 -
Geometric Mean 224299.171 -
sample variability
Name Current %
400.perlbench 177.000 1.72%
400.perlbench (avg) 177.000 1.72%
400.perlbench (avg) (percentage) 1.600 -
400.perlbench (max) 416.000 -2.35%
400.perlbench (max) (percentage) 3.750 -4.09%
401.bzip2 76.000 -
401.bzip2 (avg) 76.000 -
401.bzip2 (avg) (percentage) 0.510 -
401.bzip2 (max) 173.000 -5.98%
401.bzip2 (max) (percentage) 1.160 -5.69%
403.gcc 29.000 -
403.gcc (avg) 29.000 -
403.gcc (avg) (percentage) 0.330 -
403.gcc (max) 50.000 -5.66%
403.gcc (max) (percentage) 0.560 -5.08%
410.bwaves 224.000 -
410.bwaves (avg) 224.000 -
410.bwaves (avg) (percentage) 1.630 1.24%
410.bwaves (max) 303.000 -12.93%
410.bwaves (max) (percentage) 2.210 -11.24%
410.bwaves (unexplained diff vs previous) 249.000 35.33%
410.bwaves (unexplained diff vs previous) (percentage) 1.810 38.17%
416.gamess 453.000 3.19%
416.gamess (avg) 453.000 3.19%
416.gamess (avg) (percentage) 2.140 -
416.gamess (max) 588.000 -
416.gamess (max) (percentage) 2.780 -3.14%
429.mcf 36.000 -7.69%
429.mcf (avg) 36.000 -7.69%
429.mcf (avg) (percentage) 0.210 -8.70%
429.mcf (max) 6.000 -85.37%
429.mcf (max) (percentage) 0.040 -83.33%
429.mcf (unexplained diff vs previous) 4.000 -50.00%
429.mcf (unexplained diff vs previous) (percentage) 0.020 -60.00%
433.milc 211.000 2.93%
433.milc (avg) 211.000 2.93%
433.milc (avg) (percentage) 1.590 -
433.milc (max) 224.000 -3.45%
433.milc (max) (percentage) 1.690 -6.11%
434.zeusmp 169.000 3.05%
434.zeusmp (avg) 169.000 3.05%
434.zeusmp (avg) (percentage) 1.230 -
434.zeusmp (max) 165.000 -3.51%
434.zeusmp (max) (percentage) 1.200 -6.25%
435.gromacs 231.000 1.32%
435.gromacs (avg) 231.000 1.32%
435.gromacs (avg) (percentage) 1.480 -
435.gromacs (max) 319.000 -3.63%
435.gromacs (max) (percentage) 2.040 -5.12%
436.cactusADM 258.000 16.22%
436.cactusADM (avg) 258.000 16.22%
436.cactusADM (avg) (percentage) 1.420 12.70%
436.cactusADM (max) 520.000 63.52%
436.cactusADM (max) (percentage) 2.860 58.89%
436.cactusADM (unexplained diff vs previous) 505.000 3507.14%
436.cactusADM (unexplained diff vs previous) (percentage) 2.780 3375.00%
437.leslie3d 281.000 3.31%
437.leslie3d (avg) 281.000 3.31%
437.leslie3d (avg) (percentage) 1.920 -
437.leslie3d (max) 392.000 -3.21%
437.leslie3d (max) (percentage) 2.680 -6.29%
444.namd 329.000 7.87%
444.namd (avg) 329.000 7.87%
444.namd (avg) (percentage) 3.390 -
444.namd (max) 442.000 1.38%
444.namd (max) (percentage) 4.550 -6.19%
445.gobmk 47.000 -
445.gobmk (avg) 47.000 -
445.gobmk (avg) (percentage) 0.410 -
445.gobmk (max) 90.000 -5.26%
445.gobmk (max) (percentage) 0.780 -6.02%
447.dealII 51.000 -
447.dealII (avg) 51.000 -
447.dealII (avg) (percentage) 0.570 -
447.dealII (max) 65.000 -4.41%
447.dealII (max) (percentage) 0.720 -6.49%
450.soplex 148.000 2.07%
450.soplex (avg) 148.000 2.07%
450.soplex (avg) (percentage) 0.920 -
450.soplex (max) 149.000 -4.49%
450.soplex (max) (percentage) 0.930 -6.06%
453.povray 64.000 -3.03%
453.povray (avg) 64.000 -3.03%
453.povray (avg) (percentage) 1.020 -
453.povray (max) 129.000 -7.19%
453.povray (max) (percentage) 2.040 -5.12%
454.calculix 73.000 -20.65%
454.calculix (avg) 73.000 -20.65%
454.calculix (avg) (percentage) 0.340 -
454.calculix (max) 79.000 -25.47%
454.calculix (max) (percentage) 0.370 -5.13%
456.hmmer 65.000 -
456.hmmer (avg) 65.000 -
456.hmmer (avg) (percentage) 0.590 -
456.hmmer (max) 74.000 -10.84%
456.hmmer (max) (percentage) 0.670 -10.67%
456.hmmer (unexplained diff vs previous) 60.000 11.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.540 12.50%
458.sjeng 39.000 34.48%
458.sjeng (avg) 39.000 34.48%
458.sjeng (avg) (percentage) 0.280 33.33%
458.sjeng (max) 116.000 93.33%
458.sjeng (max) (percentage) 0.820 90.70%
458.sjeng (unexplained diff vs previous) 116.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.820 -
459.GemsFDTD 246.000 -4.65%
459.GemsFDTD (avg) 246.000 -4.65%
459.GemsFDTD (avg) (percentage) 1.050 -3.67%
459.GemsFDTD (max) 500.000 -5.66%
459.GemsFDTD (max) (percentage) 2.130 -4.91%
459.GemsFDTD (unexplained diff vs previous) 176.000 188.52%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.750 188.46%
462.libquantum 59.000 18.00%
462.libquantum (avg) 59.000 18.00%
462.libquantum (avg) (percentage) 0.520 20.93%
462.libquantum (max) 158.000 62.89%
462.libquantum (max) (percentage) 1.380 64.29%
462.libquantum (unexplained diff vs previous) 161.000 3925.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.400 4566.67%
464.h264ref 50.000 -
464.h264ref (avg) 50.000 -
464.h264ref (avg) (percentage) 0.370 -
464.h264ref (max) 46.000 -6.12%
464.h264ref (max) (percentage) 0.340 -5.56%
465.tonto 94.000 -2.08%
465.tonto (avg) 94.000 -2.08%
465.tonto (avg) (percentage) 1.150 -
465.tonto (max) 159.000 -5.36%
465.tonto (max) (percentage) 1.930 -3.98%
470.lbm 208.000 -3.70%
470.lbm (avg) 208.000 -3.70%
470.lbm (avg) (percentage) 1.690 -
470.lbm (max) 311.000 -9.59%
470.lbm (max) (percentage) 2.520 -6.32%
471.omnetpp 145.000 -8.23%
471.omnetpp (avg) 145.000 -8.23%
471.omnetpp (avg) (percentage) 1.360 -8.11%
471.omnetpp (max) 121.000 -11.68%
471.omnetpp (max) (percentage) 1.140 -10.94%
471.omnetpp (unexplained diff vs previous) 20.000 150.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.190 171.43%
473.astar 29.000 3.57%
473.astar (avg) 29.000 3.57%
473.astar (avg) (percentage) 0.210 -
473.astar (max) 43.000 26.47%
473.astar (max) (percentage) 0.310 29.17%
473.astar (unexplained diff vs previous) 44.000 100.00%
473.astar (unexplained diff vs previous) (percentage) 0.310 106.67%
481.wrf 267.000 -3.96%
481.wrf (avg) 267.000 -3.96%
481.wrf (avg) (percentage) 1.650 -
481.wrf (max) 536.000 -7.43%
481.wrf (max) (percentage) 3.310 -3.78%
482.sphinx3 569.000 -1.04%
482.sphinx3 (avg) 569.000 -1.04%
482.sphinx3 (avg) (percentage) 1.930 1.05%
482.sphinx3 (max) 628.000 3.80%
482.sphinx3 (max) (percentage) 2.130 5.97%
482.sphinx3 (unexplained diff vs previous) 642.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.180 -
483.xalancbmk 127.000 -
483.xalancbmk (avg) 127.000 -
483.xalancbmk (avg) (percentage) 1.190 -
483.xalancbmk (max) 693.000 -3.48%
483.xalancbmk (max) (percentage) 6.450 -3.15%
Geometric Mean 17.290 11.80%