Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=02d44d76584e4d483fe0fc677c12066ec23d67f4 (+ 26 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/d0b961b802dd7d9d555ff4515835a479329326e9 (+ 27 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=16439f419b270184ec501c531bf20d83b6745fb0 (+ 26 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/29/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0029 (3-changed-components) 2023-04-02T11:43:40 0:00:00
Previous 0028 (basepoints/gcc-13-06968-g69044e11ac5) 2023-03-31T16:26:00 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 43 13
Performance Improvements 115 196
Added Tests 12 0
Unchanged Tests 1066 1027
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.39% 59.000 61.000 - 8.93% -
435.gromacs 2.03% 7236.000 7383.000 - 1.57% -
465.tonto 1.59% 10898.000 11071.000 - 1.19% -
482.sphinx3 1.49% 938.000 952.000 - 0.74% -
445.gobmk 1.27% 5037.000 5101.000 - 1.55% -
471.omnetpp 1.07% 2700.000 2729.000 - 0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 1414.29% 0.070 1.060 - -99.73% -
471.omnetpp (unexplained diff vs previous) 1350.00% 2.000 29.000 - -99.73% -
464.h264ref (unexplained diff vs previous) 400.00% 9.000 45.000 - -99.34% -
464.h264ref (unexplained diff vs previous) (percentage) 393.75% 0.160 0.790 - -99.33% -
435.gromacs (unexplained diff vs previous) 267.50% 40.000 147.000 - -97.91% -
435.gromacs (unexplained diff vs previous) (percentage) 261.82% 0.550 1.990 - -97.94% -
410.bwaves (unexplained diff vs previous) (percentage) 121.43% 0.280 0.620 - -99.55% -
410.bwaves (unexplained diff vs previous) 118.75% 16.000 35.000 - -99.55% -
429.mcf (unexplained diff vs previous) (percentage) 112.82% 0.780 1.660 - -99.87% -
429.mcf (unexplained diff vs previous) 109.09% 11.000 23.000 - -99.88% -
401.bzip2 (unexplained diff vs previous) (percentage) 97.01% 0.670 1.320 - -99.64% -
401.bzip2 (unexplained diff vs previous) 95.00% 20.000 39.000 - -99.64% -
401.bzip2 (max) (percentage) 94.03% 0.670 1.300 - -98.35% -
401.bzip2 (max) 90.00% 20.000 38.000 - -98.36% -
447.dealII (unexplained diff vs previous) 71.43% 7.000 12.000 - -99.83% -
447.dealII (unexplained diff vs previous) (percentage) 70.73% 0.410 0.700 - -99.83% -
462.libquantum (max) (percentage) 70.24% 0.840 1.430 - -98.56% -
482.sphinx3 (unexplained diff vs previous) 55.56% 9.000 14.000 - -99.95% -
482.sphinx3 (unexplained diff vs previous) (percentage) 53.12% 0.960 1.470 - -99.95% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 47.62% 0.210 0.310 - -99.88% -
459.GemsFDTD (unexplained diff vs previous) 46.15% 13.000 19.000 - -99.88% -
482.sphinx3 (max) 40.00% 10.000 14.000 - -98.46% -
482.sphinx3 (max) (percentage) 39.25% 1.070 1.490 - -98.46% -
435.gromacs (max) 36.70% 109.000 149.000 - -95.83% -
435.gromacs (max) (percentage) 33.55% 1.520 2.030 - -95.87% -
429.mcf (max) (percentage) 25.38% 1.300 1.630 - -98.25% -
434.zeusmp (max) (percentage) 24.56% 0.570 0.710 - -99.13% -
429.mcf (max) 22.22% 18.000 22.000 - -98.34% -
434.zeusmp (max) 21.43% 14.000 17.000 - -99.17% -
464.h264ref (max) (percentage) 6.76% 0.740 0.790 - -98.54% -
445.gobmk (max) 6.67% 60.000 64.000 - -97.58% -
445.gobmk (max) (percentage) 4.96% 1.210 1.270 - -97.59% -
464.h264ref (max) 4.76% 42.000 44.000 - -98.59% -
453.povray (max) (percentage) 4.35% 0.690 0.720 - -99.21% -
437.leslie3d (avg) (percentage) 2.05% 4.380 4.470 - 46.56% -
465.tonto 1.74% 288.000 293.000 - -19.73% -
465.tonto (avg) 1.74% 288.000 293.000 - -19.73% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -6.86% 12034.000 11209.000 - -3.70% -
429.mcf -1.63% 1411.000 1388.000 - -2.53% -
454.calculix -1.61% 62.000 61.000 - -1.61% -
462.libquantum -1.43% 140.000 138.000 - -1.43% -
401.bzip2 -1.30% 2991.000 2952.000 - 0.37% -
483.xalancbmk -1.06% 3862.000 3821.000 - 0.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) -92.31% 39.000 3.000 - -99.97% -
473.astar (unexplained diff vs previous) (percentage) -92.11% 0.760 0.060 - -99.97% -
470.lbm (unexplained diff vs previous) (percentage) -88.10% 0.420 0.050 - -99.98% -
470.lbm (unexplained diff vs previous) -87.50% 16.000 2.000 - -99.98% -
444.namd (unexplained diff vs previous) -60.00% 5.000 2.000 - -99.98% -
450.soplex (max) -60.00% 5.000 2.000 - -99.63% -
456.hmmer (unexplained diff vs previous) -60.00% 10.000 4.000 - -99.95% -
456.hmmer (unexplained diff vs previous) (percentage) -60.00% 0.350 0.140 - -99.95% -
444.namd (unexplained diff vs previous) (percentage) -59.70% 0.670 0.270 - -99.98% -
450.soplex (max) (percentage) -50.50% 1.010 0.500 - -99.48% -
437.leslie3d (unexplained diff vs previous) -49.60% 1637.000 825.000 - -64.35% -
483.xalancbmk (max) -48.42% 95.000 49.000 - -98.13% -
483.xalancbmk (max) (percentage) -47.15% 2.460 1.300 - -98.11% -
437.leslie3d (unexplained diff vs previous) (percentage) -45.88% 13.600 7.360 - -62.98% -
436.cactusADM (unexplained diff vs previous) (percentage) -42.11% 0.570 0.330 - -99.96% -
436.cactusADM (unexplained diff vs previous) -41.67% 12.000 7.000 - -99.96% -
470.lbm (max) (percentage) -41.67% 0.600 0.350 - -99.52% -
470.lbm (max) -40.91% 22.000 13.000 - -99.53% -
437.leslie3d (max) -14.63% 1894.000 1617.000 - -16.17% -
458.sjeng (unexplained diff vs previous) (percentage) -13.64% 0.440 0.380 - -99.58% -
473.astar (max) -13.16% 38.000 33.000 - -99.03% -
458.sjeng (unexplained diff vs previous) -12.12% 33.000 29.000 - -99.58% -
473.astar (max) (percentage) -12.00% 0.750 0.660 - -99.01% -
459.GemsFDTD (max) -10.71% 28.000 25.000 - -99.43% -
459.GemsFDTD (max) (percentage) -10.64% 0.470 0.420 - -99.41% -
444.namd (max) (percentage) -10.26% 0.780 0.700 - -99.24% -
456.hmmer (max) -10.00% 10.000 9.000 - -99.58% -
456.hmmer (max) (percentage) -8.57% 0.350 0.320 - -99.57% -
437.leslie3d (max) (percentage) -8.32% 15.740 14.430 - -12.97% -
433.milc (max) (percentage) -6.12% 0.490 0.460 - -99.49% -
447.dealII (max) -5.26% 19.000 18.000 - -98.70% -
437.leslie3d -4.93% 527.000 501.000 - 41.13% -
437.leslie3d (avg) -4.93% 527.000 501.000 - 41.13% -
416.gamess (avg) (percentage) -4.50% 2.220 2.120 - -52.04% -
465.tonto (max) (percentage) -4.46% 1.120 1.070 - -94.46% -
471.omnetpp (max) (percentage) -4.44% 1.350 1.290 - -98.38% -
416.gamess -4.36% 275.000 263.000 - -52.18% -
416.gamess (avg) -4.36% 275.000 263.000 - -52.18% -
433.milc -4.35% 46.000 44.000 - -36.23% -
433.milc (avg) -4.35% 46.000 44.000 - -36.23% -
453.povray -4.35% 23.000 22.000 - -47.62% -
453.povray (avg) -4.35% 23.000 22.000 - -47.62% -
447.dealII (max) (percentage) -4.35% 1.150 1.100 - -98.63% -
483.xalancbmk -4.22% 166.000 159.000 - -35.89% -
483.xalancbmk (avg) -4.22% 166.000 159.000 - -35.89% -
450.soplex -4.17% 24.000 23.000 - -36.11% -
450.soplex (avg) -4.17% 24.000 23.000 - -36.11% -
429.mcf -4.11% 146.000 140.000 - 28.44% -
429.mcf (avg) -4.11% 146.000 140.000 - 28.44% -
400.perlbench (max) -3.57% 28.000 27.000 - -98.07% -
450.soplex (avg) (percentage) -3.55% 4.230 4.080 - -36.55% -
447.dealII -3.51% 57.000 55.000 - -44.44% -
447.dealII (avg) -3.51% 57.000 55.000 - -44.44% -
470.lbm -3.50% 143.000 138.000 - -42.26% -
470.lbm (avg) -3.50% 143.000 138.000 - -42.26% -
464.h264ref -3.47% 173.000 167.000 - -43.00% -
464.h264ref (avg) -3.47% 173.000 167.000 - -43.00% -
444.namd (avg) (percentage) -3.44% 5.240 5.060 - -45.12% -
453.povray (avg) (percentage) -3.31% 4.230 4.090 - -47.63% -
456.hmmer (avg) (percentage) -3.28% 2.440 2.360 - -46.49% -
465.tonto (max) -3.28% 122.000 118.000 - -94.41% -
434.zeusmp -3.26% 92.000 89.000 - -39.46% -
434.zeusmp (avg) -3.26% 92.000 89.000 - -39.46% -
459.GemsFDTD (avg) (percentage) -3.22% 3.730 3.610 - -38.18% -
458.sjeng -3.18% 157.000 152.000 - -36.93% -
458.sjeng (avg) -3.18% 157.000 152.000 - -36.93% -
401.bzip2 -3.09% 97.000 94.000 - -41.61% -
401.bzip2 (avg) -3.09% 97.000 94.000 - -41.61% -
410.bwaves -3.09% 162.000 157.000 - -36.95% -
410.bwaves (avg) -3.09% 162.000 157.000 - -36.95% -
483.xalancbmk (avg) (percentage) -3.02% 4.310 4.180 - -35.69% -
447.dealII (avg) (percentage) -2.99% 3.340 3.240 - -43.85% -
473.astar -2.98% 168.000 163.000 - -23.47% -
473.astar (avg) -2.98% 168.000 163.000 - -23.47% -
433.milc (avg) (percentage) -2.96% 4.050 3.930 - -35.04% -
470.lbm (avg) (percentage) -2.92% 3.770 3.660 - -42.18% -
429.mcf (avg) (percentage) -2.89% 10.390 10.090 - 31.55% -
458.sjeng (avg) (percentage) -2.88% 2.080 2.020 - -36.68% -
400.perlbench (max) (percentage) -2.87% 1.740 1.690 - -97.99% -
410.bwaves (max) -2.86% 35.000 34.000 - -98.96% -
456.hmmer -2.86% 70.000 68.000 - -46.46% -
456.hmmer (avg) -2.86% 70.000 68.000 - -46.46% -
436.cactusADM (avg) (percentage) -2.85% 4.210 4.090 - -31.61% -
471.omnetpp (max) -2.78% 36.000 35.000 - -98.39% -
473.astar (avg) (percentage) -2.75% 3.270 3.180 - -23.56% -
434.zeusmp (avg) (percentage) -2.72% 3.670 3.570 - -38.97% -
403.gcc (max) (percentage) -2.72% 7.710 7.500 - -92.45% -
464.h264ref (avg) (percentage) -2.63% 3.040 2.960 - -41.85% -
444.namd -2.63% 38.000 37.000 - -45.59% -
444.namd (avg) -2.63% 38.000 37.000 - -45.59% -
459.GemsFDTD -2.62% 229.000 223.000 - -38.06% -
459.GemsFDTD (avg) -2.62% 229.000 223.000 - -38.06% -
471.omnetpp (avg) (percentage) -2.52% 5.160 5.030 - -38.66% -
410.bwaves (avg) (percentage) -2.45% 2.860 2.790 - -36.73% -
436.cactusADM (max) -2.38% 42.000 41.000 - -97.78% -
482.sphinx3 (avg) (percentage) -2.29% 4.810 4.700 - -40.73% -
436.cactusADM -2.27% 88.000 86.000 - -30.65% -
436.cactusADM (avg) -2.27% 88.000 86.000 - -30.65% -
482.sphinx3 -2.22% 45.000 44.000 - -40.54% -
482.sphinx3 (avg) -2.22% 45.000 44.000 - -40.54% -
401.bzip2 (avg) (percentage) -2.14% 3.270 3.200 - -41.61% -
462.libquantum (avg) (percentage) -2.00% 4.500 4.410 - -42.43% -
435.gromacs (avg) (percentage) -1.71% 3.510 3.450 - -31.82% -
445.gobmk (avg) (percentage) -1.68% 2.380 2.340 - -40.15% -
481.wrf (max) -1.60% 125.000 123.000 - -96.76% -
436.cactusADM (max) (percentage) -1.49% 2.020 1.990 - -97.76% -
471.omnetpp -1.44% 139.000 137.000 - -38.57% -
471.omnetpp (avg) -1.44% 139.000 137.000 - -38.57% -
481.wrf (max) (percentage) -1.30% 2.300 2.270 - -96.70% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.92% 104048.000 108124.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 8.93% 56.000 61.000 - 3.39% -
435.gromacs 1.57% 7269.000 7383.000 - 2.03% -
445.gobmk 1.55% 5023.000 5101.000 - 1.27% -
450.soplex 1.41% 567.000 575.000 - 0.17% -
465.tonto 1.19% 10941.000 11071.000 - 1.59% -
436.cactusADM 1.10% 2083.000 2106.000 - 0.33% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 46.56% 3.050 4.470 - 2.05% -
437.leslie3d 41.13% 355.000 501.000 - -4.93% -
437.leslie3d (avg) 41.13% 355.000 501.000 - -4.93% -
429.mcf (avg) (percentage) 31.55% 7.670 10.090 - -2.89% -
429.mcf 28.44% 109.000 140.000 - -4.11% -
429.mcf (avg) 28.44% 109.000 140.000 - -4.11% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.13% 387748.000 383368.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -3.70% 11640.000 11209.000 - -6.86% -
429.mcf -2.53% 1424.000 1388.000 - -1.63% -
481.wrf -1.92% 5534.000 5428.000 - -0.49% -
400.perlbench -1.68% 1663.000 1635.000 - -0.49% -
464.h264ref -1.61% 5761.000 5668.000 - -0.79% -
454.calculix -1.61% 62.000 61.000 - -1.61% -
462.libquantum -1.43% 140.000 138.000 - -1.43% -
447.dealII -1.10% 1724.000 1705.000 - -0.70% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex (unexplained diff vs previous) (percentage) -99.99% 2557.320 0.170 - 0.00% -
450.soplex (unexplained diff vs previous) -99.99% 14500.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.450 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.98% 263.730 0.050 - -88.10% -
470.lbm (unexplained diff vs previous) -99.98% 9990.000 2.000 - -87.50% -
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 - -60.00% -
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.270 - -59.70% -
473.astar (unexplained diff vs previous) -99.97% 10146.000 3.000 - -92.31% -
473.astar (unexplained diff vs previous) (percentage) -99.97% 197.850 0.060 - -92.11% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 4.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.350 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.96% 787.130 0.330 - -42.11% -
436.cactusADM (unexplained diff vs previous) -99.96% 16396.000 7.000 - -41.67% -
416.gamess (unexplained diff vs previous) (percentage) -99.95% 62.730 0.030 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.95% 8030.000 4.000 - -60.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.95% 278.630 0.140 - -60.00% -
416.gamess (unexplained diff vs previous) -99.95% 7819.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.470 - 53.12% -
482.sphinx3 (unexplained diff vs previous) -99.95% 26073.000 14.000 - 55.56% -
453.povray (unexplained diff vs previous) (percentage) -99.93% 1043.330 0.730 - 0.00% -
453.povray (unexplained diff vs previous) -99.93% 5707.000 4.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.88% 15458.000 19.000 - 46.15% -
429.mcf (unexplained diff vs previous) -99.88% 18593.000 23.000 - 109.09% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.88% 250.410 0.310 - 47.62% -
429.mcf (unexplained diff vs previous) (percentage) -99.87% 1305.690 1.660 - 112.82% -
434.zeusmp (unexplained diff vs previous) -99.84% 11280.000 18.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.84% 448.690 0.720 - 0.00% -
447.dealII (unexplained diff vs previous) -99.83% 7017.000 12.000 - 71.43% -
447.dealII (unexplained diff vs previous) (percentage) -99.83% 407.020 0.700 - 70.73% -
416.gamess (max) -99.73% 4805.000 13.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.73% 391.300 1.060 - 1414.29% -
471.omnetpp (unexplained diff vs previous) -99.73% 10659.000 29.000 - 1350.00% -
416.gamess (max) (percentage) -99.71% 38.550 0.110 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.64% 368.340 1.320 - 97.01% -
401.bzip2 (unexplained diff vs previous) -99.64% 10833.000 39.000 - 95.00% -
450.soplex (max) -99.63% 545.000 2.000 - -60.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.58% 90.870 0.380 - -13.64% -
458.sjeng (unexplained diff vs previous) -99.58% 6876.000 29.000 - -12.12% -
456.hmmer (max) -99.58% 2120.000 9.000 - -10.00% -
456.hmmer (max) (percentage) -99.57% 73.590 0.320 - -8.57% -
410.bwaves (unexplained diff vs previous) -99.55% 7794.000 35.000 - 118.75% -
410.bwaves (unexplained diff vs previous) (percentage) -99.55% 137.900 0.620 - 121.43% -
470.lbm (max) -99.53% 2746.000 13.000 - -40.91% -
433.milc (max) -99.52% 1044.000 5.000 - 0.00% -
470.lbm (max) (percentage) -99.52% 72.510 0.350 - -41.67% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.51% 219.170 1.070 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -99.51% 8368.000 41.000 - 0.00% -
433.milc (max) (percentage) -99.49% 90.750 0.460 - -6.12% -
450.soplex (max) (percentage) -99.48% 96.240 0.500 - -50.50% -
459.GemsFDTD (max) -99.43% 4411.000 25.000 - -10.71% -
459.GemsFDTD (max) (percentage) -99.41% 71.460 0.420 - -10.64% -
453.povray (max) -99.40% 499.000 3.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.34% 6843.000 45.000 - 400.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.33% 118.780 0.790 - 393.75% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
444.namd (max) -99.27% 685.000 5.000 - 0.00% -
444.namd (max) (percentage) -99.24% 91.790 0.700 - -10.26% -
453.povray (max) (percentage) -99.21% 91.250 0.720 - 4.35% -
434.zeusmp (max) -99.17% 2055.000 17.000 - 21.43% -
434.zeusmp (max) (percentage) -99.13% 81.770 0.710 - 24.56% -
473.astar (max) -99.03% 3406.000 33.000 - -13.16% -
473.astar (max) (percentage) -99.01% 66.430 0.660 - -12.00% -
410.bwaves (max) -98.96% 3276.000 34.000 - -2.86% -
410.bwaves (max) (percentage) -98.93% 57.970 0.620 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.87% 111.110 1.250 - 0.00% -
445.gobmk (unexplained diff vs previous) -98.85% 5581.000 64.000 - 0.00% -
458.sjeng (max) -98.78% 3602.000 44.000 - 0.00% -
458.sjeng (max) (percentage) -98.76% 47.610 0.590 - 0.00% -
447.dealII (max) -98.70% 1384.000 18.000 - -5.26% -
447.dealII (max) (percentage) -98.63% 80.280 1.100 - -4.35% -
464.h264ref (max) -98.59% 3127.000 44.000 - 4.76% -
462.libquantum (max) (percentage) -98.56% 98.970 1.430 - 70.24% -
464.h264ref (max) (percentage) -98.54% 54.290 0.790 - 6.76% -
482.sphinx3 (max) -98.46% 911.000 14.000 - 40.00% -
482.sphinx3 (max) (percentage) -98.46% 96.500 1.490 - 39.25% -
471.omnetpp (max) -98.39% 2169.000 35.000 - -2.78% -
471.omnetpp (max) (percentage) -98.38% 79.650 1.290 - -4.44% -
401.bzip2 (max) -98.36% 2313.000 38.000 - 90.00% -
401.bzip2 (max) (percentage) -98.35% 78.650 1.300 - 94.03% -
429.mcf (max) -98.34% 1322.000 22.000 - 22.22% -
429.mcf (max) (percentage) -98.25% 92.890 1.630 - 25.38% -
483.xalancbmk (max) -98.13% 2621.000 49.000 - -48.42% -
483.xalancbmk (max) (percentage) -98.11% 68.670 1.300 - -47.15% -
400.perlbench (max) -98.07% 1397.000 27.000 - -3.57% -
400.perlbench (max) (percentage) -97.99% 84.060 1.690 - -2.87% -
435.gromacs (unexplained diff vs previous) (percentage) -97.94% 96.680 1.990 - 261.82% -
435.gromacs (unexplained diff vs previous) -97.91% 7028.000 147.000 - 267.50% -
436.cactusADM (max) -97.78% 1848.000 41.000 - -2.38% -
436.cactusADM (max) (percentage) -97.76% 88.730 1.990 - -1.49% -
445.gobmk (max) (percentage) -97.59% 52.630 1.270 - 4.96% -
445.gobmk (max) -97.58% 2643.000 64.000 - 6.67% -
481.wrf (max) -96.76% 3801.000 123.000 - -1.60% -
454.calculix (max) -96.72% 61.000 2.000 - 0.00% -
481.wrf (max) (percentage) -96.70% 68.700 2.270 - -1.30% -
454.calculix (max) (percentage) -96.15% 99.730 3.840 - 0.00% -
435.gromacs (max) (percentage) -95.87% 49.160 2.030 - 33.55% -
435.gromacs (max) -95.83% 3573.000 149.000 - 36.70% -
465.tonto (max) (percentage) -94.46% 19.310 1.070 - -4.46% -
465.tonto (max) -94.41% 2112.000 118.000 - -3.28% -
403.gcc (max) -92.73% 55.000 4.000 - 0.00% -
403.gcc (max) (percentage) -92.45% 99.360 7.500 - -2.72% -
437.leslie3d (unexplained diff vs previous) -64.35% 2314.000 825.000 - -49.60% -
437.leslie3d (unexplained diff vs previous) (percentage) -62.98% 19.880 7.360 - -45.88% -
416.gamess -52.18% 550.000 263.000 - -4.36% -
416.gamess (avg) -52.18% 550.000 263.000 - -4.36% -
416.gamess (avg) (percentage) -52.04% 4.420 2.120 - -4.50% -
453.povray (avg) (percentage) -47.63% 7.810 4.090 - -3.31% -
453.povray -47.62% 42.000 22.000 - -4.35% -
453.povray (avg) -47.62% 42.000 22.000 - -4.35% -
456.hmmer (avg) (percentage) -46.49% 4.410 2.360 - -3.28% -
456.hmmer -46.46% 127.000 68.000 - -2.86% -
456.hmmer (avg) -46.46% 127.000 68.000 - -2.86% -
444.namd -45.59% 68.000 37.000 - -2.63% -
444.namd (avg) -45.59% 68.000 37.000 - -2.63% -
444.namd (avg) (percentage) -45.12% 9.220 5.060 - -3.44% -
447.dealII -44.44% 99.000 55.000 - -3.51% -
447.dealII (avg) -44.44% 99.000 55.000 - -3.51% -
447.dealII (avg) (percentage) -43.85% 5.770 3.240 - -2.99% -
464.h264ref -43.00% 293.000 167.000 - -3.47% -
464.h264ref (avg) -43.00% 293.000 167.000 - -3.47% -
462.libquantum (avg) (percentage) -42.43% 7.660 4.410 - -2.00% -
481.wrf -42.32% 345.000 199.000 - -0.50% -
481.wrf (avg) -42.32% 345.000 199.000 - -0.50% -
470.lbm -42.26% 239.000 138.000 - -3.50% -
470.lbm (avg) -42.26% 239.000 138.000 - -3.50% -
470.lbm (avg) (percentage) -42.18% 6.330 3.660 - -2.92% -
464.h264ref (avg) (percentage) -41.85% 5.090 2.960 - -2.63% -
401.bzip2 -41.61% 161.000 94.000 - -3.09% -
401.bzip2 (avg) -41.61% 161.000 94.000 - -3.09% -
401.bzip2 (avg) (percentage) -41.61% 5.480 3.200 - -2.14% -
481.wrf (avg) (percentage) -41.03% 6.240 3.680 - 0.00% -
482.sphinx3 (avg) (percentage) -40.73% 7.930 4.700 - -2.29% -
482.sphinx3 -40.54% 74.000 44.000 - -2.22% -
482.sphinx3 (avg) -40.54% 74.000 44.000 - -2.22% -
445.gobmk (avg) (percentage) -40.15% 3.910 2.340 - -1.68% -
462.libquantum -40.00% 10.000 6.000 - 0.00% -
462.libquantum (avg) -40.00% 10.000 6.000 - 0.00% -
434.zeusmp -39.46% 147.000 89.000 - -3.26% -
434.zeusmp (avg) -39.46% 147.000 89.000 - -3.26% -
445.gobmk -39.29% 196.000 119.000 - 0.00% -
445.gobmk (avg) -39.29% 196.000 119.000 - 0.00% -
400.perlbench -39.05% 105.000 64.000 - 0.00% -
400.perlbench (avg) -39.05% 105.000 64.000 - 0.00% -
434.zeusmp (avg) (percentage) -38.97% 5.850 3.570 - -2.72% -
471.omnetpp (avg) (percentage) -38.66% 8.200 5.030 - -2.52% -
471.omnetpp -38.57% 223.000 137.000 - -1.44% -
471.omnetpp (avg) -38.57% 223.000 137.000 - -1.44% -
400.perlbench (avg) (percentage) -38.27% 6.350 3.920 - 0.00% -
459.GemsFDTD (avg) (percentage) -38.18% 5.840 3.610 - -3.22% -
454.calculix (avg) (percentage) -38.15% 8.020 4.960 - 0.00% -
459.GemsFDTD -38.06% 360.000 223.000 - -2.62% -
459.GemsFDTD (avg) -38.06% 360.000 223.000 - -2.62% -
410.bwaves -36.95% 249.000 157.000 - -3.09% -
410.bwaves (avg) -36.95% 249.000 157.000 - -3.09% -
458.sjeng -36.93% 241.000 152.000 - -3.18% -
458.sjeng (avg) -36.93% 241.000 152.000 - -3.18% -
410.bwaves (avg) (percentage) -36.73% 4.410 2.790 - -2.45% -
458.sjeng (avg) (percentage) -36.68% 3.190 2.020 - -2.88% -
450.soplex (avg) (percentage) -36.55% 6.430 4.080 - -3.55% -
433.milc -36.23% 69.000 44.000 - -4.35% -
433.milc (avg) -36.23% 69.000 44.000 - -4.35% -
450.soplex -36.11% 36.000 23.000 - -4.17% -
450.soplex (avg) -36.11% 36.000 23.000 - -4.17% -
483.xalancbmk -35.89% 248.000 159.000 - -4.22% -
483.xalancbmk (avg) -35.89% 248.000 159.000 - -4.22% -
483.xalancbmk (avg) (percentage) -35.69% 6.500 4.180 - -3.02% -
433.milc (avg) (percentage) -35.04% 6.050 3.930 - -2.96% -
435.gromacs (avg) (percentage) -31.82% 5.060 3.450 - -1.71% -
436.cactusADM (avg) (percentage) -31.61% 5.980 4.090 - -2.85% -
435.gromacs -30.79% 367.000 254.000 - 0.40% -
435.gromacs (avg) -30.79% 367.000 254.000 - 0.40% -
436.cactusADM -30.65% 124.000 86.000 - -2.27% -
436.cactusADM (avg) -30.65% 124.000 86.000 - -2.27% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
454.calculix -25.00% 4.000 3.000 - 0.00% -
454.calculix (avg) -25.00% 4.000 3.000 - 0.00% -
473.astar (avg) (percentage) -23.56% 4.160 3.180 - -2.75% -
473.astar -23.47% 213.000 163.000 - -2.98% -
473.astar (avg) -23.47% 213.000 163.000 - -2.98% -
465.tonto (avg) (percentage) -20.66% 3.340 2.650 - 0.00% -
465.tonto -19.73% 365.000 293.000 - 1.74% -
465.tonto (avg) -19.73% 365.000 293.000 - 1.74% -
437.leslie3d (max) -16.17% 1929.000 1617.000 - -14.63% -
437.leslie3d (max) (percentage) -12.97% 16.580 14.430 - -8.32% -
403.gcc (avg) (percentage) -12.02% 7.320 6.440 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1635.000 -
401.bzip2 2952.000 -1.30%
403.gcc 61.000 3.39%
410.bwaves 5642.000 -
416.gamess 12428.000 -
429.mcf 1388.000 -1.63%
433.milc 1145.000 -
434.zeusmp 2507.000 -
435.gromacs 7383.000 2.03%
436.cactusADM 2106.000 -
437.leslie3d 11209.000 -6.86%
444.namd 746.000 -
445.gobmk 5101.000 1.27%
447.dealII 1705.000 -
450.soplex 575.000 -
453.povray 549.000 -
454.calculix 61.000 -1.61%
456.hmmer 2900.000 -
458.sjeng 7535.000 -
459.GemsFDTD 6178.000 -
462.libquantum 138.000 -1.43%
464.h264ref 5668.000 -
465.tonto 11071.000 1.59%
470.lbm 3792.000 -
471.omnetpp 2729.000 1.07%
473.astar 5142.000 -
481.wrf 5428.000 -
482.sphinx3 952.000 1.49%
483.xalancbmk 3821.000 -1.06%
Geometric Mean 2099.670 -
Code Size (bytes)
Name Current %
400.perlbench 889147.000 -
401.bzip2 44233.000 -
403.gcc 2443867.000 -
410.bwaves 16760.000 -
416.gamess 5751013.000 -
429.mcf 9123.000 -
433.milc 61378.000 -
434.zeusmp 152125.000 -
435.gromacs 498901.000 -
436.cactusADM 352895.000 -
437.leslie3d 59475.000 -
444.namd 188340.000 -
445.gobmk 1377562.000 -
447.dealII 312935.000 -
450.soplex 205105.000 -
453.povray 661073.000 -
454.calculix 845170.000 -
456.hmmer 108667.000 -
458.sjeng 108124.000 -
459.GemsFDTD 245032.000 -
462.libquantum 16085.000 -
464.h264ref 383368.000 -
465.tonto 1950214.000 -
470.lbm 9691.000 -
471.omnetpp 478063.000 -
473.astar 22956.000 -
481.wrf 1960014.000 -
482.sphinx3 112795.000 -
483.xalancbmk 2343606.000 -
Geometric Mean 224163.538 -
sample variability
Name Current %
400.perlbench 64.000 -
400.perlbench (avg) 64.000 -
400.perlbench (avg) (percentage) 3.920 -
400.perlbench (max) 27.000 -3.57%
400.perlbench (max) (percentage) 1.690 -2.87%
401.bzip2 94.000 -3.09%
401.bzip2 (avg) 94.000 -3.09%
401.bzip2 (avg) (percentage) 3.200 -2.14%
401.bzip2 (max) 38.000 90.00%
401.bzip2 (max) (percentage) 1.300 94.03%
401.bzip2 (unexplained diff vs previous) 39.000 95.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.320 97.01%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.440 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.500 -2.72%
410.bwaves 157.000 -3.09%
410.bwaves (avg) 157.000 -3.09%
410.bwaves (avg) (percentage) 2.790 -2.45%
410.bwaves (max) 34.000 -2.86%
410.bwaves (max) (percentage) 0.620 -
410.bwaves (unexplained diff vs previous) 35.000 118.75%
410.bwaves (unexplained diff vs previous) (percentage) 0.620 121.43%
416.gamess 263.000 -4.36%
416.gamess (avg) 263.000 -4.36%
416.gamess (avg) (percentage) 2.120 -4.50%
416.gamess (max) 13.000 -
416.gamess (max) (percentage) 0.110 -
416.gamess (unexplained diff vs previous) 4.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.030 -
429.mcf 140.000 -4.11%
429.mcf (avg) 140.000 -4.11%
429.mcf (avg) (percentage) 10.090 -2.89%
429.mcf (max) 22.000 22.22%
429.mcf (max) (percentage) 1.630 25.38%
429.mcf (unexplained diff vs previous) 23.000 109.09%
429.mcf (unexplained diff vs previous) (percentage) 1.660 112.82%
433.milc 44.000 -4.35%
433.milc (avg) 44.000 -4.35%
433.milc (avg) (percentage) 3.930 -2.96%
433.milc (max) 5.000 -
433.milc (max) (percentage) 0.460 -6.12%
433.milc (unexplained diff vs previous) 4.000 -
433.milc (unexplained diff vs previous) (percentage) 0.350 -
434.zeusmp 89.000 -3.26%
434.zeusmp (avg) 89.000 -3.26%
434.zeusmp (avg) (percentage) 3.570 -2.72%
434.zeusmp (max) 17.000 21.43%
434.zeusmp (max) (percentage) 0.710 24.56%
434.zeusmp (unexplained diff vs previous) 18.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.720 -
435.gromacs 254.000 -
435.gromacs (avg) 254.000 -
435.gromacs (avg) (percentage) 3.450 -1.71%
435.gromacs (max) 149.000 36.70%
435.gromacs (max) (percentage) 2.030 33.55%
435.gromacs (unexplained diff vs previous) 147.000 267.50%
435.gromacs (unexplained diff vs previous) (percentage) 1.990 261.82%
436.cactusADM 86.000 -2.27%
436.cactusADM (avg) 86.000 -2.27%
436.cactusADM (avg) (percentage) 4.090 -2.85%
436.cactusADM (max) 41.000 -2.38%
436.cactusADM (max) (percentage) 1.990 -1.49%
436.cactusADM (unexplained diff vs previous) 7.000 -41.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.330 -42.11%
437.leslie3d 501.000 -4.93%
437.leslie3d (avg) 501.000 -4.93%
437.leslie3d (avg) (percentage) 4.470 2.05%
437.leslie3d (max) 1617.000 -14.63%
437.leslie3d (max) (percentage) 14.430 -8.32%
437.leslie3d (unexplained diff vs previous) 825.000 -49.60%
437.leslie3d (unexplained diff vs previous) (percentage) 7.360 -45.88%
444.namd 37.000 -2.63%
444.namd (avg) 37.000 -2.63%
444.namd (avg) (percentage) 5.060 -3.44%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.700 -10.26%
444.namd (unexplained diff vs previous) 2.000 -60.00%
444.namd (unexplained diff vs previous) (percentage) 0.270 -59.70%
445.gobmk 119.000 -
445.gobmk (avg) 119.000 -
445.gobmk (avg) (percentage) 2.340 -1.68%
445.gobmk (max) 64.000 6.67%
445.gobmk (max) (percentage) 1.270 4.96%
445.gobmk (unexplained diff vs previous) 64.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.250 -
447.dealII 55.000 -3.51%
447.dealII (avg) 55.000 -3.51%
447.dealII (avg) (percentage) 3.240 -2.99%
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.100 -4.35%
447.dealII (unexplained diff vs previous) 12.000 71.43%
447.dealII (unexplained diff vs previous) (percentage) 0.700 70.73%
450.soplex 23.000 -4.17%
450.soplex (avg) 23.000 -4.17%
450.soplex (avg) (percentage) 4.080 -3.55%
450.soplex (max) 2.000 -60.00%
450.soplex (max) (percentage) 0.500 -50.50%
450.soplex (unexplained diff vs previous) 1.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.170 -
453.povray 22.000 -4.35%
453.povray (avg) 22.000 -4.35%
453.povray (avg) (percentage) 4.090 -3.31%
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.720 4.35%
453.povray (unexplained diff vs previous) 4.000 -
453.povray (unexplained diff vs previous) (percentage) 0.730 -
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 4.960 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.840 -
456.hmmer 68.000 -2.86%
456.hmmer (avg) 68.000 -2.86%
456.hmmer (avg) (percentage) 2.360 -3.28%
456.hmmer (max) 9.000 -10.00%
456.hmmer (max) (percentage) 0.320 -8.57%
456.hmmer (unexplained diff vs previous) 4.000 -60.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -60.00%
458.sjeng 152.000 -3.18%
458.sjeng (avg) 152.000 -3.18%
458.sjeng (avg) (percentage) 2.020 -2.88%
458.sjeng (max) 44.000 -
458.sjeng (max) (percentage) 0.590 -
458.sjeng (unexplained diff vs previous) 29.000 -12.12%
458.sjeng (unexplained diff vs previous) (percentage) 0.380 -13.64%
459.GemsFDTD 223.000 -2.62%
459.GemsFDTD (avg) 223.000 -2.62%
459.GemsFDTD (avg) (percentage) 3.610 -3.22%
459.GemsFDTD (max) 25.000 -10.71%
459.GemsFDTD (max) (percentage) 0.420 -10.64%
459.GemsFDTD (unexplained diff vs previous) 19.000 46.15%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.310 47.62%
462.libquantum 6.000 -
462.libquantum (avg) 6.000 -
462.libquantum (avg) (percentage) 4.410 -2.00%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.430 70.24%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.450 -
464.h264ref 167.000 -3.47%
464.h264ref (avg) 167.000 -3.47%
464.h264ref (avg) (percentage) 2.960 -2.63%
464.h264ref (max) 44.000 4.76%
464.h264ref (max) (percentage) 0.790 6.76%
464.h264ref (unexplained diff vs previous) 45.000 400.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.790 393.75%
465.tonto 293.000 1.74%
465.tonto (avg) 293.000 1.74%
465.tonto (avg) (percentage) 2.650 -
465.tonto (max) 118.000 -3.28%
465.tonto (max) (percentage) 1.070 -4.46%
470.lbm 138.000 -3.50%
470.lbm (avg) 138.000 -3.50%
470.lbm (avg) (percentage) 3.660 -2.92%
470.lbm (max) 13.000 -40.91%
470.lbm (max) (percentage) 0.350 -41.67%
470.lbm (unexplained diff vs previous) 2.000 -87.50%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -88.10%
471.omnetpp 137.000 -1.44%
471.omnetpp (avg) 137.000 -1.44%
471.omnetpp (avg) (percentage) 5.030 -2.52%
471.omnetpp (max) 35.000 -2.78%
471.omnetpp (max) (percentage) 1.290 -4.44%
471.omnetpp (unexplained diff vs previous) 29.000 1350.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.060 1414.29%
473.astar 163.000 -2.98%
473.astar (avg) 163.000 -2.98%
473.astar (avg) (percentage) 3.180 -2.75%
473.astar (max) 33.000 -13.16%
473.astar (max) (percentage) 0.660 -12.00%
473.astar (unexplained diff vs previous) 3.000 -92.31%
473.astar (unexplained diff vs previous) (percentage) 0.060 -92.11%
481.wrf 199.000 -
481.wrf (avg) 199.000 -
481.wrf (avg) (percentage) 3.680 -
481.wrf (max) 123.000 -1.60%
481.wrf (max) (percentage) 2.270 -1.30%
482.sphinx3 44.000 -2.22%
482.sphinx3 (avg) 44.000 -2.22%
482.sphinx3 (avg) (percentage) 4.700 -2.29%
482.sphinx3 (max) 14.000 40.00%
482.sphinx3 (max) (percentage) 1.490 39.25%
482.sphinx3 (unexplained diff vs previous) 14.000 55.56%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.470 53.12%
483.xalancbmk 159.000 -4.22%
483.xalancbmk (avg) 159.000 -4.22%
483.xalancbmk (avg) (percentage) 4.180 -3.02%
483.xalancbmk (max) 49.000 -48.42%
483.xalancbmk (max) (percentage) 1.300 -47.15%
483.xalancbmk (unexplained diff vs previous) 41.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 1.070 -
Geometric Mean 9.085 11.07%