Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d59a54c2c350ba65c65dde5e2a8976918ac59046 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/5adfb6540db95da5faf1f77fbe9ec38b4cf8eb1f (+ 57 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f465b21b06a17e26c1af7d75603afc481ebce0f6 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=1026c1155e7fa777e6e74cbd8e602d46ae491a75 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/267/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0267 (basepoints/gcc-13-02098-g5adfb6540db9) 2022-08-18T02:47:32 0:00:00
Previous 0264 (glibc-2.36.9000-00050-gf465b21b06) 2022-08-17T13:09:56 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 40 56
Performance Improvements 141 162
Unchanged Tests 1055 1018
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 3.68% 112097.000 116217.000 - -3.33% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
464.h264ref 5.54% 13052.000 13775.000 - -5.37% -
459.GemsFDTD 3.81% 21436.000 22253.000 - -4.72% -
482.sphinx3 1.07% 27289.000 27580.000 - -7.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) 355.56% 9.000 41.000 - 32.26% -
458.sjeng (max) (percentage) 350.00% 0.060 0.270 - 22.73% -
471.omnetpp (unexplained diff vs previous) 279.17% 24.000 91.000 - 250.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 277.78% 0.180 0.680 - 183.33% -
458.sjeng 200.00% 9.000 27.000 - -42.55% -
458.sjeng (avg) 200.00% 9.000 27.000 - -42.55% -
458.sjeng (avg) (percentage) 200.00% 0.060 0.180 - -45.45% -
400.perlbench (max) 153.57% 28.000 71.000 - -79.42% -
400.perlbench (max) (percentage) 148.15% 0.270 0.670 - -79.32% -
400.perlbench 142.86% 21.000 51.000 - -67.31% -
400.perlbench (avg) 142.86% 21.000 51.000 - -67.31% -
400.perlbench (avg) (percentage) 140.00% 0.200 0.480 - -67.35% -
471.omnetpp 131.71% 41.000 95.000 - -44.12% -
471.omnetpp (avg) 131.71% 41.000 95.000 - -44.12% -
471.omnetpp (avg) (percentage) 129.03% 0.310 0.710 - -55.35% -
464.h264ref (max) 117.07% 41.000 89.000 - 43.55% -
464.h264ref (max) (percentage) 103.12% 0.320 0.650 - 51.16% -
471.omnetpp (max) 98.28% 58.000 115.000 - -82.63% -
471.omnetpp (max) (percentage) 95.45% 0.440 0.860 - -86.06% -
464.h264ref 82.50% 40.000 73.000 - -6.41% -
464.h264ref (avg) 82.50% 40.000 73.000 - -6.41% -
459.GemsFDTD (max) 81.13% 265.000 480.000 - 242.86% -
459.GemsFDTD (max) (percentage) 74.19% 1.240 2.160 - 260.00% -
464.h264ref (avg) (percentage) 70.97% 0.310 0.530 - -1.85% -
434.zeusmp (unexplained diff vs previous) 41.67% 12.000 17.000 - -94.48% -
459.GemsFDTD 37.65% 255.000 351.000 - 67.14% -
459.GemsFDTD (avg) 37.65% 255.000 351.000 - 67.14% -
434.zeusmp (max) 33.33% 12.000 16.000 - -94.68% -
434.zeusmp (max) (percentage) 33.33% 0.090 0.120 - -94.74% -
434.zeusmp (unexplained diff vs previous) (percentage) 33.33% 0.090 0.120 - -94.85% -
459.GemsFDTD (avg) (percentage) 32.77% 1.190 1.580 - 75.56% -
433.milc (max) (percentage) 31.25% 0.320 0.420 - -86.75% -
433.milc (max) 30.00% 40.000 52.000 - -87.35% -
434.zeusmp (avg) (percentage) 11.11% 0.090 0.100 - -93.24% -
434.zeusmp 8.33% 12.000 13.000 - -93.33% -
434.zeusmp (avg) 8.33% 12.000 13.000 - -93.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.12% 14448.000 13708.000 - -8.64% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (unexplained diff vs previous) -98.40% 1123.000 18.000 - 260.00% -
410.bwaves (unexplained diff vs previous) (percentage) -98.35% 3.030 0.050 - -50.00% -
454.calculix (unexplained diff vs previous) (percentage) -98.31% 5.340 0.090 - 350.00% -
410.bwaves (unexplained diff vs previous) -98.21% 447.000 8.000 - -46.67% -
453.povray (unexplained diff vs previous) (percentage) -97.42% 2.710 0.070 - 250.00% -
453.povray (unexplained diff vs previous) -97.33% 187.000 5.000 - 400.00% -
444.namd (unexplained diff vs previous) -95.22% 712.000 34.000 - -95.14% -
444.namd (unexplained diff vs previous) (percentage) -95.21% 7.720 0.370 - -95.21% -
445.gobmk (unexplained diff vs previous) (percentage) -91.67% 1.080 0.090 - -94.19% -
445.gobmk (unexplained diff vs previous) -91.54% 130.000 11.000 - -94.09% -
447.dealII (unexplained diff vs previous) (percentage) -89.17% 2.400 0.260 - -66.67% -
447.dealII (unexplained diff vs previous) -89.08% 229.000 25.000 - -67.11% -
436.cactusADM (unexplained diff vs previous) -85.71% 21.000 3.000 - -99.47% -
482.sphinx3 (unexplained diff vs previous) (percentage) -85.19% 2.430 0.360 - -41.94% -
482.sphinx3 (unexplained diff vs previous) -85.09% 664.000 99.000 - -46.77% -
470.lbm (unexplained diff vs previous) -83.99% 537.000 86.000 - 514.29% -
470.lbm (unexplained diff vs previous) (percentage) -83.91% 3.790 0.610 - 454.55% -
436.cactusADM (unexplained diff vs previous) (percentage) -81.82% 0.110 0.020 - -99.38% -
453.povray -68.75% 192.000 60.000 - -25.93% -
453.povray (avg) -68.75% 192.000 60.000 - -25.93% -
453.povray (avg) (percentage) -68.46% 2.790 0.880 - -29.60% -
454.calculix -68.45% 1084.000 342.000 - -25.49% -
454.calculix (avg) -68.45% 1084.000 342.000 - -25.49% -
454.calculix (avg) (percentage) -68.41% 5.160 1.630 - -18.91% -
410.bwaves -65.22% 437.000 152.000 - -5.00% -
410.bwaves (avg) -65.22% 437.000 152.000 - -5.00% -
447.dealII -65.09% 232.000 81.000 - -22.12% -
447.dealII (avg) -65.09% 232.000 81.000 - -22.12% -
447.dealII (avg) (percentage) -65.02% 2.430 0.850 - -20.56% -
410.bwaves (avg) (percentage) -64.86% 2.960 1.040 - -4.59% -
444.namd (avg) (percentage) -64.14% 7.000 2.510 - -36.13% -
444.namd -64.03% 645.000 232.000 - -34.65% -
444.namd (avg) -64.03% 645.000 232.000 - -34.65% -
445.gobmk -63.21% 106.000 39.000 - -57.61% -
445.gobmk (avg) -63.21% 106.000 39.000 - -57.61% -
470.lbm -63.15% 540.000 199.000 - -34.32% -
470.lbm (avg) -63.15% 540.000 199.000 - -34.32% -
470.lbm (avg) (percentage) -62.73% 3.810 1.420 - -40.08% -
445.gobmk (avg) (percentage) -62.50% 0.880 0.330 - -57.14% -
482.sphinx3 (avg) (percentage) -56.65% 2.630 1.140 - -21.92% -
433.milc (unexplained diff vs previous) (percentage) -56.25% 0.320 0.140 - -95.73% -
482.sphinx3 -56.21% 717.000 314.000 - -27.98% -
482.sphinx3 (avg) -56.21% 717.000 314.000 - -27.98% -
433.milc (unexplained diff vs previous) -55.00% 40.000 18.000 - -95.76% -
436.cactusADM -50.00% 22.000 11.000 - -96.22% -
436.cactusADM (avg) -50.00% 22.000 11.000 - -96.22% -
436.cactusADM (avg) (percentage) -50.00% 0.120 0.060 - -96.39% -
456.hmmer -48.75% 80.000 41.000 - -45.33% -
456.hmmer (avg) -48.75% 80.000 41.000 - -45.33% -
456.hmmer (unexplained diff vs previous) (percentage) -48.61% 0.720 0.370 - -50.67% -
456.hmmer (avg) (percentage) -48.05% 0.770 0.400 - -41.18% -
456.hmmer (unexplained diff vs previous) -48.00% 75.000 39.000 - -53.01% -
481.wrf (avg) (percentage) -44.23% 3.640 2.030 - 7.41% -
481.wrf -44.17% 652.000 364.000 - 14.47% -
481.wrf (avg) -44.17% 652.000 364.000 - 14.47% -
465.tonto -39.32% 206.000 125.000 - -8.76% -
465.tonto (avg) -39.32% 206.000 125.000 - -8.76% -
401.bzip2 (avg) (percentage) -39.22% 0.510 0.310 - -29.55% -
401.bzip2 -38.89% 72.000 44.000 - -33.33% -
401.bzip2 (avg) -38.89% 72.000 44.000 - -33.33% -
465.tonto (avg) (percentage) -38.60% 2.150 1.320 - -20.96% -
429.mcf (unexplained diff vs previous) (percentage) -33.33% 0.240 0.160 - -70.37% -
429.mcf (unexplained diff vs previous) -32.65% 49.000 33.000 - -64.52% -
429.mcf -30.91% 55.000 38.000 - -57.78% -
429.mcf (avg) -30.91% 55.000 38.000 - -57.78% -
436.cactusADM (max) -30.00% 20.000 14.000 - -97.46% -
429.mcf (avg) (percentage) -29.63% 0.270 0.190 - -64.15% -
437.leslie3d (max) -28.76% 525.000 374.000 - 6.55% -
437.leslie3d (unexplained diff vs previous) -27.61% 507.000 367.000 - 7.00% -
436.cactusADM (max) (percentage) -27.27% 0.110 0.080 - -97.46% -
465.tonto (max) -25.91% 220.000 163.000 - -44.37% -
483.xalancbmk (max) -25.81% 31.000 23.000 - -48.89% -
470.lbm (max) -25.45% 558.000 416.000 - -36.29% -
410.bwaves (max) -25.22% 460.000 344.000 - 1046.67% -
465.tonto (max) (percentage) -25.22% 2.300 1.720 - -51.96% -
454.calculix (max) -25.16% 1065.000 797.000 - -25.79% -
481.wrf (max) (percentage) -25.14% 3.580 2.680 - -14.92% -
454.calculix (max) (percentage) -25.05% 5.070 3.800 - -19.15% -
410.bwaves (max) (percentage) -25.00% 3.120 2.340 - 1014.29% -
437.leslie3d (max) (percentage) -25.00% 3.640 2.730 - 16.67% -
453.povray (max) (percentage) -25.00% 2.640 1.980 - -21.74% -
445.gobmk (max) -25.00% 128.000 96.000 - -47.54% -
483.xalancbmk (max) (percentage) -25.00% 0.240 0.180 - -56.10% -
444.namd (max) (percentage) -24.97% 7.170 5.380 - -25.07% -
481.wrf (max) -24.96% 641.000 481.000 - -9.25% -
482.sphinx3 (max) (percentage) -24.90% 2.490 1.870 - 27.21% -
470.lbm (max) (percentage) -24.87% 3.940 2.960 - -41.96% -
453.povray (max) -24.86% 181.000 136.000 - -17.58% -
447.dealII (max) (percentage) -24.79% 2.340 1.760 - 60.00% -
447.dealII (max) -24.66% 223.000 168.000 - 57.01% -
444.namd (max) -24.66% 661.000 498.000 - -23.27% -
445.gobmk (max) (percentage) -24.53% 1.060 0.800 - -47.71% -
435.gromacs (unexplained diff vs previous) -24.32% 37.000 28.000 - -91.19% -
482.sphinx3 (max) -24.15% 679.000 515.000 - 17.31% -
437.leslie3d (unexplained diff vs previous) (percentage) -23.65% 3.510 2.680 - 17.03% -
456.hmmer (max) (percentage) -23.61% 0.720 0.550 - -56.69% -
435.gromacs (max) (percentage) -23.08% 0.260 0.200 - -90.10% -
435.gromacs (unexplained diff vs previous) (percentage) -23.08% 0.260 0.200 - -90.29% -
456.hmmer (max) -22.97% 74.000 57.000 - -59.29% -
435.gromacs (max) -22.22% 36.000 28.000 - -91.00% -
401.bzip2 (unexplained diff vs previous) -21.54% 65.000 51.000 - -61.36% -
429.mcf (max) -20.75% 53.000 42.000 - -54.35% -
401.bzip2 (unexplained diff vs previous) (percentage) -20.00% 0.450 0.360 - -58.62% -
429.mcf (max) (percentage) -19.23% 0.260 0.210 - -61.11% -
450.soplex (unexplained diff vs previous) -18.75% 128.000 104.000 - -66.56% -
437.leslie3d -18.68% 471.000 383.000 - 7.28% -
437.leslie3d (avg) -18.68% 471.000 383.000 - 7.28% -
450.soplex (unexplained diff vs previous) (percentage) -18.60% 0.860 0.700 - -65.17% -
416.gamess (max) -18.37% 49.000 40.000 - -93.90% -
416.gamess (max) (percentage) -18.18% 0.220 0.180 - -93.77% -
450.soplex (max) (percentage) -17.44% 0.860 0.710 - -63.96% -
401.bzip2 (max) (percentage) -17.39% 0.460 0.380 - -56.82% -
450.soplex (max) -17.32% 127.000 105.000 - -65.46% -
401.bzip2 (max) -16.92% 65.000 54.000 - -59.40% -
483.xalancbmk (avg) (percentage) -16.67% 0.240 0.200 - -70.15% -
483.xalancbmk -16.13% 31.000 26.000 - -64.86% -
483.xalancbmk (avg) -16.13% 31.000 26.000 - -64.86% -
450.soplex (avg) (percentage) -16.05% 0.810 0.680 - -45.16% -
450.soplex -15.97% 119.000 100.000 - -47.64% -
450.soplex (avg) -15.97% 119.000 100.000 - -47.64% -
435.gromacs (avg) (percentage) -15.79% 0.190 0.160 - -90.75% -
403.gcc (max) -15.62% 32.000 27.000 - -57.81% -
462.libquantum -15.56% 45.000 38.000 - -49.33% -
462.libquantum (avg) -15.56% 45.000 38.000 - -49.33% -
435.gromacs -15.38% 26.000 22.000 - -91.73% -
435.gromacs (avg) -15.38% 26.000 22.000 - -91.73% -
462.libquantum (avg) (percentage) -15.15% 0.330 0.280 - -56.92% -
473.astar -14.29% 14.000 12.000 - -57.14% -
473.astar (avg) -14.29% 14.000 12.000 - -57.14% -
437.leslie3d (avg) (percentage) -14.11% 3.260 2.800 - 17.65% -
403.gcc (max) (percentage) -13.51% 0.370 0.320 - -55.56% -
462.libquantum (max) -13.04% 46.000 40.000 - -45.95% -
462.libquantum (unexplained diff vs previous) -12.77% 47.000 41.000 - 4000.00% -
462.libquantum (max) (percentage) -11.76% 0.340 0.300 - -53.12% -
462.libquantum (unexplained diff vs previous) (percentage) -11.76% 0.340 0.300 - 2900.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -7.22% 0.970 0.900 - 328.57% -
403.gcc (avg) (percentage) -5.00% 0.400 0.380 - -37.70% -
459.GemsFDTD (unexplained diff vs previous) -3.85% 208.000 200.000 - 316.67% -
403.gcc -2.94% 34.000 33.000 - -38.89% -
403.gcc (avg) -2.94% 34.000 33.000 - -38.89% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.60% 260647.000 267429.000 - 0.00% -
459.GemsFDTD 1.29% 253716.000 256984.000 - 0.00% -
400.perlbench 1.24% 930652.000 942188.000 - -0.86% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 25.10% 10739.000 13435.000 - 0.47% -
429.mcf 18.98% 17158.000 20414.000 - 0.02% -
462.libquantum 17.65% 11614.000 13664.000 - 0.09% -
483.xalancbmk 17.52% 11172.000 13129.000 - -0.32% -
465.tonto 15.92% 8205.000 9511.000 - -0.75% -
470.lbm 9.85% 12819.000 14082.000 - -0.71% -
458.sjeng 7.37% 14275.000 15327.000 - 0.04% -
481.wrf 6.74% 16834.000 17969.000 - 0.22% -
473.astar 5.79% 14932.000 15796.000 - 0.13% -
453.povray 5.44% 6544.000 6900.000 - 0.12% -
434.zeusmp 5.11% 13211.000 13886.000 - 0.04% -
436.cactusADM 4.53% 17544.000 18338.000 - -0.03% -
444.namd 2.46% 9050.000 9273.000 - 0.52% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 4000.00% 1.000 41.000 - -12.77% -
462.libquantum (unexplained diff vs previous) (percentage) 2900.00% 0.010 0.300 - -11.76% -
410.bwaves (max) 1046.67% 30.000 344.000 - -25.22% -
410.bwaves (max) (percentage) 1014.29% 0.210 2.340 - -25.00% -
470.lbm (unexplained diff vs previous) 514.29% 14.000 86.000 - -83.99% -
473.astar (unexplained diff vs previous) 500.00% 3.000 18.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 454.55% 0.110 0.610 - -83.91% -
473.astar (unexplained diff vs previous) (percentage) 450.00% 0.020 0.110 - 0.00% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - -97.33% -
454.calculix (unexplained diff vs previous) (percentage) 350.00% 0.020 0.090 - -98.31% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 328.57% 0.210 0.900 - -7.22% -
459.GemsFDTD (unexplained diff vs previous) 316.67% 48.000 200.000 - -3.85% -
454.calculix (unexplained diff vs previous) 260.00% 5.000 18.000 - -98.40% -
459.GemsFDTD (max) (percentage) 260.00% 0.600 2.160 - 74.19% -
453.povray (unexplained diff vs previous) (percentage) 250.00% 0.020 0.070 - -97.42% -
471.omnetpp (unexplained diff vs previous) 250.00% 26.000 91.000 - 279.17% -
459.GemsFDTD (max) 242.86% 140.000 480.000 - 81.13% -
471.omnetpp (unexplained diff vs previous) (percentage) 183.33% 0.240 0.680 - 277.78% -
459.GemsFDTD (avg) (percentage) 75.56% 0.900 1.580 - 32.77% -
459.GemsFDTD 67.14% 210.000 351.000 - 37.65% -
459.GemsFDTD (avg) 67.14% 210.000 351.000 - 37.65% -
447.dealII (max) (percentage) 60.00% 1.100 1.760 - -24.79% -
447.dealII (max) 57.01% 107.000 168.000 - -24.66% -
464.h264ref (max) (percentage) 51.16% 0.430 0.650 - 103.12% -
464.h264ref (max) 43.55% 62.000 89.000 - 117.07% -
458.sjeng (max) 32.26% 31.000 41.000 - 355.56% -
482.sphinx3 (max) (percentage) 27.21% 1.470 1.870 - -24.90% -
458.sjeng (max) (percentage) 22.73% 0.220 0.270 - 350.00% -
437.leslie3d (avg) (percentage) 17.65% 2.380 2.800 - -14.11% -
482.sphinx3 (max) 17.31% 439.000 515.000 - -24.15% -
437.leslie3d (unexplained diff vs previous) (percentage) 17.03% 2.290 2.680 - -23.65% -
437.leslie3d (max) (percentage) 16.67% 2.340 2.730 - -25.00% -
481.wrf 14.47% 318.000 364.000 - -44.17% -
481.wrf (avg) 14.47% 318.000 364.000 - -44.17% -
481.wrf (avg) (percentage) 7.41% 1.890 2.030 - -44.23% -
437.leslie3d 7.28% 357.000 383.000 - -18.68% -
437.leslie3d (avg) 7.28% 357.000 383.000 - -18.68% -
437.leslie3d (unexplained diff vs previous) 7.00% 343.000 367.000 - -27.61% -
437.leslie3d (max) 6.55% 351.000 374.000 - -28.76% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.33% 120221.000 116217.000 - 3.68% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
435.gromacs -8.70% 15419.000 14077.000 - 0.26% -
437.leslie3d -8.64% 15005.000 13708.000 - -5.12% -
454.calculix -8.14% 22860.000 20999.000 - -0.06% -
482.sphinx3 -7.85% 29928.000 27580.000 - 1.07% -
401.bzip2 -6.16% 15185.000 14249.000 - -0.30% -
456.hmmer -5.49% 11046.000 10440.000 - 0.44% -
464.h264ref -5.37% 14556.000 13775.000 - 5.54% -
459.GemsFDTD -4.72% 23356.000 22253.000 - 3.81% -
450.soplex -4.07% 15466.000 14836.000 - 0.20% -
433.milc -3.22% 12976.000 12558.000 - -0.34% -
403.gcc -2.93% 9010.000 8746.000 - 0.80% -
447.dealII -1.86% 9751.000 9570.000 - 0.21% -
416.gamess -1.22% 22704.000 22426.000 - -0.19% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM (unexplained diff vs previous) -99.47% 570.000 3.000 - -85.71% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.38% 3.250 0.020 - -81.82% -
436.cactusADM (max) -97.46% 552.000 14.000 - -30.00% -
436.cactusADM (max) (percentage) -97.46% 3.150 0.080 - -27.27% -
436.cactusADM (avg) (percentage) -96.39% 1.660 0.060 - -50.00% -
436.cactusADM -96.22% 291.000 11.000 - -50.00% -
436.cactusADM (avg) -96.22% 291.000 11.000 - -50.00% -
433.milc (unexplained diff vs previous) -95.76% 425.000 18.000 - -55.00% -
433.milc (unexplained diff vs previous) (percentage) -95.73% 3.280 0.140 - -56.25% -
444.namd (unexplained diff vs previous) (percentage) -95.21% 7.730 0.370 - -95.21% -
444.namd (unexplained diff vs previous) -95.14% 700.000 34.000 - -95.22% -
434.zeusmp (unexplained diff vs previous) (percentage) -94.85% 2.330 0.120 - 33.33% -
434.zeusmp (max) (percentage) -94.74% 2.280 0.120 - 33.33% -
434.zeusmp (max) -94.68% 301.000 16.000 - 33.33% -
434.zeusmp (unexplained diff vs previous) -94.48% 308.000 17.000 - 41.67% -
445.gobmk (unexplained diff vs previous) (percentage) -94.19% 1.550 0.090 - -91.67% -
445.gobmk (unexplained diff vs previous) -94.09% 186.000 11.000 - -91.54% -
416.gamess (max) -93.90% 656.000 40.000 - -18.37% -
416.gamess (max) (percentage) -93.77% 2.890 0.180 - -18.18% -
434.zeusmp -93.33% 195.000 13.000 - 8.33% -
434.zeusmp (avg) -93.33% 195.000 13.000 - 8.33% -
434.zeusmp (avg) (percentage) -93.24% 1.480 0.100 - 11.11% -
435.gromacs -91.73% 266.000 22.000 - -15.38% -
435.gromacs (avg) -91.73% 266.000 22.000 - -15.38% -
435.gromacs (unexplained diff vs previous) -91.19% 318.000 28.000 - -24.32% -
416.gamess -91.06% 492.000 44.000 - 0.00% -
416.gamess (avg) -91.06% 492.000 44.000 - 0.00% -
435.gromacs (max) -91.00% 311.000 28.000 - -22.22% -
416.gamess (avg) (percentage) -90.78% 2.170 0.200 - 0.00% -
435.gromacs (avg) (percentage) -90.75% 1.730 0.160 - -15.79% -
435.gromacs (unexplained diff vs previous) (percentage) -90.29% 2.060 0.200 - -23.08% -
435.gromacs (max) (percentage) -90.10% 2.020 0.200 - -23.08% -
433.milc (max) -87.35% 411.000 52.000 - 30.00% -
433.milc (max) (percentage) -86.75% 3.170 0.420 - 31.25% -
471.omnetpp (max) (percentage) -86.06% 6.170 0.860 - 95.45% -
433.milc -84.09% 220.000 35.000 - 0.00% -
433.milc (avg) -84.09% 220.000 35.000 - 0.00% -
433.milc (avg) (percentage) -83.53% 1.700 0.280 - 0.00% -
471.omnetpp (max) -82.63% 662.000 115.000 - 98.28% -
400.perlbench (max) -79.42% 345.000 71.000 - 153.57% -
400.perlbench (max) (percentage) -79.32% 3.240 0.670 - 148.15% -
429.mcf (unexplained diff vs previous) (percentage) -70.37% 0.540 0.160 - -33.33% -
483.xalancbmk (avg) (percentage) -70.15% 0.670 0.200 - -16.67% -
400.perlbench (avg) (percentage) -67.35% 1.470 0.480 - 140.00% -
400.perlbench -67.31% 156.000 51.000 - 142.86% -
400.perlbench (avg) -67.31% 156.000 51.000 - 142.86% -
447.dealII (unexplained diff vs previous) -67.11% 76.000 25.000 - -89.08% -
447.dealII (unexplained diff vs previous) (percentage) -66.67% 0.780 0.260 - -89.17% -
450.soplex (unexplained diff vs previous) -66.56% 311.000 104.000 - -18.75% -
450.soplex (max) -65.46% 304.000 105.000 - -17.32% -
450.soplex (unexplained diff vs previous) (percentage) -65.17% 2.010 0.700 - -18.60% -
483.xalancbmk -64.86% 74.000 26.000 - -16.13% -
483.xalancbmk (avg) -64.86% 74.000 26.000 - -16.13% -
429.mcf (unexplained diff vs previous) -64.52% 93.000 33.000 - -32.65% -
429.mcf (avg) (percentage) -64.15% 0.530 0.190 - -29.63% -
450.soplex (max) (percentage) -63.96% 1.970 0.710 - -17.44% -
401.bzip2 (unexplained diff vs previous) -61.36% 132.000 51.000 - -21.54% -
429.mcf (max) (percentage) -61.11% 0.540 0.210 - -19.23% -
401.bzip2 (max) -59.40% 133.000 54.000 - -16.92% -
456.hmmer (max) -59.29% 140.000 57.000 - -22.97% -
401.bzip2 (unexplained diff vs previous) (percentage) -58.62% 0.870 0.360 - -20.00% -
473.astar (avg) (percentage) -57.89% 0.190 0.080 - -11.11% -
403.gcc (max) -57.81% 64.000 27.000 - -15.62% -
429.mcf -57.78% 90.000 38.000 - -30.91% -
429.mcf (avg) -57.78% 90.000 38.000 - -30.91% -
445.gobmk -57.61% 92.000 39.000 - -63.21% -
445.gobmk (avg) -57.61% 92.000 39.000 - -63.21% -
445.gobmk (avg) (percentage) -57.14% 0.770 0.330 - -62.50% -
473.astar -57.14% 28.000 12.000 - -14.29% -
473.astar (avg) -57.14% 28.000 12.000 - -14.29% -
462.libquantum (avg) (percentage) -56.92% 0.650 0.280 - -15.15% -
401.bzip2 (max) (percentage) -56.82% 0.880 0.380 - -17.39% -
456.hmmer (max) (percentage) -56.69% 1.270 0.550 - -23.61% -
483.xalancbmk (max) (percentage) -56.10% 0.410 0.180 - -25.00% -
403.gcc (max) (percentage) -55.56% 0.720 0.320 - -13.51% -
471.omnetpp (avg) (percentage) -55.35% 1.590 0.710 - 129.03% -
429.mcf (max) -54.35% 92.000 42.000 - -20.75% -
462.libquantum (max) (percentage) -53.12% 0.640 0.300 - -11.76% -
456.hmmer (unexplained diff vs previous) -53.01% 83.000 39.000 - -48.00% -
465.tonto (max) (percentage) -51.96% 3.580 1.720 - -25.22% -
456.hmmer (unexplained diff vs previous) (percentage) -50.67% 0.750 0.370 - -48.61% -
410.bwaves (unexplained diff vs previous) (percentage) -50.00% 0.100 0.050 - -98.35% -
462.libquantum -49.33% 75.000 38.000 - -15.56% -
462.libquantum (avg) -49.33% 75.000 38.000 - -15.56% -
483.xalancbmk (max) -48.89% 45.000 23.000 - -25.81% -
445.gobmk (max) (percentage) -47.71% 1.530 0.800 - -24.53% -
450.soplex -47.64% 191.000 100.000 - -15.97% -
450.soplex (avg) -47.64% 191.000 100.000 - -15.97% -
445.gobmk (max) -47.54% 183.000 96.000 - -25.00% -
482.sphinx3 (unexplained diff vs previous) -46.77% 186.000 99.000 - -85.09% -
410.bwaves (unexplained diff vs previous) -46.67% 15.000 8.000 - -98.21% -
462.libquantum (max) -45.95% 74.000 40.000 - -13.04% -
458.sjeng (avg) (percentage) -45.45% 0.330 0.180 - 200.00% -
456.hmmer -45.33% 75.000 41.000 - -48.75% -
456.hmmer (avg) -45.33% 75.000 41.000 - -48.75% -
450.soplex (avg) (percentage) -45.16% 1.240 0.680 - -16.05% -
465.tonto (max) -44.37% 293.000 163.000 - -25.91% -
471.omnetpp -44.12% 170.000 95.000 - 131.71% -
471.omnetpp (avg) -44.12% 170.000 95.000 - 131.71% -
458.sjeng -42.55% 47.000 27.000 - 200.00% -
458.sjeng (avg) -42.55% 47.000 27.000 - 200.00% -
470.lbm (max) (percentage) -41.96% 5.100 2.960 - -24.87% -
482.sphinx3 (unexplained diff vs previous) (percentage) -41.94% 0.620 0.360 - -85.19% -
456.hmmer (avg) (percentage) -41.18% 0.680 0.400 - -48.05% -
470.lbm (avg) (percentage) -40.08% 2.370 1.420 - -62.73% -
403.gcc -38.89% 54.000 33.000 - -2.94% -
403.gcc (avg) -38.89% 54.000 33.000 - -2.94% -
403.gcc (avg) (percentage) -37.70% 0.610 0.380 - -5.00% -
470.lbm (max) -36.29% 653.000 416.000 - -25.45% -
444.namd (avg) (percentage) -36.13% 3.930 2.510 - -64.14% -
444.namd -34.65% 355.000 232.000 - -64.03% -
444.namd (avg) -34.65% 355.000 232.000 - -64.03% -
470.lbm -34.32% 303.000 199.000 - -63.15% -
470.lbm (avg) -34.32% 303.000 199.000 - -63.15% -
401.bzip2 -33.33% 66.000 44.000 - -38.89% -
401.bzip2 (avg) -33.33% 66.000 44.000 - -38.89% -
453.povray (avg) (percentage) -29.60% 1.250 0.880 - -68.46% -
401.bzip2 (avg) (percentage) -29.55% 0.440 0.310 - -39.22% -
482.sphinx3 -27.98% 436.000 314.000 - -56.21% -
482.sphinx3 (avg) -27.98% 436.000 314.000 - -56.21% -
453.povray -25.93% 81.000 60.000 - -68.75% -
453.povray (avg) -25.93% 81.000 60.000 - -68.75% -
454.calculix (max) -25.79% 1074.000 797.000 - -25.16% -
454.calculix -25.49% 459.000 342.000 - -68.45% -
454.calculix (avg) -25.49% 459.000 342.000 - -68.45% -
444.namd (max) (percentage) -25.07% 7.180 5.380 - -24.97% -
444.namd (max) -23.27% 649.000 498.000 - -24.66% -
447.dealII -22.12% 104.000 81.000 - -65.09% -
447.dealII (avg) -22.12% 104.000 81.000 - -65.09% -
482.sphinx3 (avg) (percentage) -21.92% 1.460 1.140 - -56.65% -
453.povray (max) (percentage) -21.74% 2.530 1.980 - -25.00% -
473.astar (max) (percentage) -21.43% 0.140 0.110 - 0.00% -
465.tonto (avg) (percentage) -20.96% 1.670 1.320 - -38.60% -
447.dealII (avg) (percentage) -20.56% 1.070 0.850 - -65.02% -
454.calculix (max) (percentage) -19.15% 4.700 3.800 - -25.05% -
454.calculix (avg) (percentage) -18.91% 2.010 1.630 - -68.41% -
453.povray (max) -17.58% 165.000 136.000 - -24.86% -
473.astar (max) -15.00% 20.000 17.000 - 0.00% -
481.wrf (max) (percentage) -14.92% 3.150 2.680 - -25.14% -
481.wrf (max) -9.25% 530.000 481.000 - -24.96% -
465.tonto -8.76% 137.000 125.000 - -39.32% -
465.tonto (avg) -8.76% 137.000 125.000 - -39.32% -
464.h264ref -6.41% 78.000 73.000 - 82.50% -
464.h264ref (avg) -6.41% 78.000 73.000 - 82.50% -
410.bwaves -5.00% 160.000 152.000 - -65.22% -
410.bwaves (avg) -5.00% 160.000 152.000 - -65.22% -
410.bwaves (avg) (percentage) -4.59% 1.090 1.040 - -64.86% -
464.h264ref (avg) (percentage) -1.85% 0.540 0.530 - 70.97% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 10653.000 -
401.bzip2 14249.000 -
403.gcc 8746.000 -
410.bwaves 14708.000 -
416.gamess 22426.000 -
429.mcf 20414.000 -
433.milc 12558.000 -
434.zeusmp 13886.000 -
435.gromacs 14077.000 -
436.cactusADM 18338.000 -
437.leslie3d 13708.000 -5.12%
444.namd 9273.000 -
445.gobmk 12111.000 -
447.dealII 9570.000 -
450.soplex 14836.000 -
453.povray 6900.000 -
454.calculix 20999.000 -
456.hmmer 10440.000 -
458.sjeng 15327.000 -
459.GemsFDTD 22253.000 3.81%
462.libquantum 13664.000 -
464.h264ref 13775.000 5.54%
465.tonto 9511.000 -
470.lbm 14082.000 -
471.omnetpp 13435.000 -
473.astar 15796.000 -
481.wrf 17969.000 -
482.sphinx3 27580.000 1.07%
483.xalancbmk 13129.000 -
Geometric Mean 13956.535 -
Code Size (bytes)
Name Current %
400.perlbench 942188.000 -
401.bzip2 49876.000 -
403.gcc 2689235.000 -
410.bwaves 17880.000 -
416.gamess 6270571.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678629.000 -
436.cactusADM 553558.000 -
437.leslie3d 64933.000 -
444.namd 190967.000 -
445.gobmk 1399427.000 -
447.dealII 2113487.000 -
450.soplex 267429.000 -
453.povray 705068.000 -
454.calculix 1272374.000 -
456.hmmer 231185.000 -
458.sjeng 116217.000 3.68%
459.GemsFDTD 256984.000 -
462.libquantum 31291.000 -
464.h264ref 427908.000 -
465.tonto 2875168.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2643749.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3294630.000 -
Geometric Mean 298252.972 -
sample variability
Name Current %
400.perlbench 51.000 142.86%
400.perlbench (avg) 51.000 142.86%
400.perlbench (avg) (percentage) 0.480 140.00%
400.perlbench (max) 71.000 153.57%
400.perlbench (max) (percentage) 0.670 148.15%
401.bzip2 44.000 -38.89%
401.bzip2 (avg) 44.000 -38.89%
401.bzip2 (avg) (percentage) 0.310 -39.22%
401.bzip2 (max) 54.000 -16.92%
401.bzip2 (max) (percentage) 0.380 -17.39%
401.bzip2 (unexplained diff vs previous) 51.000 -21.54%
401.bzip2 (unexplained diff vs previous) (percentage) 0.360 -20.00%
403.gcc 33.000 -2.94%
403.gcc (avg) 33.000 -2.94%
403.gcc (avg) (percentage) 0.380 -5.00%
403.gcc (max) 27.000 -15.62%
403.gcc (max) (percentage) 0.320 -13.51%
410.bwaves 152.000 -65.22%
410.bwaves (avg) 152.000 -65.22%
410.bwaves (avg) (percentage) 1.040 -64.86%
410.bwaves (max) 344.000 -25.22%
410.bwaves (max) (percentage) 2.340 -25.00%
410.bwaves (unexplained diff vs previous) 8.000 -98.21%
410.bwaves (unexplained diff vs previous) (percentage) 0.050 -98.35%
416.gamess 44.000 -
416.gamess (avg) 44.000 -
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) 40.000 -18.37%
416.gamess (max) (percentage) 0.180 -18.18%
429.mcf 38.000 -30.91%
429.mcf (avg) 38.000 -30.91%
429.mcf (avg) (percentage) 0.190 -29.63%
429.mcf (max) 42.000 -20.75%
429.mcf (max) (percentage) 0.210 -19.23%
429.mcf (unexplained diff vs previous) 33.000 -32.65%
429.mcf (unexplained diff vs previous) (percentage) 0.160 -33.33%
433.milc 35.000 -
433.milc (avg) 35.000 -
433.milc (avg) (percentage) 0.280 -
433.milc (max) 52.000 30.00%
433.milc (max) (percentage) 0.420 31.25%
433.milc (unexplained diff vs previous) 18.000 -55.00%
433.milc (unexplained diff vs previous) (percentage) 0.140 -56.25%
434.zeusmp 13.000 8.33%
434.zeusmp (avg) 13.000 8.33%
434.zeusmp (avg) (percentage) 0.100 11.11%
434.zeusmp (max) 16.000 33.33%
434.zeusmp (max) (percentage) 0.120 33.33%
434.zeusmp (unexplained diff vs previous) 17.000 41.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 33.33%
435.gromacs 22.000 -15.38%
435.gromacs (avg) 22.000 -15.38%
435.gromacs (avg) (percentage) 0.160 -15.79%
435.gromacs (max) 28.000 -22.22%
435.gromacs (max) (percentage) 0.200 -23.08%
435.gromacs (unexplained diff vs previous) 28.000 -24.32%
435.gromacs (unexplained diff vs previous) (percentage) 0.200 -23.08%
436.cactusADM 11.000 -50.00%
436.cactusADM (avg) 11.000 -50.00%
436.cactusADM (avg) (percentage) 0.060 -50.00%
436.cactusADM (max) 14.000 -30.00%
436.cactusADM (max) (percentage) 0.080 -27.27%
436.cactusADM (unexplained diff vs previous) 3.000 -85.71%
436.cactusADM (unexplained diff vs previous) (percentage) 0.020 -81.82%
437.leslie3d 383.000 -18.68%
437.leslie3d (avg) 383.000 -18.68%
437.leslie3d (avg) (percentage) 2.800 -14.11%
437.leslie3d (max) 374.000 -28.76%
437.leslie3d (max) (percentage) 2.730 -25.00%
437.leslie3d (unexplained diff vs previous) 367.000 -27.61%
437.leslie3d (unexplained diff vs previous) (percentage) 2.680 -23.65%
444.namd 232.000 -64.03%
444.namd (avg) 232.000 -64.03%
444.namd (avg) (percentage) 2.510 -64.14%
444.namd (max) 498.000 -24.66%
444.namd (max) (percentage) 5.380 -24.97%
444.namd (unexplained diff vs previous) 34.000 -95.22%
444.namd (unexplained diff vs previous) (percentage) 0.370 -95.21%
445.gobmk 39.000 -63.21%
445.gobmk (avg) 39.000 -63.21%
445.gobmk (avg) (percentage) 0.330 -62.50%
445.gobmk (max) 96.000 -25.00%
445.gobmk (max) (percentage) 0.800 -24.53%
445.gobmk (unexplained diff vs previous) 11.000 -91.54%
445.gobmk (unexplained diff vs previous) (percentage) 0.090 -91.67%
447.dealII 81.000 -65.09%
447.dealII (avg) 81.000 -65.09%
447.dealII (avg) (percentage) 0.850 -65.02%
447.dealII (max) 168.000 -24.66%
447.dealII (max) (percentage) 1.760 -24.79%
447.dealII (unexplained diff vs previous) 25.000 -89.08%
447.dealII (unexplained diff vs previous) (percentage) 0.260 -89.17%
450.soplex 100.000 -15.97%
450.soplex (avg) 100.000 -15.97%
450.soplex (avg) (percentage) 0.680 -16.05%
450.soplex (max) 105.000 -17.32%
450.soplex (max) (percentage) 0.710 -17.44%
450.soplex (unexplained diff vs previous) 104.000 -18.75%
450.soplex (unexplained diff vs previous) (percentage) 0.700 -18.60%
453.povray 60.000 -68.75%
453.povray (avg) 60.000 -68.75%
453.povray (avg) (percentage) 0.880 -68.46%
453.povray (max) 136.000 -24.86%
453.povray (max) (percentage) 1.980 -25.00%
453.povray (unexplained diff vs previous) 5.000 -97.33%
453.povray (unexplained diff vs previous) (percentage) 0.070 -97.42%
454.calculix 342.000 -68.45%
454.calculix (avg) 342.000 -68.45%
454.calculix (avg) (percentage) 1.630 -68.41%
454.calculix (max) 797.000 -25.16%
454.calculix (max) (percentage) 3.800 -25.05%
454.calculix (unexplained diff vs previous) 18.000 -98.40%
454.calculix (unexplained diff vs previous) (percentage) 0.090 -98.31%
456.hmmer 41.000 -48.75%
456.hmmer (avg) 41.000 -48.75%
456.hmmer (avg) (percentage) 0.400 -48.05%
456.hmmer (max) 57.000 -22.97%
456.hmmer (max) (percentage) 0.550 -23.61%
456.hmmer (unexplained diff vs previous) 39.000 -48.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 -48.61%
458.sjeng 27.000 200.00%
458.sjeng (avg) 27.000 200.00%
458.sjeng (avg) (percentage) 0.180 200.00%
458.sjeng (max) 41.000 355.56%
458.sjeng (max) (percentage) 0.270 350.00%
459.GemsFDTD 351.000 37.65%
459.GemsFDTD (avg) 351.000 37.65%
459.GemsFDTD (avg) (percentage) 1.580 32.77%
459.GemsFDTD (max) 480.000 81.13%
459.GemsFDTD (max) (percentage) 2.160 74.19%
459.GemsFDTD (unexplained diff vs previous) 200.000 -3.85%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.900 -7.22%
462.libquantum 38.000 -15.56%
462.libquantum (avg) 38.000 -15.56%
462.libquantum (avg) (percentage) 0.280 -15.15%
462.libquantum (max) 40.000 -13.04%
462.libquantum (max) (percentage) 0.300 -11.76%
462.libquantum (unexplained diff vs previous) 41.000 -12.77%
462.libquantum (unexplained diff vs previous) (percentage) 0.300 -11.76%
464.h264ref 73.000 82.50%
464.h264ref (avg) 73.000 82.50%
464.h264ref (avg) (percentage) 0.530 70.97%
464.h264ref (max) 89.000 117.07%
464.h264ref (max) (percentage) 0.650 103.12%
465.tonto 125.000 -39.32%
465.tonto (avg) 125.000 -39.32%
465.tonto (avg) (percentage) 1.320 -38.60%
465.tonto (max) 163.000 -25.91%
465.tonto (max) (percentage) 1.720 -25.22%
470.lbm 199.000 -63.15%
470.lbm (avg) 199.000 -63.15%
470.lbm (avg) (percentage) 1.420 -62.73%
470.lbm (max) 416.000 -25.45%
470.lbm (max) (percentage) 2.960 -24.87%
470.lbm (unexplained diff vs previous) 86.000 -83.99%
470.lbm (unexplained diff vs previous) (percentage) 0.610 -83.91%
471.omnetpp 95.000 131.71%
471.omnetpp (avg) 95.000 131.71%
471.omnetpp (avg) (percentage) 0.710 129.03%
471.omnetpp (max) 115.000 98.28%
471.omnetpp (max) (percentage) 0.860 95.45%
471.omnetpp (unexplained diff vs previous) 91.000 279.17%
471.omnetpp (unexplained diff vs previous) (percentage) 0.680 277.78%
473.astar 12.000 -14.29%
473.astar (avg) 12.000 -14.29%
473.astar (avg) (percentage) 0.080 -
473.astar (max) 17.000 -
473.astar (max) (percentage) 0.110 -
473.astar (unexplained diff vs previous) 18.000 -
473.astar (unexplained diff vs previous) (percentage) 0.110 -
481.wrf 364.000 -44.17%
481.wrf (avg) 364.000 -44.17%
481.wrf (avg) (percentage) 2.030 -44.23%
481.wrf (max) 481.000 -24.96%
481.wrf (max) (percentage) 2.680 -25.14%
482.sphinx3 314.000 -56.21%
482.sphinx3 (avg) 314.000 -56.21%
482.sphinx3 (avg) (percentage) 1.140 -56.65%
482.sphinx3 (max) 515.000 -24.15%
482.sphinx3 (max) (percentage) 1.870 -24.90%
482.sphinx3 (unexplained diff vs previous) 99.000 -85.09%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -85.19%
483.xalancbmk 26.000 -16.13%
483.xalancbmk (avg) 26.000 -16.13%
483.xalancbmk (avg) (percentage) 0.200 -16.67%
483.xalancbmk (max) 23.000 -25.81%
483.xalancbmk (max) (percentage) 0.180 -25.00%
Geometric Mean 7.896 -34.94%