Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d59a54c2c350ba65c65dde5e2a8976918ac59046 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/5adfb6540db95da5faf1f77fbe9ec38b4cf8eb1f (+ 57 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f465b21b06a17e26c1af7d75603afc481ebce0f6 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=1026c1155e7fa777e6e74cbd8e602d46ae491a75 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/267/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0267 (basepoints/gcc-13-02098-g5adfb6540db) 2022-08-18T02:47:32 0:00:00
Previous 0265 (v5.18.18-35448-g1026c1155e7f) 2022-08-17T22:15:00 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 51 56
Performance Improvements 115 162
Unchanged Tests 1070 1018
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 3.68% 112097.000 116217.000 - -3.33% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
464.h264ref 4.77% 13148.000 13775.000 - -5.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 1000.00% 0.010 0.110 - 450.00% -
473.astar (unexplained diff vs previous) 800.00% 2.000 18.000 - 500.00% -
401.bzip2 (unexplained diff vs previous) 537.50% 8.000 51.000 - -61.36% -
401.bzip2 (unexplained diff vs previous) (percentage) 500.00% 0.060 0.360 - -58.62% -
470.lbm (unexplained diff vs previous) 473.33% 15.000 86.000 - 514.29% -
456.hmmer (unexplained diff vs previous) 457.14% 7.000 39.000 - -53.01% -
470.lbm (unexplained diff vs previous) (percentage) 454.55% 0.110 0.610 - 454.55% -
456.hmmer (unexplained diff vs previous) (percentage) 428.57% 0.070 0.370 - -50.67% -
447.dealII (unexplained diff vs previous) (percentage) 420.00% 0.050 0.260 - -66.67% -
447.dealII (unexplained diff vs previous) 400.00% 5.000 25.000 - -67.11% -
435.gromacs (unexplained diff vs previous) (percentage) 233.33% 0.060 0.200 - -90.29% -
435.gromacs (unexplained diff vs previous) 211.11% 9.000 28.000 - -91.19% -
453.povray (unexplained diff vs previous) (percentage) 75.00% 0.040 0.070 - 250.00% -
473.astar 71.43% 7.000 12.000 - -57.14% -
473.astar (avg) 71.43% 7.000 12.000 - -57.14% -
453.povray (unexplained diff vs previous) 66.67% 3.000 5.000 - 400.00% -
473.astar (avg) (percentage) 60.00% 0.050 0.080 - -57.89% -
462.libquantum (unexplained diff vs previous) (percentage) 42.86% 0.210 0.300 - 2900.00% -
434.zeusmp (unexplained diff vs previous) 41.67% 12.000 17.000 - -94.48% -
462.libquantum (unexplained diff vs previous) 41.38% 29.000 41.000 - 4000.00% -
450.soplex (unexplained diff vs previous) 38.67% 75.000 104.000 - -66.56% -
450.soplex (unexplained diff vs previous) (percentage) 37.25% 0.510 0.700 - -65.17% -
434.zeusmp (max) 33.33% 12.000 16.000 - -94.68% -
434.zeusmp (max) (percentage) 33.33% 0.090 0.120 - -94.74% -
434.zeusmp (unexplained diff vs previous) (percentage) 33.33% 0.090 0.120 - -94.85% -
435.gromacs (avg) (percentage) 23.08% 0.130 0.160 - -90.75% -
473.astar (max) (percentage) 22.22% 0.090 0.110 - -21.43% -
435.gromacs 22.22% 18.000 22.000 - -91.73% -
435.gromacs (avg) 22.22% 18.000 22.000 - -91.73% -
473.astar (max) 21.43% 14.000 17.000 - -15.00% -
429.mcf (unexplained diff vs previous) 17.86% 28.000 33.000 - -64.52% -
429.mcf (unexplained diff vs previous) (percentage) 14.29% 0.140 0.160 - -70.37% -
434.zeusmp (avg) (percentage) 11.11% 0.090 0.100 - -93.24% -
401.bzip2 (avg) (percentage) 10.71% 0.280 0.310 - -29.55% -
401.bzip2 10.00% 40.000 44.000 - -33.33% -
401.bzip2 (avg) 10.00% 40.000 44.000 - -33.33% -
434.zeusmp 8.33% 12.000 13.000 - -93.33% -
434.zeusmp (avg) 8.33% 12.000 13.000 - -93.33% -
462.libquantum (max) (percentage) 7.14% 0.280 0.300 - -53.12% -
464.h264ref 5.80% 69.000 73.000 - -6.41% -
464.h264ref (avg) 5.80% 69.000 73.000 - -6.41% -
462.libquantum 5.56% 36.000 38.000 - -49.33% -
462.libquantum (avg) 5.56% 36.000 38.000 - -49.33% -
462.libquantum (max) 5.26% 38.000 40.000 - -45.95% -
462.libquantum (avg) (percentage) 3.70% 0.270 0.280 - -56.92% -
450.soplex 3.09% 97.000 100.000 - -47.64% -
450.soplex (avg) 3.09% 97.000 100.000 - -47.64% -
450.soplex (avg) (percentage) 3.03% 0.660 0.680 - -45.16% -
437.leslie3d (unexplained diff vs previous) (percentage) 1.13% 2.650 2.680 - 17.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -2.61% 14075.000 13708.000 - -8.64% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) (percentage) -88.89% 0.450 0.050 - -50.00% -
410.bwaves (unexplained diff vs previous) -87.88% 66.000 8.000 - -46.67% -
433.milc (unexplained diff vs previous) (percentage) -71.43% 0.490 0.140 - -95.73% -
433.milc (unexplained diff vs previous) -70.49% 61.000 18.000 - -95.76% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -67.86% 2.800 0.900 - 328.57% -
459.GemsFDTD (unexplained diff vs previous) -67.59% 617.000 200.000 - 316.67% -
436.cactusADM (unexplained diff vs previous) -66.67% 9.000 3.000 - -99.47% -
436.cactusADM (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 - -99.38% -
444.namd (unexplained diff vs previous) -58.54% 82.000 34.000 - -95.14% -
444.namd (unexplained diff vs previous) (percentage) -57.95% 0.880 0.370 - -95.21% -
482.sphinx3 (unexplained diff vs previous) (percentage) -48.57% 0.700 0.360 - -41.94% -
482.sphinx3 (unexplained diff vs previous) -48.44% 192.000 99.000 - -46.77% -
471.omnetpp (unexplained diff vs previous) -40.91% 154.000 91.000 - 250.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -40.35% 1.140 0.680 - 183.33% -
454.calculix (unexplained diff vs previous) -40.00% 30.000 18.000 - 260.00% -
410.bwaves -39.44% 251.000 152.000 - -5.00% -
410.bwaves (avg) -39.44% 251.000 152.000 - -5.00% -
410.bwaves (avg) (percentage) -39.18% 1.710 1.040 - -4.59% -
454.calculix (avg) (percentage) -38.49% 2.650 1.630 - -18.91% -
454.calculix -38.38% 555.000 342.000 - -25.49% -
454.calculix (avg) -38.38% 555.000 342.000 - -25.49% -
453.povray -38.14% 97.000 60.000 - -25.93% -
453.povray (avg) -38.14% 97.000 60.000 - -25.93% -
453.povray (avg) (percentage) -38.03% 1.420 0.880 - -29.60% -
444.namd -36.61% 366.000 232.000 - -34.65% -
444.namd (avg) -36.61% 366.000 232.000 - -34.65% -
444.namd (avg) (percentage) -36.29% 3.940 2.510 - -36.13% -
454.calculix (unexplained diff vs previous) (percentage) -35.71% 0.140 0.090 - 350.00% -
445.gobmk -33.90% 59.000 39.000 - -57.61% -
445.gobmk (avg) -33.90% 59.000 39.000 - -57.61% -
445.gobmk (avg) (percentage) -32.65% 0.490 0.330 - -57.14% -
447.dealII (avg) (percentage) -31.45% 1.240 0.850 - -20.56% -
447.dealII -31.36% 118.000 81.000 - -22.12% -
447.dealII (avg) -31.36% 118.000 81.000 - -22.12% -
482.sphinx3 (avg) (percentage) -31.33% 1.660 1.140 - -21.92% -
482.sphinx3 -31.14% 456.000 314.000 - -27.98% -
482.sphinx3 (avg) -31.14% 456.000 314.000 - -27.98% -
470.lbm -28.16% 277.000 199.000 - -34.32% -
470.lbm (avg) -28.16% 277.000 199.000 - -34.32% -
470.lbm (avg) (percentage) -27.55% 1.960 1.420 - -40.08% -
433.milc (avg) (percentage) -26.32% 0.380 0.280 - -83.53% -
471.omnetpp (max) -25.81% 155.000 115.000 - -82.63% -
433.milc -25.53% 47.000 35.000 - -84.09% -
433.milc (avg) -25.53% 47.000 35.000 - -84.09% -
471.omnetpp (max) (percentage) -25.22% 1.150 0.860 - -86.06% -
436.cactusADM (avg) (percentage) -25.00% 0.080 0.060 - -96.39% -
459.GemsFDTD (max) (percentage) -25.00% 2.880 2.160 - 260.00% -
459.GemsFDTD (max) -24.41% 635.000 480.000 - 242.86% -
459.GemsFDTD (avg) (percentage) -22.17% 2.030 1.580 - 75.56% -
459.GemsFDTD -21.48% 447.000 351.000 - 67.14% -
459.GemsFDTD (avg) -21.48% 447.000 351.000 - 67.14% -
436.cactusADM -21.43% 14.000 11.000 - -96.22% -
436.cactusADM (avg) -21.43% 14.000 11.000 - -96.22% -
403.gcc (max) -15.62% 32.000 27.000 - -57.81% -
403.gcc (max) (percentage) -13.51% 0.370 0.320 - -55.56% -
400.perlbench (max) -13.41% 82.000 71.000 - -79.42% -
433.milc (max) -13.33% 60.000 52.000 - -87.35% -
400.perlbench (max) (percentage) -12.99% 0.770 0.670 - -79.32% -
458.sjeng (max) (percentage) -12.90% 0.310 0.270 - 22.73% -
458.sjeng (max) -12.77% 47.000 41.000 - 32.26% -
433.milc (max) (percentage) -12.50% 0.480 0.420 - -86.75% -
436.cactusADM (max) -12.50% 16.000 14.000 - -97.46% -
437.leslie3d (max) -12.21% 426.000 374.000 - 6.55% -
464.h264ref (max) (percentage) -12.16% 0.740 0.650 - 51.16% -
483.xalancbmk (max) -11.54% 26.000 23.000 - -48.89% -
465.tonto (max) -10.93% 183.000 163.000 - -44.37% -
465.tonto (max) (percentage) -10.42% 1.920 1.720 - -51.96% -
470.lbm (max) -10.34% 464.000 416.000 - -36.29% -
444.namd (max) -10.27% 555.000 498.000 - -23.27% -
481.wrf (max) -10.26% 536.000 481.000 - -9.25% -
481.wrf (max) (percentage) -10.07% 2.980 2.680 - -14.92% -
410.bwaves (max) (percentage) -10.00% 2.600 2.340 - 1014.29% -
416.gamess (max) (percentage) -10.00% 0.200 0.180 - -93.77% -
445.gobmk (unexplained diff vs previous) (percentage) -10.00% 0.100 0.090 - -94.19% -
483.xalancbmk (max) (percentage) -10.00% 0.200 0.180 - -56.10% -
453.povray (max) (percentage) -10.00% 2.200 1.980 - -21.74% -
454.calculix (max) (percentage) -9.95% 4.220 3.800 - -19.15% -
410.bwaves (max) -9.95% 382.000 344.000 - 1046.67% -
454.calculix (max) -9.94% 885.000 797.000 - -25.79% -
453.povray (max) -9.93% 151.000 136.000 - -17.58% -
437.leslie3d (max) (percentage) -9.90% 3.030 2.730 - 16.67% -
444.namd (max) (percentage) -9.88% 5.970 5.380 - -25.07% -
470.lbm (max) (percentage) -9.76% 3.280 2.960 - -41.96% -
447.dealII (max) (percentage) -9.74% 1.950 1.760 - 60.00% -
447.dealII (max) -9.68% 186.000 168.000 - 57.01% -
482.sphinx3 (max) (percentage) -9.66% 2.070 1.870 - 27.21% -
429.mcf -9.52% 42.000 38.000 - -57.78% -
429.mcf (avg) -9.52% 42.000 38.000 - -57.78% -
429.mcf (avg) (percentage) -9.52% 0.210 0.190 - -64.15% -
445.gobmk (max) -9.43% 106.000 96.000 - -47.54% -
482.sphinx3 (max) -9.33% 568.000 515.000 - 17.31% -
416.gamess (max) -9.09% 44.000 40.000 - -93.90% -
435.gromacs (max) (percentage) -9.09% 0.220 0.200 - -90.10% -
445.gobmk (max) (percentage) -9.09% 0.880 0.800 - -47.71% -
429.mcf (max) (percentage) -8.70% 0.230 0.210 - -61.11% -
429.mcf (max) -8.70% 46.000 42.000 - -54.35% -
445.gobmk (unexplained diff vs previous) -8.33% 12.000 11.000 - -94.09% -
456.hmmer (max) (percentage) -8.33% 0.600 0.550 - -56.69% -
464.h264ref (max) -8.25% 97.000 89.000 - 43.55% -
456.hmmer (max) -8.06% 62.000 57.000 - -59.29% -
435.gromacs (max) -6.67% 30.000 28.000 - -91.00% -
437.leslie3d -6.59% 410.000 383.000 - 7.28% -
437.leslie3d (avg) -6.59% 410.000 383.000 - 7.28% -
401.bzip2 (max) -5.26% 57.000 54.000 - -59.40% -
401.bzip2 (max) (percentage) -5.00% 0.400 0.380 - -56.82% -
456.hmmer (avg) (percentage) -4.76% 0.420 0.400 - -41.18% -
456.hmmer -4.65% 43.000 41.000 - -45.33% -
456.hmmer (avg) -4.65% 43.000 41.000 - -45.33% -
437.leslie3d (avg) (percentage) -4.11% 2.920 2.800 - 17.65% -
471.omnetpp -3.06% 98.000 95.000 - -44.12% -
471.omnetpp (avg) -3.06% 98.000 95.000 - -44.12% -
471.omnetpp (avg) (percentage) -2.74% 0.730 0.710 - -55.35% -
437.leslie3d (unexplained diff vs previous) -1.61% 373.000 367.000 - 7.00% -
450.soplex (max) (percentage) -1.39% 0.720 0.710 - -63.96% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.60% 260647.000 267429.000 - 0.00% -
459.GemsFDTD 1.29% 253716.000 256984.000 - 0.00% -
400.perlbench 1.24% 930652.000 942188.000 - -0.86% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 25.10% 10739.000 13435.000 - -0.67% -
429.mcf 18.98% 17158.000 20414.000 - 0.16% -
462.libquantum 17.65% 11614.000 13664.000 - 0.30% -
483.xalancbmk 17.52% 11172.000 13129.000 - -0.17% -
465.tonto 15.92% 8205.000 9511.000 - -0.26% -
470.lbm 9.85% 12819.000 14082.000 - -0.61% -
458.sjeng 7.37% 14275.000 15327.000 - 0.35% -
481.wrf 6.74% 16834.000 17969.000 - -0.20% -
473.astar 5.79% 14932.000 15796.000 - 0.11% -
453.povray 5.44% 6544.000 6900.000 - 0.07% -
434.zeusmp 5.11% 13211.000 13886.000 - 0.12% -
436.cactusADM 4.53% 17544.000 18338.000 - 0.02% -
444.namd 2.46% 9050.000 9273.000 - -0.37% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 4000.00% 1.000 41.000 - 41.38% -
462.libquantum (unexplained diff vs previous) (percentage) 2900.00% 0.010 0.300 - 42.86% -
410.bwaves (max) 1046.67% 30.000 344.000 - -9.95% -
410.bwaves (max) (percentage) 1014.29% 0.210 2.340 - -10.00% -
470.lbm (unexplained diff vs previous) 514.29% 14.000 86.000 - 473.33% -
473.astar (unexplained diff vs previous) 500.00% 3.000 18.000 - 800.00% -
470.lbm (unexplained diff vs previous) (percentage) 454.55% 0.110 0.610 - 454.55% -
473.astar (unexplained diff vs previous) (percentage) 450.00% 0.020 0.110 - 1000.00% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - 66.67% -
454.calculix (unexplained diff vs previous) (percentage) 350.00% 0.020 0.090 - -35.71% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 328.57% 0.210 0.900 - -67.86% -
459.GemsFDTD (unexplained diff vs previous) 316.67% 48.000 200.000 - -67.59% -
454.calculix (unexplained diff vs previous) 260.00% 5.000 18.000 - -40.00% -
459.GemsFDTD (max) (percentage) 260.00% 0.600 2.160 - -25.00% -
453.povray (unexplained diff vs previous) (percentage) 250.00% 0.020 0.070 - 75.00% -
471.omnetpp (unexplained diff vs previous) 250.00% 26.000 91.000 - -40.91% -
459.GemsFDTD (max) 242.86% 140.000 480.000 - -24.41% -
471.omnetpp (unexplained diff vs previous) (percentage) 183.33% 0.240 0.680 - -40.35% -
459.GemsFDTD (avg) (percentage) 75.56% 0.900 1.580 - -22.17% -
459.GemsFDTD 67.14% 210.000 351.000 - -21.48% -
459.GemsFDTD (avg) 67.14% 210.000 351.000 - -21.48% -
447.dealII (max) (percentage) 60.00% 1.100 1.760 - -9.74% -
447.dealII (max) 57.01% 107.000 168.000 - -9.68% -
464.h264ref (max) (percentage) 51.16% 0.430 0.650 - -12.16% -
464.h264ref (max) 43.55% 62.000 89.000 - -8.25% -
458.sjeng (max) 32.26% 31.000 41.000 - -12.77% -
482.sphinx3 (max) (percentage) 27.21% 1.470 1.870 - -9.66% -
458.sjeng (max) (percentage) 22.73% 0.220 0.270 - -12.90% -
437.leslie3d (avg) (percentage) 17.65% 2.380 2.800 - -4.11% -
482.sphinx3 (max) 17.31% 439.000 515.000 - -9.33% -
437.leslie3d (unexplained diff vs previous) (percentage) 17.03% 2.290 2.680 - 1.13% -
437.leslie3d (max) (percentage) 16.67% 2.340 2.730 - -9.90% -
481.wrf 14.47% 318.000 364.000 - -0.27% -
481.wrf (avg) 14.47% 318.000 364.000 - -0.27% -
481.wrf (avg) (percentage) 7.41% 1.890 2.030 - 0.00% -
437.leslie3d 7.28% 357.000 383.000 - -6.59% -
437.leslie3d (avg) 7.28% 357.000 383.000 - -6.59% -
437.leslie3d (unexplained diff vs previous) 7.00% 343.000 367.000 - -1.61% -
437.leslie3d (max) 6.55% 351.000 374.000 - -12.21% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.33% 120221.000 116217.000 - 3.68% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
435.gromacs -8.70% 15419.000 14077.000 - 0.20% -
437.leslie3d -8.64% 15005.000 13708.000 - -2.61% -
454.calculix -8.14% 22860.000 20999.000 - 0.09% -
482.sphinx3 -7.85% 29928.000 27580.000 - 0.36% -
401.bzip2 -6.16% 15185.000 14249.000 - -0.36% -
456.hmmer -5.49% 11046.000 10440.000 - 0.37% -
464.h264ref -5.37% 14556.000 13775.000 - 4.77% -
459.GemsFDTD -4.72% 23356.000 22253.000 - 0.91% -
450.soplex -4.07% 15466.000 14836.000 - 0.71% -
433.milc -3.22% 12976.000 12558.000 - 0.14% -
403.gcc -2.93% 9010.000 8746.000 - 0.42% -
447.dealII -1.86% 9751.000 9570.000 - 0.26% -
416.gamess -1.22% 22704.000 22426.000 - 0.00% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM (unexplained diff vs previous) -99.47% 570.000 3.000 - -66.67% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.38% 3.250 0.020 - -60.00% -
436.cactusADM (max) -97.46% 552.000 14.000 - -12.50% -
436.cactusADM (max) (percentage) -97.46% 3.150 0.080 - -11.11% -
436.cactusADM (avg) (percentage) -96.39% 1.660 0.060 - -25.00% -
436.cactusADM -96.22% 291.000 11.000 - -21.43% -
436.cactusADM (avg) -96.22% 291.000 11.000 - -21.43% -
433.milc (unexplained diff vs previous) -95.76% 425.000 18.000 - -70.49% -
433.milc (unexplained diff vs previous) (percentage) -95.73% 3.280 0.140 - -71.43% -
444.namd (unexplained diff vs previous) (percentage) -95.21% 7.730 0.370 - -57.95% -
444.namd (unexplained diff vs previous) -95.14% 700.000 34.000 - -58.54% -
434.zeusmp (unexplained diff vs previous) (percentage) -94.85% 2.330 0.120 - 33.33% -
434.zeusmp (max) (percentage) -94.74% 2.280 0.120 - 33.33% -
434.zeusmp (max) -94.68% 301.000 16.000 - 33.33% -
434.zeusmp (unexplained diff vs previous) -94.48% 308.000 17.000 - 41.67% -
445.gobmk (unexplained diff vs previous) (percentage) -94.19% 1.550 0.090 - -10.00% -
445.gobmk (unexplained diff vs previous) -94.09% 186.000 11.000 - -8.33% -
416.gamess (max) -93.90% 656.000 40.000 - -9.09% -
416.gamess (max) (percentage) -93.77% 2.890 0.180 - -10.00% -
434.zeusmp -93.33% 195.000 13.000 - 8.33% -
434.zeusmp (avg) -93.33% 195.000 13.000 - 8.33% -
434.zeusmp (avg) (percentage) -93.24% 1.480 0.100 - 11.11% -
435.gromacs -91.73% 266.000 22.000 - 22.22% -
435.gromacs (avg) -91.73% 266.000 22.000 - 22.22% -
435.gromacs (unexplained diff vs previous) -91.19% 318.000 28.000 - 211.11% -
416.gamess -91.06% 492.000 44.000 - 0.00% -
416.gamess (avg) -91.06% 492.000 44.000 - 0.00% -
435.gromacs (max) -91.00% 311.000 28.000 - -6.67% -
416.gamess (avg) (percentage) -90.78% 2.170 0.200 - 0.00% -
435.gromacs (avg) (percentage) -90.75% 1.730 0.160 - 23.08% -
435.gromacs (unexplained diff vs previous) (percentage) -90.29% 2.060 0.200 - 233.33% -
435.gromacs (max) (percentage) -90.10% 2.020 0.200 - -9.09% -
433.milc (max) -87.35% 411.000 52.000 - -13.33% -
433.milc (max) (percentage) -86.75% 3.170 0.420 - -12.50% -
471.omnetpp (max) (percentage) -86.06% 6.170 0.860 - -25.22% -
433.milc -84.09% 220.000 35.000 - -25.53% -
433.milc (avg) -84.09% 220.000 35.000 - -25.53% -
433.milc (avg) (percentage) -83.53% 1.700 0.280 - -26.32% -
471.omnetpp (max) -82.63% 662.000 115.000 - -25.81% -
400.perlbench (max) -79.42% 345.000 71.000 - -13.41% -
400.perlbench (max) (percentage) -79.32% 3.240 0.670 - -12.99% -
429.mcf (unexplained diff vs previous) (percentage) -70.37% 0.540 0.160 - 14.29% -
483.xalancbmk (avg) (percentage) -70.15% 0.670 0.200 - 0.00% -
400.perlbench (avg) (percentage) -67.35% 1.470 0.480 - 0.00% -
400.perlbench -67.31% 156.000 51.000 - 0.00% -
400.perlbench (avg) -67.31% 156.000 51.000 - 0.00% -
447.dealII (unexplained diff vs previous) -67.11% 76.000 25.000 - 400.00% -
447.dealII (unexplained diff vs previous) (percentage) -66.67% 0.780 0.260 - 420.00% -
450.soplex (unexplained diff vs previous) -66.56% 311.000 104.000 - 38.67% -
450.soplex (max) -65.46% 304.000 105.000 - -0.94% -
450.soplex (unexplained diff vs previous) (percentage) -65.17% 2.010 0.700 - 37.25% -
483.xalancbmk -64.86% 74.000 26.000 - 0.00% -
483.xalancbmk (avg) -64.86% 74.000 26.000 - 0.00% -
429.mcf (unexplained diff vs previous) -64.52% 93.000 33.000 - 17.86% -
429.mcf (avg) (percentage) -64.15% 0.530 0.190 - -9.52% -
450.soplex (max) (percentage) -63.96% 1.970 0.710 - -1.39% -
401.bzip2 (unexplained diff vs previous) -61.36% 132.000 51.000 - 537.50% -
429.mcf (max) (percentage) -61.11% 0.540 0.210 - -8.70% -
401.bzip2 (max) -59.40% 133.000 54.000 - -5.26% -
456.hmmer (max) -59.29% 140.000 57.000 - -8.06% -
401.bzip2 (unexplained diff vs previous) (percentage) -58.62% 0.870 0.360 - 500.00% -
473.astar (avg) (percentage) -57.89% 0.190 0.080 - 60.00% -
403.gcc (max) -57.81% 64.000 27.000 - -15.62% -
429.mcf -57.78% 90.000 38.000 - -9.52% -
429.mcf (avg) -57.78% 90.000 38.000 - -9.52% -
445.gobmk -57.61% 92.000 39.000 - -33.90% -
445.gobmk (avg) -57.61% 92.000 39.000 - -33.90% -
445.gobmk (avg) (percentage) -57.14% 0.770 0.330 - -32.65% -
473.astar -57.14% 28.000 12.000 - 71.43% -
473.astar (avg) -57.14% 28.000 12.000 - 71.43% -
462.libquantum (avg) (percentage) -56.92% 0.650 0.280 - 3.70% -
401.bzip2 (max) (percentage) -56.82% 0.880 0.380 - -5.00% -
456.hmmer (max) (percentage) -56.69% 1.270 0.550 - -8.33% -
483.xalancbmk (max) (percentage) -56.10% 0.410 0.180 - -10.00% -
403.gcc (max) (percentage) -55.56% 0.720 0.320 - -13.51% -
471.omnetpp (avg) (percentage) -55.35% 1.590 0.710 - -2.74% -
429.mcf (max) -54.35% 92.000 42.000 - -8.70% -
462.libquantum (max) (percentage) -53.12% 0.640 0.300 - 7.14% -
456.hmmer (unexplained diff vs previous) -53.01% 83.000 39.000 - 457.14% -
465.tonto (max) (percentage) -51.96% 3.580 1.720 - -10.42% -
456.hmmer (unexplained diff vs previous) (percentage) -50.67% 0.750 0.370 - 428.57% -
410.bwaves (unexplained diff vs previous) (percentage) -50.00% 0.100 0.050 - -88.89% -
462.libquantum -49.33% 75.000 38.000 - 5.56% -
462.libquantum (avg) -49.33% 75.000 38.000 - 5.56% -
483.xalancbmk (max) -48.89% 45.000 23.000 - -11.54% -
445.gobmk (max) (percentage) -47.71% 1.530 0.800 - -9.09% -
450.soplex -47.64% 191.000 100.000 - 3.09% -
450.soplex (avg) -47.64% 191.000 100.000 - 3.09% -
445.gobmk (max) -47.54% 183.000 96.000 - -9.43% -
482.sphinx3 (unexplained diff vs previous) -46.77% 186.000 99.000 - -48.44% -
410.bwaves (unexplained diff vs previous) -46.67% 15.000 8.000 - -87.88% -
462.libquantum (max) -45.95% 74.000 40.000 - 5.26% -
458.sjeng (avg) (percentage) -45.45% 0.330 0.180 - 0.00% -
456.hmmer -45.33% 75.000 41.000 - -4.65% -
456.hmmer (avg) -45.33% 75.000 41.000 - -4.65% -
450.soplex (avg) (percentage) -45.16% 1.240 0.680 - 3.03% -
465.tonto (max) -44.37% 293.000 163.000 - -10.93% -
471.omnetpp -44.12% 170.000 95.000 - -3.06% -
471.omnetpp (avg) -44.12% 170.000 95.000 - -3.06% -
458.sjeng -42.55% 47.000 27.000 - 0.00% -
458.sjeng (avg) -42.55% 47.000 27.000 - 0.00% -
470.lbm (max) (percentage) -41.96% 5.100 2.960 - -9.76% -
482.sphinx3 (unexplained diff vs previous) (percentage) -41.94% 0.620 0.360 - -48.57% -
456.hmmer (avg) (percentage) -41.18% 0.680 0.400 - -4.76% -
470.lbm (avg) (percentage) -40.08% 2.370 1.420 - -27.55% -
403.gcc -38.89% 54.000 33.000 - 0.00% -
403.gcc (avg) -38.89% 54.000 33.000 - 0.00% -
403.gcc (avg) (percentage) -37.70% 0.610 0.380 - 0.00% -
470.lbm (max) -36.29% 653.000 416.000 - -10.34% -
444.namd (avg) (percentage) -36.13% 3.930 2.510 - -36.29% -
444.namd -34.65% 355.000 232.000 - -36.61% -
444.namd (avg) -34.65% 355.000 232.000 - -36.61% -
470.lbm -34.32% 303.000 199.000 - -28.16% -
470.lbm (avg) -34.32% 303.000 199.000 - -28.16% -
401.bzip2 -33.33% 66.000 44.000 - 10.00% -
401.bzip2 (avg) -33.33% 66.000 44.000 - 10.00% -
453.povray (avg) (percentage) -29.60% 1.250 0.880 - -38.03% -
401.bzip2 (avg) (percentage) -29.55% 0.440 0.310 - 10.71% -
482.sphinx3 -27.98% 436.000 314.000 - -31.14% -
482.sphinx3 (avg) -27.98% 436.000 314.000 - -31.14% -
453.povray -25.93% 81.000 60.000 - -38.14% -
453.povray (avg) -25.93% 81.000 60.000 - -38.14% -
454.calculix (max) -25.79% 1074.000 797.000 - -9.94% -
454.calculix -25.49% 459.000 342.000 - -38.38% -
454.calculix (avg) -25.49% 459.000 342.000 - -38.38% -
444.namd (max) (percentage) -25.07% 7.180 5.380 - -9.88% -
444.namd (max) -23.27% 649.000 498.000 - -10.27% -
447.dealII -22.12% 104.000 81.000 - -31.36% -
447.dealII (avg) -22.12% 104.000 81.000 - -31.36% -
482.sphinx3 (avg) (percentage) -21.92% 1.460 1.140 - -31.33% -
453.povray (max) (percentage) -21.74% 2.530 1.980 - -10.00% -
473.astar (max) (percentage) -21.43% 0.140 0.110 - 22.22% -
465.tonto (avg) (percentage) -20.96% 1.670 1.320 - 0.00% -
447.dealII (avg) (percentage) -20.56% 1.070 0.850 - -31.45% -
454.calculix (max) (percentage) -19.15% 4.700 3.800 - -9.95% -
454.calculix (avg) (percentage) -18.91% 2.010 1.630 - -38.49% -
453.povray (max) -17.58% 165.000 136.000 - -9.93% -
473.astar (max) -15.00% 20.000 17.000 - 21.43% -
481.wrf (max) (percentage) -14.92% 3.150 2.680 - -10.07% -
481.wrf (max) -9.25% 530.000 481.000 - -10.26% -
465.tonto -8.76% 137.000 125.000 - 0.00% -
465.tonto (avg) -8.76% 137.000 125.000 - 0.00% -
464.h264ref -6.41% 78.000 73.000 - 5.80% -
464.h264ref (avg) -6.41% 78.000 73.000 - 5.80% -
410.bwaves -5.00% 160.000 152.000 - -39.44% -
410.bwaves (avg) -5.00% 160.000 152.000 - -39.44% -
410.bwaves (avg) (percentage) -4.59% 1.090 1.040 - -39.18% -
464.h264ref (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 10653.000 -
401.bzip2 14249.000 -
403.gcc 8746.000 -
410.bwaves 14708.000 -
416.gamess 22426.000 -
429.mcf 20414.000 -
433.milc 12558.000 -
434.zeusmp 13886.000 -
435.gromacs 14077.000 -
436.cactusADM 18338.000 -
437.leslie3d 13708.000 -2.61%
444.namd 9273.000 -
445.gobmk 12111.000 -
447.dealII 9570.000 -
450.soplex 14836.000 -
453.povray 6900.000 -
454.calculix 20999.000 -
456.hmmer 10440.000 -
458.sjeng 15327.000 -
459.GemsFDTD 22253.000 -
462.libquantum 13664.000 -
464.h264ref 13775.000 4.77%
465.tonto 9511.000 -
470.lbm 14082.000 -
471.omnetpp 13435.000 -
473.astar 15796.000 -
481.wrf 17969.000 -
482.sphinx3 27580.000 -
483.xalancbmk 13129.000 -
Geometric Mean 13956.535 -
Code Size (bytes)
Name Current %
400.perlbench 942188.000 -
401.bzip2 49876.000 -
403.gcc 2689235.000 -
410.bwaves 17880.000 -
416.gamess 6270571.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678629.000 -
436.cactusADM 553558.000 -
437.leslie3d 64933.000 -
444.namd 190967.000 -
445.gobmk 1399427.000 -
447.dealII 2113487.000 -
450.soplex 267429.000 -
453.povray 705068.000 -
454.calculix 1272374.000 -
456.hmmer 231185.000 -
458.sjeng 116217.000 3.68%
459.GemsFDTD 256984.000 -
462.libquantum 31291.000 -
464.h264ref 427908.000 -
465.tonto 2875168.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2643749.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3294630.000 -
Geometric Mean 298252.972 -
sample variability
Name Current %
400.perlbench 51.000 -
400.perlbench (avg) 51.000 -
400.perlbench (avg) (percentage) 0.480 -
400.perlbench (max) 71.000 -13.41%
400.perlbench (max) (percentage) 0.670 -12.99%
401.bzip2 44.000 10.00%
401.bzip2 (avg) 44.000 10.00%
401.bzip2 (avg) (percentage) 0.310 10.71%
401.bzip2 (max) 54.000 -5.26%
401.bzip2 (max) (percentage) 0.380 -5.00%
401.bzip2 (unexplained diff vs previous) 51.000 537.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.360 500.00%
403.gcc 33.000 -
403.gcc (avg) 33.000 -
403.gcc (avg) (percentage) 0.380 -
403.gcc (max) 27.000 -15.62%
403.gcc (max) (percentage) 0.320 -13.51%
410.bwaves 152.000 -39.44%
410.bwaves (avg) 152.000 -39.44%
410.bwaves (avg) (percentage) 1.040 -39.18%
410.bwaves (max) 344.000 -9.95%
410.bwaves (max) (percentage) 2.340 -10.00%
410.bwaves (unexplained diff vs previous) 8.000 -87.88%
410.bwaves (unexplained diff vs previous) (percentage) 0.050 -88.89%
416.gamess 44.000 -
416.gamess (avg) 44.000 -
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) 40.000 -9.09%
416.gamess (max) (percentage) 0.180 -10.00%
429.mcf 38.000 -9.52%
429.mcf (avg) 38.000 -9.52%
429.mcf (avg) (percentage) 0.190 -9.52%
429.mcf (max) 42.000 -8.70%
429.mcf (max) (percentage) 0.210 -8.70%
429.mcf (unexplained diff vs previous) 33.000 17.86%
429.mcf (unexplained diff vs previous) (percentage) 0.160 14.29%
433.milc 35.000 -25.53%
433.milc (avg) 35.000 -25.53%
433.milc (avg) (percentage) 0.280 -26.32%
433.milc (max) 52.000 -13.33%
433.milc (max) (percentage) 0.420 -12.50%
433.milc (unexplained diff vs previous) 18.000 -70.49%
433.milc (unexplained diff vs previous) (percentage) 0.140 -71.43%
434.zeusmp 13.000 8.33%
434.zeusmp (avg) 13.000 8.33%
434.zeusmp (avg) (percentage) 0.100 11.11%
434.zeusmp (max) 16.000 33.33%
434.zeusmp (max) (percentage) 0.120 33.33%
434.zeusmp (unexplained diff vs previous) 17.000 41.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 33.33%
435.gromacs 22.000 22.22%
435.gromacs (avg) 22.000 22.22%
435.gromacs (avg) (percentage) 0.160 23.08%
435.gromacs (max) 28.000 -6.67%
435.gromacs (max) (percentage) 0.200 -9.09%
435.gromacs (unexplained diff vs previous) 28.000 211.11%
435.gromacs (unexplained diff vs previous) (percentage) 0.200 233.33%
436.cactusADM 11.000 -21.43%
436.cactusADM (avg) 11.000 -21.43%
436.cactusADM (avg) (percentage) 0.060 -25.00%
436.cactusADM (max) 14.000 -12.50%
436.cactusADM (max) (percentage) 0.080 -
436.cactusADM (unexplained diff vs previous) 3.000 -66.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.020 -60.00%
437.leslie3d 383.000 -6.59%
437.leslie3d (avg) 383.000 -6.59%
437.leslie3d (avg) (percentage) 2.800 -4.11%
437.leslie3d (max) 374.000 -12.21%
437.leslie3d (max) (percentage) 2.730 -9.90%
437.leslie3d (unexplained diff vs previous) 367.000 -1.61%
437.leslie3d (unexplained diff vs previous) (percentage) 2.680 1.13%
444.namd 232.000 -36.61%
444.namd (avg) 232.000 -36.61%
444.namd (avg) (percentage) 2.510 -36.29%
444.namd (max) 498.000 -10.27%
444.namd (max) (percentage) 5.380 -9.88%
444.namd (unexplained diff vs previous) 34.000 -58.54%
444.namd (unexplained diff vs previous) (percentage) 0.370 -57.95%
445.gobmk 39.000 -33.90%
445.gobmk (avg) 39.000 -33.90%
445.gobmk (avg) (percentage) 0.330 -32.65%
445.gobmk (max) 96.000 -9.43%
445.gobmk (max) (percentage) 0.800 -9.09%
445.gobmk (unexplained diff vs previous) 11.000 -8.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.090 -10.00%
447.dealII 81.000 -31.36%
447.dealII (avg) 81.000 -31.36%
447.dealII (avg) (percentage) 0.850 -31.45%
447.dealII (max) 168.000 -9.68%
447.dealII (max) (percentage) 1.760 -9.74%
447.dealII (unexplained diff vs previous) 25.000 400.00%
447.dealII (unexplained diff vs previous) (percentage) 0.260 420.00%
450.soplex 100.000 3.09%
450.soplex (avg) 100.000 3.09%
450.soplex (avg) (percentage) 0.680 3.03%
450.soplex (max) 105.000 -
450.soplex (max) (percentage) 0.710 -1.39%
450.soplex (unexplained diff vs previous) 104.000 38.67%
450.soplex (unexplained diff vs previous) (percentage) 0.700 37.25%
453.povray 60.000 -38.14%
453.povray (avg) 60.000 -38.14%
453.povray (avg) (percentage) 0.880 -38.03%
453.povray (max) 136.000 -9.93%
453.povray (max) (percentage) 1.980 -10.00%
453.povray (unexplained diff vs previous) 5.000 66.67%
453.povray (unexplained diff vs previous) (percentage) 0.070 75.00%
454.calculix 342.000 -38.38%
454.calculix (avg) 342.000 -38.38%
454.calculix (avg) (percentage) 1.630 -38.49%
454.calculix (max) 797.000 -9.94%
454.calculix (max) (percentage) 3.800 -9.95%
454.calculix (unexplained diff vs previous) 18.000 -40.00%
454.calculix (unexplained diff vs previous) (percentage) 0.090 -35.71%
456.hmmer 41.000 -4.65%
456.hmmer (avg) 41.000 -4.65%
456.hmmer (avg) (percentage) 0.400 -4.76%
456.hmmer (max) 57.000 -8.06%
456.hmmer (max) (percentage) 0.550 -8.33%
456.hmmer (unexplained diff vs previous) 39.000 457.14%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 428.57%
458.sjeng 27.000 -
458.sjeng (avg) 27.000 -
458.sjeng (avg) (percentage) 0.180 -
458.sjeng (max) 41.000 -12.77%
458.sjeng (max) (percentage) 0.270 -12.90%
459.GemsFDTD 351.000 -21.48%
459.GemsFDTD (avg) 351.000 -21.48%
459.GemsFDTD (avg) (percentage) 1.580 -22.17%
459.GemsFDTD (max) 480.000 -24.41%
459.GemsFDTD (max) (percentage) 2.160 -25.00%
459.GemsFDTD (unexplained diff vs previous) 200.000 -67.59%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.900 -67.86%
462.libquantum 38.000 5.56%
462.libquantum (avg) 38.000 5.56%
462.libquantum (avg) (percentage) 0.280 3.70%
462.libquantum (max) 40.000 5.26%
462.libquantum (max) (percentage) 0.300 7.14%
462.libquantum (unexplained diff vs previous) 41.000 41.38%
462.libquantum (unexplained diff vs previous) (percentage) 0.300 42.86%
464.h264ref 73.000 5.80%
464.h264ref (avg) 73.000 5.80%
464.h264ref (avg) (percentage) 0.530 -
464.h264ref (max) 89.000 -8.25%
464.h264ref (max) (percentage) 0.650 -12.16%
465.tonto 125.000 -
465.tonto (avg) 125.000 -
465.tonto (avg) (percentage) 1.320 -
465.tonto (max) 163.000 -10.93%
465.tonto (max) (percentage) 1.720 -10.42%
470.lbm 199.000 -28.16%
470.lbm (avg) 199.000 -28.16%
470.lbm (avg) (percentage) 1.420 -27.55%
470.lbm (max) 416.000 -10.34%
470.lbm (max) (percentage) 2.960 -9.76%
470.lbm (unexplained diff vs previous) 86.000 473.33%
470.lbm (unexplained diff vs previous) (percentage) 0.610 454.55%
471.omnetpp 95.000 -3.06%
471.omnetpp (avg) 95.000 -3.06%
471.omnetpp (avg) (percentage) 0.710 -2.74%
471.omnetpp (max) 115.000 -25.81%
471.omnetpp (max) (percentage) 0.860 -25.22%
471.omnetpp (unexplained diff vs previous) 91.000 -40.91%
471.omnetpp (unexplained diff vs previous) (percentage) 0.680 -40.35%
473.astar 12.000 71.43%
473.astar (avg) 12.000 71.43%
473.astar (avg) (percentage) 0.080 60.00%
473.astar (max) 17.000 21.43%
473.astar (max) (percentage) 0.110 22.22%
473.astar (unexplained diff vs previous) 18.000 800.00%
473.astar (unexplained diff vs previous) (percentage) 0.110 1000.00%
481.wrf 364.000 -
481.wrf (avg) 364.000 -
481.wrf (avg) (percentage) 2.030 -
481.wrf (max) 481.000 -10.26%
481.wrf (max) (percentage) 2.680 -10.07%
482.sphinx3 314.000 -31.14%
482.sphinx3 (avg) 314.000 -31.14%
482.sphinx3 (avg) (percentage) 1.140 -31.33%
482.sphinx3 (max) 515.000 -9.33%
482.sphinx3 (max) (percentage) 1.870 -9.66%
482.sphinx3 (unexplained diff vs previous) 99.000 -48.44%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -48.57%
483.xalancbmk 26.000 -
483.xalancbmk (avg) 26.000 -
483.xalancbmk (avg) (percentage) 0.200 -
483.xalancbmk (max) 23.000 -11.54%
483.xalancbmk (max) (percentage) 0.180 -10.00%
Geometric Mean 7.896 -4.01%