Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=93203eebe2abf35d94d738541e4c62472a4102b8 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/6223ea766daf7c9155106b9784302442e2ff98d3 (+ 163 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb5bbc20702981c287aa3e44640e7d2f2b9a28cf (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/114/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0114 (basepoints/gcc-14-03998-g6223ea766da) 2023-09-14T06:44:53 0:00:00
Previous 0112 (3-changed-components) 2023-09-12T06:52:43 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 24 12
Performance Improvements 94 175
Unchanged Tests 1118 1049
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.27% 2693.000 2754.000 - 1.10% -
450.soplex 2.04% 588.000 600.000 - 5.82% -
444.namd 1.49% 738.000 749.000 - 0.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 366.67% 0.030 0.140 - -99.95% -
450.soplex (unexplained diff vs previous) 300.00% 3.000 12.000 - -99.92% -
456.hmmer (unexplained diff vs previous) 300.00% 1.000 4.000 - -99.95% -
450.soplex (unexplained diff vs previous) (percentage) 292.16% 0.510 2.000 - -99.92% -
433.milc (unexplained diff vs previous) (percentage) 158.82% 0.170 0.440 - -99.96% -
433.milc (unexplained diff vs previous) 150.00% 2.000 5.000 - -99.96% -
470.lbm (unexplained diff vs previous) (percentage) 61.54% 0.260 0.420 - -99.84% -
470.lbm (unexplained diff vs previous) 60.00% 10.000 16.000 - -99.84% -
410.bwaves (unexplained diff vs previous) 51.61% 31.000 47.000 - -99.40% -
410.bwaves (max) (percentage) 50.91% 0.550 0.830 - -98.57% -
410.bwaves (unexplained diff vs previous) (percentage) 50.91% 0.550 0.830 - -99.40% -
450.soplex (max) 50.00% 8.000 12.000 - -97.80% -
410.bwaves (max) 48.39% 31.000 46.000 - -98.60% -
450.soplex (max) (percentage) 36.00% 1.500 2.040 - -97.88% -
429.mcf (max) (percentage) 22.83% 0.920 1.130 - -98.78% -
429.mcf (max) 15.38% 13.000 15.000 - -98.87% -
462.libquantum (max) (percentage) 12.70% 0.630 0.710 - -99.28% -
445.gobmk 1.39% 72.000 73.000 - -62.76% -
445.gobmk (avg) 1.39% 72.000 73.000 - -62.76% -
471.omnetpp 1.22% 82.000 83.000 - -62.78% -
471.omnetpp (avg) 1.22% 82.000 83.000 - -62.78% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
464.h264ref -2.09% 390608.000 382456.000 - -1.36% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -4.19% 1669.000 1599.000 - -3.85% -
403.gcc -3.39% 59.000 57.000 - 1.79% -
473.astar -1.90% 5264.000 5164.000 - 0.70% -
437.leslie3d -1.88% 10772.000 10569.000 - -9.20% -
454.calculix -1.61% 62.000 61.000 - -1.61% -
481.wrf -1.41% 5607.000 5528.000 - -0.11% -
464.h264ref -1.18% 5780.000 5712.000 - -0.85% -
429.mcf -1.13% 1417.000 1401.000 - -1.62% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -78.50% 1.070 0.230 - -99.94% -
401.bzip2 (unexplained diff vs previous) -78.12% 32.000 7.000 - -99.94% -
453.povray (unexplained diff vs previous) -50.00% 6.000 3.000 - -99.95% -
453.povray (unexplained diff vs previous) (percentage) -50.00% 1.100 0.550 - -99.95% -
436.cactusADM (max) -20.00% 15.000 12.000 - -99.35% -
471.omnetpp (unexplained diff vs previous) (percentage) -16.29% 2.640 2.210 - -99.44% -
471.omnetpp (unexplained diff vs previous) -14.08% 71.000 61.000 - -99.43% -
436.cactusADM (max) (percentage) -14.08% 0.710 0.610 - -99.31% -
436.cactusADM (unexplained diff vs previous) (percentage) -14.08% 0.710 0.610 - -99.92% -
436.cactusADM (unexplained diff vs previous) -13.33% 15.000 13.000 - -99.92% -
401.bzip2 (max) -12.90% 31.000 27.000 - -98.83% -
435.gromacs (max) -12.66% 79.000 69.000 - -98.07% -
401.bzip2 (max) (percentage) -12.38% 1.050 0.920 - -98.83% -
400.perlbench (max) -12.00% 50.000 44.000 - -96.85% -
471.omnetpp (max) (percentage) -11.67% 2.570 2.270 - -97.15% -
435.gromacs (max) (percentage) -11.11% 1.080 0.960 - -98.05% -
471.omnetpp (max) -10.14% 69.000 62.000 - -97.14% -
482.sphinx3 (max) -10.00% 10.000 9.000 - -99.01% -
433.milc (max) (percentage) -9.62% 0.520 0.470 - -99.48% -
456.hmmer (max) -9.09% 11.000 10.000 - -99.53% -
458.sjeng (max) -9.09% 22.000 20.000 - -99.44% -
437.leslie3d (max) -8.46% 1146.000 1049.000 - -45.62% -
473.astar (max) -8.41% 107.000 98.000 - -97.12% -
464.h264ref (max) -8.33% 24.000 22.000 - -99.30% -
434.zeusmp (max) (percentage) -7.69% 0.130 0.120 - -99.85% -
456.hmmer (max) (percentage) -7.69% 0.390 0.360 - -99.51% -
444.namd (max) (percentage) -7.41% 0.810 0.750 - -99.18% -
400.perlbench (max) (percentage) -7.28% 3.020 2.800 - -96.67% -
473.astar (max) (percentage) -6.86% 2.040 1.900 - -97.14% -
437.leslie3d (max) (percentage) -6.67% 10.640 9.930 - -40.11% -
458.sjeng (max) (percentage) -6.67% 0.300 0.280 - -99.41% -
445.gobmk (max) (percentage) -6.29% 1.430 1.340 - -97.45% -
482.sphinx3 (max) (percentage) -6.25% 1.120 1.050 - -98.91% -
453.povray (max) (percentage) -6.04% 1.820 1.710 - -98.13% -
445.gobmk (max) -5.63% 71.000 67.000 - -97.47% -
465.tonto (max) (percentage) -5.63% 0.710 0.670 - -96.53% -
459.GemsFDTD (max) (percentage) -5.33% 0.750 0.710 - -99.01% -
481.wrf (max) -4.95% 101.000 96.000 - -97.47% -
473.astar (unexplained diff vs previous) -4.76% 105.000 100.000 - -99.01% -
464.h264ref (max) (percentage) -4.76% 0.420 0.400 - -99.26% -
470.lbm (max) (percentage) -4.69% 0.640 0.610 - -99.16% -
459.GemsFDTD (max) -4.44% 45.000 43.000 - -99.03% -
400.perlbench -4.35% 46.000 44.000 - -58.10% -
400.perlbench (avg) -4.35% 46.000 44.000 - -58.10% -
470.lbm (max) -4.17% 24.000 23.000 - -99.16% -
465.tonto (max) -3.90% 77.000 74.000 - -96.50% -
481.wrf (max) (percentage) -3.87% 1.810 1.740 - -97.47% -
447.dealII (max) (percentage) -2.94% 0.680 0.660 - -99.18% -
456.hmmer -2.63% 38.000 37.000 - -70.87% -
456.hmmer (avg) -2.63% 38.000 37.000 - -70.87% -
454.calculix (max) (percentage) -2.59% 2.320 2.260 - -97.73% -
473.astar (unexplained diff vs previous) (percentage) -2.51% 1.990 1.940 - -99.02% -
429.mcf -2.50% 80.000 78.000 - -28.44% -
429.mcf (avg) -2.50% 80.000 78.000 - -28.44% -
453.povray (avg) (percentage) -2.41% 2.490 2.430 - -68.89% -
482.sphinx3 (avg) (percentage) -2.30% 2.610 2.550 - -67.84% -
456.hmmer (avg) (percentage) -2.27% 1.320 1.290 - -70.75% -
434.zeusmp (avg) (percentage) -2.17% 1.840 1.800 - -69.23% -
434.zeusmp -2.17% 46.000 45.000 - -69.39% -
434.zeusmp (avg) -2.17% 46.000 45.000 - -69.39% -
401.bzip2 (avg) (percentage) -1.99% 2.010 1.970 - -64.05% -
437.leslie3d -1.87% 534.000 524.000 - 47.61% -
437.leslie3d (avg) -1.87% 534.000 524.000 - 47.61% -
473.astar -1.87% 107.000 105.000 - -50.70% -
473.astar (avg) -1.87% 107.000 105.000 - -50.70% -
436.cactusADM (avg) (percentage) -1.78% 2.250 2.210 - -63.04% -
429.mcf (avg) (percentage) -1.76% 5.680 5.580 - -27.25% -
401.bzip2 -1.67% 60.000 59.000 - -63.35% -
401.bzip2 (avg) -1.67% 60.000 59.000 - -63.35% -
462.libquantum (avg) (percentage) -1.60% 2.500 2.460 - -67.89% -
481.wrf -1.60% 125.000 123.000 - -64.35% -
481.wrf (avg) -1.60% 125.000 123.000 - -64.35% -
470.lbm (avg) (percentage) -1.59% 1.890 1.860 - -70.62% -
403.gcc (max) (percentage) -1.58% 6.330 6.230 - -93.73% -
483.xalancbmk (max) -1.45% 69.000 68.000 - -97.41% -
433.milc (avg) (percentage) -1.44% 2.080 2.050 - -66.12% -
470.lbm -1.41% 71.000 70.000 - -70.71% -
470.lbm (avg) -1.41% 71.000 70.000 - -70.71% -
410.bwaves (avg) (percentage) -1.31% 1.530 1.510 - -65.76% -
435.gromacs -1.18% 170.000 168.000 - -54.22% -
435.gromacs (avg) -1.18% 170.000 168.000 - -54.22% -
410.bwaves -1.16% 86.000 85.000 - -65.86% -
410.bwaves (avg) -1.16% 86.000 85.000 - -65.86% -
464.h264ref -1.02% 98.000 97.000 - -66.89% -
464.h264ref (avg) -1.02% 98.000 97.000 - -66.89% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 5.82% 567.000 600.000 - 2.04% -
401.bzip2 2.38% 2941.000 3011.000 - 0.23% -
436.cactusADM 2.30% 2083.000 2131.000 - 0.61% -
456.hmmer 1.94% 2882.000 2938.000 - 0.14% -
403.gcc 1.79% 56.000 57.000 - -3.39% -
483.xalancbmk 1.49% 3818.000 3875.000 - -0.84% -
471.omnetpp 1.10% 2724.000 2754.000 - 2.27% -
465.tonto 1.04% 10941.000 11055.000 - 0.95% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 62.62% 3.050 4.960 - 0.00% -
437.leslie3d 47.61% 355.000 524.000 - -1.87% -
437.leslie3d (avg) 47.61% 355.000 524.000 - -1.87% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.42% 244728.000 241256.000 - -0.00% -
464.h264ref -1.36% 387748.000 382456.000 - -2.09% -
453.povray -1.20% 661389.000 653437.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.20% 11640.000 10569.000 - -1.88% -
400.perlbench -3.85% 1663.000 1599.000 - -4.19% -
429.mcf -1.62% 1424.000 1401.000 - -1.13% -
454.calculix -1.61% 62.000 61.000 - -1.61% -
458.sjeng -1.18% 7567.000 7478.000 - -0.28% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.710 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.210 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.97% 11280.000 3.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.97% 448.690 0.120 - 0.00% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 5.000 - 150.00% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.440 - 158.82% -
456.hmmer (unexplained diff vs previous) -99.95% 8030.000 4.000 - 300.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.95% 278.630 0.140 - 366.67% -
453.povray (unexplained diff vs previous) -99.95% 5707.000 3.000 - -50.00% -
453.povray (unexplained diff vs previous) (percentage) -99.95% 1043.330 0.550 - -50.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.94% 368.340 0.230 - -78.50% -
401.bzip2 (unexplained diff vs previous) -99.94% 10833.000 7.000 - -78.12% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.92% 787.130 0.610 - -14.08% -
450.soplex (unexplained diff vs previous) (percentage) -99.92% 2557.320 2.000 - 292.16% -
436.cactusADM (unexplained diff vs previous) -99.92% 16396.000 13.000 - -13.33% -
450.soplex (unexplained diff vs previous) -99.92% 14500.000 12.000 - 300.00% -
429.mcf (unexplained diff vs previous) -99.91% 18593.000 16.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.91% 1305.690 1.140 - 0.00% -
434.zeusmp (max) -99.85% 2055.000 3.000 - 0.00% -
434.zeusmp (max) (percentage) -99.85% 81.770 0.120 - -7.69% -
470.lbm (unexplained diff vs previous) (percentage) -99.84% 263.730 0.420 - 61.54% -
470.lbm (unexplained diff vs previous) -99.84% 9990.000 16.000 - 60.00% -
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
456.hmmer (max) -99.53% 2120.000 10.000 - -9.09% -
433.milc (max) -99.52% 1044.000 5.000 - 0.00% -
456.hmmer (max) (percentage) -99.51% 73.590 0.360 - -7.69% -
433.milc (max) (percentage) -99.48% 90.750 0.470 - -9.62% -
458.sjeng (max) -99.44% 3602.000 20.000 - -9.09% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.44% 391.300 2.210 - -16.29% -
471.omnetpp (unexplained diff vs previous) -99.43% 10659.000 61.000 - -14.08% -
458.sjeng (max) (percentage) -99.41% 47.610 0.280 - -6.67% -
410.bwaves (unexplained diff vs previous) (percentage) -99.40% 137.900 0.830 - 50.91% -
410.bwaves (unexplained diff vs previous) -99.40% 7794.000 47.000 - 51.61% -
436.cactusADM (max) -99.35% 1848.000 12.000 - -20.00% -
436.cactusADM (max) (percentage) -99.31% 88.730 0.610 - -14.08% -
464.h264ref (max) -99.30% 3127.000 22.000 - -8.33% -
462.libquantum (max) (percentage) -99.28% 98.970 0.710 - 12.70% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
444.namd (max) -99.27% 685.000 5.000 - 0.00% -
464.h264ref (max) (percentage) -99.26% 54.290 0.400 - -4.76% -
447.dealII (max) -99.21% 1384.000 11.000 - 0.00% -
444.namd (max) (percentage) -99.18% 91.790 0.750 - -7.41% -
447.dealII (max) (percentage) -99.18% 80.280 0.660 - -2.94% -
470.lbm (max) -99.16% 2746.000 23.000 - -4.17% -
470.lbm (max) (percentage) -99.16% 72.510 0.610 - -4.69% -
459.GemsFDTD (max) -99.03% 4411.000 43.000 - -4.44% -
473.astar (unexplained diff vs previous) (percentage) -99.02% 197.850 1.940 - -2.51% -
473.astar (unexplained diff vs previous) -99.01% 10146.000 100.000 - -4.76% -
482.sphinx3 (max) -99.01% 911.000 9.000 - -10.00% -
459.GemsFDTD (max) (percentage) -99.01% 71.460 0.710 - -5.33% -
482.sphinx3 (max) (percentage) -98.91% 96.500 1.050 - -6.25% -
429.mcf (max) -98.87% 1322.000 15.000 - 15.38% -
401.bzip2 (max) -98.83% 2313.000 27.000 - -12.90% -
401.bzip2 (max) (percentage) -98.83% 78.650 0.920 - -12.38% -
429.mcf (max) (percentage) -98.78% 92.890 1.130 - 22.83% -
410.bwaves (max) -98.60% 3276.000 46.000 - 48.39% -
410.bwaves (max) (percentage) -98.57% 57.970 0.830 - 50.91% -
454.calculix (max) -98.36% 61.000 1.000 - 0.00% -
453.povray (max) -98.20% 499.000 9.000 - 0.00% -
453.povray (max) (percentage) -98.13% 91.250 1.710 - -6.04% -
435.gromacs (max) -98.07% 3573.000 69.000 - -12.66% -
435.gromacs (max) (percentage) -98.05% 49.160 0.960 - -11.11% -
450.soplex (max) (percentage) -97.88% 96.240 2.040 - 36.00% -
450.soplex (max) -97.80% 545.000 12.000 - 50.00% -
454.calculix (max) (percentage) -97.73% 99.730 2.260 - -2.59% -
481.wrf (max) -97.47% 3801.000 96.000 - -4.95% -
481.wrf (max) (percentage) -97.47% 68.700 1.740 - -3.87% -
445.gobmk (max) -97.47% 2643.000 67.000 - -5.63% -
445.gobmk (max) (percentage) -97.45% 52.630 1.340 - -6.29% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
483.xalancbmk (max) -97.41% 2621.000 68.000 - -1.45% -
471.omnetpp (max) (percentage) -97.15% 79.650 2.270 - -11.67% -
471.omnetpp (max) -97.14% 2169.000 62.000 - -10.14% -
473.astar (max) (percentage) -97.14% 66.430 1.900 - -6.86% -
473.astar (max) -97.12% 3406.000 98.000 - -8.41% -
400.perlbench (max) -96.85% 1397.000 44.000 - -12.00% -
400.perlbench (max) (percentage) -96.67% 84.060 2.800 - -7.28% -
465.tonto (max) (percentage) -96.53% 19.310 0.670 - -5.63% -
465.tonto (max) -96.50% 2112.000 74.000 - -3.90% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
403.gcc (max) (percentage) -93.73% 99.360 6.230 - -1.58% -
444.namd -72.06% 68.000 19.000 - 0.00% -
444.namd (avg) -72.06% 68.000 19.000 - 0.00% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
444.namd (avg) (percentage) -71.91% 9.220 2.590 - 0.00% -
456.hmmer -70.87% 127.000 37.000 - -2.63% -
456.hmmer (avg) -70.87% 127.000 37.000 - -2.63% -
456.hmmer (avg) (percentage) -70.75% 4.410 1.290 - -2.27% -
470.lbm -70.71% 239.000 70.000 - -1.41% -
470.lbm (avg) -70.71% 239.000 70.000 - -1.41% -
470.lbm (avg) (percentage) -70.62% 6.330 1.860 - -1.59% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
434.zeusmp -69.39% 147.000 45.000 - -2.17% -
434.zeusmp (avg) -69.39% 147.000 45.000 - -2.17% -
434.zeusmp (avg) (percentage) -69.23% 5.850 1.800 - -2.17% -
453.povray -69.05% 42.000 13.000 - 0.00% -
453.povray (avg) -69.05% 42.000 13.000 - 0.00% -
453.povray (avg) (percentage) -68.89% 7.810 2.430 - -2.41% -
462.libquantum (avg) (percentage) -67.89% 7.660 2.460 - -1.60% -
482.sphinx3 (avg) (percentage) -67.84% 7.930 2.550 - -2.30% -
482.sphinx3 -67.57% 74.000 24.000 - 0.00% -
482.sphinx3 (avg) -67.57% 74.000 24.000 - 0.00% -
459.GemsFDTD -67.22% 360.000 118.000 - 0.85% -
459.GemsFDTD (avg) -67.22% 360.000 118.000 - 0.85% -
464.h264ref -66.89% 293.000 97.000 - -1.02% -
464.h264ref (avg) -66.89% 293.000 97.000 - -1.02% -
459.GemsFDTD (avg) (percentage) -66.78% 5.840 1.940 - 0.00% -
433.milc -66.67% 69.000 23.000 - 0.00% -
433.milc (avg) -66.67% 69.000 23.000 - 0.00% -
464.h264ref (avg) (percentage) -66.60% 5.090 1.700 - 0.00% -
433.milc (avg) (percentage) -66.12% 6.050 2.050 - -1.44% -
410.bwaves -65.86% 249.000 85.000 - -1.16% -
410.bwaves (avg) -65.86% 249.000 85.000 - -1.16% -
410.bwaves (avg) (percentage) -65.76% 4.410 1.510 - -1.31% -
458.sjeng -65.56% 241.000 83.000 - 0.00% -
458.sjeng (avg) -65.56% 241.000 83.000 - 0.00% -
458.sjeng (avg) (percentage) -64.89% 3.190 1.120 - 0.00% -
447.dealII -64.65% 99.000 35.000 - 0.00% -
447.dealII (avg) -64.65% 99.000 35.000 - 0.00% -
481.wrf -64.35% 345.000 123.000 - -1.60% -
481.wrf (avg) -64.35% 345.000 123.000 - -1.60% -
447.dealII (avg) (percentage) -64.30% 5.770 2.060 - 0.00% -
481.wrf (avg) (percentage) -64.26% 6.240 2.230 - 0.00% -
401.bzip2 (avg) (percentage) -64.05% 5.480 1.970 - -1.99% -
401.bzip2 -63.35% 161.000 59.000 - -1.67% -
401.bzip2 (avg) -63.35% 161.000 59.000 - -1.67% -
471.omnetpp (avg) (percentage) -63.05% 8.200 3.030 - -0.66% -
436.cactusADM (avg) (percentage) -63.04% 5.980 2.210 - -1.78% -
445.gobmk (avg) (percentage) -62.92% 3.910 1.450 - 0.00% -
471.omnetpp -62.78% 223.000 83.000 - 1.22% -
471.omnetpp (avg) -62.78% 223.000 83.000 - 1.22% -
445.gobmk -62.76% 196.000 73.000 - 1.39% -
445.gobmk (avg) -62.76% 196.000 73.000 - 1.39% -
436.cactusADM -62.10% 124.000 47.000 - 0.00% -
436.cactusADM (avg) -62.10% 124.000 47.000 - 0.00% -
450.soplex (avg) (percentage) -59.41% 6.430 2.610 - -0.76% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
400.perlbench -58.10% 105.000 44.000 - -4.35% -
400.perlbench (avg) -58.10% 105.000 44.000 - -4.35% -
400.perlbench (avg) (percentage) -56.22% 6.350 2.780 - 0.00% -
465.tonto (avg) (percentage) -54.79% 3.340 1.510 - 0.00% -
465.tonto -54.52% 365.000 166.000 - 0.61% -
465.tonto (avg) -54.52% 365.000 166.000 - 0.61% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
435.gromacs -54.22% 367.000 168.000 - -1.18% -
435.gromacs (avg) -54.22% 367.000 168.000 - -1.18% -
435.gromacs (avg) (percentage) -54.15% 5.060 2.320 - 0.00% -
483.xalancbmk -54.03% 248.000 114.000 - -0.87% -
483.xalancbmk (avg) -54.03% 248.000 114.000 - -0.87% -
473.astar (avg) (percentage) -50.72% 4.160 2.050 - 0.00% -
473.astar -50.70% 213.000 105.000 - -1.87% -
473.astar (avg) -50.70% 213.000 105.000 - -1.87% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) (percentage) -48.63% 8.020 4.120 - 0.00% -
437.leslie3d (max) -45.62% 1929.000 1049.000 - -8.46% -
437.leslie3d (max) (percentage) -40.11% 16.580 9.930 - -6.67% -
429.mcf -28.44% 109.000 78.000 - -2.50% -
429.mcf (avg) -28.44% 109.000 78.000 - -2.50% -
429.mcf (avg) (percentage) -27.25% 7.670 5.580 - -1.76% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -24.59% 7.320 5.520 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1599.000 -4.19%
401.bzip2 3011.000 -
403.gcc 57.000 -3.39%
410.bwaves 5633.000 -
429.mcf 1401.000 -1.13%
433.milc 1144.000 -
434.zeusmp 2508.000 -
435.gromacs 7264.000 -
436.cactusADM 2131.000 -
437.leslie3d 10569.000 -1.88%
444.namd 749.000 1.49%
445.gobmk 5073.000 -
447.dealII 1738.000 -
450.soplex 600.000 2.04%
453.povray 550.000 -
454.calculix 61.000 -1.61%
456.hmmer 2938.000 -
458.sjeng 7478.000 -
459.GemsFDTD 6125.000 -
462.libquantum 141.000 -
464.h264ref 5712.000 -1.18%
465.tonto 11055.000 -
470.lbm 3812.000 -
471.omnetpp 2754.000 2.27%
473.astar 5164.000 -1.90%
481.wrf 5528.000 -1.41%
482.sphinx3 946.000 -
483.xalancbmk 3875.000 -
Geometric Mean 1970.825 -
Code Size (bytes)
Name Current %
400.perlbench 891979.000 -
401.bzip2 44201.000 -
403.gcc 2453199.000 -
410.bwaves 16720.000 -
429.mcf 9119.000 -
433.milc 61338.000 -
434.zeusmp 152069.000 -
435.gromacs 498293.000 -
436.cactusADM 352931.000 -
437.leslie3d 59387.000 -
444.namd 188128.000 -
445.gobmk 1378206.000 -
447.dealII 311186.000 -
450.soplex 204341.000 -
453.povray 653437.000 -
454.calculix 838466.000 -
456.hmmer 108331.000 -
458.sjeng 103592.000 -
459.GemsFDTD 241256.000 -
462.libquantum 16077.000 -
464.h264ref 382456.000 -2.09%
465.tonto 1935346.000 -
470.lbm 9707.000 -
471.omnetpp 480764.000 -
473.astar 22916.000 -
481.wrf 1962614.000 -
482.sphinx3 112735.000 -
483.xalancbmk 2334704.000 -
Geometric Mean 198929.136 -
sample variability
Name Current %
400.perlbench 44.000 -4.35%
400.perlbench (avg) 44.000 -4.35%
400.perlbench (avg) (percentage) 2.780 -
400.perlbench (max) 44.000 -12.00%
400.perlbench (max) (percentage) 2.800 -7.28%
401.bzip2 59.000 -1.67%
401.bzip2 (avg) 59.000 -1.67%
401.bzip2 (avg) (percentage) 1.970 -1.99%
401.bzip2 (max) 27.000 -12.90%
401.bzip2 (max) (percentage) 0.920 -12.38%
401.bzip2 (unexplained diff vs previous) 7.000 -78.12%
401.bzip2 (unexplained diff vs previous) (percentage) 0.230 -78.50%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.520 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.230 -1.58%
410.bwaves 85.000 -1.16%
410.bwaves (avg) 85.000 -1.16%
410.bwaves (avg) (percentage) 1.510 -1.31%
410.bwaves (max) 46.000 48.39%
410.bwaves (max) (percentage) 0.830 50.91%
410.bwaves (unexplained diff vs previous) 47.000 51.61%
410.bwaves (unexplained diff vs previous) (percentage) 0.830 50.91%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.100 -
429.mcf 78.000 -2.50%
429.mcf (avg) 78.000 -2.50%
429.mcf (avg) (percentage) 5.580 -1.76%
429.mcf (max) 15.000 15.38%
429.mcf (max) (percentage) 1.130 22.83%
429.mcf (unexplained diff vs previous) 16.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.140 -
433.milc 23.000 -
433.milc (avg) 23.000 -
433.milc (avg) (percentage) 2.050 -1.44%
433.milc (max) 5.000 -
433.milc (max) (percentage) 0.470 -9.62%
433.milc (unexplained diff vs previous) 5.000 150.00%
433.milc (unexplained diff vs previous) (percentage) 0.440 158.82%
434.zeusmp 45.000 -2.17%
434.zeusmp (avg) 45.000 -2.17%
434.zeusmp (avg) (percentage) 1.800 -2.17%
434.zeusmp (max) 3.000 -
434.zeusmp (max) (percentage) 0.120 -7.69%
434.zeusmp (unexplained diff vs previous) 3.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 -
435.gromacs 168.000 -1.18%
435.gromacs (avg) 168.000 -1.18%
435.gromacs (avg) (percentage) 2.320 -
435.gromacs (max) 69.000 -12.66%
435.gromacs (max) (percentage) 0.960 -11.11%
436.cactusADM 47.000 -
436.cactusADM (avg) 47.000 -
436.cactusADM (avg) (percentage) 2.210 -1.78%
436.cactusADM (max) 12.000 -20.00%
436.cactusADM (max) (percentage) 0.610 -14.08%
436.cactusADM (unexplained diff vs previous) 13.000 -13.33%
436.cactusADM (unexplained diff vs previous) (percentage) 0.610 -14.08%
437.leslie3d 524.000 -1.87%
437.leslie3d (avg) 524.000 -1.87%
437.leslie3d (avg) (percentage) 4.960 -
437.leslie3d (max) 1049.000 -8.46%
437.leslie3d (max) (percentage) 9.930 -6.67%
444.namd 19.000 -
444.namd (avg) 19.000 -
444.namd (avg) (percentage) 2.590 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.750 -7.41%
445.gobmk 73.000 1.39%
445.gobmk (avg) 73.000 1.39%
445.gobmk (avg) (percentage) 1.450 -
445.gobmk (max) 67.000 -5.63%
445.gobmk (max) (percentage) 1.340 -6.29%
447.dealII 35.000 -
447.dealII (avg) 35.000 -
447.dealII (avg) (percentage) 2.060 -
447.dealII (max) 11.000 -
447.dealII (max) (percentage) 0.660 -2.94%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.610 -
450.soplex (max) 12.000 50.00%
450.soplex (max) (percentage) 2.040 36.00%
450.soplex (unexplained diff vs previous) 12.000 300.00%
450.soplex (unexplained diff vs previous) (percentage) 2.000 292.16%
453.povray 13.000 -
453.povray (avg) 13.000 -
453.povray (avg) (percentage) 2.430 -2.41%
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.710 -6.04%
453.povray (unexplained diff vs previous) 3.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.550 -50.00%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.120 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.260 -2.59%
456.hmmer 37.000 -2.63%
456.hmmer (avg) 37.000 -2.63%
456.hmmer (avg) (percentage) 1.290 -2.27%
456.hmmer (max) 10.000 -9.09%
456.hmmer (max) (percentage) 0.360 -7.69%
456.hmmer (unexplained diff vs previous) 4.000 300.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 366.67%
458.sjeng 83.000 -
458.sjeng (avg) 83.000 -
458.sjeng (avg) (percentage) 1.120 -
458.sjeng (max) 20.000 -9.09%
458.sjeng (max) (percentage) 0.280 -6.67%
459.GemsFDTD 118.000 -
459.GemsFDTD (avg) 118.000 -
459.GemsFDTD (avg) (percentage) 1.940 -
459.GemsFDTD (max) 43.000 -4.44%
459.GemsFDTD (max) (percentage) 0.710 -5.33%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.460 -1.60%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.710 12.70%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.710 -
464.h264ref 97.000 -1.02%
464.h264ref (avg) 97.000 -1.02%
464.h264ref (avg) (percentage) 1.700 -
464.h264ref (max) 22.000 -8.33%
464.h264ref (max) (percentage) 0.400 -4.76%
465.tonto 166.000 -
465.tonto (avg) 166.000 -
465.tonto (avg) (percentage) 1.510 -
465.tonto (max) 74.000 -3.90%
465.tonto (max) (percentage) 0.670 -5.63%
470.lbm 70.000 -1.41%
470.lbm (avg) 70.000 -1.41%
470.lbm (avg) (percentage) 1.860 -1.59%
470.lbm (max) 23.000 -4.17%
470.lbm (max) (percentage) 0.610 -4.69%
470.lbm (unexplained diff vs previous) 16.000 60.00%
470.lbm (unexplained diff vs previous) (percentage) 0.420 61.54%
471.omnetpp 83.000 1.22%
471.omnetpp (avg) 83.000 1.22%
471.omnetpp (avg) (percentage) 3.030 -
471.omnetpp (max) 62.000 -10.14%
471.omnetpp (max) (percentage) 2.270 -11.67%
471.omnetpp (unexplained diff vs previous) 61.000 -14.08%
471.omnetpp (unexplained diff vs previous) (percentage) 2.210 -16.29%
473.astar 105.000 -1.87%
473.astar (avg) 105.000 -1.87%
473.astar (avg) (percentage) 2.050 -
473.astar (max) 98.000 -8.41%
473.astar (max) (percentage) 1.900 -6.86%
473.astar (unexplained diff vs previous) 100.000 -4.76%
473.astar (unexplained diff vs previous) (percentage) 1.940 -2.51%
481.wrf 123.000 -1.60%
481.wrf (avg) 123.000 -1.60%
481.wrf (avg) (percentage) 2.230 -
481.wrf (max) 96.000 -4.95%
481.wrf (max) (percentage) 1.740 -3.87%
482.sphinx3 24.000 -
482.sphinx3 (avg) 24.000 -
482.sphinx3 (avg) (percentage) 2.550 -2.30%
482.sphinx3 (max) 9.000 -10.00%
482.sphinx3 (max) (percentage) 1.050 -6.25%
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.210 -
483.xalancbmk 114.000 -
483.xalancbmk (avg) 114.000 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) 68.000 -1.45%
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 7.447 49.48%