Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3198c863f62ab2253a3405e677489b90c403cf1c (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/be2c74fdcd0e8d66c3667008ba2561ab5dcc379b (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e2b68828fab4fdfa5595fa89180230cdc4373ec1 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=6f8a482afd392741964fb56590457f81e82b5a5a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/365/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0365 (-00000-) 2022-12-20T19:30:44 0:00:00
Previous 0364 (basepoints/gcc-13-03896-g3b54cc9d04c) 2022-12-19T15:12:53 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 79 54
Performance Improvements 96 142
Unchanged Tests 1061 1040
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 4.11% 104004.000 108280.000 - 4.07% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm 4.60% 12320.000 12887.000 - 240.21% -
454.calculix 4.09% 21782.000 22672.000 - 36467.74% -
481.wrf 3.59% 16209.000 16791.000 - 203.42% -
453.povray 3.19% 6389.000 6593.000 - 1105.30% -
437.leslie3d 2.06% 14675.000 14978.000 - 28.68% -
459.GemsFDTD 1.07% 23372.000 23621.000 - 282.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) 24300.00% 0.010 2.440 - -99.46% -
434.zeusmp (unexplained diff vs previous) 16250.00% 2.000 327.000 - -97.10% -
436.cactusADM (unexplained diff vs previous) (percentage) 10200.00% 0.030 3.090 - -99.61% -
470.lbm (unexplained diff vs previous) 9350.00% 6.000 567.000 - -94.32% -
436.cactusADM (unexplained diff vs previous) 9000.00% 6.000 546.000 - -96.67% -
470.lbm (unexplained diff vs previous) (percentage) 8700.00% 0.050 4.400 - -98.33% -
437.leslie3d (unexplained diff vs previous) 265.06% 83.000 303.000 - -86.91% -
437.leslie3d (unexplained diff vs previous) (percentage) 254.39% 0.570 2.020 - -89.84% -
462.libquantum (unexplained diff vs previous) (percentage) 100.00% 0.040 0.080 - -100.00% -
462.libquantum (unexplained diff vs previous) 80.00% 5.000 9.000 - -99.93% -
483.xalancbmk 78.38% 37.000 66.000 - -73.39% -
483.xalancbmk (avg) 78.38% 37.000 66.000 - -73.39% -
483.xalancbmk (avg) (percentage) 74.29% 0.350 0.610 - -90.62% -
473.astar (unexplained diff vs previous) 61.90% 21.000 34.000 - -99.66% -
473.astar (unexplained diff vs previous) (percentage) 60.00% 0.150 0.240 - -99.88% -
471.omnetpp (avg) (percentage) 44.78% 0.670 0.970 - -88.17% -
471.omnetpp 43.06% 72.000 103.000 - -53.81% -
471.omnetpp (avg) 43.06% 72.000 103.000 - -53.81% -
458.sjeng 38.89% 18.000 25.000 - -89.63% -
458.sjeng (avg) 38.89% 18.000 25.000 - -89.63% -
458.sjeng (avg) (percentage) 38.46% 0.130 0.180 - -94.36% -
400.perlbench (avg) (percentage) 37.11% 0.970 1.330 - -79.06% -
401.bzip2 36.84% 38.000 52.000 - -67.70% -
401.bzip2 (avg) 36.84% 38.000 52.000 - -67.70% -
401.bzip2 (avg) (percentage) 34.62% 0.260 0.350 - -93.61% -
400.perlbench 33.02% 106.000 141.000 - 34.29% -
400.perlbench (avg) 33.02% 106.000 141.000 - 34.29% -
470.lbm 31.49% 181.000 238.000 - -0.42% -
470.lbm (avg) 31.49% 181.000 238.000 - -0.42% -
433.milc (max) (percentage) 28.63% 2.480 3.190 - -96.48% -
459.GemsFDTD 26.53% 147.000 186.000 - -48.33% -
459.GemsFDTD (avg) 26.53% 147.000 186.000 - -48.33% -
470.lbm (avg) (percentage) 25.85% 1.470 1.850 - -70.77% -
459.GemsFDTD (avg) (percentage) 25.40% 0.630 0.790 - -86.47% -
433.milc (max) 24.70% 328.000 409.000 - -60.82% -
481.wrf 22.54% 213.000 261.000 - -24.35% -
481.wrf (avg) 22.54% 213.000 261.000 - -24.35% -
436.cactusADM (max) (percentage) 21.95% 2.460 3.000 - -96.62% -
470.lbm (max) 20.33% 492.000 592.000 - -78.44% -
436.cactusADM (max) 18.34% 447.000 529.000 - -71.37% -
481.wrf (avg) (percentage) 18.18% 1.320 1.560 - -75.00% -
434.zeusmp (max) (percentage) 17.24% 2.030 2.380 - -97.09% -
453.povray 15.38% 65.000 75.000 - 78.57% -
453.povray (avg) 15.38% 65.000 75.000 - 78.57% -
470.lbm (max) (percentage) 15.00% 4.000 4.600 - -93.66% -
434.zeusmp (max) 14.75% 278.000 319.000 - -84.48% -
453.povray (avg) (percentage) 11.65% 1.030 1.150 - -85.28% -
433.milc (avg) (percentage) 9.94% 1.610 1.770 - -70.74% -
410.bwaves (avg) (percentage) 8.70% 1.610 1.750 - -60.32% -
464.h264ref 7.14% 42.000 45.000 - -84.64% -
464.h264ref (avg) 7.14% 42.000 45.000 - -84.64% -
462.libquantum 6.98% 43.000 46.000 - 360.00% -
462.libquantum (avg) 6.98% 43.000 46.000 - 360.00% -
410.bwaves 6.70% 224.000 239.000 - -4.02% -
410.bwaves (avg) 6.70% 224.000 239.000 - -4.02% -
433.milc 6.57% 213.000 227.000 - 228.99% -
433.milc (avg) 6.57% 213.000 227.000 - 228.99% -
464.h264ref (avg) (percentage) 6.45% 0.310 0.330 - -93.52% -
416.gamess (avg) (percentage) 5.42% 1.660 1.750 - -60.41% -
462.libquantum (avg) (percentage) 5.26% 0.380 0.400 - -94.78% -
436.cactusADM (avg) (percentage) 4.43% 1.580 1.650 - -72.41% -
434.zeusmp (avg) (percentage) 4.23% 1.420 1.480 - -74.70% -
482.sphinx3 (avg) (percentage) 3.45% 1.740 1.800 - -77.30% -
403.gcc (avg) (percentage) 3.33% 0.300 0.310 - -95.77% -
416.gamess 2.56% 352.000 361.000 - -34.36% -
416.gamess (avg) 2.56% 352.000 361.000 - -34.36% -
482.sphinx3 2.49% 522.000 535.000 - 622.97% -
482.sphinx3 (avg) 2.49% 522.000 535.000 - 622.97% -
434.zeusmp 1.54% 195.000 198.000 - 34.69% -
434.zeusmp (avg) 1.54% 195.000 198.000 - 34.69% -
436.cactusADM 1.39% 287.000 291.000 - 134.68% -
436.cactusADM (avg) 1.39% 287.000 291.000 - 134.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -7.31% 9746.000 9034.000 - 1109.37% -
433.milc -3.19% 13263.000 12840.000 - 1015.55% -
400.perlbench -3.03% 10984.000 10651.000 - 540.47% -
436.cactusADM -3.00% 18191.000 17645.000 - 747.10% -
416.gamess -2.78% 21255.000 20664.000 - 65.78% -
434.zeusmp -2.38% 13734.000 13407.000 - 433.29% -
450.soplex -2.26% 16108.000 15744.000 - 2676.72% -
435.gromacs -2.00% 15652.000 15339.000 - 111.02% -
410.bwaves -1.90% 13924.000 13659.000 - 141.67% -
445.gobmk -1.04% 11662.000 11541.000 - 129.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -95.24% 0.210 0.010 - -100.00% -
401.bzip2 (unexplained diff vs previous) -93.55% 31.000 2.000 - -99.98% -
456.hmmer (unexplained diff vs previous) -32.35% 102.000 69.000 - -99.14% -
456.hmmer (unexplained diff vs previous) (percentage) -31.58% 0.950 0.650 - -99.77% -
456.hmmer -21.51% 93.000 73.000 - -42.52% -
456.hmmer (avg) -21.51% 93.000 73.000 - -42.52% -
456.hmmer (avg) (percentage) -20.69% 0.870 0.690 - -84.35% -
444.namd (max) -15.22% 703.000 596.000 - -12.99% -
465.tonto (avg) (percentage) -14.94% 1.540 1.310 - -60.78% -
465.tonto -14.84% 128.000 109.000 - -70.14% -
465.tonto (avg) -14.84% 128.000 109.000 - -70.14% -
445.gobmk -13.79% 87.000 75.000 - -61.73% -
445.gobmk (avg) -13.79% 87.000 75.000 - -61.73% -
445.gobmk (avg) (percentage) -13.33% 0.750 0.650 - -83.38% -
444.namd -12.74% 416.000 363.000 - 433.82% -
444.namd (avg) -12.74% 416.000 363.000 - 433.82% -
454.calculix (avg) (percentage) -12.61% 1.190 1.040 - -87.03% -
483.xalancbmk (max) (percentage) -11.76% 0.340 0.300 - -99.56% -
400.perlbench (max) -11.48% 61.000 54.000 - -96.13% -
410.bwaves (max) -11.43% 350.000 310.000 - -90.54% -
416.gamess (max) -11.26% 595.000 528.000 - -89.01% -
483.xalancbmk (max) -11.11% 36.000 32.000 - -98.78% -
459.GemsFDTD (max) (percentage) -10.56% 1.420 1.270 - -98.22% -
435.gromacs (max) -10.53% 380.000 340.000 - -90.48% -
450.soplex (max) -10.44% 297.000 266.000 - -51.19% -
410.bwaves (max) (percentage) -9.92% 2.520 2.270 - -96.08% -
481.wrf (max) (percentage) -9.86% 3.550 3.200 - -95.34% -
459.GemsFDTD (max) -9.67% 331.000 299.000 - -93.22% -
445.gobmk (max) -9.63% 135.000 122.000 - -95.38% -
473.astar (max) (percentage) -9.30% 0.430 0.390 - -99.41% -
454.calculix -9.27% 259.000 235.000 - 5775.00% -
454.calculix (avg) -9.27% 259.000 235.000 - 5775.00% -
400.perlbench (max) (percentage) -8.93% 0.560 0.510 - -99.39% -
456.hmmer (max) -8.89% 180.000 164.000 - -92.26% -
453.povray (max) (percentage) -8.85% 2.260 2.060 - -97.74% -
437.leslie3d (max) (percentage) -8.70% 2.760 2.520 - -84.80% -
450.soplex (max) (percentage) -8.65% 1.850 1.690 - -98.24% -
435.gromacs (max) (percentage) -8.64% 2.430 2.220 - -95.48% -
445.gobmk (max) (percentage) -8.62% 1.160 1.060 - -97.99% -
465.tonto (max) (percentage) -8.61% 3.370 3.080 - -84.05% -
444.namd (max) (percentage) -8.59% 7.220 6.600 - -92.81% -
416.gamess (max) (percentage) -8.57% 2.800 2.560 - -93.36% -
458.sjeng (max) (percentage) -8.57% 0.350 0.320 - -99.33% -
465.tonto (max) -8.54% 281.000 257.000 - -87.83% -
454.calculix (max) (percentage) -8.41% 3.210 2.940 - -97.05% -
429.mcf (max) -8.33% 72.000 66.000 - -95.01% -
473.astar (max) -8.33% 60.000 55.000 - -98.39% -
456.hmmer (max) (percentage) -8.33% 1.680 1.540 - -97.91% -
458.sjeng (max) -8.16% 49.000 45.000 - -98.75% -
482.sphinx3 (max) -8.13% 738.000 678.000 - -25.58% -
401.bzip2 (max) -8.11% 37.000 34.000 - -98.53% -
401.bzip2 (max) (percentage) -8.00% 0.250 0.230 - -99.71% -
471.omnetpp (max) -7.55% 106.000 98.000 - -95.48% -
482.sphinx3 (max) (percentage) -7.32% 2.460 2.280 - -97.64% -
464.h264ref (max) (percentage) -7.32% 0.410 0.380 - -99.30% -
462.libquantum (max) (percentage) -7.29% 0.960 0.890 - -99.10% -
462.libquantum (max) -7.27% 110.000 102.000 - -26.09% -
403.gcc (max) -7.14% 42.000 39.000 - -29.09% -
464.h264ref (max) -7.14% 56.000 52.000 - -98.34% -
473.astar -7.14% 28.000 26.000 - -87.79% -
473.astar (avg) -7.14% 28.000 26.000 - -87.79% -
429.mcf (max) (percentage) -7.14% 0.420 0.390 - -99.58% -
471.omnetpp (max) (percentage) -7.07% 0.990 0.920 - -98.84% -
437.leslie3d (max) -6.91% 405.000 377.000 - -80.46% -
447.dealII (max) -6.67% 75.000 70.000 - -94.94% -
481.wrf (max) -6.61% 575.000 537.000 - -85.87% -
403.gcc (max) (percentage) -6.38% 0.470 0.440 - -99.56% -
453.povray (max) -6.25% 144.000 135.000 - -72.95% -
450.soplex -6.21% 177.000 166.000 - 361.11% -
450.soplex (avg) -6.21% 177.000 166.000 - 361.11% -
447.dealII (max) (percentage) -6.02% 0.830 0.780 - -99.03% -
444.namd (avg) (percentage) -5.85% 4.270 4.020 - -56.40% -
473.astar (avg) (percentage) -5.00% 0.200 0.190 - -95.43% -
454.calculix (max) -4.72% 699.000 666.000 - 991.80% -
437.leslie3d (avg) (percentage) -4.66% 2.360 2.250 - -26.23% -
429.mcf -4.55% 44.000 42.000 - -61.47% -
429.mcf (avg) -4.55% 44.000 42.000 - -61.47% -
429.mcf (avg) (percentage) -3.85% 0.260 0.250 - -96.74% -
450.soplex (avg) (percentage) -3.64% 1.100 1.060 - -83.51% -
437.leslie3d -2.60% 346.000 337.000 - -5.07% -
437.leslie3d (avg) -2.60% 346.000 337.000 - -5.07% -
435.gromacs -1.77% 226.000 222.000 - -39.51% -
435.gromacs (avg) -1.77% 226.000 222.000 - -39.51% -
410.bwaves (unexplained diff vs previous) -1.49% 269.000 265.000 - -96.60% -
447.dealII -1.43% 70.000 69.000 - -30.30% -
447.dealII (avg) -1.43% 70.000 69.000 - -30.30% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 4.07% 104048.000 108280.000 - 4.11% -
434.zeusmp 1.10% 152037.000 153713.000 - 0.00% -
435.gromacs 1.04% 499261.000 504467.000 - 0.83% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 36467.74% 62.000 22672.000 - 4.09% -
403.gcc 15903.57% 56.000 8962.000 - -0.82% -
462.libquantum 8133.57% 140.000 11527.000 - 0.08% -
482.sphinx3 3049.52% 945.000 29763.000 - -0.92% -
450.soplex 2676.72% 567.000 15744.000 - -2.26% -
444.namd 1109.37% 747.000 9034.000 - -7.31% -
453.povray 1105.30% 547.000 6593.000 - 3.19% -
429.mcf 1104.56% 1424.000 17153.000 - -0.41% -
433.milc 1015.55% 1151.000 12840.000 - -3.19% -
436.cactusADM 747.10% 2083.000 17645.000 - -3.00% -
400.perlbench 540.47% 1663.000 10651.000 - -3.03% -
434.zeusmp 433.29% 2514.000 13407.000 - -2.38% -
447.dealII 423.96% 1724.000 9033.000 - -0.92% -
401.bzip2 408.30% 2941.000 14949.000 - 0.01% -
471.omnetpp 292.51% 2724.000 10692.000 - -0.69% -
459.GemsFDTD 282.65% 6173.000 23621.000 - 1.07% -
456.hmmer 270.92% 2882.000 10690.000 - -0.64% -
470.lbm 240.21% 3788.000 12887.000 - 4.60% -
481.wrf 203.42% 5534.000 16791.000 - 3.59% -
483.xalancbmk 184.89% 3818.000 10877.000 - 0.22% -
473.astar 176.64% 5128.000 14186.000 - 0.24% -
410.bwaves 141.67% 5652.000 13659.000 - -1.90% -
464.h264ref 138.59% 5761.000 13745.000 - -0.64% -
445.gobmk 129.76% 5023.000 11541.000 - -1.04% -
435.gromacs 111.02% 7269.000 15339.000 - -2.00% -
458.sjeng 87.89% 7567.000 14218.000 - -0.27% -
416.gamess 65.78% 12465.000 20664.000 - -2.78% -
437.leslie3d 28.68% 11640.000 14978.000 - 2.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 5775.00% 4.000 235.000 - -9.27% -
454.calculix (avg) 5775.00% 4.000 235.000 - -9.27% -
454.calculix (max) 991.80% 61.000 666.000 - -4.72% -
482.sphinx3 622.97% 74.000 535.000 - 2.49% -
482.sphinx3 (avg) 622.97% 74.000 535.000 - 2.49% -
403.gcc 575.00% 4.000 27.000 - 0.00% -
403.gcc (avg) 575.00% 4.000 27.000 - 0.00% -
444.namd 433.82% 68.000 363.000 - -12.74% -
444.namd (avg) 433.82% 68.000 363.000 - -12.74% -
450.soplex 361.11% 36.000 166.000 - -6.21% -
450.soplex (avg) 361.11% 36.000 166.000 - -6.21% -
462.libquantum 360.00% 10.000 46.000 - 6.98% -
462.libquantum (avg) 360.00% 10.000 46.000 - 6.98% -
433.milc 228.99% 69.000 227.000 - 6.57% -
433.milc (avg) 228.99% 69.000 227.000 - 6.57% -
436.cactusADM 134.68% 124.000 291.000 - 1.39% -
436.cactusADM (avg) 134.68% 124.000 291.000 - 1.39% -
453.povray 78.57% 42.000 75.000 - 15.38% -
453.povray (avg) 78.57% 42.000 75.000 - 15.38% -
434.zeusmp 34.69% 147.000 198.000 - 1.54% -
434.zeusmp (avg) 34.69% 147.000 198.000 - 1.54% -
400.perlbench 34.29% 105.000 141.000 - 33.02% -
400.perlbench (avg) 34.29% 105.000 141.000 - 33.02% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383388.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -23.50% 10941.000 8370.000 - 0.26% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.080 - 100.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -100.00% 368.340 0.010 - -95.24% -
401.bzip2 (unexplained diff vs previous) -99.98% 10833.000 2.000 - -93.55% -
462.libquantum (unexplained diff vs previous) -99.93% 13518.000 9.000 - 80.00% -
473.astar (unexplained diff vs previous) (percentage) -99.88% 197.850 0.240 - 60.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.77% 278.630 0.650 - -31.58% -
401.bzip2 (max) (percentage) -99.71% 78.650 0.230 - -8.00% -
473.astar (unexplained diff vs previous) -99.66% 10146.000 34.000 - 61.90% -
433.milc (unexplained diff vs previous) (percentage) -99.66% 980.800 3.290 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.61% 787.130 3.090 - 10200.00% -
429.mcf (max) (percentage) -99.58% 92.890 0.390 - -7.14% -
483.xalancbmk (max) (percentage) -99.56% 68.670 0.300 - -11.76% -
403.gcc (max) (percentage) -99.56% 99.360 0.440 - -6.38% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.46% 448.690 2.440 - 24300.00% -
473.astar (max) (percentage) -99.41% 66.430 0.390 - -9.30% -
400.perlbench (max) (percentage) -99.39% 84.060 0.510 - -8.93% -
458.sjeng (max) (percentage) -99.33% 47.610 0.320 - -8.57% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - -7.32% -
456.hmmer (unexplained diff vs previous) -99.14% 8030.000 69.000 - -32.35% -
462.libquantum (max) (percentage) -99.10% 98.970 0.890 - -7.29% -
447.dealII (max) (percentage) -99.03% 80.280 0.780 - -6.02% -
471.omnetpp (max) (percentage) -98.84% 79.650 0.920 - -7.07% -
483.xalancbmk (max) -98.78% 2621.000 32.000 - -11.11% -
458.sjeng (max) -98.75% 3602.000 45.000 - -8.16% -
410.bwaves (unexplained diff vs previous) (percentage) -98.59% 137.900 1.940 - 0.52% -
401.bzip2 (max) -98.53% 2313.000 34.000 - -8.11% -
473.astar (max) -98.39% 3406.000 55.000 - -8.33% -
464.h264ref (max) -98.34% 3127.000 52.000 - -7.14% -
470.lbm (unexplained diff vs previous) (percentage) -98.33% 263.730 4.400 - 8700.00% -
450.soplex (max) (percentage) -98.24% 96.240 1.690 - -8.65% -
459.GemsFDTD (max) (percentage) -98.22% 71.460 1.270 - -10.56% -
445.gobmk (max) (percentage) -97.99% 52.630 1.060 - -8.62% -
456.hmmer (max) (percentage) -97.91% 73.590 1.540 - -8.33% -
453.povray (max) (percentage) -97.74% 91.250 2.060 - -8.85% -
482.sphinx3 (max) (percentage) -97.64% 96.500 2.280 - -7.32% -
434.zeusmp (unexplained diff vs previous) -97.10% 11280.000 327.000 - 16250.00% -
434.zeusmp (max) (percentage) -97.09% 81.770 2.380 - 17.24% -
454.calculix (max) (percentage) -97.05% 99.730 2.940 - -8.41% -
429.mcf (avg) (percentage) -96.74% 7.670 0.250 - -3.85% -
436.cactusADM (unexplained diff vs previous) -96.67% 16396.000 546.000 - 9000.00% -
436.cactusADM (max) (percentage) -96.62% 88.730 3.000 - 21.95% -
410.bwaves (unexplained diff vs previous) -96.60% 7794.000 265.000 - -1.49% -
433.milc (max) (percentage) -96.48% 90.750 3.190 - 28.63% -
433.milc (unexplained diff vs previous) -96.25% 11289.000 423.000 - 0.00% -
400.perlbench (max) -96.13% 1397.000 54.000 - -11.48% -
410.bwaves (max) (percentage) -96.08% 57.970 2.270 - -9.92% -
403.gcc (avg) (percentage) -95.77% 7.320 0.310 - 3.33% -
435.gromacs (max) (percentage) -95.48% 49.160 2.220 - -8.64% -
471.omnetpp (max) -95.48% 2169.000 98.000 - -7.55% -
473.astar (avg) (percentage) -95.43% 4.160 0.190 - -5.00% -
445.gobmk (max) -95.38% 2643.000 122.000 - -9.63% -
481.wrf (max) (percentage) -95.34% 68.700 3.200 - -9.86% -
429.mcf (max) -95.01% 1322.000 66.000 - -8.33% -
447.dealII (max) -94.94% 1384.000 70.000 - -6.67% -
462.libquantum (avg) (percentage) -94.78% 7.660 0.400 - 5.26% -
458.sjeng (avg) (percentage) -94.36% 3.190 0.180 - 38.46% -
470.lbm (unexplained diff vs previous) -94.32% 9990.000 567.000 - 9350.00% -
470.lbm (max) (percentage) -93.66% 72.510 4.600 - 15.00% -
401.bzip2 (avg) (percentage) -93.61% 5.480 0.350 - 34.62% -
464.h264ref (avg) (percentage) -93.52% 5.090 0.330 - 6.45% -
416.gamess (max) (percentage) -93.36% 38.550 2.560 - -8.57% -
459.GemsFDTD (max) -93.22% 4411.000 299.000 - -9.67% -
444.namd (max) (percentage) -92.81% 91.790 6.600 - -8.59% -
456.hmmer (max) -92.26% 2120.000 164.000 - -8.89% -
483.xalancbmk (avg) (percentage) -90.62% 6.500 0.610 - 74.29% -
410.bwaves (max) -90.54% 3276.000 310.000 - -11.43% -
435.gromacs (max) -90.48% 3573.000 340.000 - -10.53% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.84% 19.880 2.020 - 254.39% -
458.sjeng -89.63% 241.000 25.000 - 38.89% -
458.sjeng (avg) -89.63% 241.000 25.000 - 38.89% -
416.gamess (max) -89.01% 4805.000 528.000 - -11.26% -
471.omnetpp (avg) (percentage) -88.17% 8.200 0.970 - 44.78% -
465.tonto (max) -87.83% 2112.000 257.000 - -8.54% -
473.astar -87.79% 213.000 26.000 - -7.14% -
473.astar (avg) -87.79% 213.000 26.000 - -7.14% -
454.calculix (avg) (percentage) -87.03% 8.020 1.040 - -12.61% -
437.leslie3d (unexplained diff vs previous) -86.91% 2314.000 303.000 - 265.06% -
447.dealII (avg) (percentage) -86.66% 5.770 0.770 - 0.00% -
459.GemsFDTD (avg) (percentage) -86.47% 5.840 0.790 - 25.40% -
481.wrf (max) -85.87% 3801.000 537.000 - -6.61% -
453.povray (avg) (percentage) -85.28% 7.810 1.150 - 11.65% -
437.leslie3d (max) (percentage) -84.80% 16.580 2.520 - -8.70% -
464.h264ref -84.64% 293.000 45.000 - 7.14% -
464.h264ref (avg) -84.64% 293.000 45.000 - 7.14% -
434.zeusmp (max) -84.48% 2055.000 319.000 - 14.75% -
456.hmmer (avg) (percentage) -84.35% 4.410 0.690 - -20.69% -
465.tonto (max) (percentage) -84.05% 19.310 3.080 - -8.61% -
450.soplex (avg) (percentage) -83.51% 6.430 1.060 - -3.64% -
445.gobmk (avg) (percentage) -83.38% 3.910 0.650 - -13.33% -
437.leslie3d (max) -80.46% 1929.000 377.000 - -6.91% -
400.perlbench (avg) (percentage) -79.06% 6.350 1.330 - 37.11% -
470.lbm (max) -78.44% 2746.000 592.000 - 20.33% -
482.sphinx3 (avg) (percentage) -77.30% 7.930 1.800 - 3.45% -
481.wrf (avg) (percentage) -75.00% 6.240 1.560 - 18.18% -
434.zeusmp (avg) (percentage) -74.70% 5.850 1.480 - 4.23% -
483.xalancbmk -73.39% 248.000 66.000 - 78.38% -
483.xalancbmk (avg) -73.39% 248.000 66.000 - 78.38% -
453.povray (max) -72.95% 499.000 135.000 - -6.25% -
436.cactusADM (avg) (percentage) -72.41% 5.980 1.650 - 4.43% -
436.cactusADM (max) -71.37% 1848.000 529.000 - 18.34% -
435.gromacs (avg) (percentage) -71.34% 5.060 1.450 - 0.00% -
470.lbm (avg) (percentage) -70.77% 6.330 1.850 - 25.85% -
433.milc (avg) (percentage) -70.74% 6.050 1.770 - 9.94% -
465.tonto -70.14% 365.000 109.000 - -14.84% -
465.tonto (avg) -70.14% 365.000 109.000 - -14.84% -
401.bzip2 -67.70% 161.000 52.000 - 36.84% -
401.bzip2 (avg) -67.70% 161.000 52.000 - 36.84% -
445.gobmk -61.73% 196.000 75.000 - -13.79% -
445.gobmk (avg) -61.73% 196.000 75.000 - -13.79% -
429.mcf -61.47% 109.000 42.000 - -4.55% -
429.mcf (avg) -61.47% 109.000 42.000 - -4.55% -
433.milc (max) -60.82% 1044.000 409.000 - 24.70% -
465.tonto (avg) (percentage) -60.78% 3.340 1.310 - -14.94% -
416.gamess (avg) (percentage) -60.41% 4.420 1.750 - 5.42% -
410.bwaves (avg) (percentage) -60.32% 4.410 1.750 - 8.70% -
444.namd (avg) (percentage) -56.40% 9.220 4.020 - -5.85% -
471.omnetpp -53.81% 223.000 103.000 - 43.06% -
471.omnetpp (avg) -53.81% 223.000 103.000 - 43.06% -
450.soplex (max) -51.19% 545.000 266.000 - -10.44% -
459.GemsFDTD -48.33% 360.000 186.000 - 26.53% -
459.GemsFDTD (avg) -48.33% 360.000 186.000 - 26.53% -
456.hmmer -42.52% 127.000 73.000 - -21.51% -
456.hmmer (avg) -42.52% 127.000 73.000 - -21.51% -
435.gromacs -39.51% 367.000 222.000 - -1.77% -
435.gromacs (avg) -39.51% 367.000 222.000 - -1.77% -
416.gamess -34.36% 550.000 361.000 - 2.56% -
416.gamess (avg) -34.36% 550.000 361.000 - 2.56% -
447.dealII -30.30% 99.000 69.000 - -1.43% -
447.dealII (avg) -30.30% 99.000 69.000 - -1.43% -
403.gcc (max) -29.09% 55.000 39.000 - -7.14% -
437.leslie3d (avg) (percentage) -26.23% 3.050 2.250 - -4.66% -
462.libquantum (max) -26.09% 138.000 102.000 - -7.27% -
482.sphinx3 (max) -25.58% 911.000 678.000 - -8.13% -
481.wrf -24.35% 345.000 261.000 - 22.54% -
481.wrf (avg) -24.35% 345.000 261.000 - 22.54% -
444.namd (max) -12.99% 685.000 596.000 - -15.22% -
437.leslie3d -5.07% 355.000 337.000 - -2.60% -
437.leslie3d (avg) -5.07% 355.000 337.000 - -2.60% -
410.bwaves -4.02% 249.000 239.000 - 6.70% -
410.bwaves (avg) -4.02% 249.000 239.000 - 6.70% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 10651.000 -3.03%
401.bzip2 14949.000 -
403.gcc 8962.000 -
410.bwaves 13659.000 -1.90%
416.gamess 20664.000 -2.78%
429.mcf 17153.000 -
433.milc 12840.000 -3.19%
434.zeusmp 13407.000 -2.38%
435.gromacs 15339.000 -2.00%
436.cactusADM 17645.000 -3.00%
437.leslie3d 14978.000 2.06%
444.namd 9034.000 -7.31%
445.gobmk 11541.000 -1.04%
447.dealII 9033.000 -
450.soplex 15744.000 -2.26%
453.povray 6593.000 3.19%
454.calculix 22672.000 4.09%
456.hmmer 10690.000 -
458.sjeng 14218.000 -
459.GemsFDTD 23621.000 1.07%
462.libquantum 11527.000 -
464.h264ref 13745.000 -
465.tonto 8370.000 -
470.lbm 12887.000 4.60%
471.omnetpp 10692.000 -
473.astar 14186.000 -
481.wrf 16791.000 3.59%
482.sphinx3 29763.000 -
483.xalancbmk 10877.000 -
Geometric Mean 13449.873 -
Code Size (bytes)
Name Current %
400.perlbench 892928.000 -
401.bzip2 44241.000 -
403.gcc 2454376.000 -
410.bwaves 16748.000 -
416.gamess 5724185.000 -
429.mcf 9123.000 -
433.milc 61222.000 -
434.zeusmp 153713.000 -
435.gromacs 504467.000 -
436.cactusADM 352875.000 -
437.leslie3d 59491.000 -
444.namd 188365.000 -
445.gobmk 1377610.000 -
447.dealII 312530.000 -
450.soplex 205076.000 -
453.povray 661851.000 -
454.calculix 845131.000 -
456.hmmer 108695.000 -
458.sjeng 108280.000 4.11%
459.GemsFDTD 245044.000 -
462.libquantum 16117.000 -
464.h264ref 383388.000 -
465.tonto 1944499.000 -
470.lbm 9687.000 -
471.omnetpp 480180.000 -
473.astar 22944.000 -
481.wrf 1965916.000 -
482.sphinx3 112851.000 -
483.xalancbmk 2342986.000 -
Geometric Mean 224394.820 -
sample variability
Name Current %
400.perlbench 141.000 33.02%
400.perlbench (avg) 141.000 33.02%
400.perlbench (avg) (percentage) 1.330 37.11%
400.perlbench (max) 54.000 -11.48%
400.perlbench (max) (percentage) 0.510 -8.93%
401.bzip2 52.000 36.84%
401.bzip2 (avg) 52.000 36.84%
401.bzip2 (avg) (percentage) 0.350 34.62%
401.bzip2 (max) 34.000 -8.11%
401.bzip2 (max) (percentage) 0.230 -8.00%
401.bzip2 (unexplained diff vs previous) 2.000 -93.55%
401.bzip2 (unexplained diff vs previous) (percentage) 0.010 -95.24%
403.gcc 27.000 -
403.gcc (avg) 27.000 -
403.gcc (avg) (percentage) 0.310 3.33%
403.gcc (max) 39.000 -7.14%
403.gcc (max) (percentage) 0.440 -6.38%
410.bwaves 239.000 6.70%
410.bwaves (avg) 239.000 6.70%
410.bwaves (avg) (percentage) 1.750 8.70%
410.bwaves (max) 310.000 -11.43%
410.bwaves (max) (percentage) 2.270 -9.92%
410.bwaves (unexplained diff vs previous) 265.000 -1.49%
410.bwaves (unexplained diff vs previous) (percentage) 1.940 -
416.gamess 361.000 2.56%
416.gamess (avg) 361.000 2.56%
416.gamess (avg) (percentage) 1.750 5.42%
416.gamess (max) 528.000 -11.26%
416.gamess (max) (percentage) 2.560 -8.57%
429.mcf 42.000 -4.55%
429.mcf (avg) 42.000 -4.55%
429.mcf (avg) (percentage) 0.250 -3.85%
429.mcf (max) 66.000 -8.33%
429.mcf (max) (percentage) 0.390 -7.14%
433.milc 227.000 6.57%
433.milc (avg) 227.000 6.57%
433.milc (avg) (percentage) 1.770 9.94%
433.milc (max) 409.000 24.70%
433.milc (max) (percentage) 3.190 28.63%
433.milc (unexplained diff vs previous) 423.000 -
433.milc (unexplained diff vs previous) (percentage) 3.290 -
434.zeusmp 198.000 1.54%
434.zeusmp (avg) 198.000 1.54%
434.zeusmp (avg) (percentage) 1.480 4.23%
434.zeusmp (max) 319.000 14.75%
434.zeusmp (max) (percentage) 2.380 17.24%
434.zeusmp (unexplained diff vs previous) 327.000 16250.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.440 24300.00%
435.gromacs 222.000 -1.77%
435.gromacs (avg) 222.000 -1.77%
435.gromacs (avg) (percentage) 1.450 -
435.gromacs (max) 340.000 -10.53%
435.gromacs (max) (percentage) 2.220 -8.64%
436.cactusADM 291.000 1.39%
436.cactusADM (avg) 291.000 1.39%
436.cactusADM (avg) (percentage) 1.650 4.43%
436.cactusADM (max) 529.000 18.34%
436.cactusADM (max) (percentage) 3.000 21.95%
436.cactusADM (unexplained diff vs previous) 546.000 9000.00%
436.cactusADM (unexplained diff vs previous) (percentage) 3.090 10200.00%
437.leslie3d 337.000 -2.60%
437.leslie3d (avg) 337.000 -2.60%
437.leslie3d (avg) (percentage) 2.250 -4.66%
437.leslie3d (max) 377.000 -6.91%
437.leslie3d (max) (percentage) 2.520 -8.70%
437.leslie3d (unexplained diff vs previous) 303.000 265.06%
437.leslie3d (unexplained diff vs previous) (percentage) 2.020 254.39%
444.namd 363.000 -12.74%
444.namd (avg) 363.000 -12.74%
444.namd (avg) (percentage) 4.020 -5.85%
444.namd (max) 596.000 -15.22%
444.namd (max) (percentage) 6.600 -8.59%
445.gobmk 75.000 -13.79%
445.gobmk (avg) 75.000 -13.79%
445.gobmk (avg) (percentage) 0.650 -13.33%
445.gobmk (max) 122.000 -9.63%
445.gobmk (max) (percentage) 1.060 -8.62%
447.dealII 69.000 -1.43%
447.dealII (avg) 69.000 -1.43%
447.dealII (avg) (percentage) 0.770 -
447.dealII (max) 70.000 -6.67%
447.dealII (max) (percentage) 0.780 -6.02%
450.soplex 166.000 -6.21%
450.soplex (avg) 166.000 -6.21%
450.soplex (avg) (percentage) 1.060 -3.64%
450.soplex (max) 266.000 -10.44%
450.soplex (max) (percentage) 1.690 -8.65%
453.povray 75.000 15.38%
453.povray (avg) 75.000 15.38%
453.povray (avg) (percentage) 1.150 11.65%
453.povray (max) 135.000 -6.25%
453.povray (max) (percentage) 2.060 -8.85%
454.calculix 235.000 -9.27%
454.calculix (avg) 235.000 -9.27%
454.calculix (avg) (percentage) 1.040 -12.61%
454.calculix (max) 666.000 -4.72%
454.calculix (max) (percentage) 2.940 -8.41%
456.hmmer 73.000 -21.51%
456.hmmer (avg) 73.000 -21.51%
456.hmmer (avg) (percentage) 0.690 -20.69%
456.hmmer (max) 164.000 -8.89%
456.hmmer (max) (percentage) 1.540 -8.33%
456.hmmer (unexplained diff vs previous) 69.000 -32.35%
456.hmmer (unexplained diff vs previous) (percentage) 0.650 -31.58%
458.sjeng 25.000 38.89%
458.sjeng (avg) 25.000 38.89%
458.sjeng (avg) (percentage) 0.180 38.46%
458.sjeng (max) 45.000 -8.16%
458.sjeng (max) (percentage) 0.320 -8.57%
459.GemsFDTD 186.000 26.53%
459.GemsFDTD (avg) 186.000 26.53%
459.GemsFDTD (avg) (percentage) 0.790 25.40%
459.GemsFDTD (max) 299.000 -9.67%
459.GemsFDTD (max) (percentage) 1.270 -10.56%
462.libquantum 46.000 6.98%
462.libquantum (avg) 46.000 6.98%
462.libquantum (avg) (percentage) 0.400 5.26%
462.libquantum (max) 102.000 -7.27%
462.libquantum (max) (percentage) 0.890 -7.29%
462.libquantum (unexplained diff vs previous) 9.000 80.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.080 100.00%
464.h264ref 45.000 7.14%
464.h264ref (avg) 45.000 7.14%
464.h264ref (avg) (percentage) 0.330 6.45%
464.h264ref (max) 52.000 -7.14%
464.h264ref (max) (percentage) 0.380 -7.32%
465.tonto 109.000 -14.84%
465.tonto (avg) 109.000 -14.84%
465.tonto (avg) (percentage) 1.310 -14.94%
465.tonto (max) 257.000 -8.54%
465.tonto (max) (percentage) 3.080 -8.61%
470.lbm 238.000 31.49%
470.lbm (avg) 238.000 31.49%
470.lbm (avg) (percentage) 1.850 25.85%
470.lbm (max) 592.000 20.33%
470.lbm (max) (percentage) 4.600 15.00%
470.lbm (unexplained diff vs previous) 567.000 9350.00%
470.lbm (unexplained diff vs previous) (percentage) 4.400 8700.00%
471.omnetpp 103.000 43.06%
471.omnetpp (avg) 103.000 43.06%
471.omnetpp (avg) (percentage) 0.970 44.78%
471.omnetpp (max) 98.000 -7.55%
471.omnetpp (max) (percentage) 0.920 -7.07%
473.astar 26.000 -7.14%
473.astar (avg) 26.000 -7.14%
473.astar (avg) (percentage) 0.190 -5.00%
473.astar (max) 55.000 -8.33%
473.astar (max) (percentage) 0.390 -9.30%
473.astar (unexplained diff vs previous) 34.000 61.90%
473.astar (unexplained diff vs previous) (percentage) 0.240 60.00%
481.wrf 261.000 22.54%
481.wrf (avg) 261.000 22.54%
481.wrf (avg) (percentage) 1.560 18.18%
481.wrf (max) 537.000 -6.61%
481.wrf (max) (percentage) 3.200 -9.86%
482.sphinx3 535.000 2.49%
482.sphinx3 (avg) 535.000 2.49%
482.sphinx3 (avg) (percentage) 1.800 3.45%
482.sphinx3 (max) 678.000 -8.13%
482.sphinx3 (max) (percentage) 2.280 -7.32%
483.xalancbmk 66.000 78.38%
483.xalancbmk (avg) 66.000 78.38%
483.xalancbmk (avg) (percentage) 0.610 74.29%
483.xalancbmk (max) 32.000 -11.11%
483.xalancbmk (max) (percentage) 0.300 -11.76%
Geometric Mean 17.779 40.28%