Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=63224e96d0cd9e726bcd1d6d512255d92b7c5317 (+ 41 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/b15d46e8057bf58b5e021011ee6e0c07d6cdf712 (+ 101 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=eaa5b1cce87d34c945955360b1e519c6994308a1 (+ 7 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=aa0a1382849d5a6e2e65d29335e24bb3aa6ef655 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/59/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0059 (3-changed-components) 2023-06-10T18:19:31 0:00:00
Previous 0058 (4-changed-components) 2023-06-07T18:50:49 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 42 10
Performance Improvements 113 201
Added Tests 24 0
Unchanged Tests 1057 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 3.60% 1609.000 1667.000 - 0.24% -
453.povray 2.23% 537.000 549.000 - 0.37% -
447.dealII 2.00% 1704.000 1738.000 - 0.81% -
450.soplex 1.70% 587.000 597.000 - 5.29% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) 712.16% 0.740 6.010 - -69.77% -
437.leslie3d (unexplained diff vs previous) 669.88% 83.000 639.000 - -72.39% -
436.cactusADM (unexplained diff vs previous) (percentage) 300.00% 0.190 0.760 - -99.90% -
436.cactusADM (unexplained diff vs previous) 300.00% 4.000 16.000 - -99.90% -
450.soplex (unexplained diff vs previous) 233.33% 3.000 10.000 - -99.93% -
450.soplex (unexplained diff vs previous) (percentage) 229.41% 0.510 1.680 - -99.93% -
447.dealII (max) 209.09% 11.000 34.000 - -97.54% -
453.povray (max) 200.00% 4.000 12.000 - -97.60% -
447.dealII (max) (percentage) 185.71% 0.700 2.000 - -97.51% -
453.povray (max) (percentage) 175.31% 0.810 2.230 - -97.56% -
450.soplex (max) 150.00% 4.000 10.000 - -98.17% -
410.bwaves (unexplained diff vs previous) (percentage) 132.14% 0.280 0.650 - -99.53% -
410.bwaves (unexplained diff vs previous) 131.25% 16.000 37.000 - -99.53% -
450.soplex (max) (percentage) 100.00% 0.850 1.700 - -98.23% -
459.GemsFDTD (unexplained diff vs previous) 100.00% 17.000 34.000 - -99.78% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 96.43% 0.280 0.550 - -99.78% -
400.perlbench (max) 71.43% 35.000 60.000 - -95.71% -
433.milc (max) 66.67% 3.000 5.000 - -99.52% -
433.milc (unexplained diff vs previous) 66.67% 3.000 5.000 - -99.96% -
433.milc (unexplained diff vs previous) (percentage) 65.38% 0.260 0.430 - -99.96% -
400.perlbench (max) (percentage) 63.64% 2.200 3.600 - -95.72% -
433.milc (max) (percentage) 51.72% 0.290 0.440 - -99.52% -
481.wrf (max) 47.92% 48.000 71.000 - -98.13% -
481.wrf (max) (percentage) 47.73% 0.880 1.300 - -98.11% -
470.lbm (unexplained diff vs previous) (percentage) 38.10% 0.210 0.290 - -99.89% -
470.lbm (unexplained diff vs previous) 37.50% 8.000 11.000 - -99.89% -
401.bzip2 (unexplained diff vs previous) 21.43% 14.000 17.000 - -99.84% -
401.bzip2 (unexplained diff vs previous) (percentage) 21.28% 0.470 0.570 - -99.85% -
471.omnetpp (max) 18.18% 22.000 26.000 - -98.80% -
471.omnetpp (max) (percentage) 14.46% 0.830 0.950 - -98.81% -
471.omnetpp (unexplained diff vs previous) 13.04% 23.000 26.000 - -99.76% -
471.omnetpp (unexplained diff vs previous) (percentage) 11.90% 0.840 0.940 - -99.76% -
436.cactusADM (max) (percentage) 11.76% 0.680 0.760 - -99.14% -
459.GemsFDTD (max) (percentage) 7.84% 0.510 0.550 - -99.23% -
436.cactusADM (max) 7.14% 14.000 15.000 - -99.19% -
459.GemsFDTD (max) 6.45% 31.000 33.000 - -99.25% -
400.perlbench 3.92% 51.000 53.000 - -49.52% -
400.perlbench (avg) 3.92% 51.000 53.000 - -49.52% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.67% 11277.000 10638.000 - -8.61% -
454.calculix -3.17% 63.000 61.000 - -1.61% -
481.wrf -1.30% 5558.000 5486.000 - -0.87% -
473.astar -1.00% 5194.000 5142.000 - 0.27% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -66.67% 24.000 8.000 - -99.88% -
458.sjeng (unexplained diff vs previous) (percentage) -65.62% 0.320 0.110 - -99.88% -
416.gamess (max) -63.89% 36.000 13.000 - -99.73% -
416.gamess (max) (percentage) -62.07% 0.290 0.110 - -99.71% -
435.gromacs (unexplained diff vs previous) (percentage) -44.14% 1.450 0.810 - -99.16% -
435.gromacs (unexplained diff vs previous) -43.40% 106.000 60.000 - -99.15% -
434.zeusmp (unexplained diff vs previous) -37.50% 16.000 10.000 - -99.91% -
434.zeusmp (unexplained diff vs previous) (percentage) -37.50% 0.640 0.400 - -99.91% -
429.mcf (unexplained diff vs previous) (percentage) -36.36% 0.990 0.630 - -99.95% -
429.mcf (unexplained diff vs previous) -35.71% 14.000 9.000 - -99.95% -
444.namd (unexplained diff vs previous) (percentage) -34.43% 1.220 0.800 - -99.93% -
444.namd (unexplained diff vs previous) -33.33% 9.000 6.000 - -99.93% -
454.calculix (max) -33.33% 3.000 2.000 - -96.72% -
429.mcf (max) -28.57% 14.000 10.000 - -99.24% -
429.mcf (max) (percentage) -25.00% 1.000 0.750 - -99.19% -
444.namd (max) -25.00% 8.000 6.000 - -99.12% -
444.namd (max) (percentage) -25.00% 1.200 0.900 - -99.02% -
434.zeusmp (max) -18.75% 16.000 13.000 - -99.37% -
434.zeusmp (max) (percentage) -17.19% 0.640 0.530 - -99.35% -
482.sphinx3 (unexplained diff vs previous) (percentage) -14.86% 0.740 0.630 - -99.98% -
473.astar (unexplained diff vs previous) -14.75% 61.000 52.000 - -99.49% -
454.calculix (max) (percentage) -14.48% 5.110 4.370 - -95.62% -
482.sphinx3 (max) -14.29% 7.000 6.000 - -99.34% -
482.sphinx3 (unexplained diff vs previous) -14.29% 7.000 6.000 - -99.98% -
473.astar (unexplained diff vs previous) (percentage) -13.68% 1.170 1.010 - -99.49% -
473.astar (max) -13.11% 61.000 53.000 - -98.44% -
473.astar (max) (percentage) -12.61% 1.190 1.040 - -98.43% -
458.sjeng (max) -12.50% 24.000 21.000 - -99.42% -
458.sjeng (max) (percentage) -12.50% 0.320 0.280 - -99.41% -
470.lbm (max) (percentage) -9.38% 0.320 0.290 - -99.60% -
437.leslie3d (max) -9.05% 663.000 603.000 - -68.74% -
470.lbm (max) -8.33% 12.000 11.000 - -99.60% -
410.bwaves (max) -6.98% 43.000 40.000 - -98.78% -
435.gromacs (max) (percentage) -6.80% 1.470 1.370 - -97.21% -
435.gromacs (max) -6.54% 107.000 100.000 - -97.20% -
410.bwaves (max) (percentage) -6.49% 0.770 0.720 - -98.76% -
482.sphinx3 (max) (percentage) -5.33% 0.750 0.710 - -99.26% -
437.leslie3d -4.81% 478.000 455.000 - 28.17% -
437.leslie3d (avg) -4.81% 478.000 455.000 - 28.17% -
401.bzip2 (max) -4.76% 21.000 20.000 - -99.14% -
401.bzip2 (max) (percentage) -4.29% 0.700 0.670 - -99.15% -
445.gobmk (max) (percentage) -4.00% 0.500 0.480 - -99.09% -
445.gobmk (max) -4.00% 25.000 24.000 - -99.09% -
465.tonto -3.79% 211.000 203.000 - -44.38% -
465.tonto (avg) -3.79% 211.000 203.000 - -44.38% -
464.h264ref (max) (percentage) -3.70% 0.270 0.260 - -99.52% -
465.tonto (avg) (percentage) -3.63% 1.930 1.860 - -44.31% -
437.leslie3d (max) (percentage) -3.57% 5.880 5.670 - -65.80% -
433.milc -3.45% 29.000 28.000 - -59.42% -
433.milc (avg) -3.45% 29.000 28.000 - -59.42% -
465.tonto (max) -3.45% 58.000 56.000 - -97.35% -
416.gamess (avg) (percentage) -3.40% 1.470 1.420 - -67.87% -
436.cactusADM -3.39% 59.000 57.000 - -54.03% -
436.cactusADM (avg) -3.39% 59.000 57.000 - -54.03% -
464.h264ref (avg) (percentage) -3.33% 2.100 2.030 - -60.12% -
481.wrf -3.31% 151.000 146.000 - -57.68% -
481.wrf (avg) -3.31% 151.000 146.000 - -57.68% -
464.h264ref -3.31% 121.000 117.000 - -60.07% -
464.h264ref (avg) -3.31% 121.000 117.000 - -60.07% -
416.gamess -3.28% 183.000 177.000 - -67.82% -
416.gamess (avg) -3.28% 183.000 177.000 - -67.82% -
483.xalancbmk (avg) (percentage) -3.19% 3.450 3.340 - -48.62% -
483.xalancbmk -3.03% 132.000 128.000 - -48.39% -
483.xalancbmk (avg) -3.03% 132.000 128.000 - -48.39% -
445.gobmk (avg) (percentage) -3.01% 1.660 1.610 - -58.82% -
483.xalancbmk (max) -2.91% 103.000 100.000 - -96.18% -
458.sjeng (avg) (percentage) -2.80% 1.430 1.390 - -56.43% -
401.bzip2 -2.78% 72.000 70.000 - -56.52% -
401.bzip2 (avg) -2.78% 72.000 70.000 - -56.52% -
458.sjeng -2.78% 108.000 105.000 - -56.43% -
458.sjeng (avg) -2.78% 108.000 105.000 - -56.43% -
473.astar -2.50% 120.000 117.000 - -45.07% -
473.astar (avg) -2.50% 120.000 117.000 - -45.07% -
445.gobmk -2.41% 83.000 81.000 - -58.67% -
445.gobmk (avg) -2.41% 83.000 81.000 - -58.67% -
456.hmmer (avg) (percentage) -2.35% 1.700 1.660 - -62.36% -
429.mcf (avg) (percentage) -2.30% 7.400 7.230 - -5.74% -
483.xalancbmk (max) (percentage) -2.24% 2.680 2.620 - -96.18% -
435.gromacs (avg) (percentage) -2.21% 2.710 2.650 - -47.63% -
470.lbm -2.20% 91.000 89.000 - -62.76% -
470.lbm (avg) -2.20% 91.000 89.000 - -62.76% -
456.hmmer (max) (percentage) -2.17% 0.460 0.450 - -99.39% -
434.zeusmp (avg) (percentage) -2.17% 2.300 2.250 - -61.54% -
482.sphinx3 (avg) (percentage) -2.16% 3.240 3.170 - -60.03% -
470.lbm (avg) (percentage) -2.09% 2.390 2.340 - -63.03% -
401.bzip2 (avg) (percentage) -2.08% 2.400 2.350 - -57.12% -
459.GemsFDTD (avg) (percentage) -2.07% 2.410 2.360 - -59.59% -
456.hmmer -2.04% 49.000 48.000 - -62.20% -
456.hmmer (avg) -2.04% 49.000 48.000 - -62.20% -
459.GemsFDTD -2.03% 148.000 145.000 - -59.72% -
459.GemsFDTD (avg) -2.03% 148.000 145.000 - -59.72% -
462.libquantum (avg) (percentage) -1.92% 3.120 3.060 - -60.05% -
403.gcc (max) (percentage) -1.92% 5.210 5.110 - -94.86% -
465.tonto (max) (percentage) -1.89% 0.530 0.520 - -97.31% -
444.namd (avg) (percentage) -1.88% 3.190 3.130 - -66.05% -
481.wrf (avg) (percentage) -1.84% 2.720 2.670 - -57.21% -
434.zeusmp -1.75% 57.000 56.000 - -61.90% -
434.zeusmp (avg) -1.75% 57.000 56.000 - -61.90% -
471.omnetpp (avg) (percentage) -1.65% 3.640 3.580 - -56.34% -
410.bwaves (avg) (percentage) -1.59% 1.890 1.860 - -57.82% -
433.milc (avg) (percentage) -1.57% 2.540 2.500 - -58.68% -
435.gromacs -1.52% 198.000 195.000 - -46.87% -
435.gromacs (avg) -1.52% 198.000 195.000 - -46.87% -
436.cactusADM (avg) (percentage) -1.43% 2.800 2.760 - -53.85% -
450.soplex (avg) (percentage) -1.29% 3.090 3.050 - -52.57% -
473.astar (avg) (percentage) -1.29% 2.320 2.290 - -44.95% -
454.calculix (avg) (percentage) -1.07% 4.670 4.620 - -42.39% -
471.omnetpp -1.00% 100.000 99.000 - -55.61% -
471.omnetpp (avg) -1.00% 100.000 99.000 - -55.61% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM 1.08% 352891.000 356691.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - 0.00% -
450.soplex 5.29% 567.000 597.000 - 1.70% -
471.omnetpp 1.95% 2724.000 2777.000 - 0.95% -
456.hmmer 1.70% 2882.000 2931.000 - 0.17% -
401.bzip2 1.53% 2941.000 2986.000 - -0.57% -
435.gromacs 1.39% 7269.000 7370.000 - 0.82% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 40.33% 3.050 4.280 - 0.94% -
437.leslie3d 28.17% 355.000 455.000 - -4.81% -
437.leslie3d (avg) 28.17% 355.000 455.000 - -4.81% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.03% 387748.000 383756.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.61% 11640.000 10638.000 - -5.67% -
454.calculix -1.61% 62.000 61.000 - -3.17% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.710 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
454.calculix (unexplained diff vs previous) -99.99% 22953.000 2.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -99.99% 37020.970 3.280 - 0.00% -
416.gamess (unexplained diff vs previous) -99.99% 7819.000 1.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.99% 6843.000 1.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.98% 62.730 0.010 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.98% 118.780 0.020 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.630 - -14.86% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 6.000 - -14.29% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.430 - 65.38% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 5.000 - 66.67% -
429.mcf (unexplained diff vs previous) (percentage) -99.95% 1305.690 0.630 - -36.36% -
429.mcf (unexplained diff vs previous) -99.95% 18593.000 9.000 - -35.71% -
456.hmmer (unexplained diff vs previous) (percentage) -99.94% 278.630 0.170 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.94% 8030.000 5.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.93% 2557.320 1.680 - 229.41% -
450.soplex (unexplained diff vs previous) -99.93% 14500.000 10.000 - 233.33% -
444.namd (unexplained diff vs previous) (percentage) -99.93% 1118.610 0.800 - -34.43% -
444.namd (unexplained diff vs previous) -99.93% 8356.000 6.000 - -33.33% -
434.zeusmp (unexplained diff vs previous) -99.91% 11280.000 10.000 - -37.50% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.91% 448.690 0.400 - -37.50% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.90% 787.130 0.760 - 300.00% -
436.cactusADM (unexplained diff vs previous) -99.90% 16396.000 16.000 - 300.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.89% 263.730 0.290 - 38.10% -
470.lbm (unexplained diff vs previous) -99.89% 9990.000 11.000 - 37.50% -
458.sjeng (unexplained diff vs previous) -99.88% 6876.000 8.000 - -66.67% -
458.sjeng (unexplained diff vs previous) (percentage) -99.88% 90.870 0.110 - -65.62% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.85% 368.340 0.570 - 21.28% -
401.bzip2 (unexplained diff vs previous) -99.84% 10833.000 17.000 - 21.43% -
453.povray (unexplained diff vs previous) (percentage) -99.79% 1043.330 2.190 - 0.00% -
453.povray (unexplained diff vs previous) -99.79% 5707.000 12.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.78% 5581.000 12.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.78% 111.110 0.240 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.78% 250.410 0.550 - 96.43% -
459.GemsFDTD (unexplained diff vs previous) -99.78% 15458.000 34.000 - 100.00% -
483.xalancbmk (unexplained diff vs previous) -99.77% 8368.000 19.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.77% 219.170 0.500 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.76% 391.300 0.940 - 11.90% -
471.omnetpp (unexplained diff vs previous) -99.76% 10659.000 26.000 - 13.04% -
416.gamess (max) -99.73% 4805.000 13.000 - -63.89% -
416.gamess (max) (percentage) -99.71% 38.550 0.110 - -62.07% -
470.lbm (max) (percentage) -99.60% 72.510 0.290 - -9.38% -
470.lbm (max) -99.60% 2746.000 11.000 - -8.33% -
410.bwaves (unexplained diff vs previous) (percentage) -99.53% 137.900 0.650 - 132.14% -
410.bwaves (unexplained diff vs previous) -99.53% 7794.000 37.000 - 131.25% -
464.h264ref (max) (percentage) -99.52% 54.290 0.260 - -3.70% -
433.milc (max) -99.52% 1044.000 5.000 - 66.67% -
464.h264ref (max) -99.52% 3127.000 15.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.52% 407.020 1.960 - 0.00% -
447.dealII (unexplained diff vs previous) -99.52% 7017.000 34.000 - 0.00% -
433.milc (max) (percentage) -99.52% 90.750 0.440 - 51.72% -
473.astar (unexplained diff vs previous) (percentage) -99.49% 197.850 1.010 - -13.68% -
473.astar (unexplained diff vs previous) -99.49% 10146.000 52.000 - -14.75% -
458.sjeng (max) -99.42% 3602.000 21.000 - -12.50% -
458.sjeng (max) (percentage) -99.41% 47.610 0.280 - -12.50% -
481.wrf (unexplained diff vs previous) -99.41% 12149.000 72.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.40% 219.530 1.310 - 0.00% -
456.hmmer (max) (percentage) -99.39% 73.590 0.450 - -2.17% -
456.hmmer (max) -99.39% 2120.000 13.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.38% 16.190 0.100 - 0.00% -
465.tonto (unexplained diff vs previous) -99.38% 1771.000 11.000 - 0.00% -
434.zeusmp (max) -99.37% 2055.000 13.000 - -18.75% -
434.zeusmp (max) (percentage) -99.35% 81.770 0.530 - -17.19% -
482.sphinx3 (max) -99.34% 911.000 6.000 - -14.29% -
400.perlbench (unexplained diff vs previous) (percentage) -99.34% 527.480 3.480 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.34% 8772.000 58.000 - 0.00% -
482.sphinx3 (max) (percentage) -99.26% 96.500 0.710 - -5.33% -
459.GemsFDTD (max) -99.25% 4411.000 33.000 - 6.45% -
429.mcf (max) -99.24% 1322.000 10.000 - -28.57% -
459.GemsFDTD (max) (percentage) -99.23% 71.460 0.550 - 7.84% -
429.mcf (max) (percentage) -99.19% 92.890 0.750 - -25.00% -
436.cactusADM (max) -99.19% 1848.000 15.000 - 7.14% -
435.gromacs (unexplained diff vs previous) (percentage) -99.16% 96.680 0.810 - -44.14% -
401.bzip2 (max) (percentage) -99.15% 78.650 0.670 - -4.29% -
435.gromacs (unexplained diff vs previous) -99.15% 7028.000 60.000 - -43.40% -
436.cactusADM (max) (percentage) -99.14% 88.730 0.760 - 11.76% -
401.bzip2 (max) -99.14% 2313.000 20.000 - -4.76% -
444.namd (max) -99.12% 685.000 6.000 - -25.00% -
445.gobmk (max) -99.09% 2643.000 24.000 - -4.00% -
445.gobmk (max) (percentage) -99.09% 52.630 0.480 - -4.00% -
444.namd (max) (percentage) -99.02% 91.790 0.900 - -25.00% -
471.omnetpp (max) (percentage) -98.81% 79.650 0.950 - 14.46% -
471.omnetpp (max) -98.80% 2169.000 26.000 - 18.18% -
410.bwaves (max) -98.78% 3276.000 40.000 - -6.98% -
410.bwaves (max) (percentage) -98.76% 57.970 0.720 - -6.49% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
462.libquantum (max) (percentage) -98.51% 98.970 1.470 - 0.00% -
473.astar (max) -98.44% 3406.000 53.000 - -13.11% -
473.astar (max) (percentage) -98.43% 66.430 1.040 - -12.61% -
450.soplex (max) (percentage) -98.23% 96.240 1.700 - 100.00% -
450.soplex (max) -98.17% 545.000 10.000 - 150.00% -
481.wrf (max) -98.13% 3801.000 71.000 - 47.92% -
481.wrf (max) (percentage) -98.11% 68.700 1.300 - 47.73% -
453.povray (max) -97.60% 499.000 12.000 - 200.00% -
453.povray (max) (percentage) -97.56% 91.250 2.230 - 175.31% -
447.dealII (max) -97.54% 1384.000 34.000 - 209.09% -
447.dealII (max) (percentage) -97.51% 80.280 2.000 - 185.71% -
465.tonto (max) -97.35% 2112.000 56.000 - -3.45% -
465.tonto (max) (percentage) -97.31% 19.310 0.520 - -1.89% -
435.gromacs (max) (percentage) -97.21% 49.160 1.370 - -6.80% -
435.gromacs (max) -97.20% 3573.000 100.000 - -6.54% -
454.calculix (max) -96.72% 61.000 2.000 - -33.33% -
483.xalancbmk (max) -96.18% 2621.000 100.000 - -2.91% -
483.xalancbmk (max) (percentage) -96.18% 68.670 2.620 - -2.24% -
400.perlbench (max) (percentage) -95.72% 84.060 3.600 - 63.64% -
400.perlbench (max) -95.71% 1397.000 60.000 - 71.43% -
454.calculix (max) (percentage) -95.62% 99.730 4.370 - -14.48% -
403.gcc (max) (percentage) -94.86% 99.360 5.110 - -1.92% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -72.39% 2314.000 639.000 - 669.88% -
437.leslie3d (unexplained diff vs previous) (percentage) -69.77% 19.880 6.010 - 712.16% -
437.leslie3d (max) -68.74% 1929.000 603.000 - -9.05% -
416.gamess (avg) (percentage) -67.87% 4.420 1.420 - -3.40% -
416.gamess -67.82% 550.000 177.000 - -3.28% -
416.gamess (avg) -67.82% 550.000 177.000 - -3.28% -
444.namd -66.18% 68.000 23.000 - 0.00% -
444.namd (avg) -66.18% 68.000 23.000 - 0.00% -
444.namd (avg) (percentage) -66.05% 9.220 3.130 - -1.88% -
437.leslie3d (max) (percentage) -65.80% 16.580 5.670 - -3.57% -
470.lbm (avg) (percentage) -63.03% 6.330 2.340 - -2.09% -
470.lbm -62.76% 239.000 89.000 - -2.20% -
470.lbm (avg) -62.76% 239.000 89.000 - -2.20% -
456.hmmer (avg) (percentage) -62.36% 4.410 1.660 - -2.35% -
456.hmmer -62.20% 127.000 48.000 - -2.04% -
456.hmmer (avg) -62.20% 127.000 48.000 - -2.04% -
434.zeusmp -61.90% 147.000 56.000 - -1.75% -
434.zeusmp (avg) -61.90% 147.000 56.000 - -1.75% -
453.povray -61.90% 42.000 16.000 - 0.00% -
453.povray (avg) -61.90% 42.000 16.000 - 0.00% -
434.zeusmp (avg) (percentage) -61.54% 5.850 2.250 - -2.17% -
453.povray (avg) (percentage) -61.33% 7.810 3.020 - -0.66% -
464.h264ref (avg) (percentage) -60.12% 5.090 2.030 - -3.33% -
464.h264ref -60.07% 293.000 117.000 - -3.31% -
464.h264ref (avg) -60.07% 293.000 117.000 - -3.31% -
462.libquantum (avg) (percentage) -60.05% 7.660 3.060 - -1.92% -
482.sphinx3 (avg) (percentage) -60.03% 7.930 3.170 - -2.16% -
462.libquantum -60.00% 10.000 4.000 - 0.00% -
462.libquantum (avg) -60.00% 10.000 4.000 - 0.00% -
459.GemsFDTD -59.72% 360.000 145.000 - -2.03% -
459.GemsFDTD (avg) -59.72% 360.000 145.000 - -2.03% -
459.GemsFDTD (avg) (percentage) -59.59% 5.840 2.360 - -2.07% -
482.sphinx3 -59.46% 74.000 30.000 - 0.00% -
482.sphinx3 (avg) -59.46% 74.000 30.000 - 0.00% -
433.milc -59.42% 69.000 28.000 - -3.45% -
433.milc (avg) -59.42% 69.000 28.000 - -3.45% -
445.gobmk (avg) (percentage) -58.82% 3.910 1.610 - -3.01% -
433.milc (avg) (percentage) -58.68% 6.050 2.500 - -1.57% -
445.gobmk -58.67% 196.000 81.000 - -2.41% -
445.gobmk (avg) -58.67% 196.000 81.000 - -2.41% -
410.bwaves -57.83% 249.000 105.000 - -0.94% -
410.bwaves (avg) -57.83% 249.000 105.000 - -0.94% -
410.bwaves (avg) (percentage) -57.82% 4.410 1.860 - -1.59% -
481.wrf -57.68% 345.000 146.000 - -3.31% -
481.wrf (avg) -57.68% 345.000 146.000 - -3.31% -
447.dealII -57.58% 99.000 42.000 - 0.00% -
447.dealII (avg) -57.58% 99.000 42.000 - 0.00% -
481.wrf (avg) (percentage) -57.21% 6.240 2.670 - -1.84% -
447.dealII (avg) (percentage) -57.19% 5.770 2.470 - -0.80% -
401.bzip2 (avg) (percentage) -57.12% 5.480 2.350 - -2.08% -
401.bzip2 -56.52% 161.000 70.000 - -2.78% -
401.bzip2 (avg) -56.52% 161.000 70.000 - -2.78% -
458.sjeng -56.43% 241.000 105.000 - -2.78% -
458.sjeng (avg) -56.43% 241.000 105.000 - -2.78% -
458.sjeng (avg) (percentage) -56.43% 3.190 1.390 - -2.80% -
471.omnetpp (avg) (percentage) -56.34% 8.200 3.580 - -1.65% -
471.omnetpp -55.61% 223.000 99.000 - -1.00% -
471.omnetpp (avg) -55.61% 223.000 99.000 - -1.00% -
436.cactusADM -54.03% 124.000 57.000 - -3.39% -
436.cactusADM (avg) -54.03% 124.000 57.000 - -3.39% -
436.cactusADM (avg) (percentage) -53.85% 5.980 2.760 - -1.43% -
450.soplex (avg) (percentage) -52.57% 6.430 3.050 - -1.29% -
450.soplex -50.00% 36.000 18.000 - 0.00% -
450.soplex (avg) -50.00% 36.000 18.000 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
400.perlbench -49.52% 105.000 53.000 - 3.92% -
400.perlbench (avg) -49.52% 105.000 53.000 - 3.92% -
400.perlbench (avg) (percentage) -49.29% 6.350 3.220 - 0.63% -
483.xalancbmk (avg) (percentage) -48.62% 6.500 3.340 - -3.19% -
483.xalancbmk -48.39% 248.000 128.000 - -3.03% -
483.xalancbmk (avg) -48.39% 248.000 128.000 - -3.03% -
435.gromacs (avg) (percentage) -47.63% 5.060 2.650 - -2.21% -
435.gromacs -46.87% 367.000 195.000 - -1.52% -
435.gromacs (avg) -46.87% 367.000 195.000 - -1.52% -
473.astar -45.07% 213.000 117.000 - -2.50% -
473.astar (avg) -45.07% 213.000 117.000 - -2.50% -
473.astar (avg) (percentage) -44.95% 4.160 2.290 - -1.29% -
465.tonto -44.38% 365.000 203.000 - -3.79% -
465.tonto (avg) -44.38% 365.000 203.000 - -3.79% -
465.tonto (avg) (percentage) -44.31% 3.340 1.860 - -3.63% -
454.calculix (avg) (percentage) -42.39% 8.020 4.620 - -1.07% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -19.13% 7.320 5.920 - 0.00% -
429.mcf (avg) (percentage) -5.74% 7.670 7.230 - -2.30% -
429.mcf -5.50% 109.000 103.000 - -0.96% -
429.mcf (avg) -5.50% 109.000 103.000 - -0.96% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1667.000 3.60%
401.bzip2 2986.000 -
403.gcc 59.000 -
410.bwaves 5686.000 -
416.gamess 12474.000 -
429.mcf 1426.000 -
433.milc 1152.000 -
434.zeusmp 2512.000 -
435.gromacs 7370.000 -
436.cactusADM 2099.000 -
437.leslie3d 10638.000 -5.67%
444.namd 746.000 -
445.gobmk 5068.000 -
447.dealII 1738.000 2.00%
450.soplex 597.000 1.70%
453.povray 549.000 2.23%
454.calculix 61.000 -3.17%
456.hmmer 2931.000 -
458.sjeng 7579.000 -
459.GemsFDTD 6146.000 -
462.libquantum 140.000 -
464.h264ref 5803.000 -
465.tonto 10934.000 -
470.lbm 3823.000 -
471.omnetpp 2777.000 -
473.astar 5142.000 -1.00%
481.wrf 5486.000 -1.30%
482.sphinx3 954.000 -
483.xalancbmk 3834.000 -
Geometric Mean 2108.038 -
Code Size (bytes)
Name Current %
400.perlbench 888723.000 -
401.bzip2 44129.000 -
403.gcc 2443599.000 -
410.bwaves 16712.000 -
416.gamess 5717321.000 -
429.mcf 9119.000 -
433.milc 61358.000 -
434.zeusmp 152129.000 -
435.gromacs 498705.000 -
436.cactusADM 356691.000 -
437.leslie3d 59383.000 -
444.namd 188272.000 -
445.gobmk 1377662.000 -
447.dealII 313209.000 -
450.soplex 205023.000 -
453.povray 656677.000 -
454.calculix 844346.000 -
456.hmmer 108507.000 -
458.sjeng 103936.000 -
459.GemsFDTD 243996.000 -
462.libquantum 16045.000 -
464.h264ref 383756.000 -
465.tonto 1946818.000 -
470.lbm 9691.000 -
471.omnetpp 478145.000 -
473.astar 22952.000 -
481.wrf 1953374.000 -
482.sphinx3 112711.000 -
483.xalancbmk 2343847.000 -
Geometric Mean 223672.476 -
sample variability
Name Current %
400.perlbench 53.000 3.92%
400.perlbench (avg) 53.000 3.92%
400.perlbench (avg) (percentage) 3.220 -
400.perlbench (max) 60.000 71.43%
400.perlbench (max) (percentage) 3.600 63.64%
400.perlbench (unexplained diff vs previous) 58.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.480 -
401.bzip2 70.000 -2.78%
401.bzip2 (avg) 70.000 -2.78%
401.bzip2 (avg) (percentage) 2.350 -2.08%
401.bzip2 (max) 20.000 -4.76%
401.bzip2 (max) (percentage) 0.670 -4.29%
401.bzip2 (unexplained diff vs previous) 17.000 21.43%
401.bzip2 (unexplained diff vs previous) (percentage) 0.570 21.28%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.920 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.110 -1.92%
410.bwaves 105.000 -
410.bwaves (avg) 105.000 -
410.bwaves (avg) (percentage) 1.860 -1.59%
410.bwaves (max) 40.000 -6.98%
410.bwaves (max) (percentage) 0.720 -6.49%
410.bwaves (unexplained diff vs previous) 37.000 131.25%
410.bwaves (unexplained diff vs previous) (percentage) 0.650 132.14%
416.gamess 177.000 -3.28%
416.gamess (avg) 177.000 -3.28%
416.gamess (avg) (percentage) 1.420 -3.40%
416.gamess (max) 13.000 -63.89%
416.gamess (max) (percentage) 0.110 -62.07%
416.gamess (unexplained diff vs previous) 1.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.010 -
429.mcf 103.000 -
429.mcf (avg) 103.000 -
429.mcf (avg) (percentage) 7.230 -2.30%
429.mcf (max) 10.000 -28.57%
429.mcf (max) (percentage) 0.750 -25.00%
429.mcf (unexplained diff vs previous) 9.000 -35.71%
429.mcf (unexplained diff vs previous) (percentage) 0.630 -36.36%
433.milc 28.000 -3.45%
433.milc (avg) 28.000 -3.45%
433.milc (avg) (percentage) 2.500 -1.57%
433.milc (max) 5.000 66.67%
433.milc (max) (percentage) 0.440 51.72%
433.milc (unexplained diff vs previous) 5.000 66.67%
433.milc (unexplained diff vs previous) (percentage) 0.430 65.38%
434.zeusmp 56.000 -1.75%
434.zeusmp (avg) 56.000 -1.75%
434.zeusmp (avg) (percentage) 2.250 -2.17%
434.zeusmp (max) 13.000 -18.75%
434.zeusmp (max) (percentage) 0.530 -17.19%
434.zeusmp (unexplained diff vs previous) 10.000 -37.50%
434.zeusmp (unexplained diff vs previous) (percentage) 0.400 -37.50%
435.gromacs 195.000 -1.52%
435.gromacs (avg) 195.000 -1.52%
435.gromacs (avg) (percentage) 2.650 -2.21%
435.gromacs (max) 100.000 -6.54%
435.gromacs (max) (percentage) 1.370 -6.80%
435.gromacs (unexplained diff vs previous) 60.000 -43.40%
435.gromacs (unexplained diff vs previous) (percentage) 0.810 -44.14%
436.cactusADM 57.000 -3.39%
436.cactusADM (avg) 57.000 -3.39%
436.cactusADM (avg) (percentage) 2.760 -1.43%
436.cactusADM (max) 15.000 7.14%
436.cactusADM (max) (percentage) 0.760 11.76%
436.cactusADM (unexplained diff vs previous) 16.000 300.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.760 300.00%
437.leslie3d 455.000 -4.81%
437.leslie3d (avg) 455.000 -4.81%
437.leslie3d (avg) (percentage) 4.280 -
437.leslie3d (max) 603.000 -9.05%
437.leslie3d (max) (percentage) 5.670 -3.57%
437.leslie3d (unexplained diff vs previous) 639.000 669.88%
437.leslie3d (unexplained diff vs previous) (percentage) 6.010 712.16%
444.namd 23.000 -
444.namd (avg) 23.000 -
444.namd (avg) (percentage) 3.130 -1.88%
444.namd (max) 6.000 -25.00%
444.namd (max) (percentage) 0.900 -25.00%
444.namd (unexplained diff vs previous) 6.000 -33.33%
444.namd (unexplained diff vs previous) (percentage) 0.800 -34.43%
445.gobmk 81.000 -2.41%
445.gobmk (avg) 81.000 -2.41%
445.gobmk (avg) (percentage) 1.610 -3.01%
445.gobmk (max) 24.000 -4.00%
445.gobmk (max) (percentage) 0.480 -4.00%
445.gobmk (unexplained diff vs previous) 12.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -
447.dealII 42.000 -
447.dealII (avg) 42.000 -
447.dealII (avg) (percentage) 2.470 -
447.dealII (max) 34.000 209.09%
447.dealII (max) (percentage) 2.000 185.71%
447.dealII (unexplained diff vs previous) 34.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.960 -
450.soplex 18.000 -
450.soplex (avg) 18.000 -
450.soplex (avg) (percentage) 3.050 -1.29%
450.soplex (max) 10.000 150.00%
450.soplex (max) (percentage) 1.700 100.00%
450.soplex (unexplained diff vs previous) 10.000 233.33%
450.soplex (unexplained diff vs previous) (percentage) 1.680 229.41%
453.povray 16.000 -
453.povray (avg) 16.000 -
453.povray (avg) (percentage) 3.020 -
453.povray (max) 12.000 200.00%
453.povray (max) (percentage) 2.230 175.31%
453.povray (unexplained diff vs previous) 12.000 -
453.povray (unexplained diff vs previous) (percentage) 2.190 -
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.620 -1.07%
454.calculix (max) 2.000 -33.33%
454.calculix (max) (percentage) 4.370 -14.48%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.280 -
456.hmmer 48.000 -2.04%
456.hmmer (avg) 48.000 -2.04%
456.hmmer (avg) (percentage) 1.660 -2.35%
456.hmmer (max) 13.000 -
456.hmmer (max) (percentage) 0.450 -2.17%
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.170 -
458.sjeng 105.000 -2.78%
458.sjeng (avg) 105.000 -2.78%
458.sjeng (avg) (percentage) 1.390 -2.80%
458.sjeng (max) 21.000 -12.50%
458.sjeng (max) (percentage) 0.280 -12.50%
458.sjeng (unexplained diff vs previous) 8.000 -66.67%
458.sjeng (unexplained diff vs previous) (percentage) 0.110 -65.62%
459.GemsFDTD 145.000 -2.03%
459.GemsFDTD (avg) 145.000 -2.03%
459.GemsFDTD (avg) (percentage) 2.360 -2.07%
459.GemsFDTD (max) 33.000 6.45%
459.GemsFDTD (max) (percentage) 0.550 7.84%
459.GemsFDTD (unexplained diff vs previous) 34.000 100.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.550 96.43%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.060 -1.92%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.470 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.710 -
464.h264ref 117.000 -3.31%
464.h264ref (avg) 117.000 -3.31%
464.h264ref (avg) (percentage) 2.030 -3.33%
464.h264ref (max) 15.000 -
464.h264ref (max) (percentage) 0.260 -3.70%
464.h264ref (unexplained diff vs previous) 1.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -
465.tonto 203.000 -3.79%
465.tonto (avg) 203.000 -3.79%
465.tonto (avg) (percentage) 1.860 -3.63%
465.tonto (max) 56.000 -3.45%
465.tonto (max) (percentage) 0.520 -1.89%
465.tonto (unexplained diff vs previous) 11.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.100 -
470.lbm 89.000 -2.20%
470.lbm (avg) 89.000 -2.20%
470.lbm (avg) (percentage) 2.340 -2.09%
470.lbm (max) 11.000 -8.33%
470.lbm (max) (percentage) 0.290 -9.38%
470.lbm (unexplained diff vs previous) 11.000 37.50%
470.lbm (unexplained diff vs previous) (percentage) 0.290 38.10%
471.omnetpp 99.000 -1.00%
471.omnetpp (avg) 99.000 -1.00%
471.omnetpp (avg) (percentage) 3.580 -1.65%
471.omnetpp (max) 26.000 18.18%
471.omnetpp (max) (percentage) 0.950 14.46%
471.omnetpp (unexplained diff vs previous) 26.000 13.04%
471.omnetpp (unexplained diff vs previous) (percentage) 0.940 11.90%
473.astar 117.000 -2.50%
473.astar (avg) 117.000 -2.50%
473.astar (avg) (percentage) 2.290 -1.29%
473.astar (max) 53.000 -13.11%
473.astar (max) (percentage) 1.040 -12.61%
473.astar (unexplained diff vs previous) 52.000 -14.75%
473.astar (unexplained diff vs previous) (percentage) 1.010 -13.68%
481.wrf 146.000 -3.31%
481.wrf (avg) 146.000 -3.31%
481.wrf (avg) (percentage) 2.670 -1.84%
481.wrf (max) 71.000 47.92%
481.wrf (max) (percentage) 1.300 47.73%
481.wrf (unexplained diff vs previous) 72.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.310 -
482.sphinx3 30.000 -
482.sphinx3 (avg) 30.000 -
482.sphinx3 (avg) (percentage) 3.170 -2.16%
482.sphinx3 (max) 6.000 -14.29%
482.sphinx3 (max) (percentage) 0.710 -5.33%
482.sphinx3 (unexplained diff vs previous) 6.000 -14.29%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.630 -14.86%
483.xalancbmk 128.000 -3.03%
483.xalancbmk (avg) 128.000 -3.03%
483.xalancbmk (avg) (percentage) 3.340 -3.19%
483.xalancbmk (max) 100.000 -2.91%
483.xalancbmk (max) (percentage) 2.620 -2.24%
483.xalancbmk (unexplained diff vs previous) 19.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.500 -
Geometric Mean 7.279 -12.73%