Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=92172a19f67026b3eb0f9be6762b7a5821abef84 (+ 16 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/285e0bb95dd3edf3e3312f0e0ee940594f46f77d (+ 40 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9cc27336c9b6fc7b59d1adbf36f0a044a0b89a59 (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=e6a62f955681c58f49b1ce74222d6670fb55bb33 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/52/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0052 (3-changed-components) 2023-05-19T02:07:34 0:00:00
Previous 0051 (4-changed-components) 2023-05-15T20:36:59 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 42 11
Performance Improvements 136 194
Unchanged Tests 1058 1031
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 2.74% 583.000 599.000 - 5.64% -
437.leslie3d 2.21% 10700.000 10937.000 - -6.04% -
483.xalancbmk 1.46% 3773.000 3828.000 - 0.26% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) 4900.00% 1.000 50.000 - -99.36% -
410.bwaves (unexplained diff vs previous) (percentage) 4350.00% 0.020 0.890 - -99.35% -
450.soplex (unexplained diff vs previous) 1500.00% 1.000 16.000 - -99.89% -
450.soplex (unexplained diff vs previous) (percentage) 1470.59% 0.170 2.670 - -99.90% -
459.GemsFDTD (unexplained diff vs previous) 1166.67% 3.000 38.000 - -99.75% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1120.00% 0.050 0.610 - -99.76% -
458.sjeng (unexplained diff vs previous) (percentage) 800.00% 0.010 0.090 - -99.90% -
458.sjeng (unexplained diff vs previous) 600.00% 1.000 7.000 - -99.90% -
473.astar (unexplained diff vs previous) 300.00% 4.000 16.000 - -99.84% -
473.astar (unexplained diff vs previous) (percentage) 287.50% 0.080 0.310 - -99.84% -
429.mcf (unexplained diff vs previous) (percentage) 225.00% 0.840 2.730 - -99.79% -
429.mcf (unexplained diff vs previous) 216.67% 12.000 38.000 - -99.80% -
456.hmmer (unexplained diff vs previous) (percentage) 170.00% 0.100 0.270 - -99.90% -
456.hmmer (unexplained diff vs previous) 166.67% 3.000 8.000 - -99.90% -
471.omnetpp (unexplained diff vs previous) (percentage) 136.76% 0.680 1.610 - -99.59% -
471.omnetpp (unexplained diff vs previous) 131.58% 19.000 44.000 - -99.59% -
436.cactusADM (unexplained diff vs previous) 66.67% 12.000 20.000 - -99.88% -
436.cactusADM (unexplained diff vs previous) (percentage) 64.91% 0.570 0.940 - -99.88% -
450.soplex (max) 60.00% 10.000 16.000 - -97.06% -
465.tonto (unexplained diff vs previous) (percentage) 58.70% 0.460 0.730 - -95.49% -
465.tonto (unexplained diff vs previous) 56.86% 51.000 80.000 - -95.48% -
471.omnetpp (max) 53.57% 28.000 43.000 - -98.02% -
471.omnetpp (max) (percentage) 51.92% 1.040 1.580 - -98.02% -
464.h264ref (unexplained diff vs previous) (percentage) 47.37% 0.190 0.280 - -99.76% -
450.soplex (max) (percentage) 46.52% 1.870 2.740 - -97.15% -
464.h264ref (unexplained diff vs previous) 45.45% 11.000 16.000 - -99.77% -
481.wrf (unexplained diff vs previous) (percentage) 33.33% 0.180 0.240 - -99.89% -
447.dealII (unexplained diff vs previous) (percentage) 32.26% 0.930 1.230 - -99.70% -
447.dealII (unexplained diff vs previous) 31.25% 16.000 21.000 - -99.70% -
481.wrf (unexplained diff vs previous) 30.00% 10.000 13.000 - -99.89% -
434.zeusmp (unexplained diff vs previous) (percentage) 25.00% 0.160 0.200 - -99.96% -
434.zeusmp (unexplained diff vs previous) 25.00% 4.000 5.000 - -99.96% -
447.dealII (max) (percentage) 8.93% 1.120 1.220 - -98.48% -
447.dealII (max) 5.26% 19.000 20.000 - -98.55% -
450.soplex 5.26% 19.000 20.000 - -44.44% -
450.soplex (avg) 5.26% 19.000 20.000 - -44.44% -
454.calculix (unexplained diff vs previous) (percentage) 3.47% 3.170 3.280 - -99.99% -
483.xalancbmk 1.49% 134.000 136.000 - -45.16% -
483.xalancbmk (avg) 1.49% 134.000 136.000 - -45.16% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
436.cactusADM -1.15% 356739.000 352651.000 - -0.07% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -3.17% 63.000 61.000 - -1.61% -
400.perlbench -2.82% 1664.000 1617.000 - -2.77% -
429.mcf -2.66% 1430.000 1392.000 - -2.25% -
435.gromacs -2.15% 7442.000 7282.000 - 0.18% -
403.gcc -1.67% 60.000 59.000 - 5.36% -
471.omnetpp -1.58% 2777.000 2733.000 - 0.33% -
447.dealII -1.22% 1726.000 1705.000 - -1.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -64.19% 6.060 2.170 - -89.08% -
470.lbm (unexplained diff vs previous) (percentage) -63.79% 0.580 0.210 - -99.92% -
470.lbm (unexplained diff vs previous) -63.64% 22.000 8.000 - -99.92% -
437.leslie3d (unexplained diff vs previous) -63.43% 648.000 237.000 - -89.76% -
444.namd (unexplained diff vs previous) -55.56% 9.000 4.000 - -99.95% -
444.namd (unexplained diff vs previous) (percentage) -55.00% 1.200 0.540 - -99.95% -
462.libquantum (unexplained diff vs previous) (percentage) -50.69% 1.440 0.710 - -99.99% -
401.bzip2 (unexplained diff vs previous) (percentage) -50.67% 0.750 0.370 - -99.90% -
401.bzip2 (unexplained diff vs previous) -50.00% 22.000 11.000 - -99.90% -
416.gamess (unexplained diff vs previous) -50.00% 54.000 27.000 - -99.65% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.99% -
416.gamess (unexplained diff vs previous) (percentage) -48.84% 0.430 0.220 - -99.65% -
445.gobmk (unexplained diff vs previous) -46.67% 45.000 24.000 - -99.57% -
445.gobmk (unexplained diff vs previous) (percentage) -46.59% 0.880 0.470 - -99.58% -
435.gromacs (unexplained diff vs previous) -43.46% 283.000 160.000 - -97.72% -
435.gromacs (unexplained diff vs previous) (percentage) -42.11% 3.800 2.200 - -97.72% -
470.lbm (max) -27.27% 22.000 16.000 - -99.42% -
445.gobmk (max) -26.67% 45.000 33.000 - -98.75% -
462.libquantum (max) (percentage) -26.50% 2.000 1.470 - -98.51% -
454.calculix (max) -25.00% 4.000 3.000 - -95.08% -
445.gobmk (max) (percentage) -24.72% 0.890 0.670 - -98.73% -
470.lbm (max) (percentage) -24.14% 0.580 0.440 - -99.39% -
444.namd (max) -11.11% 9.000 8.000 - -98.83% -
482.sphinx3 (max) -11.11% 9.000 8.000 - -99.12% -
473.astar (max) (percentage) -10.71% 1.120 1.000 - -98.49% -
473.astar (max) -10.71% 56.000 50.000 - -98.53% -
416.gamess (max) -9.43% 53.000 48.000 - -99.00% -
416.gamess (max) (percentage) -9.30% 0.430 0.390 - -98.99% -
435.gromacs (max) -8.87% 293.000 267.000 - -92.53% -
437.leslie3d (max) (percentage) -8.60% 6.860 6.270 - -62.18% -
444.namd (max) (percentage) -8.20% 1.220 1.120 - -98.78% -
400.perlbench (max) -7.55% 53.000 49.000 - -96.49% -
435.gromacs (max) (percentage) -7.09% 3.950 3.670 - -92.53% -
437.leslie3d (max) -6.68% 734.000 685.000 - -64.49% -
458.sjeng (max) (percentage) -6.49% 0.770 0.720 - -98.49% -
482.sphinx3 (max) (percentage) -6.12% 0.980 0.920 - -99.05% -
436.cactusADM (max) (percentage) -5.71% 1.050 0.990 - -98.88% -
454.calculix (max) (percentage) -5.68% 6.510 6.140 - -93.84% -
481.wrf (max) -5.45% 55.000 52.000 - -98.63% -
458.sjeng (max) -5.26% 57.000 54.000 - -98.50% -
464.h264ref (max) -5.26% 38.000 36.000 - -98.85% -
400.perlbench (max) (percentage) -4.95% 3.230 3.070 - -96.35% -
481.wrf (max) (percentage) -4.95% 1.010 0.960 - -98.60% -
436.cactusADM (max) -4.55% 22.000 21.000 - -98.86% -
464.h264ref (max) (percentage) -4.48% 0.670 0.640 - -98.82% -
447.dealII -4.44% 45.000 43.000 - -56.57% -
447.dealII (avg) -4.44% 45.000 43.000 - -56.57% -
483.xalancbmk (max) (percentage) -4.22% 3.320 3.180 - -95.37% -
429.mcf -4.03% 124.000 119.000 - 9.17% -
429.mcf (avg) -4.03% 124.000 119.000 - 9.17% -
465.tonto (max) -4.03% 124.000 119.000 - -94.37% -
465.tonto -3.81% 236.000 227.000 - -37.81% -
465.tonto (avg) -3.81% 236.000 227.000 - -37.81% -
434.zeusmp (max) -3.70% 27.000 26.000 - -98.73% -
444.namd -3.70% 27.000 26.000 - -61.76% -
444.namd (avg) -3.70% 27.000 26.000 - -61.76% -
481.wrf -3.66% 164.000 158.000 - -54.20% -
481.wrf (avg) -3.66% 164.000 158.000 - -54.20% -
456.hmmer -3.64% 55.000 53.000 - -58.27% -
456.hmmer (avg) -3.64% 55.000 53.000 - -58.27% -
416.gamess (avg) (percentage) -3.64% 1.650 1.590 - -64.03% -
471.omnetpp -3.48% 115.000 111.000 - -50.22% -
471.omnetpp (avg) -3.48% 115.000 111.000 - -50.22% -
416.gamess -3.41% 205.000 198.000 - -64.00% -
416.gamess (avg) -3.41% 205.000 198.000 - -64.00% -
453.povray (max) (percentage) -3.37% 1.780 1.720 - -98.12% -
403.gcc (max) (percentage) -3.36% 6.250 6.040 - -93.92% -
481.wrf (avg) (percentage) -3.34% 2.990 2.890 - -53.69% -
445.gobmk -3.23% 93.000 90.000 - -54.08% -
445.gobmk (avg) -3.23% 93.000 90.000 - -54.08% -
483.xalancbmk (max) -3.20% 125.000 121.000 - -95.38% -
464.h264ref -3.08% 130.000 126.000 - -57.00% -
464.h264ref (avg) -3.08% 130.000 126.000 - -57.00% -
464.h264ref (avg) (percentage) -3.07% 2.280 2.210 - -56.58% -
401.bzip2 (max) (percentage) -2.99% 1.340 1.300 - -98.35% -
433.milc -2.94% 34.000 33.000 - -52.17% -
433.milc (avg) -2.94% 34.000 33.000 - -52.17% -
482.sphinx3 -2.94% 34.000 33.000 - -55.41% -
482.sphinx3 (avg) -2.94% 34.000 33.000 - -55.41% -
470.lbm -2.88% 104.000 101.000 - -57.74% -
470.lbm (avg) -2.88% 104.000 101.000 - -57.74% -
465.tonto (avg) (percentage) -2.79% 2.150 2.090 - -37.43% -
434.zeusmp (max) (percentage) -2.78% 1.080 1.050 - -98.72% -
429.mcf (max) -2.78% 144.000 140.000 - -89.41% -
435.gromacs -2.74% 219.000 213.000 - -41.96% -
435.gromacs (avg) -2.74% 219.000 213.000 - -41.96% -
445.gobmk (avg) (percentage) -2.72% 1.840 1.790 - -54.22% -
401.bzip2 (avg) (percentage) -2.67% 2.620 2.550 - -53.47% -
456.hmmer (avg) (percentage) -2.66% 1.880 1.830 - -58.50% -
465.tonto (max) (percentage) -2.65% 1.130 1.100 - -94.30% -
401.bzip2 -2.60% 77.000 75.000 - -53.42% -
401.bzip2 (avg) -2.60% 77.000 75.000 - -53.42% -
401.bzip2 (max) -2.56% 39.000 38.000 - -98.36% -
458.sjeng -2.54% 118.000 115.000 - -52.28% -
458.sjeng (avg) -2.54% 118.000 115.000 - -52.28% -
458.sjeng (avg) (percentage) -2.53% 1.580 1.540 - -51.72% -
410.bwaves -2.46% 122.000 119.000 - -52.21% -
410.bwaves (avg) -2.46% 122.000 119.000 - -52.21% -
473.astar (avg) (percentage) -2.28% 2.630 2.570 - -38.22% -
434.zeusmp (avg) (percentage) -2.26% 2.650 2.590 - -55.73% -
462.libquantum (avg) (percentage) -2.26% 3.540 3.460 - -54.83% -
473.astar -2.26% 133.000 130.000 - -38.97% -
473.astar (avg) -2.26% 133.000 130.000 - -38.97% -
482.sphinx3 (avg) (percentage) -2.20% 3.630 3.550 - -55.23% -
459.GemsFDTD (avg) (percentage) -2.20% 2.730 2.670 - -54.28% -
470.lbm (avg) (percentage) -2.19% 2.740 2.680 - -57.66% -
444.namd (avg) (percentage) -2.19% 3.660 3.580 - -61.17% -
433.milc (avg) (percentage) -2.01% 2.980 2.920 - -51.74% -
429.mcf (avg) (percentage) -1.95% 8.730 8.560 - 11.60% -
447.dealII (avg) (percentage) -1.92% 2.610 2.560 - -55.63% -
433.milc (unexplained diff vs previous) (percentage) -1.89% 0.530 0.520 - -99.95% -
436.cactusADM (avg) (percentage) -1.87% 3.210 3.150 - -47.32% -
400.perlbench -1.85% 54.000 53.000 - -49.52% -
400.perlbench (avg) -1.85% 54.000 53.000 - -49.52% -
459.GemsFDTD -1.79% 168.000 165.000 - -54.17% -
459.GemsFDTD (avg) -1.79% 168.000 165.000 - -54.17% -
410.bwaves (max) (percentage) -1.69% 1.180 1.160 - -98.00% -
433.milc (max) (percentage) -1.69% 1.180 1.160 - -98.72% -
471.omnetpp (avg) (percentage) -1.68% 4.160 4.090 - -50.12% -
459.GemsFDTD (max) (percentage) -1.59% 0.630 0.620 - -99.13% -
437.leslie3d (avg) (percentage) -1.57% 4.470 4.400 - 44.26% -
410.bwaves (max) -1.52% 66.000 65.000 - -98.02% -
434.zeusmp -1.52% 66.000 65.000 - -55.78% -
434.zeusmp (avg) -1.52% 66.000 65.000 - -55.78% -
436.cactusADM -1.49% 67.000 66.000 - -46.77% -
436.cactusADM (avg) -1.49% 67.000 66.000 - -46.77% -
410.bwaves (avg) (percentage) -1.39% 2.160 2.130 - -51.70% -
454.calculix (avg) (percentage) -1.27% 4.720 4.660 - -41.90% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 5.64% 567.000 599.000 - 2.74% -
403.gcc 5.36% 56.000 59.000 - -1.67% -
436.cactusADM 1.97% 2083.000 2124.000 - 0.95% -
453.povray 1.46% 547.000 555.000 - 0.00% -
456.hmmer 1.39% 2882.000 2922.000 - -0.27% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 44.26% 3.050 4.400 - -1.57% -
437.leslie3d 35.49% 355.000 481.000 - 0.63% -
437.leslie3d (avg) 35.49% 355.000 481.000 - 0.63% -
429.mcf (avg) (percentage) 11.60% 7.670 8.560 - -1.95% -
429.mcf 9.17% 109.000 119.000 - -4.03% -
429.mcf (avg) 9.17% 109.000 119.000 - -4.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.04% 11640.000 10937.000 - 2.21% -
400.perlbench -2.77% 1663.000 1617.000 - -2.82% -
429.mcf -2.25% 1424.000 1392.000 - -2.66% -
454.calculix -1.61% 62.000 61.000 - -3.17% -
447.dealII -1.10% 1724.000 1705.000 - -1.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.710 - -50.69% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -50.00% -
454.calculix (unexplained diff vs previous) -99.99% 22953.000 2.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -99.99% 37020.970 3.280 - 3.47% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.740 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 7.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 5.000 - 25.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.200 - 25.00% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - -55.56% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.540 - -55.00% -
433.milc (unexplained diff vs previous) (percentage) -99.95% 980.800 0.520 - -1.89% -
433.milc (unexplained diff vs previous) -99.95% 11289.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.92% 263.730 0.210 - -63.79% -
470.lbm (unexplained diff vs previous) -99.92% 9990.000 8.000 - -63.64% -
456.hmmer (unexplained diff vs previous) (percentage) -99.90% 278.630 0.270 - 170.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.90% 90.870 0.090 - 800.00% -
456.hmmer (unexplained diff vs previous) -99.90% 8030.000 8.000 - 166.67% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.90% 368.340 0.370 - -50.67% -
401.bzip2 (unexplained diff vs previous) -99.90% 10833.000 11.000 - -50.00% -
458.sjeng (unexplained diff vs previous) -99.90% 6876.000 7.000 - 600.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.90% 2557.320 2.670 - 1470.59% -
481.wrf (unexplained diff vs previous) -99.89% 12149.000 13.000 - 30.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.89% 219.530 0.240 - 33.33% -
450.soplex (unexplained diff vs previous) -99.89% 14500.000 16.000 - 1500.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.88% 787.130 0.940 - 64.91% -
436.cactusADM (unexplained diff vs previous) -99.88% 16396.000 20.000 - 66.67% -
473.astar (unexplained diff vs previous) (percentage) -99.84% 197.850 0.310 - 287.50% -
473.astar (unexplained diff vs previous) -99.84% 10146.000 16.000 - 300.00% -
429.mcf (unexplained diff vs previous) -99.80% 18593.000 38.000 - 216.67% -
429.mcf (unexplained diff vs previous) (percentage) -99.79% 1305.690 2.730 - 225.00% -
464.h264ref (unexplained diff vs previous) -99.77% 6843.000 16.000 - 45.45% -
464.h264ref (unexplained diff vs previous) (percentage) -99.76% 118.780 0.280 - 47.37% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.76% 250.410 0.610 - 1120.00% -
459.GemsFDTD (unexplained diff vs previous) -99.75% 15458.000 38.000 - 1166.67% -
447.dealII (unexplained diff vs previous) -99.70% 7017.000 21.000 - 31.25% -
447.dealII (unexplained diff vs previous) (percentage) -99.70% 407.020 1.230 - 32.26% -
416.gamess (unexplained diff vs previous) -99.65% 7819.000 27.000 - -50.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.65% 62.730 0.220 - -48.84% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.59% 391.300 1.610 - 136.76% -
471.omnetpp (unexplained diff vs previous) -99.59% 10659.000 44.000 - 131.58% -
445.gobmk (unexplained diff vs previous) (percentage) -99.58% 111.110 0.470 - -46.59% -
445.gobmk (unexplained diff vs previous) -99.57% 5581.000 24.000 - -46.67% -
470.lbm (max) -99.42% 2746.000 16.000 - -27.27% -
470.lbm (max) (percentage) -99.39% 72.510 0.440 - -24.14% -
410.bwaves (unexplained diff vs previous) -99.36% 7794.000 50.000 - 4900.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.35% 137.900 0.890 - 4350.00% -
456.hmmer (max) -99.25% 2120.000 16.000 - 0.00% -
456.hmmer (max) (percentage) -99.24% 73.590 0.560 - -1.75% -
459.GemsFDTD (max) -99.14% 4411.000 38.000 - 0.00% -
459.GemsFDTD (max) (percentage) -99.13% 71.460 0.620 - -1.59% -
482.sphinx3 (max) -99.12% 911.000 8.000 - -11.11% -
482.sphinx3 (max) (percentage) -99.05% 96.500 0.920 - -6.12% -
416.gamess (max) -99.00% 4805.000 48.000 - -9.43% -
416.gamess (max) (percentage) -98.99% 38.550 0.390 - -9.30% -
436.cactusADM (max) (percentage) -98.88% 88.730 0.990 - -5.71% -
436.cactusADM (max) -98.86% 1848.000 21.000 - -4.55% -
464.h264ref (max) -98.85% 3127.000 36.000 - -5.26% -
444.namd (max) -98.83% 685.000 8.000 - -11.11% -
464.h264ref (max) (percentage) -98.82% 54.290 0.640 - -4.48% -
444.namd (max) (percentage) -98.78% 91.790 1.120 - -8.20% -
433.milc (max) -98.75% 1044.000 13.000 - 0.00% -
445.gobmk (max) -98.75% 2643.000 33.000 - -26.67% -
434.zeusmp (max) -98.73% 2055.000 26.000 - -3.70% -
445.gobmk (max) (percentage) -98.73% 52.630 0.670 - -24.72% -
433.milc (max) (percentage) -98.72% 90.750 1.160 - -1.69% -
434.zeusmp (max) (percentage) -98.72% 81.770 1.050 - -2.78% -
481.wrf (max) -98.63% 3801.000 52.000 - -5.45% -
481.wrf (max) (percentage) -98.60% 68.700 0.960 - -4.95% -
447.dealII (max) -98.55% 1384.000 20.000 - 5.26% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
473.astar (max) -98.53% 3406.000 50.000 - -10.71% -
462.libquantum (max) (percentage) -98.51% 98.970 1.470 - -26.50% -
458.sjeng (max) -98.50% 3602.000 54.000 - -5.26% -
473.astar (max) (percentage) -98.49% 66.430 1.000 - -10.71% -
458.sjeng (max) (percentage) -98.49% 47.610 0.720 - -6.49% -
447.dealII (max) (percentage) -98.48% 80.280 1.220 - 8.93% -
401.bzip2 (max) -98.36% 2313.000 38.000 - -2.56% -
401.bzip2 (max) (percentage) -98.35% 78.650 1.300 - -2.99% -
453.povray (max) -98.20% 499.000 9.000 - 0.00% -
453.povray (max) (percentage) -98.12% 91.250 1.720 - -3.37% -
471.omnetpp (max) -98.02% 2169.000 43.000 - 53.57% -
471.omnetpp (max) (percentage) -98.02% 79.650 1.580 - 51.92% -
410.bwaves (max) -98.02% 3276.000 65.000 - -1.52% -
410.bwaves (max) (percentage) -98.00% 57.970 1.160 - -1.69% -
435.gromacs (unexplained diff vs previous) (percentage) -97.72% 96.680 2.200 - -42.11% -
435.gromacs (unexplained diff vs previous) -97.72% 7028.000 160.000 - -43.46% -
450.soplex (max) (percentage) -97.15% 96.240 2.740 - 46.52% -
450.soplex (max) -97.06% 545.000 16.000 - 60.00% -
400.perlbench (max) -96.49% 1397.000 49.000 - -7.55% -
400.perlbench (max) (percentage) -96.35% 84.060 3.070 - -4.95% -
465.tonto (unexplained diff vs previous) (percentage) -95.49% 16.190 0.730 - 58.70% -
465.tonto (unexplained diff vs previous) -95.48% 1771.000 80.000 - 56.86% -
483.xalancbmk (max) -95.38% 2621.000 121.000 - -3.20% -
483.xalancbmk (max) (percentage) -95.37% 68.670 3.180 - -4.22% -
454.calculix (max) -95.08% 61.000 3.000 - -25.00% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
465.tonto (max) -94.37% 2112.000 119.000 - -4.03% -
465.tonto (max) (percentage) -94.30% 19.310 1.100 - -2.65% -
403.gcc (max) (percentage) -93.92% 99.360 6.040 - -3.36% -
454.calculix (max) (percentage) -93.84% 99.730 6.140 - -5.68% -
435.gromacs (max) (percentage) -92.53% 49.160 3.670 - -7.09% -
435.gromacs (max) -92.53% 3573.000 267.000 - -8.87% -
437.leslie3d (unexplained diff vs previous) -89.76% 2314.000 237.000 - -63.43% -
429.mcf (max) -89.41% 1322.000 140.000 - -2.78% -
429.mcf (max) (percentage) -89.13% 92.890 10.100 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.08% 19.880 2.170 - -64.19% -
437.leslie3d (max) -64.49% 1929.000 685.000 - -6.68% -
416.gamess (avg) (percentage) -64.03% 4.420 1.590 - -3.64% -
416.gamess -64.00% 550.000 198.000 - -3.41% -
416.gamess (avg) -64.00% 550.000 198.000 - -3.41% -
437.leslie3d (max) (percentage) -62.18% 16.580 6.270 - -8.60% -
444.namd -61.76% 68.000 26.000 - -3.70% -
444.namd (avg) -61.76% 68.000 26.000 - -3.70% -
444.namd (avg) (percentage) -61.17% 9.220 3.580 - -2.19% -
462.libquantum -60.00% 10.000 4.000 - 0.00% -
462.libquantum (avg) -60.00% 10.000 4.000 - 0.00% -
456.hmmer (avg) (percentage) -58.50% 4.410 1.830 - -2.66% -
456.hmmer -58.27% 127.000 53.000 - -3.64% -
456.hmmer (avg) -58.27% 127.000 53.000 - -3.64% -
470.lbm -57.74% 239.000 101.000 - -2.88% -
470.lbm (avg) -57.74% 239.000 101.000 - -2.88% -
470.lbm (avg) (percentage) -57.66% 6.330 2.680 - -2.19% -
453.povray (avg) (percentage) -57.49% 7.810 3.320 - 0.00% -
453.povray -57.14% 42.000 18.000 - 0.00% -
453.povray (avg) -57.14% 42.000 18.000 - 0.00% -
464.h264ref -57.00% 293.000 126.000 - -3.08% -
464.h264ref (avg) -57.00% 293.000 126.000 - -3.08% -
464.h264ref (avg) (percentage) -56.58% 5.090 2.210 - -3.07% -
447.dealII -56.57% 99.000 43.000 - -4.44% -
447.dealII (avg) -56.57% 99.000 43.000 - -4.44% -
434.zeusmp -55.78% 147.000 65.000 - -1.52% -
434.zeusmp (avg) -55.78% 147.000 65.000 - -1.52% -
434.zeusmp (avg) (percentage) -55.73% 5.850 2.590 - -2.26% -
447.dealII (avg) (percentage) -55.63% 5.770 2.560 - -1.92% -
482.sphinx3 -55.41% 74.000 33.000 - -2.94% -
482.sphinx3 (avg) -55.41% 74.000 33.000 - -2.94% -
482.sphinx3 (avg) (percentage) -55.23% 7.930 3.550 - -2.20% -
462.libquantum (avg) (percentage) -54.83% 7.660 3.460 - -2.26% -
459.GemsFDTD (avg) (percentage) -54.28% 5.840 2.670 - -2.20% -
445.gobmk (avg) (percentage) -54.22% 3.910 1.790 - -2.72% -
481.wrf -54.20% 345.000 158.000 - -3.66% -
481.wrf (avg) -54.20% 345.000 158.000 - -3.66% -
459.GemsFDTD -54.17% 360.000 165.000 - -1.79% -
459.GemsFDTD (avg) -54.17% 360.000 165.000 - -1.79% -
445.gobmk -54.08% 196.000 90.000 - -3.23% -
445.gobmk (avg) -54.08% 196.000 90.000 - -3.23% -
481.wrf (avg) (percentage) -53.69% 6.240 2.890 - -3.34% -
401.bzip2 (avg) (percentage) -53.47% 5.480 2.550 - -2.67% -
401.bzip2 -53.42% 161.000 75.000 - -2.60% -
401.bzip2 (avg) -53.42% 161.000 75.000 - -2.60% -
458.sjeng -52.28% 241.000 115.000 - -2.54% -
458.sjeng (avg) -52.28% 241.000 115.000 - -2.54% -
410.bwaves -52.21% 249.000 119.000 - -2.46% -
410.bwaves (avg) -52.21% 249.000 119.000 - -2.46% -
433.milc -52.17% 69.000 33.000 - -2.94% -
433.milc (avg) -52.17% 69.000 33.000 - -2.94% -
433.milc (avg) (percentage) -51.74% 6.050 2.920 - -2.01% -
458.sjeng (avg) (percentage) -51.72% 3.190 1.540 - -2.53% -
410.bwaves (avg) (percentage) -51.70% 4.410 2.130 - -1.39% -
471.omnetpp -50.22% 223.000 111.000 - -3.48% -
471.omnetpp (avg) -50.22% 223.000 111.000 - -3.48% -
471.omnetpp (avg) (percentage) -50.12% 8.200 4.090 - -1.68% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
400.perlbench -49.52% 105.000 53.000 - -1.85% -
400.perlbench (avg) -49.52% 105.000 53.000 - -1.85% -
400.perlbench (avg) (percentage) -48.35% 6.350 3.280 - 0.00% -
436.cactusADM (avg) (percentage) -47.32% 5.980 3.150 - -1.87% -
450.soplex (avg) (percentage) -46.97% 6.430 3.410 - -0.58% -
436.cactusADM -46.77% 124.000 66.000 - -1.49% -
436.cactusADM (avg) -46.77% 124.000 66.000 - -1.49% -
483.xalancbmk -45.16% 248.000 136.000 - 1.49% -
483.xalancbmk (avg) -45.16% 248.000 136.000 - 1.49% -
483.xalancbmk (avg) (percentage) -45.08% 6.500 3.570 - 0.00% -
450.soplex -44.44% 36.000 20.000 - 5.26% -
450.soplex (avg) -44.44% 36.000 20.000 - 5.26% -
435.gromacs (avg) (percentage) -42.09% 5.060 2.930 - -0.68% -
435.gromacs -41.96% 367.000 213.000 - -2.74% -
435.gromacs (avg) -41.96% 367.000 213.000 - -2.74% -
454.calculix (avg) (percentage) -41.90% 8.020 4.660 - -1.27% -
473.astar -38.97% 213.000 130.000 - -2.26% -
473.astar (avg) -38.97% 213.000 130.000 - -2.26% -
473.astar (avg) (percentage) -38.22% 4.160 2.570 - -2.28% -
465.tonto -37.81% 365.000 227.000 - -3.81% -
465.tonto (avg) -37.81% 365.000 227.000 - -3.81% -
465.tonto (avg) (percentage) -37.43% 3.340 2.090 - -2.79% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -19.13% 7.320 5.920 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1617.000 -2.82%
401.bzip2 2959.000 -
403.gcc 59.000 -1.67%
410.bwaves 5626.000 -
416.gamess 12462.000 -
429.mcf 1392.000 -2.66%
433.milc 1147.000 -
434.zeusmp 2512.000 -
435.gromacs 7282.000 -2.15%
436.cactusADM 2124.000 -
437.leslie3d 10937.000 2.21%
444.namd 744.000 -
445.gobmk 5073.000 -
447.dealII 1705.000 -1.22%
450.soplex 599.000 2.74%
453.povray 555.000 -
454.calculix 61.000 -3.17%
456.hmmer 2922.000 -
458.sjeng 7507.000 -
459.GemsFDTD 6198.000 -
462.libquantum 140.000 -
464.h264ref 5721.000 -
465.tonto 10898.000 -
470.lbm 3793.000 -
471.omnetpp 2733.000 -1.58%
473.astar 5095.000 -
481.wrf 5488.000 -
482.sphinx3 945.000 -
483.xalancbmk 3828.000 1.46%
Geometric Mean 2099.034 -
Code Size (bytes)
Name Current %
400.perlbench 893131.000 -
401.bzip2 44233.000 -
403.gcc 2447919.000 -
410.bwaves 16712.000 -
416.gamess 5732073.000 -
429.mcf 9119.000 -
433.milc 61370.000 -
434.zeusmp 152125.000 -
435.gromacs 498693.000 -
436.cactusADM 352651.000 -1.15%
437.leslie3d 59379.000 -
444.namd 188328.000 -
445.gobmk 1377722.000 -
447.dealII 313237.000 -
450.soplex 205139.000 -
453.povray 661285.000 -
454.calculix 848738.000 -
456.hmmer 108603.000 -
458.sjeng 103996.000 -
459.GemsFDTD 244012.000 -
462.libquantum 16085.000 -
464.h264ref 384116.000 -
465.tonto 1939250.000 -
470.lbm 9691.000 -
471.omnetpp 478177.000 -
473.astar 22944.000 -
481.wrf 1957762.000 -
482.sphinx3 112731.000 -
483.xalancbmk 2344140.000 -
Geometric Mean 223802.342 -
sample variability
Name Current %
400.perlbench 53.000 -1.85%
400.perlbench (avg) 53.000 -1.85%
400.perlbench (avg) (percentage) 3.280 -
400.perlbench (max) 49.000 -7.55%
400.perlbench (max) (percentage) 3.070 -4.95%
401.bzip2 75.000 -2.60%
401.bzip2 (avg) 75.000 -2.60%
401.bzip2 (avg) (percentage) 2.550 -2.67%
401.bzip2 (max) 38.000 -2.56%
401.bzip2 (max) (percentage) 1.300 -2.99%
401.bzip2 (unexplained diff vs previous) 11.000 -50.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.370 -50.67%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.920 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.040 -3.36%
410.bwaves 119.000 -2.46%
410.bwaves (avg) 119.000 -2.46%
410.bwaves (avg) (percentage) 2.130 -1.39%
410.bwaves (max) 65.000 -1.52%
410.bwaves (max) (percentage) 1.160 -1.69%
410.bwaves (unexplained diff vs previous) 50.000 4900.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.890 4350.00%
416.gamess 198.000 -3.41%
416.gamess (avg) 198.000 -3.41%
416.gamess (avg) (percentage) 1.590 -3.64%
416.gamess (max) 48.000 -9.43%
416.gamess (max) (percentage) 0.390 -9.30%
416.gamess (unexplained diff vs previous) 27.000 -50.00%
416.gamess (unexplained diff vs previous) (percentage) 0.220 -48.84%
429.mcf 119.000 -4.03%
429.mcf (avg) 119.000 -4.03%
429.mcf (avg) (percentage) 8.560 -1.95%
429.mcf (max) 140.000 -2.78%
429.mcf (max) (percentage) 10.100 -
429.mcf (unexplained diff vs previous) 38.000 216.67%
429.mcf (unexplained diff vs previous) (percentage) 2.730 225.00%
433.milc 33.000 -2.94%
433.milc (avg) 33.000 -2.94%
433.milc (avg) (percentage) 2.920 -2.01%
433.milc (max) 13.000 -
433.milc (max) (percentage) 1.160 -1.69%
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.520 -1.89%
434.zeusmp 65.000 -1.52%
434.zeusmp (avg) 65.000 -1.52%
434.zeusmp (avg) (percentage) 2.590 -2.26%
434.zeusmp (max) 26.000 -3.70%
434.zeusmp (max) (percentage) 1.050 -2.78%
434.zeusmp (unexplained diff vs previous) 5.000 25.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.200 25.00%
435.gromacs 213.000 -2.74%
435.gromacs (avg) 213.000 -2.74%
435.gromacs (avg) (percentage) 2.930 -
435.gromacs (max) 267.000 -8.87%
435.gromacs (max) (percentage) 3.670 -7.09%
435.gromacs (unexplained diff vs previous) 160.000 -43.46%
435.gromacs (unexplained diff vs previous) (percentage) 2.200 -42.11%
436.cactusADM 66.000 -1.49%
436.cactusADM (avg) 66.000 -1.49%
436.cactusADM (avg) (percentage) 3.150 -1.87%
436.cactusADM (max) 21.000 -4.55%
436.cactusADM (max) (percentage) 0.990 -5.71%
436.cactusADM (unexplained diff vs previous) 20.000 66.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.940 64.91%
437.leslie3d 481.000 -
437.leslie3d (avg) 481.000 -
437.leslie3d (avg) (percentage) 4.400 -1.57%
437.leslie3d (max) 685.000 -6.68%
437.leslie3d (max) (percentage) 6.270 -8.60%
437.leslie3d (unexplained diff vs previous) 237.000 -63.43%
437.leslie3d (unexplained diff vs previous) (percentage) 2.170 -64.19%
444.namd 26.000 -3.70%
444.namd (avg) 26.000 -3.70%
444.namd (avg) (percentage) 3.580 -2.19%
444.namd (max) 8.000 -11.11%
444.namd (max) (percentage) 1.120 -8.20%
444.namd (unexplained diff vs previous) 4.000 -55.56%
444.namd (unexplained diff vs previous) (percentage) 0.540 -55.00%
445.gobmk 90.000 -3.23%
445.gobmk (avg) 90.000 -3.23%
445.gobmk (avg) (percentage) 1.790 -2.72%
445.gobmk (max) 33.000 -26.67%
445.gobmk (max) (percentage) 0.670 -24.72%
445.gobmk (unexplained diff vs previous) 24.000 -46.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.470 -46.59%
447.dealII 43.000 -4.44%
447.dealII (avg) 43.000 -4.44%
447.dealII (avg) (percentage) 2.560 -1.92%
447.dealII (max) 20.000 5.26%
447.dealII (max) (percentage) 1.220 8.93%
447.dealII (unexplained diff vs previous) 21.000 31.25%
447.dealII (unexplained diff vs previous) (percentage) 1.230 32.26%
450.soplex 20.000 5.26%
450.soplex (avg) 20.000 5.26%
450.soplex (avg) (percentage) 3.410 -
450.soplex (max) 16.000 60.00%
450.soplex (max) (percentage) 2.740 46.52%
450.soplex (unexplained diff vs previous) 16.000 1500.00%
450.soplex (unexplained diff vs previous) (percentage) 2.670 1470.59%
453.povray 18.000 -
453.povray (avg) 18.000 -
453.povray (avg) (percentage) 3.320 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.720 -3.37%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.660 -1.27%
454.calculix (max) 3.000 -25.00%
454.calculix (max) (percentage) 6.140 -5.68%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.280 3.47%
456.hmmer 53.000 -3.64%
456.hmmer (avg) 53.000 -3.64%
456.hmmer (avg) (percentage) 1.830 -2.66%
456.hmmer (max) 16.000 -
456.hmmer (max) (percentage) 0.560 -
456.hmmer (unexplained diff vs previous) 8.000 166.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.270 170.00%
458.sjeng 115.000 -2.54%
458.sjeng (avg) 115.000 -2.54%
458.sjeng (avg) (percentage) 1.540 -2.53%
458.sjeng (max) 54.000 -5.26%
458.sjeng (max) (percentage) 0.720 -6.49%
458.sjeng (unexplained diff vs previous) 7.000 600.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.090 800.00%
459.GemsFDTD 165.000 -1.79%
459.GemsFDTD (avg) 165.000 -1.79%
459.GemsFDTD (avg) (percentage) 2.670 -2.20%
459.GemsFDTD (max) 38.000 -
459.GemsFDTD (max) (percentage) 0.620 -1.59%
459.GemsFDTD (unexplained diff vs previous) 38.000 1166.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.610 1120.00%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.460 -2.26%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.470 -26.50%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.710 -50.69%
464.h264ref 126.000 -3.08%
464.h264ref (avg) 126.000 -3.08%
464.h264ref (avg) (percentage) 2.210 -3.07%
464.h264ref (max) 36.000 -5.26%
464.h264ref (max) (percentage) 0.640 -4.48%
464.h264ref (unexplained diff vs previous) 16.000 45.45%
464.h264ref (unexplained diff vs previous) (percentage) 0.280 47.37%
465.tonto 227.000 -3.81%
465.tonto (avg) 227.000 -3.81%
465.tonto (avg) (percentage) 2.090 -2.79%
465.tonto (max) 119.000 -4.03%
465.tonto (max) (percentage) 1.100 -2.65%
465.tonto (unexplained diff vs previous) 80.000 56.86%
465.tonto (unexplained diff vs previous) (percentage) 0.730 58.70%
470.lbm 101.000 -2.88%
470.lbm (avg) 101.000 -2.88%
470.lbm (avg) (percentage) 2.680 -2.19%
470.lbm (max) 16.000 -27.27%
470.lbm (max) (percentage) 0.440 -24.14%
470.lbm (unexplained diff vs previous) 8.000 -63.64%
470.lbm (unexplained diff vs previous) (percentage) 0.210 -63.79%
471.omnetpp 111.000 -3.48%
471.omnetpp (avg) 111.000 -3.48%
471.omnetpp (avg) (percentage) 4.090 -1.68%
471.omnetpp (max) 43.000 53.57%
471.omnetpp (max) (percentage) 1.580 51.92%
471.omnetpp (unexplained diff vs previous) 44.000 131.58%
471.omnetpp (unexplained diff vs previous) (percentage) 1.610 136.76%
473.astar 130.000 -2.26%
473.astar (avg) 130.000 -2.26%
473.astar (avg) (percentage) 2.570 -2.28%
473.astar (max) 50.000 -10.71%
473.astar (max) (percentage) 1.000 -10.71%
473.astar (unexplained diff vs previous) 16.000 300.00%
473.astar (unexplained diff vs previous) (percentage) 0.310 287.50%
481.wrf 158.000 -3.66%
481.wrf (avg) 158.000 -3.66%
481.wrf (avg) (percentage) 2.890 -3.34%
481.wrf (max) 52.000 -5.45%
481.wrf (max) (percentage) 0.960 -4.95%
481.wrf (unexplained diff vs previous) 13.000 30.00%
481.wrf (unexplained diff vs previous) (percentage) 0.240 33.33%
482.sphinx3 33.000 -2.94%
482.sphinx3 (avg) 33.000 -2.94%
482.sphinx3 (avg) (percentage) 3.550 -2.20%
482.sphinx3 (max) 8.000 -11.11%
482.sphinx3 (max) (percentage) 0.920 -6.12%
482.sphinx3 (unexplained diff vs previous) 7.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.740 -
483.xalancbmk 136.000 1.49%
483.xalancbmk (avg) 136.000 1.49%
483.xalancbmk (avg) (percentage) 3.570 -
483.xalancbmk (max) 121.000 -3.20%
483.xalancbmk (max) (percentage) 3.180 -4.22%
Geometric Mean 9.332 22.39%