Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6693696a7dac44f2f80e89d2d0c4bebfb4543b59 (+ 32 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (af73228fdb2e61c6354f972987ba2a746c3519f7) (+ 25 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=3fd2ff7685e3ee85c8cd2896f28ad62f67d7c483 (+ 12 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9c1d44dcc377f4dab42cd34fbbcff8be86bdaa4e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/372/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0372 (3-changed-components) 2025-02-17T18:34:22 0:00:00
Previous 0371 (4-changed-components) 2025-02-10T00:39:42 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 59 11
Performance Improvements 47 178
Added Tests 22 0
Unchanged Tests 1108 1047
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 11.64% 1839.000 2053.000 - 44.17% -
401.bzip2 6.13% 2853.000 3028.000 - 2.96% -
450.soplex 5.89% 543.000 575.000 - 1.41% -
473.astar 5.30% 4948.000 5210.000 - 1.60% -
482.sphinx3 3.93% 814.000 846.000 - -10.48% -
459.GemsFDTD 3.38% 4669.000 4827.000 - -21.80% -
465.tonto 2.81% 10686.000 10986.000 - 0.41% -
437.leslie3d 2.74% 10733.000 11027.000 - -5.27% -
435.gromacs 2.19% 7070.000 7225.000 - -0.61% -
470.lbm 2.17% 3737.000 3818.000 - 0.79% -
433.milc 2.14% 1121.000 1145.000 - -0.52% -
434.zeusmp 1.69% 2302.000 2341.000 - -6.88% -
462.libquantum 1.55% 129.000 131.000 - -6.43% -
471.omnetpp 1.52% 2638.000 2678.000 - -1.69% -
447.dealII 1.24% 1615.000 1635.000 - -5.16% -
445.gobmk 1.14% 4840.000 4895.000 - -2.55% -
444.namd 1.10% 728.000 736.000 - -1.47% -
458.sjeng 1.03% 7397.000 7473.000 - -1.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (max) 262.35% 85.000 308.000 - -85.42% -
465.tonto (max) (percentage) 251.25% 0.800 2.810 - -85.45% -
429.mcf (max) 33.71% 178.000 238.000 - -82.00% -
429.mcf (max) (percentage) 20.25% 9.680 11.640 - -87.47% -
429.mcf 14.46% 83.000 95.000 - -12.84% -
429.mcf (avg) 14.46% 83.000 95.000 - -12.84% -
401.bzip2 8.70% 46.000 50.000 - -68.94% -
401.bzip2 (avg) 8.70% 46.000 50.000 - -68.94% -
429.mcf (unexplained diff vs previous) 8.63% 197.000 214.000 - -98.85% -
450.soplex 7.69% 13.000 14.000 - -61.11% -
450.soplex (avg) 7.69% 13.000 14.000 - -61.11% -
473.astar 7.32% 82.000 88.000 - -58.69% -
473.astar (avg) 7.32% 82.000 88.000 - -58.69% -
482.sphinx3 7.14% 14.000 15.000 - -79.73% -
482.sphinx3 (avg) 7.14% 14.000 15.000 - -79.73% -
459.GemsFDTD 4.92% 61.000 64.000 - -82.22% -
459.GemsFDTD (avg) 4.92% 61.000 64.000 - -82.22% -
458.sjeng 4.76% 42.000 44.000 - -81.74% -
458.sjeng (avg) 4.76% 42.000 44.000 - -81.74% -
465.tonto 4.51% 133.000 139.000 - -61.92% -
465.tonto (avg) 4.51% 133.000 139.000 - -61.92% -
470.lbm 3.33% 30.000 31.000 - -87.03% -
470.lbm (avg) 3.33% 30.000 31.000 - -87.03% -
435.gromacs 2.61% 115.000 118.000 - -67.85% -
435.gromacs (avg) 2.61% 115.000 118.000 - -67.85% -
401.bzip2 (avg) (percentage) 2.44% 1.640 1.680 - -69.34% -
473.astar (avg) (percentage) 2.41% 1.660 1.700 - -59.13% -
437.leslie3d 2.20% 455.000 465.000 - 30.99% -
437.leslie3d (avg) 2.20% 455.000 465.000 - 30.99% -
410.bwaves 2.13% 47.000 48.000 - -80.72% -
410.bwaves (avg) 2.13% 47.000 48.000 - -80.72% -
458.sjeng (avg) (percentage) 1.72% 0.580 0.590 - -81.50% -
465.tonto (avg) (percentage) 1.60% 1.250 1.270 - -61.98% -
450.soplex (avg) (percentage) 1.58% 2.530 2.570 - -60.03% -
450.soplex (max) 1.56% 64.000 65.000 - -88.07% -
429.mcf (avg) (percentage) 1.54% 4.560 4.630 - -39.63% -
459.GemsFDTD (avg) (percentage) 1.52% 1.320 1.340 - -77.05% -
470.lbm (avg) (percentage) 1.22% 0.820 0.830 - -86.89% -
401.bzip2 (max) 1.17% 257.000 260.000 - -88.76% -
434.zeusmp (avg) (percentage) 1.14% 0.880 0.890 - -84.79% -
482.sphinx3 (avg) (percentage) 1.09% 1.830 1.850 - -76.67% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -78.08% 6.980 1.530 - -99.98% -
462.libquantum (unexplained diff vs previous) -77.78% 9.000 2.000 - -99.99% -
444.namd (max) -75.00% 32.000 8.000 - -98.83% -
444.namd (max) (percentage) -75.00% 4.400 1.100 - -98.80% -
471.omnetpp (unexplained diff vs previous) (percentage) -73.95% 5.720 1.490 - -99.62% -
471.omnetpp (unexplained diff vs previous) -73.51% 151.000 40.000 - -99.62% -
433.milc (unexplained diff vs previous) (percentage) -69.43% 6.870 2.100 - -99.79% -
433.milc (unexplained diff vs previous) -68.83% 77.000 24.000 - -99.79% -
482.sphinx3 (max) (percentage) -58.10% 9.380 3.930 - -95.93% -
482.sphinx3 (max) -56.58% 76.000 33.000 - -96.38% -
445.gobmk (max) (percentage) -46.01% 2.760 1.490 - -97.17% -
445.gobmk (max) -45.86% 133.000 72.000 - -97.28% -
458.sjeng (unexplained diff vs previous) (percentage) -43.65% 1.810 1.020 - -98.88% -
458.sjeng (unexplained diff vs previous) -43.28% 134.000 76.000 - -98.89% -
471.omnetpp (max) (percentage) -24.71% 5.990 4.510 - -94.34% -
471.omnetpp (max) -24.05% 158.000 120.000 - -94.47% -
462.libquantum (max) -22.22% 9.000 7.000 - -94.93% -
462.libquantum (max) (percentage) -22.21% 6.980 5.430 - -94.51% -
470.lbm (unexplained diff vs previous) (percentage) -21.48% 2.700 2.120 - -99.20% -
470.lbm (unexplained diff vs previous) -19.80% 101.000 81.000 - -99.19% -
458.sjeng (max) (percentage) -16.85% 1.780 1.480 - -96.89% -
470.lbm (max) (percentage) -16.73% 2.630 2.190 - -96.98% -
433.milc (max) (percentage) -16.64% 6.430 5.360 - -94.09% -
458.sjeng (max) -16.03% 131.000 110.000 - -96.95% -
470.lbm (max) -15.31% 98.000 83.000 - -96.98% -
433.milc (max) -15.28% 72.000 61.000 - -94.16% -
473.astar (unexplained diff vs previous) (percentage) -15.03% 5.920 5.030 - -97.46% -
434.zeusmp (unexplained diff vs previous) (percentage) -12.57% 1.910 1.670 - -99.63% -
434.zeusmp (unexplained diff vs previous) -11.36% 44.000 39.000 - -99.65% -
473.astar (unexplained diff vs previous) -10.58% 293.000 262.000 - -97.42% -
434.zeusmp (max) (percentage) -10.11% 1.880 1.690 - -97.93% -
434.zeusmp (max) -9.30% 43.000 39.000 - -98.10% -
447.dealII (max) (percentage) -8.45% 2.960 2.710 - -96.62% -
447.dealII (max) -6.38% 47.000 44.000 - -96.82% -
435.gromacs (max) (percentage) -5.29% 2.080 1.970 - -95.99% -
473.astar (max) (percentage) -5.19% 5.590 5.300 - -92.02% -
450.soplex (max) (percentage) -4.77% 11.950 11.380 - -88.18% -
401.bzip2 (max) (percentage) -4.77% 9.020 8.590 - -89.08% -
410.bwaves (max) (percentage) -4.42% 2.490 2.380 - -95.89% -
459.GemsFDTD (max) (percentage) -4.35% 4.600 4.400 - -93.84% -
453.povray (max) (percentage) -4.08% 4.660 4.470 - -95.10% -
453.povray (max) -4.00% 25.000 24.000 - -95.19% -
410.bwaves (max) -3.55% 141.000 136.000 - -95.85% -
435.gromacs (max) -3.40% 147.000 142.000 - -96.03% -
429.mcf (unexplained diff vs previous) (percentage) -2.71% 10.710 10.420 - -99.20% -
437.leslie3d (max) (percentage) -2.17% 3.690 3.610 - -78.23% -
453.povray (avg) (percentage) -1.21% 1.650 1.630 - -79.13% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.40% 16760.000 17832.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 44.17% 1424.000 2053.000 - 11.64% -
401.bzip2 2.96% 2941.000 3028.000 - 6.13% -
473.astar 1.60% 5128.000 5210.000 - 5.30% -
410.bwaves 1.47% 5652.000 5735.000 - 0.93% -
450.soplex 1.41% 567.000 575.000 - 5.89% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 38.36% 3.050 4.220 - -0.47% -
437.leslie3d 30.99% 355.000 465.000 - 2.20% -
437.leslie3d (avg) 30.99% 355.000 465.000 - 2.20% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.69% 59479.000 54310.000 - 0.00% -
459.GemsFDTD -4.85% 244728.000 232852.000 - 0.00% -
447.dealII -2.15% 311591.000 304898.000 - 0.00% -
462.libquantum -1.89% 16085.000 15781.000 - 0.00% -
434.zeusmp -1.82% 152037.000 149263.000 - 0.00% -
435.gromacs -1.76% 499261.000 490450.000 - 0.00% -
433.milc -1.53% 61382.000 60440.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
453.povray -1.26% 661389.000 653088.000 - 0.00% -
444.namd -1.24% 188385.000 186052.000 - 0.00% -
401.bzip2 -1.13% 44233.000 43735.000 - 0.00% -
473.astar -1.04% 22968.000 22728.000 - 0.00% -
482.sphinx3 -1.03% 112859.000 111702.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.80% 6173.000 4827.000 - 3.38% -
482.sphinx3 -10.48% 945.000 846.000 - 3.93% -
434.zeusmp -6.88% 2514.000 2341.000 - 1.69% -
462.libquantum -6.43% 140.000 131.000 - 1.55% -
437.leslie3d -5.27% 11640.000 11027.000 - 2.74% -
447.dealII -5.16% 1724.000 1635.000 - 1.24% -
445.gobmk -2.55% 5023.000 4895.000 - 1.14% -
471.omnetpp -1.69% 2724.000 2678.000 - 1.52% -
444.namd -1.47% 747.000 736.000 - 1.10% -
453.povray -1.28% 547.000 540.000 - 0.19% -
458.sjeng -1.24% 7567.000 7473.000 - 1.03% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - -77.78% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.530 - -78.08% -
453.povray (unexplained diff vs previous) -99.98% 5707.000 1.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.98% 1043.330 0.190 - 0.00% -
444.namd (unexplained diff vs previous) -99.90% 8356.000 8.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.90% 1118.610 1.090 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.88% 26073.000 32.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.86% 2759.050 3.780 - 0.00% -
433.milc (unexplained diff vs previous) -99.79% 11289.000 24.000 - -68.83% -
433.milc (unexplained diff vs previous) (percentage) -99.79% 980.800 2.100 - -69.43% -
450.soplex (unexplained diff vs previous) (percentage) -99.78% 2557.320 5.570 - 0.00% -
450.soplex (unexplained diff vs previous) -99.78% 14500.000 32.000 - 0.00% -
447.dealII (unexplained diff vs previous) -99.71% 7017.000 20.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.70% 407.020 1.220 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.65% 11280.000 39.000 - -11.36% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.63% 448.690 1.670 - -12.57% -
471.omnetpp (unexplained diff vs previous) -99.62% 10659.000 40.000 - -73.51% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.62% 391.300 1.490 - -73.95% -
456.hmmer (max) (percentage) -99.54% 73.590 0.340 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.33% 137.900 0.920 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.32% 7794.000 53.000 - 0.00% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.20% 1305.690 10.420 - -2.71% -
470.lbm (unexplained diff vs previous) (percentage) -99.20% 263.730 2.120 - -21.48% -
470.lbm (unexplained diff vs previous) -99.19% 9990.000 81.000 - -19.80% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.03% 88.730 0.860 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.01% 5581.000 55.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.99% 111.110 1.120 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -98.98% 15458.000 158.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -98.89% 6876.000 76.000 - -43.28% -
458.sjeng (unexplained diff vs previous) (percentage) -98.88% 90.870 1.020 - -43.65% -
481.wrf (max) (percentage) -98.85% 68.700 0.790 - 0.00% -
429.mcf (unexplained diff vs previous) -98.85% 18593.000 214.000 - 8.63% -
444.namd (max) -98.83% 685.000 8.000 - -75.00% -
444.namd (max) (percentage) -98.80% 91.790 1.100 - -75.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.69% 250.410 3.270 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.43% 368.340 5.780 - 0.00% -
401.bzip2 (unexplained diff vs previous) -98.38% 10833.000 175.000 - 0.00% -
434.zeusmp (max) -98.10% 2055.000 39.000 - -9.30% -
434.zeusmp (max) (percentage) -97.93% 81.770 1.690 - -10.11% -
400.perlbench (max) (percentage) -97.50% 84.060 2.100 - -0.47% -
473.astar (unexplained diff vs previous) (percentage) -97.46% 197.850 5.030 - -15.03% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
473.astar (unexplained diff vs previous) -97.42% 10146.000 262.000 - -10.58% -
445.gobmk (max) -97.28% 2643.000 72.000 - -45.86% -
445.gobmk (max) (percentage) -97.17% 52.630 1.490 - -46.01% -
470.lbm (max) (percentage) -96.98% 72.510 2.190 - -16.73% -
470.lbm (max) -96.98% 2746.000 83.000 - -15.31% -
458.sjeng (max) -96.95% 3602.000 110.000 - -16.03% -
458.sjeng (max) (percentage) -96.89% 47.610 1.480 - -16.85% -
447.dealII (max) -96.82% 1384.000 44.000 - -6.38% -
447.dealII (max) (percentage) -96.62% 80.280 2.710 - -8.45% -
482.sphinx3 (max) -96.38% 911.000 33.000 - -56.58% -
403.gcc (max) (percentage) -96.28% 99.360 3.700 - 0.00% -
435.gromacs (max) -96.03% 3573.000 142.000 - -3.40% -
435.gromacs (max) (percentage) -95.99% 49.160 1.970 - -5.29% -
482.sphinx3 (max) (percentage) -95.93% 96.500 3.930 - -58.10% -
410.bwaves (max) (percentage) -95.89% 57.970 2.380 - -4.42% -
410.bwaves (max) -95.85% 3276.000 136.000 - -3.55% -
459.GemsFDTD (max) -95.19% 4411.000 212.000 - -0.93% -
453.povray (max) -95.19% 499.000 24.000 - -4.00% -
453.povray (max) (percentage) -95.10% 91.250 4.470 - -4.08% -
462.libquantum (max) -94.93% 138.000 7.000 - -22.22% -
462.libquantum (max) (percentage) -94.51% 98.970 5.430 - -22.21% -
471.omnetpp (max) -94.47% 2169.000 120.000 - -24.05% -
471.omnetpp (max) (percentage) -94.34% 79.650 4.510 - -24.71% -
433.milc (max) -94.16% 1044.000 61.000 - -15.28% -
433.milc (max) (percentage) -94.09% 90.750 5.360 - -16.64% -
459.GemsFDTD (max) (percentage) -93.84% 71.460 4.400 - -4.35% -
473.astar (max) (percentage) -92.02% 66.430 5.300 - -5.19% -
473.astar (max) -91.90% 3406.000 276.000 - 0.00% -
401.bzip2 (max) (percentage) -89.08% 78.650 8.590 - -4.77% -
401.bzip2 (max) -88.76% 2313.000 260.000 - 1.17% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
450.soplex (max) (percentage) -88.18% 96.240 11.380 - -4.77% -
450.soplex (max) -88.07% 545.000 65.000 - 1.56% -
429.mcf (max) (percentage) -87.47% 92.890 11.640 - 20.25% -
444.namd (avg) (percentage) -87.42% 9.220 1.160 - 0.00% -
437.leslie3d (unexplained diff vs previous) -87.29% 2314.000 294.000 - 0.00% -
470.lbm -87.03% 239.000 31.000 - 3.33% -
470.lbm (avg) -87.03% 239.000 31.000 - 3.33% -
470.lbm (avg) (percentage) -86.89% 6.330 0.830 - 1.22% -
437.leslie3d (unexplained diff vs previous) (percentage) -86.57% 19.880 2.670 - 0.00% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
465.tonto (max) (percentage) -85.45% 19.310 2.810 - 251.25% -
465.tonto (max) -85.42% 2112.000 308.000 - 262.35% -
434.zeusmp (avg) (percentage) -84.79% 5.850 0.890 - 1.14% -
465.tonto (unexplained diff vs previous) (percentage) -83.14% 16.190 2.730 - 0.00% -
465.tonto (unexplained diff vs previous) -83.06% 1771.000 300.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
459.GemsFDTD -82.22% 360.000 64.000 - 4.92% -
459.GemsFDTD (avg) -82.22% 360.000 64.000 - 4.92% -
429.mcf (max) -82.00% 1322.000 238.000 - 33.71% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
458.sjeng -81.74% 241.000 44.000 - 4.76% -
458.sjeng (avg) -81.74% 241.000 44.000 - 4.76% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 1.72% -
410.bwaves (avg) (percentage) -80.95% 4.410 0.840 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
410.bwaves -80.72% 249.000 48.000 - 2.13% -
410.bwaves (avg) -80.72% 249.000 48.000 - 2.13% -
447.dealII (avg) (percentage) -80.07% 5.770 1.150 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 7.14% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 7.14% -
437.leslie3d (max) -79.37% 1929.000 398.000 - 0.51% -
453.povray (avg) (percentage) -79.13% 7.810 1.630 - -1.21% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
437.leslie3d (max) (percentage) -78.23% 16.580 3.610 - -2.17% -
445.gobmk -78.06% 196.000 43.000 - 0.00% -
445.gobmk (avg) -78.06% 196.000 43.000 - 0.00% -
433.milc (avg) (percentage) -77.85% 6.050 1.340 - 0.00% -
445.gobmk (avg) (percentage) -77.24% 3.910 0.890 - 0.00% -
459.GemsFDTD (avg) (percentage) -77.05% 5.840 1.340 - 1.52% -
482.sphinx3 (avg) (percentage) -76.67% 7.930 1.850 - 1.09% -
471.omnetpp -75.34% 223.000 55.000 - 0.00% -
471.omnetpp (avg) -75.34% 223.000 55.000 - 0.00% -
471.omnetpp (avg) (percentage) -74.51% 8.200 2.090 - -0.48% -
462.libquantum (avg) (percentage) -74.41% 7.660 1.960 - -0.51% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
401.bzip2 (avg) (percentage) -69.34% 5.480 1.680 - 2.44% -
401.bzip2 -68.94% 161.000 50.000 - 8.70% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 8.70% -
435.gromacs -67.85% 367.000 118.000 - 2.61% -
435.gromacs (avg) -67.85% 367.000 118.000 - 2.61% -
435.gromacs (avg) (percentage) -67.59% 5.060 1.640 - 0.00% -
465.tonto (avg) (percentage) -61.98% 3.340 1.270 - 1.60% -
465.tonto -61.92% 365.000 139.000 - 4.51% -
465.tonto (avg) -61.92% 365.000 139.000 - 4.51% -
450.soplex -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) (percentage) -60.03% 6.430 2.570 - 1.58% -
473.astar (avg) (percentage) -59.13% 4.160 1.700 - 2.41% -
473.astar -58.69% 213.000 88.000 - 7.32% -
473.astar (avg) -58.69% 213.000 88.000 - 7.32% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -39.63% 7.670 4.630 - 1.54% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -12.84% 109.000 95.000 - 14.46% -
429.mcf (avg) -12.84% 109.000 95.000 - 14.46% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -


Report Time: 0.38s
Name Current %
401.bzip2 3028.000 6.13%
410.bwaves 5735.000 -
429.mcf 2053.000 11.64%
433.milc 1145.000 2.14%
434.zeusmp 2341.000 1.69%
435.gromacs 7225.000 2.19%
437.leslie3d 11027.000 2.74%
444.namd 736.000 1.10%
445.gobmk 4895.000 1.14%
447.dealII 1635.000 1.24%
450.soplex 575.000 5.89%
453.povray 540.000 -
458.sjeng 7473.000 1.03%
459.GemsFDTD 4827.000 3.38%
462.libquantum 131.000 1.55%
465.tonto 10986.000 2.81%
470.lbm 3818.000 2.17%
471.omnetpp 2678.000 1.52%
473.astar 5210.000 5.30%
482.sphinx3 846.000 3.93%
Geometric Mean 2374.906 2.90%
Name Current %
401.bzip2 43735.000 -
410.bwaves 17832.000 -
429.mcf 9086.000 -
433.milc 60440.000 -
434.zeusmp 149263.000 -
435.gromacs 490450.000 -
437.leslie3d 54310.000 -
444.namd 186052.000 -
445.gobmk 1374806.000 -
447.dealII 304898.000 -
450.soplex 203251.000 -
453.povray 653088.000 -
458.sjeng 103327.000 -
459.GemsFDTD 232852.000 -
462.libquantum 15781.000 -
465.tonto 1964847.000 -
470.lbm 9547.000 -
471.omnetpp 475129.000 -
473.astar 22728.000 -
482.sphinx3 111702.000 -
Geometric Mean 114554.532 -
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.100 -
401.bzip2 50.000 8.70%
401.bzip2 (avg) 50.000 8.70%
401.bzip2 (avg) (percentage) 1.680 2.44%
401.bzip2 (max) 260.000 1.17%
401.bzip2 (max) (percentage) 8.590 -4.77%
401.bzip2 (unexplained diff vs previous) 175.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 5.780 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.700 -
410.bwaves 48.000 2.13%
410.bwaves (avg) 48.000 2.13%
410.bwaves (avg) (percentage) 0.840 -
410.bwaves (max) 136.000 -3.55%
410.bwaves (max) (percentage) 2.380 -4.42%
410.bwaves (unexplained diff vs previous) 53.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.920 -
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 95.000 14.46%
429.mcf (avg) 95.000 14.46%
429.mcf (avg) (percentage) 4.630 1.54%
429.mcf (max) 238.000 33.71%
429.mcf (max) (percentage) 11.640 20.25%
429.mcf (unexplained diff vs previous) 214.000 8.63%
429.mcf (unexplained diff vs previous) (percentage) 10.420 -2.71%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.340 -
433.milc (max) 61.000 -15.28%
433.milc (max) (percentage) 5.360 -16.64%
433.milc (unexplained diff vs previous) 24.000 -68.83%
433.milc (unexplained diff vs previous) (percentage) 2.100 -69.43%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.890 1.14%
434.zeusmp (max) 39.000 -9.30%
434.zeusmp (max) (percentage) 1.690 -10.11%
434.zeusmp (unexplained diff vs previous) 39.000 -11.36%
434.zeusmp (unexplained diff vs previous) (percentage) 1.670 -12.57%
435.gromacs 118.000 2.61%
435.gromacs (avg) 118.000 2.61%
435.gromacs (avg) (percentage) 1.640 -
435.gromacs (max) 142.000 -3.40%
435.gromacs (max) (percentage) 1.970 -5.29%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.860 -
437.leslie3d 465.000 2.20%
437.leslie3d (avg) 465.000 2.20%
437.leslie3d (avg) (percentage) 4.220 -
437.leslie3d (max) 398.000 -
437.leslie3d (max) (percentage) 3.610 -2.17%
437.leslie3d (unexplained diff vs previous) 294.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.670 -
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.160 -
444.namd (max) 8.000 -75.00%
444.namd (max) (percentage) 1.100 -75.00%
444.namd (unexplained diff vs previous) 8.000 -
444.namd (unexplained diff vs previous) (percentage) 1.090 -
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.890 -
445.gobmk (max) 72.000 -45.86%
445.gobmk (max) (percentage) 1.490 -46.01%
445.gobmk (unexplained diff vs previous) 55.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.120 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.150 -
447.dealII (max) 44.000 -6.38%
447.dealII (max) (percentage) 2.710 -8.45%
447.dealII (unexplained diff vs previous) 20.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.220 -
450.soplex 14.000 7.69%
450.soplex (avg) 14.000 7.69%
450.soplex (avg) (percentage) 2.570 1.58%
450.soplex (max) 65.000 1.56%
450.soplex (max) (percentage) 11.380 -4.77%
450.soplex (unexplained diff vs previous) 32.000 -
450.soplex (unexplained diff vs previous) (percentage) 5.570 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.630 -1.21%
453.povray (max) 24.000 -4.00%
453.povray (max) (percentage) 4.470 -4.08%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.190 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.340 -
458.sjeng 44.000 4.76%
458.sjeng (avg) 44.000 4.76%
458.sjeng (avg) (percentage) 0.590 1.72%
458.sjeng (max) 110.000 -16.03%
458.sjeng (max) (percentage) 1.480 -16.85%
458.sjeng (unexplained diff vs previous) 76.000 -43.28%
458.sjeng (unexplained diff vs previous) (percentage) 1.020 -43.65%
459.GemsFDTD 64.000 4.92%
459.GemsFDTD (avg) 64.000 4.92%
459.GemsFDTD (avg) (percentage) 1.340 1.52%
459.GemsFDTD (max) 212.000 -
459.GemsFDTD (max) (percentage) 4.400 -4.35%
459.GemsFDTD (unexplained diff vs previous) 158.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.270 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.960 -
462.libquantum (max) 7.000 -22.22%
462.libquantum (max) (percentage) 5.430 -22.21%
462.libquantum (unexplained diff vs previous) 2.000 -77.78%
462.libquantum (unexplained diff vs previous) (percentage) 1.530 -78.08%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 139.000 4.51%
465.tonto (avg) 139.000 4.51%
465.tonto (avg) (percentage) 1.270 1.60%
465.tonto (max) 308.000 262.35%
465.tonto (max) (percentage) 2.810 251.25%
465.tonto (unexplained diff vs previous) 300.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.730 -
470.lbm 31.000 3.33%
470.lbm (avg) 31.000 3.33%
470.lbm (avg) (percentage) 0.830 1.22%
470.lbm (max) 83.000 -15.31%
470.lbm (max) (percentage) 2.190 -16.73%
470.lbm (unexplained diff vs previous) 81.000 -19.80%
470.lbm (unexplained diff vs previous) (percentage) 2.120 -21.48%
471.omnetpp 55.000 -
471.omnetpp (avg) 55.000 -
471.omnetpp (avg) (percentage) 2.090 -
471.omnetpp (max) 120.000 -24.05%
471.omnetpp (max) (percentage) 4.510 -24.71%
471.omnetpp (unexplained diff vs previous) 40.000 -73.51%
471.omnetpp (unexplained diff vs previous) (percentage) 1.490 -73.95%
473.astar 88.000 7.32%
473.astar (avg) 88.000 7.32%
473.astar (avg) (percentage) 1.700 2.41%
473.astar (max) 276.000 -
473.astar (max) (percentage) 5.300 -5.19%
473.astar (unexplained diff vs previous) 262.000 -10.58%
473.astar (unexplained diff vs previous) (percentage) 5.030 -15.03%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.790 -
482.sphinx3 15.000 7.14%
482.sphinx3 (avg) 15.000 7.14%
482.sphinx3 (avg) (percentage) 1.850 1.09%
482.sphinx3 (max) 33.000 -56.58%
482.sphinx3 (max) (percentage) 3.930 -58.10%
482.sphinx3 (unexplained diff vs previous) 32.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 3.780 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.503 -10.97%