Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7659033deeb4f2ae47f4b6d9ad1a45b2d314ed26 (+ 45 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (99aa410f5e0a722822698e765ca165e73ca4f637) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b4495bd40578b455668887b9170059bb0d3c0dc5 (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (+ 312 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/408/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0408 (3-changed-components) 2025-05-02T12:20:54 0:00:00
Previous 0401 (basepoints/gcc-16-00189-g99aa410f5e0) 2025-04-28T00:41:16 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 91 11
Performance Improvements 23 181
Added Tests 20 0
Unchanged Tests 1102 1044
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 9.68% 1839.000 2017.000 - 41.64% -
401.bzip2 7.77% 2894.000 3119.000 - 6.05% -
450.soplex 7.51% 546.000 587.000 - 3.53% -
435.gromacs 4.83% 7117.000 7461.000 - 2.64% -
473.astar 4.53% 4927.000 5150.000 - 0.43% -
471.omnetpp 4.15% 2600.000 2708.000 - -0.59% -
459.GemsFDTD 3.98% 4678.000 4864.000 - -21.21% -
453.povray 3.44% 523.000 541.000 - -1.10% -
465.tonto 3.29% 10579.000 10927.000 - -0.13% -
482.sphinx3 2.60% 809.000 830.000 - -12.17% -
470.lbm 2.09% 3741.000 3819.000 - 0.82% -
433.milc 1.86% 1129.000 1150.000 - -0.09% -
444.namd 1.81% 720.000 733.000 - -1.87% -
434.zeusmp 1.60% 2308.000 2345.000 - -6.72% -
410.bwaves 1.46% 5668.000 5751.000 - 1.75% -
445.gobmk 1.43% 4822.000 4891.000 - -2.63% -
458.sjeng 1.02% 7351.000 7426.000 - -1.86% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) 572.22% 36.000 242.000 - -89.54% -
401.bzip2 (max) (percentage) 521.60% 1.250 7.770 - -90.12% -
445.gobmk (max) 360.00% 15.000 69.000 - -97.39% -
445.gobmk (max) (percentage) 346.87% 0.320 1.430 - -97.28% -
465.tonto (max) 322.35% 85.000 359.000 - -83.00% -
465.tonto (max) (percentage) 306.17% 0.810 3.290 - -82.96% -
450.soplex (max) 266.67% 12.000 44.000 - -91.93% -
435.gromacs (max) 249.51% 103.000 360.000 - -89.92% -
434.zeusmp (max) 236.36% 11.000 37.000 - -98.20% -
434.zeusmp (max) (percentage) 233.33% 0.480 1.600 - -98.04% -
450.soplex (max) (percentage) 230.84% 2.270 7.510 - -92.20% -
435.gromacs (max) (percentage) 230.82% 1.460 4.830 - -90.17% -
453.povray (max) 200.00% 6.000 18.000 - -96.39% -
453.povray (max) (percentage) 175.20% 1.250 3.440 - -96.23% -
459.GemsFDTD (max) 101.04% 96.000 193.000 - -95.62% -
459.GemsFDTD (max) (percentage) 93.20% 2.060 3.980 - -94.43% -
447.dealII (max) 60.00% 10.000 16.000 - -98.84% -
447.dealII (max) (percentage) 50.00% 0.660 0.990 - -98.77% -
444.namd (max) 44.44% 9.000 13.000 - -98.10% -
444.namd (unexplained diff vs previous) 44.44% 9.000 13.000 - -99.84% -
444.namd (unexplained diff vs previous) (percentage) 41.60% 1.250 1.770 - -99.84% -
437.leslie3d (unexplained diff vs previous) (percentage) 35.63% 9.010 12.220 - -38.53% -
444.namd (max) (percentage) 32.12% 1.370 1.810 - -98.03% -
482.sphinx3 (unexplained diff vs previous) 23.53% 17.000 21.000 - -99.92% -
437.leslie3d (unexplained diff vs previous) 20.93% 1113.000 1346.000 - -41.83% -
482.sphinx3 (unexplained diff vs previous) (percentage) 20.48% 2.100 2.530 - -99.91% -
470.lbm (max) 17.91% 67.000 79.000 - -97.12% -
470.lbm (max) (percentage) 15.47% 1.810 2.090 - -97.12% -
470.lbm (unexplained diff vs previous) 13.04% 69.000 78.000 - -99.22% -
429.mcf 11.39% 79.000 88.000 - -19.27% -
429.mcf (avg) 11.39% 79.000 88.000 - -19.27% -
401.bzip2 10.87% 46.000 51.000 - -68.32% -
401.bzip2 (avg) 10.87% 46.000 51.000 - -68.32% -
470.lbm (unexplained diff vs previous) (percentage) 10.87% 1.840 2.040 - -99.23% -
433.milc (max) 10.53% 19.000 21.000 - -97.99% -
437.leslie3d (max) (percentage) 10.00% 9.900 10.890 - -34.32% -
450.soplex 7.69% 13.000 14.000 - -61.11% -
450.soplex (avg) 7.69% 13.000 14.000 - -61.11% -
435.gromacs 7.21% 111.000 119.000 - -67.57% -
435.gromacs (avg) 7.21% 111.000 119.000 - -67.57% -
433.milc 7.14% 14.000 15.000 - -78.26% -
433.milc (avg) 7.14% 14.000 15.000 - -78.26% -
471.omnetpp (unexplained diff vs previous) 6.93% 101.000 108.000 - -98.99% -
433.milc (max) (percentage) 6.90% 1.740 1.860 - -97.95% -
459.GemsFDTD 6.90% 58.000 62.000 - -82.78% -
459.GemsFDTD (avg) 6.90% 58.000 62.000 - -82.78% -
473.astar 6.33% 79.000 84.000 - -60.56% -
473.astar (avg) 6.33% 79.000 84.000 - -60.56% -
465.tonto 5.79% 121.000 128.000 - -64.93% -
465.tonto (avg) 5.79% 121.000 128.000 - -64.93% -
433.milc (unexplained diff vs previous) 5.00% 20.000 21.000 - -99.81% -
482.sphinx3 (max) 4.35% 23.000 24.000 - -97.37% -
401.bzip2 (avg) (percentage) 3.75% 1.600 1.660 - -69.71% -
471.omnetpp 3.70% 54.000 56.000 - -74.89% -
471.omnetpp (avg) 3.70% 54.000 56.000 - -74.89% -
470.lbm 3.45% 29.000 30.000 - -87.45% -
470.lbm (avg) 3.45% 29.000 30.000 - -87.45% -
433.milc (unexplained diff vs previous) (percentage) 3.39% 1.770 1.830 - -99.81% -
471.omnetpp (unexplained diff vs previous) (percentage) 2.84% 3.880 3.990 - -98.98% -
465.tonto (avg) (percentage) 2.61% 1.150 1.180 - -64.67% -
435.gromacs (avg) (percentage) 2.56% 1.560 1.600 - -68.38% -
450.soplex (avg) (percentage) 2.43% 2.470 2.530 - -60.65% -
459.GemsFDTD (avg) (percentage) 2.38% 1.260 1.290 - -77.91% -
458.sjeng 2.38% 42.000 43.000 - -82.16% -
458.sjeng (avg) 2.38% 42.000 43.000 - -82.16% -
410.bwaves 2.13% 47.000 48.000 - -80.72% -
410.bwaves (avg) 2.13% 47.000 48.000 - -80.72% -
453.povray (avg) (percentage) 1.89% 1.590 1.620 - -79.26% -
458.sjeng (avg) (percentage) 1.72% 0.580 0.590 - -81.50% -
437.leslie3d (avg) (percentage) 1.47% 4.090 4.150 - 36.07% -
470.lbm (avg) (percentage) 1.25% 0.800 0.810 - -87.20% -
473.astar (avg) (percentage) 1.23% 1.620 1.640 - -60.58% -
410.bwaves (avg) (percentage) 1.20% 0.830 0.840 - -80.95% -
429.mcf (avg) (percentage) 1.15% 4.340 4.390 - -42.76% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -10.89% 12358.000 11012.000 - -5.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) -66.67% 3.000 1.000 - -99.28% -
462.libquantum (max) (percentage) -61.33% 2.560 0.990 - -99.00% -
410.bwaves (unexplained diff vs previous) (percentage) -52.48% 3.030 1.440 - -98.96% -
410.bwaves (unexplained diff vs previous) -51.74% 172.000 83.000 - -98.94% -
429.mcf (unexplained diff vs previous) (percentage) -35.38% 13.650 8.820 - -99.32% -
429.mcf (unexplained diff vs previous) -29.08% 251.000 178.000 - -99.04% -
410.bwaves (max) (percentage) -16.61% 2.950 2.460 - -95.76% -
473.astar (unexplained diff vs previous) (percentage) -15.59% 5.130 4.330 - -97.81% -
410.bwaves (max) -15.57% 167.000 141.000 - -95.70% -
458.sjeng (unexplained diff vs previous) (percentage) -14.41% 1.180 1.010 - -98.89% -
458.sjeng (unexplained diff vs previous) -13.79% 87.000 75.000 - -98.91% -
473.astar (unexplained diff vs previous) -11.86% 253.000 223.000 - -97.80% -
429.mcf (max) (percentage) -9.99% 12.010 10.810 - -88.36% -
437.leslie3d -9.70% 505.000 456.000 - 28.45% -
437.leslie3d (avg) -9.70% 505.000 456.000 - 28.45% -
473.astar (max) (percentage) -7.17% 4.880 4.530 - -93.18% -
458.sjeng (max) (percentage) -5.98% 1.170 1.100 - -97.69% -
458.sjeng (max) -5.81% 86.000 81.000 - -97.75% -
471.omnetpp (max) (percentage) -4.71% 5.100 4.860 - -93.90% -
473.astar (max) -2.92% 240.000 233.000 - -93.16% -
437.leslie3d (max) -1.96% 1223.000 1199.000 - -37.84% -
482.sphinx3 (max) (percentage) -1.02% 2.940 2.910 - -96.98% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.42% 16760.000 17836.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 41.64% 1424.000 2017.000 - 9.68% -
401.bzip2 6.05% 2941.000 3119.000 - 7.77% -
450.soplex 3.53% 567.000 587.000 - 7.51% -
435.gromacs 2.64% 7269.000 7461.000 - 4.83% -
410.bwaves 1.75% 5652.000 5751.000 - 1.46% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 36.07% 3.050 4.150 - 1.47% -
437.leslie3d 28.45% 355.000 456.000 - -9.70% -
437.leslie3d (avg) 28.45% 355.000 456.000 - -9.70% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.59% 59479.000 54370.000 - 0.00% -
459.GemsFDTD -5.11% 244728.000 232214.000 - 0.00% -
444.namd -3.60% 188385.000 181600.000 - 0.00% -
447.dealII -2.70% 311591.000 303176.000 - 0.00% -
462.libquantum -1.94% 16085.000 15773.000 - 0.00% -
435.gromacs -1.91% 499261.000 489734.000 - 0.00% -
470.lbm -1.82% 9691.000 9515.000 - 0.00% -
434.zeusmp -1.79% 152037.000 149323.000 - 0.00% -
433.milc -1.71% 61382.000 60332.000 - 0.00% -
453.povray -1.46% 661389.000 651756.000 - 0.00% -
473.astar -1.41% 22968.000 22644.000 - 0.00% -
482.sphinx3 -1.32% 112859.000 111374.000 - 0.00% -
450.soplex -1.31% 205081.000 202400.000 - 0.00% -
471.omnetpp -1.26% 478024.000 471992.000 - 0.00% -
401.bzip2 -1.23% 44233.000 43691.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.21% 6173.000 4864.000 - 3.98% -
482.sphinx3 -12.17% 945.000 830.000 - 2.60% -
434.zeusmp -6.72% 2514.000 2345.000 - 1.60% -
462.libquantum -5.71% 140.000 132.000 - -0.75% -
447.dealII -5.51% 1724.000 1629.000 - 0.99% -
437.leslie3d -5.40% 11640.000 11012.000 - -10.89% -
445.gobmk -2.63% 5023.000 4891.000 - 1.43% -
444.namd -1.87% 747.000 733.000 - 1.81% -
458.sjeng -1.86% 7567.000 7426.000 - 1.02% -
453.povray -1.10% 547.000 541.000 - 3.44% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.760 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.92% 26073.000 21.000 - 23.53% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.91% 2759.050 2.530 - 20.48% -
444.namd (unexplained diff vs previous) -99.84% 8356.000 13.000 - 44.44% -
444.namd (unexplained diff vs previous) (percentage) -99.84% 1118.610 1.770 - 41.60% -
433.milc (unexplained diff vs previous) -99.81% 11289.000 21.000 - 5.00% -
433.milc (unexplained diff vs previous) (percentage) -99.81% 980.800 1.830 - 3.39% -
447.dealII (unexplained diff vs previous) -99.77% 7017.000 16.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.76% 407.020 0.980 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.73% 2557.320 6.980 - 0.00% -
450.soplex (unexplained diff vs previous) -99.72% 14500.000 41.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.68% 5707.000 18.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.68% 1043.330 3.330 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.67% 11280.000 37.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.65% 448.690 1.580 - 0.00% -
456.hmmer (max) (percentage) -99.55% 73.590 0.330 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.32% 1305.690 8.820 - -35.38% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
462.libquantum (max) -99.28% 138.000 1.000 - -66.67% -
470.lbm (unexplained diff vs previous) (percentage) -99.23% 263.730 2.040 - 10.87% -
470.lbm (unexplained diff vs previous) -99.22% 9990.000 78.000 - 13.04% -
454.calculix (max) (percentage) -99.19% 99.730 0.810 - 0.00% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
429.mcf (unexplained diff vs previous) -99.04% 18593.000 178.000 - -29.08% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - 0.00% -
462.libquantum (max) (percentage) -99.00% 98.970 0.990 - -61.33% -
471.omnetpp (unexplained diff vs previous) -98.99% 10659.000 108.000 - 6.93% -
471.omnetpp (unexplained diff vs previous) (percentage) -98.98% 391.300 3.990 - 2.84% -
410.bwaves (unexplained diff vs previous) (percentage) -98.96% 137.900 1.440 - -52.48% -
410.bwaves (unexplained diff vs previous) -98.94% 7794.000 83.000 - -51.74% -
458.sjeng (unexplained diff vs previous) -98.91% 6876.000 75.000 - -13.79% -
458.sjeng (unexplained diff vs previous) (percentage) -98.89% 90.870 1.010 - -14.41% -
481.wrf (max) (percentage) -98.86% 68.700 0.780 - 0.00% -
447.dealII (max) -98.84% 1384.000 16.000 - 60.00% -
459.GemsFDTD (unexplained diff vs previous) -98.80% 15458.000 186.000 - 0.00% -
447.dealII (max) (percentage) -98.77% 80.280 0.990 - 50.00% -
445.gobmk (unexplained diff vs previous) -98.76% 5581.000 69.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.73% 111.110 1.410 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.47% 250.410 3.820 - 0.00% -
434.zeusmp (max) -98.20% 2055.000 37.000 - 236.36% -
444.namd (max) -98.10% 685.000 13.000 - 44.44% -
434.zeusmp (max) (percentage) -98.04% 81.770 1.600 - 233.33% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.04% 368.340 7.210 - 0.00% -
444.namd (max) (percentage) -98.03% 91.790 1.810 - 32.12% -
433.milc (max) -97.99% 1044.000 21.000 - 10.53% -
433.milc (max) (percentage) -97.95% 90.750 1.860 - 6.90% -
401.bzip2 (unexplained diff vs previous) -97.92% 10833.000 225.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -97.81% 197.850 4.330 - -15.59% -
473.astar (unexplained diff vs previous) -97.80% 10146.000 223.000 - -11.86% -
458.sjeng (max) -97.75% 3602.000 81.000 - -5.81% -
458.sjeng (max) (percentage) -97.69% 47.610 1.100 - -5.98% -
400.perlbench (max) (percentage) -97.60% 84.060 2.020 - 0.00% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
445.gobmk (max) -97.39% 2643.000 69.000 - 360.00% -
482.sphinx3 (max) -97.37% 911.000 24.000 - 4.35% -
445.gobmk (max) (percentage) -97.28% 52.630 1.430 - 346.87% -
470.lbm (max) -97.12% 2746.000 79.000 - 17.91% -
470.lbm (max) (percentage) -97.12% 72.510 2.090 - 15.47% -
482.sphinx3 (max) (percentage) -96.98% 96.500 2.910 - -1.02% -
453.povray (max) -96.39% 499.000 18.000 - 200.00% -
403.gcc (max) (percentage) -96.31% 99.360 3.670 - -0.27% -
453.povray (max) (percentage) -96.23% 91.250 3.440 - 175.20% -
410.bwaves (max) (percentage) -95.76% 57.970 2.460 - -16.61% -
410.bwaves (max) -95.70% 3276.000 141.000 - -15.57% -
459.GemsFDTD (max) -95.62% 4411.000 193.000 - 101.04% -
435.gromacs (unexplained diff vs previous) (percentage) -95.23% 96.680 4.610 - 0.00% -
435.gromacs (unexplained diff vs previous) -95.11% 7028.000 344.000 - 0.00% -
459.GemsFDTD (max) (percentage) -94.43% 71.460 3.980 - 93.20% -
471.omnetpp (max) -93.96% 2169.000 131.000 - -0.76% -
471.omnetpp (max) (percentage) -93.90% 79.650 4.860 - -4.71% -
473.astar (max) (percentage) -93.18% 66.430 4.530 - -7.17% -
473.astar (max) -93.16% 3406.000 233.000 - -2.92% -
450.soplex (max) (percentage) -92.20% 96.240 7.510 - 230.84% -
450.soplex (max) -91.93% 545.000 44.000 - 266.67% -
435.gromacs (max) (percentage) -90.17% 49.160 4.830 - 230.82% -
401.bzip2 (max) (percentage) -90.12% 78.650 7.770 - 521.60% -
435.gromacs (max) -89.92% 3573.000 360.000 - 249.51% -
401.bzip2 (max) -89.54% 2313.000 242.000 - 572.22% -
429.mcf (max) (percentage) -88.36% 92.890 10.810 - -9.99% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.74% 9.220 1.130 - 0.89% -
470.lbm -87.45% 239.000 30.000 - 3.45% -
470.lbm (avg) -87.45% 239.000 30.000 - 3.45% -
470.lbm (avg) (percentage) -87.20% 6.330 0.810 - 1.25% -
434.zeusmp -87.07% 147.000 19.000 - 0.00% -
434.zeusmp (avg) -87.07% 147.000 19.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.81% 5.850 0.830 - 0.00% -
429.mcf (max) -83.51% 1322.000 218.000 - -0.91% -
465.tonto (max) -83.00% 2112.000 359.000 - 322.35% -
465.tonto (max) (percentage) -82.96% 19.310 3.290 - 306.17% -
447.dealII -82.83% 99.000 17.000 - 0.00% -
447.dealII (avg) -82.83% 99.000 17.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
459.GemsFDTD -82.78% 360.000 62.000 - 6.90% -
459.GemsFDTD (avg) -82.78% 360.000 62.000 - 6.90% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
458.sjeng -82.16% 241.000 43.000 - 2.38% -
458.sjeng (avg) -82.16% 241.000 43.000 - 2.38% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 1.72% -
482.sphinx3 -81.08% 74.000 14.000 - 0.00% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 0.00% -
410.bwaves (avg) (percentage) -80.95% 4.410 0.840 - 1.20% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.94% 5.770 1.100 - 0.00% -
410.bwaves -80.72% 249.000 48.000 - 2.13% -
410.bwaves (avg) -80.72% 249.000 48.000 - 2.13% -
465.tonto (unexplained diff vs previous) (percentage) -80.36% 16.190 3.180 - 0.00% -
465.tonto (unexplained diff vs previous) -80.35% 1771.000 348.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
445.gobmk -79.59% 196.000 40.000 - 0.00% -
445.gobmk (avg) -79.59% 196.000 40.000 - 0.00% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - 1.89% -
445.gobmk (avg) (percentage) -78.77% 3.910 0.830 - 0.00% -
433.milc (avg) (percentage) -78.35% 6.050 1.310 - 0.00% -
433.milc -78.26% 69.000 15.000 - 7.14% -
433.milc (avg) -78.26% 69.000 15.000 - 7.14% -
459.GemsFDTD (avg) (percentage) -77.91% 5.840 1.290 - 2.38% -
482.sphinx3 (avg) (percentage) -77.43% 7.930 1.790 - 0.00% -
462.libquantum (avg) (percentage) -75.07% 7.660 1.910 - -0.52% -
471.omnetpp -74.89% 223.000 56.000 - 3.70% -
471.omnetpp (avg) -74.89% 223.000 56.000 - 3.70% -
471.omnetpp (avg) (percentage) -74.39% 8.200 2.100 - 0.96% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.71% 5.480 1.660 - 3.75% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs (avg) (percentage) -68.38% 5.060 1.600 - 2.56% -
401.bzip2 -68.32% 161.000 51.000 - 10.87% -
401.bzip2 (avg) -68.32% 161.000 51.000 - 10.87% -
435.gromacs -67.57% 367.000 119.000 - 7.21% -
435.gromacs (avg) -67.57% 367.000 119.000 - 7.21% -
465.tonto -64.93% 365.000 128.000 - 5.79% -
465.tonto (avg) -64.93% 365.000 128.000 - 5.79% -
465.tonto (avg) (percentage) -64.67% 3.340 1.180 - 2.61% -
450.soplex -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 2.43% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - 1.23% -
473.astar -60.56% 213.000 84.000 - 6.33% -
473.astar (avg) -60.56% 213.000 84.000 - 6.33% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -42.76% 7.670 4.390 - 1.15% -
437.leslie3d (unexplained diff vs previous) -41.83% 2314.000 1346.000 - 20.93% -
437.leslie3d (unexplained diff vs previous) (percentage) -38.53% 19.880 12.220 - 35.63% -
437.leslie3d (max) -37.84% 1929.000 1199.000 - -1.96% -
437.leslie3d (max) (percentage) -34.32% 16.580 10.890 - 10.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -19.27% 109.000 88.000 - 11.39% -
429.mcf (avg) -19.27% 109.000 88.000 - 11.39% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -


Report Time: 0.39s
Name Current %
401.bzip2 3119.000 7.77%
410.bwaves 5751.000 1.46%
429.mcf 2017.000 9.68%
433.milc 1150.000 1.86%
434.zeusmp 2345.000 1.60%
435.gromacs 7461.000 4.83%
437.leslie3d 11012.000 -10.89%
444.namd 733.000 1.81%
445.gobmk 4891.000 1.43%
447.dealII 1629.000 -
450.soplex 587.000 7.51%
453.povray 541.000 3.44%
458.sjeng 7426.000 1.02%
459.GemsFDTD 4864.000 3.98%
462.libquantum 132.000 -
465.tonto 10927.000 3.29%
470.lbm 3819.000 2.09%
471.omnetpp 2708.000 4.15%
473.astar 5150.000 4.53%
482.sphinx3 830.000 2.60%
Geometric Mean 2380.821 2.54%
Name Current %
401.bzip2 43691.000 -
410.bwaves 17836.000 -
429.mcf 9086.000 -
433.milc 60332.000 -
434.zeusmp 149323.000 -
435.gromacs 489734.000 -
437.leslie3d 54370.000 -
444.namd 181600.000 -
445.gobmk 1369770.000 -
447.dealII 303176.000 -
450.soplex 202400.000 -
453.povray 651756.000 -
458.sjeng 103267.000 -
459.GemsFDTD 232214.000 -
462.libquantum 15773.000 -
465.tonto 1950697.000 -
470.lbm 9515.000 -
471.omnetpp 471992.000 -
473.astar 22644.000 -
482.sphinx3 111374.000 -
Geometric Mean 114154.287 -
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.020 -
401.bzip2 51.000 10.87%
401.bzip2 (avg) 51.000 10.87%
401.bzip2 (avg) (percentage) 1.660 3.75%
401.bzip2 (max) 242.000 572.22%
401.bzip2 (max) (percentage) 7.770 521.60%
401.bzip2 (unexplained diff vs previous) 225.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 7.210 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.670 -
410.bwaves 48.000 2.13%
410.bwaves (avg) 48.000 2.13%
410.bwaves (avg) (percentage) 0.840 1.20%
410.bwaves (max) 141.000 -15.57%
410.bwaves (max) (percentage) 2.460 -16.61%
410.bwaves (unexplained diff vs previous) 83.000 -51.74%
410.bwaves (unexplained diff vs previous) (percentage) 1.440 -52.48%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 88.000 11.39%
429.mcf (avg) 88.000 11.39%
429.mcf (avg) (percentage) 4.390 1.15%
429.mcf (max) 218.000 -
429.mcf (max) (percentage) 10.810 -9.99%
429.mcf (unexplained diff vs previous) 178.000 -29.08%
429.mcf (unexplained diff vs previous) (percentage) 8.820 -35.38%
433.milc 15.000 7.14%
433.milc (avg) 15.000 7.14%
433.milc (avg) (percentage) 1.310 -
433.milc (max) 21.000 10.53%
433.milc (max) (percentage) 1.860 6.90%
433.milc (unexplained diff vs previous) 21.000 5.00%
433.milc (unexplained diff vs previous) (percentage) 1.830 3.39%
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 0.830 -
434.zeusmp (max) 37.000 236.36%
434.zeusmp (max) (percentage) 1.600 233.33%
434.zeusmp (unexplained diff vs previous) 37.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.580 -
435.gromacs 119.000 7.21%
435.gromacs (avg) 119.000 7.21%
435.gromacs (avg) (percentage) 1.600 2.56%
435.gromacs (max) 360.000 249.51%
435.gromacs (max) (percentage) 4.830 230.82%
435.gromacs (unexplained diff vs previous) 344.000 -
435.gromacs (unexplained diff vs previous) (percentage) 4.610 -
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.850 -
437.leslie3d 456.000 -9.70%
437.leslie3d (avg) 456.000 -9.70%
437.leslie3d (avg) (percentage) 4.150 1.47%
437.leslie3d (max) 1199.000 -1.96%
437.leslie3d (max) (percentage) 10.890 10.00%
437.leslie3d (unexplained diff vs previous) 1346.000 20.93%
437.leslie3d (unexplained diff vs previous) (percentage) 12.220 35.63%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.130 -
444.namd (max) 13.000 44.44%
444.namd (max) (percentage) 1.810 32.12%
444.namd (unexplained diff vs previous) 13.000 44.44%
444.namd (unexplained diff vs previous) (percentage) 1.770 41.60%
445.gobmk 40.000 -
445.gobmk (avg) 40.000 -
445.gobmk (avg) (percentage) 0.830 -
445.gobmk (max) 69.000 360.00%
445.gobmk (max) (percentage) 1.430 346.87%
445.gobmk (unexplained diff vs previous) 69.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.410 -
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.100 -
447.dealII (max) 16.000 60.00%
447.dealII (max) (percentage) 0.990 50.00%
447.dealII (unexplained diff vs previous) 16.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.980 -
450.soplex 14.000 7.69%
450.soplex (avg) 14.000 7.69%
450.soplex (avg) (percentage) 2.530 2.43%
450.soplex (max) 44.000 266.67%
450.soplex (max) (percentage) 7.510 230.84%
450.soplex (unexplained diff vs previous) 41.000 -
450.soplex (unexplained diff vs previous) (percentage) 6.980 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 1.89%
453.povray (max) 18.000 200.00%
453.povray (max) (percentage) 3.440 175.20%
453.povray (unexplained diff vs previous) 18.000 -
453.povray (unexplained diff vs previous) (percentage) 3.330 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.810 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.330 -
458.sjeng 43.000 2.38%
458.sjeng (avg) 43.000 2.38%
458.sjeng (avg) (percentage) 0.590 1.72%
458.sjeng (max) 81.000 -5.81%
458.sjeng (max) (percentage) 1.100 -5.98%
458.sjeng (unexplained diff vs previous) 75.000 -13.79%
458.sjeng (unexplained diff vs previous) (percentage) 1.010 -14.41%
459.GemsFDTD 62.000 6.90%
459.GemsFDTD (avg) 62.000 6.90%
459.GemsFDTD (avg) (percentage) 1.290 2.38%
459.GemsFDTD (max) 193.000 101.04%
459.GemsFDTD (max) (percentage) 3.980 93.20%
459.GemsFDTD (unexplained diff vs previous) 186.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.820 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.910 -
462.libquantum (max) 1.000 -66.67%
462.libquantum (max) (percentage) 0.990 -61.33%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.760 -
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 128.000 5.79%
465.tonto (avg) 128.000 5.79%
465.tonto (avg) (percentage) 1.180 2.61%
465.tonto (max) 359.000 322.35%
465.tonto (max) (percentage) 3.290 306.17%
465.tonto (unexplained diff vs previous) 348.000 -
465.tonto (unexplained diff vs previous) (percentage) 3.180 -
470.lbm 30.000 3.45%
470.lbm (avg) 30.000 3.45%
470.lbm (avg) (percentage) 0.810 1.25%
470.lbm (max) 79.000 17.91%
470.lbm (max) (percentage) 2.090 15.47%
470.lbm (unexplained diff vs previous) 78.000 13.04%
470.lbm (unexplained diff vs previous) (percentage) 2.040 10.87%
471.omnetpp 56.000 3.70%
471.omnetpp (avg) 56.000 3.70%
471.omnetpp (avg) (percentage) 2.100 -
471.omnetpp (max) 131.000 -
471.omnetpp (max) (percentage) 4.860 -4.71%
471.omnetpp (unexplained diff vs previous) 108.000 6.93%
471.omnetpp (unexplained diff vs previous) (percentage) 3.990 2.84%
473.astar 84.000 6.33%
473.astar (avg) 84.000 6.33%
473.astar (avg) (percentage) 1.640 1.23%
473.astar (max) 233.000 -2.92%
473.astar (max) (percentage) 4.530 -7.17%
473.astar (unexplained diff vs previous) 223.000 -11.86%
473.astar (unexplained diff vs previous) (percentage) 4.330 -15.59%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.790 -
482.sphinx3 (max) 24.000 4.35%
482.sphinx3 (max) (percentage) 2.910 -1.02%
482.sphinx3 (unexplained diff vs previous) 21.000 23.53%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.530 20.48%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.874 18.82%