Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=412164f0a99a827a04394c7731c25084e794bcf4 (+ 42 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (ad56e4632b05e66da35d6c23e45312b3cfbb646c) (+ 107 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=daab2a6d19f8360248289840408e7d2e5c203c2e (+ 1 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (+ 16054 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/429/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0429 (4-changed-components) 2025-06-10T21:44:33 0:00:00
Previous 0428 (3-changed-components) 2025-06-08T12:09:32 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 67 16
Performance Improvements 32 177
Added Tests 18 0
Unchanged Tests 1119 1043
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.97% 574.000 614.000 - 8.29% -
482.sphinx3 4.74% 843.000 883.000 - -6.56% -
453.povray 3.72% 538.000 558.000 - 2.01% -
447.dealII 2.97% 1616.000 1664.000 - -3.48% -
471.omnetpp 2.60% 2728.000 2799.000 - 2.75% -
429.mcf 2.20% 2049.000 2094.000 - 47.05% -
444.namd 2.19% 731.000 747.000 - 0.00% -
433.milc 2.17% 1154.000 1179.000 - 2.43% -
445.gobmk 1.27% 4816.000 4877.000 - -2.91% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) 1900.00% 2.000 40.000 - -99.85% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1787.50% 0.240 4.530 - -99.84% -
444.namd (unexplained diff vs previous) 1500.00% 1.000 16.000 - -99.81% -
444.namd (unexplained diff vs previous) (percentage) 1428.57% 0.140 2.140 - -99.81% -
470.lbm (unexplained diff vs previous) (percentage) 480.00% 0.050 0.290 - -99.89% -
470.lbm (unexplained diff vs previous) 450.00% 2.000 11.000 - -99.89% -
473.astar (unexplained diff vs previous) 416.67% 6.000 31.000 - -99.69% -
473.astar (unexplained diff vs previous) (percentage) 400.00% 0.120 0.600 - -99.70% -
435.gromacs (max) (percentage) 316.47% 0.850 3.540 - -92.80% -
435.gromacs (max) 303.23% 62.000 250.000 - -93.00% -
433.milc (max) 212.50% 8.000 25.000 - -97.61% -
433.milc (max) (percentage) 189.33% 0.750 2.170 - -97.61% -
471.omnetpp (unexplained diff vs previous) 144.83% 29.000 71.000 - -99.33% -
471.omnetpp (unexplained diff vs previous) (percentage) 139.62% 1.060 2.540 - -99.35% -
447.dealII (max) 122.73% 22.000 49.000 - -96.46% -
473.astar (max) 121.43% 14.000 31.000 - -99.09% -
473.astar (max) (percentage) 114.29% 0.280 0.600 - -99.10% -
447.dealII (max) (percentage) 109.15% 1.420 2.970 - -96.30% -
444.namd (max) 77.78% 9.000 16.000 - -97.66% -
482.sphinx3 (max) 64.00% 25.000 41.000 - -95.50% -
444.namd (max) (percentage) 62.22% 1.350 2.190 - -97.61% -
482.sphinx3 (max) (percentage) 56.95% 3.020 4.740 - -95.09% -
450.soplex (max) 55.56% 27.000 42.000 - -92.29% -
471.omnetpp (max) 44.00% 50.000 72.000 - -96.68% -
450.soplex (max) (percentage) 43.42% 4.860 6.970 - -92.76% -
471.omnetpp (max) (percentage) 41.30% 1.840 2.600 - -96.74% -
445.gobmk (max) 24.49% 49.000 61.000 - -97.69% -
445.gobmk (max) (percentage) 23.30% 1.030 1.270 - -97.59% -
470.lbm (max) 22.22% 9.000 11.000 - -99.60% -
445.gobmk (unexplained diff vs previous) 22.00% 50.000 61.000 - -98.91% -
429.mcf (max) 21.05% 38.000 46.000 - -96.52% -
470.lbm (max) (percentage) 20.83% 0.240 0.290 - -99.60% -
445.gobmk (unexplained diff vs previous) (percentage) 20.19% 1.040 1.250 - -98.87% -
429.mcf (max) (percentage) 18.28% 1.860 2.200 - -97.63% -
453.povray (max) 17.65% 17.000 20.000 - -95.99% -
453.povray (max) (percentage) 15.53% 3.220 3.720 - -95.92% -
450.soplex 14.29% 14.000 16.000 - -55.56% -
450.soplex (avg) 14.29% 14.000 16.000 - -55.56% -
433.milc 7.69% 13.000 14.000 - -79.71% -
433.milc (avg) 7.69% 13.000 14.000 - -79.71% -
482.sphinx3 7.14% 14.000 15.000 - -79.73% -
482.sphinx3 (avg) 7.14% 14.000 15.000 - -79.73% -
447.dealII 6.67% 15.000 16.000 - -83.84% -
447.dealII (avg) 6.67% 15.000 16.000 - -83.84% -
447.dealII (avg) (percentage) 5.21% 0.960 1.010 - -82.50% -
471.omnetpp 3.77% 53.000 55.000 - -75.34% -
471.omnetpp (avg) 3.77% 53.000 55.000 - -75.34% -
435.gromacs (avg) (percentage) 3.60% 1.390 1.440 - -71.54% -
482.sphinx3 (avg) (percentage) 3.49% 1.720 1.780 - -77.55% -
453.povray (avg) (percentage) 3.27% 1.530 1.580 - -79.77% -
450.soplex (avg) (percentage) 3.08% 2.600 2.680 - -58.32% -
445.gobmk 3.03% 33.000 34.000 - -82.65% -
445.gobmk (avg) 3.03% 33.000 34.000 - -82.65% -
429.mcf 2.70% 74.000 76.000 - -30.28% -
429.mcf (avg) 2.70% 74.000 76.000 - -30.28% -
444.namd (avg) (percentage) 2.22% 0.900 0.920 - -90.02% -
433.milc (avg) (percentage) 1.71% 1.170 1.190 - -80.33% -
445.gobmk (avg) (percentage) 1.45% 0.690 0.700 - -82.10% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -3.54% 7338.000 7078.000 - -2.63% -
437.leslie3d -2.56% 10976.000 10695.000 - -8.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -89.74% 39.000 4.000 - -99.96% -
401.bzip2 (unexplained diff vs previous) (percentage) -89.68% 1.260 0.130 - -99.96% -
465.tonto (max) (percentage) -63.64% 2.200 0.800 - -95.86% -
465.tonto (max) -63.45% 238.000 87.000 - -95.88% -
434.zeusmp (max) -36.36% 22.000 14.000 - -99.32% -
434.zeusmp (max) (percentage) -35.05% 0.970 0.630 - -99.23% -
401.bzip2 (max) -17.95% 39.000 32.000 - -98.62% -
401.bzip2 (max) (percentage) -16.54% 1.270 1.060 - -98.65% -
437.leslie3d (unexplained diff vs previous) -13.54% 325.000 281.000 - -87.86% -
437.leslie3d (unexplained diff vs previous) (percentage) -11.15% 2.960 2.630 - -86.77% -
437.leslie3d (max) -9.81% 316.000 285.000 - -85.23% -
437.leslie3d (max) (percentage) -7.29% 2.880 2.670 - -83.90% -
434.zeusmp -7.14% 14.000 13.000 - -91.16% -
434.zeusmp (avg) -7.14% 14.000 13.000 - -91.16% -
459.GemsFDTD (max) -6.90% 29.000 27.000 - -99.39% -
459.GemsFDTD (max) (percentage) -6.56% 0.610 0.570 - -99.20% -
410.bwaves (max) (percentage) -6.25% 0.480 0.450 - -99.22% -
462.libquantum (max) (percentage) -4.65% 4.300 4.100 - -95.86% -
410.bwaves (max) -3.70% 27.000 26.000 - -99.21% -
458.sjeng (max) (percentage) -3.26% 0.920 0.890 - -98.13% -
437.leslie3d -3.17% 410.000 397.000 - 11.83% -
437.leslie3d (avg) -3.17% 410.000 397.000 - 11.83% -
458.sjeng (max) -2.94% 68.000 66.000 - -98.17% -
401.bzip2 -2.04% 49.000 48.000 - -70.19% -
401.bzip2 (avg) -2.04% 49.000 48.000 - -70.19% -
434.zeusmp (avg) (percentage) -1.67% 0.600 0.590 - -89.91% -
473.astar (avg) (percentage) -1.32% 1.520 1.500 - -63.94% -
473.astar -1.28% 78.000 77.000 - -63.85% -
473.astar (avg) -1.28% 78.000 77.000 - -63.85% -
401.bzip2 (avg) (percentage) -1.27% 1.580 1.560 - -71.53% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.47% 16760.000 17844.000 - 0.00% -
458.sjeng 3.37% 104048.000 107559.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 47.05% 1424.000 2094.000 - 2.20% -
450.soplex 8.29% 567.000 614.000 - 6.97% -
401.bzip2 5.51% 2941.000 3103.000 - -0.13% -
471.omnetpp 2.75% 2724.000 2799.000 - 2.60% -
433.milc 2.43% 1151.000 1179.000 - 2.17% -
410.bwaves 2.25% 5652.000 5779.000 - 0.24% -
453.povray 2.01% 547.000 558.000 - 3.72% -
470.lbm 1.16% 3788.000 3832.000 - 0.29% -
473.astar 1.11% 5128.000 5185.000 - 0.60% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 21.97% 3.050 3.720 - -0.53% -
437.leslie3d 11.83% 355.000 397.000 - -3.17% -
437.leslie3d (avg) 11.83% 355.000 397.000 - -3.17% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.57% 59479.000 54382.000 - 0.00% -
459.GemsFDTD -5.11% 244728.000 232214.000 - 0.00% -
444.namd -3.60% 188385.000 181608.000 - 0.00% -
447.dealII -2.70% 311591.000 303184.000 - 0.00% -
453.povray -2.09% 661389.000 647536.000 - 0.00% -
435.gromacs -1.90% 499261.000 489782.000 - 0.00% -
434.zeusmp -1.80% 152037.000 149295.000 - 0.00% -
433.milc -1.74% 61382.000 60312.000 - 0.00% -
470.lbm -1.73% 9691.000 9523.000 - 0.00% -
462.libquantum -1.69% 16085.000 15813.000 - 0.00% -
473.astar -1.38% 22968.000 22652.000 - 0.00% -
482.sphinx3 -1.31% 112859.000 111386.000 - 0.00% -
471.omnetpp -1.27% 478024.000 471960.000 - 0.00% -
450.soplex -1.23% 205081.000 202552.000 - 0.00% -
401.bzip2 -1.20% 44233.000 43703.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.12% 6173.000 4869.000 - 0.47% -
437.leslie3d -8.12% 11640.000 10695.000 - -2.56% -
482.sphinx3 -6.56% 945.000 883.000 - 4.74% -
434.zeusmp -6.32% 2514.000 2355.000 - 0.47% -
462.libquantum -3.57% 140.000 135.000 - -0.74% -
447.dealII -3.48% 1724.000 1664.000 - 2.97% -
445.gobmk -2.91% 5023.000 4877.000 - 1.27% -
435.gromacs -2.63% 7269.000 7078.000 - -3.54% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.740 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.96% 368.340 0.130 - -89.68% -
401.bzip2 (unexplained diff vs previous) -99.96% 10833.000 4.000 - -89.74% -
434.zeusmp (unexplained diff vs previous) -99.90% 11280.000 11.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.90% 448.690 0.470 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.89% 263.730 0.290 - 480.00% -
470.lbm (unexplained diff vs previous) -99.89% 9990.000 11.000 - 450.00% -
459.GemsFDTD (unexplained diff vs previous) -99.85% 15458.000 23.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.85% 26073.000 40.000 - 1900.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.84% 2759.050 4.530 - 1787.50% -
429.mcf (unexplained diff vs previous) (percentage) -99.84% 1305.690 2.150 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.81% 250.410 0.470 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.81% 1118.610 2.140 - 1428.57% -
444.namd (unexplained diff vs previous) -99.81% 8356.000 16.000 - 1500.00% -
433.milc (unexplained diff vs previous) (percentage) -99.78% 980.800 2.120 - 0.00% -
433.milc (unexplained diff vs previous) -99.78% 11289.000 25.000 - 0.00% -
416.gamess (max) (percentage) -99.77% 38.550 0.090 - 0.00% -
429.mcf (unexplained diff vs previous) -99.76% 18593.000 45.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.75% 2557.320 6.510 - 0.00% -
450.soplex (unexplained diff vs previous) -99.72% 14500.000 40.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.70% 197.850 0.600 - 400.00% -
473.astar (unexplained diff vs previous) -99.69% 10146.000 31.000 - 416.67% -
453.povray (unexplained diff vs previous) (percentage) -99.66% 1043.330 3.580 - 0.00% -
453.povray (unexplained diff vs previous) -99.65% 5707.000 20.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.62% 6876.000 26.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.61% 90.870 0.350 - 0.00% -
470.lbm (max) (percentage) -99.60% 72.510 0.290 - 20.83% -
470.lbm (max) -99.60% 2746.000 11.000 - 22.22% -
456.hmmer (max) (percentage) -99.57% 73.590 0.320 - 0.00% -
459.GemsFDTD (max) -99.39% 4411.000 27.000 - -6.90% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.35% 391.300 2.540 - 139.62% -
471.omnetpp (unexplained diff vs previous) -99.33% 10659.000 71.000 - 144.83% -
434.zeusmp (max) -99.32% 2055.000 14.000 - -36.36% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
447.dealII (unexplained diff vs previous) -99.32% 7017.000 48.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.29% 407.020 2.880 - 0.00% -
434.zeusmp (max) (percentage) -99.23% 81.770 0.630 - -35.05% -
410.bwaves (max) (percentage) -99.22% 57.970 0.450 - -6.25% -
410.bwaves (max) -99.21% 3276.000 26.000 - -3.70% -
459.GemsFDTD (max) (percentage) -99.20% 71.460 0.570 - -6.56% -
473.astar (max) (percentage) -99.10% 66.430 0.600 - 114.29% -
473.astar (max) -99.09% 3406.000 31.000 - 121.43% -
436.cactusADM (max) (percentage) -99.05% 88.730 0.840 - 0.00% -
445.gobmk (unexplained diff vs previous) -98.91% 5581.000 61.000 - 22.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.87% 111.110 1.250 - 20.19% -
401.bzip2 (max) (percentage) -98.65% 78.650 1.060 - -16.54% -
401.bzip2 (max) -98.62% 2313.000 32.000 - -17.95% -
481.wrf (max) (percentage) -98.52% 68.700 1.020 - 0.00% -
458.sjeng (max) -98.17% 3602.000 66.000 - -2.94% -
458.sjeng (max) (percentage) -98.13% 47.610 0.890 - -3.26% -
445.gobmk (max) -97.69% 2643.000 61.000 - 24.49% -
444.namd (max) -97.66% 685.000 16.000 - 77.78% -
400.perlbench (max) (percentage) -97.66% 84.060 1.970 - -0.51% -
429.mcf (max) (percentage) -97.63% 92.890 2.200 - 18.28% -
444.namd (max) (percentage) -97.61% 91.790 2.190 - 62.22% -
433.milc (max) (percentage) -97.61% 90.750 2.170 - 189.33% -
433.milc (max) -97.61% 1044.000 25.000 - 212.50% -
445.gobmk (max) (percentage) -97.59% 52.630 1.270 - 23.30% -
483.xalancbmk (max) (percentage) -97.29% 68.670 1.860 - 0.00% -
471.omnetpp (max) (percentage) -96.74% 79.650 2.600 - 41.30% -
471.omnetpp (max) -96.68% 2169.000 72.000 - 44.00% -
465.tonto (unexplained diff vs previous) -96.56% 1771.000 61.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -96.54% 16.190 0.560 - 0.00% -
429.mcf (max) -96.52% 1322.000 46.000 - 21.05% -
447.dealII (max) -96.46% 1384.000 49.000 - 122.73% -
462.libquantum (max) -96.38% 138.000 5.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -96.30% 7028.000 260.000 - 0.00% -
447.dealII (max) (percentage) -96.30% 80.280 2.970 - 109.15% -
435.gromacs (unexplained diff vs previous) (percentage) -96.20% 96.680 3.670 - 0.00% -
453.povray (max) -95.99% 499.000 20.000 - 17.65% -
453.povray (max) (percentage) -95.92% 91.250 3.720 - 15.53% -
403.gcc (max) (percentage) -95.91% 99.360 4.060 - 0.00% -
465.tonto (max) -95.88% 2112.000 87.000 - -63.45% -
462.libquantum (max) (percentage) -95.86% 98.970 4.100 - -4.65% -
465.tonto (max) (percentage) -95.86% 19.310 0.800 - -63.64% -
482.sphinx3 (max) -95.50% 911.000 41.000 - 64.00% -
416.gamess (avg) (percentage) -95.48% 4.420 0.200 - 0.00% -
482.sphinx3 (max) (percentage) -95.09% 96.500 4.740 - 56.95% -
454.calculix (max) (percentage) -93.74% 99.730 6.240 - 0.00% -
456.hmmer (avg) (percentage) -93.20% 4.410 0.300 - 0.00% -
435.gromacs (max) -93.00% 3573.000 250.000 - 303.23% -
435.gromacs (max) (percentage) -92.80% 49.160 3.540 - 316.47% -
450.soplex (max) (percentage) -92.76% 96.240 6.970 - 43.42% -
450.soplex (max) -92.29% 545.000 42.000 - 55.56% -
464.h264ref (avg) (percentage) -91.55% 5.090 0.430 - 0.00% -
444.namd -91.18% 68.000 6.000 - 0.00% -
444.namd (avg) -91.18% 68.000 6.000 - 0.00% -
434.zeusmp -91.16% 147.000 13.000 - -7.14% -
434.zeusmp (avg) -91.16% 147.000 13.000 - -7.14% -
470.lbm -90.38% 239.000 23.000 - 0.00% -
470.lbm (avg) -90.38% 239.000 23.000 - 0.00% -
470.lbm (avg) (percentage) -90.21% 6.330 0.620 - 0.00% -
444.namd (avg) (percentage) -90.02% 9.220 0.920 - 2.22% -
434.zeusmp (avg) (percentage) -89.91% 5.850 0.590 - -1.67% -
436.cactusADM (avg) (percentage) -89.30% 5.980 0.640 - 0.00% -
437.leslie3d (unexplained diff vs previous) -87.86% 2314.000 281.000 - -13.54% -
481.wrf (avg) (percentage) -87.18% 6.240 0.800 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -86.77% 19.880 2.630 - -11.15% -
437.leslie3d (max) -85.23% 1929.000 285.000 - -9.81% -
459.GemsFDTD -84.72% 360.000 55.000 - 0.00% -
459.GemsFDTD (avg) -84.72% 360.000 55.000 - 0.00% -
458.sjeng -84.65% 241.000 37.000 - 0.00% -
458.sjeng (avg) -84.65% 241.000 37.000 - 0.00% -
458.sjeng (avg) (percentage) -84.33% 3.190 0.500 - 0.00% -
410.bwaves (avg) (percentage) -84.13% 4.410 0.700 - 0.00% -
410.bwaves -83.94% 249.000 40.000 - 0.00% -
410.bwaves (avg) -83.94% 249.000 40.000 - 0.00% -
437.leslie3d (max) (percentage) -83.90% 16.580 2.670 - -7.29% -
447.dealII -83.84% 99.000 16.000 - 6.67% -
447.dealII (avg) -83.84% 99.000 16.000 - 6.67% -
445.gobmk -82.65% 196.000 34.000 - 3.03% -
445.gobmk (avg) -82.65% 196.000 34.000 - 3.03% -
447.dealII (avg) (percentage) -82.50% 5.770 1.010 - 5.21% -
445.gobmk (avg) (percentage) -82.10% 3.910 0.700 - 1.45% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -80.65% 5.840 1.130 - -0.88% -
433.milc (avg) (percentage) -80.33% 6.050 1.190 - 1.71% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
453.povray (avg) (percentage) -79.77% 7.810 1.580 - 3.27% -
482.sphinx3 -79.73% 74.000 15.000 - 7.14% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 7.14% -
433.milc -79.71% 69.000 14.000 - 7.69% -
433.milc (avg) -79.71% 69.000 14.000 - 7.69% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - 3.49% -
471.omnetpp (avg) (percentage) -75.98% 8.200 1.970 - 0.51% -
471.omnetpp -75.34% 223.000 55.000 - 3.77% -
471.omnetpp (avg) -75.34% 223.000 55.000 - 3.77% -
400.perlbench (avg) (percentage) -74.49% 6.350 1.620 - 0.00% -
462.libquantum (avg) (percentage) -73.11% 7.660 2.060 - -0.96% -
435.gromacs -72.48% 367.000 101.000 - 0.00% -
435.gromacs (avg) -72.48% 367.000 101.000 - 0.00% -
435.gromacs (avg) (percentage) -71.54% 5.060 1.440 - 3.60% -
401.bzip2 (avg) (percentage) -71.53% 5.480 1.560 - -1.27% -
401.bzip2 -70.19% 161.000 48.000 - -2.04% -
401.bzip2 (avg) -70.19% 161.000 48.000 - -2.04% -
465.tonto -69.04% 365.000 113.000 - 0.00% -
465.tonto (avg) -69.04% 365.000 113.000 - 0.00% -
465.tonto (avg) (percentage) -68.86% 3.340 1.040 - -0.95% -
473.astar (avg) (percentage) -63.94% 4.160 1.500 - -1.32% -
473.astar -63.85% 213.000 77.000 - -1.28% -
473.astar (avg) -63.85% 213.000 77.000 - -1.28% -
483.xalancbmk (avg) (percentage) -63.38% 6.500 2.380 - 0.00% -
454.calculix (avg) (percentage) -61.85% 8.020 3.060 - 0.00% -
403.gcc (avg) (percentage) -60.93% 7.320 2.860 - 0.00% -
450.soplex (avg) (percentage) -58.32% 6.430 2.680 - 3.08% -
450.soplex -55.56% 36.000 16.000 - 14.29% -
450.soplex (avg) -55.56% 36.000 16.000 - 14.29% -
429.mcf (avg) (percentage) -52.67% 7.670 3.630 - -0.82% -
429.mcf -30.28% 109.000 76.000 - 2.70% -
429.mcf (avg) -30.28% 109.000 76.000 - 2.70% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -


Report Time: 0.38s
Name Current %
401.bzip2 3103.000 -
410.bwaves 5779.000 -
429.mcf 2094.000 2.20%
433.milc 1179.000 2.17%
434.zeusmp 2355.000 -
435.gromacs 7078.000 -3.54%
437.leslie3d 10695.000 -2.56%
444.namd 747.000 2.19%
445.gobmk 4877.000 1.27%
447.dealII 1664.000 2.97%
450.soplex 614.000 6.97%
453.povray 558.000 3.72%
458.sjeng 7508.000 -
459.GemsFDTD 4869.000 -
462.libquantum 135.000 -
465.tonto 10889.000 -
470.lbm 3832.000 -
471.omnetpp 2799.000 2.60%
473.astar 5185.000 -
482.sphinx3 883.000 4.74%
Geometric Mean 2408.813 1.22%
Name Current %
401.bzip2 43703.000 -
410.bwaves 17844.000 -
429.mcf 9094.000 -
433.milc 60312.000 -
434.zeusmp 149295.000 -
435.gromacs 489782.000 -
437.leslie3d 54382.000 -
444.namd 181608.000 -
445.gobmk 1373734.000 -
447.dealII 303184.000 -
450.soplex 202552.000 -
453.povray 647536.000 -
458.sjeng 107559.000 -
459.GemsFDTD 232214.000 -
462.libquantum 15813.000 -
465.tonto 1950621.000 -
470.lbm 9523.000 -
471.omnetpp 471960.000 -
473.astar 22652.000 -
482.sphinx3 111386.000 -
Geometric Mean 114400.365 -
Name Current %
400.perlbench (avg) (percentage) 1.620 -
400.perlbench (max) (percentage) 1.970 -
401.bzip2 48.000 -2.04%
401.bzip2 (avg) 48.000 -2.04%
401.bzip2 (avg) (percentage) 1.560 -1.27%
401.bzip2 (max) 32.000 -17.95%
401.bzip2 (max) (percentage) 1.060 -16.54%
401.bzip2 (unexplained diff vs previous) 4.000 -89.74%
401.bzip2 (unexplained diff vs previous) (percentage) 0.130 -89.68%
403.gcc (avg) (percentage) 2.860 -
403.gcc (max) (percentage) 4.060 -
410.bwaves 40.000 -
410.bwaves (avg) 40.000 -
410.bwaves (avg) (percentage) 0.700 -
410.bwaves (max) 26.000 -3.70%
410.bwaves (max) (percentage) 0.450 -6.25%
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.090 -
429.mcf 76.000 2.70%
429.mcf (avg) 76.000 2.70%
429.mcf (avg) (percentage) 3.630 -
429.mcf (max) 46.000 21.05%
429.mcf (max) (percentage) 2.200 18.28%
429.mcf (unexplained diff vs previous) 45.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.150 -
433.milc 14.000 7.69%
433.milc (avg) 14.000 7.69%
433.milc (avg) (percentage) 1.190 1.71%
433.milc (max) 25.000 212.50%
433.milc (max) (percentage) 2.170 189.33%
433.milc (unexplained diff vs previous) 25.000 -
433.milc (unexplained diff vs previous) (percentage) 2.120 -
434.zeusmp 13.000 -7.14%
434.zeusmp (avg) 13.000 -7.14%
434.zeusmp (avg) (percentage) 0.590 -1.67%
434.zeusmp (max) 14.000 -36.36%
434.zeusmp (max) (percentage) 0.630 -35.05%
434.zeusmp (unexplained diff vs previous) 11.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.470 -
435.gromacs 101.000 -
435.gromacs (avg) 101.000 -
435.gromacs (avg) (percentage) 1.440 3.60%
435.gromacs (max) 250.000 303.23%
435.gromacs (max) (percentage) 3.540 316.47%
435.gromacs (unexplained diff vs previous) 260.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.670 -
436.cactusADM (avg) (percentage) 0.640 -
436.cactusADM (max) (percentage) 0.840 -
437.leslie3d 397.000 -3.17%
437.leslie3d (avg) 397.000 -3.17%
437.leslie3d (avg) (percentage) 3.720 -
437.leslie3d (max) 285.000 -9.81%
437.leslie3d (max) (percentage) 2.670 -7.29%
437.leslie3d (unexplained diff vs previous) 281.000 -13.54%
437.leslie3d (unexplained diff vs previous) (percentage) 2.630 -11.15%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.920 2.22%
444.namd (max) 16.000 77.78%
444.namd (max) (percentage) 2.190 62.22%
444.namd (unexplained diff vs previous) 16.000 1500.00%
444.namd (unexplained diff vs previous) (percentage) 2.140 1428.57%
445.gobmk 34.000 3.03%
445.gobmk (avg) 34.000 3.03%
445.gobmk (avg) (percentage) 0.700 1.45%
445.gobmk (max) 61.000 24.49%
445.gobmk (max) (percentage) 1.270 23.30%
445.gobmk (unexplained diff vs previous) 61.000 22.00%
445.gobmk (unexplained diff vs previous) (percentage) 1.250 20.19%
447.dealII 16.000 6.67%
447.dealII (avg) 16.000 6.67%
447.dealII (avg) (percentage) 1.010 5.21%
447.dealII (max) 49.000 122.73%
447.dealII (max) (percentage) 2.970 109.15%
447.dealII (unexplained diff vs previous) 48.000 -
447.dealII (unexplained diff vs previous) (percentage) 2.880 -
450.soplex 16.000 14.29%
450.soplex (avg) 16.000 14.29%
450.soplex (avg) (percentage) 2.680 3.08%
450.soplex (max) 42.000 55.56%
450.soplex (max) (percentage) 6.970 43.42%
450.soplex (unexplained diff vs previous) 40.000 -
450.soplex (unexplained diff vs previous) (percentage) 6.510 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.580 3.27%
453.povray (max) 20.000 17.65%
453.povray (max) (percentage) 3.720 15.53%
453.povray (unexplained diff vs previous) 20.000 -
453.povray (unexplained diff vs previous) (percentage) 3.580 -
454.calculix (avg) (percentage) 3.060 -
454.calculix (max) (percentage) 6.240 -
456.hmmer (avg) (percentage) 0.300 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 37.000 -
458.sjeng (avg) 37.000 -
458.sjeng (avg) (percentage) 0.500 -
458.sjeng (max) 66.000 -2.94%
458.sjeng (max) (percentage) 0.890 -3.26%
458.sjeng (unexplained diff vs previous) 26.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.350 -
459.GemsFDTD 55.000 -
459.GemsFDTD (avg) 55.000 -
459.GemsFDTD (avg) (percentage) 1.130 -
459.GemsFDTD (max) 27.000 -6.90%
459.GemsFDTD (max) (percentage) 0.570 -6.56%
459.GemsFDTD (unexplained diff vs previous) 23.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.470 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.060 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 4.100 -4.65%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.740 -
464.h264ref (avg) (percentage) 0.430 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 113.000 -
465.tonto (avg) 113.000 -
465.tonto (avg) (percentage) 1.040 -
465.tonto (max) 87.000 -63.45%
465.tonto (max) (percentage) 0.800 -63.64%
465.tonto (unexplained diff vs previous) 61.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.560 -
470.lbm 23.000 -
470.lbm (avg) 23.000 -
470.lbm (avg) (percentage) 0.620 -
470.lbm (max) 11.000 22.22%
470.lbm (max) (percentage) 0.290 20.83%
470.lbm (unexplained diff vs previous) 11.000 450.00%
470.lbm (unexplained diff vs previous) (percentage) 0.290 480.00%
471.omnetpp 55.000 3.77%
471.omnetpp (avg) 55.000 3.77%
471.omnetpp (avg) (percentage) 1.970 -
471.omnetpp (max) 72.000 44.00%
471.omnetpp (max) (percentage) 2.600 41.30%
471.omnetpp (unexplained diff vs previous) 71.000 144.83%
471.omnetpp (unexplained diff vs previous) (percentage) 2.540 139.62%
473.astar 77.000 -1.28%
473.astar (avg) 77.000 -1.28%
473.astar (avg) (percentage) 1.500 -1.32%
473.astar (max) 31.000 121.43%
473.astar (max) (percentage) 0.600 114.29%
473.astar (unexplained diff vs previous) 31.000 416.67%
473.astar (unexplained diff vs previous) (percentage) 0.600 400.00%
481.wrf (avg) (percentage) 0.800 -
481.wrf (max) (percentage) 1.020 -
482.sphinx3 15.000 7.14%
482.sphinx3 (avg) 15.000 7.14%
482.sphinx3 (avg) (percentage) 1.780 3.49%
482.sphinx3 (max) 41.000 64.00%
482.sphinx3 (max) (percentage) 4.740 56.95%
482.sphinx3 (unexplained diff vs previous) 40.000 1900.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 4.530 1787.50%
483.xalancbmk (avg) (percentage) 2.380 -
483.xalancbmk (max) (percentage) 1.860 -
Geometric Mean 6.397 44.17%