Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=52435e5ff6cc9f00841ad6a8db701917904de4ed (unchanged) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/33fb1625992ba8180b42988e714460bcab08ca0f (+ 5 commits) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=9e2ff880f3cbc0b4ec8505ad2ce4a1c92d7f6d56 (unchanged) |
git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=06a6642c97bbf927195d2748ba2755a9a0c208de (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/14/ |
Filter
gnu-aarch64-master-Os_LTO test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0014 (basepoints/gcc-13-06752-g33fb1625992) | 2023-03-18T17:36:49 | 0:00:00 |
Previous | 0013 (basepoints/gcc-13-06747-gd7caf313525) | 2023-03-18T04:32:16 | 0:00:00 |
Baseline | 0001 (4-changed-components) | 2023-02-20T22:48:24 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 47 | 12 |
Performance Improvements | 154 | 214 |
Added Tests | 4 | 0 |
Unchanged Tests | 1031 | 1010 |
Total Tests | 1236 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
429.mcf | 33.52% | 1408.000 | 1880.000 | - | 32.02% | - |
403.gcc | 9.26% | 54.000 | 59.000 | - | 5.36% | - |
436.cactusADM | 3.68% | 2095.000 | 2172.000 | - | 4.27% | - |
433.milc | 3.13% | 1149.000 | 1185.000 | - | 2.95% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
450.soplex (unexplained diff vs previous) (percentage) | 127.94% | 0.680 | 1.550 | - | -99.94% | - |
450.soplex (unexplained diff vs previous) | 125.00% | 4.000 | 9.000 | - | -99.94% | - |
481.wrf (unexplained diff vs previous) (percentage) | 54.44% | 2.590 | 4.000 | - | -98.18% | - |
481.wrf (unexplained diff vs previous) | 48.61% | 144.000 | 214.000 | - | -98.24% | - |
481.wrf (max) (percentage) | 44.91% | 2.650 | 3.840 | - | -94.41% | - |
429.mcf | 44.30% | 158.000 | 228.000 | - | 109.17% | - |
429.mcf (avg) | 44.30% | 158.000 | 228.000 | - | 109.17% | - |
481.wrf (max) | 39.46% | 147.000 | 205.000 | - | -94.61% | - |
429.mcf (max) | 36.07% | 463.000 | 630.000 | - | -52.34% | - |
400.perlbench (unexplained diff vs previous) (percentage) | 35.75% | 2.070 | 2.810 | - | -99.47% | - |
400.perlbench (unexplained diff vs previous) | 32.35% | 34.000 | 45.000 | - | -99.49% | - |
447.dealII (unexplained diff vs previous) (percentage) | 26.39% | 1.440 | 1.820 | - | -99.55% | - |
464.h264ref (unexplained diff vs previous) (percentage) | 25.32% | 0.790 | 0.990 | - | -99.17% | - |
464.h264ref (unexplained diff vs previous) | 24.44% | 45.000 | 56.000 | - | -99.18% | - |
447.dealII (unexplained diff vs previous) | 24.00% | 25.000 | 31.000 | - | -99.56% | - |
435.gromacs (unexplained diff vs previous) (percentage) | 15.17% | 3.890 | 4.480 | - | -95.37% | - |
401.bzip2 (unexplained diff vs previous) (percentage) | 13.89% | 1.080 | 1.230 | - | -99.67% | - |
401.bzip2 (unexplained diff vs previous) | 12.50% | 32.000 | 36.000 | - | -99.67% | - |
459.GemsFDTD (max) (percentage) | 11.99% | 2.670 | 2.990 | - | -95.82% | - |
483.xalancbmk (unexplained diff vs previous) (percentage) | 10.59% | 2.360 | 2.610 | - | -98.81% | - |
435.gromacs (unexplained diff vs previous) | 10.03% | 289.000 | 318.000 | - | -95.48% | - |
433.milc (max) | 8.82% | 34.000 | 37.000 | - | -96.46% | - |
470.lbm (unexplained diff vs previous) (percentage) | 8.57% | 1.050 | 1.140 | - | -99.57% | - |
459.GemsFDTD (max) | 8.43% | 166.000 | 180.000 | - | -95.92% | - |
458.sjeng (unexplained diff vs previous) (percentage) | 8.20% | 1.830 | 1.980 | - | -97.82% | - |
483.xalancbmk (unexplained diff vs previous) | 7.87% | 89.000 | 96.000 | - | -98.85% | - |
429.mcf (avg) (percentage) | 7.72% | 11.270 | 12.140 | - | 58.28% | - |
470.lbm (unexplained diff vs previous) | 7.50% | 40.000 | 43.000 | - | -99.57% | - |
458.sjeng (unexplained diff vs previous) | 5.76% | 139.000 | 147.000 | - | -97.86% | - |
403.gcc (max) | 5.71% | 35.000 | 37.000 | - | -32.73% | - |
435.gromacs (max) (percentage) | 5.68% | 4.050 | 4.280 | - | -91.29% | - |
473.astar (unexplained diff vs previous) (percentage) | 5.20% | 4.420 | 4.650 | - | -97.65% | - |
465.tonto (max) (percentage) | 4.52% | 3.100 | 3.240 | - | -83.22% | - |
458.sjeng (max) (percentage) | 3.74% | 1.870 | 1.940 | - | -95.93% | - |
433.milc (max) (percentage) | 2.96% | 3.040 | 3.130 | - | -96.55% | - |
436.cactusADM | 2.80% | 107.000 | 110.000 | - | -11.29% | - |
436.cactusADM (avg) | 2.80% | 107.000 | 110.000 | - | -11.29% | - |
458.sjeng (max) | 2.13% | 141.000 | 144.000 | - | -96.00% | - |
454.calculix (unexplained diff vs previous) (percentage) | 1.83% | 1.640 | 1.670 | - | -100.00% | - |
429.mcf (max) (percentage) | 1.79% | 32.930 | 33.520 | - | -63.91% | - |
433.milc | 1.69% | 59.000 | 60.000 | - | -13.04% | - |
433.milc (avg) | 1.69% | 59.000 | 60.000 | - | -13.04% | - |
435.gromacs (max) | 1.33% | 300.000 | 304.000 | - | -91.49% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
473.astar | -4.44% | 5136.000 | 4908.000 | - | -4.29% | - |
435.gromacs | -4.28% | 7422.000 | 7104.000 | - | -2.27% | - |
481.wrf | -3.84% | 5570.000 | 5356.000 | - | -3.22% | - |
465.tonto | -3.24% | 10936.000 | 10582.000 | - | -3.28% | - |
459.GemsFDTD | -2.99% | 6221.000 | 6035.000 | - | -2.24% | - |
400.perlbench | -2.74% | 1645.000 | 1600.000 | - | -3.79% | - |
483.xalancbmk | -2.54% | 3778.000 | 3682.000 | - | -3.56% | - |
458.sjeng | -1.94% | 7586.000 | 7439.000 | - | -1.69% | - |
447.dealII | -1.79% | 1733.000 | 1702.000 | - | -1.28% | - |
454.calculix | -1.64% | 61.000 | 60.000 | - | -3.23% | - |
450.soplex | -1.53% | 588.000 | 579.000 | - | 2.12% | - |
444.namd | -1.34% | 747.000 | 737.000 | - | -1.34% | - |
471.omnetpp | -1.25% | 2710.000 | 2676.000 | - | -1.76% | - |
401.bzip2 | -1.21% | 2972.000 | 2936.000 | - | -0.17% | - |
482.sphinx3 | -1.18% | 936.000 | 925.000 | - | -2.12% | - |
470.lbm | -1.13% | 3807.000 | 3764.000 | - | -0.63% | - |
445.gobmk | -1.01% | 5059.000 | 5008.000 | - | -0.30% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
456.hmmer (max) | -98.63% | 1172.000 | 16.000 | - | -99.25% | - |
456.hmmer (max) (percentage) | -98.62% | 40.470 | 0.560 | - | -99.24% | - |
437.leslie3d (unexplained diff vs previous) | -97.10% | 138.000 | 4.000 | - | -99.83% | - |
437.leslie3d (unexplained diff vs previous) (percentage) | -96.85% | 1.270 | 0.040 | - | -99.80% | - |
456.hmmer (unexplained diff vs previous) (percentage) | -94.92% | 0.590 | 0.030 | - | -99.99% | - |
456.hmmer (unexplained diff vs previous) | -94.12% | 17.000 | 1.000 | - | -99.99% | - |
410.bwaves (unexplained diff vs previous) | -68.75% | 16.000 | 5.000 | - | -99.94% | - |
410.bwaves (unexplained diff vs previous) (percentage) | -67.86% | 0.280 | 0.090 | - | -99.93% | - |
462.libquantum (unexplained diff vs previous) (percentage) | -66.67% | 2.160 | 0.720 | - | -99.99% | - |
462.libquantum (unexplained diff vs previous) | -66.67% | 3.000 | 1.000 | - | -99.99% | - |
434.zeusmp (unexplained diff vs previous) (percentage) | -65.07% | 2.720 | 0.950 | - | -99.79% | - |
434.zeusmp (unexplained diff vs previous) | -64.71% | 68.000 | 24.000 | - | -99.79% | - |
471.omnetpp (unexplained diff vs previous) | -63.83% | 94.000 | 34.000 | - | -99.68% | - |
471.omnetpp (unexplained diff vs previous) (percentage) | -63.40% | 3.470 | 1.270 | - | -99.68% | - |
453.povray (unexplained diff vs previous) | -55.56% | 9.000 | 4.000 | - | -99.93% | - |
453.povray (unexplained diff vs previous) (percentage) | -55.21% | 1.630 | 0.730 | - | -99.93% | - |
482.sphinx3 (unexplained diff vs previous) | -54.17% | 24.000 | 11.000 | - | -99.96% | - |
482.sphinx3 (unexplained diff vs previous) (percentage) | -53.52% | 2.560 | 1.190 | - | -99.96% | - |
429.mcf (unexplained diff vs previous) (percentage) | -31.49% | 36.650 | 25.110 | - | -98.08% | - |
436.cactusADM (unexplained diff vs previous) (percentage) | -26.35% | 4.820 | 3.550 | - | -99.55% | - |
445.gobmk (unexplained diff vs previous) | -26.09% | 69.000 | 51.000 | - | -99.09% | - |
445.gobmk (unexplained diff vs previous) (percentage) | -25.00% | 1.360 | 1.020 | - | -99.08% | - |
444.namd (max) | -25.00% | 12.000 | 9.000 | - | -98.69% | - |
462.libquantum (max) | -25.00% | 4.000 | 3.000 | - | -97.83% | - |
436.cactusADM (unexplained diff vs previous) | -23.76% | 101.000 | 77.000 | - | -99.53% | - |
416.gamess (unexplained diff vs previous) (percentage) | -23.64% | 0.550 | 0.420 | - | -99.33% | - |
416.gamess (unexplained diff vs previous) | -23.53% | 68.000 | 52.000 | - | -99.33% | - |
444.namd (max) (percentage) | -17.79% | 1.630 | 1.340 | - | -98.54% | - |
434.zeusmp (max) | -16.67% | 66.000 | 55.000 | - | -97.32% | - |
444.namd (unexplained diff vs previous) | -16.67% | 12.000 | 10.000 | - | -99.88% | - |
434.zeusmp (max) (percentage) | -16.60% | 2.650 | 2.210 | - | -97.30% | - |
444.namd (unexplained diff vs previous) (percentage) | -15.53% | 1.610 | 1.360 | - | -99.88% | - |
471.omnetpp (max) | -13.40% | 97.000 | 84.000 | - | -96.13% | - |
471.omnetpp (max) (percentage) | -12.53% | 3.590 | 3.140 | - | -96.06% | - |
462.libquantum | -12.50% | 8.000 | 7.000 | - | -30.00% | - |
462.libquantum (avg) | -12.50% | 8.000 | 7.000 | - | -30.00% | - |
410.bwaves (max) | -12.31% | 65.000 | 57.000 | - | -98.26% | - |
410.bwaves (max) (percentage) | -11.40% | 1.140 | 1.010 | - | -98.26% | - |
453.povray (max) | -11.11% | 9.000 | 8.000 | - | -98.40% | - |
483.xalancbmk (max) | -11.01% | 109.000 | 97.000 | - | -96.30% | - |
445.gobmk (max) | -10.34% | 87.000 | 78.000 | - | -97.05% | - |
453.povray (max) (percentage) | -10.24% | 1.660 | 1.490 | - | -98.37% | - |
462.libquantum (max) (percentage) | -10.14% | 2.960 | 2.660 | - | -97.31% | - |
436.cactusADM (max) (percentage) | -10.00% | 4.600 | 4.140 | - | -95.33% | - |
416.gamess (max) (percentage) | -9.09% | 0.550 | 0.500 | - | -98.70% | - |
416.gamess (max) | -8.82% | 68.000 | 62.000 | - | -98.71% | - |
445.gobmk (max) (percentage) | -8.72% | 1.720 | 1.570 | - | -97.02% | - |
483.xalancbmk (max) (percentage) | -8.65% | 2.890 | 2.640 | - | -96.16% | - |
482.sphinx3 (max) | -8.57% | 35.000 | 32.000 | - | -96.49% | - |
437.leslie3d (max) (percentage) | -8.55% | 3.040 | 2.780 | - | -83.23% | - |
429.mcf (unexplained diff vs previous) | -8.53% | 516.000 | 472.000 | - | -97.46% | - |
437.leslie3d (max) | -8.51% | 329.000 | 301.000 | - | -84.40% | - |
473.astar (max) | -8.44% | 237.000 | 217.000 | - | -93.63% | - |
436.cactusADM (max) | -7.29% | 96.000 | 89.000 | - | -95.18% | - |
464.h264ref (max) | -6.78% | 59.000 | 55.000 | - | -98.24% | - |
450.soplex | -6.67% | 30.000 | 28.000 | - | -22.22% | - |
450.soplex (avg) | -6.67% | 30.000 | 28.000 | - | -22.22% | - |
482.sphinx3 (max) (percentage) | -6.65% | 3.760 | 3.510 | - | -96.36% | - |
454.calculix (max) (percentage) | -6.31% | 9.660 | 9.050 | - | -90.93% | - |
470.lbm (max) | -5.98% | 117.000 | 110.000 | - | -95.99% | - |
401.bzip2 (max) | -5.66% | 53.000 | 50.000 | - | -97.84% | - |
400.perlbench | -5.19% | 77.000 | 73.000 | - | -30.48% | - |
400.perlbench (avg) | -5.19% | 77.000 | 73.000 | - | -30.48% | - |
483.xalancbmk | -5.18% | 193.000 | 183.000 | - | -26.21% | - |
483.xalancbmk (avg) | -5.18% | 193.000 | 183.000 | - | -26.21% | - |
416.gamess | -4.90% | 367.000 | 349.000 | - | -36.55% | - |
416.gamess (avg) | -4.90% | 367.000 | 349.000 | - | -36.55% | - |
470.lbm (max) (percentage) | -4.87% | 3.080 | 2.930 | - | -95.96% | - |
464.h264ref (max) (percentage) | -4.85% | 1.030 | 0.980 | - | -98.19% | - |
481.wrf | -4.80% | 250.000 | 238.000 | - | -31.01% | - |
481.wrf (avg) | -4.80% | 250.000 | 238.000 | - | -31.01% | - |
450.soplex (max) (percentage) | -4.68% | 4.910 | 4.680 | - | -95.14% | - |
471.omnetpp | -4.55% | 176.000 | 168.000 | - | -24.66% | - |
471.omnetpp (avg) | -4.55% | 176.000 | 168.000 | - | -24.66% | - |
401.bzip2 (max) (percentage) | -4.44% | 1.800 | 1.720 | - | -97.81% | - |
416.gamess (avg) (percentage) | -4.41% | 2.950 | 2.820 | - | -36.20% | - |
456.hmmer | -4.35% | 92.000 | 88.000 | - | -30.71% | - |
456.hmmer (avg) | -4.35% | 92.000 | 88.000 | - | -30.71% | - |
437.leslie3d | -4.30% | 349.000 | 334.000 | - | -5.92% | - |
437.leslie3d (avg) | -4.30% | 349.000 | 334.000 | - | -5.92% | - |
435.gromacs | -4.22% | 308.000 | 295.000 | - | -19.62% | - |
435.gromacs (avg) | -4.22% | 308.000 | 295.000 | - | -19.62% | - |
459.GemsFDTD | -4.15% | 289.000 | 277.000 | - | -23.06% | - |
459.GemsFDTD (avg) | -4.15% | 289.000 | 277.000 | - | -23.06% | - |
473.astar | -4.06% | 197.000 | 189.000 | - | -11.27% | - |
473.astar (avg) | -4.06% | 197.000 | 189.000 | - | -11.27% | - |
447.dealII | -4.05% | 74.000 | 71.000 | - | -28.28% | - |
447.dealII (avg) | -4.05% | 74.000 | 71.000 | - | -28.28% | - |
437.leslie3d (avg) (percentage) | -4.04% | 3.220 | 3.090 | - | 1.31% | - |
453.povray (avg) (percentage) | -3.98% | 5.530 | 5.310 | - | -32.01% | - |
445.gobmk | -3.97% | 151.000 | 145.000 | - | -26.02% | - |
445.gobmk (avg) | -3.97% | 151.000 | 145.000 | - | -26.02% | - |
401.bzip2 | -3.97% | 126.000 | 121.000 | - | -24.84% | - |
401.bzip2 (avg) | -3.97% | 126.000 | 121.000 | - | -24.84% | - |
444.namd | -3.92% | 51.000 | 49.000 | - | -27.94% | - |
444.namd (avg) | -3.92% | 51.000 | 49.000 | - | -27.94% | - |
473.astar (max) (percentage) | -3.90% | 4.620 | 4.440 | - | -93.32% | - |
410.bwaves | -3.86% | 207.000 | 199.000 | - | -20.08% | - |
410.bwaves (avg) | -3.86% | 207.000 | 199.000 | - | -20.08% | - |
470.lbm | -3.78% | 185.000 | 178.000 | - | -25.52% | - |
470.lbm (avg) | -3.78% | 185.000 | 178.000 | - | -25.52% | - |
456.hmmer (avg) (percentage) | -3.76% | 3.190 | 3.070 | - | -30.39% | - |
464.h264ref | -3.74% | 214.000 | 206.000 | - | -29.69% | - |
464.h264ref (avg) | -3.74% | 214.000 | 206.000 | - | -29.69% | - |
400.perlbench (max) | -3.64% | 55.000 | 53.000 | - | -96.21% | - |
410.bwaves (avg) (percentage) | -3.59% | 3.620 | 3.490 | - | -20.86% | - |
450.soplex (max) | -3.57% | 28.000 | 27.000 | - | -95.05% | - |
482.sphinx3 | -3.45% | 58.000 | 56.000 | - | -24.32% | - |
482.sphinx3 (avg) | -3.45% | 58.000 | 56.000 | - | -24.32% | - |
454.calculix (avg) (percentage) | -3.44% | 6.390 | 6.170 | - | -23.07% | - |
444.namd (avg) (percentage) | -3.34% | 6.880 | 6.650 | - | -27.87% | - |
453.povray | -3.33% | 30.000 | 29.000 | - | -30.95% | - |
453.povray (avg) | -3.33% | 30.000 | 29.000 | - | -30.95% | - |
482.sphinx3 (avg) (percentage) | -3.33% | 6.300 | 6.090 | - | -23.20% | - |
447.dealII (max) | -3.23% | 31.000 | 30.000 | - | -97.83% | - |
462.libquantum (avg) (percentage) | -3.09% | 5.820 | 5.640 | - | -26.37% | - |
471.omnetpp (avg) (percentage) | -3.08% | 6.500 | 6.300 | - | -23.17% | - |
445.gobmk (avg) (percentage) | -3.01% | 2.990 | 2.900 | - | -25.83% | - |
464.h264ref (avg) (percentage) | -2.93% | 3.750 | 3.640 | - | -28.49% | - |
433.milc (unexplained diff vs previous) (percentage) | -2.88% | 3.130 | 3.040 | - | -99.69% | - |
470.lbm (avg) (percentage) | -2.87% | 4.870 | 4.730 | - | -25.28% | - |
434.zeusmp (avg) (percentage) | -2.85% | 4.560 | 4.430 | - | -24.27% | - |
447.dealII (avg) (percentage) | -2.78% | 4.310 | 4.190 | - | -27.38% | - |
450.soplex (avg) (percentage) | -2.72% | 5.140 | 5.000 | - | -22.24% | - |
434.zeusmp | -2.63% | 114.000 | 111.000 | - | -24.49% | - |
434.zeusmp (avg) | -2.63% | 114.000 | 111.000 | - | -24.49% | - |
458.sjeng | -2.60% | 192.000 | 187.000 | - | -22.41% | - |
458.sjeng (avg) | -2.60% | 192.000 | 187.000 | - | -22.41% | - |
401.bzip2 (avg) (percentage) | -2.59% | 4.250 | 4.140 | - | -24.45% | - |
465.tonto | -2.51% | 319.000 | 311.000 | - | -14.79% | - |
465.tonto (avg) | -2.51% | 319.000 | 311.000 | - | -14.79% | - |
483.xalancbmk (avg) (percentage) | -2.35% | 5.110 | 4.990 | - | -23.23% | - |
400.perlbench (max) (percentage) | -2.06% | 3.390 | 3.320 | - | -96.05% | - |
400.perlbench (avg) (percentage) | -1.91% | 4.710 | 4.620 | - | -27.24% | - |
403.gcc (max) (percentage) | -1.66% | 64.960 | 63.880 | - | -35.71% | - |
459.GemsFDTD (avg) (percentage) | -1.50% | 4.660 | 4.590 | - | -21.40% | - |
433.milc (avg) (percentage) | -1.36% | 5.140 | 5.070 | - | -16.20% | - |
Added Tests - sample variability |
---|
459.GemsFDTD (unexplained diff vs previous) |
459.GemsFDTD (unexplained diff vs previous) (percentage) |
465.tonto (unexplained diff vs previous) |
465.tonto (unexplained diff vs previous) (percentage) |
Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
459.GemsFDTD | 1.73% | 244728.000 | 248972.000 | - | 0.00% | - |
436.cactusADM | 1.16% | 352891.000 | 356967.000 | - | 0.00% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
429.mcf | 32.02% | 1424.000 | 1880.000 | - | 33.52% | - |
403.gcc | 5.36% | 56.000 | 59.000 | - | 9.26% | - |
436.cactusADM | 4.27% | 2083.000 | 2172.000 | - | 3.68% | - |
433.milc | 2.95% | 1151.000 | 1185.000 | - | 3.13% | - |
450.soplex | 2.12% | 567.000 | 579.000 | - | -1.53% | - |
410.bwaves | 1.36% | 5652.000 | 5729.000 | - | -0.09% | - |
Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
429.mcf | 109.17% | 109.000 | 228.000 | - | 44.30% | - |
429.mcf (avg) | 109.17% | 109.000 | 228.000 | - | 44.30% | - |
429.mcf (avg) (percentage) | 58.28% | 7.670 | 12.140 | - | 7.72% | - |
437.leslie3d (avg) (percentage) | 1.31% | 3.050 | 3.090 | - | -4.04% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
464.h264ref | -1.12% | 387748.000 | 383408.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
437.leslie3d | -6.87% | 11640.000 | 10840.000 | - | -0.04% | - |
473.astar | -4.29% | 5128.000 | 4908.000 | - | -4.44% | - |
400.perlbench | -3.79% | 1663.000 | 1600.000 | - | -2.74% | - |
483.xalancbmk | -3.56% | 3818.000 | 3682.000 | - | -2.54% | - |
465.tonto | -3.28% | 10941.000 | 10582.000 | - | -3.24% | - |
454.calculix | -3.23% | 62.000 | 60.000 | - | -1.64% | - |
481.wrf | -3.22% | 5534.000 | 5356.000 | - | -3.84% | - |
435.gromacs | -2.27% | 7269.000 | 7104.000 | - | -4.28% | - |
459.GemsFDTD | -2.24% | 6173.000 | 6035.000 | - | -2.99% | - |
482.sphinx3 | -2.12% | 945.000 | 925.000 | - | -1.18% | - |
471.omnetpp | -1.76% | 2724.000 | 2676.000 | - | -1.25% | - |
458.sjeng | -1.69% | 7567.000 | 7439.000 | - | -1.94% | - |
464.h264ref | -1.51% | 5761.000 | 5674.000 | - | -0.98% | - |
462.libquantum | -1.43% | 140.000 | 138.000 | - | -0.72% | - |
444.namd | -1.34% | 747.000 | 737.000 | - | -1.34% | - |
447.dealII | -1.28% | 1724.000 | 1702.000 | - | -1.79% | - |
Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
454.calculix (unexplained diff vs previous) | -100.00% | 22953.000 | 1.000 | - | 0.00% | - |
454.calculix (unexplained diff vs previous) (percentage) | -100.00% | 37020.970 | 1.670 | - | 1.83% | - |
462.libquantum (unexplained diff vs previous) | -99.99% | 13518.000 | 1.000 | - | -66.67% | - |
462.libquantum (unexplained diff vs previous) (percentage) | -99.99% | 9655.710 | 0.720 | - | -66.67% | - |
456.hmmer (unexplained diff vs previous) (percentage) | -99.99% | 278.630 | 0.030 | - | -94.92% | - |
456.hmmer (unexplained diff vs previous) | -99.99% | 8030.000 | 1.000 | - | -94.12% | - |
482.sphinx3 (unexplained diff vs previous) | -99.96% | 26073.000 | 11.000 | - | -54.17% | - |
482.sphinx3 (unexplained diff vs previous) (percentage) | -99.96% | 2759.050 | 1.190 | - | -53.52% | - |
450.soplex (unexplained diff vs previous) (percentage) | -99.94% | 2557.320 | 1.550 | - | 127.94% | - |
450.soplex (unexplained diff vs previous) | -99.94% | 14500.000 | 9.000 | - | 125.00% | - |
410.bwaves (unexplained diff vs previous) | -99.94% | 7794.000 | 5.000 | - | -68.75% | - |
410.bwaves (unexplained diff vs previous) (percentage) | -99.93% | 137.900 | 0.090 | - | -67.86% | - |
453.povray (unexplained diff vs previous) (percentage) | -99.93% | 1043.330 | 0.730 | - | -55.21% | - |
453.povray (unexplained diff vs previous) | -99.93% | 5707.000 | 4.000 | - | -55.56% | - |
444.namd (unexplained diff vs previous) | -99.88% | 8356.000 | 10.000 | - | -16.67% | - |
444.namd (unexplained diff vs previous) (percentage) | -99.88% | 1118.610 | 1.360 | - | -15.53% | - |
437.leslie3d (unexplained diff vs previous) | -99.83% | 2314.000 | 4.000 | - | -97.10% | - |
437.leslie3d (unexplained diff vs previous) (percentage) | -99.80% | 19.880 | 0.040 | - | -96.85% | - |
434.zeusmp (unexplained diff vs previous) (percentage) | -99.79% | 448.690 | 0.950 | - | -65.07% | - |
434.zeusmp (unexplained diff vs previous) | -99.79% | 11280.000 | 24.000 | - | -64.71% | - |
433.milc (unexplained diff vs previous) (percentage) | -99.69% | 980.800 | 3.040 | - | -2.88% | - |
433.milc (unexplained diff vs previous) | -99.68% | 11289.000 | 36.000 | - | 0.00% | - |
471.omnetpp (unexplained diff vs previous) | -99.68% | 10659.000 | 34.000 | - | -63.83% | - |
471.omnetpp (unexplained diff vs previous) (percentage) | -99.68% | 391.300 | 1.270 | - | -63.40% | - |
401.bzip2 (unexplained diff vs previous) | -99.67% | 10833.000 | 36.000 | - | 12.50% | - |
401.bzip2 (unexplained diff vs previous) (percentage) | -99.67% | 368.340 | 1.230 | - | 13.89% | - |
470.lbm (unexplained diff vs previous) | -99.57% | 9990.000 | 43.000 | - | 7.50% | - |
470.lbm (unexplained diff vs previous) (percentage) | -99.57% | 263.730 | 1.140 | - | 8.57% | - |
447.dealII (unexplained diff vs previous) | -99.56% | 7017.000 | 31.000 | - | 24.00% | - |
447.dealII (unexplained diff vs previous) (percentage) | -99.55% | 407.020 | 1.820 | - | 26.39% | - |
436.cactusADM (unexplained diff vs previous) (percentage) | -99.55% | 787.130 | 3.550 | - | -26.35% | - |
436.cactusADM (unexplained diff vs previous) | -99.53% | 16396.000 | 77.000 | - | -23.76% | - |
400.perlbench (unexplained diff vs previous) | -99.49% | 8772.000 | 45.000 | - | 32.35% | - |
400.perlbench (unexplained diff vs previous) (percentage) | -99.47% | 527.480 | 2.810 | - | 35.75% | - |
416.gamess (unexplained diff vs previous) | -99.33% | 7819.000 | 52.000 | - | -23.53% | - |
416.gamess (unexplained diff vs previous) (percentage) | -99.33% | 62.730 | 0.420 | - | -23.64% | - |
456.hmmer (max) | -99.25% | 2120.000 | 16.000 | - | -98.63% | - |
456.hmmer (max) (percentage) | -99.24% | 73.590 | 0.560 | - | -98.62% | - |
464.h264ref (unexplained diff vs previous) | -99.18% | 6843.000 | 56.000 | - | 24.44% | - |
464.h264ref (unexplained diff vs previous) (percentage) | -99.17% | 118.780 | 0.990 | - | 25.32% | - |
445.gobmk (unexplained diff vs previous) | -99.09% | 5581.000 | 51.000 | - | -26.09% | - |
445.gobmk (unexplained diff vs previous) (percentage) | -99.08% | 111.110 | 1.020 | - | -25.00% | - |
483.xalancbmk (unexplained diff vs previous) | -98.85% | 8368.000 | 96.000 | - | 7.87% | - |
483.xalancbmk (unexplained diff vs previous) (percentage) | -98.81% | 219.170 | 2.610 | - | 10.59% | - |
459.GemsFDTD (unexplained diff vs previous) | -98.80% | 15458.000 | 186.000 | - | 0.00% | - |
459.GemsFDTD (unexplained diff vs previous) (percentage) | -98.77% | 250.410 | 3.080 | - | 0.00% | - |
416.gamess (max) | -98.71% | 4805.000 | 62.000 | - | -8.82% | - |
416.gamess (max) (percentage) | -98.70% | 38.550 | 0.500 | - | -9.09% | - |
444.namd (max) | -98.69% | 685.000 | 9.000 | - | -25.00% | - |
444.namd (max) (percentage) | -98.54% | 91.790 | 1.340 | - | -17.79% | - |
453.povray (max) | -98.40% | 499.000 | 8.000 | - | -11.11% | - |
453.povray (max) (percentage) | -98.37% | 91.250 | 1.490 | - | -10.24% | - |
410.bwaves (max) | -98.26% | 3276.000 | 57.000 | - | -12.31% | - |
410.bwaves (max) (percentage) | -98.26% | 57.970 | 1.010 | - | -11.40% | - |
464.h264ref (max) | -98.24% | 3127.000 | 55.000 | - | -6.78% | - |
481.wrf (unexplained diff vs previous) | -98.24% | 12149.000 | 214.000 | - | 48.61% | - |
464.h264ref (max) (percentage) | -98.19% | 54.290 | 0.980 | - | -4.85% | - |
481.wrf (unexplained diff vs previous) (percentage) | -98.18% | 219.530 | 4.000 | - | 54.44% | - |
429.mcf (unexplained diff vs previous) (percentage) | -98.08% | 1305.690 | 25.110 | - | -31.49% | - |
458.sjeng (unexplained diff vs previous) | -97.86% | 6876.000 | 147.000 | - | 5.76% | - |
401.bzip2 (max) | -97.84% | 2313.000 | 50.000 | - | -5.66% | - |
447.dealII (max) | -97.83% | 1384.000 | 30.000 | - | -3.23% | - |
462.libquantum (max) | -97.83% | 138.000 | 3.000 | - | -25.00% | - |
458.sjeng (unexplained diff vs previous) (percentage) | -97.82% | 90.870 | 1.980 | - | 8.20% | - |
401.bzip2 (max) (percentage) | -97.81% | 78.650 | 1.720 | - | -4.44% | - |
447.dealII (max) (percentage) | -97.77% | 80.280 | 1.790 | - | -0.56% | - |
473.astar (unexplained diff vs previous) | -97.75% | 10146.000 | 228.000 | - | 0.44% | - |
473.astar (unexplained diff vs previous) (percentage) | -97.65% | 197.850 | 4.650 | - | 5.20% | - |
429.mcf (unexplained diff vs previous) | -97.46% | 18593.000 | 472.000 | - | -8.53% | - |
434.zeusmp (max) | -97.32% | 2055.000 | 55.000 | - | -16.67% | - |
462.libquantum (max) (percentage) | -97.31% | 98.970 | 2.660 | - | -10.14% | - |
434.zeusmp (max) (percentage) | -97.30% | 81.770 | 2.210 | - | -16.60% | - |
445.gobmk (max) | -97.05% | 2643.000 | 78.000 | - | -10.34% | - |
445.gobmk (max) (percentage) | -97.02% | 52.630 | 1.570 | - | -8.72% | - |
433.milc (max) (percentage) | -96.55% | 90.750 | 3.130 | - | 2.96% | - |
482.sphinx3 (max) | -96.49% | 911.000 | 32.000 | - | -8.57% | - |
433.milc (max) | -96.46% | 1044.000 | 37.000 | - | 8.82% | - |
482.sphinx3 (max) (percentage) | -96.36% | 96.500 | 3.510 | - | -6.65% | - |
483.xalancbmk (max) | -96.30% | 2621.000 | 97.000 | - | -11.01% | - |
400.perlbench (max) | -96.21% | 1397.000 | 53.000 | - | -3.64% | - |
483.xalancbmk (max) (percentage) | -96.16% | 68.670 | 2.640 | - | -8.65% | - |
471.omnetpp (max) | -96.13% | 2169.000 | 84.000 | - | -13.40% | - |
471.omnetpp (max) (percentage) | -96.06% | 79.650 | 3.140 | - | -12.53% | - |
400.perlbench (max) (percentage) | -96.05% | 84.060 | 3.320 | - | -2.06% | - |
458.sjeng (max) | -96.00% | 3602.000 | 144.000 | - | 2.13% | - |
470.lbm (max) | -95.99% | 2746.000 | 110.000 | - | -5.98% | - |
470.lbm (max) (percentage) | -95.96% | 72.510 | 2.930 | - | -4.87% | - |
458.sjeng (max) (percentage) | -95.93% | 47.610 | 1.940 | - | 3.74% | - |
459.GemsFDTD (max) | -95.92% | 4411.000 | 180.000 | - | 8.43% | - |
459.GemsFDTD (max) (percentage) | -95.82% | 71.460 | 2.990 | - | 11.99% | - |
435.gromacs (unexplained diff vs previous) | -95.48% | 7028.000 | 318.000 | - | 10.03% | - |
435.gromacs (unexplained diff vs previous) (percentage) | -95.37% | 96.680 | 4.480 | - | 15.17% | - |
436.cactusADM (max) (percentage) | -95.33% | 88.730 | 4.140 | - | -10.00% | - |
436.cactusADM (max) | -95.18% | 1848.000 | 89.000 | - | -7.29% | - |
450.soplex (max) (percentage) | -95.14% | 96.240 | 4.680 | - | -4.68% | - |
450.soplex (max) | -95.05% | 545.000 | 27.000 | - | -3.57% | - |
481.wrf (max) | -94.61% | 3801.000 | 205.000 | - | 39.46% | - |
481.wrf (max) (percentage) | -94.41% | 68.700 | 3.840 | - | 44.91% | - |
473.astar (max) | -93.63% | 3406.000 | 217.000 | - | -8.44% | - |
473.astar (max) (percentage) | -93.32% | 66.430 | 4.440 | - | -3.90% | - |
454.calculix (max) | -91.80% | 61.000 | 5.000 | - | 0.00% | - |
435.gromacs (max) | -91.49% | 3573.000 | 304.000 | - | 1.33% | - |
435.gromacs (max) (percentage) | -91.29% | 49.160 | 4.280 | - | 5.68% | - |
454.calculix (max) (percentage) | -90.93% | 99.730 | 9.050 | - | -6.31% | - |
437.leslie3d (max) | -84.40% | 1929.000 | 301.000 | - | -8.51% | - |
465.tonto (max) | -83.81% | 2112.000 | 342.000 | - | 0.88% | - |
437.leslie3d (max) (percentage) | -83.23% | 16.580 | 2.780 | - | -8.55% | - |
465.tonto (max) (percentage) | -83.22% | 19.310 | 3.240 | - | 4.52% | - |
465.tonto (unexplained diff vs previous) | -80.01% | 1771.000 | 354.000 | - | 0.00% | - |
465.tonto (unexplained diff vs previous) (percentage) | -79.31% | 16.190 | 3.350 | - | 0.00% | - |
429.mcf (max) (percentage) | -63.91% | 92.890 | 33.520 | - | 1.79% | - |
429.mcf (max) | -52.34% | 1322.000 | 630.000 | - | 36.07% | - |
416.gamess | -36.55% | 550.000 | 349.000 | - | -4.90% | - |
416.gamess (avg) | -36.55% | 550.000 | 349.000 | - | -4.90% | - |
416.gamess (avg) (percentage) | -36.20% | 4.420 | 2.820 | - | -4.41% | - |
403.gcc (max) (percentage) | -35.71% | 99.360 | 63.880 | - | -1.66% | - |
403.gcc (max) | -32.73% | 55.000 | 37.000 | - | 5.71% | - |
453.povray (avg) (percentage) | -32.01% | 7.810 | 5.310 | - | -3.98% | - |
481.wrf | -31.01% | 345.000 | 238.000 | - | -4.80% | - |
481.wrf (avg) | -31.01% | 345.000 | 238.000 | - | -4.80% | - |
453.povray | -30.95% | 42.000 | 29.000 | - | -3.33% | - |
453.povray (avg) | -30.95% | 42.000 | 29.000 | - | -3.33% | - |
456.hmmer | -30.71% | 127.000 | 88.000 | - | -4.35% | - |
456.hmmer (avg) | -30.71% | 127.000 | 88.000 | - | -4.35% | - |
400.perlbench | -30.48% | 105.000 | 73.000 | - | -5.19% | - |
400.perlbench (avg) | -30.48% | 105.000 | 73.000 | - | -5.19% | - |
456.hmmer (avg) (percentage) | -30.39% | 4.410 | 3.070 | - | -3.76% | - |
462.libquantum | -30.00% | 10.000 | 7.000 | - | -12.50% | - |
462.libquantum (avg) | -30.00% | 10.000 | 7.000 | - | -12.50% | - |
464.h264ref | -29.69% | 293.000 | 206.000 | - | -3.74% | - |
464.h264ref (avg) | -29.69% | 293.000 | 206.000 | - | -3.74% | - |
481.wrf (avg) (percentage) | -28.53% | 6.240 | 4.460 | - | -0.67% | - |
464.h264ref (avg) (percentage) | -28.49% | 5.090 | 3.640 | - | -2.93% | - |
447.dealII | -28.28% | 99.000 | 71.000 | - | -4.05% | - |
447.dealII (avg) | -28.28% | 99.000 | 71.000 | - | -4.05% | - |
444.namd | -27.94% | 68.000 | 49.000 | - | -3.92% | - |
444.namd (avg) | -27.94% | 68.000 | 49.000 | - | -3.92% | - |
444.namd (avg) (percentage) | -27.87% | 9.220 | 6.650 | - | -3.34% | - |
447.dealII (avg) (percentage) | -27.38% | 5.770 | 4.190 | - | -2.78% | - |
400.perlbench (avg) (percentage) | -27.24% | 6.350 | 4.620 | - | -1.91% | - |
462.libquantum (avg) (percentage) | -26.37% | 7.660 | 5.640 | - | -3.09% | - |
483.xalancbmk | -26.21% | 248.000 | 183.000 | - | -5.18% | - |
483.xalancbmk (avg) | -26.21% | 248.000 | 183.000 | - | -5.18% | - |
445.gobmk | -26.02% | 196.000 | 145.000 | - | -3.97% | - |
445.gobmk (avg) | -26.02% | 196.000 | 145.000 | - | -3.97% | - |
445.gobmk (avg) (percentage) | -25.83% | 3.910 | 2.900 | - | -3.01% | - |
470.lbm | -25.52% | 239.000 | 178.000 | - | -3.78% | - |
470.lbm (avg) | -25.52% | 239.000 | 178.000 | - | -3.78% | - |
470.lbm (avg) (percentage) | -25.28% | 6.330 | 4.730 | - | -2.87% | - |
403.gcc | -25.00% | 4.000 | 3.000 | - | 0.00% | - |
403.gcc (avg) | -25.00% | 4.000 | 3.000 | - | 0.00% | - |
454.calculix | -25.00% | 4.000 | 3.000 | - | 0.00% | - |
454.calculix (avg) | -25.00% | 4.000 | 3.000 | - | 0.00% | - |
401.bzip2 | -24.84% | 161.000 | 121.000 | - | -3.97% | - |
401.bzip2 (avg) | -24.84% | 161.000 | 121.000 | - | -3.97% | - |
471.omnetpp | -24.66% | 223.000 | 168.000 | - | -4.55% | - |
471.omnetpp (avg) | -24.66% | 223.000 | 168.000 | - | -4.55% | - |
434.zeusmp | -24.49% | 147.000 | 111.000 | - | -2.63% | - |
434.zeusmp (avg) | -24.49% | 147.000 | 111.000 | - | -2.63% | - |
401.bzip2 (avg) (percentage) | -24.45% | 5.480 | 4.140 | - | -2.59% | - |
482.sphinx3 | -24.32% | 74.000 | 56.000 | - | -3.45% | - |
482.sphinx3 (avg) | -24.32% | 74.000 | 56.000 | - | -3.45% | - |
434.zeusmp (avg) (percentage) | -24.27% | 5.850 | 4.430 | - | -2.85% | - |
483.xalancbmk (avg) (percentage) | -23.23% | 6.500 | 4.990 | - | -2.35% | - |
482.sphinx3 (avg) (percentage) | -23.20% | 7.930 | 6.090 | - | -3.33% | - |
471.omnetpp (avg) (percentage) | -23.17% | 8.200 | 6.300 | - | -3.08% | - |
454.calculix (avg) (percentage) | -23.07% | 8.020 | 6.170 | - | -3.44% | - |
459.GemsFDTD | -23.06% | 360.000 | 277.000 | - | -4.15% | - |
459.GemsFDTD (avg) | -23.06% | 360.000 | 277.000 | - | -4.15% | - |
458.sjeng | -22.41% | 241.000 | 187.000 | - | -2.60% | - |
458.sjeng (avg) | -22.41% | 241.000 | 187.000 | - | -2.60% | - |
450.soplex (avg) (percentage) | -22.24% | 6.430 | 5.000 | - | -2.72% | - |
450.soplex | -22.22% | 36.000 | 28.000 | - | -6.67% | - |
450.soplex (avg) | -22.22% | 36.000 | 28.000 | - | -6.67% | - |
459.GemsFDTD (avg) (percentage) | -21.40% | 5.840 | 4.590 | - | -1.50% | - |
458.sjeng (avg) (percentage) | -21.00% | 3.190 | 2.520 | - | -0.79% | - |
410.bwaves (avg) (percentage) | -20.86% | 4.410 | 3.490 | - | -3.59% | - |
410.bwaves | -20.08% | 249.000 | 199.000 | - | -3.86% | - |
410.bwaves (avg) | -20.08% | 249.000 | 199.000 | - | -3.86% | - |
435.gromacs | -19.62% | 367.000 | 295.000 | - | -4.22% | - |
435.gromacs (avg) | -19.62% | 367.000 | 295.000 | - | -4.22% | - |
435.gromacs (avg) (percentage) | -17.79% | 5.060 | 4.160 | - | 0.24% | - |
433.milc (avg) (percentage) | -16.20% | 6.050 | 5.070 | - | -1.36% | - |
436.cactusADM (avg) (percentage) | -14.88% | 5.980 | 5.090 | - | -0.97% | - |
465.tonto | -14.79% | 365.000 | 311.000 | - | -2.51% | - |
465.tonto (avg) | -14.79% | 365.000 | 311.000 | - | -2.51% | - |
433.milc | -13.04% | 69.000 | 60.000 | - | 1.69% | - |
433.milc (avg) | -13.04% | 69.000 | 60.000 | - | 1.69% | - |
465.tonto (avg) (percentage) | -11.98% | 3.340 | 2.940 | - | 0.68% | - |
436.cactusADM | -11.29% | 124.000 | 110.000 | - | 2.80% | - |
436.cactusADM (avg) | -11.29% | 124.000 | 110.000 | - | 2.80% | - |
473.astar | -11.27% | 213.000 | 189.000 | - | -4.06% | - |
473.astar (avg) | -11.27% | 213.000 | 189.000 | - | -4.06% | - |
403.gcc (avg) (percentage) | -7.79% | 7.320 | 6.750 | - | 0.00% | - |
473.astar (avg) (percentage) | -7.21% | 4.160 | 3.860 | - | 0.52% | - |
437.leslie3d | -5.92% | 355.000 | 334.000 | - | -4.30% | - |
437.leslie3d (avg) | -5.92% | 355.000 | 334.000 | - | -4.30% | - |
Report Time: 0.37s