Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f06b840b9a063aa33b8b50745bddc8e6845c8f29 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/573dbd5175dbf16a3b4551ec55800febf0d1b617 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=db9b47e9f996bbdb831580ff7343542a017c80ee (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f130cb3a5bbed9c62474d814fc2bfec5ac66b81b (+ 216 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/19/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0019 (v6.2.8-48461-gf130cb3a5bbe) 2023-03-23T12:35:17 0:00:00
Previous 0019 (3-changed-components) 2023-02-18T02:10:43 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 71 101
Performance Improvements 159 128
Unchanged Tests 1006 1007
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.71% 922495.000 938305.000 - 0.82% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 20.33% 9150.000 11010.000 - 34.19% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 4800.00% 0.040 1.960 - -2.49% -
450.soplex (max) (percentage) 3075.00% 0.120 3.810 - 93.40% -
403.gcc (avg) (percentage) 760.81% 0.740 6.370 - 944.26% -
429.mcf (max) (percentage) 728.33% 1.800 14.910 - 2661.11% -
462.libquantum (unexplained diff vs previous) (percentage) 620.00% 0.100 0.720 - 7100.00% -
400.perlbench (unexplained diff vs previous) (percentage) 462.50% 0.400 2.250 - -32.84% -
473.astar (avg) (percentage) 444.00% 0.500 2.720 - 1331.58% -
462.libquantum (max) (percentage) 430.43% 0.230 1.220 - 90.62% -
429.mcf (avg) (percentage) 383.72% 1.290 6.240 - 1077.36% -
481.wrf (max) (percentage) 366.67% 0.390 1.820 - -42.22% -
450.soplex (avg) (percentage) 355.08% 1.180 5.370 - 333.06% -
401.bzip2 (avg) (percentage) 347.37% 0.760 3.400 - 672.73% -
437.leslie3d (max) (percentage) 316.54% 1.330 5.540 - 136.75% -
447.dealII (avg) (percentage) 271.88% 0.960 3.570 - 233.64% -
437.leslie3d (max) 229.28% 181.000 596.000 - 69.80% -
400.perlbench (avg) (percentage) 220.95% 1.480 4.750 - 223.13% -
462.libquantum (avg) (percentage) 216.26% 1.230 3.890 - 498.46% -
437.leslie3d (unexplained diff vs previous) (percentage) 215.56% 1.350 4.260 - 86.03% -
459.GemsFDTD (avg) (percentage) 209.65% 1.140 3.530 - 292.22% -
458.sjeng (avg) (percentage) 207.81% 0.640 1.970 - 496.97% -
445.gobmk (avg) (percentage) 190.32% 0.930 2.700 - 250.65% -
470.lbm (unexplained diff vs previous) (percentage) 166.67% 0.090 0.240 - 118.18% -
401.bzip2 (max) (percentage) 166.15% 1.300 3.460 - 293.18% -
454.calculix (avg) (percentage) 164.93% 2.110 5.590 - 178.11% -
433.milc (avg) (percentage) 162.84% 1.830 4.810 - 182.94% -
482.sphinx3 (avg) (percentage) 157.14% 1.750 4.500 - 208.22% -
471.omnetpp (max) (percentage) 152.35% 1.490 3.760 - -39.06% -
456.hmmer (avg) (percentage) 150.00% 1.120 2.800 - 311.76% -
437.leslie3d (unexplained diff vs previous) 148.11% 185.000 459.000 - 33.82% -
464.h264ref (avg) (percentage) 147.27% 1.100 2.720 - 403.70% -
453.povray (avg) (percentage) 146.29% 1.750 4.310 - 244.80% -
410.bwaves (avg) (percentage) 139.06% 1.280 3.060 - 180.73% -
434.zeusmp (avg) (percentage) 110.11% 1.880 3.950 - 166.89% -
403.gcc (max) (percentage) 109.25% 2.920 6.110 - 748.61% -
436.cactusADM (avg) (percentage) 105.88% 1.870 3.850 - 131.93% -
473.astar 96.30% 81.000 159.000 - 467.86% -
473.astar (avg) 96.30% 81.000 159.000 - 467.86% -
481.wrf (avg) (percentage) 95.34% 1.930 3.770 - 99.47% -
435.gromacs (avg) (percentage) 85.20% 1.960 3.630 - 109.83% -
450.soplex (unexplained diff vs previous) 83.33% 6.000 11.000 - -96.46% -
459.GemsFDTD (max) (percentage) 81.03% 1.160 2.100 - 250.00% -
464.h264ref (max) (percentage) 79.71% 0.690 1.240 - 188.37% -
471.omnetpp (avg) (percentage) 79.32% 2.370 4.250 - 167.30% -
471.omnetpp (unexplained diff vs previous) (percentage) 76.19% 0.840 1.480 - 516.67% -
435.gromacs (max) (percentage) 73.33% 1.800 3.120 - 54.46% -
458.sjeng 64.13% 92.000 151.000 - 221.28% -
458.sjeng (avg) 64.13% 92.000 151.000 - 221.28% -
437.leslie3d (avg) (percentage) 60.99% 2.230 3.590 - 50.84% -
470.lbm (avg) (percentage) 60.17% 2.410 3.860 - 62.87% -
447.dealII (unexplained diff vs previous) (percentage) 53.54% 0.990 1.520 - 94.87% -
447.dealII (max) (percentage) 53.06% 0.980 1.500 - 36.36% -
465.tonto 47.20% 214.000 315.000 - 129.93% -
465.tonto (avg) 47.20% 214.000 315.000 - 129.93% -
481.wrf (max) 45.59% 68.000 99.000 - -81.32% -
416.gamess (avg) (percentage) 41.49% 1.880 2.660 - 22.58% -
444.namd (avg) (percentage) 39.23% 3.900 5.430 - 38.17% -
445.gobmk 33.64% 107.000 143.000 - 55.43% -
445.gobmk (avg) 33.64% 107.000 143.000 - 55.43% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 29.55% 0.880 1.140 - 442.86% -
437.leslie3d 26.56% 305.000 386.000 - 8.12% -
437.leslie3d (avg) 26.56% 305.000 386.000 - 8.12% -
450.soplex (max) 23.53% 17.000 21.000 - -93.09% -
465.tonto (avg) (percentage) 22.65% 2.340 2.870 - 71.86% -
464.h264ref (unexplained diff vs previous) (percentage) 20.29% 0.690 0.830 - 730.00% -
464.h264ref 11.81% 144.000 161.000 - 106.41% -
464.h264ref (avg) 11.81% 144.000 161.000 - 106.41% -
465.tonto (unexplained diff vs previous) 10.31% 97.000 107.000 - 69.84% -
481.wrf (unexplained diff vs previous) (percentage) 4.76% 0.210 0.220 - -67.16% -
470.lbm (max) (percentage) 1.75% 0.570 0.580 - -88.63% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -6.87% 120213.000 111949.000 - -6.88% -
453.povray -1.18% 712861.000 704477.000 - -0.66% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -99.70% 21155.000 64.000 - -99.72% -
403.gcc -99.29% 8868.000 63.000 - -99.30% -
462.libquantum -98.99% 13734.000 139.000 - -98.80% -
482.sphinx3 -96.56% 27082.000 932.000 - -96.89% -
450.soplex -96.23% 14875.000 561.000 - -96.37% -
429.mcf -92.69% 20947.000 1532.000 - -91.07% -
444.namd -92.24% 9350.000 726.000 - -91.98% -
453.povray -91.35% 6266.000 542.000 - -91.72% -
433.milc -90.90% 12848.000 1169.000 - -90.99% -
436.cactusADM -88.99% 19027.000 2094.000 - -88.06% -
400.perlbench -83.50% 10247.000 1691.000 - -84.12% -
434.zeusmp -82.26% 14145.000 2510.000 - -81.00% -
447.dealII -78.93% 9373.000 1975.000 - -79.75% -
401.bzip2 -78.78% 14159.000 3005.000 - -80.21% -
471.omnetpp -78.57% 13527.000 2899.000 - -73.00% -
456.hmmer -74.36% 11291.000 2895.000 - -73.79% -
470.lbm -72.88% 13774.000 3735.000 - -70.86% -
459.GemsFDTD -71.41% 21390.000 6116.000 - -73.81% -
481.wrf -68.63% 17503.000 5491.000 - -67.38% -
483.xalancbmk -66.27% 12367.000 4171.000 - -62.67% -
473.astar -63.84% 16251.000 5876.000 - -60.65% -
410.bwaves -61.13% 15478.000 6016.000 - -59.23% -
464.h264ref -54.99% 13172.000 5929.000 - -59.27% -
445.gobmk -54.03% 11556.000 5312.000 - -55.71% -
435.gromacs -48.99% 14530.000 7412.000 - -51.93% -
458.sjeng -46.60% 14420.000 7700.000 - -46.06% -
416.gamess -44.48% 22367.000 12418.000 - -45.30% -
437.leslie3d -21.32% 13682.000 10765.000 - -28.26% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (unexplained diff vs previous) -99.90% 1001.000 1.000 - -80.00% -
454.calculix (max) -99.90% 956.000 1.000 - -99.91% -
482.sphinx3 (unexplained diff vs previous) -99.75% 405.000 1.000 - -99.46% -
454.calculix -99.33% 446.000 3.000 - -99.35% -
454.calculix (avg) -99.33% 446.000 3.000 - -99.35% -
444.namd (unexplained diff vs previous) -99.26% 135.000 1.000 - -99.86% -
403.gcc (max) -98.84% 258.000 3.000 - -95.31% -
436.cactusADM (unexplained diff vs previous) -98.73% 628.000 8.000 - -98.60% -
433.milc (unexplained diff vs previous) -98.47% 327.000 5.000 - -98.82% -
482.sphinx3 (max) -98.36% 1345.000 22.000 - -94.99% -
453.povray (max) -98.01% 453.000 9.000 - -94.55% -
456.hmmer (max) -97.50% 679.000 17.000 - -87.86% -
456.hmmer (unexplained diff vs previous) -97.35% 641.000 17.000 - -79.52% -
434.zeusmp (unexplained diff vs previous) -97.30% 445.000 12.000 - -96.10% -
453.povray (unexplained diff vs previous) -97.10% 69.000 2.000 - 100.00% -
462.libquantum -97.02% 168.000 5.000 - -93.33% -
462.libquantum (avg) -97.02% 168.000 5.000 - -93.33% -
462.libquantum (max) -96.77% 31.000 1.000 - -98.65% -
444.namd (max) -96.30% 432.000 16.000 - -97.53% -
445.gobmk (unexplained diff vs previous) -96.01% 426.000 17.000 - -90.86% -
434.zeusmp (max) -95.60% 523.000 23.000 - -92.36% -
429.mcf (unexplained diff vs previous) -95.42% 371.000 17.000 - -81.72% -
433.milc (max) -94.93% 335.000 17.000 - -95.86% -
436.cactusADM (max) -94.14% 648.000 38.000 - -93.12% -
410.bwaves (unexplained diff vs previous) -94.07% 607.000 36.000 - 140.00% -
458.sjeng (unexplained diff vs previous) -93.87% 359.000 22.000 - 144.44% -
403.gcc -93.85% 65.000 4.000 - -92.59% -
403.gcc (avg) -93.85% 65.000 4.000 - -92.59% -
462.libquantum (unexplained diff vs previous) -92.86% 14.000 1.000 - 0.00% -
416.gamess (max) -92.75% 552.000 40.000 - -93.90% -
482.sphinx3 (unexplained diff vs previous) (percentage) -92.67% 1.500 0.110 - -82.26% -
482.sphinx3 -91.33% 473.000 41.000 - -90.60% -
482.sphinx3 (avg) -91.33% 473.000 41.000 - -90.60% -
445.gobmk (unexplained diff vs previous) (percentage) -91.33% 3.690 0.320 - -79.35% -
401.bzip2 (unexplained diff vs previous) -90.36% 166.000 16.000 - -87.88% -
444.namd (unexplained diff vs previous) (percentage) -90.28% 1.440 0.140 - -98.19% -
456.hmmer (max) (percentage) -90.20% 6.020 0.590 - -53.54% -
456.hmmer (unexplained diff vs previous) (percentage) -89.61% 5.680 0.590 - -21.33% -
444.namd -89.29% 364.000 39.000 - -89.01% -
444.namd (avg) -89.29% 364.000 39.000 - -89.01% -
400.perlbench (max) -89.04% 438.000 48.000 - -86.09% -
436.cactusADM (unexplained diff vs previous) (percentage) -88.48% 3.300 0.380 - -88.31% -
458.sjeng (unexplained diff vs previous) (percentage) -88.35% 2.490 0.290 - 383.33% -
416.gamess (max) (percentage) -86.64% 2.470 0.330 - -88.58% -
434.zeusmp (unexplained diff vs previous) (percentage) -84.76% 3.150 0.480 - -79.40% -
410.bwaves (unexplained diff vs previous) (percentage) -84.69% 3.920 0.600 - 500.00% -
410.bwaves (max) -84.15% 631.000 100.000 - 233.33% -
433.milc (unexplained diff vs previous) (percentage) -83.14% 2.550 0.430 - -86.89% -
450.soplex -82.86% 175.000 30.000 - -84.29% -
450.soplex (avg) -82.86% 175.000 30.000 - -84.29% -
458.sjeng (max) -79.30% 459.000 95.000 - 206.45% -
453.povray -78.90% 109.000 23.000 - -71.60% -
453.povray (avg) -78.90% 109.000 23.000 - -71.60% -
436.cactusADM -77.46% 355.000 80.000 - -72.51% -
436.cactusADM (avg) -77.46% 355.000 80.000 - -72.51% -
453.povray (max) (percentage) -76.49% 7.230 1.700 - -32.81% -
433.milc -76.17% 235.000 56.000 - -74.55% -
433.milc (avg) -76.17% 235.000 56.000 - -74.55% -
434.zeusmp (max) (percentage) -74.86% 3.700 0.930 - -59.21% -
473.astar (unexplained diff vs previous) -74.14% 263.000 68.000 - 2166.67% -
483.xalancbmk (max) -73.54% 1096.000 290.000 - 544.44% -
473.astar (max) -73.39% 729.000 194.000 - 870.00% -
470.lbm (max) -73.08% 78.000 21.000 - -96.78% -
445.gobmk (max) -70.32% 411.000 122.000 - -33.33% -
465.tonto (max) (percentage) -68.45% 10.110 3.190 - -10.89% -
447.dealII (max) -68.13% 91.000 29.000 - -72.90% -
447.dealII (unexplained diff vs previous) -67.74% 93.000 30.000 - -60.53% -
481.wrf (unexplained diff vs previous) -67.57% 37.000 12.000 - -89.29% -
454.calculix (unexplained diff vs previous) (percentage) -67.02% 4.730 1.560 - 7700.00% -
416.gamess (unexplained diff vs previous) -66.67% 90.000 30.000 - -95.56% -
453.povray (unexplained diff vs previous) (percentage) -66.36% 1.100 0.370 - 1750.00% -
483.xalancbmk -66.21% 145.000 49.000 - -33.78% -
483.xalancbmk (avg) -66.21% 145.000 49.000 - -33.78% -
429.mcf -64.81% 270.000 95.000 - 5.56% -
429.mcf (avg) -64.81% 270.000 95.000 - 5.56% -
435.gromacs (unexplained diff vs previous) -64.29% 140.000 50.000 - -84.28% -
459.GemsFDTD (unexplained diff vs previous) -62.96% 189.000 70.000 - 45.83% -
434.zeusmp -62.64% 265.000 99.000 - -49.23% -
434.zeusmp (avg) -62.64% 265.000 99.000 - -49.23% -
471.omnetpp (unexplained diff vs previous) -62.28% 114.000 43.000 - 65.38% -
465.tonto (max) -62.05% 925.000 351.000 - 19.80% -
471.omnetpp -61.56% 320.000 123.000 - -27.65% -
471.omnetpp (avg) -61.56% 320.000 123.000 - -27.65% -
458.sjeng (max) (percentage) -61.13% 3.190 1.240 - 463.64% -
410.bwaves (max) (percentage) -59.07% 4.080 1.670 - 695.24% -
470.lbm -56.50% 331.000 144.000 - -52.48% -
470.lbm (avg) -56.50% 331.000 144.000 - -52.48% -
401.bzip2 (unexplained diff vs previous) (percentage) -54.70% 1.170 0.530 - -39.08% -
482.sphinx3 (max) (percentage) -51.91% 4.970 2.390 - 62.59% -
444.namd (max) (percentage) -50.97% 4.630 2.270 - -68.38% -
459.GemsFDTD (max) -48.39% 248.000 128.000 - -8.57% -
400.perlbench -47.02% 151.000 80.000 - -48.72% -
400.perlbench (avg) -47.02% 151.000 80.000 - -48.72% -
464.h264ref (unexplained diff vs previous) -46.15% 91.000 49.000 - 226.67% -
471.omnetpp (max) -45.77% 201.000 109.000 - -83.53% -
436.cactusADM (max) (percentage) -45.45% 3.410 1.860 - -40.95% -
433.milc (max) (percentage) -44.06% 2.610 1.460 - -53.94% -
401.bzip2 (max) -44.02% 184.000 103.000 - -22.56% -
416.gamess (unexplained diff vs previous) (percentage) -40.00% 0.400 0.240 - -91.95% -
429.mcf (max) -39.52% 377.000 228.000 - 147.83% -
481.wrf -38.58% 337.000 207.000 - -34.91% -
481.wrf (avg) -38.58% 337.000 207.000 - -34.91% -
429.mcf (unexplained diff vs previous) (percentage) -37.29% 1.770 1.110 - 105.56% -
456.hmmer -35.71% 126.000 81.000 - 8.00% -
456.hmmer (avg) -35.71% 126.000 81.000 - 8.00% -
445.gobmk (max) (percentage) -35.39% 3.560 2.300 - 50.33% -
400.perlbench (max) (percentage) -33.41% 4.280 2.850 - -12.04% -
454.calculix (max) (percentage) -31.86% 4.520 3.080 - -34.47% -
470.lbm (unexplained diff vs previous) -30.77% 13.000 9.000 - -35.71% -
435.gromacs (unexplained diff vs previous) (percentage) -30.21% 0.960 0.670 - -67.48% -
473.astar (unexplained diff vs previous) (percentage) -28.40% 1.620 1.160 - 5700.00% -
473.astar (max) (percentage) -26.28% 4.490 3.310 - 2264.29% -
483.xalancbmk (max) (percentage) -21.53% 8.870 6.960 - 1597.56% -
416.gamess -21.43% 420.000 330.000 - -32.93% -
416.gamess (avg) -21.43% 420.000 330.000 - -32.93% -
447.dealII -21.35% 89.000 70.000 - -32.69% -
447.dealII (avg) -21.35% 89.000 70.000 - -32.69% -
464.h264ref (max) -18.89% 90.000 73.000 - 17.74% -
459.GemsFDTD -11.52% 243.000 215.000 - 2.38% -
459.GemsFDTD (avg) -11.52% 243.000 215.000 - 2.38% -
435.gromacs (max) -11.49% 261.000 231.000 - -25.72% -
465.tonto (unexplained diff vs previous) (percentage) -8.49% 1.060 0.970 - 25.97% -
400.perlbench (unexplained diff vs previous) -7.32% 41.000 38.000 - -89.36% -
410.bwaves -7.07% 198.000 184.000 - 15.00% -
410.bwaves (avg) -7.07% 198.000 184.000 - 15.00% -
435.gromacs -5.28% 284.000 269.000 - 1.13% -
435.gromacs (avg) -5.28% 284.000 269.000 - 1.13% -
401.bzip2 -4.67% 107.000 102.000 - 54.55% -
401.bzip2 (avg) -4.67% 107.000 102.000 - 54.55% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 34.19% 8205.000 11010.000 - 20.33% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) 7700.00% 0.020 1.560 - -67.02% -
462.libquantum (unexplained diff vs previous) (percentage) 7100.00% 0.010 0.720 - 620.00% -
473.astar (unexplained diff vs previous) (percentage) 5700.00% 0.020 1.160 - -28.40% -
429.mcf (max) (percentage) 2661.11% 0.540 14.910 - 728.33% -
473.astar (max) (percentage) 2264.29% 0.140 3.310 - -26.28% -
473.astar (unexplained diff vs previous) 2166.67% 3.000 68.000 - -74.14% -
453.povray (unexplained diff vs previous) (percentage) 1750.00% 0.020 0.370 - -66.36% -
483.xalancbmk (max) (percentage) 1597.56% 0.410 6.960 - -21.53% -
473.astar (avg) (percentage) 1331.58% 0.190 2.720 - 444.00% -
429.mcf (avg) (percentage) 1077.36% 0.530 6.240 - 383.72% -
403.gcc (avg) (percentage) 944.26% 0.610 6.370 - 760.81% -
473.astar (max) 870.00% 20.000 194.000 - -73.39% -
403.gcc (max) (percentage) 748.61% 0.720 6.110 - 109.25% -
464.h264ref (unexplained diff vs previous) (percentage) 730.00% 0.100 0.830 - 20.29% -
410.bwaves (max) (percentage) 695.24% 0.210 1.670 - -59.07% -
401.bzip2 (avg) (percentage) 672.73% 0.440 3.400 - 347.37% -
483.xalancbmk (max) 544.44% 45.000 290.000 - -73.54% -
471.omnetpp (unexplained diff vs previous) (percentage) 516.67% 0.240 1.480 - 76.19% -
410.bwaves (unexplained diff vs previous) (percentage) 500.00% 0.100 0.600 - -84.69% -
462.libquantum (avg) (percentage) 498.46% 0.650 3.890 - 216.26% -
458.sjeng (avg) (percentage) 496.97% 0.330 1.970 - 207.81% -
473.astar 467.86% 28.000 159.000 - 96.30% -
473.astar (avg) 467.86% 28.000 159.000 - 96.30% -
458.sjeng (max) (percentage) 463.64% 0.220 1.240 - -61.13% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 442.86% 0.210 1.140 - 29.55% -
464.h264ref (avg) (percentage) 403.70% 0.540 2.720 - 147.27% -
458.sjeng (unexplained diff vs previous) (percentage) 383.33% 0.060 0.290 - -88.35% -
450.soplex (avg) (percentage) 333.06% 1.240 5.370 - 355.08% -
456.hmmer (avg) (percentage) 311.76% 0.680 2.800 - 150.00% -
401.bzip2 (max) (percentage) 293.18% 0.880 3.460 - 166.15% -
459.GemsFDTD (avg) (percentage) 292.22% 0.900 3.530 - 209.65% -
445.gobmk (avg) (percentage) 250.65% 0.770 2.700 - 190.32% -
459.GemsFDTD (max) (percentage) 250.00% 0.600 2.100 - 81.03% -
453.povray (avg) (percentage) 244.80% 1.250 4.310 - 146.29% -
447.dealII (avg) (percentage) 233.64% 1.070 3.570 - 271.88% -
410.bwaves (max) 233.33% 30.000 100.000 - -84.15% -
464.h264ref (unexplained diff vs previous) 226.67% 15.000 49.000 - -46.15% -
400.perlbench (avg) (percentage) 223.13% 1.470 4.750 - 220.95% -
458.sjeng 221.28% 47.000 151.000 - 64.13% -
458.sjeng (avg) 221.28% 47.000 151.000 - 64.13% -
482.sphinx3 (avg) (percentage) 208.22% 1.460 4.500 - 157.14% -
458.sjeng (max) 206.45% 31.000 95.000 - -79.30% -
464.h264ref (max) (percentage) 188.37% 0.430 1.240 - 79.71% -
433.milc (avg) (percentage) 182.94% 1.700 4.810 - 162.84% -
410.bwaves (avg) (percentage) 180.73% 1.090 3.060 - 139.06% -
454.calculix (avg) (percentage) 178.11% 2.010 5.590 - 164.93% -
471.omnetpp (avg) (percentage) 167.30% 1.590 4.250 - 79.32% -
434.zeusmp (avg) (percentage) 166.89% 1.480 3.950 - 110.11% -
429.mcf (max) 147.83% 92.000 228.000 - -39.52% -
458.sjeng (unexplained diff vs previous) 144.44% 9.000 22.000 - -93.87% -
410.bwaves (unexplained diff vs previous) 140.00% 15.000 36.000 - -94.07% -
437.leslie3d (max) (percentage) 136.75% 2.340 5.540 - 316.54% -
436.cactusADM (avg) (percentage) 131.93% 1.660 3.850 - 105.88% -
465.tonto 129.93% 137.000 315.000 - 47.20% -
465.tonto (avg) 129.93% 137.000 315.000 - 47.20% -
470.lbm (unexplained diff vs previous) (percentage) 118.18% 0.110 0.240 - 166.67% -
435.gromacs (avg) (percentage) 109.83% 1.730 3.630 - 85.20% -
464.h264ref 106.41% 78.000 161.000 - 11.81% -
464.h264ref (avg) 106.41% 78.000 161.000 - 11.81% -
429.mcf (unexplained diff vs previous) (percentage) 105.56% 0.540 1.110 - -37.29% -
453.povray (unexplained diff vs previous) 100.00% 1.000 2.000 - -97.10% -
481.wrf (avg) (percentage) 99.47% 1.890 3.770 - 95.34% -
447.dealII (unexplained diff vs previous) (percentage) 94.87% 0.780 1.520 - 53.54% -
450.soplex (max) (percentage) 93.40% 1.970 3.810 - 3075.00% -
462.libquantum (max) (percentage) 90.62% 0.640 1.220 - 430.43% -
437.leslie3d (unexplained diff vs previous) (percentage) 86.03% 2.290 4.260 - 215.56% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
465.tonto (avg) (percentage) 71.86% 1.670 2.870 - 22.65% -
465.tonto (unexplained diff vs previous) 69.84% 63.000 107.000 - 10.31% -
437.leslie3d (max) 69.80% 351.000 596.000 - 229.28% -
471.omnetpp (unexplained diff vs previous) 65.38% 26.000 43.000 - -62.28% -
470.lbm (avg) (percentage) 62.87% 2.370 3.860 - 60.17% -
482.sphinx3 (max) (percentage) 62.59% 1.470 2.390 - -51.91% -
445.gobmk 55.43% 92.000 143.000 - 33.64% -
445.gobmk (avg) 55.43% 92.000 143.000 - 33.64% -
401.bzip2 54.55% 66.000 102.000 - -4.67% -
401.bzip2 (avg) 54.55% 66.000 102.000 - -4.67% -
435.gromacs (max) (percentage) 54.46% 2.020 3.120 - 73.33% -
437.leslie3d (avg) (percentage) 50.84% 2.380 3.590 - 60.99% -
445.gobmk (max) (percentage) 50.33% 1.530 2.300 - -35.39% -
459.GemsFDTD (unexplained diff vs previous) 45.83% 48.000 70.000 - -62.96% -
444.namd (avg) (percentage) 38.17% 3.930 5.430 - 39.23% -
447.dealII (max) (percentage) 36.36% 1.100 1.500 - 53.06% -
437.leslie3d (unexplained diff vs previous) 33.82% 343.000 459.000 - 148.11% -
465.tonto (unexplained diff vs previous) (percentage) 25.97% 0.770 0.970 - -8.49% -
416.gamess (avg) (percentage) 22.58% 2.170 2.660 - 41.49% -
465.tonto (max) 19.80% 293.000 351.000 - -62.05% -
464.h264ref (max) 17.74% 62.000 73.000 - -18.89% -
410.bwaves 15.00% 160.000 184.000 - -7.07% -
410.bwaves (avg) 15.00% 160.000 184.000 - -7.07% -
437.leslie3d 8.12% 357.000 386.000 - 26.56% -
437.leslie3d (avg) 8.12% 357.000 386.000 - 26.56% -
456.hmmer 8.00% 75.000 81.000 - -35.71% -
456.hmmer (avg) 8.00% 75.000 81.000 - -35.71% -
429.mcf 5.56% 90.000 95.000 - -64.81% -
429.mcf (avg) 5.56% 90.000 95.000 - -64.81% -
459.GemsFDTD 2.38% 210.000 215.000 - -11.52% -
459.GemsFDTD (avg) 2.38% 210.000 215.000 - -11.52% -
435.gromacs 1.13% 266.000 269.000 - -5.28% -
435.gromacs (avg) 1.13% 266.000 269.000 - -5.28% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.88% 120221.000 111949.000 - -6.87% -
464.h264ref -1.01% 428364.000 424048.000 - -0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 64.000 - -99.70% -
403.gcc -99.30% 9010.000 63.000 - -99.29% -
462.libquantum -98.80% 11614.000 139.000 - -98.99% -
482.sphinx3 -96.89% 29928.000 932.000 - -96.56% -
450.soplex -96.37% 15466.000 561.000 - -96.23% -
444.namd -91.98% 9050.000 726.000 - -92.24% -
453.povray -91.72% 6544.000 542.000 - -91.35% -
429.mcf -91.07% 17158.000 1532.000 - -92.69% -
433.milc -90.99% 12976.000 1169.000 - -90.90% -
436.cactusADM -88.06% 17544.000 2094.000 - -88.99% -
400.perlbench -84.12% 10650.000 1691.000 - -83.50% -
434.zeusmp -81.00% 13211.000 2510.000 - -82.26% -
401.bzip2 -80.21% 15185.000 3005.000 - -78.78% -
447.dealII -79.75% 9751.000 1975.000 - -78.93% -
459.GemsFDTD -73.81% 23356.000 6116.000 - -71.41% -
456.hmmer -73.79% 11046.000 2895.000 - -74.36% -
471.omnetpp -73.00% 10739.000 2899.000 - -78.57% -
470.lbm -70.86% 12819.000 3735.000 - -72.88% -
481.wrf -67.38% 16834.000 5491.000 - -68.63% -
483.xalancbmk -62.67% 11172.000 4171.000 - -66.27% -
473.astar -60.65% 14932.000 5876.000 - -63.84% -
464.h264ref -59.27% 14556.000 5929.000 - -54.99% -
410.bwaves -59.23% 14755.000 6016.000 - -61.13% -
445.gobmk -55.71% 11995.000 5312.000 - -54.03% -
435.gromacs -51.93% 15419.000 7412.000 - -48.99% -
458.sjeng -46.06% 14275.000 7700.000 - -46.60% -
416.gamess -45.30% 22704.000 12418.000 - -44.48% -
437.leslie3d -28.26% 15005.000 10765.000 - -21.32% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.91% 1074.000 1.000 - -99.90% -
444.namd (unexplained diff vs previous) -99.86% 700.000 1.000 - -99.26% -
482.sphinx3 (unexplained diff vs previous) -99.46% 186.000 1.000 - -99.75% -
454.calculix -99.35% 459.000 3.000 - -99.33% -
454.calculix (avg) -99.35% 459.000 3.000 - -99.33% -
433.milc (unexplained diff vs previous) -98.82% 425.000 5.000 - -98.47% -
462.libquantum (max) -98.65% 74.000 1.000 - -96.77% -
436.cactusADM (unexplained diff vs previous) -98.60% 570.000 8.000 - -98.73% -
444.namd (unexplained diff vs previous) (percentage) -98.19% 7.730 0.140 - -90.28% -
444.namd (max) -97.53% 649.000 16.000 - -96.30% -
470.lbm (max) -96.78% 653.000 21.000 - -73.08% -
450.soplex (unexplained diff vs previous) -96.46% 311.000 11.000 - 83.33% -
434.zeusmp (unexplained diff vs previous) -96.10% 308.000 12.000 - -97.30% -
433.milc (max) -95.86% 411.000 17.000 - -94.93% -
416.gamess (unexplained diff vs previous) -95.56% 676.000 30.000 - -66.67% -
403.gcc (max) -95.31% 64.000 3.000 - -98.84% -
482.sphinx3 (max) -94.99% 439.000 22.000 - -98.36% -
453.povray (max) -94.55% 165.000 9.000 - -98.01% -
416.gamess (max) -93.90% 656.000 40.000 - -92.75% -
462.libquantum -93.33% 75.000 5.000 - -97.02% -
462.libquantum (avg) -93.33% 75.000 5.000 - -97.02% -
436.cactusADM (max) -93.12% 552.000 38.000 - -94.14% -
450.soplex (max) -93.09% 304.000 21.000 - 23.53% -
403.gcc -92.59% 54.000 4.000 - -93.85% -
403.gcc (avg) -92.59% 54.000 4.000 - -93.85% -
434.zeusmp (max) -92.36% 301.000 23.000 - -95.60% -
416.gamess (unexplained diff vs previous) (percentage) -91.95% 2.980 0.240 - -40.00% -
445.gobmk (unexplained diff vs previous) -90.86% 186.000 17.000 - -96.01% -
482.sphinx3 -90.60% 436.000 41.000 - -91.33% -
482.sphinx3 (avg) -90.60% 436.000 41.000 - -91.33% -
400.perlbench (unexplained diff vs previous) -89.36% 357.000 38.000 - -7.32% -
481.wrf (unexplained diff vs previous) -89.29% 112.000 12.000 - -67.57% -
444.namd -89.01% 355.000 39.000 - -89.29% -
444.namd (avg) -89.01% 355.000 39.000 - -89.29% -
470.lbm (max) (percentage) -88.63% 5.100 0.580 - 1.75% -
416.gamess (max) (percentage) -88.58% 2.890 0.330 - -86.64% -
436.cactusADM (unexplained diff vs previous) (percentage) -88.31% 3.250 0.380 - -88.48% -
401.bzip2 (unexplained diff vs previous) -87.88% 132.000 16.000 - -90.36% -
456.hmmer (max) -87.86% 140.000 17.000 - -97.50% -
433.milc (unexplained diff vs previous) (percentage) -86.89% 3.280 0.430 - -83.14% -
400.perlbench (max) -86.09% 345.000 48.000 - -89.04% -
450.soplex -84.29% 191.000 30.000 - -82.86% -
450.soplex (avg) -84.29% 191.000 30.000 - -82.86% -
435.gromacs (unexplained diff vs previous) -84.28% 318.000 50.000 - -64.29% -
471.omnetpp (max) -83.53% 662.000 109.000 - -45.77% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.26% 0.620 0.110 - -92.67% -
429.mcf (unexplained diff vs previous) -81.72% 93.000 17.000 - -95.42% -
481.wrf (max) -81.32% 530.000 99.000 - 45.59% -
454.calculix (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.90% -
456.hmmer (unexplained diff vs previous) -79.52% 83.000 17.000 - -97.35% -
434.zeusmp (unexplained diff vs previous) (percentage) -79.40% 2.330 0.480 - -84.76% -
445.gobmk (unexplained diff vs previous) (percentage) -79.35% 1.550 0.320 - -91.33% -
433.milc -74.55% 220.000 56.000 - -76.17% -
433.milc (avg) -74.55% 220.000 56.000 - -76.17% -
447.dealII (max) -72.90% 107.000 29.000 - -68.13% -
436.cactusADM -72.51% 291.000 80.000 - -77.46% -
436.cactusADM (avg) -72.51% 291.000 80.000 - -77.46% -
453.povray -71.60% 81.000 23.000 - -78.90% -
453.povray (avg) -71.60% 81.000 23.000 - -78.90% -
444.namd (max) (percentage) -68.38% 7.180 2.270 - -50.97% -
435.gromacs (unexplained diff vs previous) (percentage) -67.48% 2.060 0.670 - -30.21% -
481.wrf (unexplained diff vs previous) (percentage) -67.16% 0.670 0.220 - 4.76% -
447.dealII (unexplained diff vs previous) -60.53% 76.000 30.000 - -67.74% -
434.zeusmp (max) (percentage) -59.21% 2.280 0.930 - -74.86% -
433.milc (max) (percentage) -53.94% 3.170 1.460 - -44.06% -
456.hmmer (max) (percentage) -53.54% 1.270 0.590 - -90.20% -
470.lbm -52.48% 303.000 144.000 - -56.50% -
470.lbm (avg) -52.48% 303.000 144.000 - -56.50% -
434.zeusmp -49.23% 195.000 99.000 - -62.64% -
434.zeusmp (avg) -49.23% 195.000 99.000 - -62.64% -
400.perlbench -48.72% 156.000 80.000 - -47.02% -
400.perlbench (avg) -48.72% 156.000 80.000 - -47.02% -
481.wrf (max) (percentage) -42.22% 3.150 1.820 - 366.67% -
436.cactusADM (max) (percentage) -40.95% 3.150 1.860 - -45.45% -
401.bzip2 (unexplained diff vs previous) (percentage) -39.08% 0.870 0.530 - -54.70% -
471.omnetpp (max) (percentage) -39.06% 6.170 3.760 - 152.35% -
470.lbm (unexplained diff vs previous) -35.71% 14.000 9.000 - -30.77% -
481.wrf -34.91% 318.000 207.000 - -38.58% -
481.wrf (avg) -34.91% 318.000 207.000 - -38.58% -
454.calculix (max) (percentage) -34.47% 4.700 3.080 - -31.86% -
483.xalancbmk -33.78% 74.000 49.000 - -66.21% -
483.xalancbmk (avg) -33.78% 74.000 49.000 - -66.21% -
445.gobmk (max) -33.33% 183.000 122.000 - -70.32% -
416.gamess -32.93% 492.000 330.000 - -21.43% -
416.gamess (avg) -32.93% 492.000 330.000 - -21.43% -
400.perlbench (unexplained diff vs previous) (percentage) -32.84% 3.350 2.250 - 462.50% -
453.povray (max) (percentage) -32.81% 2.530 1.700 - -76.49% -
447.dealII -32.69% 104.000 70.000 - -21.35% -
447.dealII (avg) -32.69% 104.000 70.000 - -21.35% -
471.omnetpp -27.65% 170.000 123.000 - -61.56% -
471.omnetpp (avg) -27.65% 170.000 123.000 - -61.56% -
435.gromacs (max) -25.72% 311.000 231.000 - -11.49% -
401.bzip2 (max) -22.56% 133.000 103.000 - -44.02% -
456.hmmer (unexplained diff vs previous) (percentage) -21.33% 0.750 0.590 - -89.61% -
400.perlbench (max) (percentage) -12.04% 3.240 2.850 - -33.41% -
465.tonto (max) (percentage) -10.89% 3.580 3.190 - -68.45% -
459.GemsFDTD (max) -8.57% 140.000 128.000 - -48.39% -
450.soplex (unexplained diff vs previous) (percentage) -2.49% 2.010 1.960 - 4800.00% -

Report Time: 0.41s
Execution (seconds)
Name Current %
400.perlbench 1691.000 -83.50%
401.bzip2 3005.000 -78.78%
403.gcc 63.000 -99.29%
410.bwaves 6016.000 -61.13%
416.gamess 12418.000 -44.48%
429.mcf 1532.000 -92.69%
433.milc 1169.000 -90.90%
434.zeusmp 2510.000 -82.26%
435.gromacs 7412.000 -48.99%
436.cactusADM 2094.000 -88.99%
437.leslie3d 10765.000 -21.32%
444.namd 726.000 -92.24%
445.gobmk 5312.000 -54.03%
447.dealII 1975.000 -78.93%
450.soplex 561.000 -96.23%
453.povray 542.000 -91.35%
454.calculix 64.000 -99.70%
456.hmmer 2895.000 -74.36%
458.sjeng 7700.000 -46.60%
459.GemsFDTD 6116.000 -71.41%
462.libquantum 139.000 -98.99%
464.h264ref 5929.000 -54.99%
465.tonto 11010.000 20.33%
470.lbm 3735.000 -72.88%
471.omnetpp 2899.000 -78.57%
473.astar 5876.000 -63.84%
481.wrf 5491.000 -68.63%
482.sphinx3 932.000 -96.56%
483.xalancbmk 4171.000 -66.27%
Geometric Mean 2151.686 -84.48%
Code Size (bytes)
Name Current %
400.perlbench 938305.000 1.71%
401.bzip2 49892.000 -
403.gcc 2678237.000 -
410.bwaves 17876.000 -
416.gamess 6261095.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165667.000 -
435.gromacs 678645.000 -
436.cactusADM 553658.000 -
437.leslie3d 65173.000 -
444.namd 190962.000 -
445.gobmk 1399483.000 -
447.dealII 2121732.000 -
450.soplex 260508.000 -
453.povray 704477.000 -1.18%
454.calculix 1272852.000 -
456.hmmer 231140.000 -
458.sjeng 111949.000 -6.87%
459.GemsFDTD 253981.000 -
462.libquantum 31297.000 -
464.h264ref 424048.000 -
465.tonto 2875386.000 -
470.lbm 10908.000 -
471.omnetpp 566593.000 -
473.astar 32056.000 -
481.wrf 2638533.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3281683.000 -
Geometric Mean 297144.711 -
sample variability
Name Current %
400.perlbench 80.000 -47.02%
400.perlbench (avg) 80.000 -47.02%
400.perlbench (avg) (percentage) 4.750 220.95%
400.perlbench (max) 48.000 -89.04%
400.perlbench (max) (percentage) 2.850 -33.41%
400.perlbench (unexplained diff vs previous) 38.000 -7.32%
400.perlbench (unexplained diff vs previous) (percentage) 2.250 462.50%
401.bzip2 102.000 -4.67%
401.bzip2 (avg) 102.000 -4.67%
401.bzip2 (avg) (percentage) 3.400 347.37%
401.bzip2 (max) 103.000 -44.02%
401.bzip2 (max) (percentage) 3.460 166.15%
401.bzip2 (unexplained diff vs previous) 16.000 -90.36%
401.bzip2 (unexplained diff vs previous) (percentage) 0.530 -54.70%
403.gcc 4.000 -93.85%
403.gcc (avg) 4.000 -93.85%
403.gcc (avg) (percentage) 6.370 760.81%
403.gcc (max) 3.000 -98.84%
403.gcc (max) (percentage) 6.110 109.25%
410.bwaves 184.000 -7.07%
410.bwaves (avg) 184.000 -7.07%
410.bwaves (avg) (percentage) 3.060 139.06%
410.bwaves (max) 100.000 -84.15%
410.bwaves (max) (percentage) 1.670 -59.07%
410.bwaves (unexplained diff vs previous) 36.000 -94.07%
410.bwaves (unexplained diff vs previous) (percentage) 0.600 -84.69%
416.gamess 330.000 -21.43%
416.gamess (avg) 330.000 -21.43%
416.gamess (avg) (percentage) 2.660 41.49%
416.gamess (max) 40.000 -92.75%
416.gamess (max) (percentage) 0.330 -86.64%
416.gamess (unexplained diff vs previous) 30.000 -66.67%
416.gamess (unexplained diff vs previous) (percentage) 0.240 -40.00%
429.mcf 95.000 -64.81%
429.mcf (avg) 95.000 -64.81%
429.mcf (avg) (percentage) 6.240 383.72%
429.mcf (max) 228.000 -39.52%
429.mcf (max) (percentage) 14.910 728.33%
429.mcf (unexplained diff vs previous) 17.000 -95.42%
429.mcf (unexplained diff vs previous) (percentage) 1.110 -37.29%
433.milc 56.000 -76.17%
433.milc (avg) 56.000 -76.17%
433.milc (avg) (percentage) 4.810 162.84%
433.milc (max) 17.000 -94.93%
433.milc (max) (percentage) 1.460 -44.06%
433.milc (unexplained diff vs previous) 5.000 -98.47%
433.milc (unexplained diff vs previous) (percentage) 0.430 -83.14%
434.zeusmp 99.000 -62.64%
434.zeusmp (avg) 99.000 -62.64%
434.zeusmp (avg) (percentage) 3.950 110.11%
434.zeusmp (max) 23.000 -95.60%
434.zeusmp (max) (percentage) 0.930 -74.86%
434.zeusmp (unexplained diff vs previous) 12.000 -97.30%
434.zeusmp (unexplained diff vs previous) (percentage) 0.480 -84.76%
435.gromacs 269.000 -5.28%
435.gromacs (avg) 269.000 -5.28%
435.gromacs (avg) (percentage) 3.630 85.20%
435.gromacs (max) 231.000 -11.49%
435.gromacs (max) (percentage) 3.120 73.33%
435.gromacs (unexplained diff vs previous) 50.000 -64.29%
435.gromacs (unexplained diff vs previous) (percentage) 0.670 -30.21%
436.cactusADM 80.000 -77.46%
436.cactusADM (avg) 80.000 -77.46%
436.cactusADM (avg) (percentage) 3.850 105.88%
436.cactusADM (max) 38.000 -94.14%
436.cactusADM (max) (percentage) 1.860 -45.45%
436.cactusADM (unexplained diff vs previous) 8.000 -98.73%
436.cactusADM (unexplained diff vs previous) (percentage) 0.380 -88.48%
437.leslie3d 386.000 26.56%
437.leslie3d (avg) 386.000 26.56%
437.leslie3d (avg) (percentage) 3.590 60.99%
437.leslie3d (max) 596.000 229.28%
437.leslie3d (max) (percentage) 5.540 316.54%
437.leslie3d (unexplained diff vs previous) 459.000 148.11%
437.leslie3d (unexplained diff vs previous) (percentage) 4.260 215.56%
444.namd 39.000 -89.29%
444.namd (avg) 39.000 -89.29%
444.namd (avg) (percentage) 5.430 39.23%
444.namd (max) 16.000 -96.30%
444.namd (max) (percentage) 2.270 -50.97%
444.namd (unexplained diff vs previous) 1.000 -99.26%
444.namd (unexplained diff vs previous) (percentage) 0.140 -90.28%
445.gobmk 143.000 33.64%
445.gobmk (avg) 143.000 33.64%
445.gobmk (avg) (percentage) 2.700 190.32%
445.gobmk (max) 122.000 -70.32%
445.gobmk (max) (percentage) 2.300 -35.39%
445.gobmk (unexplained diff vs previous) 17.000 -96.01%
445.gobmk (unexplained diff vs previous) (percentage) 0.320 -91.33%
447.dealII 70.000 -21.35%
447.dealII (avg) 70.000 -21.35%
447.dealII (avg) (percentage) 3.570 271.88%
447.dealII (max) 29.000 -68.13%
447.dealII (max) (percentage) 1.500 53.06%
447.dealII (unexplained diff vs previous) 30.000 -67.74%
447.dealII (unexplained diff vs previous) (percentage) 1.520 53.54%
450.soplex 30.000 -82.86%
450.soplex (avg) 30.000 -82.86%
450.soplex (avg) (percentage) 5.370 355.08%
450.soplex (max) 21.000 23.53%
450.soplex (max) (percentage) 3.810 3075.00%
450.soplex (unexplained diff vs previous) 11.000 83.33%
450.soplex (unexplained diff vs previous) (percentage) 1.960 4800.00%
453.povray 23.000 -78.90%
453.povray (avg) 23.000 -78.90%
453.povray (avg) (percentage) 4.310 146.29%
453.povray (max) 9.000 -98.01%
453.povray (max) (percentage) 1.700 -76.49%
453.povray (unexplained diff vs previous) 2.000 -97.10%
453.povray (unexplained diff vs previous) (percentage) 0.370 -66.36%
454.calculix 3.000 -99.33%
454.calculix (avg) 3.000 -99.33%
454.calculix (avg) (percentage) 5.590 164.93%
454.calculix (max) 1.000 -99.90%
454.calculix (max) (percentage) 3.080 -31.86%
454.calculix (unexplained diff vs previous) 1.000 -99.90%
454.calculix (unexplained diff vs previous) (percentage) 1.560 -67.02%
456.hmmer 81.000 -35.71%
456.hmmer (avg) 81.000 -35.71%
456.hmmer (avg) (percentage) 2.800 150.00%
456.hmmer (max) 17.000 -97.50%
456.hmmer (max) (percentage) 0.590 -90.20%
456.hmmer (unexplained diff vs previous) 17.000 -97.35%
456.hmmer (unexplained diff vs previous) (percentage) 0.590 -89.61%
458.sjeng 151.000 64.13%
458.sjeng (avg) 151.000 64.13%
458.sjeng (avg) (percentage) 1.970 207.81%
458.sjeng (max) 95.000 -79.30%
458.sjeng (max) (percentage) 1.240 -61.13%
458.sjeng (unexplained diff vs previous) 22.000 -93.87%
458.sjeng (unexplained diff vs previous) (percentage) 0.290 -88.35%
459.GemsFDTD 215.000 -11.52%
459.GemsFDTD (avg) 215.000 -11.52%
459.GemsFDTD (avg) (percentage) 3.530 209.65%
459.GemsFDTD (max) 128.000 -48.39%
459.GemsFDTD (max) (percentage) 2.100 81.03%
459.GemsFDTD (unexplained diff vs previous) 70.000 -62.96%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.140 29.55%
462.libquantum 5.000 -97.02%
462.libquantum (avg) 5.000 -97.02%
462.libquantum (avg) (percentage) 3.890 216.26%
462.libquantum (max) 1.000 -96.77%
462.libquantum (max) (percentage) 1.220 430.43%
462.libquantum (unexplained diff vs previous) 1.000 -92.86%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 620.00%
464.h264ref 161.000 11.81%
464.h264ref (avg) 161.000 11.81%
464.h264ref (avg) (percentage) 2.720 147.27%
464.h264ref (max) 73.000 -18.89%
464.h264ref (max) (percentage) 1.240 79.71%
464.h264ref (unexplained diff vs previous) 49.000 -46.15%
464.h264ref (unexplained diff vs previous) (percentage) 0.830 20.29%
465.tonto 315.000 47.20%
465.tonto (avg) 315.000 47.20%
465.tonto (avg) (percentage) 2.870 22.65%
465.tonto (max) 351.000 -62.05%
465.tonto (max) (percentage) 3.190 -68.45%
465.tonto (unexplained diff vs previous) 107.000 10.31%
465.tonto (unexplained diff vs previous) (percentage) 0.970 -8.49%
470.lbm 144.000 -56.50%
470.lbm (avg) 144.000 -56.50%
470.lbm (avg) (percentage) 3.860 60.17%
470.lbm (max) 21.000 -73.08%
470.lbm (max) (percentage) 0.580 1.75%
470.lbm (unexplained diff vs previous) 9.000 -30.77%
470.lbm (unexplained diff vs previous) (percentage) 0.240 166.67%
471.omnetpp 123.000 -61.56%
471.omnetpp (avg) 123.000 -61.56%
471.omnetpp (avg) (percentage) 4.250 79.32%
471.omnetpp (max) 109.000 -45.77%
471.omnetpp (max) (percentage) 3.760 152.35%
471.omnetpp (unexplained diff vs previous) 43.000 -62.28%
471.omnetpp (unexplained diff vs previous) (percentage) 1.480 76.19%
473.astar 159.000 96.30%
473.astar (avg) 159.000 96.30%
473.astar (avg) (percentage) 2.720 444.00%
473.astar (max) 194.000 -73.39%
473.astar (max) (percentage) 3.310 -26.28%
473.astar (unexplained diff vs previous) 68.000 -74.14%
473.astar (unexplained diff vs previous) (percentage) 1.160 -28.40%
481.wrf 207.000 -38.58%
481.wrf (avg) 207.000 -38.58%
481.wrf (avg) (percentage) 3.770 95.34%
481.wrf (max) 99.000 45.59%
481.wrf (max) (percentage) 1.820 366.67%
481.wrf (unexplained diff vs previous) 12.000 -67.57%
481.wrf (unexplained diff vs previous) (percentage) 0.220 4.76%
482.sphinx3 41.000 -91.33%
482.sphinx3 (avg) 41.000 -91.33%
482.sphinx3 (avg) (percentage) 4.500 157.14%
482.sphinx3 (max) 22.000 -98.36%
482.sphinx3 (max) (percentage) 2.390 -51.91%
482.sphinx3 (unexplained diff vs previous) 1.000 -99.75%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -92.67%
483.xalancbmk 49.000 -66.21%
483.xalancbmk (avg) 49.000 -66.21%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 290.000 -73.54%
483.xalancbmk (max) (percentage) 6.960 -21.53%
Geometric Mean 11.286 -54.45%