Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=df4ffdd8c87b32357f929fb4a861760038f3bbb8 (+ 40 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/af7fa3135b6b046fe3ba869993221042a65301eb (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=780c33920281c5d5cc42a1e578bdc9218e675405 (+ 29 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/145/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0145 (2-changed-components) 2023-11-19T05:38:12 0:00:00
Previous 0143 (3-changed-components) 2023-11-16T04:36:49 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 24 64
Performance Improvements 83 104
Added Tests 6 4
Unchanged Tests 1123 1064
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 2.14% 561.000 573.000 - -96.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 1100.00% 1.000 12.000 - -96.14% -
450.soplex (unexplained diff vs previous) (percentage) 1061.11% 0.180 2.090 - 3.98% -
473.astar (unexplained diff vs previous) 450.00% 2.000 11.000 - 266.67% -
433.milc (unexplained diff vs previous) (percentage) 411.76% 0.170 0.870 - -73.48% -
433.milc (unexplained diff vs previous) 400.00% 2.000 10.000 - -97.65% -
473.astar (unexplained diff vs previous) (percentage) 400.00% 0.040 0.200 - 900.00% -
444.namd (unexplained diff vs previous) 150.00% 2.000 5.000 - -99.29% -
444.namd (unexplained diff vs previous) (percentage) 146.43% 0.280 0.690 - -91.07% -
458.sjeng (unexplained diff vs previous) (percentage) 83.87% 0.310 0.570 - 850.00% -
458.sjeng (unexplained diff vs previous) 83.33% 24.000 44.000 - 388.89% -
462.libquantum (unexplained diff vs previous) (percentage) 53.42% 1.460 2.240 - 22300.00% -
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 - 200.00% -
401.bzip2 (unexplained diff vs previous) 33.33% 9.000 12.000 - -90.91% -
401.bzip2 (unexplained diff vs previous) (percentage) 33.33% 0.330 0.440 - -49.43% -
445.gobmk (unexplained diff vs previous) (percentage) 27.59% 0.290 0.370 - -76.13% -
445.gobmk (unexplained diff vs previous) 26.67% 15.000 19.000 - -89.78% -
456.hmmer (unexplained diff vs previous) 16.67% 6.000 7.000 - -91.57% -
456.hmmer (unexplained diff vs previous) (percentage) 14.29% 0.210 0.240 - -68.00% -
433.milc (max) (percentage) 10.26% 0.780 0.860 - -72.87% -
458.sjeng (max) (percentage) 7.55% 0.530 0.570 - 159.09% -
450.soplex 5.88% 17.000 18.000 - -90.58% -
450.soplex (avg) 5.88% 17.000 18.000 - -90.58% -
458.sjeng (max) 4.88% 41.000 43.000 - 38.71% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -6.78% 59.000 55.000 - -99.39% -
462.libquantum -2.19% 137.000 134.000 - -98.85% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -87.50% 8.000 1.000 - -99.46% -
482.sphinx3 (unexplained diff vs previous) (percentage) -87.36% 0.870 0.110 - -82.26% -
482.sphinx3 (max) -73.91% 23.000 6.000 - -98.63% -
471.omnetpp (unexplained diff vs previous) (percentage) -73.85% 0.650 0.170 - -29.17% -
471.omnetpp (unexplained diff vs previous) -73.68% 19.000 5.000 - -80.77% -
482.sphinx3 (max) (percentage) -71.04% 2.590 0.750 - -48.98% -
447.dealII (max) -59.09% 22.000 9.000 - -91.59% -
447.dealII (max) (percentage) -58.26% 1.150 0.480 - -56.36% -
447.dealII (unexplained diff vs previous) (percentage) -55.36% 0.560 0.250 - -67.95% -
447.dealII (unexplained diff vs previous) -54.55% 11.000 5.000 - -93.42% -
462.libquantum (max) -33.33% 3.000 2.000 - -97.30% -
464.h264ref (unexplained diff vs previous) -16.67% 6.000 5.000 - -66.67% -
400.perlbench (max) -11.54% 26.000 23.000 - -93.33% -
400.perlbench (max) (percentage) -10.98% 1.730 1.540 - -52.47% -
470.lbm (max) -10.53% 38.000 34.000 - -94.79% -
473.astar (max) -10.24% 254.000 228.000 - 1040.00% -
471.omnetpp (max) (percentage) -10.23% 1.760 1.580 - -74.39% -
473.astar (max) (percentage) -10.09% 4.560 4.100 - 2828.57% -
456.hmmer (max) (percentage) -10.00% 0.400 0.360 - -71.65% -
464.h264ref (unexplained diff vs previous) (percentage) -10.00% 0.100 0.090 - -10.00% -
445.gobmk (max) (percentage) -10.00% 1.800 1.620 - 5.88% -
429.mcf (max) (percentage) -9.99% 20.330 18.300 - 3288.89% -
401.bzip2 (max) (percentage) -9.97% 7.620 6.860 - 679.55% -
464.h264ref (max) (percentage) -9.89% 0.910 0.820 - 90.70% -
450.soplex (max) (percentage) -9.86% 3.550 3.200 - 62.44% -
471.omnetpp (max) -9.80% 51.000 46.000 - -93.05% -
445.gobmk (max) -9.68% 93.000 84.000 - -54.10% -
401.bzip2 (max) -9.66% 207.000 187.000 - 40.60% -
470.lbm (max) (percentage) -9.62% 1.040 0.940 - -81.57% -
464.h264ref (max) -9.62% 52.000 47.000 - -24.19% -
429.mcf (max) -9.35% 385.000 349.000 - 279.35% -
456.hmmer (max) -9.09% 11.000 10.000 - -92.86% -
462.libquantum (max) (percentage) -8.75% 2.400 2.190 - 242.19% -
444.namd (max) (percentage) -8.11% 1.110 1.020 - -85.79% -
453.povray (max) -7.14% 14.000 13.000 - -92.12% -
429.mcf (unexplained diff vs previous) (percentage) -7.14% 0.840 0.780 - 44.44% -
429.mcf (unexplained diff vs previous) -6.25% 16.000 15.000 - -83.87% -
453.povray (max) (percentage) -6.08% 2.960 2.780 - 9.88% -
450.soplex (max) -5.26% 19.000 18.000 - -94.08% -
459.GemsFDTD (max) (percentage) -3.66% 1.640 1.580 - 163.33% -
435.gromacs (max) (percentage) -3.57% 0.840 0.810 - -59.90% -
410.bwaves (max) (percentage) -3.51% 1.140 1.100 - 423.81% -
447.dealII -3.03% 33.000 32.000 - -69.23% -
447.dealII (avg) -3.03% 33.000 32.000 - -69.23% -
464.h264ref -3.03% 66.000 64.000 - -17.95% -
464.h264ref (avg) -3.03% 66.000 64.000 - -17.95% -
434.zeusmp (max) (percentage) -3.03% 1.650 1.600 - -29.82% -
436.cactusADM (max) (percentage) -2.99% 0.670 0.650 - -79.37% -
437.leslie3d (max) (percentage) -2.85% 5.970 5.800 - 147.86% -
400.perlbench -2.63% 38.000 37.000 - -76.28% -
400.perlbench (avg) -2.63% 38.000 37.000 - -76.28% -
464.h264ref (avg) (percentage) -2.63% 1.140 1.110 - 105.56% -
465.tonto (max) (percentage) -2.60% 1.920 1.870 - -47.77% -
403.gcc (max) (percentage) -2.41% 7.880 7.690 - 968.06% -
400.perlbench (avg) (percentage) -2.38% 2.520 2.460 - 67.35% -
481.wrf (max) (percentage) -2.13% 0.940 0.920 - -70.79% -
401.bzip2 (avg) (percentage) -2.01% 1.990 1.950 - 343.18% -
470.lbm (avg) (percentage) -2.00% 1.500 1.470 - -37.97% -
454.calculix (max) (percentage) -1.96% 5.100 5.000 - 6.38% -
401.bzip2 -1.85% 54.000 53.000 - -19.70% -
401.bzip2 (avg) -1.85% 54.000 53.000 - -19.70% -
453.povray (avg) (percentage) -1.82% 2.200 2.160 - 72.80% -
470.lbm -1.82% 55.000 54.000 - -82.18% -
470.lbm (avg) -1.82% 55.000 54.000 - -82.18% -
447.dealII (avg) (percentage) -1.80% 1.670 1.640 - 53.27% -
482.sphinx3 (avg) (percentage) -1.75% 2.280 2.240 - 53.42% -
473.astar (avg) (percentage) -1.69% 1.770 1.740 - 815.79% -
471.omnetpp (avg) (percentage) -1.59% 2.510 2.470 - 55.35% -
429.mcf (avg) (percentage) -1.56% 5.780 5.690 - 973.58% -
445.gobmk (avg) (percentage) -1.50% 1.330 1.310 - 70.13% -
445.gobmk -1.47% 68.000 67.000 - -27.17% -
445.gobmk (avg) -1.47% 68.000 67.000 - -27.17% -
458.sjeng -1.45% 69.000 68.000 - 44.68% -
458.sjeng (avg) -1.45% 69.000 68.000 - 44.68% -
444.namd (avg) (percentage) -1.41% 2.130 2.100 - -46.56% -
471.omnetpp -1.37% 73.000 72.000 - -57.65% -
471.omnetpp (avg) -1.37% 73.000 72.000 - -57.65% -
458.sjeng (avg) (percentage) -1.11% 0.900 0.890 - 169.70% -
433.milc (avg) (percentage) -1.07% 1.870 1.850 - 8.82% -
473.astar -1.02% 98.000 97.000 - 246.43% -
473.astar (avg) -1.02% 98.000 97.000 - 246.43% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.16% 930652.000 941436.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 22300.00% 0.010 2.240 - 53.42% -
429.mcf (max) (percentage) 3288.89% 0.540 18.300 - -9.99% -
473.astar (max) (percentage) 2828.57% 0.140 4.100 - -10.09% -
453.povray (unexplained diff vs previous) (percentage) 1950.00% 0.020 0.410 - 2.50% -
483.xalancbmk (max) (percentage) 1321.95% 0.410 5.830 - -0.17% -
473.astar (max) 1040.00% 20.000 228.000 - -10.24% -
429.mcf (avg) (percentage) 973.58% 0.530 5.690 - -1.56% -
403.gcc (max) (percentage) 968.06% 0.720 7.690 - -2.41% -
403.gcc (unexplained diff vs previous) (percentage) 909.72% 0.720 7.270 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 900.00% 0.020 0.200 - 400.00% -
403.gcc (avg) (percentage) 862.30% 0.610 5.870 - 0.86% -
458.sjeng (unexplained diff vs previous) (percentage) 850.00% 0.060 0.570 - 83.87% -
473.astar (avg) (percentage) 815.79% 0.190 1.740 - -1.69% -
401.bzip2 (max) (percentage) 679.55% 0.880 6.860 - -9.97% -
410.bwaves (max) (percentage) 423.81% 0.210 1.100 - -3.51% -
458.sjeng (unexplained diff vs previous) 388.89% 9.000 44.000 - 83.33% -
401.bzip2 (avg) (percentage) 343.18% 0.440 1.950 - -2.01% -
429.mcf (max) 279.35% 92.000 349.000 - -9.35% -
473.astar (unexplained diff vs previous) 266.67% 3.000 11.000 - 450.00% -
473.astar 246.43% 28.000 97.000 - -1.02% -
473.astar (avg) 246.43% 28.000 97.000 - -1.02% -
462.libquantum (max) (percentage) 242.19% 0.640 2.190 - -8.75% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 50.00% -
462.libquantum (avg) (percentage) 196.92% 0.650 1.930 - 0.52% -
458.sjeng (avg) (percentage) 169.70% 0.330 0.890 - -1.11% -
459.GemsFDTD (max) (percentage) 163.33% 0.600 1.580 - -3.66% -
458.sjeng (max) (percentage) 159.09% 0.220 0.570 - 7.55% -
450.soplex (avg) (percentage) 155.65% 1.240 3.170 - -0.94% -
437.leslie3d (max) (percentage) 147.86% 2.340 5.800 - -2.85% -
464.h264ref (avg) (percentage) 105.56% 0.540 1.110 - -2.63% -
453.povray (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
437.leslie3d (avg) (percentage) 98.74% 2.380 4.730 - 0.00% -
464.h264ref (max) (percentage) 90.70% 0.430 0.820 - -9.89% -
459.GemsFDTD (avg) (percentage) 87.78% 0.900 1.690 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
454.calculix (avg) (percentage) 73.63% 2.010 3.490 - 0.00% -
453.povray (avg) (percentage) 72.80% 1.250 2.160 - -1.82% -
445.gobmk (avg) (percentage) 70.13% 0.770 1.310 - -1.50% -
400.perlbench (avg) (percentage) 67.35% 1.470 2.460 - -2.38% -
450.soplex (max) (percentage) 62.44% 1.970 3.200 - -9.86% -
471.omnetpp (avg) (percentage) 55.35% 1.590 2.470 - -1.59% -
482.sphinx3 (avg) (percentage) 53.42% 1.460 2.240 - -1.75% -
447.dealII (avg) (percentage) 53.27% 1.070 1.640 - -1.80% -
456.hmmer (avg) (percentage) 52.94% 0.680 1.040 - -0.95% -
458.sjeng 44.68% 47.000 68.000 - -1.45% -
458.sjeng (avg) 44.68% 47.000 68.000 - -1.45% -
429.mcf (unexplained diff vs previous) (percentage) 44.44% 0.540 0.780 - -7.14% -
401.bzip2 (max) 40.60% 133.000 187.000 - -9.66% -
458.sjeng (max) 38.71% 31.000 43.000 - 4.88% -
410.bwaves (avg) (percentage) 25.69% 1.090 1.370 - 0.00% -
434.zeusmp (avg) (percentage) 22.30% 1.480 1.810 - 0.00% -
435.gromacs (avg) (percentage) 21.39% 1.730 2.100 - 0.00% -
429.mcf 20.00% 90.000 108.000 - -0.92% -
429.mcf (avg) 20.00% 90.000 108.000 - -0.92% -
453.povray (max) (percentage) 9.88% 2.530 2.780 - -6.08% -
433.milc (avg) (percentage) 8.82% 1.700 1.850 - -1.07% -
454.calculix (max) (percentage) 6.38% 4.700 5.000 - -1.96% -
445.gobmk (max) (percentage) 5.88% 1.530 1.620 - -10.00% -
450.soplex (unexplained diff vs previous) (percentage) 3.98% 2.010 2.090 - 1061.11% -
481.wrf (avg) (percentage) 2.12% 1.890 1.930 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -37.93% 29.000 18.000 - 0.00% -
nb_execution_successful -37.93% 29.000 18.000 - 0.00% -
nb_total_tests -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.57% 120221.000 115929.000 - 0.00% -
464.h264ref -2.37% 428364.000 418228.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.39% 9010.000 55.000 - -6.78% -
462.libquantum -98.85% 11614.000 134.000 - -2.19% -
482.sphinx3 -96.94% 29928.000 917.000 - -0.11% -
450.soplex -96.30% 15466.000 573.000 - 2.14% -
453.povray -92.48% 6544.000 492.000 - -0.40% -
444.namd -92.01% 9050.000 723.000 - 0.70% -
433.milc -91.10% 12976.000 1155.000 - -0.86% -
429.mcf -88.86% 17158.000 1911.000 - 0.79% -
400.perlbench -85.66% 10650.000 1527.000 - 0.00% -
401.bzip2 -82.00% 15185.000 2733.000 - 0.44% -
447.dealII -79.63% 9751.000 1986.000 - 0.25% -
456.hmmer -73.60% 11046.000 2916.000 - -0.24% -
471.omnetpp -72.58% 10739.000 2945.000 - 0.17% -
470.lbm -71.08% 12819.000 3707.000 - 0.00% -
473.astar -62.64% 14932.000 5578.000 - -0.20% -
464.h264ref -60.06% 14556.000 5813.000 - -0.09% -
445.gobmk -56.76% 11995.000 5187.000 - 0.37% -
458.sjeng -45.95% 14275.000 7715.000 - -0.57% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.46% 186.000 1.000 - -87.50% -
444.namd (unexplained diff vs previous) -99.29% 700.000 5.000 - 150.00% -
444.namd (max) -98.92% 649.000 7.000 - 0.00% -
482.sphinx3 (max) -98.63% 439.000 6.000 - -73.91% -
433.milc (max) -97.81% 411.000 9.000 - 0.00% -
433.milc (unexplained diff vs previous) -97.65% 425.000 10.000 - 400.00% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
462.libquantum (max) -97.30% 74.000 2.000 - -33.33% -
450.soplex (unexplained diff vs previous) -96.14% 311.000 12.000 - 1100.00% -
444.namd -95.77% 355.000 15.000 - 0.00% -
444.namd (avg) -95.77% 355.000 15.000 - 0.00% -
482.sphinx3 -95.41% 436.000 20.000 - 0.00% -
482.sphinx3 (avg) -95.41% 436.000 20.000 - 0.00% -
470.lbm (max) -94.79% 653.000 34.000 - -10.53% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
450.soplex (max) -94.08% 304.000 18.000 - -5.26% -
403.gcc (unexplained diff vs previous) -93.85% 65.000 4.000 - 0.00% -
403.gcc (max) -93.75% 64.000 4.000 - 0.00% -
447.dealII (unexplained diff vs previous) -93.42% 76.000 5.000 - -54.55% -
400.perlbench (max) -93.33% 345.000 23.000 - -11.54% -
471.omnetpp (max) -93.05% 662.000 46.000 - -9.80% -
456.hmmer (max) -92.86% 140.000 10.000 - -9.09% -
453.povray (max) -92.12% 165.000 13.000 - -7.14% -
447.dealII (max) -91.59% 107.000 9.000 - -59.09% -
456.hmmer (unexplained diff vs previous) -91.57% 83.000 7.000 - 16.67% -
444.namd (unexplained diff vs previous) (percentage) -91.07% 7.730 0.690 - 146.43% -
401.bzip2 (unexplained diff vs previous) -90.91% 132.000 12.000 - 33.33% -
450.soplex -90.58% 191.000 18.000 - 5.88% -
450.soplex (avg) -90.58% 191.000 18.000 - 5.88% -
433.milc -90.45% 220.000 21.000 - 0.00% -
433.milc (avg) -90.45% 220.000 21.000 - 0.00% -
416.gamess (max) (percentage) -90.31% 2.890 0.280 - -3.45% -
445.gobmk (unexplained diff vs previous) -89.78% 186.000 19.000 - 26.67% -
453.povray -87.65% 81.000 10.000 - 0.00% -
453.povray (avg) -87.65% 81.000 10.000 - 0.00% -
444.namd (max) (percentage) -85.79% 7.180 1.020 - -8.11% -
429.mcf (unexplained diff vs previous) -83.87% 93.000 15.000 - -6.25% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.26% 0.620 0.110 - -87.36% -
470.lbm -82.18% 303.000 54.000 - -1.82% -
470.lbm (avg) -82.18% 303.000 54.000 - -1.82% -
470.lbm (max) (percentage) -81.57% 5.100 0.940 - -9.62% -
471.omnetpp (unexplained diff vs previous) -80.77% 26.000 5.000 - -73.68% -
436.cactusADM (max) (percentage) -79.37% 3.150 0.650 - -2.99% -
400.perlbench -76.28% 156.000 37.000 - -2.63% -
400.perlbench (avg) -76.28% 156.000 37.000 - -2.63% -
445.gobmk (unexplained diff vs previous) (percentage) -76.13% 1.550 0.370 - 27.59% -
471.omnetpp (max) (percentage) -74.39% 6.170 1.580 - -10.23% -
433.milc (unexplained diff vs previous) (percentage) -73.48% 3.280 0.870 - 411.76% -
433.milc (max) (percentage) -72.87% 3.170 0.860 - 10.26% -
456.hmmer (max) (percentage) -71.65% 1.270 0.360 - -10.00% -
481.wrf (max) (percentage) -70.79% 3.150 0.920 - -2.13% -
447.dealII -69.23% 104.000 32.000 - -3.03% -
447.dealII (avg) -69.23% 104.000 32.000 - -3.03% -
456.hmmer (unexplained diff vs previous) (percentage) -68.00% 0.750 0.240 - 14.29% -
447.dealII (unexplained diff vs previous) (percentage) -67.95% 0.780 0.250 - -55.36% -
464.h264ref (unexplained diff vs previous) -66.67% 15.000 5.000 - -16.67% -
456.hmmer -60.00% 75.000 30.000 - 0.00% -
456.hmmer (avg) -60.00% 75.000 30.000 - 0.00% -
435.gromacs (max) (percentage) -59.90% 2.020 0.810 - -3.57% -
471.omnetpp -57.65% 170.000 72.000 - -1.37% -
471.omnetpp (avg) -57.65% 170.000 72.000 - -1.37% -
447.dealII (max) (percentage) -56.36% 1.100 0.480 - -58.26% -
445.gobmk (max) -54.10% 183.000 84.000 - -9.68% -
400.perlbench (max) (percentage) -52.47% 3.240 1.540 - -10.98% -
416.gamess (avg) (percentage) -50.23% 2.170 1.080 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -49.43% 0.870 0.440 - 33.33% -
482.sphinx3 (max) (percentage) -48.98% 1.470 0.750 - -71.04% -
465.tonto (max) (percentage) -47.77% 3.580 1.870 - -2.60% -
444.namd (avg) (percentage) -46.56% 3.930 2.100 - -1.41% -
470.lbm (avg) (percentage) -37.97% 2.370 1.470 - -2.00% -
434.zeusmp (max) (percentage) -29.82% 2.280 1.600 - -3.03% -
471.omnetpp (unexplained diff vs previous) (percentage) -29.17% 0.240 0.170 - -73.85% -
445.gobmk -27.17% 92.000 67.000 - -1.47% -
445.gobmk (avg) -27.17% 92.000 67.000 - -1.47% -
464.h264ref (max) -24.19% 62.000 47.000 - -9.62% -
401.bzip2 -19.70% 66.000 53.000 - -1.85% -
401.bzip2 (avg) -19.70% 66.000 53.000 - -1.85% -
464.h264ref -17.95% 78.000 64.000 - -3.03% -
464.h264ref (avg) -17.95% 78.000 64.000 - -3.03% -
465.tonto (avg) (percentage) -14.37% 1.670 1.430 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -10.00% 0.100 0.090 - -10.00% -
436.cactusADM (avg) (percentage) -4.22% 1.660 1.590 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1527.000 -
401.bzip2 2733.000 -
403.gcc 55.000 -6.78%
429.mcf 1911.000 -
433.milc 1155.000 -
444.namd 723.000 -
445.gobmk 5187.000 -
447.dealII 1986.000 -
450.soplex 573.000 2.14%
453.povray 492.000 -
456.hmmer 2916.000 -
458.sjeng 7715.000 -
462.libquantum 134.000 -2.19%
464.h264ref 5813.000 -
470.lbm 3707.000 -
471.omnetpp 2945.000 -
473.astar 5578.000 -
482.sphinx3 917.000 -
Geometric Mean 1471.074 -
Code Size (bytes)
Name Current %
400.perlbench 941436.000 -
401.bzip2 49698.000 -
403.gcc 2671145.000 -
429.mcf 10979.000 -
433.milc 95589.000 -
444.namd 190746.000 -
445.gobmk 1399537.000 -
447.dealII 2123042.000 -
450.soplex 259980.000 -
453.povray 702162.000 -
456.hmmer 230496.000 -
458.sjeng 115929.000 -
462.libquantum 31321.000 -
464.h264ref 418228.000 -
470.lbm 10916.000 -
471.omnetpp 566294.000 -
473.astar 32056.000 -
482.sphinx3 152548.000 -
Geometric Mean 193421.838 -
sample variability
Name Current %
400.perlbench 37.000 -2.63%
400.perlbench (avg) 37.000 -2.63%
400.perlbench (avg) (percentage) 2.460 -2.38%
400.perlbench (max) 23.000 -11.54%
400.perlbench (max) (percentage) 1.540 -10.98%
400.perlbench (unexplained diff vs previous) 0.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.000 -
401.bzip2 53.000 -1.85%
401.bzip2 (avg) 53.000 -1.85%
401.bzip2 (avg) (percentage) 1.950 -2.01%
401.bzip2 (max) 187.000 -9.66%
401.bzip2 (max) (percentage) 6.860 -9.97%
401.bzip2 (unexplained diff vs previous) 12.000 33.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.440 33.33%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.870 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.690 -2.41%
403.gcc (unexplained diff vs previous) 4.000 -
403.gcc (unexplained diff vs previous) (percentage) 7.270 -
410.bwaves (avg) (percentage) 1.370 -
410.bwaves (max) (percentage) 1.100 -3.51%
416.gamess (avg) (percentage) 1.080 -
416.gamess (max) (percentage) 0.280 -
429.mcf 108.000 -
429.mcf (avg) 108.000 -
429.mcf (avg) (percentage) 5.690 -1.56%
429.mcf (max) 349.000 -9.35%
429.mcf (max) (percentage) 18.300 -9.99%
429.mcf (unexplained diff vs previous) 15.000 -6.25%
429.mcf (unexplained diff vs previous) (percentage) 0.780 -7.14%
433.milc 21.000 -
433.milc (avg) 21.000 -
433.milc (avg) (percentage) 1.850 -1.07%
433.milc (max) 9.000 -
433.milc (max) (percentage) 0.860 10.26%
433.milc (unexplained diff vs previous) 10.000 400.00%
433.milc (unexplained diff vs previous) (percentage) 0.870 411.76%
434.zeusmp (avg) (percentage) 1.810 -
434.zeusmp (max) (percentage) 1.600 -3.03%
435.gromacs (avg) (percentage) 2.100 -
435.gromacs (max) (percentage) 0.810 -3.57%
436.cactusADM (avg) (percentage) 1.590 -
436.cactusADM (max) (percentage) 0.650 -2.99%
437.leslie3d (avg) (percentage) 4.730 -
437.leslie3d (max) (percentage) 5.800 -2.85%
444.namd 15.000 -
444.namd (avg) 15.000 -
444.namd (avg) (percentage) 2.100 -1.41%
444.namd (max) 7.000 -
444.namd (max) (percentage) 1.020 -8.11%
444.namd (unexplained diff vs previous) 5.000 150.00%
444.namd (unexplained diff vs previous) (percentage) 0.690 146.43%
445.gobmk 67.000 -1.47%
445.gobmk (avg) 67.000 -1.47%
445.gobmk (avg) (percentage) 1.310 -1.50%
445.gobmk (max) 84.000 -9.68%
445.gobmk (max) (percentage) 1.620 -10.00%
445.gobmk (unexplained diff vs previous) 19.000 26.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.370 27.59%
447.dealII 32.000 -3.03%
447.dealII (avg) 32.000 -3.03%
447.dealII (avg) (percentage) 1.640 -1.80%
447.dealII (max) 9.000 -59.09%
447.dealII (max) (percentage) 0.480 -58.26%
447.dealII (unexplained diff vs previous) 5.000 -54.55%
447.dealII (unexplained diff vs previous) (percentage) 0.250 -55.36%
450.soplex 18.000 5.88%
450.soplex (avg) 18.000 5.88%
450.soplex (avg) (percentage) 3.170 -
450.soplex (max) 18.000 -5.26%
450.soplex (max) (percentage) 3.200 -9.86%
450.soplex (unexplained diff vs previous) 12.000 1100.00%
450.soplex (unexplained diff vs previous) (percentage) 2.090 1061.11%
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 2.160 -1.82%
453.povray (max) 13.000 -7.14%
453.povray (max) (percentage) 2.780 -6.08%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.410 -
454.calculix (avg) (percentage) 3.490 -
454.calculix (max) (percentage) 5.000 -1.96%
456.hmmer 30.000 -
456.hmmer (avg) 30.000 -
456.hmmer (avg) (percentage) 1.040 -
456.hmmer (max) 10.000 -9.09%
456.hmmer (max) (percentage) 0.360 -10.00%
456.hmmer (unexplained diff vs previous) 7.000 16.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.240 14.29%
458.sjeng 68.000 -1.45%
458.sjeng (avg) 68.000 -1.45%
458.sjeng (avg) (percentage) 0.890 -1.11%
458.sjeng (max) 43.000 4.88%
458.sjeng (max) (percentage) 0.570 7.55%
458.sjeng (unexplained diff vs previous) 44.000 83.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.570 83.87%
459.GemsFDTD (avg) (percentage) 1.690 -
459.GemsFDTD (max) (percentage) 1.580 -3.66%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.930 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.190 -8.75%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.240 53.42%
464.h264ref 64.000 -3.03%
464.h264ref (avg) 64.000 -3.03%
464.h264ref (avg) (percentage) 1.110 -2.63%
464.h264ref (max) 47.000 -9.62%
464.h264ref (max) (percentage) 0.820 -9.89%
464.h264ref (unexplained diff vs previous) 5.000 -16.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.090 -10.00%
465.tonto (avg) (percentage) 1.430 -
465.tonto (max) (percentage) 1.870 -2.60%
470.lbm 54.000 -1.82%
470.lbm (avg) 54.000 -1.82%
470.lbm (avg) (percentage) 1.470 -2.00%
470.lbm (max) 34.000 -10.53%
470.lbm (max) (percentage) 0.940 -9.62%
470.lbm (unexplained diff vs previous) 0.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.000 -
471.omnetpp 72.000 -1.37%
471.omnetpp (avg) 72.000 -1.37%
471.omnetpp (avg) (percentage) 2.470 -1.59%
471.omnetpp (max) 46.000 -9.80%
471.omnetpp (max) (percentage) 1.580 -10.23%
471.omnetpp (unexplained diff vs previous) 5.000 -73.68%
471.omnetpp (unexplained diff vs previous) (percentage) 0.170 -73.85%
473.astar 97.000 -1.02%
473.astar (avg) 97.000 -1.02%
473.astar (avg) (percentage) 1.740 -1.69%
473.astar (max) 228.000 -10.24%
473.astar (max) (percentage) 4.100 -10.09%
473.astar (unexplained diff vs previous) 11.000 450.00%
473.astar (unexplained diff vs previous) (percentage) 0.200 400.00%
481.wrf (avg) (percentage) 1.930 -
481.wrf (max) (percentage) 0.920 -2.13%
482.sphinx3 20.000 -
482.sphinx3 (avg) 20.000 -
482.sphinx3 (avg) (percentage) 2.240 -1.75%
482.sphinx3 (max) 6.000 -73.91%
482.sphinx3 (max) (percentage) 0.750 -71.04%
482.sphinx3 (unexplained diff vs previous) 1.000 -87.50%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -87.36%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.830 -
Geometric Mean 3.701 -25.18%