Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=225df051d3d4cf714d1791b9035966a6686b3f3d (+ 46 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ed6a9a35799c9298321d1589533767c2bb6f8d42 (+ 153 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9a51f4e2b6668d14a125bdb2abd0fe6b8102eed1 (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4eea81eb90e0150569d4ce66345b2ada1da2028c (+ 365 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/52/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0052 (4-changed-components) 2023-05-25T12:28:06 0:00:00
Previous 0051 (glibc-2.37.9000-00453-gda55fae9e27) 2023-05-23T15:31:55 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 72 78
Performance Improvements 58 106
Unchanged Tests 1106 1052
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 10.87% 561.000 622.000 - -96.04% -
473.astar 5.70% 4705.000 4973.000 - -61.70% -
433.milc 5.57% 1113.000 1175.000 - -91.40% -
459.GemsFDTD 4.12% 7020.000 7309.000 - -71.18% -
435.gromacs 3.87% 7358.000 7643.000 - -54.65% -
400.perlbench 3.76% 1568.000 1627.000 - -85.49% -
470.lbm 3.72% 3686.000 3823.000 - -76.56% -
401.bzip2 3.26% 2886.000 2980.000 - -82.44% -
447.dealII 3.00% 1899.000 1956.000 - -78.51% -
410.bwaves 2.96% 5877.000 6051.000 - -58.96% -
481.wrf 2.77% 6164.000 6335.000 - -71.19% -
482.sphinx3 2.51% 917.000 940.000 - -97.43% -
434.zeusmp 2.23% 2696.000 2756.000 - -86.83% -
465.tonto 1.92% 12825.000 13071.000 - 0.21% -
403.gcc 1.82% 55.000 56.000 - -99.37% -
471.omnetpp 1.62% 2778.000 2823.000 - -69.53% -
454.calculix 1.56% 64.000 65.000 - -99.80% -
464.h264ref 1.55% 6148.000 6243.000 - -58.95% -
445.gobmk 1.27% 5027.000 5091.000 - -58.93% -
444.namd 1.12% 893.000 903.000 - -94.34% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 4658.82% 0.510 24.270 - 26866.67% -
429.mcf (unexplained diff vs previous) 3766.67% 6.000 232.000 - 2220.00% -
416.gamess (unexplained diff vs previous) (percentage) 1900.00% 0.010 0.200 - -93.44% -
416.gamess (unexplained diff vs previous) 1400.00% 2.000 30.000 - -96.65% -
410.bwaves (unexplained diff vs previous) 1060.00% 15.000 174.000 - -32.30% -
410.bwaves (unexplained diff vs previous) (percentage) 1007.69% 0.260 2.880 - 65.52% -
459.GemsFDTD (unexplained diff vs previous) 750.00% 34.000 289.000 - -50.51% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 722.92% 0.480 3.950 - 71.74% -
459.GemsFDTD (max) 183.96% 106.000 301.000 - -47.92% -
459.GemsFDTD (max) (percentage) 172.85% 1.510 4.120 - 80.70% -
410.bwaves (max) 138.67% 75.000 179.000 - -31.15% -
410.bwaves (max) (percentage) 131.25% 1.280 2.960 - 67.23% -
436.cactusADM (unexplained diff vs previous) (percentage) 109.09% 0.110 0.230 - -95.22% -
436.cactusADM (unexplained diff vs previous) 100.00% 3.000 6.000 - -99.49% -
471.omnetpp (unexplained diff vs previous) 15.38% 39.000 45.000 - -27.42% -
471.omnetpp (unexplained diff vs previous) (percentage) 13.57% 1.400 1.590 - 137.31% -
450.soplex 9.09% 22.000 24.000 - -35.14% -
450.soplex (avg) 9.09% 22.000 24.000 - -35.14% -
433.milc 6.45% 31.000 33.000 - -64.89% -
433.milc (avg) 6.45% 31.000 33.000 - -64.89% -
429.mcf (avg) (percentage) 6.32% 6.170 6.560 - 1266.67% -
459.GemsFDTD 5.98% 184.000 195.000 - -44.60% -
459.GemsFDTD (avg) 5.98% 184.000 195.000 - -44.60% -
473.astar 5.61% 107.000 113.000 - 121.57% -
473.astar (avg) 5.61% 107.000 113.000 - 121.57% -
416.gamess (max) (percentage) 5.26% 0.190 0.200 - -93.63% -
400.perlbench 4.76% 42.000 44.000 - 2.33% -
400.perlbench (avg) 4.76% 42.000 44.000 - 2.33% -
435.gromacs 3.86% 207.000 215.000 - 34.38% -
435.gromacs (avg) 3.86% 207.000 215.000 - 34.38% -
410.bwaves 3.68% 136.000 141.000 - -51.21% -
410.bwaves (avg) 3.68% 136.000 141.000 - -51.21% -
416.gamess (max) 3.57% 28.000 29.000 - -96.86% -
482.sphinx3 3.45% 29.000 30.000 - -96.51% -
482.sphinx3 (avg) 3.45% 29.000 30.000 - -96.51% -
470.lbm 3.36% 119.000 123.000 - -79.77% -
470.lbm (avg) 3.36% 119.000 123.000 - -79.77% -
401.bzip2 3.23% 93.000 96.000 - 113.33% -
401.bzip2 (avg) 3.23% 93.000 96.000 - 113.33% -
434.zeusmp 2.70% 74.000 76.000 - -70.20% -
434.zeusmp (avg) 2.70% 74.000 76.000 - -70.20% -
481.wrf 2.63% 190.000 195.000 - -65.49% -
481.wrf (avg) 2.63% 190.000 195.000 - -65.49% -
465.tonto 2.31% 130.000 133.000 - -10.14% -
465.tonto (avg) 2.31% 130.000 133.000 - -10.14% -
447.dealII 1.92% 52.000 53.000 - -32.91% -
447.dealII (avg) 1.92% 52.000 53.000 - -32.91% -
459.GemsFDTD (avg) (percentage) 1.90% 2.630 2.680 - 92.81% -
464.h264ref 1.68% 119.000 121.000 - 105.08% -
464.h264ref (avg) 1.68% 119.000 121.000 - 105.08% -
445.gobmk 1.14% 88.000 89.000 - 229.63% -
445.gobmk (avg) 1.14% 88.000 89.000 - 229.63% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -19.53% 1188.000 956.000 - -91.85% -
437.leslie3d -5.71% 11978.000 11294.000 - -37.50% -
462.libquantum -1.82% 165.000 162.000 - -99.05% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -26.43% 280.000 206.000 - 456.76% -
429.mcf -15.07% 73.000 62.000 - 10.71% -
429.mcf (avg) -15.07% 73.000 62.000 - 10.71% -
437.leslie3d (max) -13.71% 642.000 554.000 - -1.07% -
436.cactusADM (max) (percentage) -10.94% 0.640 0.570 - -88.71% -
401.bzip2 (max) (percentage) -9.97% 2.910 2.620 - 555.00% -
433.milc (max) (percentage) -9.78% 1.840 1.660 - 133.80% -
470.lbm (max) (percentage) -9.76% 0.820 0.740 - -86.50% -
435.gromacs (max) (percentage) -9.75% 2.770 2.500 - 42.05% -
444.namd (max) (percentage) -8.97% 0.780 0.710 - -87.11% -
458.sjeng (max) (percentage) -8.86% 0.790 0.720 - 140.00% -
465.tonto (max) (percentage) -8.77% 0.570 0.520 - -69.59% -
445.gobmk (max) -8.62% 58.000 53.000 - 60.61% -
445.gobmk (max) (percentage) -8.62% 1.160 1.060 - 292.59% -
473.astar (max) (percentage) -8.62% 3.830 3.500 - 644.68% -
456.hmmer (max) (percentage) -8.57% 0.350 0.320 - -38.46% -
429.mcf (max) (percentage) -8.56% 23.590 21.570 - 6640.62% -
450.soplex (max) (percentage) -8.55% 5.030 4.600 - 945.45% -
437.leslie3d (max) (percentage) -8.40% 5.360 4.910 - 58.39% -
458.sjeng (max) -8.33% 60.000 55.000 - 14.58% -
465.tonto (max) -8.22% 73.000 67.000 - -69.96% -
464.h264ref (max) (percentage) -7.89% 0.760 0.700 - 79.49% -
434.zeusmp (max) (percentage) -7.59% 1.580 1.460 - -36.52% -
400.perlbench (max) (percentage) -7.38% 2.440 2.260 - 182.50% -
481.wrf (max) (percentage) -7.27% 2.200 2.040 - -50.96% -
456.hmmer (max) -6.67% 15.000 14.000 - -85.71% -
470.lbm (max) -6.67% 30.000 28.000 - -96.86% -
464.h264ref (max) -6.52% 46.000 43.000 - -27.12% -
436.cactusADM (max) -6.25% 16.000 15.000 - -98.78% -
453.povray -6.25% 16.000 15.000 - -86.73% -
453.povray (avg) -6.25% 16.000 15.000 - -86.73% -
401.bzip2 (max) -6.02% 83.000 78.000 - 16.42% -
435.gromacs (max) -5.91% 203.000 191.000 - -35.47% -
437.leslie3d -5.70% 456.000 430.000 - 42.86% -
437.leslie3d (avg) -5.70% 456.000 430.000 - 42.86% -
400.perlbench (max) -5.26% 38.000 36.000 - -59.55% -
471.omnetpp (max) (percentage) -5.09% 2.160 2.050 - 10.22% -
433.milc (max) -5.00% 20.000 19.000 - -80.41% -
471.omnetpp (max) -5.00% 60.000 57.000 - -66.86% -
434.zeusmp (max) -4.76% 42.000 40.000 - -91.68% -
481.wrf (max) -4.44% 135.000 129.000 - -85.89% -
482.sphinx3 (max) (percentage) -4.23% 0.710 0.680 - -78.41% -
454.calculix (max) (percentage) -3.73% 3.750 3.610 - 329.76% -
447.dealII (max) (percentage) -3.63% 1.930 1.860 - 12.73% -
473.astar (max) -3.33% 180.000 174.000 - 185.25% -
436.cactusADM -2.82% 71.000 69.000 - -88.21% -
436.cactusADM (avg) -2.82% 71.000 69.000 - -88.21% -
436.cactusADM (avg) (percentage) -2.57% 2.720 2.650 - 10.42% -
416.gamess (avg) (percentage) -2.55% 1.570 1.530 - -7.27% -
416.gamess -2.16% 232.000 227.000 - -53.20% -
416.gamess (avg) -2.16% 232.000 227.000 - -53.20% -
462.libquantum (max) (percentage) -2.07% 1.450 1.420 - 1675.00% -
453.povray (max) (percentage) -1.98% 1.010 0.990 - -61.78% -
403.gcc (max) (percentage) -1.84% 4.890 4.800 - 713.56% -
471.omnetpp (avg) (percentage) -1.44% 3.480 3.430 - 190.68% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 26866.67% 0.090 24.270 - 4658.82% -
429.mcf (max) (percentage) 6640.62% 0.320 21.570 - -8.56% -
429.mcf (unexplained diff vs previous) 2220.00% 10.000 232.000 - 3766.67% -
462.libquantum (max) (percentage) 1675.00% 0.080 1.420 - -2.07% -
450.soplex (avg) (percentage) 1541.67% 0.240 3.940 - 0.00% -
462.libquantum (avg) (percentage) 1368.42% 0.190 2.790 - 0.00% -
429.mcf (avg) (percentage) 1266.67% 0.480 6.560 - 6.32% -
401.bzip2 (avg) (percentage) 1103.70% 0.270 3.250 - 0.00% -
450.soplex (max) (percentage) 945.45% 0.440 4.600 - -8.55% -
403.gcc (max) (percentage) 713.56% 0.590 4.800 - -1.84% -
445.gobmk (avg) (percentage) 700.00% 0.220 1.760 - 0.00% -
473.astar (max) (percentage) 644.68% 0.470 3.500 - -8.62% -
400.perlbench (avg) (percentage) 602.56% 0.390 2.740 - 0.00% -
458.sjeng (avg) (percentage) 573.91% 0.230 1.550 - 0.00% -
401.bzip2 (max) (percentage) 555.00% 0.400 2.620 - -9.97% -
473.astar (avg) (percentage) 472.50% 0.400 2.290 - 0.00% -
429.mcf (max) 456.76% 37.000 206.000 - -26.43% -
456.hmmer (avg) (percentage) 446.67% 0.300 1.640 - 0.00% -
464.h264ref (avg) (percentage) 397.44% 0.390 1.940 - 0.00% -
403.gcc (avg) (percentage) 367.44% 0.430 2.010 - 0.00% -
454.calculix (max) (percentage) 329.76% 0.840 3.610 - -3.73% -
433.milc (avg) (percentage) 315.94% 0.690 2.870 - 0.00% -
445.gobmk (max) (percentage) 292.59% 0.270 1.060 - -8.62% -
458.sjeng 230.56% 36.000 119.000 - 0.00% -
458.sjeng (avg) 230.56% 36.000 119.000 - 0.00% -
445.gobmk 229.63% 27.000 89.000 - 1.14% -
445.gobmk (avg) 229.63% 27.000 89.000 - 1.14% -
447.dealII (avg) (percentage) 214.94% 0.870 2.740 - 0.00% -
435.gromacs (avg) (percentage) 196.84% 0.950 2.820 - 0.00% -
471.omnetpp (avg) (percentage) 190.68% 1.180 3.430 - -1.44% -
473.astar (max) 185.25% 61.000 174.000 - -3.33% -
400.perlbench (max) (percentage) 182.50% 0.800 2.260 - -7.38% -
458.sjeng (max) (percentage) 140.00% 0.300 0.720 - -8.86% -
471.omnetpp (unexplained diff vs previous) (percentage) 137.31% 0.670 1.590 - 13.57% -
433.milc (max) (percentage) 133.80% 0.710 1.660 - -9.78% -
437.leslie3d (avg) (percentage) 128.14% 1.670 3.810 - 0.00% -
434.zeusmp (avg) (percentage) 126.23% 1.220 2.760 - 0.00% -
473.astar 121.57% 51.000 113.000 - 5.61% -
473.astar (avg) 121.57% 51.000 113.000 - 5.61% -
454.calculix (avg) (percentage) 114.78% 2.030 4.360 - 0.00% -
401.bzip2 113.33% 45.000 96.000 - 3.23% -
401.bzip2 (avg) 113.33% 45.000 96.000 - 3.23% -
464.h264ref 105.08% 59.000 121.000 - 1.68% -
464.h264ref (avg) 105.08% 59.000 121.000 - 1.68% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
459.GemsFDTD (avg) (percentage) 92.81% 1.390 2.680 - 1.90% -
453.povray (avg) (percentage) 89.54% 1.530 2.900 - 0.00% -
483.xalancbmk (max) (percentage) 81.52% 0.920 1.670 - -0.60% -
459.GemsFDTD (max) (percentage) 80.70% 2.280 4.120 - 172.85% -
464.h264ref (max) (percentage) 79.49% 0.390 0.700 - -7.89% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 71.74% 2.300 3.950 - 722.92% -
410.bwaves (max) (percentage) 67.23% 1.770 2.960 - 131.25% -
410.bwaves (unexplained diff vs previous) (percentage) 65.52% 1.740 2.880 - 1007.69% -
445.gobmk (max) 60.61% 33.000 53.000 - -8.62% -
437.leslie3d (max) (percentage) 58.39% 3.100 4.910 - -8.40% -
437.leslie3d 42.86% 301.000 430.000 - -5.70% -
437.leslie3d (avg) 42.86% 301.000 430.000 - -5.70% -
435.gromacs (max) (percentage) 42.05% 1.760 2.500 - -9.75% -
482.sphinx3 (avg) (percentage) 37.45% 2.350 3.230 - 0.00% -
435.gromacs 34.38% 160.000 215.000 - 3.86% -
435.gromacs (avg) 34.38% 160.000 215.000 - 3.86% -
456.hmmer 30.36% 56.000 73.000 - 0.00% -
456.hmmer (avg) 30.36% 56.000 73.000 - 0.00% -
481.wrf (avg) (percentage) 20.23% 2.570 3.090 - 0.00% -
410.bwaves (avg) (percentage) 19.39% 1.960 2.340 - 0.86% -
401.bzip2 (max) 16.42% 67.000 78.000 - -6.02% -
458.sjeng (max) 14.58% 48.000 55.000 - -8.33% -
447.dealII (max) (percentage) 12.73% 1.650 1.860 - -3.63% -
444.namd (avg) (percentage) 12.31% 2.600 2.920 - 0.00% -
429.mcf 10.71% 56.000 62.000 - -15.07% -
429.mcf (avg) 10.71% 56.000 62.000 - -15.07% -
436.cactusADM (avg) (percentage) 10.42% 2.400 2.650 - -2.57% -
471.omnetpp (max) (percentage) 10.22% 1.860 2.050 - -5.09% -
400.perlbench 2.33% 43.000 44.000 - 4.76% -
400.perlbench (avg) 2.33% 43.000 44.000 - 4.76% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -
nb_total_tests -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.80% 32491.000 65.000 - 1.56% -
403.gcc -99.37% 8890.000 56.000 - 1.82% -
462.libquantum -99.05% 17005.000 162.000 - -1.82% -
482.sphinx3 -97.43% 36586.000 940.000 - 2.51% -
450.soplex -96.04% 15709.000 622.000 - 10.87% -
444.namd -94.34% 15957.000 903.000 - 1.12% -
453.povray -92.55% 7395.000 551.000 - -0.36% -
429.mcf -91.85% 11727.000 956.000 - -19.53% -
433.milc -91.40% 13668.000 1175.000 - 5.57% -
436.cactusADM -89.20% 24396.000 2634.000 - 0.23% -
434.zeusmp -86.83% 20932.000 2756.000 - 2.23% -
400.perlbench -85.49% 11215.000 1627.000 - 3.76% -
401.bzip2 -82.44% 16971.000 2980.000 - 3.26% -
447.dealII -78.51% 9101.000 1956.000 - 3.00% -
470.lbm -76.56% 16312.000 3823.000 - 3.72% -
456.hmmer -76.52% 18995.000 4460.000 - -0.16% -
481.wrf -71.19% 21991.000 6335.000 - 2.77% -
459.GemsFDTD -71.18% 25364.000 7309.000 - 4.12% -
471.omnetpp -69.53% 9265.000 2823.000 - 1.62% -
473.astar -61.70% 12983.000 4973.000 - 5.70% -
410.bwaves -58.96% 14745.000 6051.000 - 2.96% -
464.h264ref -58.95% 15208.000 6243.000 - 1.55% -
445.gobmk -58.93% 12396.000 5091.000 - 1.27% -
435.gromacs -54.65% 16853.000 7643.000 - 3.87% -
458.sjeng -52.02% 16018.000 7685.000 - -0.25% -
416.gamess -49.49% 29409.000 14855.000 - 0.20% -
437.leslie3d -37.50% 18070.000 11294.000 - -5.71% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.70% 659.000 2.000 - 0.00% -
454.calculix (avg) -99.70% 659.000 2.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.49% 1173.000 6.000 - 100.00% -
482.sphinx3 (max) -99.48% 1152.000 6.000 - 0.00% -
444.namd (max) -99.32% 879.000 6.000 - 0.00% -
454.calculix (max) -99.26% 272.000 2.000 - 0.00% -
436.cactusADM (max) -98.78% 1231.000 15.000 - -6.25% -
453.povray (max) -97.38% 191.000 5.000 - 0.00% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
470.lbm (max) -96.86% 893.000 28.000 - -6.67% -
416.gamess (max) -96.86% 923.000 29.000 - 3.57% -
416.gamess (unexplained diff vs previous) -96.65% 896.000 30.000 - 1400.00% -
482.sphinx3 -96.51% 859.000 30.000 - 3.45% -
482.sphinx3 (avg) -96.51% 859.000 30.000 - 3.45% -
403.gcc (max) -96.15% 52.000 2.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -95.22% 4.810 0.230 - 109.09% -
444.namd -93.72% 414.000 26.000 - 0.00% -
444.namd (avg) -93.72% 414.000 26.000 - 0.00% -
416.gamess (max) (percentage) -93.63% 3.140 0.200 - 5.26% -
416.gamess (unexplained diff vs previous) (percentage) -93.44% 3.050 0.200 - 1900.00% -
434.zeusmp (max) -91.68% 481.000 40.000 - -4.76% -
436.cactusADM (max) (percentage) -88.71% 5.050 0.570 - -10.94% -
436.cactusADM -88.21% 585.000 69.000 - -2.82% -
436.cactusADM (avg) -88.21% 585.000 69.000 - -2.82% -
462.libquantum -87.50% 32.000 4.000 - 0.00% -
462.libquantum (avg) -87.50% 32.000 4.000 - 0.00% -
444.namd (max) (percentage) -87.11% 5.510 0.710 - -8.97% -
453.povray -86.73% 113.000 15.000 - -6.25% -
453.povray (avg) -86.73% 113.000 15.000 - -6.25% -
470.lbm (max) (percentage) -86.50% 5.480 0.740 - -9.76% -
481.wrf (max) -85.89% 914.000 129.000 - -4.44% -
456.hmmer (max) -85.71% 98.000 14.000 - -6.67% -
462.libquantum (max) -84.62% 13.000 2.000 - 0.00% -
433.milc (max) -80.41% 97.000 19.000 - -5.00% -
470.lbm -79.77% 608.000 123.000 - 3.36% -
470.lbm (avg) -79.77% 608.000 123.000 - 3.36% -
482.sphinx3 (max) (percentage) -78.41% 3.150 0.680 - -4.23% -
447.dealII (max) -76.00% 150.000 36.000 - 0.00% -
434.zeusmp -70.20% 255.000 76.000 - 2.70% -
434.zeusmp (avg) -70.20% 255.000 76.000 - 2.70% -
465.tonto (max) -69.96% 223.000 67.000 - -8.22% -
465.tonto (max) (percentage) -69.59% 1.710 0.520 - -8.77% -
471.omnetpp (max) -66.86% 172.000 57.000 - -5.00% -
481.wrf -65.49% 565.000 195.000 - 2.63% -
481.wrf (avg) -65.49% 565.000 195.000 - 2.63% -
433.milc -64.89% 94.000 33.000 - 6.45% -
433.milc (avg) -64.89% 94.000 33.000 - 6.45% -
453.povray (max) (percentage) -61.78% 2.590 0.990 - -1.98% -
400.perlbench (max) -59.55% 89.000 36.000 - -5.26% -
450.soplex (max) -59.42% 69.000 28.000 - 0.00% -
416.gamess -53.20% 485.000 227.000 - -2.16% -
416.gamess (avg) -53.20% 485.000 227.000 - -2.16% -
410.bwaves -51.21% 289.000 141.000 - 3.68% -
410.bwaves (avg) -51.21% 289.000 141.000 - 3.68% -
481.wrf (max) (percentage) -50.96% 4.160 2.040 - -7.27% -
459.GemsFDTD (unexplained diff vs previous) -50.51% 584.000 289.000 - 750.00% -
459.GemsFDTD (max) -47.92% 578.000 301.000 - 183.96% -
459.GemsFDTD -44.60% 352.000 195.000 - 5.98% -
459.GemsFDTD (avg) -44.60% 352.000 195.000 - 5.98% -
456.hmmer (max) (percentage) -38.46% 0.520 0.320 - -8.57% -
434.zeusmp (max) (percentage) -36.52% 2.300 1.460 - -7.59% -
435.gromacs (max) -35.47% 296.000 191.000 - -5.91% -
450.soplex -35.14% 37.000 24.000 - 9.09% -
450.soplex (avg) -35.14% 37.000 24.000 - 9.09% -
447.dealII -32.91% 79.000 53.000 - 1.92% -
447.dealII (avg) -32.91% 79.000 53.000 - 1.92% -
410.bwaves (unexplained diff vs previous) -32.30% 257.000 174.000 - 1060.00% -
410.bwaves (max) -31.15% 260.000 179.000 - 138.67% -
471.omnetpp (unexplained diff vs previous) -27.42% 62.000 45.000 - 15.38% -
464.h264ref (max) -27.12% 59.000 43.000 - -6.52% -
470.lbm (avg) (percentage) -13.14% 3.730 3.240 - 0.00% -
471.omnetpp -11.93% 109.000 96.000 - 0.00% -
471.omnetpp (avg) -11.93% 109.000 96.000 - 0.00% -
465.tonto (avg) (percentage) -10.53% 1.140 1.020 - 0.00% -
465.tonto -10.14% 148.000 133.000 - 2.31% -
465.tonto (avg) -10.14% 148.000 133.000 - 2.31% -
416.gamess (avg) (percentage) -7.27% 1.650 1.530 - -2.55% -
437.leslie3d (max) -1.07% 560.000 554.000 - -13.71% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1627.000 3.76%
401.bzip2 2980.000 3.26%
403.gcc 56.000 1.82%
410.bwaves 6051.000 2.96%
416.gamess 14855.000 -
429.mcf 956.000 -19.53%
433.milc 1175.000 5.57%
434.zeusmp 2756.000 2.23%
435.gromacs 7643.000 3.87%
436.cactusADM 2634.000 -
437.leslie3d 11294.000 -5.71%
444.namd 903.000 1.12%
445.gobmk 5091.000 1.27%
447.dealII 1956.000 3.00%
450.soplex 622.000 10.87%
453.povray 551.000 -
454.calculix 65.000 1.56%
456.hmmer 4460.000 -
458.sjeng 7685.000 -
459.GemsFDTD 7309.000 4.12%
462.libquantum 162.000 -1.82%
464.h264ref 6243.000 1.55%
465.tonto 13071.000 1.92%
470.lbm 3823.000 3.72%
471.omnetpp 2823.000 1.62%
473.astar 4973.000 5.70%
481.wrf 6335.000 2.77%
482.sphinx3 940.000 2.51%
Geometric Mean 2195.218 1.22%
Code Size (bytes)
Name Current %
400.perlbench 563506.000 -
401.bzip2 33652.000 -
403.gcc 1589606.000 -
410.bwaves 14722.000 -
416.gamess 4552072.000 -
429.mcf 7709.000 -
433.milc 47469.000 -
434.zeusmp 140944.000 -
435.gromacs 393970.000 -
436.cactusADM 256936.000 -
437.leslie3d 48001.000 -
444.namd 162586.000 -
445.gobmk 1088094.000 -
447.dealII 191662.000 -
450.soplex 135614.000 -
453.povray 488525.000 -
454.calculix 682263.000 -
456.hmmer 74945.000 -
458.sjeng 81205.000 -
459.GemsFDTD 196014.000 -
462.libquantum 13074.000 -
464.h264ref 301638.000 -
465.tonto 1435576.000 -
470.lbm 10845.000 -
471.omnetpp 296211.000 -
473.astar 15549.000 -
481.wrf 1539936.000 -
482.sphinx3 80066.000 -
Geometric Mean 157305.300 -
sample variability
Name Current %
400.perlbench 44.000 4.76%
400.perlbench (avg) 44.000 4.76%
400.perlbench (avg) (percentage) 2.740 -
400.perlbench (max) 36.000 -5.26%
400.perlbench (max) (percentage) 2.260 -7.38%
401.bzip2 96.000 3.23%
401.bzip2 (avg) 96.000 3.23%
401.bzip2 (avg) (percentage) 3.250 -
401.bzip2 (max) 78.000 -6.02%
401.bzip2 (max) (percentage) 2.620 -9.97%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.010 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.800 -1.84%
410.bwaves 141.000 3.68%
410.bwaves (avg) 141.000 3.68%
410.bwaves (avg) (percentage) 2.340 -
410.bwaves (max) 179.000 138.67%
410.bwaves (max) (percentage) 2.960 131.25%
410.bwaves (unexplained diff vs previous) 174.000 1060.00%
410.bwaves (unexplained diff vs previous) (percentage) 2.880 1007.69%
416.gamess 227.000 -2.16%
416.gamess (avg) 227.000 -2.16%
416.gamess (avg) (percentage) 1.530 -2.55%
416.gamess (max) 29.000 3.57%
416.gamess (max) (percentage) 0.200 5.26%
416.gamess (unexplained diff vs previous) 30.000 1400.00%
416.gamess (unexplained diff vs previous) (percentage) 0.200 1900.00%
429.mcf 62.000 -15.07%
429.mcf (avg) 62.000 -15.07%
429.mcf (avg) (percentage) 6.560 6.32%
429.mcf (max) 206.000 -26.43%
429.mcf (max) (percentage) 21.570 -8.56%
429.mcf (unexplained diff vs previous) 232.000 3766.67%
429.mcf (unexplained diff vs previous) (percentage) 24.270 4658.82%
433.milc 33.000 6.45%
433.milc (avg) 33.000 6.45%
433.milc (avg) (percentage) 2.870 -
433.milc (max) 19.000 -5.00%
433.milc (max) (percentage) 1.660 -9.78%
434.zeusmp 76.000 2.70%
434.zeusmp (avg) 76.000 2.70%
434.zeusmp (avg) (percentage) 2.760 -
434.zeusmp (max) 40.000 -4.76%
434.zeusmp (max) (percentage) 1.460 -7.59%
435.gromacs 215.000 3.86%
435.gromacs (avg) 215.000 3.86%
435.gromacs (avg) (percentage) 2.820 -
435.gromacs (max) 191.000 -5.91%
435.gromacs (max) (percentage) 2.500 -9.75%
436.cactusADM 69.000 -2.82%
436.cactusADM (avg) 69.000 -2.82%
436.cactusADM (avg) (percentage) 2.650 -2.57%
436.cactusADM (max) 15.000 -6.25%
436.cactusADM (max) (percentage) 0.570 -10.94%
436.cactusADM (unexplained diff vs previous) 6.000 100.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.230 109.09%
437.leslie3d 430.000 -5.70%
437.leslie3d (avg) 430.000 -5.70%
437.leslie3d (avg) (percentage) 3.810 -
437.leslie3d (max) 554.000 -13.71%
437.leslie3d (max) (percentage) 4.910 -8.40%
444.namd 26.000 -
444.namd (avg) 26.000 -
444.namd (avg) (percentage) 2.920 -
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.710 -8.97%
445.gobmk 89.000 1.14%
445.gobmk (avg) 89.000 1.14%
445.gobmk (avg) (percentage) 1.760 -
445.gobmk (max) 53.000 -8.62%
445.gobmk (max) (percentage) 1.060 -8.62%
447.dealII 53.000 1.92%
447.dealII (avg) 53.000 1.92%
447.dealII (avg) (percentage) 2.740 -
447.dealII (max) 36.000 -
447.dealII (max) (percentage) 1.860 -3.63%
450.soplex 24.000 9.09%
450.soplex (avg) 24.000 9.09%
450.soplex (avg) (percentage) 3.940 -
450.soplex (max) 28.000 -
450.soplex (max) (percentage) 4.600 -8.55%
453.povray 15.000 -6.25%
453.povray (avg) 15.000 -6.25%
453.povray (avg) (percentage) 2.900 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 0.990 -1.98%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.360 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.610 -3.73%
456.hmmer 73.000 -
456.hmmer (avg) 73.000 -
456.hmmer (avg) (percentage) 1.640 -
456.hmmer (max) 14.000 -6.67%
456.hmmer (max) (percentage) 0.320 -8.57%
458.sjeng 119.000 -
458.sjeng (avg) 119.000 -
458.sjeng (avg) (percentage) 1.550 -
458.sjeng (max) 55.000 -8.33%
458.sjeng (max) (percentage) 0.720 -8.86%
459.GemsFDTD 195.000 5.98%
459.GemsFDTD (avg) 195.000 5.98%
459.GemsFDTD (avg) (percentage) 2.680 1.90%
459.GemsFDTD (max) 301.000 183.96%
459.GemsFDTD (max) (percentage) 4.120 172.85%
459.GemsFDTD (unexplained diff vs previous) 289.000 750.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.950 722.92%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 2.790 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.420 -2.07%
464.h264ref 121.000 1.68%
464.h264ref (avg) 121.000 1.68%
464.h264ref (avg) (percentage) 1.940 -
464.h264ref (max) 43.000 -6.52%
464.h264ref (max) (percentage) 0.700 -7.89%
465.tonto 133.000 2.31%
465.tonto (avg) 133.000 2.31%
465.tonto (avg) (percentage) 1.020 -
465.tonto (max) 67.000 -8.22%
465.tonto (max) (percentage) 0.520 -8.77%
470.lbm 123.000 3.36%
470.lbm (avg) 123.000 3.36%
470.lbm (avg) (percentage) 3.240 -
470.lbm (max) 28.000 -6.67%
470.lbm (max) (percentage) 0.740 -9.76%
471.omnetpp 96.000 -
471.omnetpp (avg) 96.000 -
471.omnetpp (avg) (percentage) 3.430 -1.44%
471.omnetpp (max) 57.000 -5.00%
471.omnetpp (max) (percentage) 2.050 -5.09%
471.omnetpp (unexplained diff vs previous) 45.000 15.38%
471.omnetpp (unexplained diff vs previous) (percentage) 1.590 13.57%
473.astar 113.000 5.61%
473.astar (avg) 113.000 5.61%
473.astar (avg) (percentage) 2.290 -
473.astar (max) 174.000 -3.33%
473.astar (max) (percentage) 3.500 -8.62%
481.wrf 195.000 2.63%
481.wrf (avg) 195.000 2.63%
481.wrf (avg) (percentage) 3.090 -
481.wrf (max) 129.000 -4.44%
481.wrf (max) (percentage) 2.040 -7.27%
482.sphinx3 30.000 3.45%
482.sphinx3 (avg) 30.000 3.45%
482.sphinx3 (avg) (percentage) 3.230 -
482.sphinx3 (max) 6.000 -
482.sphinx3 (max) (percentage) 0.680 -4.23%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.670 -
Geometric Mean 12.876 17.72%