Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d249c8a63aec45648b2165532f79b09763870795 (+ 38 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/11f50716eee812c4a27b66f894e7f3ed0c870534 (+ 87 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2aa0974d2573441bffd596b07bff8698b1f2f18c (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=87c70f5e18e519ad859e54636487afdabd89dfbd (+ 191 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/138/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0138 (4-changed-components) 2023-10-18T03:00:40 0:00:00
Previous 0137 (3-changed-components) 2023-10-14T03:40:16 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 56 15
Performance Improvements 78 165
Unchanged Tests 1102 1056
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.38% 549.000 584.000 - 3.00% -
454.calculix 5.00% 60.000 63.000 - 1.61% -
435.gromacs 4.85% 6971.000 7309.000 - 0.55% -
473.astar 4.45% 4992.000 5214.000 - 1.68% -
401.bzip2 3.74% 2859.000 2966.000 - 0.85% -
459.GemsFDTD 3.68% 5949.000 6168.000 - -0.08% -
400.perlbench 3.39% 1503.000 1554.000 - -6.55% -
464.h264ref 2.90% 5613.000 5776.000 - 0.26% -
465.tonto 2.66% 10718.000 11003.000 - 0.57% -
434.zeusmp 2.39% 2508.000 2568.000 - 2.15% -
433.milc 2.32% 1122.000 1148.000 - -0.26% -
471.omnetpp 1.88% 2657.000 2707.000 - -0.62% -
482.sphinx3 1.74% 920.000 936.000 - -0.95% -
410.bwaves 1.67% 5563.000 5656.000 - 0.07% -
481.wrf 1.65% 5466.000 5556.000 - 0.40% -
447.dealII 1.35% 1700.000 1723.000 - -0.06% -
444.namd 1.22% 736.000 745.000 - -0.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 33.20% 19.400 25.840 - -98.02% -
450.soplex 11.76% 17.000 19.000 - -47.22% -
450.soplex (avg) 11.76% 17.000 19.000 - -47.22% -
473.astar (max) 8.41% 214.000 232.000 - -93.19% -
453.povray 8.33% 12.000 13.000 - -69.05% -
453.povray (avg) 8.33% 12.000 13.000 - -69.05% -
473.astar 6.96% 115.000 123.000 - -42.25% -
473.astar (avg) 6.96% 115.000 123.000 - -42.25% -
429.mcf (unexplained diff vs previous) 5.85% 342.000 362.000 - -98.05% -
400.perlbench 4.88% 41.000 43.000 - -59.05% -
400.perlbench (avg) 4.88% 41.000 43.000 - -59.05% -
435.gromacs 4.65% 172.000 180.000 - -50.95% -
435.gromacs (avg) 4.65% 172.000 180.000 - -50.95% -
459.GemsFDTD 4.10% 122.000 127.000 - -64.72% -
459.GemsFDTD (avg) 4.10% 122.000 127.000 - -64.72% -
433.milc 4.00% 25.000 26.000 - -62.32% -
433.milc (avg) 4.00% 25.000 26.000 - -62.32% -
482.sphinx3 4.00% 25.000 26.000 - -64.86% -
482.sphinx3 (avg) 4.00% 25.000 26.000 - -64.86% -
473.astar (max) (percentage) 3.73% 4.290 4.450 - -93.30% -
429.mcf (avg) (percentage) 3.65% 7.400 7.670 - 0.00% -
401.bzip2 3.12% 64.000 66.000 - -59.01% -
401.bzip2 (avg) 3.12% 64.000 66.000 - -59.01% -
465.tonto 2.63% 190.000 195.000 - -46.58% -
465.tonto (avg) 2.63% 190.000 195.000 - -46.58% -
410.bwaves 2.33% 86.000 88.000 - -64.66% -
410.bwaves (avg) 2.33% 86.000 88.000 - -64.66% -
434.zeusmp 2.27% 44.000 45.000 - -69.39% -
434.zeusmp (avg) 2.27% 44.000 45.000 - -69.39% -
464.h264ref 2.17% 92.000 94.000 - -67.92% -
464.h264ref (avg) 2.17% 92.000 94.000 - -67.92% -
450.soplex (avg) (percentage) 2.17% 3.220 3.290 - -48.83% -
473.astar (avg) (percentage) 2.16% 2.310 2.360 - -43.27% -
481.wrf 1.61% 124.000 126.000 - -63.48% -
481.wrf (avg) 1.61% 124.000 126.000 - -63.48% -
471.omnetpp 1.23% 81.000 82.000 - -63.23% -
471.omnetpp (avg) 1.23% 81.000 82.000 - -63.23% -
458.sjeng 1.18% 85.000 86.000 - -64.32% -
458.sjeng (avg) 1.18% 85.000 86.000 - -64.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -20.53% 1763.000 1401.000 - -1.62% -
436.cactusADM -1.77% 2146.000 2108.000 - 1.20% -
403.gcc -1.69% 59.000 58.000 - 3.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -82.09% 296.000 53.000 - -97.71% -
437.leslie3d (unexplained diff vs previous) (percentage) -82.08% 2.790 0.500 - -97.48% -
470.lbm (unexplained diff vs previous) (percentage) -76.46% 4.120 0.970 - -99.63% -
470.lbm (unexplained diff vs previous) -76.13% 155.000 37.000 - -99.63% -
471.omnetpp (unexplained diff vs previous) (percentage) -60.97% 4.740 1.850 - -99.53% -
471.omnetpp (unexplained diff vs previous) -60.32% 126.000 50.000 - -99.53% -
403.gcc (max) -50.00% 2.000 1.000 - -98.18% -
450.soplex (unexplained diff vs previous) (percentage) -43.28% 10.560 5.990 - -99.77% -
400.perlbench (unexplained diff vs previous) (percentage) -40.58% 5.520 3.280 - -99.38% -
456.hmmer (unexplained diff vs previous) -40.00% 10.000 6.000 - -99.93% -
450.soplex (unexplained diff vs previous) -39.66% 58.000 35.000 - -99.76% -
400.perlbench (unexplained diff vs previous) -38.55% 83.000 51.000 - -99.42% -
456.hmmer (unexplained diff vs previous) (percentage) -38.24% 0.340 0.210 - -99.92% -
403.gcc -33.33% 3.000 2.000 - -50.00% -
403.gcc (avg) -33.33% 3.000 2.000 - -50.00% -
429.mcf (max) -32.31% 424.000 287.000 - -78.29% -
444.namd (unexplained diff vs previous) (percentage) -18.79% 1.490 1.210 - -99.89% -
444.namd (unexplained diff vs previous) -18.18% 11.000 9.000 - -99.89% -
429.mcf -17.69% 130.000 107.000 - -1.83% -
429.mcf (avg) -17.69% 130.000 107.000 - -1.83% -
471.omnetpp (max) (percentage) -16.78% 4.530 3.770 - -95.27% -
450.soplex (max) (percentage) -16.63% 9.560 7.970 - -91.72% -
456.hmmer (max) -15.38% 13.000 11.000 - -99.48% -
471.omnetpp (max) -15.00% 120.000 102.000 - -95.30% -
429.mcf (max) (percentage) -14.71% 24.070 20.530 - -77.90% -
470.lbm (max) (percentage) -12.63% 3.960 3.460 - -95.23% -
458.sjeng (max) (percentage) -12.61% 1.110 0.970 - -97.96% -
458.sjeng (max) -12.20% 82.000 72.000 - -98.00% -
450.soplex (max) -11.54% 52.000 46.000 - -91.56% -
470.lbm (max) -11.49% 148.000 131.000 - -95.23% -
444.namd (max) (percentage) -10.20% 1.470 1.320 - -98.56% -
462.libquantum (max) (percentage) -10.19% 2.160 1.940 - -98.04% -
444.namd (max) -10.00% 10.000 9.000 - -98.69% -
459.GemsFDTD (max) (percentage) -9.90% 4.140 3.730 - -94.78% -
456.hmmer (max) (percentage) -8.89% 0.450 0.410 - -99.44% -
410.bwaves (max) (percentage) -8.42% 2.020 1.850 - -96.81% -
410.bwaves (max) -7.14% 112.000 104.000 - -96.83% -
436.cactusADM (max) -6.67% 45.000 42.000 - -97.73% -
459.GemsFDTD (max) -6.50% 246.000 230.000 - -94.79% -
436.cactusADM (max) (percentage) -5.14% 2.140 2.030 - -97.71% -
473.astar (unexplained diff vs previous) (percentage) -5.12% 4.490 4.260 - -97.85% -
400.perlbench (max) (percentage) -4.97% 5.230 4.970 - -94.09% -
401.bzip2 (max) (percentage) -4.94% 4.860 4.620 - -94.13% -
435.gromacs (max) (percentage) -4.60% 4.350 4.150 - -91.56% -
434.zeusmp (max) (percentage) -4.59% 2.180 2.080 - -97.46% -
453.povray (max) -4.55% 22.000 21.000 - -95.79% -
433.milc (max) (percentage) -4.32% 7.640 7.310 - -91.94% -
453.povray (max) (percentage) -4.13% 4.120 3.950 - -95.67% -
481.wrf (max) (percentage) -4.08% 2.940 2.820 - -95.90% -
482.sphinx3 (max) (percentage) -3.96% 8.330 8.000 - -91.71% -
445.gobmk (max) -3.85% 104.000 100.000 - -96.22% -
465.tonto (max) (percentage) -3.84% 4.170 4.010 - -79.23% -
437.leslie3d (max) (percentage) -3.69% 7.850 7.560 - -54.40% -
464.h264ref (max) (percentage) -3.55% 1.690 1.630 - -97.00% -
447.dealII (max) (percentage) -3.48% 2.300 2.220 - -97.23% -
445.gobmk (max) (percentage) -3.30% 2.120 2.050 - -96.10% -
437.leslie3d (max) -3.25% 832.000 805.000 - -58.27% -
456.hmmer -2.94% 34.000 33.000 - -74.02% -
456.hmmer (avg) -2.94% 34.000 33.000 - -74.02% -
482.sphinx3 (max) -2.63% 76.000 74.000 - -91.88% -
447.dealII (max) -2.56% 39.000 38.000 - -97.25% -
454.calculix (max) (percentage) -2.52% 9.120 8.890 - -91.09% -
481.wrf (max) -2.50% 160.000 156.000 - -95.90% -
433.milc (max) -2.35% 85.000 83.000 - -92.05% -
436.cactusADM -2.22% 45.000 44.000 - -64.52% -
436.cactusADM (avg) -2.22% 45.000 44.000 - -64.52% -
437.leslie3d (avg) (percentage) -2.01% 4.980 4.880 - 60.00% -
434.zeusmp (max) -1.85% 54.000 53.000 - -97.42% -
456.hmmer (avg) (percentage) -1.69% 1.180 1.160 - -73.70% -
437.leslie3d -1.52% 528.000 520.000 - 46.48% -
437.leslie3d (avg) -1.52% 528.000 520.000 - 46.48% -
403.gcc (max) (percentage) -1.44% 3.470 3.420 - -96.56% -
400.perlbench (max) -1.28% 78.000 77.000 - -94.49% -
465.tonto (max) -1.12% 446.000 441.000 - -79.12% -
470.lbm (avg) (percentage) -1.06% 1.880 1.860 - -70.62% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 7.51% 104048.000 111860.000 - 0.00% -
450.soplex 1.58% 205081.000 208330.000 - 0.00% -
400.perlbench 1.17% 893848.000 904307.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 3.57% 56.000 58.000 - -1.69% -
450.soplex 3.00% 567.000 584.000 - 6.38% -
434.zeusmp 2.15% 2514.000 2568.000 - 2.39% -
473.astar 1.68% 5128.000 5214.000 - 4.45% -
454.calculix 1.61% 62.000 63.000 - 5.00% -
456.hmmer 1.49% 2882.000 2925.000 - 0.21% -
436.cactusADM 1.20% 2083.000 2108.000 - -1.77% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 60.00% 3.050 4.880 - -2.01% -
437.leslie3d 46.48% 355.000 520.000 - -1.52% -
437.leslie3d (avg) 46.48% 355.000 520.000 - -1.52% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.76% 152037.000 149359.000 - -0.05% -
464.h264ref -1.54% 387748.000 381780.000 - -0.02% -
459.GemsFDTD -1.32% 244728.000 241488.000 - 0.14% -
453.povray -1.15% 661389.000 653789.000 - 0.00% -
437.leslie3d -1.04% 59479.000 58862.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.42% 11640.000 10660.000 - 0.50% -
400.perlbench -6.55% 1663.000 1554.000 - 3.39% -
462.libquantum -2.86% 140.000 136.000 - 0.00% -
445.gobmk -2.77% 5023.000 4884.000 - -0.79% -
453.povray -1.65% 547.000 538.000 - 0.56% -
429.mcf -1.62% 1424.000 1401.000 - -20.53% -
458.sjeng -1.15% 7567.000 7480.000 - 0.92% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (unexplained diff vs previous) -99.93% 8030.000 6.000 - -40.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.92% 278.630 0.210 - -38.24% -
444.namd (unexplained diff vs previous) -99.89% 8356.000 9.000 - -18.18% -
444.namd (unexplained diff vs previous) (percentage) -99.89% 1118.610 1.210 - -18.79% -
416.gamess (max) (percentage) -99.77% 38.550 0.090 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.77% 2557.320 5.990 - -43.28% -
450.soplex (unexplained diff vs previous) -99.76% 14500.000 35.000 - -39.66% -
470.lbm (unexplained diff vs previous) (percentage) -99.63% 263.730 0.970 - -76.46% -
470.lbm (unexplained diff vs previous) -99.63% 9990.000 37.000 - -76.13% -
471.omnetpp (unexplained diff vs previous) -99.53% 10659.000 50.000 - -60.32% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.53% 391.300 1.850 - -60.97% -
456.hmmer (max) -99.48% 2120.000 11.000 - -15.38% -
456.hmmer (max) (percentage) -99.44% 73.590 0.410 - -8.89% -
400.perlbench (unexplained diff vs previous) -99.42% 8772.000 51.000 - -38.55% -
400.perlbench (unexplained diff vs previous) (percentage) -99.38% 527.480 3.280 - -40.58% -
444.namd (max) -98.69% 685.000 9.000 - -10.00% -
444.namd (max) (percentage) -98.56% 91.790 1.320 - -10.20% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
403.gcc (max) -98.18% 55.000 1.000 - -50.00% -
429.mcf (unexplained diff vs previous) -98.05% 18593.000 362.000 - 5.85% -
462.libquantum (max) (percentage) -98.04% 98.970 1.940 - -10.19% -
429.mcf (unexplained diff vs previous) (percentage) -98.02% 1305.690 25.840 - 33.20% -
458.sjeng (max) -98.00% 3602.000 72.000 - -12.20% -
458.sjeng (max) (percentage) -97.96% 47.610 0.970 - -12.61% -
473.astar (unexplained diff vs previous) (percentage) -97.85% 197.850 4.260 - -5.12% -
473.astar (unexplained diff vs previous) -97.81% 10146.000 222.000 - -0.89% -
436.cactusADM (max) -97.73% 1848.000 42.000 - -6.67% -
436.cactusADM (max) (percentage) -97.71% 88.730 2.030 - -5.14% -
437.leslie3d (unexplained diff vs previous) -97.71% 2314.000 53.000 - -82.09% -
437.leslie3d (unexplained diff vs previous) (percentage) -97.48% 19.880 0.500 - -82.08% -
434.zeusmp (max) (percentage) -97.46% 81.770 2.080 - -4.59% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
434.zeusmp (max) -97.42% 2055.000 53.000 - -1.85% -
447.dealII (max) -97.25% 1384.000 38.000 - -2.56% -
447.dealII (max) (percentage) -97.23% 80.280 2.220 - -3.48% -
464.h264ref (max) (percentage) -97.00% 54.290 1.630 - -3.55% -
464.h264ref (max) -96.99% 3127.000 94.000 - 0.00% -
410.bwaves (max) -96.83% 3276.000 104.000 - -7.14% -
410.bwaves (max) (percentage) -96.81% 57.970 1.850 - -8.42% -
403.gcc (max) (percentage) -96.56% 99.360 3.420 - -1.44% -
445.gobmk (max) -96.22% 2643.000 100.000 - -3.85% -
445.gobmk (max) (percentage) -96.10% 52.630 2.050 - -3.30% -
481.wrf (max) -95.90% 3801.000 156.000 - -2.50% -
481.wrf (max) (percentage) -95.90% 68.700 2.820 - -4.08% -
453.povray (max) -95.79% 499.000 21.000 - -4.55% -
453.povray (max) (percentage) -95.67% 91.250 3.950 - -4.13% -
471.omnetpp (max) -95.30% 2169.000 102.000 - -15.00% -
471.omnetpp (max) (percentage) -95.27% 79.650 3.770 - -16.78% -
470.lbm (max) -95.23% 2746.000 131.000 - -11.49% -
470.lbm (max) (percentage) -95.23% 72.510 3.460 - -12.63% -
459.GemsFDTD (max) -94.79% 4411.000 230.000 - -6.50% -
459.GemsFDTD (max) (percentage) -94.78% 71.460 3.730 - -9.90% -
400.perlbench (max) -94.49% 1397.000 77.000 - -1.28% -
401.bzip2 (max) (percentage) -94.13% 78.650 4.620 - -4.94% -
400.perlbench (max) (percentage) -94.09% 84.060 4.970 - -4.97% -
401.bzip2 (max) -94.08% 2313.000 137.000 - -0.72% -
473.astar (max) (percentage) -93.30% 66.430 4.450 - 3.73% -
473.astar (max) -93.19% 3406.000 232.000 - 8.41% -
433.milc (max) -92.05% 1044.000 83.000 - -2.35% -
433.milc (max) (percentage) -91.94% 90.750 7.310 - -4.32% -
482.sphinx3 (max) -91.88% 911.000 74.000 - -2.63% -
454.calculix (max) -91.80% 61.000 5.000 - 0.00% -
450.soplex (max) (percentage) -91.72% 96.240 7.970 - -16.63% -
482.sphinx3 (max) (percentage) -91.71% 96.500 8.000 - -3.96% -
450.soplex (max) -91.56% 545.000 46.000 - -11.54% -
435.gromacs (max) (percentage) -91.56% 49.160 4.150 - -4.60% -
435.gromacs (max) -91.52% 3573.000 303.000 - 0.00% -
454.calculix (max) (percentage) -91.09% 99.730 8.890 - -2.52% -
465.tonto (max) (percentage) -79.23% 19.310 4.010 - -3.84% -
465.tonto (max) -79.12% 2112.000 441.000 - -1.12% -
429.mcf (max) -78.29% 1322.000 287.000 - -32.31% -
429.mcf (max) (percentage) -77.90% 92.890 20.530 - -14.71% -
444.namd -75.00% 68.000 17.000 - 0.00% -
444.namd (avg) -75.00% 68.000 17.000 - 0.00% -
444.namd (avg) (percentage) -74.40% 9.220 2.360 - -0.84% -
456.hmmer -74.02% 127.000 33.000 - -2.94% -
456.hmmer (avg) -74.02% 127.000 33.000 - -2.94% -
456.hmmer (avg) (percentage) -73.70% 4.410 1.160 - -1.69% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
470.lbm -70.71% 239.000 70.000 - 0.00% -
470.lbm (avg) -70.71% 239.000 70.000 - 0.00% -
470.lbm (avg) (percentage) -70.62% 6.330 1.860 - -1.06% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
434.zeusmp (avg) (percentage) -69.57% 5.850 1.780 - 0.00% -
434.zeusmp -69.39% 147.000 45.000 - 2.27% -
434.zeusmp (avg) -69.39% 147.000 45.000 - 2.27% -
462.libquantum (avg) (percentage) -69.19% 7.660 2.360 - 0.00% -
453.povray -69.05% 42.000 13.000 - 8.33% -
453.povray (avg) -69.05% 42.000 13.000 - 8.33% -
453.povray (avg) (percentage) -69.01% 7.810 2.420 - 0.00% -
464.h264ref -67.92% 293.000 94.000 - 2.17% -
464.h264ref (avg) -67.92% 293.000 94.000 - 2.17% -
464.h264ref (avg) (percentage) -67.78% 5.090 1.640 - 0.00% -
447.dealII -65.66% 99.000 34.000 - 0.00% -
447.dealII (avg) -65.66% 99.000 34.000 - 0.00% -
447.dealII (avg) (percentage) -64.99% 5.770 2.020 - 0.00% -
482.sphinx3 -64.86% 74.000 26.000 - 4.00% -
482.sphinx3 (avg) -64.86% 74.000 26.000 - 4.00% -
459.GemsFDTD (avg) (percentage) -64.73% 5.840 2.060 - 0.00% -
459.GemsFDTD -64.72% 360.000 127.000 - 4.10% -
459.GemsFDTD (avg) -64.72% 360.000 127.000 - 4.10% -
410.bwaves -64.66% 249.000 88.000 - 2.33% -
410.bwaves (avg) -64.66% 249.000 88.000 - 2.33% -
410.bwaves (avg) (percentage) -64.63% 4.410 1.560 - 0.00% -
436.cactusADM (avg) (percentage) -64.55% 5.980 2.120 - 0.00% -
436.cactusADM -64.52% 124.000 44.000 - -2.22% -
436.cactusADM (avg) -64.52% 124.000 44.000 - -2.22% -
482.sphinx3 (avg) (percentage) -64.44% 7.930 2.820 - 0.00% -
458.sjeng -64.32% 241.000 86.000 - 1.18% -
458.sjeng (avg) -64.32% 241.000 86.000 - 1.18% -
458.sjeng (avg) (percentage) -63.95% 3.190 1.150 - 0.00% -
481.wrf (avg) (percentage) -63.62% 6.240 2.270 - -0.44% -
481.wrf -63.48% 345.000 126.000 - 1.61% -
481.wrf (avg) -63.48% 345.000 126.000 - 1.61% -
471.omnetpp -63.23% 223.000 82.000 - 1.23% -
471.omnetpp (avg) -63.23% 223.000 82.000 - 1.23% -
471.omnetpp (avg) (percentage) -63.05% 8.200 3.030 - -0.66% -
445.gobmk -62.76% 196.000 73.000 - 0.00% -
445.gobmk (avg) -62.76% 196.000 73.000 - 0.00% -
433.milc -62.32% 69.000 26.000 - 4.00% -
433.milc (avg) -62.32% 69.000 26.000 - 4.00% -
433.milc (avg) (percentage) -62.15% 6.050 2.290 - 0.00% -
445.gobmk (avg) (percentage) -61.64% 3.910 1.500 - 0.00% -
401.bzip2 (avg) (percentage) -59.12% 5.480 2.240 - 0.00% -
400.perlbench -59.05% 105.000 43.000 - 4.88% -
400.perlbench (avg) -59.05% 105.000 43.000 - 4.88% -
401.bzip2 -59.01% 161.000 66.000 - 3.12% -
401.bzip2 (avg) -59.01% 161.000 66.000 - 3.12% -
437.leslie3d (max) -58.27% 1929.000 805.000 - -3.25% -
400.perlbench (avg) (percentage) -55.91% 6.350 2.800 - 0.72% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) (percentage) -54.40% 16.580 7.560 - -3.69% -
435.gromacs (avg) (percentage) -51.19% 5.060 2.470 - 0.00% -
435.gromacs -50.95% 367.000 180.000 - 4.65% -
435.gromacs (avg) -50.95% 367.000 180.000 - 4.65% -
403.gcc -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) -50.00% 4.000 2.000 - -33.33% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
450.soplex (avg) (percentage) -48.83% 6.430 3.290 - 2.17% -
450.soplex -47.22% 36.000 19.000 - 11.76% -
450.soplex (avg) -47.22% 36.000 19.000 - 11.76% -
454.calculix (avg) (percentage) -47.13% 8.020 4.240 - 0.00% -
465.tonto (avg) (percentage) -46.71% 3.340 1.780 - 0.00% -
465.tonto -46.58% 365.000 195.000 - 2.63% -
465.tonto (avg) -46.58% 365.000 195.000 - 2.63% -
473.astar (avg) (percentage) -43.27% 4.160 2.360 - 2.16% -
473.astar -42.25% 213.000 123.000 - 6.96% -
473.astar (avg) -42.25% 213.000 123.000 - 6.96% -
403.gcc (avg) (percentage) -30.19% 7.320 5.110 - 0.00% -
429.mcf -1.83% 109.000 107.000 - -17.69% -
429.mcf (avg) -1.83% 109.000 107.000 - -17.69% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1554.000 3.39%
401.bzip2 2966.000 3.74%
403.gcc 58.000 -1.69%
410.bwaves 5656.000 1.67%
429.mcf 1401.000 -20.53%
433.milc 1148.000 2.32%
434.zeusmp 2568.000 2.39%
435.gromacs 7309.000 4.85%
436.cactusADM 2108.000 -1.77%
437.leslie3d 10660.000 -
444.namd 745.000 1.22%
445.gobmk 4884.000 -
447.dealII 1723.000 1.35%
450.soplex 584.000 6.38%
453.povray 538.000 -
454.calculix 63.000 5.00%
456.hmmer 2925.000 -
458.sjeng 7480.000 -
459.GemsFDTD 6168.000 3.68%
462.libquantum 136.000 -
464.h264ref 5776.000 2.90%
465.tonto 11003.000 2.66%
470.lbm 3797.000 -
471.omnetpp 2707.000 1.88%
473.astar 5214.000 4.45%
481.wrf 5556.000 1.65%
482.sphinx3 936.000 1.74%
Geometric Mean 1914.707 -
Code Size (bytes)
Name Current %
400.perlbench 904307.000 -
401.bzip2 44035.000 -
403.gcc 2440247.000 -
410.bwaves 16604.000 -
429.mcf 9119.000 -
433.milc 61117.000 -
434.zeusmp 149359.000 -
435.gromacs 498281.000 -
436.cactusADM 351101.000 -
437.leslie3d 58862.000 -
444.namd 188128.000 -
445.gobmk 1382402.000 -
447.dealII 310994.000 -
450.soplex 208330.000 -
453.povray 653789.000 -
454.calculix 840250.000 -
456.hmmer 108307.000 -
458.sjeng 111860.000 -
459.GemsFDTD 241488.000 -
462.libquantum 16117.000 -
464.h264ref 381780.000 -
465.tonto 1951922.000 -
470.lbm 9707.000 -
471.omnetpp 480712.000 -
473.astar 22920.000 -
481.wrf 1941414.000 -
482.sphinx3 112755.000 -
Geometric Mean 182008.972 -
sample variability
Name Current %
400.perlbench 43.000 4.88%
400.perlbench (avg) 43.000 4.88%
400.perlbench (avg) (percentage) 2.800 -
400.perlbench (max) 77.000 -1.28%
400.perlbench (max) (percentage) 4.970 -4.97%
400.perlbench (unexplained diff vs previous) 51.000 -38.55%
400.perlbench (unexplained diff vs previous) (percentage) 3.280 -40.58%
401.bzip2 66.000 3.12%
401.bzip2 (avg) 66.000 3.12%
401.bzip2 (avg) (percentage) 2.240 -
401.bzip2 (max) 137.000 -
401.bzip2 (max) (percentage) 4.620 -4.94%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 5.110 -
403.gcc (max) 1.000 -50.00%
403.gcc (max) (percentage) 3.420 -1.44%
410.bwaves 88.000 2.33%
410.bwaves (avg) 88.000 2.33%
410.bwaves (avg) (percentage) 1.560 -
410.bwaves (max) 104.000 -7.14%
410.bwaves (max) (percentage) 1.850 -8.42%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.090 -
429.mcf 107.000 -17.69%
429.mcf (avg) 107.000 -17.69%
429.mcf (avg) (percentage) 7.670 3.65%
429.mcf (max) 287.000 -32.31%
429.mcf (max) (percentage) 20.530 -14.71%
429.mcf (unexplained diff vs previous) 362.000 5.85%
429.mcf (unexplained diff vs previous) (percentage) 25.840 33.20%
433.milc 26.000 4.00%
433.milc (avg) 26.000 4.00%
433.milc (avg) (percentage) 2.290 -
433.milc (max) 83.000 -2.35%
433.milc (max) (percentage) 7.310 -4.32%
434.zeusmp 45.000 2.27%
434.zeusmp (avg) 45.000 2.27%
434.zeusmp (avg) (percentage) 1.780 -
434.zeusmp (max) 53.000 -1.85%
434.zeusmp (max) (percentage) 2.080 -4.59%
435.gromacs 180.000 4.65%
435.gromacs (avg) 180.000 4.65%
435.gromacs (avg) (percentage) 2.470 -
435.gromacs (max) 303.000 -
435.gromacs (max) (percentage) 4.150 -4.60%
436.cactusADM 44.000 -2.22%
436.cactusADM (avg) 44.000 -2.22%
436.cactusADM (avg) (percentage) 2.120 -
436.cactusADM (max) 42.000 -6.67%
436.cactusADM (max) (percentage) 2.030 -5.14%
437.leslie3d 520.000 -1.52%
437.leslie3d (avg) 520.000 -1.52%
437.leslie3d (avg) (percentage) 4.880 -2.01%
437.leslie3d (max) 805.000 -3.25%
437.leslie3d (max) (percentage) 7.560 -3.69%
437.leslie3d (unexplained diff vs previous) 53.000 -82.09%
437.leslie3d (unexplained diff vs previous) (percentage) 0.500 -82.08%
444.namd 17.000 -
444.namd (avg) 17.000 -
444.namd (avg) (percentage) 2.360 -
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.320 -10.20%
444.namd (unexplained diff vs previous) 9.000 -18.18%
444.namd (unexplained diff vs previous) (percentage) 1.210 -18.79%
445.gobmk 73.000 -
445.gobmk (avg) 73.000 -
445.gobmk (avg) (percentage) 1.500 -
445.gobmk (max) 100.000 -3.85%
445.gobmk (max) (percentage) 2.050 -3.30%
447.dealII 34.000 -
447.dealII (avg) 34.000 -
447.dealII (avg) (percentage) 2.020 -
447.dealII (max) 38.000 -2.56%
447.dealII (max) (percentage) 2.220 -3.48%
450.soplex 19.000 11.76%
450.soplex (avg) 19.000 11.76%
450.soplex (avg) (percentage) 3.290 2.17%
450.soplex (max) 46.000 -11.54%
450.soplex (max) (percentage) 7.970 -16.63%
450.soplex (unexplained diff vs previous) 35.000 -39.66%
450.soplex (unexplained diff vs previous) (percentage) 5.990 -43.28%
453.povray 13.000 8.33%
453.povray (avg) 13.000 8.33%
453.povray (avg) (percentage) 2.420 -
453.povray (max) 21.000 -4.55%
453.povray (max) (percentage) 3.950 -4.13%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.240 -
454.calculix (max) 5.000 -
454.calculix (max) (percentage) 8.890 -2.52%
456.hmmer 33.000 -2.94%
456.hmmer (avg) 33.000 -2.94%
456.hmmer (avg) (percentage) 1.160 -1.69%
456.hmmer (max) 11.000 -15.38%
456.hmmer (max) (percentage) 0.410 -8.89%
456.hmmer (unexplained diff vs previous) 6.000 -40.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.210 -38.24%
458.sjeng 86.000 1.18%
458.sjeng (avg) 86.000 1.18%
458.sjeng (avg) (percentage) 1.150 -
458.sjeng (max) 72.000 -12.20%
458.sjeng (max) (percentage) 0.970 -12.61%
459.GemsFDTD 127.000 4.10%
459.GemsFDTD (avg) 127.000 4.10%
459.GemsFDTD (avg) (percentage) 2.060 -
459.GemsFDTD (max) 230.000 -6.50%
459.GemsFDTD (max) (percentage) 3.730 -9.90%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.360 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.940 -10.19%
464.h264ref 94.000 2.17%
464.h264ref (avg) 94.000 2.17%
464.h264ref (avg) (percentage) 1.640 -
464.h264ref (max) 94.000 -
464.h264ref (max) (percentage) 1.630 -3.55%
465.tonto 195.000 2.63%
465.tonto (avg) 195.000 2.63%
465.tonto (avg) (percentage) 1.780 -
465.tonto (max) 441.000 -1.12%
465.tonto (max) (percentage) 4.010 -3.84%
470.lbm 70.000 -
470.lbm (avg) 70.000 -
470.lbm (avg) (percentage) 1.860 -1.06%
470.lbm (max) 131.000 -11.49%
470.lbm (max) (percentage) 3.460 -12.63%
470.lbm (unexplained diff vs previous) 37.000 -76.13%
470.lbm (unexplained diff vs previous) (percentage) 0.970 -76.46%
471.omnetpp 82.000 1.23%
471.omnetpp (avg) 82.000 1.23%
471.omnetpp (avg) (percentage) 3.030 -
471.omnetpp (max) 102.000 -15.00%
471.omnetpp (max) (percentage) 3.770 -16.78%
471.omnetpp (unexplained diff vs previous) 50.000 -60.32%
471.omnetpp (unexplained diff vs previous) (percentage) 1.850 -60.97%
473.astar 123.000 6.96%
473.astar (avg) 123.000 6.96%
473.astar (avg) (percentage) 2.360 2.16%
473.astar (max) 232.000 8.41%
473.astar (max) (percentage) 4.450 3.73%
473.astar (unexplained diff vs previous) 222.000 -
473.astar (unexplained diff vs previous) (percentage) 4.260 -5.12%
481.wrf 126.000 1.61%
481.wrf (avg) 126.000 1.61%
481.wrf (avg) (percentage) 2.270 -
481.wrf (max) 156.000 -2.50%
481.wrf (max) (percentage) 2.820 -4.08%
482.sphinx3 26.000 4.00%
482.sphinx3 (avg) 26.000 4.00%
482.sphinx3 (avg) (percentage) 2.820 -
482.sphinx3 (max) 74.000 -2.63%
482.sphinx3 (max) (percentage) 8.000 -3.96%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 13.706 -9.47%