Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a521809d9b182d2863e2b0cf69270d1cef1da507 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/061a82fa2b751b42d0d8ddfcd45367c848d3ee64 (+ 205 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4e16d89866e660426438238a47c2345bdc47dd97 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/160/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0160 (basepoints/gcc-14-05878-g061a82fa2b7) 2023-11-30T11:23:19 0:00:00
Previous 0158 (2-changed-components) 2023-11-29T18:30:00 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 51 64
Performance Improvements 42 131
Added Tests 50 0
Unchanged Tests 1093 1041
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 8.04% 2785.000 3009.000 - -80.18% -
473.astar 5.65% 5591.000 5907.000 - -60.44% -
450.soplex 3.19% 565.000 583.000 - -96.23% -
400.perlbench 2.63% 1522.000 1562.000 - -85.33% -
471.omnetpp 1.59% 2890.000 2936.000 - -72.66% -
445.gobmk 1.50% 5146.000 5223.000 - -56.46% -
458.sjeng 1.42% 7617.000 7725.000 - -45.88% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 862.92% 2.670 25.710 - 4661.11% -
456.hmmer (unexplained diff vs previous) (percentage) 800.00% 0.030 0.270 - -64.00% -
470.lbm (unexplained diff vs previous) (percentage) 775.00% 0.080 0.700 - 536.36% -
470.lbm (unexplained diff vs previous) 766.67% 3.000 26.000 - 85.71% -
456.hmmer (unexplained diff vs previous) 700.00% 1.000 8.000 - -90.36% -
429.mcf (unexplained diff vs previous) 664.71% 51.000 390.000 - 319.35% -
429.mcf (max) (percentage) 643.64% 2.750 20.450 - 3687.04% -
429.mcf (max) 496.15% 52.000 310.000 - 236.96% -
458.sjeng (max) 473.68% 19.000 109.000 - 251.61% -
458.sjeng (max) (percentage) 446.15% 0.260 1.420 - 545.45% -
458.sjeng (unexplained diff vs previous) 440.00% 20.000 108.000 - 1100.00% -
458.sjeng (unexplained diff vs previous) (percentage) 438.46% 0.260 1.400 - 2233.33% -
471.omnetpp (unexplained diff vs previous) 411.11% 9.000 46.000 - 76.92% -
471.omnetpp (unexplained diff vs previous) (percentage) 406.45% 0.310 1.570 - 554.17% -
473.astar (max) 311.11% 81.000 333.000 - 1565.00% -
473.astar (max) (percentage) 286.99% 1.460 5.650 - 3935.71% -
473.astar (unexplained diff vs previous) 280.72% 83.000 316.000 - 10433.33% -
473.astar (unexplained diff vs previous) (percentage) 261.49% 1.480 5.350 - 26650.00% -
470.lbm (max) 73.33% 15.000 26.000 - -96.02% -
470.lbm (max) (percentage) 70.73% 0.410 0.700 - -86.27% -
444.namd (max) 50.00% 4.000 6.000 - -99.08% -
444.namd (unexplained diff vs previous) 50.00% 4.000 6.000 - -99.14% -
444.namd (max) (percentage) 49.09% 0.550 0.820 - -88.58% -
444.namd (unexplained diff vs previous) (percentage) 49.09% 0.550 0.820 - -89.39% -
473.astar 9.68% 93.000 102.000 - 264.29% -
473.astar (avg) 9.68% 93.000 102.000 - 264.29% -
401.bzip2 9.09% 55.000 60.000 - -9.09% -
401.bzip2 (avg) 9.09% 55.000 60.000 - -9.09% -
471.omnetpp (max) 6.98% 43.000 46.000 - -93.05% -
471.omnetpp (max) (percentage) 6.71% 1.490 1.590 - -74.23% -
450.soplex 5.88% 17.000 18.000 - -90.58% -
450.soplex (avg) 5.88% 17.000 18.000 - -90.58% -
429.mcf (avg) (percentage) 4.89% 5.320 5.580 - 952.83% -
473.astar (avg) (percentage) 4.19% 1.670 1.740 - 815.79% -
458.sjeng 3.17% 63.000 65.000 - 38.30% -
458.sjeng (avg) 3.17% 63.000 65.000 - 38.30% -
464.h264ref 1.69% 59.000 60.000 - -23.08% -
464.h264ref (avg) 1.69% 59.000 60.000 - -23.08% -
445.gobmk 1.59% 63.000 64.000 - -30.43% -
445.gobmk (avg) 1.59% 63.000 64.000 - -30.43% -
471.omnetpp 1.49% 67.000 68.000 - -60.00% -
471.omnetpp (avg) 1.49% 67.000 68.000 - -60.00% -
401.bzip2 (max) 1.44% 139.000 141.000 - 6.02% -
458.sjeng (avg) (percentage) 1.19% 0.840 0.850 - 157.58% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -20.45% 1907.000 1517.000 - -91.16% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -86.67% 30.000 4.000 - -97.85% -
482.sphinx3 (unexplained diff vs previous) (percentage) -86.56% 3.200 0.430 - -30.65% -
433.milc (unexplained diff vs previous) (percentage) -85.34% 2.320 0.340 - -89.63% -
433.milc (unexplained diff vs previous) -85.19% 27.000 4.000 - -99.06% -
462.libquantum (unexplained diff vs previous) (percentage) -67.12% 2.190 0.720 - 7100.00% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
462.libquantum (max) -33.33% 3.000 2.000 - -97.30% -
433.milc (max) -18.52% 27.000 22.000 - -94.65% -
433.milc (max) (percentage) -16.88% 2.370 1.970 - -37.85% -
429.mcf -16.83% 101.000 84.000 - -6.67% -
429.mcf (avg) -16.83% 101.000 84.000 - -6.67% -
464.h264ref (max) -16.67% 6.000 5.000 - -91.94% -
482.sphinx3 (max) -13.33% 30.000 26.000 - -94.08% -
482.sphinx3 (max) (percentage) -12.42% 3.300 2.890 - 96.60% -
447.dealII (max) -9.52% 21.000 19.000 - -82.24% -
462.libquantum (max) (percentage) -8.48% 2.240 2.050 - 220.31% -
453.povray (max) -7.14% 14.000 13.000 - -92.12% -
447.dealII (max) (percentage) -6.54% 1.070 1.000 - -9.09% -
400.perlbench (max) (percentage) -6.45% 1.550 1.450 - -55.25% -
450.soplex (max) (percentage) -6.22% 4.820 4.520 - 129.44% -
401.bzip2 (max) (percentage) -6.19% 5.010 4.700 - 434.09% -
453.povray (max) (percentage) -5.59% 2.860 2.700 - 6.72% -
445.gobmk (max) (percentage) -5.13% 0.390 0.370 - -75.82% -
445.gobmk (max) -5.00% 20.000 19.000 - -89.62% -
482.sphinx3 -5.00% 20.000 19.000 - -95.64% -
482.sphinx3 (avg) -5.00% 20.000 19.000 - -95.64% -
459.GemsFDTD (max) (percentage) -4.60% 0.870 0.830 - 38.33% -
400.perlbench (max) -4.35% 23.000 22.000 - -93.62% -
450.soplex (max) -3.70% 27.000 26.000 - -91.45% -
481.wrf (max) (percentage) -2.94% 0.680 0.660 - -79.05% -
403.gcc (max) (percentage) -2.94% 5.450 5.290 - 634.72% -
436.cactusADM (max) (percentage) -2.56% 0.780 0.760 - -75.87% -
434.zeusmp (max) (percentage) -1.71% 1.170 1.150 - -49.56% -
433.milc (avg) (percentage) -1.69% 1.780 1.750 - 2.94% -
482.sphinx3 (avg) (percentage) -1.39% 2.160 2.130 - 45.89% -
454.calculix (max) (percentage) -1.09% 4.590 4.540 - -3.40% -
456.hmmer (avg) (percentage) -1.03% 0.970 0.960 - 41.18% -
444.namd (avg) (percentage) -1.02% 1.970 1.950 - -50.38% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 55.56% 18.000 28.000 - -3.45% -
nb_execution_successful 55.56% 18.000 28.000 - -3.45% -
nb_total_tests 45.00% 20.000 29.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
410.bwaves
410.bwaves (avg)
410.bwaves (max)
416.gamess
416.gamess (avg)
416.gamess (max)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (max)
435.gromacs
435.gromacs (avg)
435.gromacs (max)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (max)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (max)
454.calculix
454.calculix (avg)
454.calculix (max)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (max)
465.tonto
465.tonto (avg)
465.tonto (max)
481.wrf
481.wrf (avg)
481.wrf (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 1.42% 231209.000 234488.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 39.84% 8205.000 11474.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) 26650.00% 0.020 5.350 - 261.49% -
473.astar (unexplained diff vs previous) 10433.33% 3.000 316.000 - 280.72% -
462.libquantum (unexplained diff vs previous) (percentage) 7100.00% 0.010 0.720 - -67.12% -
429.mcf (unexplained diff vs previous) (percentage) 4661.11% 0.540 25.710 - 862.92% -
473.astar (max) (percentage) 3935.71% 0.140 5.650 - 286.99% -
429.mcf (max) (percentage) 3687.04% 0.540 20.450 - 643.64% -
458.sjeng (unexplained diff vs previous) (percentage) 2233.33% 0.060 1.400 - 438.46% -
473.astar (max) 1565.00% 20.000 333.000 - 311.11% -
483.xalancbmk (max) (percentage) 1312.20% 0.410 5.790 - -0.17% -
458.sjeng (unexplained diff vs previous) 1100.00% 9.000 108.000 - 440.00% -
429.mcf (avg) (percentage) 952.83% 0.530 5.580 - 4.89% -
403.gcc (avg) (percentage) 880.33% 0.610 5.980 - 0.00% -
473.astar (avg) (percentage) 815.79% 0.190 1.740 - 4.19% -
403.gcc (max) (percentage) 634.72% 0.720 5.290 - -2.94% -
471.omnetpp (unexplained diff vs previous) (percentage) 554.17% 0.240 1.570 - 406.45% -
458.sjeng (max) (percentage) 545.45% 0.220 1.420 - 446.15% -
470.lbm (unexplained diff vs previous) (percentage) 536.36% 0.110 0.700 - 775.00% -
401.bzip2 (max) (percentage) 434.09% 0.880 4.700 - -6.19% -
401.bzip2 (avg) (percentage) 354.55% 0.440 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) 319.35% 93.000 390.000 - 664.71% -
473.astar 264.29% 28.000 102.000 - 9.68% -
473.astar (avg) 264.29% 28.000 102.000 - 9.68% -
458.sjeng (max) 251.61% 31.000 109.000 - 473.68% -
429.mcf (max) 236.96% 92.000 310.000 - 496.15% -
462.libquantum (max) (percentage) 220.31% 0.640 2.050 - -8.48% -
462.libquantum (avg) (percentage) 176.92% 0.650 1.800 - -0.55% -
458.sjeng (avg) (percentage) 157.58% 0.330 0.850 - 1.19% -
450.soplex (avg) (percentage) 153.23% 1.240 3.140 - 0.00% -
450.soplex (max) (percentage) 129.44% 1.970 4.520 - -6.22% -
437.leslie3d (max) (percentage) 129.06% 2.340 5.360 - -0.56% -
482.sphinx3 (max) (percentage) 96.60% 1.470 2.890 - -12.42% -
437.leslie3d (avg) (percentage) 92.44% 2.380 4.580 - 0.00% -
464.h264ref (avg) (percentage) 88.89% 0.540 1.020 - 0.00% -
470.lbm (unexplained diff vs previous) 85.71% 14.000 26.000 - 766.67% -
459.GemsFDTD (avg) (percentage) 78.89% 0.900 1.610 - 0.00% -
471.omnetpp (unexplained diff vs previous) 76.92% 26.000 46.000 - 411.11% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
454.calculix (avg) (percentage) 70.65% 2.010 3.430 - 0.00% -
453.povray (avg) (percentage) 68.80% 1.250 2.110 - 0.00% -
437.leslie3d (max) 60.68% 351.000 564.000 - 0.00% -
445.gobmk (avg) (percentage) 59.74% 0.770 1.230 - 0.00% -
400.perlbench (avg) (percentage) 56.46% 1.470 2.300 - 0.00% -
471.omnetpp (avg) (percentage) 47.17% 1.590 2.340 - -0.43% -
482.sphinx3 (avg) (percentage) 45.89% 1.460 2.130 - -1.39% -
447.dealII (avg) (percentage) 43.93% 1.070 1.540 - 0.00% -
456.hmmer (avg) (percentage) 41.18% 0.680 0.960 - -1.03% -
459.GemsFDTD (max) (percentage) 38.33% 0.600 0.830 - -4.60% -
458.sjeng 38.30% 47.000 65.000 - 3.17% -
458.sjeng (avg) 38.30% 47.000 65.000 - 3.17% -
437.leslie3d 34.73% 357.000 481.000 - 0.00% -
437.leslie3d (avg) 34.73% 357.000 481.000 - 0.00% -
435.gromacs (avg) (percentage) 17.92% 1.730 2.040 - 0.00% -
410.bwaves (avg) (percentage) 17.43% 1.090 1.280 - 0.00% -
434.zeusmp (avg) (percentage) 15.54% 1.480 1.710 - 0.00% -
465.tonto 14.60% 137.000 157.000 - 0.00% -
465.tonto (avg) 14.60% 137.000 157.000 - 0.00% -
410.bwaves (max) (percentage) 9.52% 0.210 0.230 - -4.17% -
453.povray (max) (percentage) 6.72% 2.530 2.700 - -5.59% -
401.bzip2 (max) 6.02% 133.000 141.000 - 1.44% -
433.milc (avg) (percentage) 2.94% 1.700 1.750 - -1.69% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 55.56% -
nb_execution_successful -3.45% 29.000 28.000 - 55.56% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -2.43% 428364.000 417940.000 - 0.01% -
434.zeusmp -1.73% 165699.000 162829.000 - 0.00% -
410.bwaves -1.34% 17880.000 17640.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 64.000 - 0.00% -
403.gcc -99.37% 9010.000 57.000 - 0.00% -
462.libquantum -98.81% 11614.000 138.000 - 0.73% -
482.sphinx3 -96.88% 29928.000 934.000 - -0.43% -
450.soplex -96.23% 15466.000 583.000 - 3.19% -
453.povray -92.25% 6544.000 507.000 - 0.60% -
444.namd -91.89% 9050.000 734.000 - 0.82% -
429.mcf -91.16% 17158.000 1517.000 - -20.45% -
433.milc -91.05% 12976.000 1162.000 - -0.34% -
436.cactusADM -88.04% 17544.000 2099.000 - 0.00% -
400.perlbench -85.33% 10650.000 1562.000 - 2.63% -
434.zeusmp -80.47% 13211.000 2580.000 - 0.00% -
401.bzip2 -80.18% 15185.000 3009.000 - 8.04% -
447.dealII -79.79% 9751.000 1971.000 - -0.10% -
459.GemsFDTD -73.79% 23356.000 6122.000 - 0.00% -
456.hmmer -73.47% 11046.000 2931.000 - 0.27% -
471.omnetpp -72.66% 10739.000 2936.000 - 1.59% -
470.lbm -70.86% 12819.000 3736.000 - 0.70% -
481.wrf -66.76% 16834.000 5595.000 - 0.00% -
473.astar -60.44% 14932.000 5907.000 - 5.65% -
464.h264ref -59.43% 14556.000 5905.000 - 0.70% -
410.bwaves -59.36% 14755.000 5996.000 - 0.00% -
445.gobmk -56.46% 11995.000 5223.000 - 1.50% -
435.gromacs -52.46% 15419.000 7330.000 - 0.00% -
458.sjeng -45.88% 14275.000 7725.000 - 1.42% -
416.gamess -44.66% 22704.000 12564.000 - 0.00% -
437.leslie3d -29.86% 15005.000 10524.000 - 0.00% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.81% 1074.000 2.000 - 0.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.14% 700.000 6.000 - 50.00% -
444.namd (max) -99.08% 649.000 6.000 - 50.00% -
433.milc (unexplained diff vs previous) -99.06% 425.000 4.000 - -85.19% -
482.sphinx3 (unexplained diff vs previous) -97.85% 186.000 4.000 - -86.67% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
462.libquantum (max) -97.30% 74.000 2.000 - -33.33% -
436.cactusADM (max) -97.28% 552.000 15.000 - 0.00% -
444.namd -96.06% 355.000 14.000 - 0.00% -
444.namd (avg) -96.06% 355.000 14.000 - 0.00% -
470.lbm (max) -96.02% 653.000 26.000 - 73.33% -
482.sphinx3 -95.64% 436.000 19.000 - -5.00% -
482.sphinx3 (avg) -95.64% 436.000 19.000 - -5.00% -
403.gcc (max) -95.31% 64.000 3.000 - 0.00% -
416.gamess (max) -95.27% 656.000 31.000 - 0.00% -
456.hmmer (max) -95.00% 140.000 7.000 - 0.00% -
433.milc (max) -94.65% 411.000 22.000 - -18.52% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
482.sphinx3 (max) -94.08% 439.000 26.000 - -13.33% -
400.perlbench (max) -93.62% 345.000 22.000 - -4.35% -
481.wrf (max) -93.21% 530.000 36.000 - 0.00% -
471.omnetpp (max) -93.05% 662.000 46.000 - 6.98% -
453.povray (max) -92.12% 165.000 13.000 - -7.14% -
464.h264ref (max) -91.94% 62.000 5.000 - -16.67% -
450.soplex (max) -91.45% 304.000 26.000 - -3.70% -
416.gamess (max) (percentage) -91.35% 2.890 0.250 - 0.00% -
433.milc -90.91% 220.000 20.000 - 0.00% -
433.milc (avg) -90.91% 220.000 20.000 - 0.00% -
450.soplex -90.58% 191.000 18.000 - 5.88% -
450.soplex (avg) -90.58% 191.000 18.000 - 5.88% -
434.zeusmp (max) -90.37% 301.000 29.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -90.36% 83.000 8.000 - 700.00% -
433.milc (unexplained diff vs previous) (percentage) -89.63% 3.280 0.340 - -85.34% -
445.gobmk (max) -89.62% 183.000 19.000 - -5.00% -
444.namd (unexplained diff vs previous) (percentage) -89.39% 7.730 0.820 - 49.09% -
436.cactusADM -89.00% 291.000 32.000 - 0.00% -
436.cactusADM (avg) -89.00% 291.000 32.000 - 0.00% -
444.namd (max) (percentage) -88.58% 7.180 0.820 - 49.09% -
453.povray -87.65% 81.000 10.000 - 0.00% -
453.povray (avg) -87.65% 81.000 10.000 - 0.00% -
470.lbm (max) (percentage) -86.27% 5.100 0.700 - 70.73% -
470.lbm -83.83% 303.000 49.000 - 0.00% -
470.lbm (avg) -83.83% 303.000 49.000 - 0.00% -
435.gromacs (max) -82.64% 311.000 54.000 - 0.00% -
447.dealII (max) -82.24% 107.000 19.000 - -9.52% -
481.wrf (max) (percentage) -79.05% 3.150 0.660 - -2.94% -
456.hmmer (max) (percentage) -78.74% 1.270 0.270 - 0.00% -
400.perlbench -77.56% 156.000 35.000 - 0.00% -
400.perlbench (avg) -77.56% 156.000 35.000 - 0.00% -
434.zeusmp -77.44% 195.000 44.000 - 0.00% -
434.zeusmp (avg) -77.44% 195.000 44.000 - 0.00% -
464.h264ref (max) (percentage) -76.74% 0.430 0.100 - -9.09% -
436.cactusADM (max) (percentage) -75.87% 3.150 0.760 - -2.56% -
445.gobmk (max) (percentage) -75.82% 1.530 0.370 - -5.13% -
471.omnetpp (max) (percentage) -74.23% 6.170 1.590 - 6.71% -
416.gamess -73.98% 492.000 128.000 - 0.00% -
416.gamess (avg) -73.98% 492.000 128.000 - 0.00% -
447.dealII -71.15% 104.000 30.000 - 0.00% -
447.dealII (avg) -71.15% 104.000 30.000 - 0.00% -
481.wrf -67.92% 318.000 102.000 - 0.00% -
481.wrf (avg) -67.92% 318.000 102.000 - 0.00% -
459.GemsFDTD (max) -64.29% 140.000 50.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -64.00% 0.750 0.270 - 800.00% -
435.gromacs (max) (percentage) -63.37% 2.020 0.740 - 0.00% -
456.hmmer -62.67% 75.000 28.000 - 0.00% -
456.hmmer (avg) -62.67% 75.000 28.000 - 0.00% -
471.omnetpp -60.00% 170.000 68.000 - 1.49% -
471.omnetpp (avg) -60.00% 170.000 68.000 - 1.49% -
410.bwaves (max) -56.67% 30.000 13.000 - 0.00% -
400.perlbench (max) (percentage) -55.25% 3.240 1.450 - -6.45% -
459.GemsFDTD -53.33% 210.000 98.000 - 0.00% -
459.GemsFDTD (avg) -53.33% 210.000 98.000 - 0.00% -
416.gamess (avg) (percentage) -53.00% 2.170 1.020 - 0.00% -
410.bwaves -52.50% 160.000 76.000 - 0.00% -
410.bwaves (avg) -52.50% 160.000 76.000 - 0.00% -
465.tonto (max) (percentage) -51.96% 3.580 1.720 - -0.58% -
444.namd (avg) (percentage) -50.38% 3.930 1.950 - -1.02% -
434.zeusmp (max) (percentage) -49.56% 2.280 1.150 - -1.71% -
435.gromacs -43.98% 266.000 149.000 - 0.00% -
435.gromacs (avg) -43.98% 266.000 149.000 - 0.00% -
470.lbm (avg) (percentage) -43.88% 2.370 1.330 - -0.75% -
433.milc (max) (percentage) -37.85% 3.170 1.970 - -16.88% -
465.tonto (max) -32.76% 293.000 197.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -30.65% 0.620 0.430 - -86.56% -
445.gobmk -30.43% 92.000 64.000 - 1.59% -
445.gobmk (avg) -30.43% 92.000 64.000 - 1.59% -
464.h264ref -23.08% 78.000 60.000 - 1.69% -
464.h264ref (avg) -23.08% 78.000 60.000 - 1.69% -
465.tonto (avg) (percentage) -17.96% 1.670 1.370 - 0.00% -
447.dealII (max) (percentage) -9.09% 1.100 1.000 - -6.54% -
401.bzip2 -9.09% 66.000 60.000 - 9.09% -
401.bzip2 (avg) -9.09% 66.000 60.000 - 9.09% -
436.cactusADM (avg) (percentage) -7.23% 1.660 1.540 - 0.00% -
429.mcf -6.67% 90.000 84.000 - -16.83% -
429.mcf (avg) -6.67% 90.000 84.000 - -16.83% -
454.calculix (max) (percentage) -3.40% 4.700 4.540 - -1.09% -
481.wrf (avg) (percentage) -3.17% 1.890 1.830 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1562.000 2.63%
401.bzip2 3009.000 8.04%
403.gcc 57.000 -
410.bwaves 5996.000 -
416.gamess 12564.000 -
429.mcf 1517.000 -20.45%
433.milc 1162.000 -
434.zeusmp 2580.000 -
435.gromacs 7330.000 -
436.cactusADM 2099.000 -
437.leslie3d 10524.000 -
444.namd 734.000 -
445.gobmk 5223.000 1.50%
447.dealII 1971.000 -
450.soplex 583.000 3.19%
453.povray 507.000 -
454.calculix 64.000 -
456.hmmer 2931.000 -
458.sjeng 7725.000 1.42%
459.GemsFDTD 6122.000 -
462.libquantum 138.000 -
464.h264ref 5905.000 -
465.tonto 11474.000 -
470.lbm 3736.000 -
471.omnetpp 2936.000 1.59%
473.astar 5907.000 5.65%
481.wrf 5595.000 -
482.sphinx3 934.000 -
Geometric Mean 2090.935 41.44%
Code Size (bytes)
Name Current %
400.perlbench 929284.000 -
401.bzip2 49690.000 -
403.gcc 2683573.000 -
410.bwaves 17640.000 -
416.gamess 6251075.000 -
429.mcf 10979.000 -
433.milc 95617.000 -
434.zeusmp 162829.000 -
435.gromacs 677869.000 -
436.cactusADM 555604.000 -
437.leslie3d 64776.000 -
444.namd 190766.000 -
445.gobmk 1399885.000 -
447.dealII 2118491.000 -
450.soplex 259941.000 -
453.povray 706478.000 -
454.calculix 1270147.000 -
456.hmmer 234488.000 -
458.sjeng 120025.000 -
459.GemsFDTD 254373.000 -
462.libquantum 31353.000 -
464.h264ref 417940.000 -
465.tonto 2873397.000 -
470.lbm 10916.000 -
471.omnetpp 566460.000 -
473.astar 32228.000 -
481.wrf 2623960.000 -
482.sphinx3 152612.000 -
Geometric Mean 272916.866 40.89%
Score
Name Current %
nb_compile_successful 28.000 55.56%
nb_execution_successful 28.000 55.56%
nb_total_tests 29.000 45.00%
Geometric Mean 28.329 51.95%
sample variability
Name Current %
400.perlbench 35.000 -
400.perlbench (avg) 35.000 -
400.perlbench (avg) (percentage) 2.300 -
400.perlbench (max) 22.000 -4.35%
400.perlbench (max) (percentage) 1.450 -6.45%
401.bzip2 60.000 9.09%
401.bzip2 (avg) 60.000 9.09%
401.bzip2 (avg) (percentage) 2.000 -
401.bzip2 (max) 141.000 1.44%
401.bzip2 (max) (percentage) 4.700 -6.19%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.980 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.290 -2.94%
410.bwaves 76.000 -
410.bwaves (avg) 76.000 -
410.bwaves (avg) (percentage) 1.280 -
410.bwaves (max) 13.000 -
410.bwaves (max) (percentage) 0.230 -
416.gamess 128.000 -
416.gamess (avg) 128.000 -
416.gamess (avg) (percentage) 1.020 -
416.gamess (max) 31.000 -
416.gamess (max) (percentage) 0.250 -
429.mcf 84.000 -16.83%
429.mcf (avg) 84.000 -16.83%
429.mcf (avg) (percentage) 5.580 4.89%
429.mcf (max) 310.000 496.15%
429.mcf (max) (percentage) 20.450 643.64%
429.mcf (unexplained diff vs previous) 390.000 664.71%
429.mcf (unexplained diff vs previous) (percentage) 25.710 862.92%
433.milc 20.000 -
433.milc (avg) 20.000 -
433.milc (avg) (percentage) 1.750 -1.69%
433.milc (max) 22.000 -18.52%
433.milc (max) (percentage) 1.970 -16.88%
433.milc (unexplained diff vs previous) 4.000 -85.19%
433.milc (unexplained diff vs previous) (percentage) 0.340 -85.34%
434.zeusmp 44.000 -
434.zeusmp (avg) 44.000 -
434.zeusmp (avg) (percentage) 1.710 -
434.zeusmp (max) 29.000 -
434.zeusmp (max) (percentage) 1.150 -1.71%
435.gromacs 149.000 -
435.gromacs (avg) 149.000 -
435.gromacs (avg) (percentage) 2.040 -
435.gromacs (max) 54.000 -
435.gromacs (max) (percentage) 0.740 -
436.cactusADM 32.000 -
436.cactusADM (avg) 32.000 -
436.cactusADM (avg) (percentage) 1.540 -
436.cactusADM (max) 15.000 -
436.cactusADM (max) (percentage) 0.760 -2.56%
437.leslie3d 481.000 -
437.leslie3d (avg) 481.000 -
437.leslie3d (avg) (percentage) 4.580 -
437.leslie3d (max) 564.000 -
437.leslie3d (max) (percentage) 5.360 -
444.namd 14.000 -
444.namd (avg) 14.000 -
444.namd (avg) (percentage) 1.950 -1.02%
444.namd (max) 6.000 50.00%
444.namd (max) (percentage) 0.820 49.09%
444.namd (unexplained diff vs previous) 6.000 50.00%
444.namd (unexplained diff vs previous) (percentage) 0.820 49.09%
445.gobmk 64.000 1.59%
445.gobmk (avg) 64.000 1.59%
445.gobmk (avg) (percentage) 1.230 -
445.gobmk (max) 19.000 -5.00%
445.gobmk (max) (percentage) 0.370 -5.13%
447.dealII 30.000 -
447.dealII (avg) 30.000 -
447.dealII (avg) (percentage) 1.540 -
447.dealII (max) 19.000 -9.52%
447.dealII (max) (percentage) 1.000 -6.54%
450.soplex 18.000 5.88%
450.soplex (avg) 18.000 5.88%
450.soplex (avg) (percentage) 3.140 -
450.soplex (max) 26.000 -3.70%
450.soplex (max) (percentage) 4.520 -6.22%
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 2.110 -
453.povray (max) 13.000 -7.14%
453.povray (max) (percentage) 2.700 -5.59%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.430 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.540 -1.09%
456.hmmer 28.000 -
456.hmmer (avg) 28.000 -
456.hmmer (avg) (percentage) 0.960 -1.03%
456.hmmer (max) 7.000 -
456.hmmer (max) (percentage) 0.270 -
456.hmmer (unexplained diff vs previous) 8.000 700.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.270 800.00%
458.sjeng 65.000 3.17%
458.sjeng (avg) 65.000 3.17%
458.sjeng (avg) (percentage) 0.850 1.19%
458.sjeng (max) 109.000 473.68%
458.sjeng (max) (percentage) 1.420 446.15%
458.sjeng (unexplained diff vs previous) 108.000 440.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.400 438.46%
459.GemsFDTD 98.000 -
459.GemsFDTD (avg) 98.000 -
459.GemsFDTD (avg) (percentage) 1.610 -
459.GemsFDTD (max) 50.000 -
459.GemsFDTD (max) (percentage) 0.830 -4.60%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.800 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.050 -8.48%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -67.12%
464.h264ref 60.000 1.69%
464.h264ref (avg) 60.000 1.69%
464.h264ref (avg) (percentage) 1.020 -
464.h264ref (max) 5.000 -16.67%
464.h264ref (max) (percentage) 0.100 -
465.tonto 157.000 -
465.tonto (avg) 157.000 -
465.tonto (avg) (percentage) 1.370 -
465.tonto (max) 197.000 -
465.tonto (max) (percentage) 1.720 -
470.lbm 49.000 -
470.lbm (avg) 49.000 -
470.lbm (avg) (percentage) 1.330 -
470.lbm (max) 26.000 73.33%
470.lbm (max) (percentage) 0.700 70.73%
470.lbm (unexplained diff vs previous) 26.000 766.67%
470.lbm (unexplained diff vs previous) (percentage) 0.700 775.00%
471.omnetpp 68.000 1.49%
471.omnetpp (avg) 68.000 1.49%
471.omnetpp (avg) (percentage) 2.340 -
471.omnetpp (max) 46.000 6.98%
471.omnetpp (max) (percentage) 1.590 6.71%
471.omnetpp (unexplained diff vs previous) 46.000 411.11%
471.omnetpp (unexplained diff vs previous) (percentage) 1.570 406.45%
473.astar 102.000 9.68%
473.astar (avg) 102.000 9.68%
473.astar (avg) (percentage) 1.740 4.19%
473.astar (max) 333.000 311.11%
473.astar (max) (percentage) 5.650 286.99%
473.astar (unexplained diff vs previous) 316.000 280.72%
473.astar (unexplained diff vs previous) (percentage) 5.350 261.49%
481.wrf 102.000 -
481.wrf (avg) 102.000 -
481.wrf (avg) (percentage) 1.830 -
481.wrf (max) 36.000 -
481.wrf (max) (percentage) 0.660 -2.94%
482.sphinx3 19.000 -5.00%
482.sphinx3 (avg) 19.000 -5.00%
482.sphinx3 (avg) (percentage) 2.130 -1.39%
482.sphinx3 (max) 26.000 -13.33%
482.sphinx3 (max) (percentage) 2.890 -12.42%
482.sphinx3 (unexplained diff vs previous) 4.000 -86.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.430 -86.56%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.790 -
Geometric Mean 9.050 80.18%