Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fbf4b3c9bb0347950ee8792093e44c9d0cac60c5 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/31ef3fe9e49b5446d465628830a9b6591c2168ce (+ 264 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a53451559dc9cce765ea5bcbb92c4007e058e92b (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/94/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0094 (basepoints/gcc-14-04263-g31ef3fe9e49) 2023-09-22T10:48:41 0:00:00
Previous 0093 (basepoints/gcc-14-03999-g3c834d85f2e) 2023-09-18T12:16:32 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 73
Performance Improvements 68 121
Added Tests 14 0
Unchanged Tests 1134 1042
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 2.97% 1548.000 1594.000 - -85.79% -
462.libquantum 2.53% 158.000 162.000 - -99.05% -
447.dealII 2.15% 1767.000 1805.000 - -80.17% -
471.omnetpp 1.59% 2770.000 2814.000 - -69.63% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 193.33% 15.000 44.000 - -29.03% -
471.omnetpp (unexplained diff vs previous) (percentage) 188.89% 0.540 1.560 - 132.84% -
471.omnetpp (max) 158.82% 17.000 44.000 - -74.42% -
471.omnetpp (max) (percentage) 148.44% 0.640 1.590 - -14.52% -
462.libquantum (max) 33.33% 3.000 4.000 - -69.23% -
447.dealII (max) 15.15% 33.000 38.000 - -74.67% -
447.dealII (max) (percentage) 13.76% 1.890 2.150 - 30.30% -
462.libquantum (max) (percentage) 10.00% 2.300 2.530 - 3062.50% -
450.soplex 4.76% 21.000 22.000 - -40.54% -
450.soplex (avg) 4.76% 21.000 22.000 - -40.54% -
400.perlbench 2.78% 36.000 37.000 - -13.95% -
400.perlbench (avg) 2.78% 36.000 37.000 - -13.95% -
471.omnetpp 1.37% 73.000 74.000 - -32.11% -
471.omnetpp (avg) 1.37% 73.000 74.000 - -32.11% -
464.h264ref 1.00% 100.000 101.000 - 71.19% -
464.h264ref (avg) 1.00% 100.000 101.000 - 71.19% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -10.94% 64.000 57.000 - -99.36% -
435.gromacs -2.03% 7650.000 7495.000 - -55.53% -
465.tonto -1.71% 13063.000 12840.000 - -1.56% -
429.mcf -1.69% 945.000 929.000 - -92.08% -
454.calculix -1.56% 64.000 63.000 - -99.81% -
481.wrf -1.54% 6301.000 6204.000 - -71.79% -
453.povray -1.09% 548.000 542.000 - -92.67% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (max) (percentage) -25.88% 0.850 0.630 - -88.50% -
470.lbm (max) -25.81% 31.000 23.000 - -97.42% -
429.mcf (max) -24.75% 202.000 152.000 - 310.81% -
434.zeusmp (max) -24.14% 29.000 22.000 - -95.43% -
429.mcf (max) (percentage) -23.79% 21.480 16.370 - 5015.62% -
434.zeusmp (max) (percentage) -23.15% 1.080 0.830 - -63.91% -
436.cactusADM (max) (percentage) -19.61% 1.020 0.820 - -83.76% -
436.cactusADM (max) -19.23% 26.000 21.000 - -98.29% -
410.bwaves (max) -14.75% 61.000 52.000 - -80.00% -
410.bwaves (max) (percentage) -13.59% 1.030 0.890 - -49.72% -
444.namd (max) -11.11% 9.000 8.000 - -99.09% -
433.milc (max) -7.14% 14.000 13.000 - -86.60% -
458.sjeng (max) -7.14% 28.000 26.000 - -45.83% -
465.tonto (max) -6.98% 86.000 80.000 - -64.13% -
482.sphinx3 (max) -6.67% 15.000 14.000 - -98.78% -
459.GemsFDTD (max) -6.25% 32.000 30.000 - -94.81% -
444.namd (max) (percentage) -5.94% 1.010 0.950 - -82.76% -
433.milc (max) (percentage) -5.47% 1.280 1.210 - 70.42% -
458.sjeng (max) (percentage) -5.41% 0.370 0.350 - 16.67% -
465.tonto (max) (percentage) -4.55% 0.660 0.630 - -63.16% -
459.GemsFDTD (max) (percentage) -4.44% 0.450 0.430 - -81.14% -
473.astar (max) -4.31% 116.000 111.000 - 81.97% -
437.leslie3d (max) -4.28% 631.000 604.000 - 7.86% -
482.sphinx3 (max) (percentage) -4.24% 1.650 1.580 - -49.84% -
437.leslie3d (max) (percentage) -4.23% 5.440 5.210 - 68.06% -
473.astar (max) (percentage) -4.18% 2.390 2.290 - 387.23% -
450.soplex (max) -3.85% 26.000 25.000 - -63.77% -
453.povray (max) (percentage) -3.82% 1.570 1.510 - -41.70% -
401.bzip2 (max) (percentage) -3.81% 5.770 5.550 - 1287.50% -
454.calculix (max) (percentage) -3.56% 4.490 4.330 - 415.48% -
401.bzip2 (max) -3.53% 170.000 164.000 - 144.78% -
464.h264ref (max) -3.23% 31.000 30.000 - -49.15% -
400.perlbench (max) (percentage) -3.19% 0.940 0.910 - 13.75% -
450.soplex (max) (percentage) -3.18% 4.400 4.260 - 868.18% -
429.mcf -2.74% 73.000 71.000 - 26.79% -
429.mcf (avg) -2.74% 73.000 71.000 - 26.79% -
410.bwaves -2.68% 112.000 109.000 - -62.28% -
410.bwaves (avg) -2.68% 112.000 109.000 - -62.28% -
481.wrf (max) -2.46% 122.000 119.000 - -86.98% -
470.lbm (avg) (percentage) -2.45% 2.450 2.390 - -35.92% -
465.tonto -2.42% 124.000 121.000 - -18.24% -
465.tonto (avg) -2.42% 124.000 121.000 - -18.24% -
434.zeusmp (avg) (percentage) -2.37% 2.110 2.060 - 68.85% -
435.gromacs -2.34% 214.000 209.000 - 30.63% -
435.gromacs (avg) -2.34% 214.000 209.000 - 30.63% -
435.gromacs (max) -2.23% 179.000 175.000 - -40.88% -
470.lbm -2.20% 91.000 89.000 - -85.36% -
470.lbm (avg) -2.20% 91.000 89.000 - -85.36% -
410.bwaves (avg) (percentage) -2.12% 1.890 1.850 - -5.61% -
464.h264ref (max) (percentage) -2.00% 0.500 0.490 - 25.64% -
436.cactusADM (avg) (percentage) -1.93% 2.070 2.030 - -15.42% -
429.mcf (avg) (percentage) -1.92% 7.800 7.650 - 1493.75% -
436.cactusADM -1.89% 53.000 52.000 - -91.11% -
436.cactusADM (avg) -1.89% 53.000 52.000 - -91.11% -
434.zeusmp -1.75% 57.000 56.000 - -78.04% -
434.zeusmp (avg) -1.75% 57.000 56.000 - -78.04% -
481.wrf -1.73% 173.000 170.000 - -69.91% -
481.wrf (avg) -1.73% 173.000 170.000 - -69.91% -
471.omnetpp (avg) (percentage) -1.12% 2.670 2.640 - 123.73% -
481.wrf (max) (percentage) -1.03% 1.940 1.920 - -53.85% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.98% 191136.000 194930.000 - -0.00% -
453.povray 1.50% 489013.000 496357.000 - -0.02% -
471.omnetpp 1.40% 295652.000 299803.000 - -0.00% -
437.leslie3d 1.40% 48001.000 48673.000 - 0.37% -
416.gamess 1.27% 4554728.000 4612360.000 - -0.02% -
433.milc 1.02% 47497.000 47981.000 - 0.03% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 5015.62% 0.320 16.370 - -23.79% -
462.libquantum (max) (percentage) 3062.50% 0.080 2.530 - 10.00% -
462.libquantum (unexplained diff vs previous) (percentage) 2987.50% 0.080 2.470 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 1811.11% 0.090 1.720 - 0.00% -
429.mcf (avg) (percentage) 1493.75% 0.480 7.650 - -1.92% -
450.soplex (avg) (percentage) 1441.67% 0.240 3.700 - 0.00% -
401.bzip2 (max) (percentage) 1287.50% 0.400 5.550 - -3.81% -
462.libquantum (avg) (percentage) 1136.84% 0.190 2.350 - 0.00% -
401.bzip2 (avg) (percentage) 1037.04% 0.270 3.070 - 0.00% -
450.soplex (max) (percentage) 868.18% 0.440 4.260 - -3.18% -
445.gobmk (avg) (percentage) 586.36% 0.220 1.510 - 0.00% -
403.gcc (max) (percentage) 505.08% 0.590 3.570 - -0.83% -
400.perlbench (avg) (percentage) 502.56% 0.390 2.350 - 0.00% -
458.sjeng (avg) (percentage) 452.17% 0.230 1.270 - 0.00% -
473.astar (avg) (percentage) 432.50% 0.400 2.130 - 0.00% -
454.calculix (max) (percentage) 415.48% 0.840 4.330 - -3.56% -
473.astar (max) (percentage) 387.23% 0.470 2.290 - -4.18% -
403.gcc (avg) (percentage) 353.49% 0.430 1.950 - 0.00% -
464.h264ref (avg) (percentage) 315.38% 0.390 1.620 - 0.00% -
429.mcf (max) 310.81% 37.000 152.000 - -24.75% -
456.hmmer (avg) (percentage) 306.67% 0.300 1.220 - 0.00% -
433.milc (avg) (percentage) 260.87% 0.690 2.490 - 0.00% -
435.gromacs (avg) (percentage) 194.74% 0.950 2.800 - 0.00% -
447.dealII (avg) (percentage) 186.21% 0.870 2.490 - -0.40% -
445.gobmk 181.48% 27.000 76.000 - 0.00% -
445.gobmk (avg) 181.48% 27.000 76.000 - 0.00% -
445.gobmk (max) (percentage) 181.48% 0.270 0.760 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 181.33% 0.750 2.110 - 0.00% -
458.sjeng 169.44% 36.000 97.000 - 0.00% -
458.sjeng (avg) 169.44% 36.000 97.000 - 0.00% -
401.bzip2 (max) 144.78% 67.000 164.000 - -3.53% -
471.omnetpp (unexplained diff vs previous) (percentage) 132.84% 0.670 1.560 - 188.89% -
471.omnetpp (avg) (percentage) 123.73% 1.180 2.640 - -1.12% -
437.leslie3d (avg) (percentage) 111.98% 1.670 3.540 - 0.00% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
473.astar 101.96% 51.000 103.000 - -0.96% -
473.astar (avg) 101.96% 51.000 103.000 - -0.96% -
401.bzip2 100.00% 45.000 90.000 - 0.00% -
401.bzip2 (avg) 100.00% 45.000 90.000 - 0.00% -
454.calculix (avg) (percentage) 97.54% 2.030 4.010 - 0.00% -
473.astar (max) 81.97% 61.000 111.000 - -4.31% -
483.xalancbmk (max) (percentage) 73.91% 0.920 1.600 - -0.62% -
464.h264ref 71.19% 59.000 101.000 - 1.00% -
464.h264ref (avg) 71.19% 59.000 101.000 - 1.00% -
433.milc (max) (percentage) 70.42% 0.710 1.210 - -5.47% -
434.zeusmp (avg) (percentage) 68.85% 1.220 2.060 - -2.37% -
437.leslie3d (max) (percentage) 68.06% 3.100 5.210 - -4.23% -
459.GemsFDTD (avg) (percentage) 64.03% 1.390 2.280 - 0.00% -
429.mcf (unexplained diff vs previous) 60.00% 10.000 16.000 - 0.00% -
453.povray (avg) (percentage) 51.63% 1.530 2.320 - 0.00% -
437.leslie3d 36.21% 301.000 410.000 - -0.24% -
437.leslie3d (avg) 36.21% 301.000 410.000 - -0.24% -
435.gromacs (max) (percentage) 32.95% 1.760 2.340 - 0.00% -
435.gromacs 30.63% 160.000 209.000 - -2.34% -
435.gromacs (avg) 30.63% 160.000 209.000 - -2.34% -
447.dealII (max) (percentage) 30.30% 1.650 2.150 - 13.76% -
429.mcf 26.79% 56.000 71.000 - -2.74% -
429.mcf (avg) 26.79% 56.000 71.000 - -2.74% -
464.h264ref (max) (percentage) 25.64% 0.390 0.490 - -2.00% -
458.sjeng (max) (percentage) 16.67% 0.300 0.350 - -5.41% -
445.gobmk (max) 15.15% 33.000 38.000 - 0.00% -
400.perlbench (max) (percentage) 13.75% 0.800 0.910 - -3.19% -
482.sphinx3 (avg) (percentage) 12.34% 2.350 2.640 - 0.38% -
437.leslie3d (max) 7.86% 560.000 604.000 - -4.28% -
481.wrf (avg) (percentage) 7.00% 2.570 2.750 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 63.000 - -1.56% -
403.gcc -99.36% 8890.000 57.000 - -10.94% -
462.libquantum -99.05% 17005.000 162.000 - 2.53% -
482.sphinx3 -97.50% 36586.000 915.000 - -0.54% -
450.soplex -96.21% 15709.000 595.000 - 0.17% -
444.namd -94.38% 15957.000 897.000 - -0.66% -
453.povray -92.67% 7395.000 542.000 - -1.09% -
429.mcf -92.08% 11727.000 929.000 - -1.69% -
433.milc -91.94% 13668.000 1102.000 - 0.09% -
436.cactusADM -89.42% 24396.000 2581.000 - -0.19% -
434.zeusmp -86.90% 20932.000 2742.000 - -0.15% -
400.perlbench -85.79% 11215.000 1594.000 - 2.97% -
401.bzip2 -82.56% 16971.000 2960.000 - -0.10% -
447.dealII -80.17% 9101.000 1805.000 - 2.15% -
470.lbm -77.10% 16312.000 3735.000 - 0.11% -
456.hmmer -76.53% 18995.000 4458.000 - -0.40% -
481.wrf -71.79% 21991.000 6204.000 - -1.54% -
459.GemsFDTD -71.76% 25364.000 7162.000 - -0.18% -
471.omnetpp -69.63% 9265.000 2814.000 - 1.59% -
473.astar -62.62% 12983.000 4853.000 - -0.78% -
410.bwaves -59.85% 14745.000 5920.000 - -0.27% -
464.h264ref -58.95% 15208.000 6243.000 - 0.42% -
445.gobmk -58.95% 12396.000 5089.000 - -0.16% -
435.gromacs -55.53% 16853.000 7495.000 - -2.03% -
458.sjeng -52.00% 16018.000 7688.000 - -0.04% -
416.gamess -49.83% 29409.000 14755.000 - -0.24% -
437.leslie3d -35.82% 18070.000 11597.000 - -0.15% -
465.tonto -1.56% 13044.000 12840.000 - -1.71% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.70% 659.000 2.000 - 0.00% -
454.calculix (avg) -99.70% 659.000 2.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.57% 1173.000 5.000 - 0.00% -
470.lbm (unexplained diff vs previous) -99.51% 822.000 4.000 - 0.00% -
454.calculix (max) -99.26% 272.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.15% 470.000 4.000 - 0.00% -
444.namd (max) -99.09% 879.000 8.000 - -11.11% -
482.sphinx3 (max) -98.78% 1152.000 14.000 - -6.67% -
436.cactusADM (max) -98.29% 1231.000 21.000 - -19.23% -
470.lbm (unexplained diff vs previous) (percentage) -97.82% 5.040 0.110 - 0.00% -
470.lbm (max) -97.42% 893.000 23.000 - -25.81% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
482.sphinx3 -97.21% 859.000 24.000 - 0.00% -
482.sphinx3 (avg) -97.21% 859.000 24.000 - 0.00% -
403.gcc (max) -96.15% 52.000 2.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -96.05% 4.810 0.190 - 0.00% -
453.povray (max) -95.81% 191.000 8.000 - 0.00% -
434.zeusmp (max) -95.43% 481.000 22.000 - -24.14% -
444.namd -95.41% 414.000 19.000 - 0.00% -
444.namd (avg) -95.41% 414.000 19.000 - 0.00% -
416.gamess (max) -95.12% 923.000 45.000 - 0.00% -
459.GemsFDTD (max) -94.81% 578.000 30.000 - -6.25% -
410.bwaves (unexplained diff vs previous) -93.77% 257.000 16.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -93.33% 2.250 0.150 - 0.00% -
456.hmmer (max) -91.84% 98.000 8.000 - 0.00% -
436.cactusADM -91.11% 585.000 52.000 - -1.89% -
436.cactusADM (avg) -91.11% 585.000 52.000 - -1.89% -
462.libquantum -90.62% 32.000 3.000 - 0.00% -
462.libquantum (avg) -90.62% 32.000 3.000 - 0.00% -
416.gamess (max) (percentage) -90.13% 3.140 0.310 - 0.00% -
453.povray -89.38% 113.000 12.000 - 0.00% -
453.povray (avg) -89.38% 113.000 12.000 - 0.00% -
470.lbm (max) (percentage) -88.50% 5.480 0.630 - -25.88% -
481.wrf (max) -86.98% 914.000 119.000 - -2.46% -
433.milc (max) -86.60% 97.000 13.000 - -7.14% -
470.lbm -85.36% 608.000 89.000 - -2.20% -
470.lbm (avg) -85.36% 608.000 89.000 - -2.20% -
410.bwaves (unexplained diff vs previous) (percentage) -84.48% 1.740 0.270 - 0.00% -
400.perlbench (max) -84.27% 89.000 14.000 - 0.00% -
436.cactusADM (max) (percentage) -83.76% 5.050 0.820 - -19.61% -
444.namd (max) (percentage) -82.76% 5.510 0.950 - -5.94% -
459.GemsFDTD (max) (percentage) -81.14% 2.280 0.430 - -4.44% -
410.bwaves (max) -80.00% 260.000 52.000 - -14.75% -
434.zeusmp -78.04% 255.000 56.000 - -1.75% -
434.zeusmp (avg) -78.04% 255.000 56.000 - -1.75% -
447.dealII (max) -74.67% 150.000 38.000 - 15.15% -
471.omnetpp (max) -74.42% 172.000 44.000 - 158.82% -
462.libquantum (unexplained diff vs previous) -71.43% 14.000 4.000 - 0.00% -
433.milc -71.28% 94.000 27.000 - 0.00% -
433.milc (avg) -71.28% 94.000 27.000 - 0.00% -
481.wrf -69.91% 565.000 170.000 - -1.73% -
481.wrf (avg) -69.91% 565.000 170.000 - -1.73% -
462.libquantum (max) -69.23% 13.000 4.000 - 33.33% -
465.tonto (max) -64.13% 223.000 80.000 - -6.98% -
434.zeusmp (max) (percentage) -63.91% 2.300 0.830 - -23.15% -
450.soplex (max) -63.77% 69.000 25.000 - -3.85% -
465.tonto (max) (percentage) -63.16% 1.710 0.630 - -4.55% -
410.bwaves -62.28% 289.000 109.000 - -2.68% -
410.bwaves (avg) -62.28% 289.000 109.000 - -2.68% -
456.hmmer (max) (percentage) -61.54% 0.520 0.200 - 0.00% -
416.gamess -60.21% 485.000 193.000 - 0.00% -
416.gamess (avg) -60.21% 485.000 193.000 - 0.00% -
481.wrf (max) (percentage) -53.85% 4.160 1.920 - -1.03% -
459.GemsFDTD -53.69% 352.000 163.000 - 0.00% -
459.GemsFDTD (avg) -53.69% 352.000 163.000 - 0.00% -
482.sphinx3 (max) (percentage) -49.84% 3.150 1.580 - -4.24% -
410.bwaves (max) (percentage) -49.72% 1.770 0.890 - -13.59% -
464.h264ref (max) -49.15% 59.000 30.000 - -3.23% -
458.sjeng (max) -45.83% 48.000 26.000 - -7.14% -
447.dealII -44.30% 79.000 44.000 - 0.00% -
447.dealII (avg) -44.30% 79.000 44.000 - 0.00% -
447.dealII (unexplained diff vs previous) -44.12% 68.000 38.000 - 0.00% -
453.povray (max) (percentage) -41.70% 2.590 1.510 - -3.82% -
435.gromacs (max) -40.88% 296.000 175.000 - -2.23% -
450.soplex -40.54% 37.000 22.000 - 4.76% -
450.soplex (avg) -40.54% 37.000 22.000 - 4.76% -
470.lbm (avg) (percentage) -35.92% 3.730 2.390 - -2.45% -
471.omnetpp -32.11% 109.000 74.000 - 1.37% -
471.omnetpp (avg) -32.11% 109.000 74.000 - 1.37% -
471.omnetpp (unexplained diff vs previous) -29.03% 62.000 44.000 - 193.33% -
416.gamess (avg) (percentage) -20.61% 1.650 1.310 - 0.00% -
465.tonto -18.24% 148.000 121.000 - -2.42% -
465.tonto (avg) -18.24% 148.000 121.000 - -2.42% -
465.tonto (avg) (percentage) -16.67% 1.140 0.950 - 0.00% -
436.cactusADM (avg) (percentage) -15.42% 2.400 2.030 - -1.93% -
444.namd (avg) (percentage) -15.38% 2.600 2.200 - 0.00% -
471.omnetpp (max) (percentage) -14.52% 1.860 1.590 - 148.44% -
400.perlbench -13.95% 43.000 37.000 - 2.78% -
400.perlbench (avg) -13.95% 43.000 37.000 - 2.78% -
410.bwaves (avg) (percentage) -5.61% 1.960 1.850 - -2.12% -
456.hmmer -3.57% 56.000 54.000 - 0.00% -
456.hmmer (avg) -3.57% 56.000 54.000 - 0.00% -


Report Time: 0.37s
Name Current %
400.perlbench 1594.000 2.97%
401.bzip2 2960.000 -
403.gcc 57.000 -10.94%
410.bwaves 5920.000 -
416.gamess 14755.000 -
429.mcf 929.000 -1.69%
433.milc 1102.000 -
434.zeusmp 2742.000 -
435.gromacs 7495.000 -2.03%
436.cactusADM 2581.000 -
437.leslie3d 11597.000 -
444.namd 897.000 -
445.gobmk 5089.000 -
447.dealII 1805.000 2.15%
450.soplex 595.000 -
453.povray 542.000 -1.09%
454.calculix 63.000 -1.56%
456.hmmer 4458.000 -
458.sjeng 7688.000 -
459.GemsFDTD 7162.000 -
462.libquantum 162.000 2.53%
464.h264ref 6243.000 -
465.tonto 12840.000 -1.71%
470.lbm 3735.000 -
471.omnetpp 2814.000 1.59%
473.astar 4853.000 -
481.wrf 6204.000 -1.54%
482.sphinx3 915.000 -
Geometric Mean 2158.991 -
Name Current %
400.perlbench 563742.000 -
401.bzip2 33620.000 -
403.gcc 1588382.000 -
410.bwaves 14782.000 -
416.gamess 4612360.000 -
429.mcf 7717.000 -
433.milc 47981.000 -
434.zeusmp 139964.000 -
435.gromacs 395518.000 -
436.cactusADM 258044.000 -
437.leslie3d 48673.000 -
444.namd 162535.000 -
445.gobmk 1089152.000 -
447.dealII 194930.000 -
450.soplex 136502.000 -
453.povray 496357.000 -
454.calculix 683139.000 -
456.hmmer 74921.000 -
458.sjeng 81229.000 -
459.GemsFDTD 196550.000 -
462.libquantum 13154.000 -
464.h264ref 301854.000 -
465.tonto 1444164.000 -
470.lbm 10853.000 -
471.omnetpp 299803.000 -
473.astar 15669.000 -
481.wrf 1541104.000 -
482.sphinx3 80306.000 -
Geometric Mean 158002.542 -
Name Current %
nb_compile_successful 28.000 -
nb_execution_successful 28.000 -
nb_total_tests 29.000 3.57%
Geometric Mean 28.329 1.18%
Name Current %
400.perlbench 37.000 2.78%
400.perlbench (avg) 37.000 2.78%
400.perlbench (avg) (percentage) 2.350 -
400.perlbench (max) 14.000 -
400.perlbench (max) (percentage) 0.910 -3.19%
401.bzip2 90.000 -
401.bzip2 (avg) 90.000 -
401.bzip2 (avg) (percentage) 3.070 -
401.bzip2 (max) 164.000 -3.53%
401.bzip2 (max) (percentage) 5.550 -3.81%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.950 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.570 -
410.bwaves 109.000 -2.68%
410.bwaves (avg) 109.000 -2.68%
410.bwaves (avg) (percentage) 1.850 -2.12%
410.bwaves (max) 52.000 -14.75%
410.bwaves (max) (percentage) 0.890 -13.59%
410.bwaves (unexplained diff vs previous) 16.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.270 -
416.gamess 193.000 -
416.gamess (avg) 193.000 -
416.gamess (avg) (percentage) 1.310 -
416.gamess (max) 45.000 -
416.gamess (max) (percentage) 0.310 -
429.mcf 71.000 -2.74%
429.mcf (avg) 71.000 -2.74%
429.mcf (avg) (percentage) 7.650 -1.92%
429.mcf (max) 152.000 -24.75%
429.mcf (max) (percentage) 16.370 -23.79%
429.mcf (unexplained diff vs previous) 16.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.720 -
433.milc 27.000 -
433.milc (avg) 27.000 -
433.milc (avg) (percentage) 2.490 -
433.milc (max) 13.000 -7.14%
433.milc (max) (percentage) 1.210 -5.47%
434.zeusmp 56.000 -1.75%
434.zeusmp (avg) 56.000 -1.75%
434.zeusmp (avg) (percentage) 2.060 -2.37%
434.zeusmp (max) 22.000 -24.14%
434.zeusmp (max) (percentage) 0.830 -23.15%
434.zeusmp (unexplained diff vs previous) 4.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.150 -
435.gromacs 209.000 -2.34%
435.gromacs (avg) 209.000 -2.34%
435.gromacs (avg) (percentage) 2.800 -
435.gromacs (max) 175.000 -2.23%
435.gromacs (max) (percentage) 2.340 -
436.cactusADM 52.000 -1.89%
436.cactusADM (avg) 52.000 -1.89%
436.cactusADM (avg) (percentage) 2.030 -1.93%
436.cactusADM (max) 21.000 -19.23%
436.cactusADM (max) (percentage) 0.820 -19.61%
436.cactusADM (unexplained diff vs previous) 5.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.190 -
437.leslie3d 410.000 -
437.leslie3d (avg) 410.000 -
437.leslie3d (avg) (percentage) 3.540 -
437.leslie3d (max) 604.000 -4.28%
437.leslie3d (max) (percentage) 5.210 -4.23%
444.namd 19.000 -
444.namd (avg) 19.000 -
444.namd (avg) (percentage) 2.200 -
444.namd (max) 8.000 -11.11%
444.namd (max) (percentage) 0.950 -5.94%
445.gobmk 76.000 -
445.gobmk (avg) 76.000 -
445.gobmk (avg) (percentage) 1.510 -
445.gobmk (max) 38.000 -
445.gobmk (max) (percentage) 0.760 -
447.dealII 44.000 -
447.dealII (avg) 44.000 -
447.dealII (avg) (percentage) 2.490 -
447.dealII (max) 38.000 15.15%
447.dealII (max) (percentage) 2.150 13.76%
447.dealII (unexplained diff vs previous) 38.000 -
447.dealII (unexplained diff vs previous) (percentage) 2.110 -
450.soplex 22.000 4.76%
450.soplex (avg) 22.000 4.76%
450.soplex (avg) (percentage) 3.700 -
450.soplex (max) 25.000 -3.85%
450.soplex (max) (percentage) 4.260 -3.18%
453.povray 12.000 -
453.povray (avg) 12.000 -
453.povray (avg) (percentage) 2.320 -
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.510 -3.82%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.010 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.330 -3.56%
456.hmmer 54.000 -
456.hmmer (avg) 54.000 -
456.hmmer (avg) (percentage) 1.220 -
456.hmmer (max) 8.000 -
456.hmmer (max) (percentage) 0.200 -
458.sjeng 97.000 -
458.sjeng (avg) 97.000 -
458.sjeng (avg) (percentage) 1.270 -
458.sjeng (max) 26.000 -7.14%
458.sjeng (max) (percentage) 0.350 -5.41%
459.GemsFDTD 163.000 -
459.GemsFDTD (avg) 163.000 -
459.GemsFDTD (avg) (percentage) 2.280 -
459.GemsFDTD (max) 30.000 -6.25%
459.GemsFDTD (max) (percentage) 0.430 -4.44%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.350 -
462.libquantum (max) 4.000 33.33%
462.libquantum (max) (percentage) 2.530 10.00%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.470 -
464.h264ref 101.000 1.00%
464.h264ref (avg) 101.000 1.00%
464.h264ref (avg) (percentage) 1.620 -
464.h264ref (max) 30.000 -3.23%
464.h264ref (max) (percentage) 0.490 -2.00%
465.tonto 121.000 -2.42%
465.tonto (avg) 121.000 -2.42%
465.tonto (avg) (percentage) 0.950 -
465.tonto (max) 80.000 -6.98%
465.tonto (max) (percentage) 0.630 -4.55%
470.lbm 89.000 -2.20%
470.lbm (avg) 89.000 -2.20%
470.lbm (avg) (percentage) 2.390 -2.45%
470.lbm (max) 23.000 -25.81%
470.lbm (max) (percentage) 0.630 -25.88%
470.lbm (unexplained diff vs previous) 4.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.110 -
471.omnetpp 74.000 1.37%
471.omnetpp (avg) 74.000 1.37%
471.omnetpp (avg) (percentage) 2.640 -1.12%
471.omnetpp (max) 44.000 158.82%
471.omnetpp (max) (percentage) 1.590 148.44%
471.omnetpp (unexplained diff vs previous) 44.000 193.33%
471.omnetpp (unexplained diff vs previous) (percentage) 1.560 188.89%
473.astar 103.000 -
473.astar (avg) 103.000 -
473.astar (avg) (percentage) 2.130 -
473.astar (max) 111.000 -4.31%
473.astar (max) (percentage) 2.290 -4.18%
481.wrf 170.000 -1.73%
481.wrf (avg) 170.000 -1.73%
481.wrf (avg) (percentage) 2.750 -
481.wrf (max) 119.000 -2.46%
481.wrf (max) (percentage) 1.920 -1.03%
482.sphinx3 24.000 -
482.sphinx3 (avg) 24.000 -
482.sphinx3 (avg) (percentage) 2.640 -
482.sphinx3 (max) 14.000 -6.67%
482.sphinx3 (max) (percentage) 1.580 -4.24%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.600 -
Geometric Mean 9.562 -13.55%