Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=31ee179e275a25625f66e7045a651433f9856087 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/e7310e24b1c0ca67b1bb507c1330b2bf39e59e32 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9cc9d61ee12f2f8620d8e0ea3c42af02bf07fe1e (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=42a734d19dbe4dcf194201c26051f5ce6a22cde3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/323/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0323 (basepoints/gcc-13-03596-ge7310e24b1c) 2022-11-02T16:30:06 0:00:00
Previous 0323 (3-changed-components) 2024-11-15T06:34:51 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 106 55
Performance Improvements 80 133
Added Tests 25 0
Unchanged Tests 1025 1048
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 8.95% 54786.000 59691.000 - 0.36% -
459.GemsFDTD 6.54% 236656.000 252128.000 - 3.02% -
434.zeusmp 4.65% 146883.000 153713.000 - 1.10% -
450.soplex 4.20% 202574.000 211088.000 - 2.93% -
435.gromacs 2.18% 489685.000 500339.000 - 0.22% -
447.dealII 1.90% 307012.000 312844.000 - 0.40% -
410.bwaves 1.72% 16464.000 16748.000 - -0.07% -
458.sjeng 1.68% 102284.000 104004.000 - -0.04% -
471.omnetpp 1.49% 475388.000 482476.000 - 0.93% -
470.lbm 1.47% 9547.000 9687.000 - -0.04% -
462.libquantum 1.41% 15893.000 16117.000 - 0.20% -
444.namd 1.40% 185768.000 188373.000 - -0.01% -
456.hmmer 1.38% 107195.000 108679.000 - -0.01% -
453.povray 1.22% 649821.000 657739.000 - -0.55% -
401.bzip2 1.19% 43719.000 44241.000 - 0.02% -
433.milc 1.19% 60501.000 61222.000 - -0.26% -
482.sphinx3 1.05% 111663.000 112835.000 - -0.02% -
464.h264ref 1.05% 379440.000 383420.000 - -1.12% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8706.11% 131.000 11536.000 - 8140.00% -
482.sphinx3 3648.57% 803.000 30101.000 - 3085.29% -
450.soplex 2778.14% 549.000 15801.000 - 2686.77% -
453.povray 1094.64% 541.000 6463.000 - 1081.54% -
444.namd 1070.44% 768.000 8989.000 - 1103.35% -
433.milc 1041.90% 1129.000 12892.000 - 1020.07% -
429.mcf 821.33% 1866.000 17192.000 - 1107.30% -
436.cactusADM 725.58% 2142.000 17684.000 - 748.97% -
400.perlbench 612.75% 1506.000 10734.000 - 545.46% -
434.zeusmp 487.71% 2287.000 13441.000 - 434.65% -
447.dealII 456.91% 1620.000 9022.000 - 423.32% -
401.bzip2 423.36% 2873.000 15036.000 - 411.25% -
459.GemsFDTD 354.18% 5203.000 23631.000 - 282.81% -
471.omnetpp 311.33% 2612.000 10744.000 - 294.42% -
456.hmmer 288.27% 2855.000 11085.000 - 284.63% -
470.lbm 245.63% 3706.000 12809.000 - 238.15% -
473.astar 188.92% 4909.000 14183.000 - 176.58% -
410.bwaves 145.07% 5816.000 14253.000 - 152.18% -
464.h264ref 138.02% 5749.000 13684.000 - 137.53% -
445.gobmk 135.45% 4897.000 11530.000 - 129.54% -
435.gromacs 120.00% 6946.000 15281.000 - 110.22% -
458.sjeng 95.66% 7265.000 14215.000 - 87.86% -
437.leslie3d 33.50% 10600.000 14151.000 - 21.57% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) 3850.00% 2.000 79.000 - -42.75% -
482.sphinx3 2492.31% 13.000 337.000 - 355.41% -
482.sphinx3 (avg) 2492.31% 13.000 337.000 - 355.41% -
482.sphinx3 (max) 1750.00% 20.000 370.000 - -59.39% -
471.omnetpp (unexplained diff vs previous) 1562.50% 8.000 133.000 - -98.75% -
453.povray (max) 1250.00% 8.000 108.000 - -78.36% -
436.cactusADM (max) 1157.69% 26.000 327.000 - -82.31% -
447.dealII (max) 1115.38% 13.000 158.000 - -88.58% -
436.cactusADM (unexplained diff vs previous) 985.71% 7.000 76.000 - -99.54% -
433.milc 984.62% 13.000 141.000 - 104.35% -
433.milc (avg) 984.62% 13.000 141.000 - 104.35% -
450.soplex (max) 942.86% 21.000 219.000 - -59.82% -
433.milc (max) 870.37% 27.000 262.000 - -74.90% -
462.libquantum 850.00% 2.000 19.000 - 90.00% -
462.libquantum (avg) 850.00% 2.000 19.000 - 90.00% -
450.soplex 823.08% 13.000 120.000 - 233.33% -
450.soplex (avg) 823.08% 13.000 120.000 - 233.33% -
434.zeusmp (max) 760.87% 23.000 198.000 - -90.36% -
470.lbm (max) 758.97% 39.000 335.000 - -87.80% -
447.dealII 655.56% 18.000 136.000 - 37.37% -
447.dealII (avg) 655.56% 18.000 136.000 - 37.37% -
434.zeusmp 647.62% 21.000 157.000 - 6.80% -
434.zeusmp (avg) 647.62% 21.000 157.000 - 6.80% -
453.povray 612.50% 8.000 57.000 - 35.71% -
453.povray (avg) 612.50% 8.000 57.000 - 35.71% -
410.bwaves 604.00% 50.000 352.000 - 41.37% -
410.bwaves (avg) 604.00% 50.000 352.000 - 41.37% -
436.cactusADM 550.00% 22.000 143.000 - 15.32% -
436.cactusADM (avg) 550.00% 22.000 143.000 - 15.32% -
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 - -99.96% -
400.perlbench 324.14% 29.000 123.000 - 17.14% -
400.perlbench (avg) 324.14% 29.000 123.000 - 17.14% -
471.omnetpp (unexplained diff vs previous) (percentage) 300.00% 0.310 1.240 - -99.68% -
410.bwaves (max) 283.72% 86.000 330.000 - -89.93% -
470.lbm 267.74% 31.000 114.000 - -52.30% -
470.lbm (avg) 267.74% 31.000 114.000 - -52.30% -
471.omnetpp (max) 226.83% 41.000 134.000 - -93.82% -
400.perlbench (max) 210.00% 50.000 155.000 - -88.90% -
481.wrf (max) (percentage) 207.41% 0.810 2.490 - -96.38% -
410.bwaves (avg) (percentage) 183.91% 0.870 2.470 - -43.99% -
444.namd 177.78% 9.000 25.000 - -63.24% -
444.namd (avg) 177.78% 9.000 25.000 - -63.24% -
470.lbm (max) (percentage) 147.17% 1.060 2.620 - -96.39% -
456.hmmer (max) 107.14% 14.000 29.000 - -98.63% -
447.dealII (max) (percentage) 104.65% 0.860 1.760 - -97.81% -
456.hmmer 92.86% 14.000 27.000 - -78.74% -
456.hmmer (avg) 92.86% 14.000 27.000 - -78.74% -
464.h264ref (max) 74.19% 31.000 54.000 - -98.27% -
401.bzip2 67.50% 40.000 67.000 - -58.39% -
401.bzip2 (avg) 67.50% 40.000 67.000 - -58.39% -
471.omnetpp 60.00% 55.000 88.000 - -60.54% -
471.omnetpp (avg) 60.00% 55.000 88.000 - -60.54% -
410.bwaves (max) (percentage) 56.76% 1.480 2.320 - -96.00% -
436.cactusADM (max) (percentage) 48.00% 1.250 1.850 - -97.92% -
434.zeusmp (max) (percentage) 46.53% 1.010 1.480 - -98.19% -
436.cactusADM (unexplained diff vs previous) (percentage) 30.30% 0.330 0.430 - -99.95% -
447.dealII (avg) (percentage) 29.06% 1.170 1.510 - -73.83% -
434.zeusmp (avg) (percentage) 23.16% 0.950 1.170 - -80.00% -
429.mcf 15.73% 89.000 103.000 - -5.50% -
429.mcf (avg) 15.73% 89.000 103.000 - -5.50% -
453.povray (max) (percentage) 9.80% 1.530 1.680 - -98.16% -
459.GemsFDTD 7.35% 68.000 73.000 - -79.72% -
459.GemsFDTD (avg) 7.35% 68.000 73.000 - -79.72% -
470.lbm (avg) (percentage) 5.95% 0.840 0.890 - -85.94% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -14.71% 34.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto -1.58% 1975683.000 1944559.000 - -0.08% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -22.27% 10809.000 8402.000 - -23.21% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (avg) (percentage) -96.93% 1.630 0.050 - -98.80% -
473.astar (max) (percentage) -96.67% 4.800 0.160 - -99.76% -
429.mcf (max) (percentage) -95.76% 11.800 0.500 - -99.46% -
462.libquantum (unexplained diff vs previous) (percentage) -94.74% 0.760 0.040 - -100.00% -
454.calculix (avg) (percentage) -94.17% 3.600 0.210 - -97.38% -
435.gromacs (max) (percentage) -93.70% 2.540 0.160 - -99.67% -
465.tonto (max) -92.90% 324.000 23.000 - -98.91% -
403.gcc (avg) (percentage) -92.53% 5.090 0.380 - -94.81% -
444.namd (max) (percentage) -92.07% 2.900 0.230 - -99.75% -
483.xalancbmk (avg) (percentage) -91.89% 2.960 0.240 - -96.31% -
403.gcc (max) (percentage) -91.51% 3.770 0.320 - -99.68% -
473.astar -91.25% 80.000 7.000 - -96.71% -
473.astar (avg) -91.25% 80.000 7.000 - -96.71% -
445.gobmk (max) (percentage) -90.91% 1.320 0.120 - -99.77% -
462.libquantum (avg) (percentage) -90.76% 1.840 0.170 - -97.78% -
465.tonto (max) (percentage) -90.67% 3.000 0.280 - -98.55% -
473.astar (max) -90.64% 235.000 22.000 - -99.35% -
435.gromacs (avg) (percentage) -89.27% 1.770 0.190 - -96.25% -
429.mcf (avg) (percentage) -87.53% 4.810 0.600 - -92.18% -
435.gromacs (max) -86.36% 176.000 24.000 - -99.33% -
459.GemsFDTD (max) (percentage) -86.35% 2.710 0.370 - -99.48% -
445.gobmk (avg) (percentage) -84.09% 0.880 0.140 - -96.42% -
483.xalancbmk (max) (percentage) -83.62% 1.770 0.290 - -99.58% -
401.bzip2 (max) (percentage) -82.33% 2.660 0.470 - -99.40% -
437.leslie3d (max) (percentage) -81.84% 12.060 2.190 - -86.79% -
445.gobmk (max) -79.69% 64.000 13.000 - -99.51% -
454.calculix (max) (percentage) -79.52% 0.830 0.170 - -99.83% -
465.tonto -79.10% 134.000 28.000 - -92.33% -
465.tonto (avg) -79.10% 134.000 28.000 - -92.33% -
473.astar (unexplained diff vs previous) (percentage) -76.92% 0.260 0.060 - -99.97% -
444.namd (avg) (percentage) -76.47% 1.190 0.280 - -96.96% -
459.GemsFDTD (avg) (percentage) -76.34% 1.310 0.310 - -94.69% -
435.gromacs -76.23% 122.000 29.000 - -92.10% -
435.gromacs (avg) -76.23% 122.000 29.000 - -92.10% -
437.leslie3d (max) -75.82% 1278.000 309.000 - -83.98% -
458.sjeng (avg) (percentage) -75.41% 0.610 0.150 - -95.30% -
470.lbm (unexplained diff vs previous) (percentage) -75.00% 0.760 0.190 - -99.93% -
437.leslie3d (avg) (percentage) -74.12% 4.520 1.170 - -61.64% -
465.tonto (avg) (percentage) -72.58% 1.240 0.340 - -89.82% -
450.soplex (avg) (percentage) -69.48% 2.490 0.760 - -88.18% -
401.bzip2 (avg) (percentage) -68.31% 1.420 0.450 - -91.79% -
464.h264ref (avg) (percentage) -66.67% 0.720 0.240 - -95.28% -
437.leslie3d -65.55% 479.000 165.000 - -53.52% -
437.leslie3d (avg) -65.55% 479.000 165.000 - -53.52% -
450.soplex (max) (percentage) -65.25% 4.000 1.390 - -98.56% -
445.gobmk -62.79% 43.000 16.000 - -91.84% -
445.gobmk (avg) -62.79% 43.000 16.000 - -91.84% -
462.libquantum (max) (percentage) -62.70% 1.850 0.690 - -99.30% -
416.gamess (avg) (percentage) -61.84% 0.760 0.290 - -93.44% -
429.mcf (max) -61.36% 220.000 85.000 - -93.57% -
471.omnetpp (avg) (percentage) -61.14% 2.110 0.820 - -90.00% -
400.perlbench (max) (percentage) -56.72% 3.350 1.450 - -98.28% -
482.sphinx3 (max) (percentage) -52.69% 2.600 1.230 - -98.73% -
458.sjeng -52.27% 44.000 21.000 - -91.29% -
458.sjeng (avg) -52.27% 44.000 21.000 - -91.29% -
456.hmmer (avg) (percentage) -51.92% 0.520 0.250 - -94.33% -
458.sjeng (max) (percentage) -51.76% 0.850 0.410 - -99.14% -
456.hmmer (max) (percentage) -48.08% 0.520 0.270 - -99.63% -
453.povray (avg) (percentage) -42.58% 1.550 0.890 - -88.60% -
400.perlbench (avg) (percentage) -40.72% 1.940 1.150 - -81.89% -
473.astar (unexplained diff vs previous) -38.46% 13.000 8.000 - -99.92% -
459.GemsFDTD (max) -38.30% 141.000 87.000 - -98.03% -
482.sphinx3 (avg) (percentage) -35.26% 1.730 1.120 - -85.88% -
416.gamess (max) (percentage) -35.14% 0.370 0.240 - -99.38% -
464.h264ref (max) (percentage) -25.93% 0.540 0.400 - -99.26% -
436.cactusADM (avg) (percentage) -23.58% 1.060 0.810 - -86.45% -
464.h264ref -21.95% 41.000 32.000 - -89.08% -
464.h264ref (avg) -21.95% 41.000 32.000 - -89.08% -
471.omnetpp (max) (percentage) -21.88% 1.600 1.250 - -98.43% -
481.wrf (avg) (percentage) -17.22% 1.800 1.490 - -76.12% -
433.milc (max) (percentage) -15.35% 2.410 2.040 - -97.75% -
470.lbm (unexplained diff vs previous) -14.29% 28.000 24.000 - -99.76% -
433.milc (avg) (percentage) -11.29% 1.240 1.100 - -81.82% -
444.namd (max) -9.09% 22.000 20.000 - -97.08% -
401.bzip2 (max) -7.89% 76.000 70.000 - -96.97% -
458.sjeng (max) -4.92% 61.000 58.000 - -98.39% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 20.83% 24.000 29.000 - 0.00% -
nb_execution_successful 20.83% 24.000 29.000 - 0.00% -

Added Tests - Code Size
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - Execution
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
416.gamess
416.gamess (avg)
416.gamess (max)
454.calculix
454.calculix (avg)
454.calculix (max)
481.wrf
481.wrf (avg)
481.wrf (max)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 3.02% 244728.000 252128.000 - 6.54% -
450.soplex 2.93% 205081.000 211088.000 - 4.20% -
434.zeusmp 1.10% 152037.000 153713.000 - 4.65% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 36138.71% 62.000 22468.000 - 0.00% -
403.gcc 16089.29% 56.000 9066.000 - 0.00% -
462.libquantum 8140.00% 140.000 11536.000 - 8706.11% -
482.sphinx3 3085.29% 945.000 30101.000 - 3648.57% -
450.soplex 2686.77% 567.000 15801.000 - 2778.14% -
429.mcf 1107.30% 1424.000 17192.000 - 821.33% -
444.namd 1103.35% 747.000 8989.000 - 1070.44% -
453.povray 1081.54% 547.000 6463.000 - 1094.64% -
433.milc 1020.07% 1151.000 12892.000 - 1041.90% -
436.cactusADM 748.97% 2083.000 17684.000 - 725.58% -
400.perlbench 545.46% 1663.000 10734.000 - 612.75% -
434.zeusmp 434.65% 2514.000 13441.000 - 487.71% -
447.dealII 423.32% 1724.000 9022.000 - 456.91% -
401.bzip2 411.25% 2941.000 15036.000 - 423.36% -
471.omnetpp 294.42% 2724.000 10744.000 - 311.33% -
456.hmmer 284.63% 2882.000 11085.000 - 288.27% -
459.GemsFDTD 282.81% 6173.000 23631.000 - 354.18% -
470.lbm 238.15% 3788.000 12809.000 - 245.63% -
481.wrf 204.45% 5534.000 16848.000 - 0.00% -
483.xalancbmk 185.02% 3818.000 10882.000 - 0.00% -
473.astar 176.58% 5128.000 14183.000 - 188.92% -
410.bwaves 152.18% 5652.000 14253.000 - 145.07% -
464.h264ref 137.53% 5761.000 13684.000 - 138.02% -
445.gobmk 129.54% 5023.000 11530.000 - 135.45% -
435.gromacs 110.22% 7269.000 15281.000 - 120.00% -
458.sjeng 87.86% 7567.000 14215.000 - 95.66% -
416.gamess 64.91% 12465.000 20556.000 - 0.00% -
437.leslie3d 21.57% 11640.000 14151.000 - 33.50% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 1075.00% 4.000 47.000 - 0.00% -
454.calculix (avg) 1075.00% 4.000 47.000 - 0.00% -
403.gcc 750.00% 4.000 34.000 - 0.00% -
403.gcc (avg) 750.00% 4.000 34.000 - 0.00% -
482.sphinx3 355.41% 74.000 337.000 - 2492.31% -
482.sphinx3 (avg) 355.41% 74.000 337.000 - 2492.31% -
450.soplex 233.33% 36.000 120.000 - 823.08% -
450.soplex (avg) 233.33% 36.000 120.000 - 823.08% -
433.milc 104.35% 69.000 141.000 - 984.62% -
433.milc (avg) 104.35% 69.000 141.000 - 984.62% -
462.libquantum 90.00% 10.000 19.000 - 850.00% -
462.libquantum (avg) 90.00% 10.000 19.000 - 850.00% -
410.bwaves 41.37% 249.000 352.000 - 604.00% -
410.bwaves (avg) 41.37% 249.000 352.000 - 604.00% -
447.dealII 37.37% 99.000 136.000 - 655.56% -
447.dealII (avg) 37.37% 99.000 136.000 - 655.56% -
453.povray 35.71% 42.000 57.000 - 612.50% -
453.povray (avg) 35.71% 42.000 57.000 - 612.50% -
400.perlbench 17.14% 105.000 123.000 - 324.14% -
400.perlbench (avg) 17.14% 105.000 123.000 - 324.14% -
436.cactusADM 15.32% 124.000 143.000 - 550.00% -
436.cactusADM (avg) 15.32% 124.000 143.000 - 550.00% -
434.zeusmp 6.80% 147.000 157.000 - 647.62% -
434.zeusmp (avg) 6.80% 147.000 157.000 - 647.62% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383420.000 - 1.05% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -23.21% 10941.000 8402.000 - -22.27% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.040 - -94.74% -
473.astar (unexplained diff vs previous) (percentage) -99.97% 197.850 0.060 - -76.92% -
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 - 400.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.95% 787.130 0.430 - 30.30% -
470.lbm (unexplained diff vs previous) (percentage) -99.93% 263.730 0.190 - -75.00% -
473.astar (unexplained diff vs previous) -99.92% 10146.000 8.000 - -38.46% -
454.calculix (max) (percentage) -99.83% 99.730 0.170 - -79.52% -
445.gobmk (max) (percentage) -99.77% 52.630 0.120 - -90.91% -
470.lbm (unexplained diff vs previous) -99.76% 9990.000 24.000 - -14.29% -
473.astar (max) (percentage) -99.76% 66.430 0.160 - -96.67% -
444.namd (max) (percentage) -99.75% 91.790 0.230 - -92.07% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.68% 391.300 1.240 - 300.00% -
403.gcc (max) (percentage) -99.68% 99.360 0.320 - -91.51% -
435.gromacs (max) (percentage) -99.67% 49.160 0.160 - -93.70% -
456.hmmer (max) (percentage) -99.63% 73.590 0.270 - -48.08% -
483.xalancbmk (max) (percentage) -99.58% 68.670 0.290 - -83.62% -
436.cactusADM (unexplained diff vs previous) -99.54% 16396.000 76.000 - 985.71% -
445.gobmk (max) -99.51% 2643.000 13.000 - -79.69% -
459.GemsFDTD (max) (percentage) -99.48% 71.460 0.370 - -86.35% -
429.mcf (max) (percentage) -99.46% 92.890 0.500 - -95.76% -
401.bzip2 (max) (percentage) -99.40% 78.650 0.470 - -82.33% -
416.gamess (max) (percentage) -99.38% 38.550 0.240 - -35.14% -
473.astar (max) -99.35% 3406.000 22.000 - -90.64% -
435.gromacs (max) -99.33% 3573.000 24.000 - -86.36% -
462.libquantum (max) (percentage) -99.30% 98.970 0.690 - -62.70% -
464.h264ref (max) (percentage) -99.26% 54.290 0.400 - -25.93% -
458.sjeng (max) (percentage) -99.14% 47.610 0.410 - -51.76% -
416.gamess (max) -98.98% 4805.000 49.000 - 0.00% -
465.tonto (max) -98.91% 2112.000 23.000 - -92.90% -
483.xalancbmk (max) -98.82% 2621.000 31.000 - 0.00% -
473.astar (avg) (percentage) -98.80% 4.160 0.050 - -96.93% -
471.omnetpp (unexplained diff vs previous) -98.75% 10659.000 133.000 - 1562.50% -
482.sphinx3 (max) (percentage) -98.73% 96.500 1.230 - -52.69% -
456.hmmer (max) -98.63% 2120.000 29.000 - 107.14% -
450.soplex (max) (percentage) -98.56% 96.240 1.390 - -65.25% -
465.tonto (max) (percentage) -98.55% 19.310 0.280 - -90.67% -
471.omnetpp (max) (percentage) -98.43% 79.650 1.250 - -21.88% -
458.sjeng (max) -98.39% 3602.000 58.000 - -4.92% -
400.perlbench (max) (percentage) -98.28% 84.060 1.450 - -56.72% -
464.h264ref (max) -98.27% 3127.000 54.000 - 74.19% -
434.zeusmp (max) (percentage) -98.19% 81.770 1.480 - 46.53% -
453.povray (max) (percentage) -98.16% 91.250 1.680 - 9.80% -
459.GemsFDTD (max) -98.03% 4411.000 87.000 - -38.30% -
436.cactusADM (max) (percentage) -97.92% 88.730 1.850 - 48.00% -
447.dealII (max) (percentage) -97.81% 80.280 1.760 - 104.65% -
462.libquantum (avg) (percentage) -97.78% 7.660 0.170 - -90.76% -
433.milc (max) (percentage) -97.75% 90.750 2.040 - -15.35% -
454.calculix (avg) (percentage) -97.38% 8.020 0.210 - -94.17% -
444.namd (max) -97.08% 685.000 20.000 - -9.09% -
401.bzip2 (max) -96.97% 2313.000 70.000 - -7.89% -
444.namd (avg) (percentage) -96.96% 9.220 0.280 - -76.47% -
473.astar -96.71% 213.000 7.000 - -91.25% -
473.astar (avg) -96.71% 213.000 7.000 - -91.25% -
445.gobmk (avg) (percentage) -96.42% 3.910 0.140 - -84.09% -
470.lbm (max) (percentage) -96.39% 72.510 2.620 - 147.17% -
481.wrf (max) (percentage) -96.38% 68.700 2.490 - 207.41% -
483.xalancbmk (avg) (percentage) -96.31% 6.500 0.240 - -91.89% -
435.gromacs (avg) (percentage) -96.25% 5.060 0.190 - -89.27% -
410.bwaves (max) (percentage) -96.00% 57.970 2.320 - 56.76% -
458.sjeng (avg) (percentage) -95.30% 3.190 0.150 - -75.41% -
464.h264ref (avg) (percentage) -95.28% 5.090 0.240 - -66.67% -
403.gcc (avg) (percentage) -94.81% 7.320 0.380 - -92.53% -
459.GemsFDTD (avg) (percentage) -94.69% 5.840 0.310 - -76.34% -
456.hmmer (avg) (percentage) -94.33% 4.410 0.250 - -51.92% -
471.omnetpp (max) -93.82% 2169.000 134.000 - 226.83% -
429.mcf (max) -93.57% 1322.000 85.000 - -61.36% -
416.gamess (avg) (percentage) -93.44% 4.420 0.290 - -61.84% -
465.tonto -92.33% 365.000 28.000 - -79.10% -
465.tonto (avg) -92.33% 365.000 28.000 - -79.10% -
429.mcf (avg) (percentage) -92.18% 7.670 0.600 - -87.53% -
435.gromacs -92.10% 367.000 29.000 - -76.23% -
435.gromacs (avg) -92.10% 367.000 29.000 - -76.23% -
445.gobmk -91.84% 196.000 16.000 - -62.79% -
445.gobmk (avg) -91.84% 196.000 16.000 - -62.79% -
401.bzip2 (avg) (percentage) -91.79% 5.480 0.450 - -68.31% -
458.sjeng -91.29% 241.000 21.000 - -52.27% -
458.sjeng (avg) -91.29% 241.000 21.000 - -52.27% -
434.zeusmp (max) -90.36% 2055.000 198.000 - 760.87% -
471.omnetpp (avg) (percentage) -90.00% 8.200 0.820 - -61.14% -
410.bwaves (max) -89.93% 3276.000 330.000 - 283.72% -
465.tonto (avg) (percentage) -89.82% 3.340 0.340 - -72.58% -
483.xalancbmk -89.52% 248.000 26.000 - 0.00% -
483.xalancbmk (avg) -89.52% 248.000 26.000 - 0.00% -
416.gamess -89.27% 550.000 59.000 - 0.00% -
416.gamess (avg) -89.27% 550.000 59.000 - 0.00% -
464.h264ref -89.08% 293.000 32.000 - -21.95% -
464.h264ref (avg) -89.08% 293.000 32.000 - -21.95% -
481.wrf (max) -88.98% 3801.000 419.000 - 0.00% -
400.perlbench (max) -88.90% 1397.000 155.000 - 210.00% -
453.povray (avg) (percentage) -88.60% 7.810 0.890 - -42.58% -
447.dealII (max) -88.58% 1384.000 158.000 - 1115.38% -
450.soplex (avg) (percentage) -88.18% 6.430 0.760 - -69.48% -
470.lbm (max) -87.80% 2746.000 335.000 - 758.97% -
437.leslie3d (max) (percentage) -86.79% 16.580 2.190 - -81.84% -
436.cactusADM (avg) (percentage) -86.45% 5.980 0.810 - -23.58% -
470.lbm (avg) (percentage) -85.94% 6.330 0.890 - 5.95% -
482.sphinx3 (avg) (percentage) -85.88% 7.930 1.120 - -35.26% -
437.leslie3d (max) -83.98% 1929.000 309.000 - -75.82% -
436.cactusADM (max) -82.31% 1848.000 327.000 - 1157.69% -
400.perlbench (avg) (percentage) -81.89% 6.350 1.150 - -40.72% -
433.milc (avg) (percentage) -81.82% 6.050 1.100 - -11.29% -
434.zeusmp (avg) (percentage) -80.00% 5.850 1.170 - 23.16% -
459.GemsFDTD -79.72% 360.000 73.000 - 7.35% -
459.GemsFDTD (avg) -79.72% 360.000 73.000 - 7.35% -
456.hmmer -78.74% 127.000 27.000 - 92.86% -
456.hmmer (avg) -78.74% 127.000 27.000 - 92.86% -
453.povray (max) -78.36% 499.000 108.000 - 1250.00% -
481.wrf (avg) (percentage) -76.12% 6.240 1.490 - -17.22% -
433.milc (max) -74.90% 1044.000 262.000 - 870.37% -
447.dealII (avg) (percentage) -73.83% 5.770 1.510 - 29.06% -
444.namd -63.24% 68.000 25.000 - 177.78% -
444.namd (avg) -63.24% 68.000 25.000 - 177.78% -
437.leslie3d (avg) (percentage) -61.64% 3.050 1.170 - -74.12% -
471.omnetpp -60.54% 223.000 88.000 - 60.00% -
471.omnetpp (avg) -60.54% 223.000 88.000 - 60.00% -
450.soplex (max) -59.82% 545.000 219.000 - 942.86% -
482.sphinx3 (max) -59.39% 911.000 370.000 - 1750.00% -
401.bzip2 -58.39% 161.000 67.000 - 67.50% -
401.bzip2 (avg) -58.39% 161.000 67.000 - 67.50% -
437.leslie3d -53.52% 355.000 165.000 - -65.55% -
437.leslie3d (avg) -53.52% 355.000 165.000 - -65.55% -
470.lbm -52.30% 239.000 114.000 - 267.74% -
470.lbm (avg) -52.30% 239.000 114.000 - 267.74% -
403.gcc (max) -47.27% 55.000 29.000 - 0.00% -
410.bwaves (avg) (percentage) -43.99% 4.410 2.470 - 183.91% -
462.libquantum (max) -42.75% 138.000 79.000 - 3850.00% -
454.calculix (max) -37.70% 61.000 38.000 - 0.00% -
481.wrf -27.25% 345.000 251.000 - 0.00% -
481.wrf (avg) -27.25% 345.000 251.000 - 0.00% -
429.mcf -5.50% 109.000 103.000 - 15.73% -
429.mcf (avg) -5.50% 109.000 103.000 - 15.73% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 10734.000 612.75%
401.bzip2 15036.000 423.36%
403.gcc 9066.000 -
410.bwaves 14253.000 145.07%
416.gamess 20556.000 -
429.mcf 17192.000 821.33%
433.milc 12892.000 1041.90%
434.zeusmp 13441.000 487.71%
435.gromacs 15281.000 120.00%
436.cactusADM 17684.000 725.58%
437.leslie3d 14151.000 33.50%
444.namd 8989.000 1070.44%
445.gobmk 11530.000 135.45%
447.dealII 9022.000 456.91%
450.soplex 15801.000 2778.14%
453.povray 6463.000 1094.64%
454.calculix 22468.000 -
456.hmmer 11085.000 288.27%
458.sjeng 14215.000 95.66%
459.GemsFDTD 23631.000 354.18%
462.libquantum 11536.000 8706.11%
464.h264ref 13684.000 138.02%
465.tonto 8402.000 -22.27%
470.lbm 12809.000 245.63%
471.omnetpp 10744.000 311.33%
473.astar 14183.000 188.92%
481.wrf 16848.000 -
482.sphinx3 30101.000 3648.57%
483.xalancbmk 10882.000 -
Geometric Mean 13464.142 464.28%
Code Size (bytes)
Name Current %
400.perlbench 888800.000 -
401.bzip2 44241.000 1.19%
403.gcc 2446180.000 -
410.bwaves 16748.000 1.72%
416.gamess 5732377.000 -
429.mcf 9123.000 -
433.milc 61222.000 1.19%
434.zeusmp 153713.000 4.65%
435.gromacs 500339.000 2.18%
436.cactusADM 352867.000 -
437.leslie3d 59691.000 8.95%
444.namd 188373.000 1.40%
445.gobmk 1377618.000 -
447.dealII 312844.000 1.90%
450.soplex 211088.000 4.20%
453.povray 657739.000 1.22%
454.calculix 845155.000 -
456.hmmer 108679.000 1.38%
458.sjeng 104004.000 1.68%
459.GemsFDTD 252128.000 6.54%
462.libquantum 16117.000 1.41%
464.h264ref 383420.000 1.05%
465.tonto 1944559.000 -1.58%
470.lbm 9687.000 1.47%
471.omnetpp 482476.000 1.49%
473.astar 22944.000 -
481.wrf 1974104.000 -
482.sphinx3 112835.000 1.05%
483.xalancbmk 2341614.000 -
Geometric Mean 224462.037 64.16%
Score
Name Current %
nb_compile_successful 29.000 20.83%
nb_execution_successful 29.000 20.83%
nb_total_tests 29.000 -14.71%
Geometric Mean 29.000 7.59%
sample variability
Name Current %
400.perlbench 123.000 324.14%
400.perlbench (avg) 123.000 324.14%
400.perlbench (avg) (percentage) 1.150 -40.72%
400.perlbench (max) 155.000 210.00%
400.perlbench (max) (percentage) 1.450 -56.72%
401.bzip2 67.000 67.50%
401.bzip2 (avg) 67.000 67.50%
401.bzip2 (avg) (percentage) 0.450 -68.31%
401.bzip2 (max) 70.000 -7.89%
401.bzip2 (max) (percentage) 0.470 -82.33%
403.gcc 34.000 -
403.gcc (avg) 34.000 -
403.gcc (avg) (percentage) 0.380 -92.53%
403.gcc (max) 29.000 -
403.gcc (max) (percentage) 0.320 -91.51%
410.bwaves 352.000 604.00%
410.bwaves (avg) 352.000 604.00%
410.bwaves (avg) (percentage) 2.470 183.91%
410.bwaves (max) 330.000 283.72%
410.bwaves (max) (percentage) 2.320 56.76%
416.gamess 59.000 -
416.gamess (avg) 59.000 -
416.gamess (avg) (percentage) 0.290 -61.84%
416.gamess (max) 49.000 -
416.gamess (max) (percentage) 0.240 -35.14%
429.mcf 103.000 15.73%
429.mcf (avg) 103.000 15.73%
429.mcf (avg) (percentage) 0.600 -87.53%
429.mcf (max) 85.000 -61.36%
429.mcf (max) (percentage) 0.500 -95.76%
433.milc 141.000 984.62%
433.milc (avg) 141.000 984.62%
433.milc (avg) (percentage) 1.100 -11.29%
433.milc (max) 262.000 870.37%
433.milc (max) (percentage) 2.040 -15.35%
434.zeusmp 157.000 647.62%
434.zeusmp (avg) 157.000 647.62%
434.zeusmp (avg) (percentage) 1.170 23.16%
434.zeusmp (max) 198.000 760.87%
434.zeusmp (max) (percentage) 1.480 46.53%
435.gromacs 29.000 -76.23%
435.gromacs (avg) 29.000 -76.23%
435.gromacs (avg) (percentage) 0.190 -89.27%
435.gromacs (max) 24.000 -86.36%
435.gromacs (max) (percentage) 0.160 -93.70%
436.cactusADM 143.000 550.00%
436.cactusADM (avg) 143.000 550.00%
436.cactusADM (avg) (percentage) 0.810 -23.58%
436.cactusADM (max) 327.000 1157.69%
436.cactusADM (max) (percentage) 1.850 48.00%
436.cactusADM (unexplained diff vs previous) 76.000 985.71%
436.cactusADM (unexplained diff vs previous) (percentage) 0.430 30.30%
437.leslie3d 165.000 -65.55%
437.leslie3d (avg) 165.000 -65.55%
437.leslie3d (avg) (percentage) 1.170 -74.12%
437.leslie3d (max) 309.000 -75.82%
437.leslie3d (max) (percentage) 2.190 -81.84%
444.namd 25.000 177.78%
444.namd (avg) 25.000 177.78%
444.namd (avg) (percentage) 0.280 -76.47%
444.namd (max) 20.000 -9.09%
444.namd (max) (percentage) 0.230 -92.07%
445.gobmk 16.000 -62.79%
445.gobmk (avg) 16.000 -62.79%
445.gobmk (avg) (percentage) 0.140 -84.09%
445.gobmk (max) 13.000 -79.69%
445.gobmk (max) (percentage) 0.120 -90.91%
447.dealII 136.000 655.56%
447.dealII (avg) 136.000 655.56%
447.dealII (avg) (percentage) 1.510 29.06%
447.dealII (max) 158.000 1115.38%
447.dealII (max) (percentage) 1.760 104.65%
450.soplex 120.000 823.08%
450.soplex (avg) 120.000 823.08%
450.soplex (avg) (percentage) 0.760 -69.48%
450.soplex (max) 219.000 942.86%
450.soplex (max) (percentage) 1.390 -65.25%
453.povray 57.000 612.50%
453.povray (avg) 57.000 612.50%
453.povray (avg) (percentage) 0.890 -42.58%
453.povray (max) 108.000 1250.00%
453.povray (max) (percentage) 1.680 9.80%
454.calculix 47.000 -
454.calculix (avg) 47.000 -
454.calculix (avg) (percentage) 0.210 -94.17%
454.calculix (max) 38.000 -
454.calculix (max) (percentage) 0.170 -79.52%
456.hmmer 27.000 92.86%
456.hmmer (avg) 27.000 92.86%
456.hmmer (avg) (percentage) 0.250 -51.92%
456.hmmer (max) 29.000 107.14%
456.hmmer (max) (percentage) 0.270 -48.08%
458.sjeng 21.000 -52.27%
458.sjeng (avg) 21.000 -52.27%
458.sjeng (avg) (percentage) 0.150 -75.41%
458.sjeng (max) 58.000 -4.92%
458.sjeng (max) (percentage) 0.410 -51.76%
459.GemsFDTD 73.000 7.35%
459.GemsFDTD (avg) 73.000 7.35%
459.GemsFDTD (avg) (percentage) 0.310 -76.34%
459.GemsFDTD (max) 87.000 -38.30%
459.GemsFDTD (max) (percentage) 0.370 -86.35%
462.libquantum 19.000 850.00%
462.libquantum (avg) 19.000 850.00%
462.libquantum (avg) (percentage) 0.170 -90.76%
462.libquantum (max) 79.000 3850.00%
462.libquantum (max) (percentage) 0.690 -62.70%
462.libquantum (unexplained diff vs previous) 5.000 400.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.040 -94.74%
464.h264ref 32.000 -21.95%
464.h264ref (avg) 32.000 -21.95%
464.h264ref (avg) (percentage) 0.240 -66.67%
464.h264ref (max) 54.000 74.19%
464.h264ref (max) (percentage) 0.400 -25.93%
465.tonto 28.000 -79.10%
465.tonto (avg) 28.000 -79.10%
465.tonto (avg) (percentage) 0.340 -72.58%
465.tonto (max) 23.000 -92.90%
465.tonto (max) (percentage) 0.280 -90.67%
470.lbm 114.000 267.74%
470.lbm (avg) 114.000 267.74%
470.lbm (avg) (percentage) 0.890 5.95%
470.lbm (max) 335.000 758.97%
470.lbm (max) (percentage) 2.620 147.17%
470.lbm (unexplained diff vs previous) 24.000 -14.29%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -75.00%
471.omnetpp 88.000 60.00%
471.omnetpp (avg) 88.000 60.00%
471.omnetpp (avg) (percentage) 0.820 -61.14%
471.omnetpp (max) 134.000 226.83%
471.omnetpp (max) (percentage) 1.250 -21.88%
471.omnetpp (unexplained diff vs previous) 133.000 1562.50%
471.omnetpp (unexplained diff vs previous) (percentage) 1.240 300.00%
473.astar 7.000 -91.25%
473.astar (avg) 7.000 -91.25%
473.astar (avg) (percentage) 0.050 -96.93%
473.astar (max) 22.000 -90.64%
473.astar (max) (percentage) 0.160 -96.67%
473.astar (unexplained diff vs previous) 8.000 -38.46%
473.astar (unexplained diff vs previous) (percentage) 0.060 -76.92%
481.wrf 251.000 -
481.wrf (avg) 251.000 -
481.wrf (avg) (percentage) 1.490 -17.22%
481.wrf (max) 419.000 -
481.wrf (max) (percentage) 2.490 207.41%
482.sphinx3 337.000 2492.31%
482.sphinx3 (avg) 337.000 2492.31%
482.sphinx3 (avg) (percentage) 1.120 -35.26%
482.sphinx3 (max) 370.000 1750.00%
482.sphinx3 (max) (percentage) 1.230 -52.69%
483.xalancbmk 26.000 -
483.xalancbmk (avg) 26.000 -
483.xalancbmk (avg) (percentage) 0.240 -91.89%
483.xalancbmk (max) 31.000 -
483.xalancbmk (max) (percentage) 0.290 -83.62%
Geometric Mean 9.162 12.67%