Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a83c64f567ec7f161b8efb87205d44a2fbbf36f8 (+ 92 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/203b127fccc9abe5373c9e3cc03a476c35b1f594 (+ 117 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=22a46dee24351fd5f4f188ad80554cad79c82524 (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=42a734d19dbe4dcf194201c26051f5ce6a22cde3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/328/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0328 (3-changed-components) 2022-11-09T17:16:33 0:00:00
Previous 0325 (basepoints/gcc-15-05326-gf242f79b8af) 2024-11-17T09:03:45 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 139 55
Performance Improvements 53 141
Added Tests 29 0
Unchanged Tests 1015 1040
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 9.42% 54370.000 59491.000 - 0.02% -
434.zeusmp 4.65% 146883.000 153713.000 - 1.10% -
459.GemsFDTD 3.54% 236656.000 245040.000 - 0.13% -
435.gromacs 2.18% 489657.000 500327.000 - 0.21% -
462.libquantum 2.03% 15797.000 16117.000 - 0.20% -
447.dealII 1.79% 307012.000 312518.000 - 0.30% -
410.bwaves 1.72% 16464.000 16748.000 - -0.07% -
458.sjeng 1.68% 102284.000 104004.000 - -0.04% -
470.lbm 1.47% 9547.000 9687.000 - -0.04% -
444.namd 1.40% 185768.000 188365.000 - -0.01% -
456.hmmer 1.40% 107195.000 108691.000 - 0.00% -
433.milc 1.27% 60457.000 61222.000 - -0.26% -
450.soplex 1.23% 202574.000 205068.000 - -0.01% -
453.povray 1.22% 649821.000 657755.000 - -0.55% -
401.bzip2 1.19% 43719.000 44241.000 - 0.02% -
482.sphinx3 1.05% 111663.000 112839.000 - -0.02% -
464.h264ref 1.05% 379440.000 383416.000 - -1.12% -
471.omnetpp 1.01% 475388.000 480176.000 - 0.45% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8539.10% 133.000 11490.000 - 8107.14% -
482.sphinx3 3485.98% 806.000 28903.000 - 2958.52% -
450.soplex 2819.06% 551.000 16084.000 - 2736.68% -
444.namd 1172.45% 766.000 9747.000 - 1204.82% -
453.povray 1076.21% 538.000 6328.000 - 1056.86% -
433.milc 1067.93% 1132.000 13221.000 - 1048.65% -
429.mcf 834.29% 1843.000 17219.000 - 1109.20% -
436.cactusADM 748.20% 2141.000 18160.000 - 771.82% -
400.perlbench 641.94% 1495.000 11092.000 - 566.99% -
434.zeusmp 502.72% 2277.000 13724.000 - 445.90% -
447.dealII 461.95% 1619.000 9098.000 - 427.73% -
401.bzip2 423.43% 2855.000 14944.000 - 408.13% -
459.GemsFDTD 348.90% 5176.000 23235.000 - 276.40% -
471.omnetpp 308.71% 2618.000 10700.000 - 292.80% -
456.hmmer 274.62% 2872.000 10759.000 - 273.32% -
470.lbm 227.17% 3710.000 12138.000 - 220.43% -
473.astar 188.43% 4918.000 14185.000 - 176.62% -
464.h264ref 140.37% 5740.000 13797.000 - 139.49% -
445.gobmk 137.72% 4899.000 11646.000 - 131.85% -
410.bwaves 135.19% 5840.000 13735.000 - 143.01% -
435.gromacs 125.62% 6962.000 15708.000 - 116.10% -
458.sjeng 94.92% 7297.000 14223.000 - 87.96% -
437.leslie3d 39.83% 10990.000 15367.000 - 32.02% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) 46900.00% 1.000 470.000 - -97.13% -
450.soplex (unexplained diff vs previous) 12650.00% 2.000 255.000 - -98.24% -
436.cactusADM (unexplained diff vs previous) (percentage) 5080.00% 0.050 2.590 - -99.67% -
444.namd 4244.44% 9.000 391.000 - 475.00% -
444.namd (avg) 4244.44% 9.000 391.000 - 475.00% -
482.sphinx3 3853.85% 13.000 514.000 - 594.59% -
482.sphinx3 (avg) 3853.85% 13.000 514.000 - 594.59% -
444.namd (max) 3450.00% 20.000 710.000 - 3.65% -
410.bwaves (unexplained diff vs previous) 3058.33% 24.000 758.000 - -90.27% -
453.povray (max) 2642.86% 7.000 192.000 - -61.52% -
482.sphinx3 (max) 2627.78% 18.000 491.000 - -46.10% -
434.zeusmp (unexplained diff vs previous) 2350.00% 10.000 245.000 - -97.83% -
462.libquantum 2350.00% 2.000 49.000 - 390.00% -
462.libquantum (avg) 2350.00% 2.000 49.000 - 390.00% -
462.libquantum (max) 2050.00% 2.000 43.000 - -68.84% -
436.cactusADM (max) 2000.00% 23.000 483.000 - -73.86% -
471.omnetpp (unexplained diff vs previous) 1933.33% 6.000 122.000 - -98.86% -
433.milc 1614.29% 14.000 240.000 - 247.83% -
433.milc (avg) 1614.29% 14.000 240.000 - 247.83% -
459.GemsFDTD (unexplained diff vs previous) 1474.07% 27.000 425.000 - -97.25% -
433.milc (max) 1295.83% 24.000 335.000 - -67.91% -
434.zeusmp (max) 1295.00% 20.000 279.000 - -86.42% -
436.cactusADM 1259.09% 22.000 299.000 - 141.13% -
436.cactusADM (avg) 1259.09% 22.000 299.000 - 141.13% -
450.soplex (max) 1257.89% 19.000 258.000 - -52.66% -
410.bwaves (unexplained diff vs previous) (percentage) 1246.34% 0.410 5.520 - -96.00% -
447.dealII (max) 1200.00% 11.000 143.000 - -89.67% -
450.soplex 1161.54% 13.000 164.000 - 355.56% -
450.soplex (avg) 1161.54% 13.000 164.000 - 355.56% -
470.lbm (max) 1062.86% 35.000 407.000 - -85.18% -
453.povray 1037.50% 8.000 91.000 - 116.67% -
453.povray (avg) 1037.50% 8.000 91.000 - 116.67% -
434.zeusmp 885.71% 21.000 207.000 - 40.82% -
434.zeusmp (avg) 885.71% 21.000 207.000 - 40.82% -
410.bwaves (max) 820.51% 78.000 718.000 - -78.08% -
416.gamess (max) (percentage) 748.65% 0.370 3.140 - -91.85% -
400.perlbench (max) 730.43% 46.000 382.000 - -72.66% -
400.perlbench 686.21% 29.000 228.000 - 117.14% -
400.perlbench (avg) 686.21% 29.000 228.000 - 117.14% -
470.lbm 654.84% 31.000 234.000 - -2.09% -
470.lbm (avg) 654.84% 31.000 234.000 - -2.09% -
471.omnetpp (max) 521.62% 37.000 230.000 - -89.40% -
410.bwaves 514.00% 50.000 307.000 - 23.29% -
410.bwaves (avg) 514.00% 50.000 307.000 - 23.29% -
471.omnetpp (unexplained diff vs previous) (percentage) 395.65% 0.230 1.140 - -99.71% -
481.wrf (max) (percentage) 371.60% 0.810 3.820 - -94.44% -
450.soplex (unexplained diff vs previous) (percentage) 341.67% 0.360 1.590 - -99.94% -
454.calculix (max) (percentage) 310.98% 0.820 3.370 - -96.62% -
434.zeusmp (unexplained diff vs previous) (percentage) 306.82% 0.440 1.790 - -99.60% -
447.dealII 300.00% 18.000 72.000 - -27.27% -
447.dealII (avg) 300.00% 18.000 72.000 - -27.27% -
410.bwaves (max) (percentage) 290.30% 1.340 5.230 - -90.98% -
456.hmmer 278.57% 14.000 53.000 - -58.27% -
456.hmmer (avg) 278.57% 14.000 53.000 - -58.27% -
470.lbm (max) (percentage) 253.68% 0.950 3.360 - -95.37% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 251.92% 0.520 1.830 - -99.27% -
459.GemsFDTD 246.27% 67.000 232.000 - -35.56% -
459.GemsFDTD (avg) 246.27% 67.000 232.000 - -35.56% -
444.namd (avg) (percentage) 240.68% 1.180 4.020 - -56.40% -
459.GemsFDTD (max) 237.10% 124.000 418.000 - -90.52% -
483.xalancbmk (max) (percentage) 186.44% 1.770 5.070 - -92.62% -
464.h264ref (max) 185.19% 27.000 77.000 - -97.54% -
444.namd (max) (percentage) 169.00% 2.710 7.290 - -92.06% -
416.gamess (avg) (percentage) 165.79% 0.760 2.020 - -54.30% -
471.omnetpp 161.11% 54.000 141.000 - -36.77% -
471.omnetpp (avg) 161.11% 54.000 141.000 - -36.77% -
410.bwaves (avg) (percentage) 157.47% 0.870 2.240 - -49.21% -
445.gobmk (max) 156.14% 57.000 146.000 - -94.48% -
435.gromacs (max) 141.51% 159.000 384.000 - -89.25% -
436.cactusADM (max) (percentage) 139.64% 1.110 2.660 - -97.00% -
470.lbm (avg) (percentage) 129.76% 0.840 1.930 - -69.51% -
456.hmmer (max) 129.41% 17.000 39.000 - -98.16% -
434.zeusmp (max) (percentage) 124.18% 0.910 2.040 - -97.51% -
453.povray (max) (percentage) 120.29% 1.380 3.040 - -96.67% -
447.dealII (max) (percentage) 119.44% 0.720 1.580 - -98.03% -
401.bzip2 105.00% 40.000 82.000 - -49.07% -
401.bzip2 (avg) 105.00% 40.000 82.000 - -49.07% -
435.gromacs 86.99% 123.000 230.000 - -37.33% -
435.gromacs (avg) 86.99% 123.000 230.000 - -37.33% -
445.gobmk 64.29% 42.000 69.000 - -64.80% -
445.gobmk (avg) 64.29% 42.000 69.000 - -64.80% -
401.bzip2 (max) 63.38% 71.000 116.000 - -94.98% -
434.zeusmp (avg) (percentage) 58.95% 0.950 1.510 - -74.19% -
436.cactusADM (avg) (percentage) 57.14% 1.050 1.650 - -72.41% -
471.omnetpp (max) (percentage) 50.35% 1.430 2.150 - -97.30% -
458.sjeng (max) 47.27% 55.000 81.000 - -97.75% -
433.milc (avg) (percentage) 46.77% 1.240 1.820 - -69.92% -
464.h264ref 20.00% 40.000 48.000 - -83.62% -
464.h264ref (avg) 20.00% 40.000 48.000 - -83.62% -
433.milc (max) (percentage) 18.69% 2.140 2.540 - -97.20% -
481.wrf (avg) (percentage) 17.22% 1.800 2.110 - -66.19% -
464.h264ref (max) (percentage) 16.67% 0.480 0.560 - -98.97% -
400.perlbench (max) (percentage) 10.22% 3.130 3.450 - -95.90% -
445.gobmk (max) (percentage) 7.69% 1.170 1.260 - -97.61% -
435.gromacs (max) (percentage) 6.99% 2.290 2.450 - -95.02% -
400.perlbench (avg) (percentage) 6.19% 1.940 2.060 - -67.56% -
482.sphinx3 (avg) (percentage) 4.09% 1.710 1.780 - -77.55% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -14.71% 34.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto -1.37% 1975683.000 1948611.000 - 0.13% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -23.50% 10934.000 8365.000 - -23.54% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) (percentage) -98.00% 4.490 0.090 - -99.86% -
429.mcf (max) (percentage) -96.34% 10.920 0.400 - -99.57% -
429.mcf (avg) (percentage) -94.98% 4.780 0.240 - -96.87% -
473.astar (max) -94.55% 220.000 12.000 - -99.65% -
403.gcc (avg) (percentage) -93.91% 5.090 0.310 - -95.77% -
403.gcc (max) (percentage) -92.04% 3.770 0.300 - -99.70% -
473.astar (avg) (percentage) -90.74% 1.620 0.150 - -96.39% -
458.sjeng (unexplained diff vs previous) (percentage) -81.82% 0.440 0.080 - -99.91% -
462.libquantum (max) (percentage) -77.25% 1.670 0.380 - -99.62% -
462.libquantum (avg) (percentage) -76.63% 1.840 0.430 - -94.39% -
473.astar -73.42% 79.000 21.000 - -90.14% -
473.astar (avg) -73.42% 79.000 21.000 - -90.14% -
454.calculix (avg) (percentage) -69.44% 3.600 1.100 - -86.28% -
401.bzip2 (max) (percentage) -68.67% 2.490 0.780 - -99.01% -
437.leslie3d (max) (percentage) -68.11% 10.850 3.460 - -79.13% -
483.xalancbmk (avg) (percentage) -67.91% 2.960 0.950 - -85.38% -
473.astar (unexplained diff vs previous) (percentage) -66.67% 0.180 0.060 - -99.97% -
429.mcf (max) -66.17% 201.000 68.000 - -94.86% -
458.sjeng (unexplained diff vs previous) -65.62% 32.000 11.000 - -99.84% -
458.sjeng (avg) (percentage) -65.00% 0.600 0.210 - -93.42% -
401.bzip2 (avg) (percentage) -60.99% 1.410 0.550 - -89.96% -
450.soplex (avg) (percentage) -58.54% 2.460 1.020 - -84.14% -
437.leslie3d (max) -55.45% 1192.000 531.000 - -72.47% -
450.soplex (max) (percentage) -54.65% 3.550 1.610 - -98.33% -
437.leslie3d (avg) (percentage) -54.20% 4.520 2.070 - -32.13% -
465.tonto (max) -53.92% 306.000 141.000 - -93.32% -
429.mcf -53.41% 88.000 41.000 - -62.39% -
429.mcf (avg) -53.41% 88.000 41.000 - -62.39% -
464.h264ref (avg) (percentage) -50.70% 0.710 0.350 - -93.12% -
465.tonto (max) (percentage) -39.64% 2.800 1.690 - -91.25% -
456.hmmer (max) (percentage) -38.33% 0.600 0.370 - -99.50% -
471.omnetpp (avg) (percentage) -36.84% 2.090 1.320 - -83.90% -
437.leslie3d -35.89% 496.000 318.000 - -10.42% -
437.leslie3d (avg) -35.89% 496.000 318.000 - -10.42% -
458.sjeng -32.56% 43.000 29.000 - -87.97% -
458.sjeng (avg) -32.56% 43.000 29.000 - -87.97% -
445.gobmk (avg) (percentage) -31.03% 0.870 0.600 - -84.65% -
447.dealII (avg) (percentage) -30.43% 1.150 0.800 - -86.14% -
465.tonto -30.37% 135.000 94.000 - -74.25% -
465.tonto (avg) -30.37% 135.000 94.000 - -74.25% -
482.sphinx3 (max) (percentage) -26.41% 2.310 1.700 - -98.24% -
459.GemsFDTD (max) (percentage) -25.31% 2.410 1.800 - -97.48% -
458.sjeng (max) (percentage) -25.00% 0.760 0.570 - -98.80% -
459.GemsFDTD (avg) (percentage) -23.08% 1.300 1.000 - -82.88% -
435.gromacs (avg) (percentage) -16.95% 1.770 1.470 - -70.95% -
473.astar (unexplained diff vs previous) -11.11% 9.000 8.000 - -99.92% -
465.tonto (avg) (percentage) -8.87% 1.240 1.130 - -66.17% -
453.povray (avg) (percentage) -5.84% 1.540 1.450 - -81.43% -
456.hmmer (avg) (percentage) -3.85% 0.520 0.500 - -88.66% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 20.83% 24.000 29.000 - 0.00% -
nb_execution_successful 20.83% 24.000 29.000 - 0.00% -

Added Tests - Code Size
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - Execution
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
416.gamess
416.gamess (avg)
416.gamess (max)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
454.calculix
454.calculix (avg)
454.calculix (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (max)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 1.10% 152037.000 153713.000 - 4.65% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 34966.13% 62.000 21741.000 - 0.00% -
403.gcc 16078.57% 56.000 9060.000 - 0.00% -
462.libquantum 8107.14% 140.000 11490.000 - 8539.10% -
482.sphinx3 2958.52% 945.000 28903.000 - 3485.98% -
450.soplex 2736.68% 567.000 16084.000 - 2819.06% -
444.namd 1204.82% 747.000 9747.000 - 1172.45% -
429.mcf 1109.20% 1424.000 17219.000 - 834.29% -
453.povray 1056.86% 547.000 6328.000 - 1076.21% -
433.milc 1048.65% 1151.000 13221.000 - 1067.93% -
436.cactusADM 771.82% 2083.000 18160.000 - 748.20% -
400.perlbench 566.99% 1663.000 11092.000 - 641.94% -
434.zeusmp 445.90% 2514.000 13724.000 - 502.72% -
447.dealII 427.73% 1724.000 9098.000 - 461.95% -
401.bzip2 408.13% 2941.000 14944.000 - 423.43% -
471.omnetpp 292.80% 2724.000 10700.000 - 308.71% -
459.GemsFDTD 276.40% 6173.000 23235.000 - 348.90% -
456.hmmer 273.32% 2882.000 10759.000 - 274.62% -
470.lbm 220.43% 3788.000 12138.000 - 227.17% -
481.wrf 190.73% 5534.000 16089.000 - 0.00% -
483.xalancbmk 184.89% 3818.000 10877.000 - 0.00% -
473.astar 176.62% 5128.000 14185.000 - 188.43% -
410.bwaves 143.01% 5652.000 13735.000 - 135.19% -
464.h264ref 139.49% 5761.000 13797.000 - 140.37% -
445.gobmk 131.85% 5023.000 11646.000 - 137.72% -
435.gromacs 116.10% 7269.000 15708.000 - 125.62% -
458.sjeng 87.96% 7567.000 14223.000 - 94.92% -
416.gamess 70.89% 12465.000 21302.000 - 0.00% -
437.leslie3d 32.02% 11640.000 15367.000 - 39.83% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 5875.00% 4.000 239.000 - 0.00% -
454.calculix (avg) 5875.00% 4.000 239.000 - 0.00% -
454.calculix (max) 1100.00% 61.000 732.000 - 0.00% -
403.gcc 600.00% 4.000 28.000 - 0.00% -
403.gcc (avg) 600.00% 4.000 28.000 - 0.00% -
482.sphinx3 594.59% 74.000 514.000 - 3853.85% -
482.sphinx3 (avg) 594.59% 74.000 514.000 - 3853.85% -
444.namd 475.00% 68.000 391.000 - 4244.44% -
444.namd (avg) 475.00% 68.000 391.000 - 4244.44% -
462.libquantum 390.00% 10.000 49.000 - 2350.00% -
462.libquantum (avg) 390.00% 10.000 49.000 - 2350.00% -
450.soplex 355.56% 36.000 164.000 - 1161.54% -
450.soplex (avg) 355.56% 36.000 164.000 - 1161.54% -
433.milc 247.83% 69.000 240.000 - 1614.29% -
433.milc (avg) 247.83% 69.000 240.000 - 1614.29% -
436.cactusADM 141.13% 124.000 299.000 - 1259.09% -
436.cactusADM (avg) 141.13% 124.000 299.000 - 1259.09% -
400.perlbench 117.14% 105.000 228.000 - 686.21% -
400.perlbench (avg) 117.14% 105.000 228.000 - 686.21% -
453.povray 116.67% 42.000 91.000 - 1037.50% -
453.povray (avg) 116.67% 42.000 91.000 - 1037.50% -
434.zeusmp 40.82% 147.000 207.000 - 885.71% -
434.zeusmp (avg) 40.82% 147.000 207.000 - 885.71% -
410.bwaves 23.29% 249.000 307.000 - 514.00% -
410.bwaves (avg) 23.29% 249.000 307.000 - 514.00% -
444.namd (max) 3.65% 685.000 710.000 - 3450.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383416.000 - 1.05% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -23.54% 10941.000 8365.000 - -23.50% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.380 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.97% 197.850 0.060 - -66.67% -
450.soplex (unexplained diff vs previous) (percentage) -99.94% 2557.320 1.590 - 341.67% -
473.astar (unexplained diff vs previous) -99.92% 10146.000 8.000 - -11.11% -
458.sjeng (unexplained diff vs previous) (percentage) -99.91% 90.870 0.080 - -81.82% -
473.astar (max) (percentage) -99.86% 66.430 0.090 - -98.00% -
458.sjeng (unexplained diff vs previous) -99.84% 6876.000 11.000 - -65.62% -
433.milc (unexplained diff vs previous) (percentage) -99.75% 980.800 2.470 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.71% 391.300 1.140 - 395.65% -
403.gcc (max) (percentage) -99.70% 99.360 0.300 - -92.04% -
462.libquantum (unexplained diff vs previous) -99.67% 13518.000 44.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.67% 787.130 2.590 - 5080.00% -
473.astar (max) -99.65% 3406.000 12.000 - -94.55% -
462.libquantum (max) (percentage) -99.62% 98.970 0.380 - -77.25% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.60% 448.690 1.790 - 306.82% -
429.mcf (max) (percentage) -99.57% 92.890 0.400 - -96.34% -
456.hmmer (max) (percentage) -99.50% 73.590 0.370 - -38.33% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.27% 250.410 1.830 - 251.92% -
401.bzip2 (max) (percentage) -99.01% 78.650 0.780 - -68.67% -
464.h264ref (max) (percentage) -98.97% 54.290 0.560 - 16.67% -
471.omnetpp (unexplained diff vs previous) -98.86% 10659.000 122.000 - 1933.33% -
458.sjeng (max) (percentage) -98.80% 47.610 0.570 - -25.00% -
450.soplex (max) (percentage) -98.33% 96.240 1.610 - -54.65% -
450.soplex (unexplained diff vs previous) -98.24% 14500.000 255.000 - 12650.00% -
482.sphinx3 (max) (percentage) -98.24% 96.500 1.700 - -26.41% -
456.hmmer (max) -98.16% 2120.000 39.000 - 129.41% -
447.dealII (max) (percentage) -98.03% 80.280 1.580 - 119.44% -
434.zeusmp (unexplained diff vs previous) -97.83% 11280.000 245.000 - 2350.00% -
458.sjeng (max) -97.75% 3602.000 81.000 - 47.27% -
445.gobmk (max) (percentage) -97.61% 52.630 1.260 - 7.69% -
464.h264ref (max) -97.54% 3127.000 77.000 - 185.19% -
434.zeusmp (max) (percentage) -97.51% 81.770 2.040 - 124.18% -
459.GemsFDTD (max) (percentage) -97.48% 71.460 1.800 - -25.31% -
471.omnetpp (max) (percentage) -97.30% 79.650 2.150 - 50.35% -
459.GemsFDTD (unexplained diff vs previous) -97.25% 15458.000 425.000 - 1474.07% -
433.milc (max) (percentage) -97.20% 90.750 2.540 - 18.69% -
436.cactusADM (unexplained diff vs previous) -97.13% 16396.000 470.000 - 46900.00% -
433.milc (unexplained diff vs previous) -97.10% 11289.000 327.000 - 0.00% -
436.cactusADM (max) (percentage) -97.00% 88.730 2.660 - 139.64% -
429.mcf (avg) (percentage) -96.87% 7.670 0.240 - -94.98% -
453.povray (max) (percentage) -96.67% 91.250 3.040 - 120.29% -
454.calculix (max) (percentage) -96.62% 99.730 3.370 - 310.98% -
473.astar (avg) (percentage) -96.39% 4.160 0.150 - -90.74% -
410.bwaves (unexplained diff vs previous) (percentage) -96.00% 137.900 5.520 - 1246.34% -
400.perlbench (max) (percentage) -95.90% 84.060 3.450 - 10.22% -
403.gcc (avg) (percentage) -95.77% 7.320 0.310 - -93.91% -
470.lbm (max) (percentage) -95.37% 72.510 3.360 - 253.68% -
435.gromacs (max) (percentage) -95.02% 49.160 2.450 - 6.99% -
401.bzip2 (max) -94.98% 2313.000 116.000 - 63.38% -
429.mcf (max) -94.86% 1322.000 68.000 - -66.17% -
445.gobmk (max) -94.48% 2643.000 146.000 - 156.14% -
481.wrf (max) (percentage) -94.44% 68.700 3.820 - 371.60% -
462.libquantum (avg) (percentage) -94.39% 7.660 0.430 - -76.63% -
458.sjeng (avg) (percentage) -93.42% 3.190 0.210 - -65.00% -
465.tonto (max) -93.32% 2112.000 141.000 - -53.92% -
464.h264ref (avg) (percentage) -93.12% 5.090 0.350 - -50.70% -
483.xalancbmk (max) (percentage) -92.62% 68.670 5.070 - 186.44% -
444.namd (max) (percentage) -92.06% 91.790 7.290 - 169.00% -
416.gamess (max) (percentage) -91.85% 38.550 3.140 - 748.65% -
465.tonto (max) (percentage) -91.25% 19.310 1.690 - -39.64% -
410.bwaves (max) (percentage) -90.98% 57.970 5.230 - 290.30% -
459.GemsFDTD (max) -90.52% 4411.000 418.000 - 237.10% -
410.bwaves (unexplained diff vs previous) -90.27% 7794.000 758.000 - 3058.33% -
473.astar -90.14% 213.000 21.000 - -73.42% -
473.astar (avg) -90.14% 213.000 21.000 - -73.42% -
401.bzip2 (avg) (percentage) -89.96% 5.480 0.550 - -60.99% -
447.dealII (max) -89.67% 1384.000 143.000 - 1200.00% -
471.omnetpp (max) -89.40% 2169.000 230.000 - 521.62% -
435.gromacs (max) -89.25% 3573.000 384.000 - 141.51% -
456.hmmer (avg) (percentage) -88.66% 4.410 0.500 - -3.85% -
458.sjeng -87.97% 241.000 29.000 - -32.56% -
458.sjeng (avg) -87.97% 241.000 29.000 - -32.56% -
434.zeusmp (max) -86.42% 2055.000 279.000 - 1295.00% -
454.calculix (avg) (percentage) -86.28% 8.020 1.100 - -69.44% -
447.dealII (avg) (percentage) -86.14% 5.770 0.800 - -30.43% -
416.gamess (max) -86.10% 4805.000 668.000 - 0.00% -
483.xalancbmk (avg) (percentage) -85.38% 6.500 0.950 - -67.91% -
470.lbm (max) -85.18% 2746.000 407.000 - 1062.86% -
445.gobmk (avg) (percentage) -84.65% 3.910 0.600 - -31.03% -
450.soplex (avg) (percentage) -84.14% 6.430 1.020 - -58.54% -
471.omnetpp (avg) (percentage) -83.90% 8.200 1.320 - -36.84% -
481.wrf (max) -83.85% 3801.000 614.000 - 0.00% -
464.h264ref -83.62% 293.000 48.000 - 20.00% -
464.h264ref (avg) -83.62% 293.000 48.000 - 20.00% -
459.GemsFDTD (avg) (percentage) -82.88% 5.840 1.000 - -23.08% -
453.povray (avg) (percentage) -81.43% 7.810 1.450 - -5.84% -
437.leslie3d (max) (percentage) -79.13% 16.580 3.460 - -68.11% -
483.xalancbmk (max) -78.98% 2621.000 551.000 - 0.00% -
410.bwaves (max) -78.08% 3276.000 718.000 - 820.51% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - 4.09% -
465.tonto -74.25% 365.000 94.000 - -30.37% -
465.tonto (avg) -74.25% 365.000 94.000 - -30.37% -
434.zeusmp (avg) (percentage) -74.19% 5.850 1.510 - 58.95% -
436.cactusADM (max) -73.86% 1848.000 483.000 - 2000.00% -
400.perlbench (max) -72.66% 1397.000 382.000 - 730.43% -
437.leslie3d (max) -72.47% 1929.000 531.000 - -55.45% -
436.cactusADM (avg) (percentage) -72.41% 5.980 1.650 - 57.14% -
435.gromacs (avg) (percentage) -70.95% 5.060 1.470 - -16.95% -
433.milc (avg) (percentage) -69.92% 6.050 1.820 - 46.77% -
470.lbm (avg) (percentage) -69.51% 6.330 1.930 - 129.76% -
462.libquantum (max) -68.84% 138.000 43.000 - 2050.00% -
433.milc (max) -67.91% 1044.000 335.000 - 1295.83% -
400.perlbench (avg) (percentage) -67.56% 6.350 2.060 - 6.19% -
481.wrf (avg) (percentage) -66.19% 6.240 2.110 - 17.22% -
465.tonto (avg) (percentage) -66.17% 3.340 1.130 - -8.87% -
445.gobmk -64.80% 196.000 69.000 - 64.29% -
445.gobmk (avg) -64.80% 196.000 69.000 - 64.29% -
429.mcf -62.39% 109.000 41.000 - -53.41% -
429.mcf (avg) -62.39% 109.000 41.000 - -53.41% -
453.povray (max) -61.52% 499.000 192.000 - 2642.86% -
483.xalancbmk -58.47% 248.000 103.000 - 0.00% -
483.xalancbmk (avg) -58.47% 248.000 103.000 - 0.00% -
456.hmmer -58.27% 127.000 53.000 - 278.57% -
456.hmmer (avg) -58.27% 127.000 53.000 - 278.57% -
444.namd (avg) (percentage) -56.40% 9.220 4.020 - 240.68% -
416.gamess (avg) (percentage) -54.30% 4.420 2.020 - 165.79% -
450.soplex (max) -52.66% 545.000 258.000 - 1257.89% -
403.gcc (max) -50.91% 55.000 27.000 - 0.00% -
410.bwaves (avg) (percentage) -49.21% 4.410 2.240 - 157.47% -
401.bzip2 -49.07% 161.000 82.000 - 105.00% -
401.bzip2 (avg) -49.07% 161.000 82.000 - 105.00% -
482.sphinx3 (max) -46.10% 911.000 491.000 - 2627.78% -
435.gromacs -37.33% 367.000 230.000 - 86.99% -
435.gromacs (avg) -37.33% 367.000 230.000 - 86.99% -
471.omnetpp -36.77% 223.000 141.000 - 161.11% -
471.omnetpp (avg) -36.77% 223.000 141.000 - 161.11% -
459.GemsFDTD -35.56% 360.000 232.000 - 246.27% -
459.GemsFDTD (avg) -35.56% 360.000 232.000 - 246.27% -
437.leslie3d (avg) (percentage) -32.13% 3.050 2.070 - -54.20% -
447.dealII -27.27% 99.000 72.000 - 300.00% -
447.dealII (avg) -27.27% 99.000 72.000 - 300.00% -
416.gamess -21.82% 550.000 430.000 - 0.00% -
416.gamess (avg) -21.82% 550.000 430.000 - 0.00% -
437.leslie3d -10.42% 355.000 318.000 - -35.89% -
437.leslie3d (avg) -10.42% 355.000 318.000 - -35.89% -
470.lbm -2.09% 239.000 234.000 - 654.84% -
470.lbm (avg) -2.09% 239.000 234.000 - 654.84% -
481.wrf -1.74% 345.000 339.000 - 0.00% -
481.wrf (avg) -1.74% 345.000 339.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 11092.000 641.94%
401.bzip2 14944.000 423.43%
403.gcc 9060.000 -
410.bwaves 13735.000 135.19%
416.gamess 21302.000 -
429.mcf 17219.000 834.29%
433.milc 13221.000 1067.93%
434.zeusmp 13724.000 502.72%
435.gromacs 15708.000 125.62%
436.cactusADM 18160.000 748.20%
437.leslie3d 15367.000 39.83%
444.namd 9747.000 1172.45%
445.gobmk 11646.000 137.72%
447.dealII 9098.000 461.95%
450.soplex 16084.000 2819.06%
453.povray 6328.000 1076.21%
454.calculix 21741.000 -
456.hmmer 10759.000 274.62%
458.sjeng 14223.000 94.92%
459.GemsFDTD 23235.000 348.90%
462.libquantum 11490.000 8539.10%
464.h264ref 13797.000 140.37%
465.tonto 8365.000 -23.50%
470.lbm 12138.000 227.17%
471.omnetpp 10700.000 308.71%
473.astar 14185.000 188.43%
481.wrf 16089.000 -
482.sphinx3 28903.000 3485.98%
483.xalancbmk 10877.000 -
Geometric Mean 13501.613 464.70%
Code Size (bytes)
Name Current %
400.perlbench 892912.000 -
401.bzip2 44241.000 1.19%
403.gcc 2446120.000 -
410.bwaves 16748.000 1.72%
416.gamess 5732285.000 -
429.mcf 9123.000 -
433.milc 61222.000 1.27%
434.zeusmp 153713.000 4.65%
435.gromacs 500327.000 2.18%
436.cactusADM 352867.000 -
437.leslie3d 59491.000 9.42%
444.namd 188365.000 1.40%
445.gobmk 1377606.000 -
447.dealII 312518.000 1.79%
450.soplex 205068.000 1.23%
453.povray 657755.000 1.22%
454.calculix 845075.000 -
456.hmmer 108691.000 1.40%
458.sjeng 104004.000 1.68%
459.GemsFDTD 245040.000 3.54%
462.libquantum 16117.000 2.03%
464.h264ref 383416.000 1.05%
465.tonto 1948611.000 -1.37%
470.lbm 9687.000 1.47%
471.omnetpp 480176.000 1.01%
473.astar 22944.000 -
481.wrf 1965892.000 -
482.sphinx3 112839.000 1.05%
483.xalancbmk 2342986.000 -
Geometric Mean 223970.600 63.86%
Score
Name Current %
nb_compile_successful 29.000 20.83%
nb_execution_successful 29.000 20.83%
nb_total_tests 29.000 -14.71%
Geometric Mean 29.000 7.59%
sample variability
Name Current %
400.perlbench 228.000 686.21%
400.perlbench (avg) 228.000 686.21%
400.perlbench (avg) (percentage) 2.060 6.19%
400.perlbench (max) 382.000 730.43%
400.perlbench (max) (percentage) 3.450 10.22%
401.bzip2 82.000 105.00%
401.bzip2 (avg) 82.000 105.00%
401.bzip2 (avg) (percentage) 0.550 -60.99%
401.bzip2 (max) 116.000 63.38%
401.bzip2 (max) (percentage) 0.780 -68.67%
403.gcc 28.000 -
403.gcc (avg) 28.000 -
403.gcc (avg) (percentage) 0.310 -93.91%
403.gcc (max) 27.000 -
403.gcc (max) (percentage) 0.300 -92.04%
410.bwaves 307.000 514.00%
410.bwaves (avg) 307.000 514.00%
410.bwaves (avg) (percentage) 2.240 157.47%
410.bwaves (max) 718.000 820.51%
410.bwaves (max) (percentage) 5.230 290.30%
410.bwaves (unexplained diff vs previous) 758.000 3058.33%
410.bwaves (unexplained diff vs previous) (percentage) 5.520 1246.34%
416.gamess 430.000 -
416.gamess (avg) 430.000 -
416.gamess (avg) (percentage) 2.020 165.79%
416.gamess (max) 668.000 -
416.gamess (max) (percentage) 3.140 748.65%
429.mcf 41.000 -53.41%
429.mcf (avg) 41.000 -53.41%
429.mcf (avg) (percentage) 0.240 -94.98%
429.mcf (max) 68.000 -66.17%
429.mcf (max) (percentage) 0.400 -96.34%
433.milc 240.000 1614.29%
433.milc (avg) 240.000 1614.29%
433.milc (avg) (percentage) 1.820 46.77%
433.milc (max) 335.000 1295.83%
433.milc (max) (percentage) 2.540 18.69%
433.milc (unexplained diff vs previous) 327.000 -
433.milc (unexplained diff vs previous) (percentage) 2.470 -
434.zeusmp 207.000 885.71%
434.zeusmp (avg) 207.000 885.71%
434.zeusmp (avg) (percentage) 1.510 58.95%
434.zeusmp (max) 279.000 1295.00%
434.zeusmp (max) (percentage) 2.040 124.18%
434.zeusmp (unexplained diff vs previous) 245.000 2350.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.790 306.82%
435.gromacs 230.000 86.99%
435.gromacs (avg) 230.000 86.99%
435.gromacs (avg) (percentage) 1.470 -16.95%
435.gromacs (max) 384.000 141.51%
435.gromacs (max) (percentage) 2.450 6.99%
436.cactusADM 299.000 1259.09%
436.cactusADM (avg) 299.000 1259.09%
436.cactusADM (avg) (percentage) 1.650 57.14%
436.cactusADM (max) 483.000 2000.00%
436.cactusADM (max) (percentage) 2.660 139.64%
436.cactusADM (unexplained diff vs previous) 470.000 46900.00%
436.cactusADM (unexplained diff vs previous) (percentage) 2.590 5080.00%
437.leslie3d 318.000 -35.89%
437.leslie3d (avg) 318.000 -35.89%
437.leslie3d (avg) (percentage) 2.070 -54.20%
437.leslie3d (max) 531.000 -55.45%
437.leslie3d (max) (percentage) 3.460 -68.11%
444.namd 391.000 4244.44%
444.namd (avg) 391.000 4244.44%
444.namd (avg) (percentage) 4.020 240.68%
444.namd (max) 710.000 3450.00%
444.namd (max) (percentage) 7.290 169.00%
445.gobmk 69.000 64.29%
445.gobmk (avg) 69.000 64.29%
445.gobmk (avg) (percentage) 0.600 -31.03%
445.gobmk (max) 146.000 156.14%
445.gobmk (max) (percentage) 1.260 7.69%
447.dealII 72.000 300.00%
447.dealII (avg) 72.000 300.00%
447.dealII (avg) (percentage) 0.800 -30.43%
447.dealII (max) 143.000 1200.00%
447.dealII (max) (percentage) 1.580 119.44%
450.soplex 164.000 1161.54%
450.soplex (avg) 164.000 1161.54%
450.soplex (avg) (percentage) 1.020 -58.54%
450.soplex (max) 258.000 1257.89%
450.soplex (max) (percentage) 1.610 -54.65%
450.soplex (unexplained diff vs previous) 255.000 12650.00%
450.soplex (unexplained diff vs previous) (percentage) 1.590 341.67%
453.povray 91.000 1037.50%
453.povray (avg) 91.000 1037.50%
453.povray (avg) (percentage) 1.450 -5.84%
453.povray (max) 192.000 2642.86%
453.povray (max) (percentage) 3.040 120.29%
454.calculix 239.000 -
454.calculix (avg) 239.000 -
454.calculix (avg) (percentage) 1.100 -69.44%
454.calculix (max) 732.000 -
454.calculix (max) (percentage) 3.370 310.98%
456.hmmer 53.000 278.57%
456.hmmer (avg) 53.000 278.57%
456.hmmer (avg) (percentage) 0.500 -3.85%
456.hmmer (max) 39.000 129.41%
456.hmmer (max) (percentage) 0.370 -38.33%
458.sjeng 29.000 -32.56%
458.sjeng (avg) 29.000 -32.56%
458.sjeng (avg) (percentage) 0.210 -65.00%
458.sjeng (max) 81.000 47.27%
458.sjeng (max) (percentage) 0.570 -25.00%
458.sjeng (unexplained diff vs previous) 11.000 -65.62%
458.sjeng (unexplained diff vs previous) (percentage) 0.080 -81.82%
459.GemsFDTD 232.000 246.27%
459.GemsFDTD (avg) 232.000 246.27%
459.GemsFDTD (avg) (percentage) 1.000 -23.08%
459.GemsFDTD (max) 418.000 237.10%
459.GemsFDTD (max) (percentage) 1.800 -25.31%
459.GemsFDTD (unexplained diff vs previous) 425.000 1474.07%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.830 251.92%
462.libquantum 49.000 2350.00%
462.libquantum (avg) 49.000 2350.00%
462.libquantum (avg) (percentage) 0.430 -76.63%
462.libquantum (max) 43.000 2050.00%
462.libquantum (max) (percentage) 0.380 -77.25%
462.libquantum (unexplained diff vs previous) 44.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.380 -
464.h264ref 48.000 20.00%
464.h264ref (avg) 48.000 20.00%
464.h264ref (avg) (percentage) 0.350 -50.70%
464.h264ref (max) 77.000 185.19%
464.h264ref (max) (percentage) 0.560 16.67%
465.tonto 94.000 -30.37%
465.tonto (avg) 94.000 -30.37%
465.tonto (avg) (percentage) 1.130 -8.87%
465.tonto (max) 141.000 -53.92%
465.tonto (max) (percentage) 1.690 -39.64%
470.lbm 234.000 654.84%
470.lbm (avg) 234.000 654.84%
470.lbm (avg) (percentage) 1.930 129.76%
470.lbm (max) 407.000 1062.86%
470.lbm (max) (percentage) 3.360 253.68%
471.omnetpp 141.000 161.11%
471.omnetpp (avg) 141.000 161.11%
471.omnetpp (avg) (percentage) 1.320 -36.84%
471.omnetpp (max) 230.000 521.62%
471.omnetpp (max) (percentage) 2.150 50.35%
471.omnetpp (unexplained diff vs previous) 122.000 1933.33%
471.omnetpp (unexplained diff vs previous) (percentage) 1.140 395.65%
473.astar 21.000 -73.42%
473.astar (avg) 21.000 -73.42%
473.astar (avg) (percentage) 0.150 -90.74%
473.astar (max) 12.000 -94.55%
473.astar (max) (percentage) 0.090 -98.00%
473.astar (unexplained diff vs previous) 8.000 -11.11%
473.astar (unexplained diff vs previous) (percentage) 0.060 -66.67%
481.wrf 339.000 -
481.wrf (avg) 339.000 -
481.wrf (avg) (percentage) 2.110 17.22%
481.wrf (max) 614.000 -
481.wrf (max) (percentage) 3.820 371.60%
482.sphinx3 514.000 3853.85%
482.sphinx3 (avg) 514.000 3853.85%
482.sphinx3 (avg) (percentage) 1.780 4.09%
482.sphinx3 (max) 491.000 2627.78%
482.sphinx3 (max) (percentage) 1.700 -26.41%
483.xalancbmk 103.000 -
483.xalancbmk (avg) 103.000 -
483.xalancbmk (avg) (percentage) 0.950 -67.91%
483.xalancbmk (max) 551.000 -
483.xalancbmk (max) (percentage) 5.070 186.44%
Geometric Mean 20.369 180.06%