Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=98b1464bdf6306a8ab4614b5e9f76cdb2dd00b33 (+ 38 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ccb6e08a4d5a067513b3a10bbf0d76e28e1d4a8e (+ 123 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a36814e1455093fc9ebfcdf6ef39bb0cf3d447da (+ 14 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e7e98f48b9d83402a8baccb8f4cfb0ddb8a40aee (+ 61 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/244/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0244 (4-changed-components) 2024-09-27T21:23:24 0:00:00
Previous 0243 (3-changed-components) 2024-09-22T14:02:27 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 20 48
Performance Improvements 56 130
Added Tests 4 0
Unchanged Tests 1156 1058
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.10% 11351.000 11816.000 - -34.61% -
462.libquantum 2.84% 211.000 217.000 - -98.72% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) (percentage) 425.00% 0.080 0.420 0.000 -75.86% 0.000
410.bwaves (unexplained diff vs previous) 400.00% 5.000 25.000 0.000 -90.27% 0.000
462.libquantum 50.00% 2.000 3.000 - -90.62% -
462.libquantum (avg) 50.00% 2.000 3.000 - -90.62% -
433.milc (max) 33.33% 3.000 4.000 - -95.88% -
433.milc (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 -95.83% 0.000
433.milc (unexplained diff vs previous) (percentage) 33.33% 0.270 0.360 0.000 -48.57% 0.000
470.lbm (unexplained diff vs previous) 13.33% 15.000 17.000 0.000 -97.93% 0.000
470.lbm (max) (percentage) 12.20% 0.410 0.460 - -91.61% -
470.lbm (unexplained diff vs previous) (percentage) 12.20% 0.410 0.460 0.000 -90.87% 0.000
433.milc (max) (percentage) 8.82% 0.340 0.370 - -47.89% -
470.lbm (max) 6.67% 15.000 16.000 - -98.21% -
437.leslie3d 3.68% 543.000 563.000 - 87.04% -
437.leslie3d (avg) 3.68% 543.000 563.000 - 87.04% -
471.omnetpp 2.08% 48.000 49.000 - -55.05% -
471.omnetpp (avg) 2.08% 48.000 49.000 - -55.05% -
473.astar 1.43% 70.000 71.000 - 39.22% -
473.astar (avg) 1.43% 70.000 71.000 - 39.22% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
456.hmmer -2.47% 4297.000 4191.000 - -77.94% -
453.povray -2.39% 544.000 531.000 - -92.82% -
400.perlbench -1.55% 1548.000 1524.000 - -86.41% -
435.gromacs -1.34% 7542.000 7441.000 - -55.85% -
445.gobmk -1.30% 5096.000 5030.000 - -59.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) -90.91% 11.000 1.000 0.000 -99.91% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -90.48% 0.420 0.040 0.000 -99.17% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -59.38% 2.240 0.910 0.000 35.82% 0.000
471.omnetpp (unexplained diff vs previous) -59.02% 61.000 25.000 0.000 -59.68% 0.000
444.namd (unexplained diff vs previous) -30.00% 10.000 7.000 0.000 -99.16% 0.000
444.namd (unexplained diff vs previous) (percentage) -29.36% 1.090 0.770 0.000 -85.28% 0.000
436.cactusADM (max) (percentage) -23.81% 0.420 0.320 - -93.66% -
436.cactusADM (max) -20.00% 10.000 8.000 - -99.35% -
444.namd (max) -20.00% 10.000 8.000 - -99.09% -
473.astar (max) (percentage) -16.98% 1.590 1.320 - 180.85% -
471.omnetpp (max) (percentage) -16.82% 2.200 1.830 - -1.61% -
434.zeusmp (max) -16.67% 6.000 5.000 - -98.96% -
444.namd (max) (percentage) -16.36% 1.100 0.920 - -83.30% -
473.astar (max) -15.79% 76.000 64.000 - 4.92% -
471.omnetpp (max) -15.25% 59.000 50.000 - -70.93% -
447.dealII (max) -14.29% 7.000 6.000 - -96.00% -
459.GemsFDTD (max) (percentage) -14.29% 0.910 0.780 - -65.79% -
459.GemsFDTD (max) -14.06% 64.000 55.000 - -90.48% -
456.hmmer (max) -13.33% 15.000 13.000 - -86.73% -
453.povray (max) -11.11% 9.000 8.000 - -95.81% -
410.bwaves (max) -10.34% 29.000 26.000 - -90.00% -
447.dealII (max) (percentage) -10.26% 0.390 0.350 - -78.79% -
410.bwaves (max) (percentage) -10.20% 0.490 0.440 - -75.14% -
450.soplex (max) (percentage) -8.74% 2.060 1.880 - 327.27% -
450.soplex (max) -8.33% 12.000 11.000 - -84.06% -
445.gobmk (max) -7.14% 42.000 39.000 - 18.18% -
464.h264ref (max) -7.14% 28.000 26.000 - -55.93% -
400.perlbench (max) -6.82% 44.000 41.000 - -53.93% -
464.h264ref (max) (percentage) -6.52% 0.460 0.430 - 10.26% -
435.gromacs (max) -6.35% 126.000 118.000 - -60.14% -
437.leslie3d (max) (percentage) -6.16% 5.520 5.180 - 67.10% -
445.gobmk (max) (percentage) -6.02% 0.830 0.780 - 188.89% -
429.mcf (max) (percentage) -5.73% 5.060 4.770 - 1390.62% -
456.hmmer (max) (percentage) -5.71% 0.350 0.330 - -36.54% -
400.perlbench (max) (percentage) -5.59% 2.860 2.700 - 237.50% -
435.gromacs (max) (percentage) -5.36% 1.680 1.590 - -9.66% -
429.mcf (max) -4.84% 62.000 59.000 - 59.46% -
453.povray (max) (percentage) -4.79% 1.670 1.590 - -38.61% -
482.sphinx3 (max) (percentage) -4.71% 0.850 0.810 - -74.29% -
434.zeusmp (max) (percentage) -4.55% 0.220 0.210 - -90.87% -
456.hmmer -4.35% 23.000 22.000 - -60.71% -
456.hmmer (avg) -4.35% 23.000 22.000 - -60.71% -
465.tonto (max) (percentage) -3.16% 0.950 0.920 - -46.20% -
465.tonto (max) -2.50% 120.000 117.000 - -47.53% -
437.leslie3d (max) -2.24% 626.000 612.000 - 9.29% -
433.milc (avg) (percentage) -1.72% 1.160 1.140 - 65.22% -
435.gromacs -1.56% 128.000 126.000 - -21.25% -
435.gromacs (avg) -1.56% 128.000 126.000 - -21.25% -
459.GemsFDTD -1.19% 84.000 83.000 - -76.42% -
459.GemsFDTD (avg) -1.19% 84.000 83.000 - -76.42% -
436.cactusADM (avg) (percentage) -1.10% 0.910 0.900 - -62.50% -

Added Tests - sample variability
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.85% 1437761.000 1464414.000 - 0.00% -
473.astar 1.70% 15549.000 15813.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 1390.62% 0.320 4.770 - -5.73% -
403.gcc (max) (percentage) 1128.81% 0.590 7.250 - -0.28% -
450.soplex (avg) (percentage) 966.67% 0.240 2.560 - 0.00% -
429.mcf (avg) (percentage) 810.42% 0.480 4.370 - 0.00% -
462.libquantum (max) (percentage) 800.00% 0.080 0.720 - 0.00% -
462.libquantum (avg) (percentage) 636.84% 0.190 1.400 - 0.00% -
401.bzip2 (avg) (percentage) 562.96% 0.270 1.790 - 0.00% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 0.00% -
450.soplex (max) (percentage) 327.27% 0.440 1.880 - -8.74% -
454.calculix (max) (percentage) 311.90% 0.840 3.460 - 0.00% -
445.gobmk (avg) (percentage) 309.09% 0.220 0.900 - 0.00% -
400.perlbench (avg) (percentage) 292.31% 0.390 1.530 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 282.52% 1.030 3.940 0.000 0.00% 0.000
473.astar (avg) (percentage) 265.00% 0.400 1.460 - 0.00% -
400.perlbench (max) (percentage) 237.50% 0.800 2.700 - -5.59% -
445.gobmk (max) (percentage) 188.89% 0.270 0.780 - -6.02% -
437.leslie3d (avg) (percentage) 185.63% 1.670 4.770 - -0.42% -
458.sjeng (avg) (percentage) 182.61% 0.230 0.650 - 0.00% -
473.astar (max) (percentage) 180.85% 0.470 1.320 - -16.98% -
437.leslie3d (unexplained diff vs previous) 148.66% 187.000 465.000 0.000 0.00% 0.000
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
464.h264ref (avg) (percentage) 89.74% 0.390 0.740 - 0.00% -
437.leslie3d 87.04% 301.000 563.000 - 3.68% -
437.leslie3d (avg) 87.04% 301.000 563.000 - 3.68% -
456.hmmer (avg) (percentage) 80.00% 0.300 0.540 - 0.00% -
435.gromacs (avg) (percentage) 78.95% 0.950 1.700 - 0.00% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 0.00% -
437.leslie3d (max) (percentage) 67.10% 3.100 5.180 - -6.16% -
445.gobmk 66.67% 27.000 45.000 - 0.00% -
445.gobmk (avg) 66.67% 27.000 45.000 - 0.00% -
433.milc (avg) (percentage) 65.22% 0.690 1.140 - -1.72% -
483.xalancbmk (max) (percentage) 64.13% 0.920 1.510 - 0.00% -
447.dealII (avg) (percentage) 59.77% 0.870 1.390 - 0.00% -
429.mcf (max) 59.46% 37.000 59.000 - -4.84% -
471.omnetpp (avg) (percentage) 51.69% 1.180 1.790 - -0.56% -
473.astar 39.22% 51.000 71.000 - 1.43% -
473.astar (avg) 39.22% 51.000 71.000 - 1.43% -
458.sjeng 36.11% 36.000 49.000 - 0.00% -
458.sjeng (avg) 36.11% 36.000 49.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 35.82% 0.670 0.910 0.000 -59.38% 0.000
445.gobmk (max) 18.18% 33.000 39.000 - -7.14% -
401.bzip2 13.33% 45.000 51.000 - 0.00% -
401.bzip2 (avg) 13.33% 45.000 51.000 - 0.00% -
464.h264ref (max) (percentage) 10.26% 0.390 0.430 - -6.52% -
437.leslie3d (max) 9.29% 560.000 612.000 - -2.24% -
473.astar (max) 4.92% 61.000 64.000 - -15.79% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.83% 10845.000 10213.000 - 0.00% -
437.leslie3d -3.79% 48001.000 46184.000 - -0.01% -
434.zeusmp -1.66% 141060.000 138714.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.72% 17005.000 217.000 - 2.84% -
482.sphinx3 -97.50% 36586.000 915.000 - 0.77% -
450.soplex -96.24% 15709.000 591.000 - 0.00% -
444.namd -94.31% 15957.000 908.000 - -0.77% -
453.povray -92.82% 7395.000 531.000 - -2.39% -
433.milc -91.97% 13668.000 1097.000 - 0.37% -
429.mcf -89.38% 11727.000 1245.000 - 0.16% -
436.cactusADM -89.34% 24396.000 2601.000 - -0.04% -
434.zeusmp -86.72% 20932.000 2779.000 - -0.04% -
400.perlbench -86.41% 11215.000 1524.000 - -1.55% -
401.bzip2 -83.01% 16971.000 2884.000 - -0.17% -
447.dealII -78.99% 9101.000 1912.000 - 0.16% -
456.hmmer -77.94% 18995.000 4191.000 - -2.47% -
470.lbm -77.44% 16312.000 3680.000 - 0.46% -
459.GemsFDTD -72.15% 25364.000 7065.000 - -0.27% -
471.omnetpp -70.39% 9265.000 2743.000 - 0.92% -
473.astar -62.48% 12983.000 4871.000 - 0.66% -
464.h264ref -59.67% 15208.000 6133.000 - -0.23% -
445.gobmk -59.42% 12396.000 5030.000 - -1.30% -
410.bwaves -59.21% 14745.000 6015.000 - 0.42% -
435.gromacs -55.85% 16853.000 7441.000 - -1.34% -
458.sjeng -52.28% 16018.000 7644.000 - -0.39% -
437.leslie3d -34.61% 18070.000 11816.000 - 4.10% -
465.tonto -2.19% 13044.000 12758.000 - 0.63% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM (unexplained diff vs previous) -99.91% 1173.000 1.000 0.000 -90.91% 0.000
482.sphinx3 (max) -99.39% 1152.000 7.000 - 0.00% -
436.cactusADM (max) -99.35% 1231.000 8.000 - -20.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.17% 4.810 0.040 0.000 -90.48% 0.000
444.namd (unexplained diff vs previous) -99.16% 834.000 7.000 0.000 -30.00% 0.000
444.namd (max) -99.09% 879.000 8.000 - -20.00% -
434.zeusmp (max) -98.96% 481.000 5.000 - -16.67% -
482.sphinx3 -98.37% 859.000 14.000 - 0.00% -
482.sphinx3 (avg) -98.37% 859.000 14.000 - 0.00% -
470.lbm (max) -98.21% 893.000 16.000 - 6.67% -
470.lbm (unexplained diff vs previous) -97.93% 822.000 17.000 0.000 13.33% 0.000
444.namd -97.58% 414.000 10.000 - 0.00% -
444.namd (avg) -97.58% 414.000 10.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -96.75% 584.000 19.000 0.000 0.00% 0.000
416.gamess (max) (percentage) -96.18% 3.140 0.120 - 0.00% -
436.cactusADM -96.07% 585.000 23.000 - 0.00% -
436.cactusADM (avg) -96.07% 585.000 23.000 - 0.00% -
447.dealII (max) -96.00% 150.000 6.000 - -14.29% -
433.milc (max) -95.88% 97.000 4.000 - 33.33% -
433.milc (unexplained diff vs previous) -95.83% 96.000 4.000 0.000 33.33% 0.000
453.povray (max) -95.81% 191.000 8.000 - -11.11% -
453.povray -93.81% 113.000 7.000 - 0.00% -
453.povray (avg) -93.81% 113.000 7.000 - 0.00% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - 0.00% -
436.cactusADM (max) (percentage) -93.66% 5.050 0.320 - -23.81% -
470.lbm -93.59% 608.000 39.000 - 0.00% -
470.lbm (avg) -93.59% 608.000 39.000 - 0.00% -
462.libquantum (max) -92.31% 13.000 1.000 - 0.00% -
470.lbm (max) (percentage) -91.61% 5.480 0.460 - 12.20% -
470.lbm (unexplained diff vs previous) (percentage) -90.87% 5.040 0.460 0.000 12.20% 0.000
434.zeusmp (max) (percentage) -90.87% 2.300 0.210 - -4.55% -
462.libquantum -90.62% 32.000 3.000 - 50.00% -
462.libquantum (avg) -90.62% 32.000 3.000 - 50.00% -
459.GemsFDTD (max) -90.48% 578.000 55.000 - -14.06% -
410.bwaves (unexplained diff vs previous) -90.27% 257.000 25.000 0.000 400.00% 0.000
410.bwaves (max) -90.00% 260.000 26.000 - -10.34% -
401.bzip2 (max) -89.55% 67.000 7.000 - 0.00% -
434.zeusmp -89.41% 255.000 27.000 - 0.00% -
434.zeusmp (avg) -89.41% 255.000 27.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -88.26% 2.300 0.270 0.000 0.00% 0.000
433.milc -87.23% 94.000 12.000 - 0.00% -
433.milc (avg) -87.23% 94.000 12.000 - 0.00% -
456.hmmer (max) -86.73% 98.000 13.000 - -13.33% -
444.namd (unexplained diff vs previous) (percentage) -85.28% 5.230 0.770 0.000 -29.36% 0.000
450.soplex (max) -84.06% 69.000 11.000 - -8.33% -
444.namd (max) (percentage) -83.30% 5.510 0.920 - -16.36% -
410.bwaves -80.62% 289.000 56.000 - 0.00% -
410.bwaves (avg) -80.62% 289.000 56.000 - 0.00% -
447.dealII (max) (percentage) -78.79% 1.650 0.350 - -10.26% -
459.GemsFDTD -76.42% 352.000 83.000 - -1.19% -
459.GemsFDTD (avg) -76.42% 352.000 83.000 - -1.19% -
410.bwaves (unexplained diff vs previous) (percentage) -75.86% 1.740 0.420 0.000 425.00% 0.000
410.bwaves (max) (percentage) -75.14% 1.770 0.440 - -10.20% -
482.sphinx3 (max) (percentage) -74.29% 3.150 0.810 - -4.71% -
470.lbm (avg) (percentage) -71.05% 3.730 1.080 - -0.92% -
471.omnetpp (max) -70.93% 172.000 50.000 - -15.25% -
447.dealII -67.09% 79.000 26.000 - 0.00% -
447.dealII (avg) -67.09% 79.000 26.000 - 0.00% -
458.sjeng (max) -66.67% 48.000 16.000 - 0.00% -
459.GemsFDTD (max) (percentage) -65.79% 2.280 0.780 - -14.29% -
436.cactusADM (avg) (percentage) -62.50% 2.400 0.900 - -1.10% -
456.hmmer -60.71% 56.000 22.000 - -4.35% -
456.hmmer (avg) -60.71% 56.000 22.000 - -4.35% -
435.gromacs (max) -60.14% 296.000 118.000 - -6.35% -
471.omnetpp (unexplained diff vs previous) -59.68% 62.000 25.000 0.000 -59.02% 0.000
450.soplex -59.46% 37.000 15.000 - 0.00% -
450.soplex (avg) -59.46% 37.000 15.000 - 0.00% -
444.namd (avg) (percentage) -56.92% 2.600 1.120 - 0.00% -
464.h264ref (max) -55.93% 59.000 26.000 - -7.14% -
471.omnetpp -55.05% 109.000 49.000 - 2.08% -
471.omnetpp (avg) -55.05% 109.000 49.000 - 2.08% -
400.perlbench (max) -53.93% 89.000 41.000 - -6.82% -
410.bwaves (avg) (percentage) -52.04% 1.960 0.940 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -48.57% 0.700 0.360 0.000 33.33% 0.000
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - 0.00% -
433.milc (max) (percentage) -47.89% 0.710 0.370 - 8.82% -
465.tonto (max) -47.53% 223.000 117.000 - -2.50% -
400.perlbench -46.51% 43.000 23.000 - 0.00% -
400.perlbench (avg) -46.51% 43.000 23.000 - 0.00% -
465.tonto (max) (percentage) -46.20% 1.710 0.920 - -3.16% -
453.povray (max) (percentage) -38.61% 2.590 1.590 - -4.79% -
456.hmmer (max) (percentage) -36.54% 0.520 0.330 - -5.71% -
401.bzip2 (max) (percentage) -35.00% 0.400 0.260 - 0.00% -
482.sphinx3 (avg) (percentage) -32.34% 2.350 1.590 - 0.00% -
465.tonto -30.41% 148.000 103.000 - 0.98% -
465.tonto (avg) -30.41% 148.000 103.000 - 0.98% -
465.tonto (avg) (percentage) -28.95% 1.140 0.810 - 0.00% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - 0.00% -
458.sjeng (max) (percentage) -26.67% 0.300 0.220 - 0.00% -
464.h264ref -23.73% 59.000 45.000 - 0.00% -
464.h264ref (avg) -23.73% 59.000 45.000 - 0.00% -
435.gromacs -21.25% 160.000 126.000 - -1.56% -
435.gromacs (avg) -21.25% 160.000 126.000 - -1.56% -
434.zeusmp (avg) (percentage) -18.03% 1.220 1.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -15.11% 1.390 1.180 - -0.84% -
435.gromacs (max) (percentage) -9.66% 1.760 1.590 - -5.36% -
453.povray (avg) (percentage) -6.54% 1.530 1.430 - 0.00% -
429.mcf -3.57% 56.000 54.000 - 0.00% -
429.mcf (avg) -3.57% 56.000 54.000 - 0.00% -
471.omnetpp (max) (percentage) -1.61% 1.860 1.830 - -16.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1524.000 -1.55%
401.bzip2 2884.000 -
410.bwaves 6015.000 -
429.mcf 1245.000 -
433.milc 1097.000 -
434.zeusmp 2779.000 -
435.gromacs 7441.000 -1.34%
436.cactusADM 2601.000 -
437.leslie3d 11816.000 4.10%
444.namd 908.000 -
445.gobmk 5030.000 -1.30%
447.dealII 1912.000 -
450.soplex 591.000 -
453.povray 531.000 -2.39%
456.hmmer 4191.000 -2.47%
458.sjeng 7644.000 -
459.GemsFDTD 7065.000 -
462.libquantum 217.000 2.84%
464.h264ref 6133.000 -
465.tonto 12758.000 -
470.lbm 3680.000 -
471.omnetpp 2743.000 -
473.astar 4871.000 -
482.sphinx3 915.000 -
Geometric Mean 2619.270 -
Code Size (bytes)
Name Current %
400.perlbench 562126.000 -
401.bzip2 33366.000 -
410.bwaves 14723.000 -
429.mcf 7709.000 -
433.milc 47741.000 -
434.zeusmp 138714.000 -
435.gromacs 392994.000 -
436.cactusADM 256570.000 -
437.leslie3d 46184.000 -
444.namd 163131.000 -
445.gobmk 1087400.000 -
447.dealII 190419.000 -
450.soplex 135780.000 -
453.povray 493643.000 -
456.hmmer 74381.000 -
458.sjeng 81349.000 -
459.GemsFDTD 194171.000 -
462.libquantum 13142.000 -
464.h264ref 301466.000 -
465.tonto 1464414.000 -
470.lbm 10213.000 -
471.omnetpp 296057.000 -
473.astar 15813.000 -
482.sphinx3 79574.000 -
Geometric Mean 105783.076 -
sample variability
Name Current %
400.perlbench 23.000 -
400.perlbench (avg) 23.000 -
400.perlbench (avg) (percentage) 1.530 -
400.perlbench (max) 41.000 -6.82%
400.perlbench (max) (percentage) 2.700 -5.59%
401.bzip2 51.000 -
401.bzip2 (avg) 51.000 -
401.bzip2 (avg) (percentage) 1.790 -
401.bzip2 (max) 7.000 -
401.bzip2 (max) (percentage) 0.260 -
403.gcc (avg) (percentage) 2.370 -
403.gcc (max) (percentage) 7.250 -
410.bwaves 56.000 -
410.bwaves (avg) 56.000 -
410.bwaves (avg) (percentage) 0.940 -
410.bwaves (max) 26.000 -10.34%
410.bwaves (max) (percentage) 0.440 -10.20%
410.bwaves (unexplained diff vs previous) 25.000 400.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.420 425.00%
416.gamess (avg) (percentage) 0.850 -
416.gamess (max) (percentage) 0.120 -
429.mcf 54.000 -
429.mcf (avg) 54.000 -
429.mcf (avg) (percentage) 4.370 -
429.mcf (max) 59.000 -4.84%
429.mcf (max) (percentage) 4.770 -5.73%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.140 -1.72%
433.milc (max) 4.000 33.33%
433.milc (max) (percentage) 0.370 8.82%
433.milc (unexplained diff vs previous) 4.000 33.33%
433.milc (unexplained diff vs previous) (percentage) 0.360 33.33%
434.zeusmp 27.000 -
434.zeusmp (avg) 27.000 -
434.zeusmp (avg) (percentage) 1.000 -
434.zeusmp (max) 5.000 -16.67%
434.zeusmp (max) (percentage) 0.210 -4.55%
435.gromacs 126.000 -1.56%
435.gromacs (avg) 126.000 -1.56%
435.gromacs (avg) (percentage) 1.700 -
435.gromacs (max) 118.000 -6.35%
435.gromacs (max) (percentage) 1.590 -5.36%
436.cactusADM 23.000 -
436.cactusADM (avg) 23.000 -
436.cactusADM (avg) (percentage) 0.900 -1.10%
436.cactusADM (max) 8.000 -20.00%
436.cactusADM (max) (percentage) 0.320 -23.81%
436.cactusADM (unexplained diff vs previous) 1.000 -90.91%
436.cactusADM (unexplained diff vs previous) (percentage) 0.040 -90.48%
437.leslie3d 563.000 3.68%
437.leslie3d (avg) 563.000 3.68%
437.leslie3d (avg) (percentage) 4.770 -
437.leslie3d (max) 612.000 -2.24%
437.leslie3d (max) (percentage) 5.180 -6.16%
437.leslie3d (unexplained diff vs previous) 465.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 3.940 -
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.120 -
444.namd (max) 8.000 -20.00%
444.namd (max) (percentage) 0.920 -16.36%
444.namd (unexplained diff vs previous) 7.000 -30.00%
444.namd (unexplained diff vs previous) (percentage) 0.770 -29.36%
445.gobmk 45.000 -
445.gobmk (avg) 45.000 -
445.gobmk (avg) (percentage) 0.900 -
445.gobmk (max) 39.000 -7.14%
445.gobmk (max) (percentage) 0.780 -6.02%
447.dealII 26.000 -
447.dealII (avg) 26.000 -
447.dealII (avg) (percentage) 1.390 -
447.dealII (max) 6.000 -14.29%
447.dealII (max) (percentage) 0.350 -10.26%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.560 -
450.soplex (max) 11.000 -8.33%
450.soplex (max) (percentage) 1.880 -8.74%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.430 -
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.590 -4.79%
454.calculix (avg) (percentage) 3.440 -
454.calculix (max) (percentage) 3.460 -
456.hmmer 22.000 -4.35%
456.hmmer (avg) 22.000 -4.35%
456.hmmer (avg) (percentage) 0.540 -
456.hmmer (max) 13.000 -13.33%
456.hmmer (max) (percentage) 0.330 -5.71%
458.sjeng 49.000 -
458.sjeng (avg) 49.000 -
458.sjeng (avg) (percentage) 0.650 -
458.sjeng (max) 16.000 -
458.sjeng (max) (percentage) 0.220 -
459.GemsFDTD 83.000 -1.19%
459.GemsFDTD (avg) 83.000 -1.19%
459.GemsFDTD (avg) (percentage) 1.180 -
459.GemsFDTD (max) 55.000 -14.06%
459.GemsFDTD (max) (percentage) 0.780 -14.29%
459.GemsFDTD (unexplained diff vs previous) 19.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.270 -
462.libquantum 3.000 50.00%
462.libquantum (avg) 3.000 50.00%
462.libquantum (avg) (percentage) 1.400 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.720 -
464.h264ref 45.000 -
464.h264ref (avg) 45.000 -
464.h264ref (avg) (percentage) 0.740 -
464.h264ref (max) 26.000 -7.14%
464.h264ref (max) (percentage) 0.430 -6.52%
465.tonto 103.000 -
465.tonto (avg) 103.000 -
465.tonto (avg) (percentage) 0.810 -
465.tonto (max) 117.000 -2.50%
465.tonto (max) (percentage) 0.920 -3.16%
470.lbm 39.000 -
470.lbm (avg) 39.000 -
470.lbm (avg) (percentage) 1.080 -
470.lbm (max) 16.000 6.67%
470.lbm (max) (percentage) 0.460 12.20%
470.lbm (unexplained diff vs previous) 17.000 13.33%
470.lbm (unexplained diff vs previous) (percentage) 0.460 12.20%
471.omnetpp 49.000 2.08%
471.omnetpp (avg) 49.000 2.08%
471.omnetpp (avg) (percentage) 1.790 -
471.omnetpp (max) 50.000 -15.25%
471.omnetpp (max) (percentage) 1.830 -16.82%
471.omnetpp (unexplained diff vs previous) 25.000 -59.02%
471.omnetpp (unexplained diff vs previous) (percentage) 0.910 -59.38%
473.astar 71.000 1.43%
473.astar (avg) 71.000 1.43%
473.astar (avg) (percentage) 1.460 -
473.astar (max) 64.000 -15.79%
473.astar (max) (percentage) 1.320 -16.98%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 0.260 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.590 -
482.sphinx3 (max) 7.000 -
482.sphinx3 (max) (percentage) 0.810 -4.71%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.510 -
Geometric Mean 5.929 -2.64%