Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=047fa8cc1cc534f19428b18d3d0c50e8139d3335 (+ 648 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/2c3db94d9fd07681f8806dae93d555779ff4dfb1 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=77c6a2717de1b6a78e79538b2074579ed77839ed (+ 187 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=138574c99c479ecabd4ad4cbdac9db35ea048d4c (+ 18849 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/177/
View Options
Report
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0177 (3-changed-components) 2024-01-02T18:59:54 0:00:00
Previous 0168 (basepoints/gcc-14-06032-g2c3db94d9fd0) 2023-12-13T00:36:50 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 127 23
Performance Improvements 52 11
Added Tests 0 139
Unchanged Tests 1033 1039
Total Tests 1212

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 18.50% 8195.000 9711.000 - 8.76% -
450.soplex 9.44% 498.000 545.000 - 2.44% -
403.gcc 7.55% 53.000 57.000 - 0.00% -
462.libquantum 6.67% 75.000 80.000 - -1.23% -
400.perlbench 5.89% 1393.000 1475.000 - 3.51% -
435.gromacs 4.73% 5074.000 5314.000 - 1.30% -
473.astar 4.65% 4929.000 5158.000 - 4.39% -
471.omnetpp 4.55% 2483.000 2596.000 - -2.77% -
465.tonto 4.50% 8572.000 8958.000 - -1.44% -
481.wrf 3.94% 3981.000 4138.000 - 0.34% -
482.sphinx3 3.56% 758.000 785.000 - 0.26% -
470.lbm 3.19% 3262.000 3366.000 - 0.36% -
401.bzip2 3.12% 2662.000 2745.000 - -1.05% -
410.bwaves 2.63% 4226.000 4337.000 - -0.09% -
459.GemsFDTD 2.47% 4088.000 4189.000 - -0.73% -
445.gobmk 2.22% 4731.000 4836.000 - -1.49% -
433.milc 2.19% 1096.000 1120.000 - -0.80% -
464.h264ref 1.81% 4189.000 4265.000 - -0.16% -
447.dealII 1.74% 1383.000 1407.000 - -1.33% -
434.zeusmp 1.73% 1965.000 1999.000 - 0.40% -
458.sjeng 1.08% 6389.000 6458.000 - -1.39% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) 500.00% 4.000 24.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 489.66% 0.290 1.710 - 0.00% -
437.leslie3d (max) 238.23% 531.000 1796.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 205.65% 496.000 1516.000 - 0.00% -
437.leslie3d (max) (percentage) 185.05% 6.490 18.500 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 158.02% 6.050 15.610 - 0.00% -
447.dealII (max) 140.00% 10.000 24.000 - 0.00% -
447.dealII (max) (percentage) 120.25% 0.790 1.740 - 0.00% -
403.gcc (max) 100.00% 2.000 4.000 - 0.00% -
450.soplex (max) 96.15% 26.000 51.000 - 0.00% -
450.soplex (max) (percentage) 77.44% 5.320 9.440 - 0.00% -
410.bwaves (max) 72.73% 66.000 114.000 - 0.00% -
450.soplex (unexplained diff vs previous) 67.86% 28.000 47.000 - 0.00% -
462.libquantum (max) 66.67% 3.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 66.67% 3.000 5.000 - 0.00% -
410.bwaves (max) (percentage) 66.46% 1.580 2.630 - 0.00% -
410.bwaves (unexplained diff vs previous) 63.24% 68.000 111.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 59.01% 1.610 2.560 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 56.25% 4.000 6.250 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 53.38% 5.620 8.620 - 0.00% -
403.gcc (max) (percentage) 40.86% 5.360 7.550 - 0.00% -
437.leslie3d 39.16% 332.000 462.000 - 0.00% -
437.leslie3d (avg) 39.16% 332.000 462.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 36.86% 22.680 31.040 - 0.00% -
403.gcc (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
462.libquantum (max) (percentage) 29.77% 5.140 6.670 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 24.03% 5.660 7.020 - 0.00% -
465.tonto 22.94% 109.000 134.000 - 0.00% -
465.tonto (avg) 22.94% 109.000 134.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
450.soplex 18.18% 11.000 13.000 - 0.00% -
450.soplex (avg) 18.18% 11.000 13.000 - 0.00% -
437.leslie3d (avg) (percentage) 17.24% 4.060 4.760 - 0.00% -
465.tonto (avg) (percentage) 17.19% 1.280 1.500 - 0.00% -
470.lbm (max) 16.30% 92.000 107.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 15.79% 0.190 0.220 - 0.00% -
473.astar 13.04% 69.000 78.000 - 0.00% -
473.astar (avg) 13.04% 69.000 78.000 - 0.00% -
410.bwaves 12.90% 31.000 35.000 - 0.00% -
410.bwaves (avg) 12.90% 31.000 35.000 - 0.00% -
470.lbm (max) (percentage) 12.72% 2.830 3.190 - 0.00% -
410.bwaves (avg) (percentage) 12.16% 0.740 0.830 - 0.00% -
450.soplex (avg) (percentage) 12.11% 2.230 2.500 - 0.00% -
470.lbm 12.00% 25.000 28.000 - 0.00% -
470.lbm (avg) 12.00% 25.000 28.000 - 0.00% -
465.tonto (max) 11.63% 361.000 403.000 - 0.00% -
433.milc 11.11% 9.000 10.000 - 0.00% -
433.milc (avg) 11.11% 9.000 10.000 - 0.00% -
445.gobmk 10.00% 40.000 44.000 - 0.00% -
445.gobmk (avg) 10.00% 40.000 44.000 - 0.00% -
482.sphinx3 10.00% 10.000 11.000 - 0.00% -
482.sphinx3 (avg) 10.00% 10.000 11.000 - 0.00% -
435.gromacs 9.84% 122.000 134.000 - 0.00% -
435.gromacs (avg) 9.84% 122.000 134.000 - 0.00% -
471.omnetpp 9.80% 51.000 56.000 - 0.00% -
471.omnetpp (avg) 9.80% 51.000 56.000 - 0.00% -
434.zeusmp (max) 9.68% 31.000 34.000 - 0.00% -
470.lbm (unexplained diff vs previous) 9.47% 95.000 104.000 - 0.00% -
470.lbm (avg) (percentage) 8.97% 0.780 0.850 - 0.00% -
464.h264ref (avg) (percentage) 8.62% 0.580 0.630 - 0.00% -
462.libquantum (avg) (percentage) 8.51% 1.880 2.040 - 0.00% -
464.h264ref 8.33% 24.000 26.000 - 0.00% -
464.h264ref (avg) 8.33% 24.000 26.000 - 0.00% -
434.zeusmp (max) (percentage) 8.12% 1.600 1.730 - 0.00% -
473.astar (avg) (percentage) 7.80% 1.410 1.520 - 0.00% -
447.dealII 7.69% 13.000 14.000 - 0.00% -
447.dealII (avg) 7.69% 13.000 14.000 - 0.00% -
429.mcf (avg) (percentage) 7.53% 6.770 7.280 - 0.00% -
445.gobmk (avg) (percentage) 6.98% 0.860 0.920 - 0.00% -
400.perlbench 6.67% 30.000 32.000 - 0.00% -
400.perlbench (avg) 6.67% 30.000 32.000 - 0.00% -
465.tonto (max) (percentage) 6.64% 4.220 4.500 - 0.00% -
434.zeusmp 6.25% 16.000 17.000 - 0.00% -
434.zeusmp (avg) 6.25% 16.000 17.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 6.25% 32.000 34.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 6.19% 2.910 3.090 - 0.00% -
401.bzip2 6.12% 49.000 52.000 - 0.00% -
401.bzip2 (avg) 6.12% 49.000 52.000 - 0.00% -
459.GemsFDTD 5.88% 51.000 54.000 - 0.00% -
459.GemsFDTD (avg) 5.88% 51.000 54.000 - 0.00% -
458.sjeng 5.56% 36.000 38.000 - 0.00% -
458.sjeng (avg) 5.56% 36.000 38.000 - 0.00% -
435.gromacs (avg) (percentage) 5.39% 2.410 2.540 - 0.00% -
481.wrf 5.17% 58.000 61.000 - 0.00% -
481.wrf (avg) 5.17% 58.000 61.000 - 0.00% -
482.sphinx3 (avg) (percentage) 5.11% 1.370 1.440 - 0.00% -
459.GemsFDTD (avg) (percentage) 4.80% 1.250 1.310 - 0.00% -
434.zeusmp (avg) (percentage) 4.71% 0.850 0.890 - 0.00% -
429.mcf (unexplained diff vs previous) 4.45% 427.000 446.000 - 0.00% -
433.milc (avg) (percentage) 4.40% 0.910 0.950 - 0.00% -
433.milc (max) 4.35% 23.000 24.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 4.29% 1.630 1.700 - 0.00% -
447.dealII (avg) (percentage) 4.12% 0.970 1.010 - 0.00% -
403.gcc (avg) (percentage) 4.11% 4.380 4.560 - 0.00% -
445.gobmk (max) 3.88% 103.000 107.000 - 0.00% -
458.sjeng (avg) (percentage) 3.51% 0.570 0.590 - 0.00% -
471.omnetpp (avg) (percentage) 3.35% 2.090 2.160 - 0.00% -
436.cactusADM (avg) (percentage) 2.91% 1.030 1.060 - 0.00% -
464.h264ref (max) 2.67% 75.000 77.000 - 0.00% -
481.wrf (max) 2.44% 82.000 84.000 - 0.00% -
433.milc (max) (percentage) 2.34% 2.140 2.190 - 0.00% -
401.bzip2 (avg) (percentage) 2.15% 1.860 1.900 - 0.00% -
465.tonto (unexplained diff vs previous) 2.12% 378.000 386.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 1.73% 1.730 1.760 - 0.00% -
435.gromacs (max) 1.62% 247.000 251.000 - 0.00% -
445.gobmk (max) (percentage) 1.37% 2.190 2.220 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -23.69% 1883.000 1437.000 - -2.04% -
436.cactusADM -1.73% 1852.000 1820.000 - -0.22% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) -62.50% 8.000 3.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -62.37% 1.860 0.700 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -57.52% 1.130 0.480 - 0.00% -
444.namd (unexplained diff vs previous) -57.14% 7.000 3.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -43.02% 5.300 3.020 - 0.00% -
401.bzip2 (unexplained diff vs previous) -41.13% 141.000 83.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -33.54% 1.610 1.070 - 0.00% -
429.mcf (max) -33.33% 552.000 368.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -33.01% 103.000 69.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -23.00% 3.130 2.410 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -21.09% 128.000 101.000 - 0.00% -
429.mcf -18.11% 127.000 104.000 - 0.00% -
429.mcf (avg) -18.11% 127.000 104.000 - 0.00% -
400.perlbench (max) (percentage) -16.73% 2.450 2.040 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -15.75% 5.270 4.440 - 0.00% -
458.sjeng (max) (percentage) -12.58% 1.590 1.390 - 0.00% -
429.mcf (max) (percentage) -12.51% 29.330 25.660 - 0.00% -
444.namd (max) -12.50% 8.000 7.000 - 0.00% -
453.povray (max) -12.50% 8.000 7.000 - 0.00% -
473.astar (unexplained diff vs previous) -11.92% 260.000 229.000 - 0.00% -
458.sjeng (max) -11.88% 101.000 89.000 - 0.00% -
400.perlbench (max) -11.76% 34.000 30.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -11.72% 5.120 4.520 - 0.00% -
453.povray (max) (percentage) -11.34% 1.940 1.720 - 0.00% -
444.namd (max) (percentage) -10.29% 1.360 1.220 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -10.18% 3.830 3.440 - 0.00% -
435.gromacs (unexplained diff vs previous) -7.69% 260.000 240.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -6.90% 29.000 27.000 - 0.00% -
473.astar (max) (percentage) -6.65% 5.110 4.770 - 0.00% -
482.sphinx3 (max) (percentage) -5.77% 3.810 3.590 - 0.00% -
401.bzip2 (max) (percentage) -5.73% 5.580 5.260 - 0.00% -
471.omnetpp (max) (percentage) -5.21% 4.800 4.550 - 0.00% -
456.hmmer (max) (percentage) -4.50% 1.110 1.060 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -3.55% 4.510 4.350 - 0.00% -
456.hmmer (max) -3.45% 29.000 28.000 - 0.00% -
459.GemsFDTD (max) (percentage) -3.28% 4.270 4.130 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -3.26% 1.840 1.780 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -3.13% 2.240 2.170 - 0.00% -
436.cactusADM (max) -3.12% 32.000 31.000 - 0.00% -
435.gromacs (max) (percentage) -2.87% 4.870 4.730 - 0.00% -
401.bzip2 (max) -2.70% 148.000 144.000 - 0.00% -
453.povray (avg) (percentage) -2.53% 1.580 1.540 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -2.28% 2.190 2.140 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -2.27% 4.410 4.310 - 0.00% -
473.astar (max) -1.99% 251.000 246.000 - 0.00% -
436.cactusADM (max) (percentage) -1.70% 1.760 1.730 - 0.00% -
416.gamess (max) (percentage) -1.54% 0.650 0.640 - 0.00% -
416.gamess (max) -1.45% 69.000 68.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -1.30% 77.000 76.000 - 0.00% -
454.calculix (max) (percentage) -1.02% 2.950 2.920 - 0.00% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 5.48% 21532.000 22712.000 - 0.00% -
481.wrf 3.75% 4016025.000 4166516.000 - 0.00% -
447.dealII 3.19% 2802286.000 2891817.000 - 0.00% -
459.GemsFDTD 3.15% 295414.000 304718.000 - 0.00% -
456.hmmer 2.09% 270823.000 276471.000 - 0.00% -
400.perlbench 1.76% 1087835.000 1107020.000 - -0.00% -
436.cactusADM 1.73% 652261.000 663565.000 - 0.00% -
429.mcf 1.49% 12072.000 12252.000 - 0.00% -
416.gamess 1.32% 7063623.000 7156920.000 - 0.01% -
465.tonto 1.31% 3263584.000 3306331.000 - 0.00% -
444.namd 1.27% 226710.000 229582.000 - 0.00% -
464.h264ref 1.20% 472362.000 478042.000 - 0.00% -
482.sphinx3 1.15% 175488.000 177512.000 - 0.00% -
434.zeusmp 1.09% 203703.000 205919.000 - 0.00% -
470.lbm 1.03% 11601.000 11721.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 8.76% 8929.000 9711.000 - 18.50% -
473.astar 4.39% 4941.000 5158.000 - 4.65% -
400.perlbench 3.51% 1425.000 1475.000 - 5.89% -
450.soplex 2.44% 532.000 545.000 - 9.44% -
416.gamess 2.22% 10494.000 10727.000 - 0.06% -
435.gromacs 1.30% 5246.000 5314.000 - 4.73% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -6.90% 29.000 27.000 - 0.00% -
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.25% 37101.000 36265.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -2.77% 2670.000 2596.000 - 4.55% -
444.namd -2.36% 636.000 621.000 - 0.49% -
429.mcf -2.04% 1467.000 1437.000 - -23.69% -
445.gobmk -1.49% 4909.000 4836.000 - 2.22% -
465.tonto -1.44% 9089.000 8958.000 - 4.50% -
458.sjeng -1.39% 6549.000 6458.000 - 1.08% -
447.dealII -1.33% 1426.000 1407.000 - 1.74% -
462.libquantum -1.23% 81.000 80.000 - 6.67% -
401.bzip2 -1.05% 2774.000 2745.000 - 3.12% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 6.90% 29.000 31.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1475.000 5.89%
401.bzip2 2745.000 3.12%
403.gcc 57.000 7.55%
410.bwaves 4337.000 2.63%
416.gamess 10727.000 -
429.mcf 1437.000 -23.69%
433.milc 1120.000 2.19%
434.zeusmp 1999.000 1.73%
435.gromacs 5314.000 4.73%
436.cactusADM 1820.000 -1.73%
437.leslie3d 9711.000 18.50%
444.namd 621.000 -
445.gobmk 4836.000 2.22%
447.dealII 1407.000 1.74%
450.soplex 545.000 9.44%
453.povray 426.000 -
456.hmmer 2674.000 -
458.sjeng 6458.000 1.08%
459.GemsFDTD 4189.000 2.47%
462.libquantum 80.000 6.67%
464.h264ref 4265.000 1.81%
465.tonto 8958.000 4.50%
470.lbm 3366.000 3.19%
471.omnetpp 2596.000 4.55%
473.astar 5158.000 4.65%
481.wrf 4138.000 3.94%
482.sphinx3 785.000 3.56%
Geometric Mean 1980.505 2.40%
Code Size (bytes)
Name Current %
400.perlbench 1107020.000 -
401.bzip2 59225.000 -
403.gcc 3179212.000 -
410.bwaves 22712.000 -
416.gamess 7156920.000 -
429.mcf 12252.000 -
433.milc 112703.000 -
434.zeusmp 205919.000 -
435.gromacs 793838.000 -
436.cactusADM 663565.000 -
437.leslie3d 79506.000 -
444.namd 229582.000 -
445.gobmk 1553991.000 -
447.dealII 2891817.000 -
450.soplex 350435.000 -
453.povray 835055.000 -
456.hmmer 276471.000 -
458.sjeng 130631.000 -
459.GemsFDTD 304718.000 -
462.libquantum 38392.000 -
464.h264ref 478042.000 -
465.tonto 3306331.000 -
470.lbm 11721.000 -
471.omnetpp 634607.000 -
473.astar 36265.000 -
481.wrf 4166516.000 -
482.sphinx3 177512.000 -
Geometric Mean 308510.811 -
sample variability
Name Current %
400.perlbench 32.000 6.67%
400.perlbench (avg) 32.000 6.67%
400.perlbench (avg) (percentage) 2.200 -
400.perlbench (max) 30.000 -11.76%
400.perlbench (max) (percentage) 2.040 -16.73%
401.bzip2 52.000 6.12%
401.bzip2 (avg) 52.000 6.12%
401.bzip2 (avg) (percentage) 1.900 2.15%
401.bzip2 (max) 144.000 -2.70%
401.bzip2 (max) (percentage) 5.260 -5.73%
401.bzip2 (unexplained diff vs previous) 83.000 -41.13%
401.bzip2 (unexplained diff vs previous) (percentage) 3.020 -43.02%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.560 4.11%
403.gcc (max) 4.000 100.00%
403.gcc (max) (percentage) 7.550 40.86%
403.gcc (unexplained diff vs previous) 4.000 33.33%
403.gcc (unexplained diff vs previous) (percentage) 7.020 24.03%
410.bwaves 35.000 12.90%
410.bwaves (avg) 35.000 12.90%
410.bwaves (avg) (percentage) 0.830 12.16%
410.bwaves (max) 114.000 72.73%
410.bwaves (max) (percentage) 2.630 66.46%
410.bwaves (unexplained diff vs previous) 111.000 63.24%
410.bwaves (unexplained diff vs previous) (percentage) 2.560 59.01%
416.gamess 31.000 -
416.gamess (avg) 31.000 -
416.gamess (avg) (percentage) 0.290 -
416.gamess (max) 68.000 -1.45%
416.gamess (max) (percentage) 0.640 -1.54%
429.mcf 104.000 -18.11%
429.mcf (avg) 104.000 -18.11%
429.mcf (avg) (percentage) 7.280 7.53%
429.mcf (max) 368.000 -33.33%
429.mcf (max) (percentage) 25.660 -12.51%
429.mcf (unexplained diff vs previous) 446.000 4.45%
429.mcf (unexplained diff vs previous) (percentage) 31.040 36.86%
433.milc 10.000 11.11%
433.milc (avg) 10.000 11.11%
433.milc (avg) (percentage) 0.950 4.40%
433.milc (max) 24.000 4.35%
433.milc (max) (percentage) 2.190 2.34%
433.milc (unexplained diff vs previous) 24.000 -
433.milc (unexplained diff vs previous) (percentage) 2.140 -2.28%
434.zeusmp 17.000 6.25%
434.zeusmp (avg) 17.000 6.25%
434.zeusmp (avg) (percentage) 0.890 4.71%
434.zeusmp (max) 34.000 9.68%
434.zeusmp (max) (percentage) 1.730 8.12%
434.zeusmp (unexplained diff vs previous) 34.000 6.25%
434.zeusmp (unexplained diff vs previous) (percentage) 1.700 4.29%
435.gromacs 134.000 9.84%
435.gromacs (avg) 134.000 9.84%
435.gromacs (avg) (percentage) 2.540 5.39%
435.gromacs (max) 251.000 1.62%
435.gromacs (max) (percentage) 4.730 -2.87%
435.gromacs (unexplained diff vs previous) 240.000 -7.69%
435.gromacs (unexplained diff vs previous) (percentage) 4.520 -11.72%
436.cactusADM 19.000 -
436.cactusADM (avg) 19.000 -
436.cactusADM (avg) (percentage) 1.060 2.91%
436.cactusADM (max) 31.000 -3.12%
436.cactusADM (max) (percentage) 1.730 -1.70%
436.cactusADM (unexplained diff vs previous) 32.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 1.760 1.73%
437.leslie3d 462.000 39.16%
437.leslie3d (avg) 462.000 39.16%
437.leslie3d (avg) (percentage) 4.760 17.24%
437.leslie3d (max) 1796.000 238.23%
437.leslie3d (max) (percentage) 18.500 185.05%
437.leslie3d (unexplained diff vs previous) 1516.000 205.65%
437.leslie3d (unexplained diff vs previous) (percentage) 15.610 158.02%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.810 -
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 1.220 -10.29%
444.namd (unexplained diff vs previous) 3.000 -57.14%
444.namd (unexplained diff vs previous) (percentage) 0.480 -57.52%
445.gobmk 44.000 10.00%
445.gobmk (avg) 44.000 10.00%
445.gobmk (avg) (percentage) 0.920 6.98%
445.gobmk (max) 107.000 3.88%
445.gobmk (max) (percentage) 2.220 1.37%
445.gobmk (unexplained diff vs previous) 105.000 -
445.gobmk (unexplained diff vs previous) (percentage) 2.170 -3.13%
447.dealII 14.000 7.69%
447.dealII (avg) 14.000 7.69%
447.dealII (avg) (percentage) 1.010 4.12%
447.dealII (max) 24.000 140.00%
447.dealII (max) (percentage) 1.740 120.25%
447.dealII (unexplained diff vs previous) 24.000 500.00%
447.dealII (unexplained diff vs previous) (percentage) 1.710 489.66%
450.soplex 13.000 18.18%
450.soplex (avg) 13.000 18.18%
450.soplex (avg) (percentage) 2.500 12.11%
450.soplex (max) 51.000 96.15%
450.soplex (max) (percentage) 9.440 77.44%
450.soplex (unexplained diff vs previous) 47.000 67.86%
450.soplex (unexplained diff vs previous) (percentage) 8.620 53.38%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.540 -2.53%
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.720 -11.34%
453.povray (unexplained diff vs previous) 3.000 -62.50%
453.povray (unexplained diff vs previous) (percentage) 0.700 -62.37%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.920 -1.02%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 28.000 -3.45%
456.hmmer (max) (percentage) 1.060 -4.50%
456.hmmer (unexplained diff vs previous) 6.000 20.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.220 15.79%
458.sjeng 38.000 5.56%
458.sjeng (avg) 38.000 5.56%
458.sjeng (avg) (percentage) 0.590 3.51%
458.sjeng (max) 89.000 -11.88%
458.sjeng (max) (percentage) 1.390 -12.58%
458.sjeng (unexplained diff vs previous) 69.000 -33.01%
458.sjeng (unexplained diff vs previous) (percentage) 1.070 -33.54%
459.GemsFDTD 54.000 5.88%
459.GemsFDTD (avg) 54.000 5.88%
459.GemsFDTD (avg) (percentage) 1.310 4.80%
459.GemsFDTD (max) 173.000 -
459.GemsFDTD (max) (percentage) 4.130 -3.28%
459.GemsFDTD (unexplained diff vs previous) 101.000 -21.09%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.410 -23.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.040 8.51%
462.libquantum (max) 5.000 66.67%
462.libquantum (max) (percentage) 6.670 29.77%
462.libquantum (unexplained diff vs previous) 5.000 66.67%
462.libquantum (unexplained diff vs previous) (percentage) 6.250 56.25%
464.h264ref 26.000 8.33%
464.h264ref (avg) 26.000 8.33%
464.h264ref (avg) (percentage) 0.630 8.62%
464.h264ref (max) 77.000 2.67%
464.h264ref (max) (percentage) 1.810 -
464.h264ref (unexplained diff vs previous) 76.000 -1.30%
464.h264ref (unexplained diff vs previous) (percentage) 1.780 -3.26%
465.tonto 134.000 22.94%
465.tonto (avg) 134.000 22.94%
465.tonto (avg) (percentage) 1.500 17.19%
465.tonto (max) 403.000 11.63%
465.tonto (max) (percentage) 4.500 6.64%
465.tonto (unexplained diff vs previous) 386.000 2.12%
465.tonto (unexplained diff vs previous) (percentage) 4.310 -2.27%
470.lbm 28.000 12.00%
470.lbm (avg) 28.000 12.00%
470.lbm (avg) (percentage) 0.850 8.97%
470.lbm (max) 107.000 16.30%
470.lbm (max) (percentage) 3.190 12.72%
470.lbm (unexplained diff vs previous) 104.000 9.47%
470.lbm (unexplained diff vs previous) (percentage) 3.090 6.19%
471.omnetpp 56.000 9.80%
471.omnetpp (avg) 56.000 9.80%
471.omnetpp (avg) (percentage) 2.160 3.35%
471.omnetpp (max) 118.000 -
471.omnetpp (max) (percentage) 4.550 -5.21%
471.omnetpp (unexplained diff vs previous) 113.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 4.350 -3.55%
473.astar 78.000 13.04%
473.astar (avg) 78.000 13.04%
473.astar (avg) (percentage) 1.520 7.80%
473.astar (max) 246.000 -1.99%
473.astar (max) (percentage) 4.770 -6.65%
473.astar (unexplained diff vs previous) 229.000 -11.92%
473.astar (unexplained diff vs previous) (percentage) 4.440 -15.75%
481.wrf 61.000 5.17%
481.wrf (avg) 61.000 5.17%
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) 84.000 2.44%
481.wrf (max) (percentage) 2.040 -
482.sphinx3 11.000 10.00%
482.sphinx3 (avg) 11.000 10.00%
482.sphinx3 (avg) (percentage) 1.440 5.11%
482.sphinx3 (max) 28.000 -
482.sphinx3 (max) (percentage) 3.590 -5.77%
482.sphinx3 (unexplained diff vs previous) 27.000 -6.90%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.440 -10.18%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.650 -
Geometric Mean 10.935 8.27%