Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=172dc8923748b76120cf054d5f01b3230859f7b4 (+ 106 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=491e55beab7457ed310a4a47496f4a333c5d1032 (+ 27 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=86ad7187b3f1d3ab7b15a466d9a89d0e6880495f (+ 704 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/124/
View Options
Report
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0124 (3-changed-components) 2024-02-03T10:05:51 0:00:00
Previous 0121 (3-changed-components) 2024-01-23T08:12:07 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 33 24
Performance Improvements 121 9
Added Tests 4 140
Unchanged Tests 1042 1027
Total Tests 1200

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 6000.00% 1.000 61.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 5525.00% 0.040 2.250 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 3100.00% 1.000 32.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3000.00% 0.020 0.620 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 687.50% 0.080 0.630 - 0.00% -
434.zeusmp (unexplained diff vs previous) 650.00% 2.000 15.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 575.00% 0.040 0.270 - 0.00% -
458.sjeng (unexplained diff vs previous) 566.67% 3.000 20.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 450.00% 2.000 11.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 433.33% 0.060 0.320 - 0.00% -
433.milc (max) 250.00% 2.000 7.000 - 0.00% -
433.milc (max) (percentage) 250.00% 0.180 0.630 - 0.00% -
433.milc (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 250.00% 0.180 0.630 - 0.00% -
453.povray (unexplained diff vs previous) 200.00% 1.000 3.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 195.65% 0.230 0.680 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 190.91% 0.110 0.320 - 0.00% -
416.gamess (unexplained diff vs previous) 187.50% 16.000 46.000 - 0.00% -
473.astar (unexplained diff vs previous) 141.67% 12.000 29.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 141.67% 0.240 0.580 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 121.05% 0.380 0.840 - 0.00% -
465.tonto (unexplained diff vs previous) 115.79% 38.000 82.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 45.74% 0.940 1.370 - 0.00% -
435.gromacs (unexplained diff vs previous) 44.44% 54.000 78.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 39.02% 0.410 0.570 - 0.00% -
401.bzip2 (max) (percentage) 38.36% 1.590 2.200 - 0.00% -
410.bwaves (unexplained diff vs previous) 38.10% 21.000 29.000 - 0.00% -
401.bzip2 (max) 34.09% 44.000 59.000 - 0.00% -
416.gamess (max) (percentage) 14.29% 0.280 0.320 - 0.00% -
416.gamess (max) 12.50% 40.000 45.000 - 0.00% -
416.gamess 6.45% 31.000 33.000 - 0.00% -
416.gamess (avg) 6.45% 31.000 33.000 - 0.00% -
416.gamess (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -7.02% 57.000 53.000 - 0.00% -
401.bzip2 -2.20% 2776.000 2715.000 - 3.74% -
435.gromacs -1.36% 5754.000 5676.000 - 4.59% -
437.leslie3d -1.21% 10156.000 10033.000 - 1.74% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -87.61% 993.000 123.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -87.42% 9.780 1.230 - 0.00% -
471.omnetpp (unexplained diff vs previous) -84.78% 46.000 7.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -84.66% 1.890 0.290 - 0.00% -
400.perlbench (unexplained diff vs previous) -75.00% 12.000 3.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -74.68% 0.790 0.200 - 0.00% -
450.soplex (unexplained diff vs previous) -64.29% 14.000 5.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -63.81% 2.570 0.930 - 0.00% -
445.gobmk (max) -61.36% 44.000 17.000 - 0.00% -
445.gobmk (max) (percentage) -60.00% 0.900 0.360 - 0.00% -
400.perlbench (max) -58.33% 24.000 10.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -58.33% 24.000 10.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -58.33% 0.480 0.200 - 0.00% -
400.perlbench (max) (percentage) -57.41% 1.620 0.690 - 0.00% -
462.libquantum (max) -50.00% 2.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -50.00% 20.000 10.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -50.00% 0.520 0.260 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -43.48% 0.920 0.520 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -43.33% 0.300 0.170 - 0.00% -
436.cactusADM (unexplained diff vs previous) -42.86% 7.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) -42.86% 7.000 4.000 - 0.00% -
429.mcf (max) -40.00% 5.000 3.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -32.56% 0.430 0.290 - 0.00% -
464.h264ref (unexplained diff vs previous) -32.00% 25.000 17.000 - 0.00% -
429.mcf (max) (percentage) -30.51% 0.590 0.410 - 0.00% -
450.soplex (max) -28.57% 14.000 10.000 - 0.00% -
464.h264ref (max) -28.00% 25.000 18.000 - 0.00% -
437.leslie3d (max) -25.88% 904.000 670.000 - 0.00% -
464.h264ref (max) (percentage) -25.58% 0.430 0.320 - 0.00% -
437.leslie3d (max) (percentage) -25.03% 8.910 6.680 - 0.00% -
450.soplex (max) (percentage) -25.00% 2.640 1.980 - 0.00% -
453.povray -25.00% 4.000 3.000 - 0.00% -
453.povray (avg) -25.00% 4.000 3.000 - 0.00% -
470.lbm (max) -20.00% 20.000 16.000 - 0.00% -
470.lbm (max) (percentage) -17.31% 0.520 0.430 - 0.00% -
435.gromacs (max) -12.50% 112.000 98.000 - 0.00% -
456.hmmer -12.50% 8.000 7.000 - 0.00% -
456.hmmer (avg) -12.50% 8.000 7.000 - 0.00% -
444.namd (max) (percentage) -12.09% 0.910 0.800 - 0.00% -
435.gromacs (max) (percentage) -11.22% 1.960 1.740 - 0.00% -
459.GemsFDTD (max) (percentage) -10.34% 0.870 0.780 - 0.00% -
403.gcc (max) -10.00% 10.000 9.000 - 0.00% -
436.cactusADM (max) -10.00% 30.000 27.000 - 0.00% -
434.zeusmp (max) (percentage) -9.89% 0.910 0.820 - 0.00% -
471.omnetpp (max) (percentage) -9.84% 1.930 1.740 - 0.00% -
434.zeusmp (max) -9.52% 21.000 19.000 - 0.00% -
459.GemsFDTD (max) -9.09% 44.000 40.000 - 0.00% -
471.omnetpp (max) -8.70% 46.000 42.000 - 0.00% -
436.cactusADM (max) (percentage) -8.59% 1.280 1.170 - 0.00% -
482.sphinx3 (max) (percentage) -7.84% 1.020 0.940 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
453.povray (max) (percentage) -6.93% 1.010 0.940 - 0.00% -
473.astar (max) (percentage) -6.85% 0.730 0.680 - 0.00% -
436.cactusADM -6.67% 15.000 14.000 - 0.00% -
436.cactusADM (avg) -6.67% 15.000 14.000 - 0.00% -
447.dealII (max) (percentage) -6.56% 1.220 1.140 - 0.00% -
462.libquantum (max) (percentage) -6.37% 2.040 1.910 - 0.00% -
400.perlbench (avg) (percentage) -5.74% 1.220 1.150 - 0.00% -
437.leslie3d -5.73% 524.000 494.000 - 0.00% -
437.leslie3d (avg) -5.73% 524.000 494.000 - 0.00% -
400.perlbench -5.56% 18.000 17.000 - 0.00% -
400.perlbench (avg) -5.56% 18.000 17.000 - 0.00% -
473.astar (max) -5.56% 36.000 34.000 - 0.00% -
462.libquantum (avg) (percentage) -5.49% 1.640 1.550 - 0.00% -
429.mcf (avg) (percentage) -5.24% 6.870 6.510 - 0.00% -
410.bwaves (max) -5.13% 78.000 74.000 - 0.00% -
445.gobmk -5.00% 40.000 38.000 - 0.00% -
445.gobmk (avg) -5.00% 40.000 38.000 - 0.00% -
447.dealII (max) -5.00% 20.000 19.000 - 0.00% -
473.astar -4.94% 81.000 77.000 - 0.00% -
473.astar (avg) -4.94% 81.000 77.000 - 0.00% -
445.gobmk (avg) (percentage) -4.88% 0.820 0.780 - 0.00% -
429.mcf -4.84% 62.000 59.000 - 0.00% -
429.mcf (avg) -4.84% 62.000 59.000 - 0.00% -
436.cactusADM (avg) (percentage) -4.69% 0.640 0.610 - 0.00% -
410.bwaves (max) (percentage) -4.61% 1.520 1.450 - 0.00% -
464.h264ref -4.55% 22.000 21.000 - 0.00% -
464.h264ref (avg) -4.55% 22.000 21.000 - 0.00% -
437.leslie3d (avg) (percentage) -4.46% 5.160 4.930 - 0.00% -
458.sjeng (max) (percentage) -4.17% 0.480 0.460 - 0.00% -
435.gromacs -4.11% 146.000 140.000 - 0.00% -
435.gromacs (avg) -4.11% 146.000 140.000 - 0.00% -
450.soplex (avg) (percentage) -4.08% 2.450 2.350 - 0.00% -
471.omnetpp (avg) (percentage) -3.98% 1.760 1.690 - 0.00% -
473.astar (avg) (percentage) -3.73% 1.610 1.550 - 0.00% -
410.bwaves -3.70% 54.000 52.000 - 0.00% -
410.bwaves (avg) -3.70% 54.000 52.000 - 0.00% -
470.lbm (avg) (percentage) -3.19% 0.940 0.910 - 0.00% -
401.bzip2 -2.99% 67.000 65.000 - 0.00% -
401.bzip2 (avg) -2.99% 67.000 65.000 - 0.00% -
456.hmmer (max) (percentage) -2.94% 0.340 0.330 - 0.00% -
458.sjeng (max) -2.86% 35.000 34.000 - 0.00% -
470.lbm -2.78% 36.000 35.000 - 0.00% -
470.lbm (avg) -2.78% 36.000 35.000 - 0.00% -
435.gromacs (avg) (percentage) -2.75% 2.550 2.480 - 0.00% -
482.sphinx3 (avg) (percentage) -2.70% 1.480 1.440 - 0.00% -
464.h264ref (avg) (percentage) -2.63% 0.380 0.370 - 0.00% -
433.milc (avg) (percentage) -2.42% 1.240 1.210 - 0.00% -
471.omnetpp -2.38% 42.000 41.000 - 0.00% -
471.omnetpp (avg) -2.38% 42.000 41.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.24% 1.340 1.310 - 0.00% -
453.povray (avg) (percentage) -2.17% 0.920 0.900 - 0.00% -
458.sjeng (avg) (percentage) -1.92% 0.520 0.510 - 0.00% -
410.bwaves (avg) (percentage) -1.90% 1.050 1.030 - 0.00% -
447.dealII (avg) (percentage) -1.75% 1.140 1.120 - 0.00% -
454.calculix (max) (percentage) -1.64% 4.270 4.200 - 0.00% -
403.gcc (max) (percentage) -1.58% 17.740 17.460 - 0.00% -
483.xalancbmk (max) (percentage) -1.50% 1.330 1.310 - 0.00% -
459.GemsFDTD -1.47% 68.000 67.000 - 0.00% -
459.GemsFDTD (avg) -1.47% 68.000 67.000 - 0.00% -
444.namd (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
481.wrf (max) (percentage) -1.23% 0.810 0.800 - 0.00% -
465.tonto (max) -1.22% 82.000 81.000 - 0.00% -
465.tonto (max) (percentage) -1.19% 0.840 0.830 - 0.00% -
434.zeusmp (avg) (percentage) -1.18% 0.850 0.840 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -1.08% 0.930 0.920 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.91% 23410.000 24559.000 - 0.00% -
459.GemsFDTD 3.30% 332309.000 343277.000 - 0.00% -
437.leslie3d 2.31% 82727.000 84635.000 - 0.00% -
444.namd 2.13% 223054.000 227802.000 - 0.00% -
465.tonto 1.52% 3107830.000 3155098.000 - 0.00% -
416.gamess 1.32% 7145862.000 7240451.000 - 0.00% -
447.dealII 1.02% 2447503.000 2472572.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 10.52% 1369.000 1513.000 - -0.20% -
473.astar 6.75% 4714.000 5032.000 - -0.57% -
458.sjeng 6.41% 7048.000 7500.000 - 0.27% -
450.soplex 4.66% 515.000 539.000 - -0.92% -
482.sphinx3 4.61% 737.000 771.000 - 0.78% -
435.gromacs 4.59% 5427.000 5676.000 - -1.36% -
401.bzip2 3.74% 2617.000 2715.000 - -2.20% -
471.omnetpp 3.57% 2351.000 2435.000 - 0.29% -
465.tonto 2.93% 9514.000 9793.000 - -0.83% -
416.gamess 2.34% 14025.000 14353.000 - 0.32% -
433.milc 2.10% 1096.000 1119.000 - 0.63% -
437.leslie3d 1.74% 9861.000 10033.000 - -1.21% -
459.GemsFDTD 1.71% 5078.000 5165.000 - 0.62% -
470.lbm 1.09% 3842.000 3884.000 - 0.26% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - 0.00% -
nb_execution_successful -10.34% 29.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.40% 31376.000 30624.000 - 0.00% -
453.povray -2.38% 768026.000 749779.000 - 0.00% -
403.gcc -1.51% 2862353.000 2819205.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -17.83% 1116.000 917.000 - 0.00% -
462.libquantum -9.91% 111.000 100.000 - 0.00% -
410.bwaves -2.48% 5252.000 5122.000 - -0.56% -
447.dealII -1.20% 1757.000 1736.000 - 0.93% -
453.povray -1.12% 447.000 442.000 - 0.68% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1513.000 -
401.bzip2 2715.000 -2.20%
403.gcc 53.000 -7.02%
410.bwaves 5122.000 -
416.gamess 14353.000 -
429.mcf 917.000 -
433.milc 1119.000 -
434.zeusmp 2393.000 -
435.gromacs 5676.000 -1.36%
436.cactusADM 2371.000 -
437.leslie3d 10033.000 -1.21%
444.namd 769.000 -
445.gobmk 4996.000 -
447.dealII 1736.000 -
450.soplex 539.000 -
453.povray 442.000 -
456.hmmer 3471.000 -
458.sjeng 7500.000 -
459.GemsFDTD 5165.000 -
462.libquantum 100.000 -
464.h264ref 5835.000 -
465.tonto 9793.000 -
470.lbm 3884.000 -
471.omnetpp 2435.000 -
473.astar 5032.000 -
482.sphinx3 771.000 -
Geometric Mean 2099.691 -
Code Size (bytes)
Name Current %
400.perlbench 986215.000 -
401.bzip2 52540.000 -
403.gcc 2819205.000 -
410.bwaves 24559.000 -
416.gamess 7240451.000 -
429.mcf 10363.000 -
433.milc 98558.000 -
434.zeusmp 234146.000 -
435.gromacs 741177.000 -
436.cactusADM 586571.000 -
437.leslie3d 84635.000 -
444.namd 227802.000 -
445.gobmk 1359853.000 -
447.dealII 2472572.000 -
450.soplex 298173.000 -
453.povray 749779.000 -
456.hmmer 234745.000 -
458.sjeng 126084.000 -
459.GemsFDTD 343277.000 -
462.libquantum 32383.000 -
464.h264ref 472436.000 -
465.tonto 3155098.000 -
470.lbm 11190.000 -
471.omnetpp 502098.000 -
473.astar 30624.000 -
482.sphinx3 153287.000 -
Geometric Mean 258051.843 -
sample variability
Name Current %
400.perlbench 17.000 -5.56%
400.perlbench (avg) 17.000 -5.56%
400.perlbench (avg) (percentage) 1.150 -5.74%
400.perlbench (max) 10.000 -58.33%
400.perlbench (max) (percentage) 0.690 -57.41%
400.perlbench (unexplained diff vs previous) 3.000 -75.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.200 -74.68%
401.bzip2 65.000 -2.99%
401.bzip2 (avg) 65.000 -2.99%
401.bzip2 (avg) (percentage) 2.410 -
401.bzip2 (max) 59.000 34.09%
401.bzip2 (max) (percentage) 2.200 38.36%
401.bzip2 (unexplained diff vs previous) 61.000 6000.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.250 5525.00%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.990 -
403.gcc (max) 9.000 -10.00%
403.gcc (max) (percentage) 17.460 -1.58%
410.bwaves 52.000 -3.70%
410.bwaves (avg) 52.000 -3.70%
410.bwaves (avg) (percentage) 1.030 -1.90%
410.bwaves (max) 74.000 -5.13%
410.bwaves (max) (percentage) 1.450 -4.61%
410.bwaves (unexplained diff vs previous) 29.000 38.10%
410.bwaves (unexplained diff vs previous) (percentage) 0.570 39.02%
416.gamess 33.000 6.45%
416.gamess (avg) 33.000 6.45%
416.gamess (avg) (percentage) 0.230 4.55%
416.gamess (max) 45.000 12.50%
416.gamess (max) (percentage) 0.320 14.29%
416.gamess (unexplained diff vs previous) 46.000 187.50%
416.gamess (unexplained diff vs previous) (percentage) 0.320 190.91%
429.mcf 59.000 -4.84%
429.mcf (avg) 59.000 -4.84%
429.mcf (avg) (percentage) 6.510 -5.24%
429.mcf (max) 3.000 -40.00%
429.mcf (max) (percentage) 0.410 -30.51%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.210 -2.42%
433.milc (max) 7.000 250.00%
433.milc (max) (percentage) 0.630 250.00%
433.milc (unexplained diff vs previous) 7.000 250.00%
433.milc (unexplained diff vs previous) (percentage) 0.630 250.00%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.840 -1.18%
434.zeusmp (max) 19.000 -9.52%
434.zeusmp (max) (percentage) 0.820 -9.89%
434.zeusmp (unexplained diff vs previous) 15.000 650.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.630 687.50%
435.gromacs 140.000 -4.11%
435.gromacs (avg) 140.000 -4.11%
435.gromacs (avg) (percentage) 2.480 -2.75%
435.gromacs (max) 98.000 -12.50%
435.gromacs (max) (percentage) 1.740 -11.22%
435.gromacs (unexplained diff vs previous) 78.000 44.44%
435.gromacs (unexplained diff vs previous) (percentage) 1.370 45.74%
436.cactusADM 14.000 -6.67%
436.cactusADM (avg) 14.000 -6.67%
436.cactusADM (avg) (percentage) 0.610 -4.69%
436.cactusADM (max) 27.000 -10.00%
436.cactusADM (max) (percentage) 1.170 -8.59%
436.cactusADM (unexplained diff vs previous) 4.000 -42.86%
436.cactusADM (unexplained diff vs previous) (percentage) 0.170 -43.33%
437.leslie3d 494.000 -5.73%
437.leslie3d (avg) 494.000 -5.73%
437.leslie3d (avg) (percentage) 4.930 -4.46%
437.leslie3d (max) 670.000 -25.88%
437.leslie3d (max) (percentage) 6.680 -25.03%
437.leslie3d (unexplained diff vs previous) 123.000 -87.61%
437.leslie3d (unexplained diff vs previous) (percentage) 1.230 -87.42%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.740 -1.33%
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.800 -12.09%
444.namd (unexplained diff vs previous) 4.000 -42.86%
444.namd (unexplained diff vs previous) (percentage) 0.520 -43.48%
445.gobmk 38.000 -5.00%
445.gobmk (avg) 38.000 -5.00%
445.gobmk (avg) (percentage) 0.780 -4.88%
445.gobmk (max) 17.000 -61.36%
445.gobmk (max) (percentage) 0.360 -60.00%
445.gobmk (unexplained diff vs previous) 10.000 -58.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.200 -58.33%
447.dealII 19.000 -
447.dealII (avg) 19.000 -
447.dealII (avg) (percentage) 1.120 -1.75%
447.dealII (max) 19.000 -5.00%
447.dealII (max) (percentage) 1.140 -6.56%
447.dealII (unexplained diff vs previous) 16.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.920 -1.08%
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.350 -4.08%
450.soplex (max) 10.000 -28.57%
450.soplex (max) (percentage) 1.980 -25.00%
450.soplex (unexplained diff vs previous) 5.000 -64.29%
450.soplex (unexplained diff vs previous) (percentage) 0.930 -63.81%
453.povray 3.000 -25.00%
453.povray (avg) 3.000 -25.00%
453.povray (avg) (percentage) 0.900 -2.17%
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.940 -6.93%
453.povray (unexplained diff vs previous) 3.000 200.00%
453.povray (unexplained diff vs previous) (percentage) 0.680 195.65%
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 4.200 -1.64%
456.hmmer 7.000 -12.50%
456.hmmer (avg) 7.000 -12.50%
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 11.000 -
456.hmmer (max) (percentage) 0.330 -2.94%
456.hmmer (unexplained diff vs previous) 11.000 450.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.320 433.33%
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.510 -1.92%
458.sjeng (max) 34.000 -2.86%
458.sjeng (max) (percentage) 0.460 -4.17%
458.sjeng (unexplained diff vs previous) 20.000 566.67%
458.sjeng (unexplained diff vs previous) (percentage) 0.270 575.00%
459.GemsFDTD 67.000 -1.47%
459.GemsFDTD (avg) 67.000 -1.47%
459.GemsFDTD (avg) (percentage) 1.310 -2.24%
459.GemsFDTD (max) 40.000 -9.09%
459.GemsFDTD (max) (percentage) 0.780 -10.34%
459.GemsFDTD (unexplained diff vs previous) 32.000 3100.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.620 3000.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.550 -5.49%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.910 -6.37%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 21.000 -4.55%
464.h264ref (avg) 21.000 -4.55%
464.h264ref (avg) (percentage) 0.370 -2.63%
464.h264ref (max) 18.000 -28.00%
464.h264ref (max) (percentage) 0.320 -25.58%
464.h264ref (unexplained diff vs previous) 17.000 -32.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.290 -32.56%
465.tonto 80.000 -
465.tonto (avg) 80.000 -
465.tonto (avg) (percentage) 0.820 -
465.tonto (max) 81.000 -1.22%
465.tonto (max) (percentage) 0.830 -1.19%
465.tonto (unexplained diff vs previous) 82.000 115.79%
465.tonto (unexplained diff vs previous) (percentage) 0.840 121.05%
470.lbm 35.000 -2.78%
470.lbm (avg) 35.000 -2.78%
470.lbm (avg) (percentage) 0.910 -3.19%
470.lbm (max) 16.000 -20.00%
470.lbm (max) (percentage) 0.430 -17.31%
470.lbm (unexplained diff vs previous) 10.000 -50.00%
470.lbm (unexplained diff vs previous) (percentage) 0.260 -50.00%
471.omnetpp 41.000 -2.38%
471.omnetpp (avg) 41.000 -2.38%
471.omnetpp (avg) (percentage) 1.690 -3.98%
471.omnetpp (max) 42.000 -8.70%
471.omnetpp (max) (percentage) 1.740 -9.84%
471.omnetpp (unexplained diff vs previous) 7.000 -84.78%
471.omnetpp (unexplained diff vs previous) (percentage) 0.290 -84.66%
473.astar 77.000 -4.94%
473.astar (avg) 77.000 -4.94%
473.astar (avg) (percentage) 1.550 -3.73%
473.astar (max) 34.000 -5.56%
473.astar (max) (percentage) 0.680 -6.85%
473.astar (unexplained diff vs previous) 29.000 141.67%
473.astar (unexplained diff vs previous) (percentage) 0.580 141.67%
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.800 -1.23%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.440 -2.70%
482.sphinx3 (max) 7.000 -
482.sphinx3 (max) (percentage) 0.940 -7.84%
482.sphinx3 (unexplained diff vs previous) 6.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.780 -
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.310 -1.50%
Geometric Mean 4.013 -16.22%