Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3a48480b7a9d64ec7a4ee82c63e4c0486920326 (+ 421 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b96a2eba2fcca37deea221a18c998ee0084a5d21 (+ 108 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=68eca432f6e41c1de6f4a7af6d60d9daa9f5eba1 (+ 18569 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/108/
View Options
Report
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0108 (3-changed-components) 2023-12-18T14:07:36 0:00:00
Previous 0101 (basepoints/gcc-14-06033-g55e94561e97) 2023-11-30T02:14:34 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 51 23
Performance Improvements 110 7
Added Tests 2 138
Unchanged Tests 1037 1032
Total Tests 1200

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 18.75% 48.000 57.000 - 7.55% -
400.perlbench 2.19% 1506.000 1539.000 - 12.42% -
453.povray 1.14% 438.000 443.000 - -0.89% -
447.dealII 1.10% 1732.000 1751.000 - -0.34% -
437.leslie3d 1.09% 9743.000 9849.000 - -0.12% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (unexplained diff vs previous) (percentage) 4900.00% 0.010 0.500 - 0.00% -
465.tonto (unexplained diff vs previous) 4800.00% 1.000 49.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 1100.00% 1.000 12.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 900.00% 0.020 0.200 - 0.00% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 391.30% 0.230 1.130 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 209.09% 0.220 0.680 - 0.00% -
435.gromacs (unexplained diff vs previous) 207.69% 13.000 40.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 133.33% 0.180 0.420 - 0.00% -
416.gamess (unexplained diff vs previous) 130.77% 26.000 60.000 - 0.00% -
403.gcc (max) 100.00% 5.000 10.000 - 0.00% -
416.gamess (max) 87.50% 32.000 60.000 - 0.00% -
416.gamess (max) (percentage) 82.61% 0.230 0.420 - 0.00% -
403.gcc (max) (percentage) 68.77% 11.110 18.750 - 0.00% -
403.gcc 50.00% 2.000 3.000 - 0.00% -
403.gcc (avg) 50.00% 2.000 3.000 - 0.00% -
403.gcc (unexplained diff vs previous) 50.00% 6.000 9.000 - 0.00% -
403.gcc (avg) (percentage) 47.88% 4.720 6.980 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 27.10% 1.550 1.970 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 26.32% 12.500 15.790 - 0.00% -
410.bwaves (unexplained diff vs previous) 24.69% 81.000 101.000 - 0.00% -
410.bwaves (max) (percentage) 22.93% 1.570 1.930 - 0.00% -
410.bwaves (max) 20.73% 82.000 99.000 - 0.00% -
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
416.gamess 10.00% 30.000 33.000 - 0.00% -
416.gamess (avg) 10.00% 30.000 33.000 - 0.00% -
416.gamess (avg) (percentage) 9.52% 0.210 0.230 - 0.00% -
458.sjeng (unexplained diff vs previous) 7.32% 41.000 44.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 7.27% 0.550 0.590 - 0.00% -
471.omnetpp (unexplained diff vs previous) 7.14% 14.000 15.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 7.02% 0.570 0.610 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 6.67% 0.300 0.320 - 0.00% -
445.gobmk (unexplained diff vs previous) 6.67% 15.000 16.000 - 0.00% -
447.dealII 5.56% 18.000 19.000 - 0.00% -
447.dealII (avg) 5.56% 18.000 19.000 - 0.00% -
470.lbm (max) 5.26% 19.000 20.000 - 0.00% -
456.hmmer (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -
410.bwaves (avg) (percentage) 4.42% 1.130 1.180 - 0.00% -
436.cactusADM (avg) (percentage) 3.33% 0.600 0.620 - 0.00% -
470.lbm (max) (percentage) 1.96% 0.510 0.520 - 0.00% -
462.libquantum (avg) (percentage) 1.95% 1.540 1.570 - 0.00% -
410.bwaves 1.69% 59.000 60.000 - 0.00% -
410.bwaves (avg) 1.69% 59.000 60.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.11% 0.900 0.910 - 0.00% -
453.povray (avg) (percentage) 1.04% 0.960 0.970 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -2.00% 100.000 98.000 - -11.71% -
410.bwaves -1.93% 5240.000 5139.000 - -2.15% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -94.12% 34.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -94.12% 3.740 0.220 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -89.07% 3.020 0.330 - 0.00% -
401.bzip2 (unexplained diff vs previous) -89.02% 82.000 9.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -77.78% 0.810 0.180 - 0.00% -
433.milc (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
450.soplex (max) -76.92% 13.000 3.000 - 0.00% -
444.namd (max) -75.00% 12.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) -75.00% 4.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -75.00% 0.520 0.130 - 0.00% -
444.namd (max) (percentage) -72.19% 1.690 0.470 - 0.00% -
473.astar (unexplained diff vs previous) -71.21% 66.000 19.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -70.77% 1.300 0.380 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -70.24% 0.840 0.250 - 0.00% -
434.zeusmp (unexplained diff vs previous) -70.00% 20.000 6.000 - 0.00% -
450.soplex (max) (percentage) -69.92% 2.460 0.740 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -67.09% 0.790 0.260 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -66.67% 6.000 2.000 - 0.00% -
459.GemsFDTD (max) -56.60% 106.000 46.000 - 0.00% -
459.GemsFDTD (max) (percentage) -56.10% 2.050 0.900 - 0.00% -
462.libquantum (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -49.00% 4.000 2.040 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -42.93% 1.910 1.090 - 0.00% -
447.dealII (unexplained diff vs previous) -42.42% 33.000 19.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -19.30% 1.140 0.920 - 0.00% -
436.cactusADM (unexplained diff vs previous) -18.52% 27.000 22.000 - 0.00% -
444.namd -16.67% 6.000 5.000 - 0.00% -
444.namd (avg) -16.67% 6.000 5.000 - 0.00% -
433.milc (max) (percentage) -16.25% 0.800 0.670 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -13.95% 0.430 0.370 - 0.00% -
456.hmmer (unexplained diff vs previous) -13.33% 15.000 13.000 - 0.00% -
401.bzip2 (max) -12.66% 79.000 69.000 - 0.00% -
401.bzip2 (max) (percentage) -12.63% 2.930 2.560 - 0.00% -
433.milc (max) -12.50% 8.000 7.000 - 0.00% -
473.astar (max) -12.50% 64.000 56.000 - 0.00% -
473.astar (max) (percentage) -12.50% 1.280 1.120 - 0.00% -
453.povray (max) -11.11% 9.000 8.000 - 0.00% -
434.zeusmp (max) -10.53% 19.000 17.000 - 0.00% -
434.zeusmp (max) (percentage) -9.64% 0.830 0.750 - 0.00% -
401.bzip2 (avg) (percentage) -7.91% 3.160 2.910 - 0.00% -
445.gobmk -7.84% 51.000 47.000 - 0.00% -
445.gobmk (avg) -7.84% 51.000 47.000 - 0.00% -
445.gobmk (max) -7.69% 65.000 60.000 - 0.00% -
471.omnetpp (max) -7.69% 39.000 36.000 - 0.00% -
450.soplex (avg) (percentage) -7.53% 2.920 2.700 - 0.00% -
471.omnetpp (max) (percentage) -7.45% 1.610 1.490 - 0.00% -
429.mcf (max) (percentage) -7.20% 3.610 3.350 - 0.00% -
456.hmmer (max) -7.14% 14.000 13.000 - 0.00% -
401.bzip2 -7.06% 85.000 79.000 - 0.00% -
401.bzip2 (avg) -7.06% 85.000 79.000 - 0.00% -
456.hmmer (max) (percentage) -6.98% 0.430 0.400 - 0.00% -
436.cactusADM (max) -6.90% 29.000 27.000 - 0.00% -
450.soplex -6.67% 15.000 14.000 - 0.00% -
450.soplex (avg) -6.67% 15.000 14.000 - 0.00% -
436.cactusADM (max) (percentage) -6.40% 1.250 1.170 - 0.00% -
481.wrf (max) (percentage) -6.32% 0.950 0.890 - 0.00% -
429.mcf (max) -6.25% 32.000 30.000 - 0.00% -
433.milc -6.25% 16.000 15.000 - 0.00% -
433.milc (avg) -6.25% 16.000 15.000 - 0.00% -
462.libquantum (max) (percentage) -6.23% 3.850 3.610 - 0.00% -
445.gobmk (max) (percentage) -6.15% 1.300 1.220 - 0.00% -
482.sphinx3 (max) (percentage) -6.12% 0.980 0.920 - 0.00% -
445.gobmk (avg) (percentage) -5.88% 1.020 0.960 - 0.00% -
429.mcf (avg) (percentage) -5.84% 8.560 8.060 - 0.00% -
453.povray (max) (percentage) -5.80% 2.070 1.950 - 0.00% -
437.leslie3d (avg) (percentage) -5.42% 4.980 4.710 - 0.00% -
433.milc (avg) (percentage) -5.37% 1.490 1.410 - 0.00% -
482.sphinx3 (avg) (percentage) -5.36% 1.680 1.590 - 0.00% -
473.astar -5.26% 95.000 90.000 - 0.00% -
473.astar (avg) -5.26% 95.000 90.000 - 0.00% -
434.zeusmp (avg) (percentage) -5.21% 0.960 0.910 - 0.00% -
429.mcf -5.19% 77.000 73.000 - 0.00% -
429.mcf (avg) -5.19% 77.000 73.000 - 0.00% -
444.namd (avg) (percentage) -5.00% 0.800 0.760 - 0.00% -
447.dealII (max) (percentage) -4.81% 1.870 1.780 - 0.00% -
473.astar (avg) (percentage) -4.76% 1.890 1.800 - 0.00% -
464.h264ref (avg) (percentage) -4.76% 0.420 0.400 - 0.00% -
435.gromacs (avg) (percentage) -4.71% 2.970 2.830 - 0.00% -
465.tonto -4.60% 87.000 83.000 - 0.00% -
465.tonto (avg) -4.60% 87.000 83.000 - 0.00% -
434.zeusmp -4.55% 22.000 21.000 - 0.00% -
434.zeusmp (avg) -4.55% 22.000 21.000 - 0.00% -
437.leslie3d -4.54% 485.000 463.000 - 0.00% -
437.leslie3d (avg) -4.54% 485.000 463.000 - 0.00% -
465.tonto (avg) (percentage) -4.49% 0.890 0.850 - 0.00% -
400.perlbench (max) (percentage) -4.41% 2.270 2.170 - 0.00% -
464.h264ref -4.17% 24.000 23.000 - 0.00% -
464.h264ref (avg) -4.17% 24.000 23.000 - 0.00% -
435.gromacs -4.07% 172.000 165.000 - 0.00% -
435.gromacs (avg) -4.07% 172.000 165.000 - 0.00% -
464.h264ref (max) (percentage) -3.45% 0.580 0.560 - 0.00% -
471.omnetpp (avg) (percentage) -3.33% 1.800 1.740 - 0.00% -
447.dealII (max) -3.12% 32.000 31.000 - 0.00% -
464.h264ref (max) -3.03% 33.000 32.000 - 0.00% -
400.perlbench (max) -2.94% 34.000 33.000 - 0.00% -
470.lbm (avg) (percentage) -2.86% 1.050 1.020 - 0.00% -
437.leslie3d (max) (percentage) -2.78% 4.670 4.540 - 0.00% -
483.xalancbmk (max) (percentage) -2.74% 1.460 1.420 - 0.00% -
459.GemsFDTD -2.53% 79.000 77.000 - 0.00% -
459.GemsFDTD (avg) -2.53% 79.000 77.000 - 0.00% -
470.lbm -2.50% 40.000 39.000 - 0.00% -
470.lbm (avg) -2.50% 40.000 39.000 - 0.00% -
454.calculix (max) (percentage) -2.38% 4.630 4.520 - 0.00% -
471.omnetpp -2.27% 44.000 43.000 - 0.00% -
471.omnetpp (avg) -2.27% 44.000 43.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.96% 1.530 1.500 - 0.00% -
437.leslie3d (max) -1.54% 454.000 447.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.23% 31.000 32.000 - 10.34% -

Added Tests - sample variability
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.91% 23410.000 24559.000 - 0.00% -
459.GemsFDTD 3.30% 332309.000 343277.000 - 0.00% -
437.leslie3d 2.31% 82727.000 84635.000 - 0.00% -
444.namd 2.13% 223054.000 227802.000 - 0.00% -
465.tonto 1.52% 3107830.000 3155098.000 - 0.00% -
416.gamess 1.32% 7145862.000 7240451.000 - 0.00% -
447.dealII 1.02% 2447503.000 2472572.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 12.42% 1369.000 1539.000 - 2.19% -
435.gromacs 7.89% 5427.000 5855.000 - 0.69% -
403.gcc 7.55% 53.000 57.000 - 18.75% -
473.astar 7.19% 4714.000 5053.000 - -0.37% -
458.sjeng 6.29% 7048.000 7491.000 - 0.59% -
471.omnetpp 5.15% 2351.000 2472.000 - 0.61% -
450.soplex 4.27% 515.000 537.000 - 0.00% -
401.bzip2 4.09% 2617.000 2724.000 - 0.33% -
465.tonto 3.41% 9514.000 9838.000 - 0.50% -
482.sphinx3 3.26% 737.000 761.000 - -0.26% -
416.gamess 2.57% 14025.000 14386.000 - 0.42% -
433.milc 2.10% 1096.000 1119.000 - 0.18% -
459.GemsFDTD 1.85% 5078.000 5172.000 - -0.90% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - 0.00% -
nb_execution_successful -10.34% 29.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.40% 31376.000 30624.000 - 0.00% -
453.povray -2.38% 768026.000 749779.000 - 0.00% -
403.gcc -1.51% 2862353.000 2819205.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -18.73% 1116.000 907.000 - -0.22% -
462.libquantum -11.71% 111.000 98.000 - -2.00% -
410.bwaves -2.15% 5252.000 5139.000 - -1.93% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 3.23% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
400.perlbench 1539.000 2.19%
401.bzip2 2724.000 -
403.gcc 57.000 18.75%
410.bwaves 5139.000 -1.93%
416.gamess 14386.000 -
429.mcf 907.000 -
433.milc 1119.000 -
434.zeusmp 2397.000 -
435.gromacs 5855.000 -
436.cactusADM 2385.000 -
437.leslie3d 9849.000 1.09%
444.namd 767.000 -
445.gobmk 4985.000 -
447.dealII 1751.000 1.10%
450.soplex 537.000 -
453.povray 443.000 1.14%
456.hmmer 3484.000 -
458.sjeng 7491.000 -
459.GemsFDTD 5172.000 -
462.libquantum 98.000 -2.00%
464.h264ref 5855.000 -
465.tonto 9838.000 -
470.lbm 3861.000 -
471.omnetpp 2472.000 -
473.astar 5053.000 -
482.sphinx3 761.000 -
Geometric Mean 2107.955 -
Code Size (bytes)
Name Current %
400.perlbench 986215.000 -
401.bzip2 52540.000 -
403.gcc 2819205.000 -
410.bwaves 24559.000 -
416.gamess 7240451.000 -
429.mcf 10363.000 -
433.milc 98558.000 -
434.zeusmp 234146.000 -
435.gromacs 741177.000 -
436.cactusADM 586579.000 -
437.leslie3d 84635.000 -
444.namd 227802.000 -
445.gobmk 1359853.000 -
447.dealII 2472572.000 -
450.soplex 298173.000 -
453.povray 749779.000 -
456.hmmer 234745.000 -
458.sjeng 126084.000 -
459.GemsFDTD 343277.000 -
462.libquantum 32383.000 -
464.h264ref 472436.000 -
465.tonto 3155098.000 -
470.lbm 11190.000 -
471.omnetpp 502098.000 -
473.astar 30624.000 -
482.sphinx3 153287.000 -
Geometric Mean 258051.978 -
Score
Name Current %
nb_compile_successful 26.000 -
nb_execution_successful 26.000 -
nb_total_tests 32.000 3.23%
Geometric Mean 27.863 1.06%
sample variability
Name Current %
400.perlbench 20.000 -
400.perlbench (avg) 20.000 -
400.perlbench (avg) (percentage) 1.350 -
400.perlbench (max) 33.000 -2.94%
400.perlbench (max) (percentage) 2.170 -4.41%
401.bzip2 79.000 -7.06%
401.bzip2 (avg) 79.000 -7.06%
401.bzip2 (avg) (percentage) 2.910 -7.91%
401.bzip2 (max) 69.000 -12.66%
401.bzip2 (max) (percentage) 2.560 -12.63%
401.bzip2 (unexplained diff vs previous) 9.000 -89.02%
401.bzip2 (unexplained diff vs previous) (percentage) 0.330 -89.07%
403.gcc 3.000 50.00%
403.gcc (avg) 3.000 50.00%
403.gcc (avg) (percentage) 6.980 47.88%
403.gcc (max) 10.000 100.00%
403.gcc (max) (percentage) 18.750 68.77%
403.gcc (unexplained diff vs previous) 9.000 50.00%
403.gcc (unexplained diff vs previous) (percentage) 15.790 26.32%
410.bwaves 60.000 1.69%
410.bwaves (avg) 60.000 1.69%
410.bwaves (avg) (percentage) 1.180 4.42%
410.bwaves (max) 99.000 20.73%
410.bwaves (max) (percentage) 1.930 22.93%
410.bwaves (unexplained diff vs previous) 101.000 24.69%
410.bwaves (unexplained diff vs previous) (percentage) 1.970 27.10%
416.gamess 33.000 10.00%
416.gamess (avg) 33.000 10.00%
416.gamess (avg) (percentage) 0.230 9.52%
416.gamess (max) 60.000 87.50%
416.gamess (max) (percentage) 0.420 82.61%
416.gamess (unexplained diff vs previous) 60.000 130.77%
416.gamess (unexplained diff vs previous) (percentage) 0.420 133.33%
429.mcf 73.000 -5.19%
429.mcf (avg) 73.000 -5.19%
429.mcf (avg) (percentage) 8.060 -5.84%
429.mcf (max) 30.000 -6.25%
429.mcf (max) (percentage) 3.350 -7.20%
429.mcf (unexplained diff vs previous) 2.000 -94.12%
429.mcf (unexplained diff vs previous) (percentage) 0.220 -94.12%
433.milc 15.000 -6.25%
433.milc (avg) 15.000 -6.25%
433.milc (avg) (percentage) 1.410 -5.37%
433.milc (max) 7.000 -12.50%
433.milc (max) (percentage) 0.670 -16.25%
433.milc (unexplained diff vs previous) 2.000 -77.78%
433.milc (unexplained diff vs previous) (percentage) 0.180 -77.78%
434.zeusmp 21.000 -4.55%
434.zeusmp (avg) 21.000 -4.55%
434.zeusmp (avg) (percentage) 0.910 -5.21%
434.zeusmp (max) 17.000 -10.53%
434.zeusmp (max) (percentage) 0.750 -9.64%
434.zeusmp (unexplained diff vs previous) 6.000 -70.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.250 -70.24%
435.gromacs 165.000 -4.07%
435.gromacs (avg) 165.000 -4.07%
435.gromacs (avg) (percentage) 2.830 -4.71%
435.gromacs (max) 40.000 -
435.gromacs (max) (percentage) 0.690 -
435.gromacs (unexplained diff vs previous) 40.000 207.69%
435.gromacs (unexplained diff vs previous) (percentage) 0.680 209.09%
436.cactusADM 14.000 -
436.cactusADM (avg) 14.000 -
436.cactusADM (avg) (percentage) 0.620 3.33%
436.cactusADM (max) 27.000 -6.90%
436.cactusADM (max) (percentage) 1.170 -6.40%
436.cactusADM (unexplained diff vs previous) 22.000 -18.52%
436.cactusADM (unexplained diff vs previous) (percentage) 0.920 -19.30%
437.leslie3d 463.000 -4.54%
437.leslie3d (avg) 463.000 -4.54%
437.leslie3d (avg) (percentage) 4.710 -5.42%
437.leslie3d (max) 447.000 -1.54%
437.leslie3d (max) (percentage) 4.540 -2.78%
437.leslie3d (unexplained diff vs previous) 106.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 1.080 -
444.namd 5.000 -16.67%
444.namd (avg) 5.000 -16.67%
444.namd (avg) (percentage) 0.760 -5.00%
444.namd (max) 3.000 -75.00%
444.namd (max) (percentage) 0.470 -72.19%
444.namd (unexplained diff vs previous) 1.000 -75.00%
444.namd (unexplained diff vs previous) (percentage) 0.130 -75.00%
445.gobmk 47.000 -7.84%
445.gobmk (avg) 47.000 -7.84%
445.gobmk (avg) (percentage) 0.960 -5.88%
445.gobmk (max) 60.000 -7.69%
445.gobmk (max) (percentage) 1.220 -6.15%
445.gobmk (unexplained diff vs previous) 16.000 6.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.320 6.67%
447.dealII 19.000 5.56%
447.dealII (avg) 19.000 5.56%
447.dealII (avg) (percentage) 1.090 -
447.dealII (max) 31.000 -3.12%
447.dealII (max) (percentage) 1.780 -4.81%
447.dealII (unexplained diff vs previous) 19.000 -42.42%
447.dealII (unexplained diff vs previous) (percentage) 1.090 -42.93%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.700 -7.53%
450.soplex (max) 3.000 -76.92%
450.soplex (max) (percentage) 0.740 -69.92%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.970 1.04%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.950 -5.80%
453.povray (unexplained diff vs previous) 5.000 400.00%
453.povray (unexplained diff vs previous) (percentage) 1.130 391.30%
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 4.520 -2.38%
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.230 4.55%
456.hmmer (max) 13.000 -7.14%
456.hmmer (max) (percentage) 0.400 -6.98%
456.hmmer (unexplained diff vs previous) 13.000 -13.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 -13.95%
458.sjeng 47.000 -
458.sjeng (avg) 47.000 -
458.sjeng (avg) (percentage) 0.640 -
458.sjeng (max) 53.000 -
458.sjeng (max) (percentage) 0.720 -
458.sjeng (unexplained diff vs previous) 44.000 7.32%
458.sjeng (unexplained diff vs previous) (percentage) 0.590 7.27%
459.GemsFDTD 77.000 -2.53%
459.GemsFDTD (avg) 77.000 -2.53%
459.GemsFDTD (avg) (percentage) 1.500 -1.96%
459.GemsFDTD (max) 46.000 -56.60%
459.GemsFDTD (max) (percentage) 0.900 -56.10%
459.GemsFDTD (unexplained diff vs previous) 47.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.910 1.11%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.570 1.95%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.610 -6.23%
462.libquantum (unexplained diff vs previous) 2.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.040 -49.00%
464.h264ref 23.000 -4.17%
464.h264ref (avg) 23.000 -4.17%
464.h264ref (avg) (percentage) 0.400 -4.76%
464.h264ref (max) 32.000 -3.03%
464.h264ref (max) (percentage) 0.560 -3.45%
464.h264ref (unexplained diff vs previous) 12.000 1100.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.200 900.00%
465.tonto 83.000 -4.60%
465.tonto (avg) 83.000 -4.60%
465.tonto (avg) (percentage) 0.850 -4.49%
465.tonto (max) 112.000 -
465.tonto (max) (percentage) 1.140 -
465.tonto (unexplained diff vs previous) 49.000 4800.00%
465.tonto (unexplained diff vs previous) (percentage) 0.500 4900.00%
470.lbm 39.000 -2.50%
470.lbm (avg) 39.000 -2.50%
470.lbm (avg) (percentage) 1.020 -2.86%
470.lbm (max) 20.000 5.26%
470.lbm (max) (percentage) 0.520 1.96%
470.lbm (unexplained diff vs previous) 20.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.520 -
471.omnetpp 43.000 -2.27%
471.omnetpp (avg) 43.000 -2.27%
471.omnetpp (avg) (percentage) 1.740 -3.33%
471.omnetpp (max) 36.000 -7.69%
471.omnetpp (max) (percentage) 1.490 -7.45%
471.omnetpp (unexplained diff vs previous) 15.000 7.14%
471.omnetpp (unexplained diff vs previous) (percentage) 0.610 7.02%
473.astar 90.000 -5.26%
473.astar (avg) 90.000 -5.26%
473.astar (avg) (percentage) 1.800 -4.76%
473.astar (max) 56.000 -12.50%
473.astar (max) (percentage) 1.120 -12.50%
473.astar (unexplained diff vs previous) 19.000 -71.21%
473.astar (unexplained diff vs previous) (percentage) 0.380 -70.77%
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.890 -6.32%
482.sphinx3 12.000 -
482.sphinx3 (avg) 12.000 -
482.sphinx3 (avg) (percentage) 1.590 -5.36%
482.sphinx3 (max) 7.000 -
482.sphinx3 (max) (percentage) 0.920 -6.12%
482.sphinx3 (unexplained diff vs previous) 2.000 -66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.260 -67.09%
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.420 -2.74%
Geometric Mean 5.005 -16.72%