Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=83066cb9c7dc2d16adf22649251392d04a7c8d83 (+ 33 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c1597e7fb9f9ecb9d7c33b5afa48031f284375de (+ 109 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e7190fc73dbc8a1f8f94f8ccacd9a190fa5e609c (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=43379dc94db5d75933aac04f61b8d313be92ebe1 (+ 142 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3-build/107/
View Options
Report
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0107 (4-changed-components) 2023-09-02T03:57:01 0:00:00
Previous 0106 (3-changed-components) 2023-08-29T03:46:34 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T10:24:04 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 37 25
Performance Improvements 120 10
Added Tests 2 142
Unchanged Tests 1053 1035
Total Tests 1212

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.27% 55.000 59.000 - 13.46% -
471.omnetpp 6.03% 2323.000 2463.000 - 0.37% -
454.calculix 1.82% 55.000 56.000 - -5.08% -
401.bzip2 1.58% 2790.000 2834.000 - 6.50% -
453.povray 1.35% 444.000 450.000 - 0.45% -
447.dealII 1.29% 1468.000 1487.000 - 2.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) 400.00% 5.000 25.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 383.33% 0.060 0.290 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 380.00% 0.100 0.480 - 0.00% -
456.hmmer (unexplained diff vs previous) 350.00% 2.000 9.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 300.00% 0.190 0.760 - 0.00% -
450.soplex (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 200.00% 1.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 193.33% 0.150 0.440 - 0.00% -
453.povray (unexplained diff vs previous) 100.00% 3.000 6.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 95.59% 0.680 1.330 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 68.60% 0.860 1.450 - 0.00% -
437.leslie3d (unexplained diff vs previous) 66.67% 81.000 135.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 62.50% 8.000 13.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 61.11% 0.360 0.580 - 0.00% -
481.wrf (unexplained diff vs previous) 36.67% 30.000 41.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 35.29% 0.680 0.920 - 0.00% -
444.namd (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 33.33% 0.390 0.520 - 0.00% -
453.povray (max) 20.00% 5.000 6.000 - 0.00% -
471.omnetpp 19.44% 36.000 43.000 - 0.00% -
471.omnetpp (avg) 19.44% 36.000 43.000 - 0.00% -
456.hmmer (max) 12.50% 8.000 9.000 - 0.00% -
471.omnetpp (max) 12.12% 132.000 148.000 - 0.00% -
456.hmmer (max) (percentage) 11.54% 0.260 0.290 - 0.00% -
471.omnetpp (avg) (percentage) 10.06% 1.590 1.750 - 0.00% -
471.omnetpp (max) (percentage) 5.42% 5.720 6.030 - 0.00% -
453.povray (max) (percentage) 3.85% 1.300 1.350 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 2.22% 0.450 0.460 - 0.00% -
401.bzip2 1.85% 54.000 55.000 - 0.00% -
401.bzip2 (avg) 1.85% 54.000 55.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1.14% 0.880 0.890 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -1.43% 9421.000 9286.000 - 3.68% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) -90.48% 21.000 2.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -90.20% 1.530 0.150 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -86.67% 0.150 0.020 - 0.00% -
416.gamess (unexplained diff vs previous) -85.71% 21.000 3.000 - 0.00% -
470.lbm (unexplained diff vs previous) -85.71% 7.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -85.71% 0.210 0.030 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -79.07% 0.860 0.180 - 0.00% -
473.astar (unexplained diff vs previous) -78.57% 42.000 9.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -76.36% 0.550 0.130 - 0.00% -
458.sjeng (unexplained diff vs previous) -76.32% 38.000 9.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -68.18% 22.000 7.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -67.71% 0.960 0.310 - 0.00% -
445.gobmk (unexplained diff vs previous) -60.00% 20.000 8.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -59.52% 0.420 0.170 - 0.00% -
433.milc (max) (percentage) -44.30% 0.790 0.440 - 0.00% -
433.milc (max) -42.86% 7.000 4.000 - 0.00% -
433.milc (unexplained diff vs previous) -40.00% 5.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -40.00% 0.500 0.300 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -32.58% 0.890 0.600 - 0.00% -
435.gromacs (unexplained diff vs previous) -32.00% 50.000 34.000 - 0.00% -
416.gamess (max) -28.57% 21.000 15.000 - 0.00% -
416.gamess (max) (percentage) -26.67% 0.150 0.110 - 0.00% -
445.gobmk (max) (percentage) -26.53% 0.490 0.360 - 0.00% -
445.gobmk (max) -26.09% 23.000 17.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -25.00% 0.160 0.120 - 0.00% -
410.bwaves (unexplained diff vs previous) -25.00% 8.000 6.000 - 0.00% -
400.perlbench (max) -19.05% 21.000 17.000 - 0.00% -
436.cactusADM (max) (percentage) -16.84% 0.950 0.790 - 0.00% -
400.perlbench (max) (percentage) -16.77% 1.550 1.290 - 0.00% -
444.namd -16.67% 6.000 5.000 - 0.00% -
444.namd (avg) -16.67% 6.000 5.000 - 0.00% -
436.cactusADM (max) -14.29% 21.000 18.000 - 0.00% -
458.sjeng (max) -13.16% 38.000 33.000 - 0.00% -
458.sjeng (max) (percentage) -12.73% 0.550 0.480 - 0.00% -
473.astar (max) (percentage) -12.64% 0.870 0.760 - 0.00% -
473.astar (max) -11.90% 42.000 37.000 - 0.00% -
437.leslie3d (max) -11.31% 504.000 447.000 - 0.00% -
462.libquantum (max) (percentage) -10.22% 2.250 2.020 - 0.00% -
437.leslie3d (max) (percentage) -10.07% 5.360 4.820 - 0.00% -
410.bwaves (max) (percentage) -9.38% 1.280 1.160 - 0.00% -
410.bwaves (max) -9.23% 65.000 59.000 - 0.00% -
447.dealII (max) -8.33% 12.000 11.000 - 0.00% -
482.sphinx3 -8.33% 12.000 11.000 - 0.00% -
482.sphinx3 (avg) -8.33% 12.000 11.000 - 0.00% -
470.lbm (max) -8.00% 25.000 23.000 - 0.00% -
464.h264ref (max) (percentage) -7.14% 0.280 0.260 - 0.00% -
436.cactusADM -7.14% 14.000 13.000 - 0.00% -
436.cactusADM (avg) -7.14% 14.000 13.000 - 0.00% -
464.h264ref (max) -6.67% 15.000 14.000 - 0.00% -
450.soplex (max) (percentage) -6.61% 4.990 4.660 - 0.00% -
470.lbm (max) (percentage) -6.58% 0.760 0.710 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -6.43% 6.070 5.680 - 0.00% -
416.gamess (avg) (percentage) -6.25% 0.160 0.150 - 0.00% -
434.zeusmp (max) (percentage) -5.81% 0.860 0.810 - 0.00% -
434.zeusmp -5.26% 19.000 18.000 - 0.00% -
434.zeusmp (avg) -5.26% 19.000 18.000 - 0.00% -
434.zeusmp (max) -5.26% 19.000 18.000 - 0.00% -
400.perlbench -5.00% 20.000 19.000 - 0.00% -
400.perlbench (avg) -5.00% 20.000 19.000 - 0.00% -
410.bwaves -4.65% 43.000 41.000 - 0.00% -
410.bwaves (avg) -4.65% 43.000 41.000 - 0.00% -
458.sjeng -4.65% 43.000 41.000 - 0.00% -
458.sjeng (avg) -4.65% 43.000 41.000 - 0.00% -
416.gamess -4.55% 22.000 21.000 - 0.00% -
416.gamess (avg) -4.55% 22.000 21.000 - 0.00% -
470.lbm -4.55% 22.000 21.000 - 0.00% -
470.lbm (avg) -4.55% 22.000 21.000 - 0.00% -
470.lbm (avg) (percentage) -4.48% 0.670 0.640 - 0.00% -
445.gobmk (avg) (percentage) -4.20% 1.190 1.140 - 0.00% -
429.mcf -4.08% 49.000 47.000 - 0.00% -
429.mcf (avg) -4.08% 49.000 47.000 - 0.00% -
450.soplex (max) -4.00% 25.000 24.000 - 0.00% -
400.perlbench (avg) (percentage) -3.97% 1.510 1.450 - 0.00% -
437.leslie3d -3.87% 336.000 323.000 - 0.00% -
437.leslie3d (avg) -3.87% 336.000 323.000 - 0.00% -
450.soplex (avg) (percentage) -3.86% 2.850 2.740 - 0.00% -
447.dealII (max) (percentage) -3.66% 0.820 0.790 - 0.00% -
459.GemsFDTD (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
429.mcf (avg) (percentage) -3.56% 5.620 5.420 - 0.00% -
410.bwaves (avg) (percentage) -3.53% 0.850 0.820 - 0.00% -
445.gobmk -3.51% 57.000 55.000 - 0.00% -
445.gobmk (avg) -3.51% 57.000 55.000 - 0.00% -
459.GemsFDTD (max) -3.45% 29.000 28.000 - 0.00% -
435.gromacs (avg) (percentage) -3.45% 2.030 1.960 - 0.00% -
482.sphinx3 (avg) (percentage) -3.39% 1.770 1.710 - 0.00% -
473.astar (avg) (percentage) -3.36% 1.490 1.440 - 0.00% -
458.sjeng (avg) (percentage) -3.23% 0.620 0.600 - 0.00% -
436.cactusADM (avg) (percentage) -3.17% 0.630 0.610 - 0.00% -
454.calculix (max) (percentage) -3.04% 2.630 2.550 - 0.00% -
473.astar -2.78% 72.000 70.000 - 0.00% -
473.astar (avg) -2.78% 72.000 70.000 - 0.00% -
435.gromacs -2.65% 113.000 110.000 - 0.00% -
435.gromacs (avg) -2.65% 113.000 110.000 - 0.00% -
444.namd (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
465.tonto (max) -2.53% 79.000 77.000 - 0.00% -
437.leslie3d (avg) (percentage) -2.52% 3.570 3.480 - 0.00% -
481.wrf (max) (percentage) -2.44% 1.230 1.200 - 0.00% -
434.zeusmp (avg) (percentage) -2.33% 0.860 0.840 - 0.00% -
465.tonto (max) (percentage) -2.30% 0.870 0.850 - 0.00% -
435.gromacs (max) (percentage) -2.23% 5.370 5.250 - 0.00% -
481.wrf (avg) (percentage) -2.13% 1.410 1.380 - 0.00% -
401.bzip2 (max) (percentage) -2.09% 3.820 3.740 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.06% 0.970 0.950 - 0.00% -
462.libquantum (avg) (percentage) -2.06% 1.940 1.900 - 0.00% -
429.mcf (max) -2.03% 148.000 145.000 - 0.00% -
459.GemsFDTD -2.00% 50.000 49.000 - 0.00% -
459.GemsFDTD (avg) -2.00% 50.000 49.000 - 0.00% -
483.xalancbmk (max) (percentage) -1.99% 3.510 3.440 - 0.00% -
433.milc (avg) (percentage) -1.92% 1.040 1.020 - 0.00% -
481.wrf (max) -1.85% 54.000 53.000 - 0.00% -
429.mcf (max) (percentage) -1.83% 16.930 16.620 - 0.00% -
435.gromacs (max) -1.66% 301.000 296.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -1.65% 1.820 1.790 - 0.00% -
481.wrf -1.61% 62.000 61.000 - 0.00% -
481.wrf (avg) -1.61% 62.000 61.000 - 0.00% -
403.gcc (max) (percentage) -1.53% 4.580 4.510 - 0.00% -
465.tonto -1.45% 69.000 68.000 - 0.00% -
465.tonto (avg) -1.45% 69.000 68.000 - 0.00% -
444.namd (avg) (percentage) -1.28% 0.780 0.770 - 0.00% -

Added Tests - sample variability
454.calculix
454.calculix (avg)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 8.94% 103307.000 112539.000 - 0.00% -
433.milc 6.27% 123066.000 130786.000 - 0.00% -
416.gamess 2.82% 9253742.000 9514238.000 - 0.00% -
447.dealII 2.72% 3051649.000 3134583.000 - 0.00% -
436.cactusADM 2.70% 742675.000 762747.000 - 0.01% -
453.povray 2.13% 931630.000 951442.000 - 0.00% -
462.libquantum 1.72% 34503.000 35095.000 - 0.00% -
410.bwaves 1.45% 24246.000 24598.000 - 0.00% -
481.wrf 1.23% 6974847.000 7060846.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 13.46% 52.000 59.000 - 7.27% -
450.soplex 7.60% 487.000 524.000 - 0.77% -
401.bzip2 6.50% 2661.000 2834.000 - 1.58% -
437.leslie3d 3.68% 8956.000 9286.000 - -1.43% -
435.gromacs 3.28% 5464.000 5643.000 - 0.61% -
447.dealII 2.55% 1450.000 1487.000 - 1.29% -
434.zeusmp 2.53% 2177.000 2232.000 - -0.58% -
400.perlbench 2.09% 1342.000 1370.000 - -0.15% -
433.milc 2.05% 976.000 996.000 - -0.30% -
473.astar 1.75% 4803.000 4887.000 - -0.18% -
410.bwaves 1.49% 5038.000 5113.000 - -0.12% -
444.namd 1.18% 765.000 774.000 - 0.52% -
481.wrf 1.05% 4396.000 4442.000 - 0.93% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -
nb_total_tests -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -1.26% 159956.000 157948.000 - 0.00% -
459.GemsFDTD -1.13% 407317.000 402717.000 - 0.00% -
464.h264ref -1.05% 800800.000 792392.000 - -0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -21.79% 1120.000 876.000 - -0.45% -
456.hmmer -7.26% 3387.000 3141.000 - 0.29% -
454.calculix -5.08% 59.000 56.000 - 1.82% -
470.lbm -3.68% 3507.000 3378.000 - 0.03% -
436.cactusADM -1.50% 2330.000 2295.000 - 0.31% -
416.gamess -1.37% 14261.000 14066.000 - -0.02% -
458.sjeng -1.05% 7029.000 6955.000 - -0.13% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.43s
Execution (seconds)
Name Current %
400.perlbench 1370.000 -
401.bzip2 2834.000 1.58%
403.gcc 59.000 7.27%
410.bwaves 5113.000 -
416.gamess 14066.000 -
429.mcf 876.000 -
433.milc 996.000 -
434.zeusmp 2232.000 -
435.gromacs 5643.000 -
436.cactusADM 2295.000 -
437.leslie3d 9286.000 -1.43%
444.namd 774.000 -
445.gobmk 4827.000 -
447.dealII 1487.000 1.29%
450.soplex 524.000 -
453.povray 450.000 1.35%
454.calculix 56.000 1.82%
456.hmmer 3141.000 -
458.sjeng 6955.000 -
459.GemsFDTD 5186.000 -
462.libquantum 112.000 -
464.h264ref 5691.000 -
465.tonto 9067.000 -
470.lbm 3378.000 -
471.omnetpp 2463.000 6.03%
473.astar 4887.000 -
481.wrf 4442.000 -
482.sphinx3 687.000 -
Geometric Mean 1831.957 -
Code Size (bytes)
Name Current %
400.perlbench 1180649.000 -
401.bzip2 76972.000 -
403.gcc 3216741.000 -
410.bwaves 24598.000 -
416.gamess 9514238.000 -
429.mcf 10603.000 -
433.milc 130786.000 -
434.zeusmp 339202.000 -
435.gromacs 934425.000 -
436.cactusADM 762747.000 -
437.leslie3d 112539.000 -
444.namd 229810.000 -
445.gobmk 1484373.000 -
447.dealII 3134583.000 -
450.soplex 410533.000 -
453.povray 951442.000 -
454.calculix 1748986.000 -
456.hmmer 299001.000 -
458.sjeng 157948.000 -
459.GemsFDTD 402717.000 -
462.libquantum 35095.000 -
464.h264ref 792392.000 -
465.tonto 4335221.000 -
470.lbm 12302.000 -
471.omnetpp 555722.000 -
473.astar 38460.000 -
481.wrf 7060846.000 -
482.sphinx3 196987.000 -
Geometric Mean 378908.090 -
sample variability
Name Current %
400.perlbench 19.000 -5.00%
400.perlbench (avg) 19.000 -5.00%
400.perlbench (avg) (percentage) 1.450 -3.97%
400.perlbench (max) 17.000 -19.05%
400.perlbench (max) (percentage) 1.290 -16.77%
400.perlbench (unexplained diff vs previous) 2.000 -90.48%
400.perlbench (unexplained diff vs previous) (percentage) 0.150 -90.20%
401.bzip2 55.000 1.85%
401.bzip2 (avg) 55.000 1.85%
401.bzip2 (avg) (percentage) 1.960 -
401.bzip2 (max) 105.000 -
401.bzip2 (max) (percentage) 3.740 -2.09%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.620 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.510 -1.53%
410.bwaves 41.000 -4.65%
410.bwaves (avg) 41.000 -4.65%
410.bwaves (avg) (percentage) 0.820 -3.53%
410.bwaves (max) 59.000 -9.23%
410.bwaves (max) (percentage) 1.160 -9.38%
410.bwaves (unexplained diff vs previous) 6.000 -25.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.120 -25.00%
416.gamess 21.000 -4.55%
416.gamess (avg) 21.000 -4.55%
416.gamess (avg) (percentage) 0.150 -6.25%
416.gamess (max) 15.000 -28.57%
416.gamess (max) (percentage) 0.110 -26.67%
416.gamess (unexplained diff vs previous) 3.000 -85.71%
416.gamess (unexplained diff vs previous) (percentage) 0.020 -86.67%
429.mcf 47.000 -4.08%
429.mcf (avg) 47.000 -4.08%
429.mcf (avg) (percentage) 5.420 -3.56%
429.mcf (max) 145.000 -2.03%
429.mcf (max) (percentage) 16.620 -1.83%
429.mcf (unexplained diff vs previous) 4.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.460 2.22%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.020 -1.92%
433.milc (max) 4.000 -42.86%
433.milc (max) (percentage) 0.440 -44.30%
433.milc (unexplained diff vs previous) 3.000 -40.00%
433.milc (unexplained diff vs previous) (percentage) 0.300 -40.00%
434.zeusmp 18.000 -5.26%
434.zeusmp (avg) 18.000 -5.26%
434.zeusmp (avg) (percentage) 0.840 -2.33%
434.zeusmp (max) 18.000 -5.26%
434.zeusmp (max) (percentage) 0.810 -5.81%
434.zeusmp (unexplained diff vs previous) 13.000 62.50%
434.zeusmp (unexplained diff vs previous) (percentage) 0.580 61.11%
435.gromacs 110.000 -2.65%
435.gromacs (avg) 110.000 -2.65%
435.gromacs (avg) (percentage) 1.960 -3.45%
435.gromacs (max) 296.000 -1.66%
435.gromacs (max) (percentage) 5.250 -2.23%
435.gromacs (unexplained diff vs previous) 34.000 -32.00%
435.gromacs (unexplained diff vs previous) (percentage) 0.600 -32.58%
436.cactusADM 13.000 -7.14%
436.cactusADM (avg) 13.000 -7.14%
436.cactusADM (avg) (percentage) 0.610 -3.17%
436.cactusADM (max) 18.000 -14.29%
436.cactusADM (max) (percentage) 0.790 -16.84%
436.cactusADM (unexplained diff vs previous) 7.000 -68.18%
436.cactusADM (unexplained diff vs previous) (percentage) 0.310 -67.71%
437.leslie3d 323.000 -3.87%
437.leslie3d (avg) 323.000 -3.87%
437.leslie3d (avg) (percentage) 3.480 -2.52%
437.leslie3d (max) 447.000 -11.31%
437.leslie3d (max) (percentage) 4.820 -10.07%
437.leslie3d (unexplained diff vs previous) 135.000 66.67%
437.leslie3d (unexplained diff vs previous) (percentage) 1.450 68.60%
444.namd 5.000 -16.67%
444.namd (avg) 5.000 -16.67%
444.namd (avg) (percentage) 0.770 -1.28%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.750 -2.60%
444.namd (unexplained diff vs previous) 4.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 0.520 33.33%
445.gobmk 55.000 -3.51%
445.gobmk (avg) 55.000 -3.51%
445.gobmk (avg) (percentage) 1.140 -4.20%
445.gobmk (max) 17.000 -26.09%
445.gobmk (max) (percentage) 0.360 -26.53%
445.gobmk (unexplained diff vs previous) 8.000 -60.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.170 -59.52%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.820 -
447.dealII (max) 11.000 -8.33%
447.dealII (max) (percentage) 0.790 -3.66%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.740 -3.86%
450.soplex (max) 24.000 -4.00%
450.soplex (max) (percentage) 4.660 -6.61%
450.soplex (unexplained diff vs previous) 4.000 300.00%
450.soplex (unexplained diff vs previous) (percentage) 0.760 300.00%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.230 -
453.povray (max) 6.000 20.00%
453.povray (max) (percentage) 1.350 3.85%
453.povray (unexplained diff vs previous) 6.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 1.330 95.59%
454.calculix 0.000 -
454.calculix (avg) 0.000 -
454.calculix (avg) (percentage) 1.770 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.550 -3.04%
454.calculix (unexplained diff vs previous) 1.000 -
454.calculix (unexplained diff vs previous) (percentage) 1.790 -1.65%
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.310 -
456.hmmer (max) 9.000 12.50%
456.hmmer (max) (percentage) 0.290 11.54%
456.hmmer (unexplained diff vs previous) 9.000 350.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.290 383.33%
458.sjeng 41.000 -4.65%
458.sjeng (avg) 41.000 -4.65%
458.sjeng (avg) (percentage) 0.600 -3.23%
458.sjeng (max) 33.000 -13.16%
458.sjeng (max) (percentage) 0.480 -12.73%
458.sjeng (unexplained diff vs previous) 9.000 -76.32%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 -76.36%
459.GemsFDTD 49.000 -2.00%
459.GemsFDTD (avg) 49.000 -2.00%
459.GemsFDTD (avg) (percentage) 0.950 -2.06%
459.GemsFDTD (max) 28.000 -3.45%
459.GemsFDTD (max) (percentage) 0.540 -3.57%
459.GemsFDTD (unexplained diff vs previous) 25.000 400.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.480 380.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.900 -2.06%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.020 -10.22%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.890 1.14%
464.h264ref 27.000 -
464.h264ref (avg) 27.000 -
464.h264ref (avg) (percentage) 0.480 -
464.h264ref (max) 14.000 -6.67%
464.h264ref (max) (percentage) 0.260 -7.14%
465.tonto 68.000 -1.45%
465.tonto (avg) 68.000 -1.45%
465.tonto (avg) (percentage) 0.760 -
465.tonto (max) 77.000 -2.53%
465.tonto (max) (percentage) 0.850 -2.30%
470.lbm 21.000 -4.55%
470.lbm (avg) 21.000 -4.55%
470.lbm (avg) (percentage) 0.640 -4.48%
470.lbm (max) 23.000 -8.00%
470.lbm (max) (percentage) 0.710 -6.58%
470.lbm (unexplained diff vs previous) 1.000 -85.71%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -85.71%
471.omnetpp 43.000 19.44%
471.omnetpp (avg) 43.000 19.44%
471.omnetpp (avg) (percentage) 1.750 10.06%
471.omnetpp (max) 148.000 12.12%
471.omnetpp (max) (percentage) 6.030 5.42%
471.omnetpp (unexplained diff vs previous) 140.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 5.680 -6.43%
473.astar 70.000 -2.78%
473.astar (avg) 70.000 -2.78%
473.astar (avg) (percentage) 1.440 -3.36%
473.astar (max) 37.000 -11.90%
473.astar (max) (percentage) 0.760 -12.64%
473.astar (unexplained diff vs previous) 9.000 -78.57%
473.astar (unexplained diff vs previous) (percentage) 0.180 -79.07%
481.wrf 61.000 -1.61%
481.wrf (avg) 61.000 -1.61%
481.wrf (avg) (percentage) 1.380 -2.13%
481.wrf (max) 53.000 -1.85%
481.wrf (max) (percentage) 1.200 -2.44%
481.wrf (unexplained diff vs previous) 41.000 36.67%
481.wrf (unexplained diff vs previous) (percentage) 0.920 35.29%
482.sphinx3 11.000 -8.33%
482.sphinx3 (avg) 11.000 -8.33%
482.sphinx3 (avg) (percentage) 1.710 -3.39%
482.sphinx3 (max) 8.000 -
482.sphinx3 (max) (percentage) 1.200 -
482.sphinx3 (unexplained diff vs previous) 3.000 200.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.440 193.33%
483.xalancbmk (avg) (percentage) 1.860 -
483.xalancbmk (max) (percentage) 3.440 -1.99%
Geometric Mean 4.202 -18.05%