Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=58ce812559c95eb80cac0ea2ec6ca9da768e48f2 (+ 43 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b86cb494f9a27a106c96c025c6d834334d85b80a (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=24b0b28008edcc0e8293779d867f3c42fedfe98f (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3-build/170/
View Options
Report
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0170 (2-changed-components) 2024-01-13T00:08:23 0:00:00
Previous 0167 (3-changed-components) 2024-01-04T00:16:34 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T10:24:04 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 39 21
Performance Improvements 96 11
Added Tests 2 136
Unchanged Tests 1063 1032
Total Tests 1200

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.51% 57.000 59.000 - 13.46% -
435.gromacs 1.41% 5654.000 5734.000 - 4.94% -
447.dealII 1.23% 1469.000 1487.000 - 2.55% -
429.mcf 1.20% 913.000 924.000 - -17.50% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) 1250.00% 0.060 0.810 - 0.00% -
445.gobmk (unexplained diff vs previous) 1200.00% 3.000 39.000 - 0.00% -
447.dealII (unexplained diff vs previous) 800.00% 2.000 18.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 764.29% 0.140 1.210 - 0.00% -
465.tonto (unexplained diff vs previous) 566.67% 9.000 60.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 560.00% 0.100 0.660 - 0.00% -
416.gamess (unexplained diff vs previous) 337.50% 8.000 35.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 305.00% 0.200 0.810 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 300.00% 0.060 0.240 - 0.00% -
433.milc (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
456.hmmer (max) 166.67% 6.000 16.000 - 0.00% -
456.hmmer (max) (percentage) 145.45% 0.220 0.540 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 145.45% 0.220 0.540 - 0.00% -
456.hmmer (unexplained diff vs previous) 142.86% 7.000 17.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 140.00% 5.000 12.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 136.36% 0.220 0.520 - 0.00% -
435.gromacs (unexplained diff vs previous) 116.22% 37.000 80.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 115.38% 0.650 1.400 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 109.68% 0.310 0.650 - 0.00% -
410.bwaves (unexplained diff vs previous) 106.25% 16.000 33.000 - 0.00% -
473.astar (unexplained diff vs previous) 87.50% 8.000 15.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 82.35% 0.170 0.310 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.570 0.760 - 0.00% -
450.soplex (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 29.93% 17.510 22.750 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 23.68% 38.000 47.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 21.62% 0.740 0.900 - 0.00% -
470.lbm (unexplained diff vs previous) 18.18% 11.000 13.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 18.18% 0.330 0.390 - 0.00% -
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
437.leslie3d (avg) (percentage) 9.03% 4.540 4.950 - 0.00% -
462.libquantum (max) (percentage) 7.69% 1.820 1.960 - 0.00% -
437.leslie3d (unexplained diff vs previous) 5.85% 1879.000 1989.000 - 0.00% -
456.hmmer (avg) (percentage) 4.00% 0.250 0.260 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -18.54% 10730.000 8741.000 - -2.40% -
462.libquantum -1.96% 102.000 100.000 - -10.71% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -93.69% 1.110 0.070 - 0.00% -
401.bzip2 (unexplained diff vs previous) -93.33% 30.000 2.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -79.49% 0.390 0.080 - 0.00% -
458.sjeng (unexplained diff vs previous) -79.31% 29.000 6.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -79.25% 53.000 11.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -79.07% 2.150 0.450 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -77.78% 0.180 0.040 - 0.00% -
434.zeusmp (unexplained diff vs previous) -75.00% 4.000 1.000 - 0.00% -
444.namd (max) (percentage) -67.42% 0.890 0.290 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -66.67% 0.660 0.220 - 0.00% -
444.namd (max) -66.67% 6.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -66.67% 6.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -66.29% 0.890 0.300 - 0.00% -
444.namd (unexplained diff vs previous) -33.33% 3.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -33.33% 0.390 0.260 - 0.00% -
453.povray (max) -33.33% 3.000 2.000 - 0.00% -
437.leslie3d (max) -28.68% 2277.000 1624.000 - 0.00% -
453.povray (max) (percentage) -26.25% 0.800 0.590 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -16.20% 1.420 1.190 - 0.00% -
429.mcf (unexplained diff vs previous) -15.38% 13.000 11.000 - 0.00% -
471.omnetpp (max) -12.96% 54.000 47.000 - 0.00% -
433.milc (max) -12.50% 24.000 21.000 - 0.00% -
437.leslie3d (max) (percentage) -12.48% 21.230 18.580 - 0.00% -
471.omnetpp (max) (percentage) -12.33% 2.190 1.920 - 0.00% -
458.sjeng (max) -12.31% 65.000 57.000 - 0.00% -
470.lbm (max) -11.76% 34.000 30.000 - 0.00% -
473.astar (max) -11.54% 156.000 138.000 - 0.00% -
465.tonto (max) (percentage) -11.41% 1.840 1.630 - 0.00% -
458.sjeng (max) (percentage) -11.36% 0.880 0.780 - 0.00% -
437.leslie3d -11.29% 487.000 432.000 - 0.00% -
437.leslie3d (avg) -11.29% 487.000 432.000 - 0.00% -
450.soplex (max) (percentage) -11.23% 3.740 3.320 - 0.00% -
433.milc (max) (percentage) -11.20% 2.410 2.140 - 0.00% -
401.bzip2 (max) (percentage) -11.15% 3.140 2.790 - 0.00% -
400.perlbench (max) -11.11% 18.000 16.000 - 0.00% -
464.h264ref (max) -11.11% 36.000 32.000 - 0.00% -
482.sphinx3 (max) (percentage) -11.11% 2.520 2.240 - 0.00% -
429.mcf (max) (percentage) -11.10% 15.590 13.860 - 0.00% -
473.astar (max) (percentage) -11.04% 3.260 2.900 - 0.00% -
436.cactusADM (max) (percentage) -10.94% 0.640 0.570 - 0.00% -
410.bwaves (max) (percentage) -10.81% 1.110 0.990 - 0.00% -
470.lbm (max) (percentage) -10.78% 1.020 0.910 - 0.00% -
465.tonto (max) -10.78% 167.000 149.000 - 0.00% -
401.bzip2 (max) -10.71% 84.000 75.000 - 0.00% -
410.bwaves (max) -10.71% 56.000 50.000 - 0.00% -
450.soplex (max) -10.53% 19.000 17.000 - 0.00% -
459.GemsFDTD (max) (percentage) -10.18% 1.670 1.500 - 0.00% -
435.gromacs (max) (percentage) -9.95% 3.820 3.440 - 0.00% -
429.mcf (max) -9.86% 142.000 128.000 - 0.00% -
464.h264ref (max) (percentage) -9.38% 0.640 0.580 - 0.00% -
459.GemsFDTD (max) -9.30% 86.000 78.000 - 0.00% -
445.gobmk (max) (percentage) -9.23% 1.300 1.180 - 0.00% -
434.zeusmp (max) (percentage) -8.92% 1.570 1.430 - 0.00% -
434.zeusmp (max) -8.82% 34.000 31.000 - 0.00% -
435.gromacs (max) -8.37% 215.000 197.000 - 0.00% -
445.gobmk (max) -8.06% 62.000 57.000 - 0.00% -
436.cactusADM (max) -7.14% 14.000 13.000 - 0.00% -
400.perlbench (max) (percentage) -6.61% 1.210 1.130 - 0.00% -
447.dealII (max) (percentage) -6.51% 2.150 2.010 - 0.00% -
447.dealII (max) -6.45% 31.000 29.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -6.25% 0.320 0.300 - 0.00% -
450.soplex -6.25% 16.000 15.000 - 0.00% -
450.soplex (avg) -6.25% 16.000 15.000 - 0.00% -
482.sphinx3 (max) -6.25% 16.000 15.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -5.56% 18.000 17.000 - 0.00% -
401.bzip2 -4.00% 50.000 48.000 - 0.00% -
401.bzip2 (avg) -4.00% 50.000 48.000 - 0.00% -
416.gamess (max) -3.90% 77.000 74.000 - 0.00% -
416.gamess (max) (percentage) -3.70% 0.540 0.520 - 0.00% -
453.povray (avg) (percentage) -3.42% 1.170 1.130 - 0.00% -
401.bzip2 (avg) (percentage) -3.24% 1.850 1.790 - 0.00% -
450.soplex (avg) (percentage) -2.62% 3.050 2.970 - 0.00% -
400.perlbench (avg) (percentage) -2.52% 1.590 1.550 - 0.00% -
471.omnetpp -2.44% 41.000 40.000 - 0.00% -
471.omnetpp (avg) -2.44% 41.000 40.000 - 0.00% -
434.zeusmp (avg) (percentage) -2.41% 0.830 0.810 - 0.00% -
482.sphinx3 (avg) (percentage) -2.34% 1.710 1.670 - 0.00% -
458.sjeng -2.27% 44.000 43.000 - 0.00% -
458.sjeng (avg) -2.27% 44.000 43.000 - 0.00% -
473.astar (avg) (percentage) -2.13% 1.410 1.380 - 0.00% -
429.mcf (avg) (percentage) -2.03% 6.400 6.270 - 0.00% -
464.h264ref (avg) (percentage) -1.96% 0.510 0.500 - 0.00% -
454.calculix (max) (percentage) -1.92% 3.130 3.070 - 0.00% -
471.omnetpp (avg) (percentage) -1.81% 1.660 1.630 - 0.00% -
481.wrf (max) (percentage) -1.78% 4.500 4.420 - 0.00% -
429.mcf -1.72% 58.000 57.000 - 0.00% -
429.mcf (avg) -1.72% 58.000 57.000 - 0.00% -
458.sjeng (avg) (percentage) -1.67% 0.600 0.590 - 0.00% -
473.astar -1.49% 67.000 66.000 - 0.00% -
473.astar (avg) -1.49% 67.000 66.000 - 0.00% -
444.namd (avg) (percentage) -1.30% 0.770 0.760 - 0.00% -
403.gcc (max) (percentage) -1.19% 11.760 11.620 - 0.00% -
465.tonto (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 9.87% 103307.000 113499.000 - 0.00% -
433.milc 6.93% 123066.000 131590.000 - 0.00% -
416.gamess 3.64% 9253742.000 9590511.000 - 0.00% -
436.cactusADM 3.49% 742675.000 768579.000 - 0.00% -
447.dealII 3.27% 3051649.000 3151559.000 - 0.00% -
410.bwaves 2.86% 24246.000 24939.000 - 0.00% -
444.namd 2.52% 230794.000 236618.000 - 0.00% -
462.libquantum 1.74% 34503.000 35103.000 - 0.00% -
453.povray 1.05% 931630.000 941423.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 13.46% 52.000 59.000 - 3.51% -
400.perlbench 11.85% 1342.000 1501.000 - -0.33% -
450.soplex 8.01% 487.000 526.000 - -0.75% -
458.sjeng 5.19% 7029.000 7394.000 - 0.08% -
435.gromacs 4.94% 5464.000 5734.000 - 1.41% -
447.dealII 2.55% 1450.000 1487.000 - 1.23% -
434.zeusmp 2.30% 2177.000 2227.000 - 0.04% -
433.milc 1.64% 976.000 992.000 - -0.80% -
465.tonto 1.62% 9001.000 9147.000 - 0.66% -
401.bzip2 1.54% 2661.000 2702.000 - -0.07% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - 0.00% -
nb_execution_successful -10.34% 29.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 -1.71% 76368.000 75064.000 - 0.00% -
434.zeusmp -1.63% 342546.000 336970.000 - 0.00% -
458.sjeng -1.15% 159956.000 158116.000 - 0.00% -
403.gcc -1.04% 3211589.000 3178285.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -17.50% 1120.000 924.000 - 1.20% -
462.libquantum -10.71% 112.000 100.000 - -1.96% -
456.hmmer -7.88% 3387.000 3120.000 - -0.54% -
470.lbm -3.79% 3507.000 3374.000 - 0.39% -
437.leslie3d -2.40% 8956.000 8741.000 - -18.54% -
482.sphinx3 -1.90% 686.000 673.000 - 0.30% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1501.000 -
401.bzip2 2702.000 -
403.gcc 59.000 3.51%
410.bwaves 5069.000 -
416.gamess 14361.000 -
429.mcf 924.000 1.20%
433.milc 992.000 -
434.zeusmp 2227.000 -
435.gromacs 5734.000 1.41%
436.cactusADM 2330.000 -
437.leslie3d 8741.000 -18.54%
444.namd 765.000 -
445.gobmk 4840.000 -
447.dealII 1487.000 1.23%
450.soplex 526.000 -
453.povray 451.000 -
456.hmmer 3120.000 -
458.sjeng 7394.000 -
459.GemsFDTD 5200.000 -
462.libquantum 100.000 -1.96%
464.h264ref 5678.000 -
465.tonto 9147.000 -
470.lbm 3374.000 -
471.omnetpp 2459.000 -
473.astar 4791.000 -
482.sphinx3 673.000 -
Geometric Mean 2023.044 -
Code Size (bytes)
Name Current %
400.perlbench 1186815.000 -
401.bzip2 75064.000 -
403.gcc 3178285.000 -
410.bwaves 24939.000 -
416.gamess 9590511.000 -
429.mcf 10675.000 -
433.milc 131590.000 -
434.zeusmp 336970.000 -
435.gromacs 933329.000 -
436.cactusADM 768579.000 -
437.leslie3d 113499.000 -
444.namd 236618.000 -
445.gobmk 1487157.000 -
447.dealII 3151559.000 -
450.soplex 410438.000 -
453.povray 941423.000 -
456.hmmer 299009.000 -
458.sjeng 158116.000 -
459.GemsFDTD 405697.000 -
462.libquantum 35103.000 -
464.h264ref 795252.000 -
465.tonto 4349710.000 -
470.lbm 12302.000 -
471.omnetpp 554342.000 -
473.astar 38476.000 -
482.sphinx3 197707.000 -
Geometric Mean 319910.043 -
sample variability
Name Current %
400.perlbench 23.000 -
400.perlbench (avg) 23.000 -
400.perlbench (avg) (percentage) 1.550 -2.52%
400.perlbench (max) 16.000 -11.11%
400.perlbench (max) (percentage) 1.130 -6.61%
400.perlbench (unexplained diff vs previous) 5.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.330 -
401.bzip2 48.000 -4.00%
401.bzip2 (avg) 48.000 -4.00%
401.bzip2 (avg) (percentage) 1.790 -3.24%
401.bzip2 (max) 75.000 -10.71%
401.bzip2 (max) (percentage) 2.790 -11.15%
401.bzip2 (unexplained diff vs previous) 2.000 -93.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -93.69%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.970 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 11.620 -1.19%
410.bwaves 41.000 -
410.bwaves (avg) 41.000 -
410.bwaves (avg) (percentage) 0.810 -
410.bwaves (max) 50.000 -10.71%
410.bwaves (max) (percentage) 0.990 -10.81%
410.bwaves (unexplained diff vs previous) 33.000 106.25%
410.bwaves (unexplained diff vs previous) (percentage) 0.650 109.68%
416.gamess 31.000 -
416.gamess (avg) 31.000 -
416.gamess (avg) (percentage) 0.220 -
416.gamess (max) 74.000 -3.90%
416.gamess (max) (percentage) 0.520 -3.70%
416.gamess (unexplained diff vs previous) 35.000 337.50%
416.gamess (unexplained diff vs previous) (percentage) 0.240 300.00%
429.mcf 57.000 -1.72%
429.mcf (avg) 57.000 -1.72%
429.mcf (avg) (percentage) 6.270 -2.03%
429.mcf (max) 128.000 -9.86%
429.mcf (max) (percentage) 13.860 -11.10%
429.mcf (unexplained diff vs previous) 11.000 -15.38%
429.mcf (unexplained diff vs previous) (percentage) 1.190 -16.20%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.860 -
433.milc (max) 21.000 -12.50%
433.milc (max) (percentage) 2.140 -11.20%
433.milc (unexplained diff vs previous) 8.000 300.00%
433.milc (unexplained diff vs previous) (percentage) 0.810 305.00%
434.zeusmp 18.000 -
434.zeusmp (avg) 18.000 -
434.zeusmp (avg) (percentage) 0.810 -2.41%
434.zeusmp (max) 31.000 -8.82%
434.zeusmp (max) (percentage) 1.430 -8.92%
434.zeusmp (unexplained diff vs previous) 1.000 -75.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.040 -77.78%
435.gromacs 122.000 -
435.gromacs (avg) 122.000 -
435.gromacs (avg) (percentage) 2.140 -
435.gromacs (max) 197.000 -8.37%
435.gromacs (max) (percentage) 3.440 -9.95%
435.gromacs (unexplained diff vs previous) 80.000 116.22%
435.gromacs (unexplained diff vs previous) (percentage) 1.400 115.38%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.510 -
436.cactusADM (max) 13.000 -7.14%
436.cactusADM (max) (percentage) 0.570 -10.94%
436.cactusADM (unexplained diff vs previous) 12.000 140.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.520 136.36%
437.leslie3d 432.000 -11.29%
437.leslie3d (avg) 432.000 -11.29%
437.leslie3d (avg) (percentage) 4.950 9.03%
437.leslie3d (max) 1624.000 -28.68%
437.leslie3d (max) (percentage) 18.580 -12.48%
437.leslie3d (unexplained diff vs previous) 1989.000 5.85%
437.leslie3d (unexplained diff vs previous) (percentage) 22.750 29.93%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.760 -1.30%
444.namd (max) 2.000 -66.67%
444.namd (max) (percentage) 0.290 -67.42%
444.namd (unexplained diff vs previous) 2.000 -33.33%
444.namd (unexplained diff vs previous) (percentage) 0.260 -33.33%
445.gobmk 53.000 -
445.gobmk (avg) 53.000 -
445.gobmk (avg) (percentage) 1.100 -
445.gobmk (max) 57.000 -8.06%
445.gobmk (max) (percentage) 1.180 -9.23%
445.gobmk (unexplained diff vs previous) 39.000 1200.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.810 1250.00%
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.190 -
447.dealII (max) 29.000 -6.45%
447.dealII (max) (percentage) 2.010 -6.51%
447.dealII (unexplained diff vs previous) 18.000 800.00%
447.dealII (unexplained diff vs previous) (percentage) 1.210 764.29%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.970 -2.62%
450.soplex (max) 17.000 -10.53%
450.soplex (max) (percentage) 3.320 -11.23%
450.soplex (unexplained diff vs previous) 4.000 33.33%
450.soplex (unexplained diff vs previous) (percentage) 0.760 33.33%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.130 -3.42%
453.povray (max) 2.000 -33.33%
453.povray (max) (percentage) 0.590 -26.25%
453.povray (unexplained diff vs previous) 1.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 0.220 -66.67%
454.calculix (avg) (percentage) 2.300 -
454.calculix (max) (percentage) 3.070 -1.92%
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.260 4.00%
456.hmmer (max) 16.000 166.67%
456.hmmer (max) (percentage) 0.540 145.45%
456.hmmer (unexplained diff vs previous) 17.000 142.86%
456.hmmer (unexplained diff vs previous) (percentage) 0.540 145.45%
458.sjeng 43.000 -2.27%
458.sjeng (avg) 43.000 -2.27%
458.sjeng (avg) (percentage) 0.590 -1.67%
458.sjeng (max) 57.000 -12.31%
458.sjeng (max) (percentage) 0.780 -11.36%
458.sjeng (unexplained diff vs previous) 6.000 -79.31%
458.sjeng (unexplained diff vs previous) (percentage) 0.080 -79.49%
459.GemsFDTD 54.000 -
459.GemsFDTD (avg) 54.000 -
459.GemsFDTD (avg) (percentage) 1.050 -
459.GemsFDTD (max) 78.000 -9.30%
459.GemsFDTD (max) (percentage) 1.500 -10.18%
459.GemsFDTD (unexplained diff vs previous) 47.000 23.68%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.900 21.62%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.570 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.960 7.69%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.000 -
464.h264ref 28.000 -
464.h264ref (avg) 28.000 -
464.h264ref (avg) (percentage) 0.500 -1.96%
464.h264ref (max) 32.000 -11.11%
464.h264ref (max) (percentage) 0.580 -9.38%
464.h264ref (unexplained diff vs previous) 17.000 -5.56%
464.h264ref (unexplained diff vs previous) (percentage) 0.300 -6.25%
465.tonto 90.000 -
465.tonto (avg) 90.000 -
465.tonto (avg) (percentage) 0.990 -1.00%
465.tonto (max) 149.000 -10.78%
465.tonto (max) (percentage) 1.630 -11.41%
465.tonto (unexplained diff vs previous) 60.000 566.67%
465.tonto (unexplained diff vs previous) (percentage) 0.660 560.00%
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.670 -
470.lbm (max) 30.000 -11.76%
470.lbm (max) (percentage) 0.910 -10.78%
470.lbm (unexplained diff vs previous) 13.000 18.18%
470.lbm (unexplained diff vs previous) (percentage) 0.390 18.18%
471.omnetpp 40.000 -2.44%
471.omnetpp (avg) 40.000 -2.44%
471.omnetpp (avg) (percentage) 1.630 -1.81%
471.omnetpp (max) 47.000 -12.96%
471.omnetpp (max) (percentage) 1.920 -12.33%
471.omnetpp (unexplained diff vs previous) 11.000 -79.25%
471.omnetpp (unexplained diff vs previous) (percentage) 0.450 -79.07%
473.astar 66.000 -1.49%
473.astar (avg) 66.000 -1.49%
473.astar (avg) (percentage) 1.380 -2.13%
473.astar (max) 138.000 -11.54%
473.astar (max) (percentage) 2.900 -11.04%
473.astar (unexplained diff vs previous) 15.000 87.50%
473.astar (unexplained diff vs previous) (percentage) 0.310 82.35%
481.wrf (avg) (percentage) 1.900 -
481.wrf (max) (percentage) 4.420 -1.78%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.670 -2.34%
482.sphinx3 (max) 15.000 -6.25%
482.sphinx3 (max) (percentage) 2.240 -11.11%
482.sphinx3 (unexplained diff vs previous) 2.000 -66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.300 -66.29%
483.xalancbmk (avg) (percentage) 1.860 -
483.xalancbmk (max) (percentage) 2.640 -
Geometric Mean 5.534 10.72%