Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c588e374965509b81a623ce9ef79a026f27d2592 (+ 22 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/442db842f3fbcbf4e92ea6f686631d48c45e0142 (+ 99 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=35dc62de3d5d73a91d4ca8fa9799b510a34d170d (+ 10 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/25cd1b6c4571a4d82346fe97e81e280f64129355 (+ 120 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/226/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0226 (4-changed-components) 2024-09-15T13:09:57 0:00:00
Previous 0224 (4-changed-components) 2024-09-10T08:43:54 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 62 16
Performance Improvements 83 10
Added Tests 2 132
Unchanged Tests 1029 1018
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.02% 99.000 101.000 - -9.01% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 500.00% 2.000 12.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 466.67% 0.060 0.340 0.000 0.00% 0.000
462.libquantum (max) 100.00% 1.000 2.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 73.91% 2.070 3.600 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 67.80% 118.000 198.000 0.000 0.00% 0.000
435.gromacs (max) (percentage) 64.15% 2.120 3.480 - 0.00% -
435.gromacs (max) 59.17% 120.000 191.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 57.80% 1.730 2.730 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 53.49% 43.000 66.000 0.000 0.00% 0.000
471.omnetpp (max) (percentage) 51.14% 1.760 2.660 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 50.00% 1.040 1.560 0.000 0.00% 0.000
456.hmmer (max) 50.00% 8.000 12.000 - 0.00% -
471.omnetpp (max) 48.84% 43.000 64.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 48.58% 2.120 3.150 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 48.00% 25.000 37.000 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 46.67% 1.050 1.540 - 0.00% -
434.zeusmp (max) 44.00% 25.000 36.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 43.75% 16.000 23.000 0.000 0.00% 0.000
456.hmmer (max) (percentage) 40.00% 0.250 0.350 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 39.52% 3.340 4.660 0.000 0.00% 0.000
482.sphinx3 (max) 37.50% 16.000 22.000 - 0.00% -
482.sphinx3 (max) (percentage) 36.77% 2.230 3.050 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 35.25% 19.460 26.320 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 33.33% 39.000 52.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) 31.17% 1.540 2.020 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 25.86% 1.740 2.190 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 23.40% 47.000 58.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) 21.46% 2.610 3.170 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) 17.76% 259.000 305.000 0.000 0.00% 0.000
465.tonto (max) (percentage) 14.55% 2.680 3.070 - 0.00% -
465.tonto (max) 10.90% 266.000 295.000 - 0.00% -
437.leslie3d (avg) (percentage) 7.61% 5.390 5.800 - 0.00% -
437.leslie3d (unexplained diff vs previous) 7.07% 2391.000 2560.000 0.000 0.00% 0.000
465.tonto (avg) (percentage) 6.73% 1.040 1.110 - 0.00% -
429.mcf (max) (percentage) 6.21% 4.190 4.450 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 5.22% 1.340 1.410 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 4.90% 4.490 4.710 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 3.96% 101.000 105.000 0.000 0.00% 0.000
445.gobmk (avg) (percentage) 3.95% 0.760 0.790 - 0.00% -
458.sjeng (avg) (percentage) 3.70% 0.540 0.560 - 0.00% -
482.sphinx3 (avg) (percentage) 3.15% 1.270 1.310 - 0.00% -
465.tonto 2.91% 103.000 106.000 - 0.00% -
465.tonto (avg) 2.91% 103.000 106.000 - 0.00% -
473.astar (avg) (percentage) 2.76% 1.450 1.490 - 0.00% -
450.soplex (avg) (percentage) 2.59% 2.320 2.380 - 0.00% -
410.bwaves (avg) (percentage) 2.53% 0.790 0.810 - 0.00% -
410.bwaves 2.50% 40.000 41.000 - 0.00% -
410.bwaves (avg) 2.50% 40.000 41.000 - 0.00% -
458.sjeng 2.50% 40.000 41.000 - 0.00% -
458.sjeng (avg) 2.50% 40.000 41.000 - 0.00% -
433.milc (avg) (percentage) 2.44% 0.820 0.840 - 0.00% -
458.sjeng (max) (percentage) 2.21% 1.360 1.390 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 2.13% 1.880 1.920 0.000 0.00% 0.000
429.mcf (max) 2.08% 48.000 49.000 - 0.00% -
436.cactusADM (avg) (percentage) 2.04% 0.490 0.500 - 0.00% -
471.omnetpp (avg) (percentage) 2.01% 1.490 1.520 - 0.00% -
459.GemsFDTD (avg) (percentage) 1.85% 1.080 1.100 - 0.00% -
435.gromacs (avg) (percentage) 1.51% 1.990 2.020 - 0.00% -
401.bzip2 (avg) (percentage) 1.19% 1.680 1.700 - 0.00% -
434.zeusmp (avg) (percentage) 1.18% 0.850 0.860 - 0.00% -
470.lbm (avg) (percentage) 1.18% 0.850 0.860 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -20.84% 12287.000 9727.000 - -1.36% -
450.soplex -4.49% 534.000 510.000 - -0.97% -
429.mcf -4.45% 1168.000 1116.000 - 0.00% -
435.gromacs -3.48% 5691.000 5493.000 - 1.22% -
465.tonto -3.07% 9941.000 9636.000 - 1.28% -
482.sphinx3 -3.05% 754.000 731.000 - -0.81% -
473.astar -2.70% 5009.000 4874.000 - 3.39% -
471.omnetpp -2.66% 2483.000 2417.000 - 2.81% -
401.bzip2 -2.15% 2702.000 2644.000 - 1.03% -
459.GemsFDTD -1.98% 5139.000 5037.000 - -0.81% -
445.gobmk -1.91% 5025.000 4929.000 - -0.42% -
433.milc -1.88% 1115.000 1094.000 - -0.18% -
410.bwaves -1.63% 5156.000 5072.000 - -3.43% -
434.zeusmp -1.54% 2406.000 2369.000 - -0.63% -
458.sjeng -1.39% 7528.000 7423.000 - 5.32% -
470.lbm -1.31% 3883.000 3832.000 - -0.26% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) -75.61% 41.000 10.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -75.56% 2.700 0.660 0.000 0.00% 0.000
453.povray (max) (percentage) -57.76% 2.320 0.980 - 0.00% -
447.dealII (unexplained diff vs previous) -56.41% 39.000 17.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -55.80% 2.240 0.990 0.000 0.00% 0.000
453.povray (max) -55.56% 9.000 4.000 - 0.00% -
444.namd (max) -40.00% 5.000 3.000 - 0.00% -
470.lbm (unexplained diff vs previous) -37.80% 82.000 51.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) -37.14% 35.000 22.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -36.97% 2.110 1.330 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -36.67% 0.600 0.380 0.000 0.00% 0.000
444.namd (max) (percentage) -34.25% 0.730 0.480 - 0.00% -
437.leslie3d (max) -31.70% 2968.000 2027.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -30.61% 147.000 102.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -29.02% 2.860 2.030 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -25.00% 4.000 3.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -25.00% 0.520 0.390 0.000 0.00% 0.000
410.bwaves (max) -24.77% 109.000 82.000 - 0.00% -
410.bwaves (max) (percentage) -23.11% 2.120 1.630 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -22.50% 1.200 0.930 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -21.43% 28.000 22.000 0.000 0.00% 0.000
436.cactusADM (max) (percentage) -20.34% 1.180 0.940 - 0.00% -
436.cactusADM (max) -18.52% 27.000 22.000 - 0.00% -
400.perlbench (max) -15.91% 44.000 37.000 - 0.00% -
437.leslie3d -14.80% 662.000 564.000 - 0.00% -
437.leslie3d (avg) -14.80% 662.000 564.000 - 0.00% -
459.GemsFDTD (max) -14.57% 151.000 129.000 - 0.00% -
400.perlbench (max) (percentage) -14.14% 2.900 2.490 - 0.00% -
437.leslie3d (max) (percentage) -13.74% 24.160 20.840 - 0.00% -
459.GemsFDTD (max) (percentage) -12.59% 2.940 2.570 - 0.00% -
450.soplex (max) -12.00% 25.000 22.000 - 0.00% -
473.astar (max) -10.88% 147.000 131.000 - 0.00% -
470.lbm (max) -10.84% 83.000 74.000 - 0.00% -
445.gobmk (max) -10.48% 105.000 94.000 - 0.00% -
470.lbm (max) (percentage) -10.19% 2.160 1.940 - 0.00% -
464.h264ref (max) (percentage) -10.00% 0.600 0.540 - 0.00% -
464.h264ref (max) -8.82% 34.000 31.000 - 0.00% -
445.gobmk (max) (percentage) -8.61% 2.090 1.910 - 0.00% -
473.astar (max) (percentage) -8.16% 2.940 2.700 - 0.00% -
410.bwaves (unexplained diff vs previous) -7.69% 91.000 84.000 0.000 0.00% 0.000
447.dealII (max) -7.69% 39.000 36.000 - 0.00% -
447.dealII (max) (percentage) -6.99% 2.290 2.130 - 0.00% -
445.gobmk (unexplained diff vs previous) -6.80% 103.000 96.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -5.68% 1.760 1.660 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -5.59% 143.000 135.000 0.000 0.00% 0.000
447.dealII -5.56% 18.000 17.000 - 0.00% -
447.dealII (avg) -5.56% 18.000 17.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -4.88% 2.050 1.950 0.000 0.00% 0.000
433.milc (max) -4.76% 21.000 20.000 - 0.00% -
450.soplex (max) (percentage) -4.67% 4.710 4.490 - 0.00% -
429.mcf -4.44% 45.000 43.000 - 0.00% -
429.mcf (avg) -4.44% 45.000 43.000 - 0.00% -
400.perlbench -4.00% 25.000 24.000 - 0.00% -
400.perlbench (avg) -4.00% 25.000 24.000 - 0.00% -
401.bzip2 (max) -3.12% 64.000 62.000 - 0.00% -
470.lbm -3.03% 33.000 32.000 - 0.00% -
470.lbm (avg) -3.03% 33.000 32.000 - 0.00% -
453.povray (avg) (percentage) -2.97% 1.010 0.980 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -2.81% 2.850 2.770 0.000 0.00% 0.000
435.gromacs -2.65% 113.000 110.000 - 0.00% -
435.gromacs (avg) -2.65% 113.000 110.000 - 0.00% -
400.perlbench (avg) (percentage) -2.41% 1.660 1.620 - 0.00% -
401.bzip2 -2.22% 45.000 44.000 - 0.00% -
401.bzip2 (avg) -2.22% 45.000 44.000 - 0.00% -
433.milc (max) (percentage) -2.08% 1.920 1.880 - 0.00% -
401.bzip2 (max) (percentage) -2.08% 2.400 2.350 - 0.00% -
444.namd (avg) (percentage) -1.61% 0.620 0.610 - 0.00% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.16% 23410.000 24383.000 - 0.00% -
465.tonto 3.31% 3107830.000 3210634.000 - 0.00% -
462.libquantum 3.00% 32503.000 33478.000 - 0.00% -
444.namd 2.72% 223054.000 229122.000 - 0.00% -
400.perlbench 2.00% 981846.000 1001511.000 - 0.00% -
447.dealII 1.47% 2447503.000 2483565.000 - 0.00% -
429.mcf 1.44% 10303.000 10451.000 - 0.00% -
471.omnetpp 1.34% 502628.000 509346.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 10.30% 1369.000 1510.000 - -0.66% -
458.sjeng 5.32% 7048.000 7423.000 - -1.39% -
473.astar 3.39% 4714.000 4874.000 - -2.70% -
471.omnetpp 2.81% 2351.000 2417.000 - -2.66% -
465.tonto 1.28% 9514.000 9636.000 - -3.07% -
435.gromacs 1.22% 5427.000 5493.000 - -3.48% -
401.bzip2 1.03% 2617.000 2644.000 - -2.15% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -4.54% 82727.000 78972.000 - 0.00% -
473.astar -1.24% 31376.000 30988.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.01% 111.000 101.000 - 2.02% -
453.povray -3.80% 447.000 430.000 - 0.00% -
410.bwaves -3.43% 5252.000 5072.000 - -1.63% -
447.dealII -1.82% 1757.000 1725.000 - -0.98% -
437.leslie3d -1.36% 9861.000 9727.000 - -20.84% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.41s
Name Current %
400.perlbench 1510.000 -
401.bzip2 2644.000 -2.15%
410.bwaves 5072.000 -1.63%
429.mcf 1116.000 -4.45%
433.milc 1094.000 -1.88%
434.zeusmp 2369.000 -1.54%
435.gromacs 5493.000 -3.48%
436.cactusADM 2361.000 -
437.leslie3d 9727.000 -20.84%
444.namd 760.000 -
445.gobmk 4929.000 -1.91%
447.dealII 1725.000 -
450.soplex 510.000 -4.49%
453.povray 430.000 -
456.hmmer 3482.000 -
458.sjeng 7423.000 -1.39%
459.GemsFDTD 5037.000 -1.98%
462.libquantum 101.000 2.02%
464.h264ref 5811.000 -
465.tonto 9636.000 -3.07%
470.lbm 3832.000 -1.31%
471.omnetpp 2417.000 -2.66%
473.astar 4874.000 -2.70%
482.sphinx3 731.000 -3.05%
Geometric Mean 2239.904 -2.50%
Name Current %
400.perlbench 1001511.000 -
401.bzip2 52944.000 -
410.bwaves 24383.000 -
429.mcf 10451.000 -
433.milc 98858.000 -
434.zeusmp 233524.000 -
435.gromacs 744421.000 -
436.cactusADM 586879.000 -
437.leslie3d 78972.000 -
444.namd 229122.000 -
445.gobmk 1368757.000 -
447.dealII 2483565.000 -
450.soplex 300558.000 -
453.povray 760911.000 -
456.hmmer 235745.000 -
458.sjeng 125984.000 -
459.GemsFDTD 330593.000 -
462.libquantum 33478.000 -
464.h264ref 472428.000 -
465.tonto 3210634.000 -
470.lbm 11190.000 -
471.omnetpp 509346.000 -
473.astar 30988.000 -
482.sphinx3 153867.000 -
Geometric Mean 203675.900 -
Name Current %
400.perlbench 24.000 -4.00%
400.perlbench (avg) 24.000 -4.00%
400.perlbench (avg) (percentage) 1.620 -2.41%
400.perlbench (max) 37.000 -15.91%
400.perlbench (max) (percentage) 2.490 -14.14%
400.perlbench (unexplained diff vs previous) 10.000 -75.61%
400.perlbench (unexplained diff vs previous) (percentage) 0.660 -75.56%
401.bzip2 44.000 -2.22%
401.bzip2 (avg) 44.000 -2.22%
401.bzip2 (avg) (percentage) 1.700 1.19%
401.bzip2 (max) 62.000 -3.12%
401.bzip2 (max) (percentage) 2.350 -2.08%
401.bzip2 (unexplained diff vs previous) 58.000 23.40%
401.bzip2 (unexplained diff vs previous) (percentage) 2.190 25.86%
403.gcc (avg) (percentage) 7.670 -
403.gcc (max) (percentage) 12.740 -
410.bwaves 41.000 2.50%
410.bwaves (avg) 41.000 2.50%
410.bwaves (avg) (percentage) 0.810 2.53%
410.bwaves (max) 82.000 -24.77%
410.bwaves (max) (percentage) 1.630 -23.11%
410.bwaves (unexplained diff vs previous) 84.000 -7.69%
410.bwaves (unexplained diff vs previous) (percentage) 1.660 -5.68%
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.220 -
429.mcf 43.000 -4.44%
429.mcf (avg) 43.000 -4.44%
429.mcf (avg) (percentage) 3.930 -
429.mcf (max) 49.000 2.08%
429.mcf (max) (percentage) 4.450 6.21%
429.mcf (unexplained diff vs previous) 52.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 4.660 39.52%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.840 2.44%
433.milc (max) 20.000 -4.76%
433.milc (max) (percentage) 1.880 -2.08%
433.milc (unexplained diff vs previous) 21.000 -
433.milc (unexplained diff vs previous) (percentage) 1.920 2.13%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.860 1.18%
434.zeusmp (max) 36.000 44.00%
434.zeusmp (max) (percentage) 1.540 46.67%
434.zeusmp (unexplained diff vs previous) 37.000 48.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.560 50.00%
435.gromacs 110.000 -2.65%
435.gromacs (avg) 110.000 -2.65%
435.gromacs (avg) (percentage) 2.020 1.51%
435.gromacs (max) 191.000 59.17%
435.gromacs (max) (percentage) 3.480 64.15%
435.gromacs (unexplained diff vs previous) 198.000 67.80%
435.gromacs (unexplained diff vs previous) (percentage) 3.600 73.91%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.500 2.04%
436.cactusADM (max) 22.000 -18.52%
436.cactusADM (max) (percentage) 0.940 -20.34%
436.cactusADM (unexplained diff vs previous) 22.000 -21.43%
436.cactusADM (unexplained diff vs previous) (percentage) 0.930 -22.50%
437.leslie3d 564.000 -14.80%
437.leslie3d (avg) 564.000 -14.80%
437.leslie3d (avg) (percentage) 5.800 7.61%
437.leslie3d (max) 2027.000 -31.70%
437.leslie3d (max) (percentage) 20.840 -13.74%
437.leslie3d (unexplained diff vs previous) 2560.000 7.07%
437.leslie3d (unexplained diff vs previous) (percentage) 26.320 35.25%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.610 -1.61%
444.namd (max) 3.000 -40.00%
444.namd (max) (percentage) 0.480 -34.25%
444.namd (unexplained diff vs previous) 3.000 -25.00%
444.namd (unexplained diff vs previous) (percentage) 0.390 -25.00%
445.gobmk 38.000 -
445.gobmk (avg) 38.000 -
445.gobmk (avg) (percentage) 0.790 3.95%
445.gobmk (max) 94.000 -10.48%
445.gobmk (max) (percentage) 1.910 -8.61%
445.gobmk (unexplained diff vs previous) 96.000 -6.80%
445.gobmk (unexplained diff vs previous) (percentage) 1.950 -4.88%
447.dealII 17.000 -5.56%
447.dealII (avg) 17.000 -5.56%
447.dealII (avg) (percentage) 1.040 -
447.dealII (max) 36.000 -7.69%
447.dealII (max) (percentage) 2.130 -6.99%
447.dealII (unexplained diff vs previous) 17.000 -56.41%
447.dealII (unexplained diff vs previous) (percentage) 0.990 -55.80%
450.soplex 12.000 -
450.soplex (avg) 12.000 -
450.soplex (avg) (percentage) 2.380 2.59%
450.soplex (max) 22.000 -12.00%
450.soplex (max) (percentage) 4.490 -4.67%
450.soplex (unexplained diff vs previous) 24.000 -
450.soplex (unexplained diff vs previous) (percentage) 4.710 4.90%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.980 -2.97%
453.povray (max) 4.000 -55.56%
453.povray (max) (percentage) 0.980 -57.76%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 3.120 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.210 -
456.hmmer (max) 12.000 50.00%
456.hmmer (max) (percentage) 0.350 40.00%
456.hmmer (unexplained diff vs previous) 12.000 500.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 466.67%
458.sjeng 41.000 2.50%
458.sjeng (avg) 41.000 2.50%
458.sjeng (avg) (percentage) 0.560 3.70%
458.sjeng (max) 103.000 -
458.sjeng (max) (percentage) 1.390 2.21%
458.sjeng (unexplained diff vs previous) 105.000 3.96%
458.sjeng (unexplained diff vs previous) (percentage) 1.410 5.22%
459.GemsFDTD 55.000 -
459.GemsFDTD (avg) 55.000 -
459.GemsFDTD (avg) (percentage) 1.100 1.85%
459.GemsFDTD (max) 129.000 -14.57%
459.GemsFDTD (max) (percentage) 2.570 -12.59%
459.GemsFDTD (unexplained diff vs previous) 102.000 -30.61%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.030 -29.02%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.750 -
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 2.020 31.17%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.980 -
464.h264ref 22.000 -
464.h264ref (avg) 22.000 -
464.h264ref (avg) (percentage) 0.380 -
464.h264ref (max) 31.000 -8.82%
464.h264ref (max) (percentage) 0.540 -10.00%
464.h264ref (unexplained diff vs previous) 22.000 -37.14%
464.h264ref (unexplained diff vs previous) (percentage) 0.380 -36.67%
465.tonto 106.000 2.91%
465.tonto (avg) 106.000 2.91%
465.tonto (avg) (percentage) 1.110 6.73%
465.tonto (max) 295.000 10.90%
465.tonto (max) (percentage) 3.070 14.55%
465.tonto (unexplained diff vs previous) 305.000 17.76%
465.tonto (unexplained diff vs previous) (percentage) 3.170 21.46%
470.lbm 32.000 -3.03%
470.lbm (avg) 32.000 -3.03%
470.lbm (avg) (percentage) 0.860 1.18%
470.lbm (max) 74.000 -10.84%
470.lbm (max) (percentage) 1.940 -10.19%
470.lbm (unexplained diff vs previous) 51.000 -37.80%
470.lbm (unexplained diff vs previous) (percentage) 1.330 -36.97%
471.omnetpp 36.000 -
471.omnetpp (avg) 36.000 -
471.omnetpp (avg) (percentage) 1.520 2.01%
471.omnetpp (max) 64.000 48.84%
471.omnetpp (max) (percentage) 2.660 51.14%
471.omnetpp (unexplained diff vs previous) 66.000 53.49%
471.omnetpp (unexplained diff vs previous) (percentage) 2.730 57.80%
473.astar 72.000 -
473.astar (avg) 72.000 -
473.astar (avg) (percentage) 1.490 2.76%
473.astar (max) 131.000 -10.88%
473.astar (max) (percentage) 2.700 -8.16%
473.astar (unexplained diff vs previous) 135.000 -5.59%
473.astar (unexplained diff vs previous) (percentage) 2.770 -2.81%
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.670 -
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.310 3.15%
482.sphinx3 (max) 22.000 37.50%
482.sphinx3 (max) (percentage) 3.050 36.77%
482.sphinx3 (unexplained diff vs previous) 23.000 43.75%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.150 48.58%
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.020 -
Geometric Mean 7.011 -1.69%