Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2b53203690f3c6baa92b4c6007bc587c3c39844f (+ 84 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4b0860d029f3cd61485d97c3620a5935b398b178 (+ 12 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (+ 162 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/137/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0137 (3-changed-components) 2024-03-05T23:28:11 0:00:00
Previous 0134 (3-changed-components) 2024-02-24T22:55:59 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 24
Performance Improvements 155 9
Added Tests 2 138
Unchanged Tests 1038 1029
Total Tests 1200

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) (percentage) 6.98% 0.860 0.920 - 0.00% -
447.dealII (unexplained diff vs previous) 6.67% 15.000 16.000 - 0.00% -
447.dealII (max) (percentage) 5.81% 0.860 0.910 - 0.00% -
464.h264ref 4.35% 23.000 24.000 - 0.00% -
464.h264ref (avg) 4.35% 23.000 24.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -8.47% 59.000 54.000 - 1.89% -
401.bzip2 -2.24% 2769.000 2707.000 - 3.44% -
435.gromacs -1.82% 5728.000 5624.000 - 3.63% -
400.perlbench -1.16% 1549.000 1531.000 - 11.83% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -98.46% 260.000 4.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -98.45% 28.420 0.440 - 0.00% -
458.sjeng (unexplained diff vs previous) -97.75% 89.000 2.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -97.48% 1.190 0.030 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -96.12% 3.610 0.140 - 0.00% -
437.leslie3d (unexplained diff vs previous) -96.11% 360.000 14.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -94.38% 89.000 5.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -94.22% 1.730 0.100 - 0.00% -
473.astar (unexplained diff vs previous) -92.47% 186.000 14.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -92.41% 3.690 0.280 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -90.00% 2.000 0.200 - 0.00% -
465.tonto (unexplained diff vs previous) -89.80% 196.000 20.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -89.29% 5.230 0.560 - 0.00% -
450.soplex (unexplained diff vs previous) -89.29% 28.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -85.71% 21.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -85.56% 1.870 0.270 - 0.00% -
445.gobmk (unexplained diff vs previous) -81.91% 94.000 17.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -81.91% 1.880 0.340 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -80.77% 1.300 0.250 - 0.00% -
436.cactusADM (unexplained diff vs previous) -80.65% 31.000 6.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -66.67% 12.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -66.46% 1.580 0.530 - 0.00% -
470.lbm (unexplained diff vs previous) -64.29% 70.000 25.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -63.89% 1.800 0.650 - 0.00% -
416.gamess (unexplained diff vs previous) -63.16% 19.000 7.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -61.54% 0.130 0.050 - 0.00% -
482.sphinx3 (max) (percentage) -54.20% 2.620 1.200 - 0.00% -
401.bzip2 (unexplained diff vs previous) -53.38% 133.000 62.000 - 0.00% -
482.sphinx3 (max) -52.63% 19.000 9.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -52.51% 219.000 104.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -52.29% 4.800 2.290 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -52.17% 1.380 0.660 - 0.00% -
410.bwaves (unexplained diff vs previous) -52.00% 25.000 12.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -51.57% 3.820 1.850 - 0.00% -
434.zeusmp (unexplained diff vs previous) -51.52% 33.000 16.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -51.02% 0.490 0.240 - 0.00% -
453.povray (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -49.45% 0.910 0.460 - 0.00% -
444.namd (unexplained diff vs previous) -42.86% 7.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -42.86% 0.910 0.520 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -42.00% 1.500 0.870 - 0.00% -
471.omnetpp (unexplained diff vs previous) -41.67% 36.000 21.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -40.00% 15.000 9.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -39.53% 0.430 0.260 - 0.00% -
459.GemsFDTD (max) -36.19% 105.000 67.000 - 0.00% -
459.GemsFDTD (max) (percentage) -35.92% 2.060 1.320 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -29.17% 0.720 0.510 - 0.00% -
464.h264ref (unexplained diff vs previous) -28.57% 42.000 30.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -28.00% 25.000 18.000 - 0.00% -
458.sjeng (max) -27.17% 92.000 67.000 - 0.00% -
458.sjeng (max) (percentage) -26.83% 1.230 0.900 - 0.00% -
470.lbm (max) -26.76% 71.000 52.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -26.71% 1.610 1.180 - 0.00% -
436.cactusADM (max) -26.67% 30.000 22.000 - 0.00% -
401.bzip2 (max) -26.62% 139.000 102.000 - 0.00% -
435.gromacs (max) -26.43% 227.000 167.000 - 0.00% -
445.gobmk (max) -25.26% 95.000 71.000 - 0.00% -
429.mcf (max) -25.25% 202.000 151.000 - 0.00% -
470.lbm (max) (percentage) -25.14% 1.830 1.370 - 0.00% -
433.milc (max) (percentage) -25.13% 1.910 1.430 - 0.00% -
435.gromacs (max) (percentage) -25.13% 3.980 2.980 - 0.00% -
465.tonto (max) -25.13% 199.000 149.000 - 0.00% -
473.astar (max) (percentage) -25.07% 3.830 2.870 - 0.00% -
436.cactusADM (max) (percentage) -25.00% 1.280 0.960 - 0.00% -
445.gobmk (max) (percentage) -25.00% 1.920 1.440 - 0.00% -
450.soplex (max) (percentage) -25.00% 5.520 4.140 - 0.00% -
465.tonto (max) (percentage) -25.00% 2.040 1.530 - 0.00% -
434.zeusmp (max) (percentage) -25.00% 1.400 1.050 - 0.00% -
429.mcf (max) (percentage) -24.99% 22.130 16.600 - 0.00% -
401.bzip2 (max) (percentage) -24.95% 5.050 3.790 - 0.00% -
473.astar (max) -24.87% 193.000 145.000 - 0.00% -
464.h264ref (max) (percentage) -24.66% 0.730 0.550 - 0.00% -
434.zeusmp (max) -24.24% 33.000 25.000 - 0.00% -
450.soplex (max) -24.14% 29.000 22.000 - 0.00% -
433.milc (max) -23.81% 21.000 16.000 - 0.00% -
464.h264ref (max) -23.81% 42.000 32.000 - 0.00% -
456.hmmer (max) -20.00% 15.000 12.000 - 0.00% -
453.povray (max) (percentage) -16.67% 0.900 0.750 - 0.00% -
456.hmmer (max) (percentage) -16.28% 0.430 0.360 - 0.00% -
444.namd (max) -14.29% 7.000 6.000 - 0.00% -
437.leslie3d (max) -12.60% 373.000 326.000 - 0.00% -
437.leslie3d (max) (percentage) -12.53% 3.750 3.280 - 0.00% -
400.perlbench (max) (percentage) -10.05% 2.190 1.970 - 0.00% -
403.gcc (max) -10.00% 10.000 9.000 - 0.00% -
444.namd (max) (percentage) -9.78% 0.920 0.830 - 0.00% -
400.perlbench (max) -9.09% 33.000 30.000 - 0.00% -
471.omnetpp (max) (percentage) -8.65% 2.660 2.430 - 0.00% -
471.omnetpp (max) -7.94% 63.000 58.000 - 0.00% -
462.libquantum (max) (percentage) -7.36% 3.670 3.400 - 0.00% -
433.milc -7.14% 14.000 13.000 - 0.00% -
433.milc (avg) -7.14% 14.000 13.000 - 0.00% -
416.gamess (max) -6.38% 47.000 44.000 - 0.00% -
416.gamess (max) (percentage) -6.06% 0.330 0.310 - 0.00% -
410.bwaves (max) -5.88% 68.000 64.000 - 0.00% -
447.dealII -5.88% 17.000 16.000 - 0.00% -
447.dealII (avg) -5.88% 17.000 16.000 - 0.00% -
429.mcf -5.48% 73.000 69.000 - 0.00% -
429.mcf (avg) -5.48% 73.000 69.000 - 0.00% -
410.bwaves (max) (percentage) -5.26% 1.330 1.260 - 0.00% -
462.libquantum (avg) (percentage) -5.23% 1.720 1.630 - 0.00% -
465.tonto -5.21% 96.000 91.000 - 0.00% -
465.tonto (avg) -5.21% 96.000 91.000 - 0.00% -
458.sjeng (avg) (percentage) -5.08% 0.590 0.560 - 0.00% -
465.tonto (avg) (percentage) -5.05% 0.990 0.940 - 0.00% -
437.leslie3d -5.03% 457.000 434.000 - 0.00% -
437.leslie3d (avg) -5.03% 457.000 434.000 - 0.00% -
437.leslie3d (avg) (percentage) -5.01% 4.590 4.360 - 0.00% -
400.perlbench -5.00% 20.000 19.000 - 0.00% -
400.perlbench (avg) -5.00% 20.000 19.000 - 0.00% -
434.zeusmp -4.76% 21.000 20.000 - 0.00% -
434.zeusmp (avg) -4.76% 21.000 20.000 - 0.00% -
445.gobmk -4.65% 43.000 41.000 - 0.00% -
445.gobmk (avg) -4.65% 43.000 41.000 - 0.00% -
445.gobmk (avg) (percentage) -4.60% 0.870 0.830 - 0.00% -
458.sjeng -4.55% 44.000 42.000 - 0.00% -
458.sjeng (avg) -4.55% 44.000 42.000 - 0.00% -
429.mcf (avg) (percentage) -4.39% 7.980 7.630 - 0.00% -
416.gamess (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
450.soplex (avg) (percentage) -4.23% 2.600 2.490 - 0.00% -
473.astar (avg) (percentage) -4.17% 1.680 1.610 - 0.00% -
410.bwaves (avg) (percentage) -3.88% 1.030 0.990 - 0.00% -
410.bwaves -3.85% 52.000 50.000 - 0.00% -
410.bwaves (avg) -3.85% 52.000 50.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -3.68% 1.360 1.310 - 0.00% -
473.astar -3.57% 84.000 81.000 - 0.00% -
473.astar (avg) -3.57% 84.000 81.000 - 0.00% -
435.gromacs -3.50% 143.000 138.000 - 0.00% -
435.gromacs (avg) -3.50% 143.000 138.000 - 0.00% -
482.sphinx3 (avg) (percentage) -3.31% 1.510 1.460 - 0.00% -
433.milc (avg) (percentage) -3.17% 1.260 1.220 - 0.00% -
416.gamess -3.12% 32.000 31.000 - 0.00% -
416.gamess (avg) -3.12% 32.000 31.000 - 0.00% -
436.cactusADM (avg) (percentage) -2.99% 0.670 0.650 - 0.00% -
459.GemsFDTD -2.90% 69.000 67.000 - 0.00% -
459.GemsFDTD (avg) -2.90% 69.000 67.000 - 0.00% -
470.lbm -2.78% 36.000 35.000 - 0.00% -
470.lbm (avg) -2.78% 36.000 35.000 - 0.00% -
471.omnetpp -2.50% 40.000 39.000 - 0.00% -
471.omnetpp (avg) -2.50% 40.000 39.000 - 0.00% -
453.povray (avg) (percentage) -2.47% 0.810 0.790 - 0.00% -
471.omnetpp (avg) (percentage) -2.38% 1.680 1.640 - 0.00% -
470.lbm (avg) (percentage) -2.11% 0.950 0.930 - 0.00% -
435.gromacs (avg) (percentage) -1.60% 2.500 2.460 - 0.00% -
483.xalancbmk (max) (percentage) -1.60% 1.250 1.230 - 0.00% -
403.gcc (max) (percentage) -1.50% 18.000 17.730 - 0.00% -
401.bzip2 -1.49% 67.000 66.000 - 0.00% -
401.bzip2 (avg) -1.49% 67.000 66.000 - 0.00% -
444.namd (avg) (percentage) -1.41% 0.710 0.700 - 0.00% -
481.wrf (max) (percentage) -1.30% 0.770 0.760 - 0.00% -
454.calculix (max) (percentage) -1.24% 4.020 3.970 - 0.00% -
434.zeusmp (avg) (percentage) -1.14% 0.880 0.870 - 0.00% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.91% 23410.000 24559.000 - 0.00% -
459.GemsFDTD 3.30% 332309.000 343277.000 - 0.00% -
437.leslie3d 2.31% 82727.000 84635.000 - 0.00% -
444.namd 2.13% 223054.000 227802.000 - 0.00% -
465.tonto 1.52% 3107830.000 3155098.000 - 0.00% -
416.gamess 1.32% 7145862.000 7240451.000 - 0.00% -
447.dealII 1.02% 2447503.000 2472572.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 11.83% 1369.000 1531.000 - -1.16% -
473.astar 7.32% 4714.000 5059.000 - 0.28% -
458.sjeng 6.48% 7048.000 7505.000 - 0.03% -
450.soplex 4.47% 515.000 538.000 - 0.56% -
435.gromacs 3.63% 5427.000 5624.000 - -1.82% -
401.bzip2 3.44% 2617.000 2707.000 - -2.24% -
471.omnetpp 2.93% 2351.000 2420.000 - 0.88% -
465.tonto 2.72% 9514.000 9773.000 - -0.20% -
482.sphinx3 2.71% 737.000 757.000 - -0.53% -
433.milc 2.10% 1096.000 1119.000 - -0.27% -
416.gamess 2.09% 14025.000 14318.000 - 0.05% -
403.gcc 1.89% 53.000 54.000 - -8.47% -
459.GemsFDTD 1.36% 5078.000 5147.000 - 0.10% -
434.zeusmp 1.09% 2384.000 2410.000 - 0.67% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - 0.00% -
nb_execution_successful -10.34% 29.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.40% 31376.000 30624.000 - 0.00% -
453.povray -2.38% 768026.000 749779.000 - 0.00% -
403.gcc -1.51% 2862353.000 2819205.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -18.37% 1116.000 911.000 - -0.44% -
462.libquantum -9.91% 111.000 100.000 - 0.00% -
410.bwaves -2.82% 5252.000 5104.000 - -0.23% -
453.povray -2.46% 447.000 436.000 - -0.46% -
447.dealII -1.14% 1757.000 1737.000 - -0.91% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1531.000 -1.16%
401.bzip2 2707.000 -2.24%
403.gcc 54.000 -8.47%
410.bwaves 5104.000 -
416.gamess 14318.000 -
429.mcf 911.000 -
433.milc 1119.000 -
434.zeusmp 2410.000 -
435.gromacs 5624.000 -1.82%
436.cactusADM 2388.000 -
437.leslie3d 9956.000 -
444.namd 766.000 -
445.gobmk 4979.000 -
447.dealII 1737.000 -
450.soplex 538.000 -
453.povray 436.000 -
456.hmmer 3481.000 -
458.sjeng 7505.000 -
459.GemsFDTD 5147.000 -
462.libquantum 100.000 -
464.h264ref 5858.000 -
465.tonto 9773.000 -
470.lbm 3861.000 -
471.omnetpp 2420.000 -
473.astar 5059.000 -
482.sphinx3 757.000 -
Geometric Mean 2097.023 -
Name Current %
400.perlbench 986215.000 -
401.bzip2 52540.000 -
403.gcc 2819205.000 -
410.bwaves 24559.000 -
416.gamess 7240451.000 -
429.mcf 10363.000 -
433.milc 98558.000 -
434.zeusmp 234146.000 -
435.gromacs 741177.000 -
436.cactusADM 586571.000 -
437.leslie3d 84635.000 -
444.namd 227802.000 -
445.gobmk 1359853.000 -
447.dealII 2472572.000 -
450.soplex 298173.000 -
453.povray 749779.000 -
456.hmmer 234745.000 -
458.sjeng 126084.000 -
459.GemsFDTD 343277.000 -
462.libquantum 32383.000 -
464.h264ref 472436.000 -
465.tonto 3155098.000 -
470.lbm 11190.000 -
471.omnetpp 502098.000 -
473.astar 30624.000 -
482.sphinx3 153287.000 -
Geometric Mean 258051.843 -
Name Current %
400.perlbench 19.000 -5.00%
400.perlbench (avg) 19.000 -5.00%
400.perlbench (avg) (percentage) 1.290 -
400.perlbench (max) 30.000 -9.09%
400.perlbench (max) (percentage) 1.970 -10.05%
400.perlbench (unexplained diff vs previous) 18.000 -28.00%
400.perlbench (unexplained diff vs previous) (percentage) 1.180 -26.71%
401.bzip2 66.000 -1.49%
401.bzip2 (avg) 66.000 -1.49%
401.bzip2 (avg) (percentage) 2.440 -
401.bzip2 (max) 102.000 -26.62%
401.bzip2 (max) (percentage) 3.790 -24.95%
401.bzip2 (unexplained diff vs previous) 62.000 -53.38%
401.bzip2 (unexplained diff vs previous) (percentage) 2.290 -52.29%
403.gcc 4.000 -
403.gcc (avg) 4.000 -
403.gcc (avg) (percentage) 7.670 -
403.gcc (max) 9.000 -10.00%
403.gcc (max) (percentage) 17.730 -1.50%
410.bwaves 50.000 -3.85%
410.bwaves (avg) 50.000 -3.85%
410.bwaves (avg) (percentage) 0.990 -3.88%
410.bwaves (max) 64.000 -5.88%
410.bwaves (max) (percentage) 1.260 -5.26%
410.bwaves (unexplained diff vs previous) 12.000 -52.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.240 -51.02%
416.gamess 31.000 -3.12%
416.gamess (avg) 31.000 -3.12%
416.gamess (avg) (percentage) 0.220 -4.35%
416.gamess (max) 44.000 -6.38%
416.gamess (max) (percentage) 0.310 -6.06%
416.gamess (unexplained diff vs previous) 7.000 -63.16%
416.gamess (unexplained diff vs previous) (percentage) 0.050 -61.54%
429.mcf 69.000 -5.48%
429.mcf (avg) 69.000 -5.48%
429.mcf (avg) (percentage) 7.630 -4.39%
429.mcf (max) 151.000 -25.25%
429.mcf (max) (percentage) 16.600 -24.99%
429.mcf (unexplained diff vs previous) 4.000 -98.46%
429.mcf (unexplained diff vs previous) (percentage) 0.440 -98.45%
433.milc 13.000 -7.14%
433.milc (avg) 13.000 -7.14%
433.milc (avg) (percentage) 1.220 -3.17%
433.milc (max) 16.000 -23.81%
433.milc (max) (percentage) 1.430 -25.13%
433.milc (unexplained diff vs previous) 3.000 -85.71%
433.milc (unexplained diff vs previous) (percentage) 0.270 -85.56%
434.zeusmp 20.000 -4.76%
434.zeusmp (avg) 20.000 -4.76%
434.zeusmp (avg) (percentage) 0.870 -1.14%
434.zeusmp (max) 25.000 -24.24%
434.zeusmp (max) (percentage) 1.050 -25.00%
434.zeusmp (unexplained diff vs previous) 16.000 -51.52%
434.zeusmp (unexplained diff vs previous) (percentage) 0.660 -52.17%
435.gromacs 138.000 -3.50%
435.gromacs (avg) 138.000 -3.50%
435.gromacs (avg) (percentage) 2.460 -1.60%
435.gromacs (max) 167.000 -26.43%
435.gromacs (max) (percentage) 2.980 -25.13%
435.gromacs (unexplained diff vs previous) 104.000 -52.51%
435.gromacs (unexplained diff vs previous) (percentage) 1.850 -51.57%
436.cactusADM 15.000 -
436.cactusADM (avg) 15.000 -
436.cactusADM (avg) (percentage) 0.650 -2.99%
436.cactusADM (max) 22.000 -26.67%
436.cactusADM (max) (percentage) 0.960 -25.00%
436.cactusADM (unexplained diff vs previous) 6.000 -80.65%
436.cactusADM (unexplained diff vs previous) (percentage) 0.250 -80.77%
437.leslie3d 434.000 -5.03%
437.leslie3d (avg) 434.000 -5.03%
437.leslie3d (avg) (percentage) 4.360 -5.01%
437.leslie3d (max) 326.000 -12.60%
437.leslie3d (max) (percentage) 3.280 -12.53%
437.leslie3d (unexplained diff vs previous) 14.000 -96.11%
437.leslie3d (unexplained diff vs previous) (percentage) 0.140 -96.12%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.700 -1.41%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.830 -9.78%
444.namd (unexplained diff vs previous) 4.000 -42.86%
444.namd (unexplained diff vs previous) (percentage) 0.520 -42.86%
445.gobmk 41.000 -4.65%
445.gobmk (avg) 41.000 -4.65%
445.gobmk (avg) (percentage) 0.830 -4.60%
445.gobmk (max) 71.000 -25.26%
445.gobmk (max) (percentage) 1.440 -25.00%
445.gobmk (unexplained diff vs previous) 17.000 -81.91%
445.gobmk (unexplained diff vs previous) (percentage) 0.340 -81.91%
447.dealII 16.000 -5.88%
447.dealII (avg) 16.000 -5.88%
447.dealII (avg) (percentage) 0.970 -
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 0.910 5.81%
447.dealII (unexplained diff vs previous) 16.000 6.67%
447.dealII (unexplained diff vs previous) (percentage) 0.920 6.98%
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.490 -4.23%
450.soplex (max) 22.000 -24.14%
450.soplex (max) (percentage) 4.140 -25.00%
450.soplex (unexplained diff vs previous) 3.000 -89.29%
450.soplex (unexplained diff vs previous) (percentage) 0.560 -89.29%
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.790 -2.47%
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.750 -16.67%
453.povray (unexplained diff vs previous) 2.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.460 -49.45%
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 3.970 -1.24%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 12.000 -20.00%
456.hmmer (max) (percentage) 0.360 -16.28%
456.hmmer (unexplained diff vs previous) 9.000 -40.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.260 -39.53%
458.sjeng 42.000 -4.55%
458.sjeng (avg) 42.000 -4.55%
458.sjeng (avg) (percentage) 0.560 -5.08%
458.sjeng (max) 67.000 -27.17%
458.sjeng (max) (percentage) 0.900 -26.83%
458.sjeng (unexplained diff vs previous) 2.000 -97.75%
458.sjeng (unexplained diff vs previous) (percentage) 0.030 -97.48%
459.GemsFDTD 67.000 -2.90%
459.GemsFDTD (avg) 67.000 -2.90%
459.GemsFDTD (avg) (percentage) 1.310 -3.68%
459.GemsFDTD (max) 67.000 -36.19%
459.GemsFDTD (max) (percentage) 1.320 -35.92%
459.GemsFDTD (unexplained diff vs previous) 5.000 -94.38%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.100 -94.22%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.630 -5.23%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.400 -7.36%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 24.000 4.35%
464.h264ref (avg) 24.000 4.35%
464.h264ref (avg) (percentage) 0.410 -
464.h264ref (max) 32.000 -23.81%
464.h264ref (max) (percentage) 0.550 -24.66%
464.h264ref (unexplained diff vs previous) 30.000 -28.57%
464.h264ref (unexplained diff vs previous) (percentage) 0.510 -29.17%
465.tonto 91.000 -5.21%
465.tonto (avg) 91.000 -5.21%
465.tonto (avg) (percentage) 0.940 -5.05%
465.tonto (max) 149.000 -25.13%
465.tonto (max) (percentage) 1.530 -25.00%
465.tonto (unexplained diff vs previous) 20.000 -89.80%
465.tonto (unexplained diff vs previous) (percentage) 0.200 -90.00%
470.lbm 35.000 -2.78%
470.lbm (avg) 35.000 -2.78%
470.lbm (avg) (percentage) 0.930 -2.11%
470.lbm (max) 52.000 -26.76%
470.lbm (max) (percentage) 1.370 -25.14%
470.lbm (unexplained diff vs previous) 25.000 -64.29%
470.lbm (unexplained diff vs previous) (percentage) 0.650 -63.89%
471.omnetpp 39.000 -2.50%
471.omnetpp (avg) 39.000 -2.50%
471.omnetpp (avg) (percentage) 1.640 -2.38%
471.omnetpp (max) 58.000 -7.94%
471.omnetpp (max) (percentage) 2.430 -8.65%
471.omnetpp (unexplained diff vs previous) 21.000 -41.67%
471.omnetpp (unexplained diff vs previous) (percentage) 0.870 -42.00%
473.astar 81.000 -3.57%
473.astar (avg) 81.000 -3.57%
473.astar (avg) (percentage) 1.610 -4.17%
473.astar (max) 145.000 -24.87%
473.astar (max) (percentage) 2.870 -25.07%
473.astar (unexplained diff vs previous) 14.000 -92.47%
473.astar (unexplained diff vs previous) (percentage) 0.280 -92.41%
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.760 -1.30%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.460 -3.31%
482.sphinx3 (max) 9.000 -52.63%
482.sphinx3 (max) (percentage) 1.200 -54.20%
482.sphinx3 (unexplained diff vs previous) 4.000 -66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.530 -66.46%
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.230 -1.60%
Geometric Mean 4.813 -43.88%