Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=546c7898dccb204eb56c8ed7c5b707c75de31b53 (+ 46 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/66c7257b675068fe62505d74873371fd0508b499 (+ 48 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=decf02d3825daecb95ee293f7b830c4c0cbd1cc5 (+ 17 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=5212c40d4ee548e36f78eb62a3cf59ce347ab712 (+ 188 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3-build/16/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0016 (4-changed-components) 2023-04-08T20:16:26 0:00:00
Previous 0014 (3-changed-components) 2023-04-04T08:11:52 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T10:24:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 82 15
Performance Improvements 87 5
Added Tests 6 147
Unchanged Tests 1061 1069
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 5.08% 59.000 62.000 - 5.08% -
437.leslie3d 4.22% 8856.000 9230.000 - 3.06% -
429.mcf 3.97% 857.000 891.000 - -20.45% -
401.bzip2 2.70% 2778.000 2853.000 - 7.22% -
435.gromacs 2.48% 5609.000 5748.000 - 5.20% -
471.omnetpp 1.27% 2443.000 2474.000 - 0.81% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 3657.14% 0.070 2.630 - 0.00% -
401.bzip2 (unexplained diff vs previous) 3650.00% 2.000 75.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 3600.00% 0.010 0.370 - 0.00% -
416.gamess (unexplained diff vs previous) 2550.00% 2.000 53.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 1850.00% 2.000 39.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 1766.67% 0.030 0.560 - 0.00% -
429.mcf (max) 600.00% 5.000 35.000 - 0.00% -
429.mcf (max) (percentage) 467.14% 0.700 3.970 - 0.00% -
429.mcf (unexplained diff vs previous) 466.67% 6.000 34.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 445.71% 0.700 3.820 - 0.00% -
471.omnetpp (unexplained diff vs previous) 287.50% 8.000 31.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 278.79% 0.330 1.250 - 0.00% -
435.gromacs (max) 215.56% 45.000 142.000 - 0.00% -
435.gromacs (max) (percentage) 206.17% 0.810 2.480 - 0.00% -
435.gromacs (unexplained diff vs previous) 202.17% 46.000 139.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 195.12% 0.820 2.420 - 0.00% -
401.bzip2 (max) 175.00% 28.000 77.000 - 0.00% -
401.bzip2 (max) (percentage) 167.33% 1.010 2.700 - 0.00% -
416.gamess (max) 70.97% 31.000 53.000 - 0.00% -
416.gamess (max) (percentage) 68.18% 0.220 0.370 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 64.91% 0.570 0.940 - 0.00% -
400.perlbench (unexplained diff vs previous) 62.50% 8.000 13.000 - 0.00% -
453.povray 50.00% 2.000 3.000 - 0.00% -
453.povray (avg) 50.00% 2.000 3.000 - 0.00% -
454.calculix (max) 50.00% 2.000 3.000 - 0.00% -
454.calculix (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -
453.povray (max) (percentage) 45.95% 0.740 1.080 - 0.00% -
454.calculix (max) (percentage) 44.73% 3.510 5.080 - 0.00% -
473.astar (unexplained diff vs previous) 43.75% 32.000 46.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 43.08% 0.650 0.930 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) 42.77% 3.390 4.840 - 0.00% -
473.astar (max) 39.39% 33.000 46.000 - 0.00% -
473.astar (max) (percentage) 36.23% 0.690 0.940 - 0.00% -
453.povray (max) 33.33% 3.000 4.000 - 0.00% -
458.sjeng (max) 31.03% 29.000 38.000 - 0.00% -
458.sjeng (max) (percentage) 30.95% 0.420 0.550 - 0.00% -
454.calculix (avg) (percentage) 29.57% 2.300 2.980 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 24.68% 0.770 0.960 - 0.00% -
401.bzip2 24.24% 33.000 41.000 - 0.00% -
401.bzip2 (avg) 24.24% 33.000 41.000 - 0.00% -
456.hmmer (avg) (percentage) 23.33% 0.300 0.370 - 0.00% -
416.gamess (avg) (percentage) 23.08% 0.130 0.160 - 0.00% -
410.bwaves (unexplained diff vs previous) 22.50% 40.000 49.000 - 0.00% -
416.gamess 22.22% 18.000 22.000 - 0.00% -
416.gamess (avg) 22.22% 18.000 22.000 - 0.00% -
410.bwaves (max) (percentage) 21.79% 0.780 0.950 - 0.00% -
410.bwaves (max) 20.00% 40.000 48.000 - 0.00% -
456.hmmer 20.00% 10.000 12.000 - 0.00% -
456.hmmer (avg) 20.00% 10.000 12.000 - 0.00% -
453.povray (avg) (percentage) 19.35% 0.620 0.740 - 0.00% -
435.gromacs 19.23% 78.000 93.000 - 0.00% -
435.gromacs (avg) 19.23% 78.000 93.000 - 0.00% -
401.bzip2 (avg) (percentage) 18.03% 1.220 1.440 - 0.00% -
436.cactusADM (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
444.namd 16.67% 6.000 7.000 - 0.00% -
444.namd (avg) 16.67% 6.000 7.000 - 0.00% -
435.gromacs (avg) (percentage) 15.71% 1.400 1.620 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 15.38% 0.260 0.300 - 0.00% -
456.hmmer (max) 14.29% 21.000 24.000 - 0.00% -
444.namd (avg) (percentage) 13.10% 0.840 0.950 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 10.64% 1.410 1.560 - 0.00% -
456.hmmer (max) (percentage) 9.23% 0.650 0.710 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 9.23% 0.650 0.710 - 0.00% -
444.namd (unexplained diff vs previous) 9.09% 11.000 12.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 9.09% 22.000 24.000 - 0.00% -
483.xalancbmk (avg) (percentage) 8.46% 1.300 1.410 - 0.00% -
444.namd (max) (percentage) 7.69% 1.430 1.540 - 0.00% -
429.mcf 6.67% 30.000 32.000 - 0.00% -
429.mcf (avg) 6.67% 30.000 32.000 - 0.00% -
483.xalancbmk 6.52% 46.000 49.000 - 0.00% -
483.xalancbmk (avg) 6.52% 46.000 49.000 - 0.00% -
437.leslie3d 4.27% 351.000 366.000 - 0.00% -
437.leslie3d (avg) 4.27% 351.000 366.000 - 0.00% -
471.omnetpp 3.45% 29.000 30.000 - 0.00% -
471.omnetpp (avg) 3.45% 29.000 30.000 - 0.00% -
429.mcf (avg) (percentage) 1.98% 3.530 3.600 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -1.97% 3595.000 3524.000 - 1.03% -
444.namd -1.54% 781.000 769.000 - 0.52% -
453.povray -1.08% 465.000 460.000 - 2.68% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (max) -96.36% 55.000 2.000 - 0.00% -
433.milc (max) (percentage) -95.13% 5.540 0.270 - 0.00% -
447.dealII (unexplained diff vs previous) -92.86% 14.000 1.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -92.55% 0.940 0.070 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -83.33% 12.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -83.15% 1.780 0.300 - 0.00% -
433.milc (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -66.67% 0.300 0.100 - 0.00% -
470.lbm (max) -57.14% 35.000 15.000 - 0.00% -
470.lbm (max) (percentage) -54.81% 1.040 0.470 - 0.00% -
459.GemsFDTD (max) -54.29% 245.000 112.000 - 0.00% -
459.GemsFDTD (max) (percentage) -54.24% 4.830 2.210 - 0.00% -
445.gobmk (max) -44.44% 36.000 20.000 - 0.00% -
445.gobmk (max) (percentage) -43.24% 0.740 0.420 - 0.00% -
464.h264ref (max) (percentage) -42.15% 1.210 0.700 - 0.00% -
464.h264ref (max) -41.18% 68.000 40.000 - 0.00% -
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -32.65% 0.980 0.660 - 0.00% -
434.zeusmp (unexplained diff vs previous) -31.82% 22.000 15.000 - 0.00% -
462.libquantum (max) (percentage) -30.72% 3.060 2.120 - 0.00% -
447.dealII (max) (percentage) -30.00% 1.200 0.840 - 0.00% -
447.dealII (max) -29.41% 17.000 12.000 - 0.00% -
447.dealII (avg) (percentage) -19.23% 0.780 0.630 - 0.00% -
482.sphinx3 -19.05% 21.000 17.000 - 0.00% -
482.sphinx3 (avg) -19.05% 21.000 17.000 - 0.00% -
447.dealII -18.18% 11.000 9.000 - 0.00% -
447.dealII (avg) -18.18% 11.000 9.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -16.67% 2.160 1.800 - 0.00% -
459.GemsFDTD -16.51% 109.000 91.000 - 0.00% -
459.GemsFDTD (avg) -16.51% 109.000 91.000 - 0.00% -
445.gobmk -16.00% 25.000 21.000 - 0.00% -
445.gobmk (avg) -16.00% 25.000 21.000 - 0.00% -
450.soplex -15.79% 19.000 16.000 - 0.00% -
450.soplex (avg) -15.79% 19.000 16.000 - 0.00% -
481.wrf (avg) (percentage) -15.70% 1.210 1.020 - 0.00% -
445.gobmk (avg) (percentage) -15.69% 0.510 0.430 - 0.00% -
450.soplex (avg) (percentage) -15.22% 3.680 3.120 - 0.00% -
470.lbm -15.22% 46.000 39.000 - 0.00% -
470.lbm (avg) -15.22% 46.000 39.000 - 0.00% -
481.wrf -15.09% 53.000 45.000 - 0.00% -
481.wrf (avg) -15.09% 53.000 45.000 - 0.00% -
482.sphinx3 (avg) (percentage) -14.70% 3.130 2.670 - 0.00% -
470.lbm (avg) (percentage) -14.60% 1.370 1.170 - 0.00% -
433.milc (avg) (percentage) -13.71% 1.750 1.510 - 0.00% -
433.milc -11.76% 17.000 15.000 - 0.00% -
433.milc (avg) -11.76% 17.000 15.000 - 0.00% -
434.zeusmp (avg) (percentage) -9.46% 1.480 1.340 - 0.00% -
434.zeusmp -9.09% 33.000 30.000 - 0.00% -
434.zeusmp (avg) -9.09% 33.000 30.000 - 0.00% -
436.cactusADM -9.09% 11.000 10.000 - 0.00% -
436.cactusADM (avg) -9.09% 11.000 10.000 - 0.00% -
400.perlbench (max) (percentage) -8.11% 1.110 1.020 - 0.00% -
483.xalancbmk (max) -8.00% 75.000 69.000 - 0.00% -
465.tonto (max) (percentage) -7.35% 0.680 0.630 - 0.00% -
400.perlbench (max) -6.67% 15.000 14.000 - 0.00% -
465.tonto (max) -6.56% 61.000 57.000 - 0.00% -
471.omnetpp (max) (percentage) -6.29% 1.750 1.640 - 0.00% -
483.xalancbmk (max) (percentage) -6.19% 2.100 1.970 - 0.00% -
436.cactusADM (avg) (percentage) -6.12% 0.490 0.460 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -5.88% 17.000 16.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -5.41% 0.740 0.700 - 0.00% -
464.h264ref (unexplained diff vs previous) -4.76% 42.000 40.000 - 0.00% -
471.omnetpp (max) -4.76% 42.000 40.000 - 0.00% -
437.leslie3d (max) (percentage) -4.76% 10.300 9.810 - 0.00% -
410.bwaves -4.69% 64.000 61.000 - 0.00% -
410.bwaves (avg) -4.69% 64.000 61.000 - 0.00% -
462.libquantum (avg) (percentage) -4.65% 1.290 1.230 - 0.00% -
450.soplex (max) -4.17% 24.000 23.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -4.05% 74.000 71.000 - 0.00% -
473.astar (avg) (percentage) -4.00% 1.250 1.200 - 0.00% -
473.astar -3.28% 61.000 59.000 - 0.00% -
473.astar (avg) -3.28% 61.000 59.000 - 0.00% -
410.bwaves (avg) (percentage) -3.23% 1.240 1.200 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -3.03% 0.330 0.320 - 0.00% -
458.sjeng -2.63% 38.000 37.000 - 0.00% -
458.sjeng (avg) -2.63% 38.000 37.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -2.43% 2.060 2.010 - 0.00% -
450.soplex (max) (percentage) -2.16% 4.620 4.520 - 0.00% -
481.wrf (max) (percentage) -2.13% 2.820 2.760 - 0.00% -
436.cactusADM (max) (percentage) -2.11% 0.950 0.930 - 0.00% -
403.gcc (max) (percentage) -1.89% 2.120 2.080 - 0.00% -
481.wrf (max) -1.61% 124.000 122.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -1.04% 0.960 0.950 - 0.00% -
400.perlbench (avg) (percentage) -1.03% 0.970 0.960 - 0.00% -

Added Tests - sample variability
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 7.80% 487.000 525.000 - 0.96% -
401.bzip2 7.22% 2661.000 2853.000 - 2.70% -
435.gromacs 5.20% 5464.000 5748.000 - 2.48% -
454.calculix 5.08% 59.000 62.000 - 5.08% -
434.zeusmp 4.13% 2177.000 2267.000 - 0.67% -
400.perlbench 3.58% 1342.000 1390.000 - -0.93% -
473.astar 3.37% 4803.000 4965.000 - 0.94% -
437.leslie3d 3.06% 8956.000 9230.000 - 4.22% -
447.dealII 2.97% 1450.000 1493.000 - -0.07% -
433.milc 2.77% 976.000 1003.000 - -0.10% -
453.povray 2.68% 448.000 460.000 - -1.08% -
462.libquantum 1.79% 112.000 114.000 - 0.88% -
410.bwaves 1.61% 5038.000 5119.000 - -0.95% -
445.gobmk 1.57% 4847.000 4923.000 - 0.20% -
483.xalancbmk 1.03% 3488.000 3524.000 - -1.97% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -20.45% 1120.000 891.000 - 3.97% -
470.lbm -3.34% 3507.000 3390.000 - 0.00% -
482.sphinx3 -2.04% 686.000 672.000 - -0.30% -
403.gcc -1.92% 52.000 51.000 - 0.00% -
459.GemsFDTD -1.63% 5157.000 5073.000 - -0.31% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1390.000 -
401.bzip2 2853.000 2.70%
403.gcc 51.000 -
410.bwaves 5119.000 -
416.gamess 14331.000 -
429.mcf 891.000 3.97%
433.milc 1003.000 -
434.zeusmp 2267.000 -
435.gromacs 5748.000 2.48%
436.cactusADM 2322.000 -
437.leslie3d 9230.000 4.22%
444.namd 769.000 -1.54%
445.gobmk 4923.000 -
447.dealII 1493.000 -
450.soplex 525.000 -
453.povray 460.000 -1.08%
454.calculix 62.000 5.08%
456.hmmer 3391.000 -
458.sjeng 6999.000 -
459.GemsFDTD 5073.000 -
462.libquantum 114.000 -
464.h264ref 5716.000 -
465.tonto 9077.000 -
470.lbm 3390.000 -
471.omnetpp 2474.000 1.27%
473.astar 4965.000 -
481.wrf 4435.000 -
482.sphinx3 672.000 -
483.xalancbmk 3524.000 -1.97%
Geometric Mean 1885.815 -
Name Current %
400.perlbench 1178437.000 -
401.bzip2 76368.000 -
403.gcc 3211493.000 -
410.bwaves 24246.000 -
416.gamess 9254478.000 -
429.mcf 10583.000 -
433.milc 122786.000 -
434.zeusmp 342562.000 -
435.gromacs 927165.000 -
436.cactusADM 740571.000 -
437.leslie3d 103139.000 -
444.namd 230666.000 -
445.gobmk 1479613.000 -
447.dealII 3042486.000 -
450.soplex 409324.000 -
453.povray 923974.000 -
454.calculix 1741258.000 -
456.hmmer 296801.000 -
458.sjeng 159900.000 -
459.GemsFDTD 408073.000 -
462.libquantum 34535.000 -
464.h264ref 800552.000 -
465.tonto 4322721.000 -
470.lbm 12326.000 -
471.omnetpp 554432.000 -
473.astar 37928.000 -
481.wrf 6975066.000 -
482.sphinx3 196779.000 -
483.xalancbmk 3774433.000 -
Geometric Mean 405701.048 -
Name Current %
400.perlbench 13.000 -
400.perlbench (avg) 13.000 -
400.perlbench (avg) (percentage) 0.960 -1.03%
400.perlbench (max) 14.000 -6.67%
400.perlbench (max) (percentage) 1.020 -8.11%
400.perlbench (unexplained diff vs previous) 13.000 62.50%
400.perlbench (unexplained diff vs previous) (percentage) 0.940 64.91%
401.bzip2 41.000 24.24%
401.bzip2 (avg) 41.000 24.24%
401.bzip2 (avg) (percentage) 1.440 18.03%
401.bzip2 (max) 77.000 175.00%
401.bzip2 (max) (percentage) 2.700 167.33%
401.bzip2 (unexplained diff vs previous) 75.000 3650.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.630 3657.14%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 3.580 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.080 -1.89%
410.bwaves 61.000 -4.69%
410.bwaves (avg) 61.000 -4.69%
410.bwaves (avg) (percentage) 1.200 -3.23%
410.bwaves (max) 48.000 20.00%
410.bwaves (max) (percentage) 0.950 21.79%
410.bwaves (unexplained diff vs previous) 49.000 22.50%
410.bwaves (unexplained diff vs previous) (percentage) 0.960 24.68%
416.gamess 22.000 22.22%
416.gamess (avg) 22.000 22.22%
416.gamess (avg) (percentage) 0.160 23.08%
416.gamess (max) 53.000 70.97%
416.gamess (max) (percentage) 0.370 68.18%
416.gamess (unexplained diff vs previous) 53.000 2550.00%
416.gamess (unexplained diff vs previous) (percentage) 0.370 3600.00%
429.mcf 32.000 6.67%
429.mcf (avg) 32.000 6.67%
429.mcf (avg) (percentage) 3.600 1.98%
429.mcf (max) 35.000 600.00%
429.mcf (max) (percentage) 3.970 467.14%
429.mcf (unexplained diff vs previous) 34.000 466.67%
429.mcf (unexplained diff vs previous) (percentage) 3.820 445.71%
433.milc 15.000 -11.76%
433.milc (avg) 15.000 -11.76%
433.milc (avg) (percentage) 1.510 -13.71%
433.milc (max) 2.000 -96.36%
433.milc (max) (percentage) 0.270 -95.13%
433.milc (unexplained diff vs previous) 1.000 -66.67%
433.milc (unexplained diff vs previous) (percentage) 0.100 -66.67%
434.zeusmp 30.000 -9.09%
434.zeusmp (avg) 30.000 -9.09%
434.zeusmp (avg) (percentage) 1.340 -9.46%
434.zeusmp (max) 28.000 -
434.zeusmp (max) (percentage) 1.250 -
434.zeusmp (unexplained diff vs previous) 15.000 -31.82%
434.zeusmp (unexplained diff vs previous) (percentage) 0.660 -32.65%
435.gromacs 93.000 19.23%
435.gromacs (avg) 93.000 19.23%
435.gromacs (avg) (percentage) 1.620 15.71%
435.gromacs (max) 142.000 215.56%
435.gromacs (max) (percentage) 2.480 206.17%
435.gromacs (unexplained diff vs previous) 139.000 202.17%
435.gromacs (unexplained diff vs previous) (percentage) 2.420 195.12%
436.cactusADM 10.000 -9.09%
436.cactusADM (avg) 10.000 -9.09%
436.cactusADM (avg) (percentage) 0.460 -6.12%
436.cactusADM (max) 21.000 -
436.cactusADM (max) (percentage) 0.930 -2.11%
436.cactusADM (unexplained diff vs previous) 7.000 16.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.300 15.38%
437.leslie3d 366.000 4.27%
437.leslie3d (avg) 366.000 4.27%
437.leslie3d (avg) (percentage) 3.970 -
437.leslie3d (max) 905.000 -
437.leslie3d (max) (percentage) 9.810 -4.76%
444.namd 7.000 16.67%
444.namd (avg) 7.000 16.67%
444.namd (avg) (percentage) 0.950 13.10%
444.namd (max) 11.000 -
444.namd (max) (percentage) 1.540 7.69%
444.namd (unexplained diff vs previous) 12.000 9.09%
444.namd (unexplained diff vs previous) (percentage) 1.560 10.64%
445.gobmk 21.000 -16.00%
445.gobmk (avg) 21.000 -16.00%
445.gobmk (avg) (percentage) 0.430 -15.69%
445.gobmk (max) 20.000 -44.44%
445.gobmk (max) (percentage) 0.420 -43.24%
445.gobmk (unexplained diff vs previous) 10.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.200 -
447.dealII 9.000 -18.18%
447.dealII (avg) 9.000 -18.18%
447.dealII (avg) (percentage) 0.630 -19.23%
447.dealII (max) 12.000 -29.41%
447.dealII (max) (percentage) 0.840 -30.00%
447.dealII (unexplained diff vs previous) 1.000 -92.86%
447.dealII (unexplained diff vs previous) (percentage) 0.070 -92.55%
450.soplex 16.000 -15.79%
450.soplex (avg) 16.000 -15.79%
450.soplex (avg) (percentage) 3.120 -15.22%
450.soplex (max) 23.000 -4.17%
450.soplex (max) (percentage) 4.520 -2.16%
450.soplex (unexplained diff vs previous) 5.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.950 -1.04%
453.povray 3.000 50.00%
453.povray (avg) 3.000 50.00%
453.povray (avg) (percentage) 0.740 19.35%
453.povray (max) 4.000 33.33%
453.povray (max) (percentage) 1.080 45.95%
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 1.090 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.980 29.57%
454.calculix (max) 3.000 50.00%
454.calculix (max) (percentage) 5.080 44.73%
454.calculix (unexplained diff vs previous) 3.000 50.00%
454.calculix (unexplained diff vs previous) (percentage) 4.840 42.77%
456.hmmer 12.000 20.00%
456.hmmer (avg) 12.000 20.00%
456.hmmer (avg) (percentage) 0.370 23.33%
456.hmmer (max) 24.000 14.29%
456.hmmer (max) (percentage) 0.710 9.23%
456.hmmer (unexplained diff vs previous) 24.000 9.09%
456.hmmer (unexplained diff vs previous) (percentage) 0.710 9.23%
458.sjeng 37.000 -2.63%
458.sjeng (avg) 37.000 -2.63%
458.sjeng (avg) (percentage) 0.540 -
458.sjeng (max) 38.000 31.03%
458.sjeng (max) (percentage) 0.550 30.95%
458.sjeng (unexplained diff vs previous) 39.000 1850.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.560 1766.67%
459.GemsFDTD 91.000 -16.51%
459.GemsFDTD (avg) 91.000 -16.51%
459.GemsFDTD (avg) (percentage) 1.800 -16.67%
459.GemsFDTD (max) 112.000 -54.29%
459.GemsFDTD (max) (percentage) 2.210 -54.24%
459.GemsFDTD (unexplained diff vs previous) 16.000 -5.88%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.320 -3.03%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.230 -4.65%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.120 -30.72%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.880 -
464.h264ref 39.000 -
464.h264ref (avg) 39.000 -
464.h264ref (avg) (percentage) 0.690 -
464.h264ref (max) 40.000 -41.18%
464.h264ref (max) (percentage) 0.700 -42.15%
464.h264ref (unexplained diff vs previous) 40.000 -4.76%
464.h264ref (unexplained diff vs previous) (percentage) 0.700 -5.41%
465.tonto 69.000 -
465.tonto (avg) 69.000 -
465.tonto (avg) (percentage) 0.770 -
465.tonto (max) 57.000 -6.56%
465.tonto (max) (percentage) 0.630 -7.35%
470.lbm 39.000 -15.22%
470.lbm (avg) 39.000 -15.22%
470.lbm (avg) (percentage) 1.170 -14.60%
470.lbm (max) 15.000 -57.14%
470.lbm (max) (percentage) 0.470 -54.81%
470.lbm (unexplained diff vs previous) 0.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.000 -
471.omnetpp 30.000 3.45%
471.omnetpp (avg) 30.000 3.45%
471.omnetpp (avg) (percentage) 1.220 -
471.omnetpp (max) 40.000 -4.76%
471.omnetpp (max) (percentage) 1.640 -6.29%
471.omnetpp (unexplained diff vs previous) 31.000 287.50%
471.omnetpp (unexplained diff vs previous) (percentage) 1.250 278.79%
473.astar 59.000 -3.28%
473.astar (avg) 59.000 -3.28%
473.astar (avg) (percentage) 1.200 -4.00%
473.astar (max) 46.000 39.39%
473.astar (max) (percentage) 0.940 36.23%
473.astar (unexplained diff vs previous) 46.000 43.75%
473.astar (unexplained diff vs previous) (percentage) 0.930 43.08%
481.wrf 45.000 -15.09%
481.wrf (avg) 45.000 -15.09%
481.wrf (avg) (percentage) 1.020 -15.70%
481.wrf (max) 122.000 -1.61%
481.wrf (max) (percentage) 2.760 -2.13%
481.wrf (unexplained diff vs previous) 20.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.450 -
482.sphinx3 17.000 -19.05%
482.sphinx3 (avg) 17.000 -19.05%
482.sphinx3 (avg) (percentage) 2.670 -14.70%
482.sphinx3 (max) 22.000 -
482.sphinx3 (max) (percentage) 3.290 -
482.sphinx3 (unexplained diff vs previous) 2.000 -83.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.300 -83.15%
483.xalancbmk 49.000 6.52%
483.xalancbmk (avg) 49.000 6.52%
483.xalancbmk (avg) (percentage) 1.410 8.46%
483.xalancbmk (max) 69.000 -8.00%
483.xalancbmk (max) (percentage) 1.970 -6.19%
483.xalancbmk (unexplained diff vs previous) 71.000 -4.05%
483.xalancbmk (unexplained diff vs previous) (percentage) 2.010 -2.43%
Geometric Mean 5.062 6.71%