Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b6b746e6b81c69588d7ca07708b307bd7728b0ac (+ 47 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/705b0d2b62318b3935214f08a1cf023b1117acb8 (+ 110 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=65cbd52174f5bc211dd655727c2239e25e55bfce (+ 14 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=911893ac7b96a82cd5251f3bb864b892a8fe91cf (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/9/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0009 (3-changed-components) 2023-04-17T09:56:04 0:00:00
Previous 0008 (4-changed-components) 2023-04-14T09:56:53 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 39 7
Performance Improvements 124 6
Added Tests 0 145
Unchanged Tests 1073 1078
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 16.33% 49.000 57.000 - 0.00% -
437.leslie3d 7.84% 8365.000 9021.000 - 1.03% -
454.calculix 5.36% 56.000 59.000 - -1.67% -
462.libquantum 2.53% 79.000 81.000 - 0.00% -
429.mcf 1.92% 1456.000 1484.000 - 1.16% -
471.omnetpp 1.90% 2468.000 2515.000 - -5.81% -
481.wrf 1.76% 4026.000 4097.000 - -0.65% -
483.xalancbmk 1.12% 3380.000 3418.000 - 4.21% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) 13020.00% 5.000 656.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 12016.67% 0.060 7.270 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 2450.00% 0.020 0.510 - 0.00% -
473.astar (unexplained diff vs previous) 2400.00% 1.000 25.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 283.33% 0.240 0.920 - 0.00% -
465.tonto (unexplained diff vs previous) 281.82% 22.000 84.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 184.62% 13.000 37.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 180.00% 0.200 0.560 - 0.00% -
471.omnetpp (unexplained diff vs previous) 113.64% 22.000 47.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 110.11% 0.890 1.870 - 0.00% -
444.namd (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.160 0.320 - 0.00% -
445.gobmk (unexplained diff vs previous) 55.00% 20.000 31.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 53.66% 0.410 0.630 - 0.00% -
429.mcf (unexplained diff vs previous) 27.27% 22.000 28.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 25.17% 1.510 1.890 - 0.00% -
437.leslie3d 22.47% 445.000 545.000 - 0.00% -
437.leslie3d (avg) 22.47% 445.000 545.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 21.33% 0.750 0.910 - 0.00% -
434.zeusmp (unexplained diff vs previous) 20.00% 15.000 18.000 - 0.00% -
437.leslie3d (avg) (percentage) 13.72% 5.320 6.050 - 0.00% -
434.zeusmp 6.67% 15.000 16.000 - 0.00% -
434.zeusmp (avg) 6.67% 15.000 16.000 - 0.00% -
434.zeusmp (avg) (percentage) 3.80% 0.790 0.820 - 0.00% -
464.h264ref 1.89% 53.000 54.000 - 0.00% -
464.h264ref (avg) 1.89% 53.000 54.000 - 0.00% -
437.leslie3d (max) 1.71% 1055.000 1073.000 - 0.00% -
462.libquantum (avg) (percentage) 1.68% 2.380 2.420 - 0.00% -
481.wrf 1.64% 122.000 124.000 - 0.00% -
481.wrf (avg) 1.64% 122.000 124.000 - 0.00% -
434.zeusmp (max) (percentage) 1.12% 0.890 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -1.59% 1449.000 1426.000 - 0.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -94.74% 19.000 1.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -94.20% 0.690 0.040 - 0.00% -
470.lbm (unexplained diff vs previous) -86.67% 15.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -86.67% 0.450 0.060 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -75.00% 0.360 0.090 - 0.00% -
433.milc (unexplained diff vs previous) -75.00% 4.000 1.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -75.00% 4.000 1.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -73.33% 0.150 0.040 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -71.65% 1.270 0.360 - 0.00% -
450.soplex (unexplained diff vs previous) -71.43% 7.000 2.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -43.75% 16.000 9.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -43.24% 0.370 0.210 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -41.27% 1.890 1.110 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -40.62% 64.000 38.000 - 0.00% -
447.dealII -27.78% 18.000 13.000 - 0.00% -
447.dealII (avg) -27.78% 18.000 13.000 - 0.00% -
447.dealII (avg) (percentage) -25.95% 1.310 0.970 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -25.49% 0.510 0.380 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -25.00% 4.000 3.000 - 0.00% -
401.bzip2 (avg) (percentage) -24.26% 1.690 1.280 - 0.00% -
401.bzip2 -23.91% 46.000 35.000 - 0.00% -
401.bzip2 (avg) -23.91% 46.000 35.000 - 0.00% -
470.lbm (avg) (percentage) -23.85% 1.300 0.990 - 0.00% -
470.lbm -23.26% 43.000 33.000 - 0.00% -
470.lbm (avg) -23.26% 43.000 33.000 - 0.00% -
450.soplex (avg) (percentage) -23.17% 5.180 3.980 - 0.00% -
456.hmmer (avg) (percentage) -23.08% 0.260 0.200 - 0.00% -
433.milc (avg) (percentage) -23.02% 1.390 1.070 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -22.37% 0.760 0.590 - 0.00% -
473.astar -21.54% 130.000 102.000 - 0.00% -
473.astar (avg) -21.54% 130.000 102.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -21.43% 14.000 11.000 - 0.00% -
450.soplex -21.43% 28.000 22.000 - 0.00% -
450.soplex (avg) -21.43% 28.000 22.000 - 0.00% -
473.astar (avg) (percentage) -20.83% 2.640 2.090 - 0.00% -
429.mcf (avg) (percentage) -20.30% 10.150 8.090 - 0.00% -
465.tonto (avg) (percentage) -20.24% 2.520 2.010 - 0.00% -
433.milc -20.00% 15.000 12.000 - 0.00% -
433.milc (avg) -20.00% 15.000 12.000 - 0.00% -
444.namd -20.00% 5.000 4.000 - 0.00% -
444.namd (avg) -20.00% 5.000 4.000 - 0.00% -
465.tonto -19.38% 227.000 183.000 - 0.00% -
465.tonto (avg) -19.38% 227.000 183.000 - 0.00% -
482.sphinx3 (avg) (percentage) -18.88% 1.430 1.160 - 0.00% -
429.mcf -18.37% 147.000 120.000 - 0.00% -
429.mcf (avg) -18.37% 147.000 120.000 - 0.00% -
482.sphinx3 -18.18% 11.000 9.000 - 0.00% -
482.sphinx3 (avg) -18.18% 11.000 9.000 - 0.00% -
444.namd (avg) (percentage) -17.05% 0.880 0.730 - 0.00% -
436.cactusADM -16.67% 30.000 25.000 - 0.00% -
436.cactusADM (avg) -16.67% 30.000 25.000 - 0.00% -
456.hmmer -16.67% 6.000 5.000 - 0.00% -
456.hmmer (avg) -16.67% 6.000 5.000 - 0.00% -
436.cactusADM (avg) (percentage) -16.56% 1.630 1.360 - 0.00% -
483.xalancbmk (avg) (percentage) -16.10% 2.920 2.450 - 0.00% -
410.bwaves -15.79% 19.000 16.000 - 0.00% -
410.bwaves (avg) -15.79% 19.000 16.000 - 0.00% -
483.xalancbmk -15.31% 98.000 83.000 - 0.00% -
483.xalancbmk (avg) -15.31% 98.000 83.000 - 0.00% -
453.povray (max) (percentage) -14.92% 1.810 1.540 - 0.00% -
453.povray (max) -14.29% 7.000 6.000 - 0.00% -
410.bwaves (avg) (percentage) -13.33% 0.450 0.390 - 0.00% -
445.gobmk -12.28% 57.000 50.000 - 0.00% -
445.gobmk (avg) -12.28% 57.000 50.000 - 0.00% -
445.gobmk (avg) (percentage) -11.97% 1.170 1.030 - 0.00% -
435.gromacs (max) -11.67% 360.000 318.000 - 0.00% -
435.gromacs (max) (percentage) -11.16% 6.630 5.890 - 0.00% -
459.GemsFDTD (max) -11.11% 63.000 56.000 - 0.00% -
445.gobmk (max) (percentage) -10.06% 1.690 1.520 - 0.00% -
401.bzip2 (max) (percentage) -10.00% 2.300 2.070 - 0.00% -
410.bwaves (max) -10.00% 20.000 18.000 - 0.00% -
444.namd (max) -10.00% 10.000 9.000 - 0.00% -
456.hmmer (max) -10.00% 10.000 9.000 - 0.00% -
458.sjeng -10.00% 60.000 54.000 - 0.00% -
458.sjeng (avg) -10.00% 60.000 54.000 - 0.00% -
459.GemsFDTD (max) (percentage) -10.00% 1.500 1.350 - 0.00% -
433.milc (max) (percentage) -9.91% 2.120 1.910 - 0.00% -
458.sjeng (max) (percentage) -9.85% 1.320 1.190 - 0.00% -
458.sjeng (avg) (percentage) -9.78% 0.920 0.830 - 0.00% -
445.gobmk (max) -9.76% 82.000 74.000 - 0.00% -
401.bzip2 (max) -9.68% 62.000 56.000 - 0.00% -
429.mcf (max) (percentage) -9.57% 16.930 15.310 - 0.00% -
458.sjeng (max) -9.30% 86.000 78.000 - 0.00% -
450.soplex (max) -9.26% 54.000 49.000 - 0.00% -
470.lbm (max) -8.96% 67.000 61.000 - 0.00% -
433.milc (max) -8.70% 23.000 21.000 - 0.00% -
450.soplex (max) (percentage) -8.54% 9.840 9.000 - 0.00% -
410.bwaves (max) (percentage) -8.51% 0.470 0.430 - 0.00% -
470.lbm (max) (percentage) -8.46% 2.010 1.840 - 0.00% -
482.sphinx3 (max) (percentage) -7.73% 2.070 1.910 - 0.00% -
429.mcf (max) -7.72% 246.000 227.000 - 0.00% -
456.hmmer (max) (percentage) -7.69% 0.390 0.360 - 0.00% -
403.gcc (max) (percentage) -7.13% 9.260 8.600 - 0.00% -
454.calculix (max) (percentage) -7.09% 5.080 4.720 - 0.00% -
473.astar (max) -6.91% 246.000 229.000 - 0.00% -
462.libquantum (max) (percentage) -6.77% 4.580 4.270 - 0.00% -
471.omnetpp (max) (percentage) -6.76% 2.070 1.930 - 0.00% -
436.cactusADM (max) (percentage) -6.74% 2.670 2.490 - 0.00% -
473.astar (max) (percentage) -6.60% 5.000 4.670 - 0.00% -
400.perlbench (max) -6.56% 61.000 57.000 - 0.00% -
465.tonto (max) (percentage) -6.37% 3.610 3.380 - 0.00% -
483.xalancbmk (max) (percentage) -6.35% 3.150 2.950 - 0.00% -
482.sphinx3 (max) -6.25% 16.000 15.000 - 0.00% -
444.namd (max) (percentage) -6.13% 1.630 1.530 - 0.00% -
436.cactusADM (max) -6.12% 49.000 46.000 - 0.00% -
464.h264ref (max) (percentage) -5.92% 1.690 1.590 - 0.00% -
447.dealII (max) -5.88% 34.000 32.000 - 0.00% -
471.omnetpp (max) -5.88% 51.000 48.000 - 0.00% -
481.wrf (max) (percentage) -5.83% 4.120 3.880 - 0.00% -
447.dealII (max) (percentage) -5.74% 2.440 2.300 - 0.00% -
437.leslie3d (max) (percentage) -5.71% 12.620 11.900 - 0.00% -
483.xalancbmk (max) -5.66% 106.000 100.000 - 0.00% -
464.h264ref (max) -5.63% 71.000 67.000 - 0.00% -
400.perlbench (max) (percentage) -5.62% 4.270 4.030 - 0.00% -
465.tonto (max) -5.23% 325.000 308.000 - 0.00% -
416.gamess (max) (percentage) -5.00% 0.400 0.380 - 0.00% -
416.gamess (max) -4.88% 41.000 39.000 - 0.00% -
481.wrf (max) -4.24% 165.000 158.000 - 0.00% -
471.omnetpp (avg) (percentage) -2.79% 2.150 2.090 - 0.00% -
459.GemsFDTD -1.92% 52.000 51.000 - 0.00% -
459.GemsFDTD (avg) -1.92% 52.000 51.000 - 0.00% -
471.omnetpp -1.89% 53.000 52.000 - 0.00% -
471.omnetpp (avg) -1.89% 53.000 52.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk 4.21% 3280.000 3418.000 - 1.12% -
450.soplex 3.95% 532.000 553.000 - 0.36% -
435.gromacs 2.97% 5246.000 5402.000 - -0.55% -
453.povray 2.10% 428.000 437.000 - 0.69% -
436.cactusADM 2.08% 1824.000 1862.000 - 0.59% -
429.mcf 1.16% 1467.000 1484.000 - 1.92% -
437.leslie3d 1.03% 8929.000 9021.000 - 7.84% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -5.47% 79330.000 74994.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -5.81% 2670.000 2515.000 - 1.90% -
454.calculix -1.67% 60.000 59.000 - 5.36% -
401.bzip2 -1.33% 2774.000 2737.000 - 0.04% -
444.namd -1.26% 636.000 628.000 - -0.32% -
447.dealII -1.12% 1426.000 1410.000 - -0.07% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1426.000 -1.59%
401.bzip2 2737.000 -
403.gcc 57.000 16.33%
410.bwaves 4335.000 -
416.gamess 10482.000 -
429.mcf 1484.000 1.92%
433.milc 1124.000 -
434.zeusmp 1984.000 -
435.gromacs 5402.000 -
436.cactusADM 1862.000 -
437.leslie3d 9021.000 7.84%
444.namd 628.000 -
445.gobmk 4917.000 -
447.dealII 1410.000 -
450.soplex 553.000 -
453.povray 437.000 -
454.calculix 59.000 5.36%
456.hmmer 2671.000 -
458.sjeng 6601.000 -
459.GemsFDTD 4221.000 -
462.libquantum 81.000 2.53%
464.h264ref 4254.000 -
465.tonto 9113.000 -
470.lbm 3347.000 -
471.omnetpp 2515.000 1.90%
473.astar 4911.000 -
481.wrf 4097.000 1.76%
482.sphinx3 788.000 -
483.xalancbmk 3418.000 1.12%
Geometric Mean 1785.770 1.28%
Name Current %
400.perlbench 1095894.000 -
401.bzip2 58669.000 -
403.gcc 3161344.000 -
410.bwaves 21532.000 -
416.gamess 7062991.000 -
429.mcf 12072.000 -
433.milc 111999.000 -
434.zeusmp 203719.000 -
435.gromacs 789814.000 -
436.cactusADM 650213.000 -
437.leslie3d 74994.000 -
444.namd 226542.000 -
445.gobmk 1554015.000 -
447.dealII 2802306.000 -
450.soplex 347581.000 -
453.povray 837663.000 -
454.calculix 1445193.000 -
456.hmmer 270839.000 -
458.sjeng 130527.000 -
459.GemsFDTD 295590.000 -
462.libquantum 38088.000 -
464.h264ref 472250.000 -
465.tonto 3242351.000 -
470.lbm 11601.000 -
471.omnetpp 630590.000 -
473.astar 36849.000 -
481.wrf 4021084.000 -
482.sphinx3 175472.000 -
483.xalancbmk 4065648.000 -
Geometric Mean 350813.010 -
Name Current %
400.perlbench 39.000 -
400.perlbench (avg) 39.000 -
400.perlbench (avg) (percentage) 2.740 -
400.perlbench (max) 57.000 -6.56%
400.perlbench (max) (percentage) 4.030 -5.62%
401.bzip2 35.000 -23.91%
401.bzip2 (avg) 35.000 -23.91%
401.bzip2 (avg) (percentage) 1.280 -24.26%
401.bzip2 (max) 56.000 -9.68%
401.bzip2 (max) (percentage) 2.070 -10.00%
401.bzip2 (unexplained diff vs previous) 1.000 -94.74%
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -94.20%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.580 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.600 -7.13%
410.bwaves 16.000 -15.79%
410.bwaves (avg) 16.000 -15.79%
410.bwaves (avg) (percentage) 0.390 -13.33%
410.bwaves (max) 18.000 -10.00%
410.bwaves (max) (percentage) 0.430 -8.51%
410.bwaves (unexplained diff vs previous) 9.000 -43.75%
410.bwaves (unexplained diff vs previous) (percentage) 0.210 -43.24%
416.gamess 35.000 -
416.gamess (avg) 35.000 -
416.gamess (avg) (percentage) 0.340 -
416.gamess (max) 39.000 -4.88%
416.gamess (max) (percentage) 0.380 -5.00%
429.mcf 120.000 -18.37%
429.mcf (avg) 120.000 -18.37%
429.mcf (avg) (percentage) 8.090 -20.30%
429.mcf (max) 227.000 -7.72%
429.mcf (max) (percentage) 15.310 -9.57%
429.mcf (unexplained diff vs previous) 28.000 27.27%
429.mcf (unexplained diff vs previous) (percentage) 1.890 25.17%
433.milc 12.000 -20.00%
433.milc (avg) 12.000 -20.00%
433.milc (avg) (percentage) 1.070 -23.02%
433.milc (max) 21.000 -8.70%
433.milc (max) (percentage) 1.910 -9.91%
433.milc (unexplained diff vs previous) 1.000 -75.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -75.00%
434.zeusmp 16.000 6.67%
434.zeusmp (avg) 16.000 6.67%
434.zeusmp (avg) (percentage) 0.820 3.80%
434.zeusmp (max) 17.000 -
434.zeusmp (max) (percentage) 0.900 1.12%
434.zeusmp (unexplained diff vs previous) 18.000 20.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.910 21.33%
435.gromacs 212.000 -
435.gromacs (avg) 212.000 -
435.gromacs (avg) (percentage) 3.930 -
435.gromacs (max) 318.000 -11.67%
435.gromacs (max) (percentage) 5.890 -11.16%
436.cactusADM 25.000 -16.67%
436.cactusADM (avg) 25.000 -16.67%
436.cactusADM (avg) (percentage) 1.360 -16.56%
436.cactusADM (max) 46.000 -6.12%
436.cactusADM (max) (percentage) 2.490 -6.74%
436.cactusADM (unexplained diff vs previous) 11.000 -21.43%
436.cactusADM (unexplained diff vs previous) (percentage) 0.590 -22.37%
437.leslie3d 545.000 22.47%
437.leslie3d (avg) 545.000 22.47%
437.leslie3d (avg) (percentage) 6.050 13.72%
437.leslie3d (max) 1073.000 1.71%
437.leslie3d (max) (percentage) 11.900 -5.71%
437.leslie3d (unexplained diff vs previous) 656.000 13020.00%
437.leslie3d (unexplained diff vs previous) (percentage) 7.270 12016.67%
444.namd 4.000 -20.00%
444.namd (avg) 4.000 -20.00%
444.namd (avg) (percentage) 0.730 -17.05%
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.530 -6.13%
444.namd (unexplained diff vs previous) 2.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.320 100.00%
445.gobmk 50.000 -12.28%
445.gobmk (avg) 50.000 -12.28%
445.gobmk (avg) (percentage) 1.030 -11.97%
445.gobmk (max) 74.000 -9.76%
445.gobmk (max) (percentage) 1.520 -10.06%
445.gobmk (unexplained diff vs previous) 31.000 55.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.630 53.66%
447.dealII 13.000 -27.78%
447.dealII (avg) 13.000 -27.78%
447.dealII (avg) (percentage) 0.970 -25.95%
447.dealII (max) 32.000 -5.88%
447.dealII (max) (percentage) 2.300 -5.74%
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.070 -
450.soplex 22.000 -21.43%
450.soplex (avg) 22.000 -21.43%
450.soplex (avg) (percentage) 3.980 -23.17%
450.soplex (max) 49.000 -9.26%
450.soplex (max) (percentage) 9.000 -8.54%
450.soplex (unexplained diff vs previous) 2.000 -71.43%
450.soplex (unexplained diff vs previous) (percentage) 0.360 -71.65%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.360 -
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.540 -14.92%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.670 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.720 -7.09%
456.hmmer 5.000 -16.67%
456.hmmer (avg) 5.000 -16.67%
456.hmmer (avg) (percentage) 0.200 -23.08%
456.hmmer (max) 9.000 -10.00%
456.hmmer (max) (percentage) 0.360 -7.69%
456.hmmer (unexplained diff vs previous) 1.000 -75.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.040 -73.33%
458.sjeng 54.000 -10.00%
458.sjeng (avg) 54.000 -10.00%
458.sjeng (avg) (percentage) 0.830 -9.78%
458.sjeng (max) 78.000 -9.30%
458.sjeng (max) (percentage) 1.190 -9.85%
458.sjeng (unexplained diff vs previous) 37.000 184.62%
458.sjeng (unexplained diff vs previous) (percentage) 0.560 180.00%
459.GemsFDTD 51.000 -1.92%
459.GemsFDTD (avg) 51.000 -1.92%
459.GemsFDTD (avg) (percentage) 1.230 -
459.GemsFDTD (max) 56.000 -11.11%
459.GemsFDTD (max) (percentage) 1.350 -10.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.420 1.68%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.270 -6.77%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.470 -
464.h264ref 54.000 1.89%
464.h264ref (avg) 54.000 1.89%
464.h264ref (avg) (percentage) 1.270 -
464.h264ref (max) 67.000 -5.63%
464.h264ref (max) (percentage) 1.590 -5.92%
465.tonto 183.000 -19.38%
465.tonto (avg) 183.000 -19.38%
465.tonto (avg) (percentage) 2.010 -20.24%
465.tonto (max) 308.000 -5.23%
465.tonto (max) (percentage) 3.380 -6.37%
465.tonto (unexplained diff vs previous) 84.000 281.82%
465.tonto (unexplained diff vs previous) (percentage) 0.920 283.33%
470.lbm 33.000 -23.26%
470.lbm (avg) 33.000 -23.26%
470.lbm (avg) (percentage) 0.990 -23.85%
470.lbm (max) 61.000 -8.96%
470.lbm (max) (percentage) 1.840 -8.46%
470.lbm (unexplained diff vs previous) 2.000 -86.67%
470.lbm (unexplained diff vs previous) (percentage) 0.060 -86.67%
471.omnetpp 52.000 -1.89%
471.omnetpp (avg) 52.000 -1.89%
471.omnetpp (avg) (percentage) 2.090 -2.79%
471.omnetpp (max) 48.000 -5.88%
471.omnetpp (max) (percentage) 1.930 -6.76%
471.omnetpp (unexplained diff vs previous) 47.000 113.64%
471.omnetpp (unexplained diff vs previous) (percentage) 1.870 110.11%
473.astar 102.000 -21.54%
473.astar (avg) 102.000 -21.54%
473.astar (avg) (percentage) 2.090 -20.83%
473.astar (max) 229.000 -6.91%
473.astar (max) (percentage) 4.670 -6.60%
473.astar (unexplained diff vs previous) 25.000 2400.00%
473.astar (unexplained diff vs previous) (percentage) 0.510 2450.00%
481.wrf 124.000 1.64%
481.wrf (avg) 124.000 1.64%
481.wrf (avg) (percentage) 3.050 -
481.wrf (max) 158.000 -4.24%
481.wrf (max) (percentage) 3.880 -5.83%
482.sphinx3 9.000 -18.18%
482.sphinx3 (avg) 9.000 -18.18%
482.sphinx3 (avg) (percentage) 1.160 -18.88%
482.sphinx3 (max) 15.000 -6.25%
482.sphinx3 (max) (percentage) 1.910 -7.73%
482.sphinx3 (unexplained diff vs previous) 3.000 -25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.380 -25.49%
483.xalancbmk 83.000 -15.31%
483.xalancbmk (avg) 83.000 -15.31%
483.xalancbmk (avg) (percentage) 2.450 -16.10%
483.xalancbmk (max) 100.000 -5.66%
483.xalancbmk (max) (percentage) 2.950 -6.35%
483.xalancbmk (unexplained diff vs previous) 38.000 -40.62%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.110 -41.27%
Geometric Mean 6.977 5.92%