Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=66637e209cc836c19a21a28e91046649c7702037 (+ 19 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f9a10e91499ec9291fe28f20c34f1f1e65c521e8 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=78ca44da0160a0b442f0ca1f253e3360f044b2ec (+ 3 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/89/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0089 (2-changed-components) 2023-11-24T13:26:49 0:00:00
Previous 0087 (3-changed-components) 2023-11-21T05:00:17 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 47 19
Performance Improvements 97 10
Added Tests 30 144
Unchanged Tests 1014 1015
Total Tests 1188

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.14% 2153.000 2199.000 - 1.29% -
481.wrf 2.06% 5057.000 5161.000 - 1.59% -
403.gcc 1.85% 54.000 55.000 - 5.77% -
447.dealII 1.40% 1362.000 1381.000 - -1.99% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) (percentage) 457.14% 0.070 0.390 - 0.00% -
410.bwaves (unexplained diff vs previous) 425.00% 4.000 21.000 - 0.00% -
456.hmmer (max) (percentage) 241.67% 0.120 0.410 - 0.00% -
456.hmmer (max) 225.00% 4.000 13.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 186.96% 1.150 3.300 - 0.00% -
435.gromacs (unexplained diff vs previous) 179.10% 67.000 187.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 102.60% 0.770 1.560 - 0.00% -
429.mcf (unexplained diff vs previous) 100.00% 7.000 14.000 - 0.00% -
450.soplex (max) (percentage) 70.86% 1.510 2.580 - 0.00% -
470.lbm (unexplained diff vs previous) 64.29% 14.000 23.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 63.89% 0.360 0.590 - 0.00% -
450.soplex (max) 62.50% 8.000 13.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 52.58% 10.460 15.960 - 0.00% -
435.gromacs (max) (percentage) 36.17% 2.350 3.200 - 0.00% -
435.gromacs (max) 32.12% 137.000 181.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 31.59% 1184.000 1558.000 - 0.00% -
471.omnetpp (max) 27.03% 37.000 47.000 - 0.00% -
471.omnetpp (max) (percentage) 21.59% 1.760 2.140 - 0.00% -
437.leslie3d (avg) (percentage) 20.92% 3.490 4.220 - 0.00% -
456.hmmer 20.00% 5.000 6.000 - 0.00% -
456.hmmer (avg) 20.00% 5.000 6.000 - 0.00% -
437.leslie3d (max) (percentage) 17.89% 11.680 13.770 - 0.00% -
456.hmmer (avg) (percentage) 12.50% 0.160 0.180 - 0.00% -
481.wrf 9.09% 66.000 72.000 - 0.00% -
481.wrf (avg) 9.09% 66.000 72.000 - 0.00% -
471.omnetpp 8.33% 24.000 26.000 - 0.00% -
471.omnetpp (avg) 8.33% 24.000 26.000 - 0.00% -
435.gromacs (avg) (percentage) 7.74% 1.680 1.810 - 0.00% -
481.wrf (max) 7.07% 99.000 106.000 - 0.00% -
481.wrf (avg) (percentage) 6.87% 1.310 1.400 - 0.00% -
400.perlbench (avg) (percentage) 5.51% 1.270 1.340 - 0.00% -
400.perlbench 5.26% 19.000 20.000 - 0.00% -
400.perlbench (avg) 5.26% 19.000 20.000 - 0.00% -
471.omnetpp (avg) (percentage) 5.17% 1.160 1.220 - 0.00% -
481.wrf (max) (percentage) 4.57% 1.970 2.060 - 0.00% -
437.leslie3d 4.31% 394.000 411.000 - 0.00% -
437.leslie3d (avg) 4.31% 394.000 411.000 - 0.00% -
435.gromacs 4.08% 98.000 102.000 - 0.00% -
435.gromacs (avg) 4.08% 98.000 102.000 - 0.00% -
410.bwaves (max) (percentage) 2.63% 0.380 0.390 - 0.00% -
450.soplex (avg) (percentage) 2.54% 1.970 2.020 - 0.00% -
447.dealII (avg) (percentage) 1.67% 1.200 1.220 - 0.00% -
437.leslie3d (max) 1.67% 1321.000 1343.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -13.77% 11317.000 9759.000 - -5.68% -
435.gromacs -3.20% 5848.000 5661.000 - -1.03% -
450.soplex -2.58% 542.000 528.000 - -0.75% -
400.perlbench -2.13% 1546.000 1513.000 - 10.76% -
429.mcf -1.54% 910.000 896.000 - -3.03% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) -85.00% 20.000 3.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -84.52% 0.840 0.130 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -69.59% 2.170 0.660 - 0.00% -
473.astar (unexplained diff vs previous) -69.52% 105.000 32.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -65.00% 20.000 7.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -64.10% 0.390 0.140 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -50.79% 1.890 0.930 - 0.00% -
462.libquantum (max) -50.00% 2.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -40.00% 35.000 21.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -38.78% 0.490 0.300 - 0.00% -
459.GemsFDTD (max) -38.46% 26.000 16.000 - 0.00% -
459.GemsFDTD (max) (percentage) -38.46% 0.520 0.320 - 0.00% -
434.zeusmp (unexplained diff vs previous) -36.84% 19.000 12.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -36.71% 0.790 0.500 - 0.00% -
401.bzip2 (max) (percentage) -26.47% 0.680 0.500 - 0.00% -
434.zeusmp (max) (percentage) -25.32% 0.790 0.590 - 0.00% -
416.gamess (max) (percentage) -25.00% 0.120 0.090 - 0.00% -
416.gamess (max) -23.53% 17.000 13.000 - 0.00% -
401.bzip2 (max) -22.22% 18.000 14.000 - 0.00% -
434.zeusmp (max) -22.22% 18.000 14.000 - 0.00% -
482.sphinx3 (max) -21.05% 19.000 15.000 - 0.00% -
482.sphinx3 (max) (percentage) -18.50% 2.540 2.070 - 0.00% -
436.cactusADM (max) -15.00% 20.000 17.000 - 0.00% -
433.milc (max) -14.29% 7.000 6.000 - 0.00% -
462.libquantum (max) (percentage) -13.07% 1.990 1.730 - 0.00% -
436.cactusADM (max) (percentage) -12.94% 0.850 0.740 - 0.00% -
433.milc (unexplained diff vs previous) -12.50% 8.000 7.000 - 0.00% -
433.milc (max) (percentage) -12.50% 0.720 0.630 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -12.50% 0.720 0.630 - 0.00% -
444.namd (max) (percentage) -12.24% 0.490 0.430 - 0.00% -
445.gobmk (max) (percentage) -12.08% 2.070 1.820 - 0.00% -
464.h264ref -12.00% 25.000 22.000 - 0.00% -
464.h264ref (avg) -12.00% 25.000 22.000 - 0.00% -
445.gobmk (max) -11.34% 97.000 86.000 - 0.00% -
454.calculix (avg) (percentage) -10.84% 2.030 1.810 - 0.00% -
464.h264ref (avg) (percentage) -10.64% 0.470 0.420 - 0.00% -
482.sphinx3 -10.00% 10.000 9.000 - 0.00% -
482.sphinx3 (avg) -10.00% 10.000 9.000 - 0.00% -
473.astar (max) (percentage) -8.39% 2.860 2.620 - 0.00% -
436.cactusADM -8.33% 12.000 11.000 - 0.00% -
436.cactusADM (avg) -8.33% 12.000 11.000 - 0.00% -
473.astar (max) -7.97% 138.000 127.000 - 0.00% -
429.mcf (max) -7.14% 14.000 13.000 - 0.00% -
444.namd (avg) (percentage) -7.14% 0.420 0.390 - 0.00% -
470.lbm (max) -6.90% 29.000 27.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -6.67% 0.900 0.840 - 0.00% -
482.sphinx3 (avg) (percentage) -6.67% 1.350 1.260 - 0.00% -
459.GemsFDTD -6.52% 46.000 43.000 - 0.00% -
459.GemsFDTD (avg) -6.52% 46.000 43.000 - 0.00% -
416.gamess -5.88% 17.000 16.000 - 0.00% -
416.gamess (avg) -5.88% 17.000 16.000 - 0.00% -
436.cactusADM (avg) (percentage) -5.66% 0.530 0.500 - 0.00% -
465.tonto (avg) (percentage) -5.63% 0.710 0.670 - 0.00% -
434.zeusmp -5.56% 18.000 17.000 - 0.00% -
434.zeusmp (avg) -5.56% 18.000 17.000 - 0.00% -
470.lbm (max) (percentage) -5.41% 0.740 0.700 - 0.00% -
429.mcf (max) (percentage) -4.94% 1.620 1.540 - 0.00% -
465.tonto -4.35% 69.000 66.000 - 0.00% -
465.tonto (avg) -4.35% 69.000 66.000 - 0.00% -
470.lbm -4.17% 24.000 23.000 - 0.00% -
470.lbm (avg) -4.17% 24.000 23.000 - 0.00% -
473.astar (avg) (percentage) -3.82% 1.310 1.260 - 0.00% -
401.bzip2 (avg) (percentage) -3.81% 1.050 1.010 - 0.00% -
454.calculix (max) (percentage) -3.63% 3.030 2.920 - 0.00% -
401.bzip2 -3.45% 29.000 28.000 - 0.00% -
401.bzip2 (avg) -3.45% 29.000 28.000 - 0.00% -
458.sjeng (max) (percentage) -3.33% 0.600 0.580 - 0.00% -
429.mcf -3.33% 30.000 29.000 - 0.00% -
429.mcf (avg) -3.33% 30.000 29.000 - 0.00% -
429.mcf (avg) (percentage) -3.27% 3.360 3.250 - 0.00% -
447.dealII (max) (percentage) -3.26% 2.760 2.670 - 0.00% -
473.astar -3.17% 63.000 61.000 - 0.00% -
473.astar (avg) -3.17% 63.000 61.000 - 0.00% -
400.perlbench (max) -3.03% 33.000 32.000 - 0.00% -
453.povray (avg) (percentage) -3.00% 1.000 0.970 - 0.00% -
410.bwaves (avg) (percentage) -2.70% 0.740 0.720 - 0.00% -
447.dealII (max) -2.70% 37.000 36.000 - 0.00% -
453.povray (max) (percentage) -2.63% 1.520 1.480 - 0.00% -
434.zeusmp (avg) (percentage) -2.60% 0.770 0.750 - 0.00% -
464.h264ref (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
458.sjeng (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
410.bwaves -2.56% 39.000 38.000 - 0.00% -
410.bwaves (avg) -2.56% 39.000 38.000 - 0.00% -
465.tonto (max) (percentage) -2.46% 1.220 1.190 - 0.00% -
464.h264ref (max) -2.44% 41.000 40.000 - 0.00% -
458.sjeng (max) -2.38% 42.000 41.000 - 0.00% -
433.milc (avg) (percentage) -2.25% 0.890 0.870 - 0.00% -
403.gcc (max) (percentage) -1.68% 3.570 3.510 - 0.00% -
465.tonto (max) -1.68% 119.000 117.000 - 0.00% -
470.lbm (avg) (percentage) -1.61% 0.620 0.610 - 0.00% -
400.perlbench (max) (percentage) -1.39% 2.160 2.130 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.86% 381188.000 392074.000 - 0.00% -
481.wrf 2.70% 3709079.000 3809378.000 - 0.00% -
444.namd 2.50% 225019.000 230649.000 - 0.00% -
437.leslie3d 2.39% 79677.000 81581.000 - 0.00% -
410.bwaves 2.25% 22626.000 23134.000 - 0.00% -
459.GemsFDTD 2.06% 326542.000 333262.000 - 0.00% -
464.h264ref 1.71% 448678.000 456350.000 - 0.00% -
401.bzip2 1.45% 48792.000 49500.000 - 0.00% -
416.gamess 1.42% 6775160.000 6871616.000 - 0.00% -
470.lbm 1.33% 10803.000 10947.000 - 0.00% -
465.tonto 1.11% 2255286.000 2280249.000 - 0.00% -
436.cactusADM 1.04% 409394.000 413646.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 10.76% 1366.000 1513.000 - -2.13% -
403.gcc 5.77% 52.000 55.000 - 1.85% -
458.sjeng 5.74% 6725.000 7111.000 - -0.29% -
416.gamess 5.13% 14139.000 14865.000 - 0.08% -
401.bzip2 2.82% 2728.000 2805.000 - 0.50% -
481.wrf 1.59% 5080.000 5161.000 - 2.06% -
471.omnetpp 1.29% 2171.000 2199.000 - 2.14% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
453.povray -1.41% 792591.000 781388.000 - 0.00% -
403.gcc -1.39% 2947961.000 2907021.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -5.68% 10347.000 9759.000 - -13.77% -
462.libquantum -5.31% 113.000 107.000 - 0.94% -
429.mcf -3.03% 924.000 896.000 - -1.54% -
447.dealII -1.99% 1409.000 1381.000 - 1.40% -
454.calculix -1.69% 59.000 58.000 - 0.00% -
464.h264ref -1.07% 5407.000 5349.000 - 0.06% -
435.gromacs -1.03% 5720.000 5661.000 - -3.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1513.000 -2.13%
401.bzip2 2805.000 -
403.gcc 55.000 1.85%
410.bwaves 5374.000 -
416.gamess 14865.000 -
429.mcf 896.000 -1.54%
433.milc 1111.000 -
434.zeusmp 2383.000 -
435.gromacs 5661.000 -3.20%
436.cactusADM 2376.000 -
437.leslie3d 9759.000 -13.77%
444.namd 774.000 -
445.gobmk 4753.000 -
447.dealII 1381.000 1.40%
450.soplex 528.000 -2.58%
453.povray 427.000 -
454.calculix 58.000 -
456.hmmer 3380.000 -
458.sjeng 7111.000 -
459.GemsFDTD 5166.000 -
462.libquantum 107.000 -
464.h264ref 5349.000 -
465.tonto 9868.000 -
470.lbm 3913.000 -
471.omnetpp 2199.000 2.14%
473.astar 4881.000 -
481.wrf 5161.000 2.06%
482.sphinx3 755.000 -
Geometric Mean 1875.317 -
Name Current %
400.perlbench 1029373.000 -
401.bzip2 49500.000 -
403.gcc 2907021.000 -
410.bwaves 23134.000 -
416.gamess 6871616.000 -
429.mcf 9683.000 -
433.milc 70697.000 -
434.zeusmp 218524.000 -
435.gromacs 575888.000 -
436.cactusADM 413646.000 -
437.leslie3d 81581.000 -
444.namd 230649.000 -
445.gobmk 1397941.000 -
447.dealII 392074.000 -
450.soplex 245207.000 -
453.povray 781388.000 -
454.calculix 999169.000 -
456.hmmer 126927.000 -
458.sjeng 118523.000 -
459.GemsFDTD 333262.000 -
462.libquantum 19961.000 -
464.h264ref 456350.000 -
465.tonto 2280249.000 -
470.lbm 10947.000 -
471.omnetpp 524823.000 -
473.astar 23628.000 -
481.wrf 3809378.000 -
482.sphinx3 128827.000 -
Geometric Mean 248322.494 -
Name Current %
400.perlbench 20.000 5.26%
400.perlbench (avg) 20.000 5.26%
400.perlbench (avg) (percentage) 1.340 5.51%
400.perlbench (max) 32.000 -3.03%
400.perlbench (max) (percentage) 2.130 -1.39%
400.perlbench (unexplained diff vs previous) 33.000 -
400.perlbench (unexplained diff vs previous) (percentage) 2.180 -
401.bzip2 28.000 -3.45%
401.bzip2 (avg) 28.000 -3.45%
401.bzip2 (avg) (percentage) 1.010 -3.81%
401.bzip2 (max) 14.000 -22.22%
401.bzip2 (max) (percentage) 0.500 -26.47%
401.bzip2 (unexplained diff vs previous) 14.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.500 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 3.430 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.510 -1.68%
410.bwaves 38.000 -2.56%
410.bwaves (avg) 38.000 -2.56%
410.bwaves (avg) (percentage) 0.720 -2.70%
410.bwaves (max) 20.000 -
410.bwaves (max) (percentage) 0.390 2.63%
410.bwaves (unexplained diff vs previous) 21.000 425.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.390 457.14%
416.gamess 16.000 -5.88%
416.gamess (avg) 16.000 -5.88%
416.gamess (avg) (percentage) 0.110 -
416.gamess (max) 13.000 -23.53%
416.gamess (max) (percentage) 0.090 -25.00%
416.gamess (unexplained diff vs previous) 12.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.080 -
429.mcf 29.000 -3.33%
429.mcf (avg) 29.000 -3.33%
429.mcf (avg) (percentage) 3.250 -3.27%
429.mcf (max) 13.000 -7.14%
429.mcf (max) (percentage) 1.540 -4.94%
429.mcf (unexplained diff vs previous) 14.000 100.00%
429.mcf (unexplained diff vs previous) (percentage) 1.560 102.60%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.870 -2.25%
433.milc (max) 6.000 -14.29%
433.milc (max) (percentage) 0.630 -12.50%
433.milc (unexplained diff vs previous) 7.000 -12.50%
433.milc (unexplained diff vs previous) (percentage) 0.630 -12.50%
434.zeusmp 17.000 -5.56%
434.zeusmp (avg) 17.000 -5.56%
434.zeusmp (avg) (percentage) 0.750 -2.60%
434.zeusmp (max) 14.000 -22.22%
434.zeusmp (max) (percentage) 0.590 -25.32%
434.zeusmp (unexplained diff vs previous) 12.000 -36.84%
434.zeusmp (unexplained diff vs previous) (percentage) 0.500 -36.71%
435.gromacs 102.000 4.08%
435.gromacs (avg) 102.000 4.08%
435.gromacs (avg) (percentage) 1.810 7.74%
435.gromacs (max) 181.000 32.12%
435.gromacs (max) (percentage) 3.200 36.17%
435.gromacs (unexplained diff vs previous) 187.000 179.10%
435.gromacs (unexplained diff vs previous) (percentage) 3.300 186.96%
436.cactusADM 11.000 -8.33%
436.cactusADM (avg) 11.000 -8.33%
436.cactusADM (avg) (percentage) 0.500 -5.66%
436.cactusADM (max) 17.000 -15.00%
436.cactusADM (max) (percentage) 0.740 -12.94%
436.cactusADM (unexplained diff vs previous) 3.000 -85.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.130 -84.52%
437.leslie3d 411.000 4.31%
437.leslie3d (avg) 411.000 4.31%
437.leslie3d (avg) (percentage) 4.220 20.92%
437.leslie3d (max) 1343.000 1.67%
437.leslie3d (max) (percentage) 13.770 17.89%
437.leslie3d (unexplained diff vs previous) 1558.000 31.59%
437.leslie3d (unexplained diff vs previous) (percentage) 15.960 52.58%
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.390 -7.14%
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.430 -12.24%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 41.000 -
445.gobmk (avg) 41.000 -
445.gobmk (avg) (percentage) 0.880 -
445.gobmk (max) 86.000 -11.34%
445.gobmk (max) (percentage) 1.820 -12.08%
445.gobmk (unexplained diff vs previous) 45.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.950 -
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 1.220 1.67%
447.dealII (max) 36.000 -2.70%
447.dealII (max) (percentage) 2.670 -3.26%
447.dealII (unexplained diff vs previous) 19.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.380 -
450.soplex 10.000 -
450.soplex (avg) 10.000 -
450.soplex (avg) (percentage) 2.020 2.54%
450.soplex (max) 13.000 62.50%
450.soplex (max) (percentage) 2.580 70.86%
450.soplex (unexplained diff vs previous) 14.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.650 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.970 -3.00%
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.480 -2.63%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.700 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 1.810 -10.84%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.920 -3.63%
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 6.000 20.00%
456.hmmer (avg) 6.000 20.00%
456.hmmer (avg) (percentage) 0.180 12.50%
456.hmmer (max) 13.000 225.00%
456.hmmer (max) (percentage) 0.410 241.67%
456.hmmer (unexplained diff vs previous) 14.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.410 -
458.sjeng 27.000 -
458.sjeng (avg) 27.000 -
458.sjeng (avg) (percentage) 0.380 -2.56%
458.sjeng (max) 41.000 -2.38%
458.sjeng (max) (percentage) 0.580 -3.33%
458.sjeng (unexplained diff vs previous) 21.000 -40.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.300 -38.78%
459.GemsFDTD 43.000 -6.52%
459.GemsFDTD (avg) 43.000 -6.52%
459.GemsFDTD (avg) (percentage) 0.840 -6.67%
459.GemsFDTD (max) 16.000 -38.46%
459.GemsFDTD (max) (percentage) 0.320 -38.46%
459.GemsFDTD (unexplained diff vs previous) 7.000 -65.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.140 -64.10%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.100 -
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.730 -13.07%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.930 -50.79%
464.h264ref 22.000 -12.00%
464.h264ref (avg) 22.000 -12.00%
464.h264ref (avg) (percentage) 0.420 -10.64%
464.h264ref (max) 40.000 -2.44%
464.h264ref (max) (percentage) 0.750 -2.60%
464.h264ref (unexplained diff vs previous) 3.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -
465.tonto 66.000 -4.35%
465.tonto (avg) 66.000 -4.35%
465.tonto (avg) (percentage) 0.670 -5.63%
465.tonto (max) 117.000 -1.68%
465.tonto (max) (percentage) 1.190 -2.46%
465.tonto (unexplained diff vs previous) 46.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.470 -
470.lbm 23.000 -4.17%
470.lbm (avg) 23.000 -4.17%
470.lbm (avg) (percentage) 0.610 -1.61%
470.lbm (max) 27.000 -6.90%
470.lbm (max) (percentage) 0.700 -5.41%
470.lbm (unexplained diff vs previous) 23.000 64.29%
470.lbm (unexplained diff vs previous) (percentage) 0.590 63.89%
471.omnetpp 26.000 8.33%
471.omnetpp (avg) 26.000 8.33%
471.omnetpp (avg) (percentage) 1.220 5.17%
471.omnetpp (max) 47.000 27.03%
471.omnetpp (max) (percentage) 2.140 21.59%
471.omnetpp (unexplained diff vs previous) 46.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.090 -
473.astar 61.000 -3.17%
473.astar (avg) 61.000 -3.17%
473.astar (avg) (percentage) 1.260 -3.82%
473.astar (max) 127.000 -7.97%
473.astar (max) (percentage) 2.620 -8.39%
473.astar (unexplained diff vs previous) 32.000 -69.52%
473.astar (unexplained diff vs previous) (percentage) 0.660 -69.59%
481.wrf 72.000 9.09%
481.wrf (avg) 72.000 9.09%
481.wrf (avg) (percentage) 1.400 6.87%
481.wrf (max) 106.000 7.07%
481.wrf (max) (percentage) 2.060 4.57%
481.wrf (unexplained diff vs previous) 104.000 -
481.wrf (unexplained diff vs previous) (percentage) 2.020 -
482.sphinx3 9.000 -10.00%
482.sphinx3 (avg) 9.000 -10.00%
482.sphinx3 (avg) (percentage) 1.260 -6.67%
482.sphinx3 (max) 15.000 -21.05%
482.sphinx3 (max) (percentage) 2.070 -18.50%
482.sphinx3 (unexplained diff vs previous) 1.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.130 -
Geometric Mean 3.965 -28.29%