Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8c749ff8aa787049cea4d4f7331493ee17565344 (+ 6 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/241/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0241 (llvmorg-20-init-14090-g8c749ff8aa78) 2024-12-02T04:09:23 0:00:00
Previous 0240 (llvmorg-20-init-14084-gf33536468b7f) 2024-11-30T17:59:48 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 67 9
Performance Improvements 91 16
Added Tests 9 153
Unchanged Tests 1009 998
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 4.31% 510.000 532.000 - 1.72% -
482.sphinx3 3.73% 778.000 807.000 - 1.13% -
471.omnetpp 2.48% 2542.000 2605.000 - 3.17% -
447.dealII 2.27% 1587.000 1623.000 - 1.44% -
453.povray 2.04% 442.000 451.000 - 2.73% -
444.namd 1.35% 669.000 678.000 - 0.00% -
433.milc 1.31% 1221.000 1237.000 - -0.32% -
437.leslie3d 1.01% 44005.000 44448.000 - -21.75% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 270.59% 17.000 63.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 261.19% 0.670 2.420 - 0.00% -
453.povray (unexplained diff vs previous) 200.00% 3.000 9.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 194.12% 0.680 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 163.64% 11.000 29.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 154.61% 1.410 3.590 - 0.00% -
437.leslie3d (unexplained diff vs previous) 134.39% 189.000 443.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 132.56% 0.430 1.000 - 0.00% -
482.sphinx3 (max) 100.00% 15.000 30.000 - 0.00% -
482.sphinx3 (max) (percentage) 82.84% 2.040 3.730 - 0.00% -
437.leslie3d (max) 54.48% 290.000 448.000 - 0.00% -
437.leslie3d (max) (percentage) 53.03% 0.660 1.010 - 0.00% -
456.hmmer (unexplained diff vs previous) 42.86% 7.000 10.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 40.00% 0.250 0.350 - 0.00% -
447.dealII (unexplained diff vs previous) 38.46% 26.000 36.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 35.37% 1.640 2.220 - 0.00% -
433.milc (unexplained diff vs previous) 33.33% 12.000 16.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 31.63% 0.980 1.290 - 0.00% -
444.namd (max) 28.57% 7.000 9.000 - 0.00% -
444.namd (unexplained diff vs previous) 28.57% 7.000 9.000 - 0.00% -
447.dealII (max) 28.57% 28.000 36.000 - 0.00% -
456.hmmer (max) 28.57% 7.000 9.000 - 0.00% -
447.dealII (max) (percentage) 26.82% 1.790 2.270 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 26.67% 1.050 1.330 - 0.00% -
444.namd (max) (percentage) 26.17% 1.070 1.350 - 0.00% -
437.leslie3d 25.00% 96.000 120.000 - 0.00% -
437.leslie3d (avg) 25.00% 96.000 120.000 - 0.00% -
456.hmmer (max) (percentage) 25.00% 0.280 0.350 - 0.00% -
436.cactusADM (max) 23.53% 17.000 21.000 - 0.00% -
437.leslie3d (avg) (percentage) 22.73% 0.220 0.270 - 0.00% -
436.cactusADM (max) (percentage) 18.52% 0.270 0.320 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 18.52% 0.270 0.320 - 0.00% -
482.sphinx3 18.18% 11.000 13.000 - 0.00% -
482.sphinx3 (avg) 18.18% 11.000 13.000 - 0.00% -
433.milc 16.67% 6.000 7.000 - 0.00% -
433.milc (avg) 16.67% 6.000 7.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 16.67% 18.000 21.000 - 0.00% -
447.dealII 12.50% 16.000 18.000 - 0.00% -
447.dealII (avg) 12.50% 16.000 18.000 - 0.00% -
482.sphinx3 (avg) (percentage) 10.88% 1.470 1.630 - 0.00% -
447.dealII (avg) (percentage) 10.38% 1.060 1.170 - 0.00% -
436.cactusADM 10.00% 10.000 11.000 - 0.00% -
436.cactusADM (avg) 10.00% 10.000 11.000 - 0.00% -
450.soplex 8.33% 12.000 13.000 - 0.00% -
450.soplex (avg) 8.33% 12.000 13.000 - 0.00% -
471.omnetpp (max) 6.67% 60.000 64.000 - 0.00% -
436.cactusADM (avg) (percentage) 6.25% 0.160 0.170 - 0.00% -
471.omnetpp 5.88% 34.000 36.000 - 0.00% -
471.omnetpp (avg) 5.88% 34.000 36.000 - 0.00% -
453.povray (avg) (percentage) 5.63% 1.420 1.500 - 0.00% -
433.milc (avg) (percentage) 5.45% 0.550 0.580 - 0.00% -
471.omnetpp (max) (percentage) 3.77% 2.390 2.480 - 0.00% -
444.namd (avg) (percentage) 3.75% 0.800 0.830 - 0.00% -
450.soplex (avg) (percentage) 3.64% 2.470 2.560 - 0.00% -
410.bwaves 3.12% 32.000 33.000 - 0.00% -
410.bwaves (avg) 3.12% 32.000 33.000 - 0.00% -
471.omnetpp (avg) (percentage) 2.94% 1.360 1.400 - 0.00% -
459.GemsFDTD 1.43% 70.000 71.000 - 0.00% -
459.GemsFDTD (avg) 1.43% 70.000 71.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.14% 88.000 87.000 - -2.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -99.21% 17.820 0.140 - 0.00% -
429.mcf (unexplained diff vs previous) -99.21% 252.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -98.03% 152.000 3.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -97.97% 2.960 0.060 - 0.00% -
435.gromacs (unexplained diff vs previous) -84.24% 165.000 26.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -84.21% 0.950 0.150 - 0.00% -
462.libquantum (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -83.14% 6.820 1.150 - 0.00% -
464.h264ref (unexplained diff vs previous) -79.49% 39.000 8.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -78.95% 0.950 0.200 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -75.59% 1.270 0.310 - 0.00% -
458.sjeng (unexplained diff vs previous) -75.28% 89.000 22.000 - 0.00% -
470.lbm (unexplained diff vs previous) -69.70% 33.000 10.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -69.23% 1.040 0.320 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -63.41% 0.410 0.150 - 0.00% -
410.bwaves (unexplained diff vs previous) -62.35% 85.000 32.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -59.09% 0.220 0.090 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -58.67% 0.750 0.310 - 0.00% -
401.bzip2 (unexplained diff vs previous) -57.89% 19.000 8.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -57.89% 19.000 8.000 - 0.00% -
416.gamess (unexplained diff vs previous) -51.19% 84.000 41.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -50.00% 0.220 0.110 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -44.13% 179.000 100.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -43.68% 0.870 0.490 - 0.00% -
400.perlbench -31.71% 41.000 28.000 - 0.00% -
400.perlbench (avg) -31.71% 41.000 28.000 - 0.00% -
400.perlbench (avg) (percentage) -31.08% 2.510 1.730 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -29.59% 5.880 4.140 - 0.00% -
450.soplex (unexplained diff vs previous) -26.67% 30.000 22.000 - 0.00% -
465.tonto (max) -17.24% 116.000 96.000 - 0.00% -
462.libquantum (max) -16.67% 6.000 5.000 - 0.00% -
465.tonto (max) (percentage) -16.67% 0.180 0.150 - 0.00% -
429.mcf (max) (percentage) -16.66% 15.130 12.610 - 0.00% -
429.mcf (max) -16.43% 213.000 178.000 - 0.00% -
416.gamess (max) -14.29% 84.000 72.000 - 0.00% -
416.gamess (max) (percentage) -13.64% 0.220 0.190 - 0.00% -
459.GemsFDTD (max) -12.71% 181.000 158.000 - 0.00% -
462.libquantum (max) (percentage) -12.57% 7.320 6.400 - 0.00% -
459.GemsFDTD (max) (percentage) -12.50% 0.880 0.770 - 0.00% -
410.bwaves (max) (percentage) -12.20% 0.410 0.360 - 0.00% -
410.bwaves (max) -11.90% 84.000 74.000 - 0.00% -
435.gromacs (max) (percentage) -11.11% 0.990 0.880 - 0.00% -
435.gromacs (max) -11.05% 172.000 153.000 - 0.00% -
433.milc (max) -10.00% 20.000 18.000 - 0.00% -
470.lbm (max) -9.52% 42.000 38.000 - 0.00% -
470.lbm (max) (percentage) -8.89% 1.350 1.230 - 0.00% -
473.astar (max) (percentage) -8.62% 3.250 2.970 - 0.00% -
458.sjeng (max) (percentage) -8.59% 1.280 1.170 - 0.00% -
433.milc (max) (percentage) -8.54% 1.640 1.500 - 0.00% -
473.astar (max) -8.43% 166.000 152.000 - 0.00% -
458.sjeng (max) -7.87% 89.000 82.000 - 0.00% -
450.soplex (max) (percentage) -7.43% 7.400 6.850 - 0.00% -
465.tonto (avg) (percentage) -7.14% 0.140 0.130 - 0.00% -
434.zeusmp (max) -6.67% 30.000 28.000 - 0.00% -
464.h264ref -6.67% 15.000 14.000 - 0.00% -
464.h264ref (avg) -6.67% 15.000 14.000 - 0.00% -
465.tonto -6.67% 90.000 84.000 - 0.00% -
465.tonto (avg) -6.67% 90.000 84.000 - 0.00% -
481.wrf (avg) (percentage) -6.25% 0.160 0.150 - 0.00% -
401.bzip2 (max) -5.56% 72.000 68.000 - 0.00% -
434.zeusmp (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
464.h264ref (avg) (percentage) -5.41% 0.370 0.350 - 0.00% -
481.wrf -5.26% 38.000 36.000 - 0.00% -
481.wrf (avg) -5.26% 38.000 36.000 - 0.00% -
401.bzip2 (max) (percentage) -5.24% 2.860 2.710 - 0.00% -
429.mcf (avg) (percentage) -4.57% 2.190 2.090 - 0.00% -
401.bzip2 -4.17% 24.000 23.000 - 0.00% -
401.bzip2 (avg) -4.17% 24.000 23.000 - 0.00% -
401.bzip2 (avg) (percentage) -4.17% 0.960 0.920 - 0.00% -
473.astar (avg) (percentage) -3.70% 0.810 0.780 - 0.00% -
458.sjeng (avg) (percentage) -3.64% 0.550 0.530 - 0.00% -
481.wrf (max) -3.51% 57.000 55.000 - 0.00% -
429.mcf -3.33% 30.000 29.000 - 0.00% -
429.mcf (avg) -3.33% 30.000 29.000 - 0.00% -
445.gobmk (max) (percentage) -3.16% 1.580 1.530 - 0.00% -
464.h264ref (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
450.soplex (max) -2.70% 37.000 36.000 - 0.00% -
462.libquantum (avg) (percentage) -2.67% 2.620 2.550 - 0.00% -
435.gromacs -2.63% 76.000 74.000 - 0.00% -
435.gromacs (avg) -2.63% 76.000 74.000 - 0.00% -
458.sjeng -2.63% 38.000 37.000 - 0.00% -
458.sjeng (avg) -2.63% 38.000 37.000 - 0.00% -
464.h264ref (max) -2.56% 39.000 38.000 - 0.00% -
473.astar -2.44% 41.000 40.000 - 0.00% -
473.astar (avg) -2.44% 41.000 40.000 - 0.00% -
435.gromacs (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
453.povray (max) (percentage) -2.11% 2.840 2.780 - 0.00% -
470.lbm (avg) (percentage) -1.69% 0.590 0.580 - 0.00% -
403.gcc (max) (percentage) -1.23% 7.310 7.220 - 0.00% -
400.perlbench (max) (percentage) -1.18% 2.550 2.520 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (max)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd 1.60% 193170.000 196267.000 - 0.00% -
401.bzip2 1.51% 53812.000 54624.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 4.24% 3935.000 4102.000 - 0.20% -
471.omnetpp 3.17% 2525.000 2605.000 - 2.48% -
453.povray 2.73% 439.000 451.000 - 2.04% -
450.soplex 1.72% 523.000 532.000 - 4.31% -
447.dealII 1.44% 1600.000 1623.000 - 2.27% -
482.sphinx3 1.13% 798.000 807.000 - 3.73% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.82% 34.000 31.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -18.20% 1135066.000 928441.000 - 0.00% -
465.tonto -17.53% 14243435.000 11746689.000 - 0.00% -
410.bwaves -9.49% 670624.000 606952.000 - 0.00% -
434.zeusmp -7.13% 1365588.000 1268237.000 - 0.00% -
459.GemsFDTD -3.64% 2149275.000 2071052.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.96% 5066.000 2.000 - 0.00% -
429.mcf -26.46% 1920.000 1412.000 - -0.14% -
437.leslie3d -21.75% 56799.000 44448.000 - 1.01% -
459.GemsFDTD -13.34% 23686.000 20526.000 - -0.48% -
465.tonto -5.63% 68481.000 64628.000 - 0.08% -
403.gcc -4.92% 61.000 58.000 - 0.00% -
410.bwaves -3.98% 21502.000 20646.000 - 0.16% -
462.libquantum -2.25% 89.000 87.000 - -1.14% -
458.sjeng -2.02% 7191.000 7046.000 - 0.31% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 12.50% 24.000 27.000 - 0.00% -
nb_execution_successful 8.33% 24.000 26.000 - 0.00% -

Added Tests - Code Size
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - Execution
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1651.000 -
401.bzip2 2540.000 -
403.gcc 58.000 -
410.bwaves 20646.000 -
416.gamess 38164.000 -
429.mcf 1412.000 -
433.milc 1237.000 1.31%
434.zeusmp 8475.000 -
435.gromacs 17403.000 -
436.cactusADM 6660.000 -
437.leslie3d 44448.000 1.01%
444.namd 678.000 1.35%
445.gobmk 2.000 -
447.dealII 1623.000 2.27%
450.soplex 532.000 4.31%
453.povray 451.000 2.04%
456.hmmer 2836.000 -
458.sjeng 7046.000 -
459.GemsFDTD 20526.000 -
462.libquantum 87.000 -1.14%
464.h264ref 4102.000 -
465.tonto 64628.000 -
470.lbm 3163.000 -
471.omnetpp 2605.000 2.48%
473.astar 5141.000 -
481.wrf 24022.000 -
482.sphinx3 807.000 3.73%
Geometric Mean 2507.137 -
Name Current %
400.perlbench 1041110.000 -
401.bzip2 54624.000 -
403.gcc 2998072.000 -
410.bwaves 606952.000 -
416.gamess 12742743.000 -
429.mcf 11531.000 -
433.milc 103684.000 -
434.zeusmp 1268237.000 -
435.gromacs 978504.000 -
436.cactusADM 1239536.000 -
437.leslie3d 928441.000 -
444.namd 196267.000 -
447.dealII 2630869.000 -
450.soplex 305306.000 -
453.povray 773027.000 -
456.hmmer 251142.000 -
458.sjeng 124339.000 -
459.GemsFDTD 2071052.000 -
462.libquantum 35820.000 -
464.h264ref 460549.000 -
465.tonto 11746689.000 -
470.lbm 11388.000 -
471.omnetpp 633870.000 -
473.astar 34592.000 -
481.wrf 9388455.000 -
482.sphinx3 167561.000 -
Geometric Mean 455899.466 -
Name Current %
400.perlbench 28.000 -31.71%
400.perlbench (avg) 28.000 -31.71%
400.perlbench (avg) (percentage) 1.730 -31.08%
400.perlbench (max) 41.000 -
400.perlbench (max) (percentage) 2.520 -1.18%
400.perlbench (unexplained diff vs previous) 8.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.480 -
401.bzip2 23.000 -4.17%
401.bzip2 (avg) 23.000 -4.17%
401.bzip2 (avg) (percentage) 0.920 -4.17%
401.bzip2 (max) 68.000 -5.56%
401.bzip2 (max) (percentage) 2.710 -5.24%
401.bzip2 (unexplained diff vs previous) 8.000 -57.89%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 -58.67%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.540 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.220 -1.23%
410.bwaves 33.000 3.12%
410.bwaves (avg) 33.000 3.12%
410.bwaves (avg) (percentage) 0.160 -
410.bwaves (max) 74.000 -11.90%
410.bwaves (max) (percentage) 0.360 -12.20%
410.bwaves (unexplained diff vs previous) 32.000 -62.35%
410.bwaves (unexplained diff vs previous) (percentage) 0.150 -63.41%
416.gamess 38.000 -
416.gamess (avg) 38.000 -
416.gamess (avg) (percentage) 0.100 -
416.gamess (max) 72.000 -14.29%
416.gamess (max) (percentage) 0.190 -13.64%
416.gamess (unexplained diff vs previous) 41.000 -51.19%
416.gamess (unexplained diff vs previous) (percentage) 0.110 -50.00%
429.mcf 29.000 -3.33%
429.mcf (avg) 29.000 -3.33%
429.mcf (avg) (percentage) 2.090 -4.57%
429.mcf (max) 178.000 -16.43%
429.mcf (max) (percentage) 12.610 -16.66%
429.mcf (unexplained diff vs previous) 2.000 -99.21%
429.mcf (unexplained diff vs previous) (percentage) 0.140 -99.21%
433.milc 7.000 16.67%
433.milc (avg) 7.000 16.67%
433.milc (avg) (percentage) 0.580 5.45%
433.milc (max) 18.000 -10.00%
433.milc (max) (percentage) 1.500 -8.54%
433.milc (unexplained diff vs previous) 16.000 33.33%
433.milc (unexplained diff vs previous) (percentage) 1.290 31.63%
434.zeusmp 11.000 -
434.zeusmp (avg) 11.000 -
434.zeusmp (avg) (percentage) 0.130 -
434.zeusmp (max) 28.000 -6.67%
434.zeusmp (max) (percentage) 0.340 -5.56%
434.zeusmp (unexplained diff vs previous) 8.000 -57.89%
434.zeusmp (unexplained diff vs previous) (percentage) 0.090 -59.09%
435.gromacs 74.000 -2.63%
435.gromacs (avg) 74.000 -2.63%
435.gromacs (avg) (percentage) 0.430 -2.27%
435.gromacs (max) 153.000 -11.05%
435.gromacs (max) (percentage) 0.880 -11.11%
435.gromacs (unexplained diff vs previous) 26.000 -84.24%
435.gromacs (unexplained diff vs previous) (percentage) 0.150 -84.21%
436.cactusADM 11.000 10.00%
436.cactusADM (avg) 11.000 10.00%
436.cactusADM (avg) (percentage) 0.170 6.25%
436.cactusADM (max) 21.000 23.53%
436.cactusADM (max) (percentage) 0.320 18.52%
436.cactusADM (unexplained diff vs previous) 21.000 16.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.320 18.52%
437.leslie3d 120.000 25.00%
437.leslie3d (avg) 120.000 25.00%
437.leslie3d (avg) (percentage) 0.270 22.73%
437.leslie3d (max) 448.000 54.48%
437.leslie3d (max) (percentage) 1.010 53.03%
437.leslie3d (unexplained diff vs previous) 443.000 134.39%
437.leslie3d (unexplained diff vs previous) (percentage) 1.000 132.56%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.830 3.75%
444.namd (max) 9.000 28.57%
444.namd (max) (percentage) 1.350 26.17%
444.namd (unexplained diff vs previous) 9.000 28.57%
444.namd (unexplained diff vs previous) (percentage) 1.330 26.67%
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 0.490 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 1.530 -3.16%
447.dealII 18.000 12.50%
447.dealII (avg) 18.000 12.50%
447.dealII (avg) (percentage) 1.170 10.38%
447.dealII (max) 36.000 28.57%
447.dealII (max) (percentage) 2.270 26.82%
447.dealII (unexplained diff vs previous) 36.000 38.46%
447.dealII (unexplained diff vs previous) (percentage) 2.220 35.37%
450.soplex 13.000 8.33%
450.soplex (avg) 13.000 8.33%
450.soplex (avg) (percentage) 2.560 3.64%
450.soplex (max) 36.000 -2.70%
450.soplex (max) (percentage) 6.850 -7.43%
450.soplex (unexplained diff vs previous) 22.000 -26.67%
450.soplex (unexplained diff vs previous) (percentage) 4.140 -29.59%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.500 5.63%
453.povray (max) 12.000 -
453.povray (max) (percentage) 2.780 -2.11%
453.povray (unexplained diff vs previous) 9.000 200.00%
453.povray (unexplained diff vs previous) (percentage) 2.000 194.12%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.290 -
456.hmmer (max) 9.000 28.57%
456.hmmer (max) (percentage) 0.350 25.00%
456.hmmer (unexplained diff vs previous) 10.000 42.86%
456.hmmer (unexplained diff vs previous) (percentage) 0.350 40.00%
458.sjeng 37.000 -2.63%
458.sjeng (avg) 37.000 -2.63%
458.sjeng (avg) (percentage) 0.530 -3.64%
458.sjeng (max) 82.000 -7.87%
458.sjeng (max) (percentage) 1.170 -8.59%
458.sjeng (unexplained diff vs previous) 22.000 -75.28%
458.sjeng (unexplained diff vs previous) (percentage) 0.310 -75.59%
459.GemsFDTD 71.000 1.43%
459.GemsFDTD (avg) 71.000 1.43%
459.GemsFDTD (avg) (percentage) 0.350 -
459.GemsFDTD (max) 158.000 -12.71%
459.GemsFDTD (max) (percentage) 0.770 -12.50%
459.GemsFDTD (unexplained diff vs previous) 100.000 -44.13%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.490 -43.68%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.550 -2.67%
462.libquantum (max) 5.000 -16.67%
462.libquantum (max) (percentage) 6.400 -12.57%
462.libquantum (unexplained diff vs previous) 1.000 -83.33%
462.libquantum (unexplained diff vs previous) (percentage) 1.150 -83.14%
464.h264ref 14.000 -6.67%
464.h264ref (avg) 14.000 -6.67%
464.h264ref (avg) (percentage) 0.350 -5.41%
464.h264ref (max) 38.000 -2.56%
464.h264ref (max) (percentage) 0.930 -3.12%
464.h264ref (unexplained diff vs previous) 8.000 -79.49%
464.h264ref (unexplained diff vs previous) (percentage) 0.200 -78.95%
465.tonto 84.000 -6.67%
465.tonto (avg) 84.000 -6.67%
465.tonto (avg) (percentage) 0.130 -7.14%
465.tonto (max) 96.000 -17.24%
465.tonto (max) (percentage) 0.150 -16.67%
465.tonto (unexplained diff vs previous) 51.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.080 -
470.lbm 18.000 -
470.lbm (avg) 18.000 -
470.lbm (avg) (percentage) 0.580 -1.69%
470.lbm (max) 38.000 -9.52%
470.lbm (max) (percentage) 1.230 -8.89%
470.lbm (unexplained diff vs previous) 10.000 -69.70%
470.lbm (unexplained diff vs previous) (percentage) 0.320 -69.23%
471.omnetpp 36.000 5.88%
471.omnetpp (avg) 36.000 5.88%
471.omnetpp (avg) (percentage) 1.400 2.94%
471.omnetpp (max) 64.000 6.67%
471.omnetpp (max) (percentage) 2.480 3.77%
471.omnetpp (unexplained diff vs previous) 63.000 270.59%
471.omnetpp (unexplained diff vs previous) (percentage) 2.420 261.19%
473.astar 40.000 -2.44%
473.astar (avg) 40.000 -2.44%
473.astar (avg) (percentage) 0.780 -3.70%
473.astar (max) 152.000 -8.43%
473.astar (max) (percentage) 2.970 -8.62%
473.astar (unexplained diff vs previous) 3.000 -98.03%
473.astar (unexplained diff vs previous) (percentage) 0.060 -97.97%
481.wrf 36.000 -5.26%
481.wrf (avg) 36.000 -5.26%
481.wrf (avg) (percentage) 0.150 -6.25%
481.wrf (max) 55.000 -3.51%
481.wrf (max) (percentage) 0.230 -
481.wrf (unexplained diff vs previous) 6.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.020 -
482.sphinx3 13.000 18.18%
482.sphinx3 (avg) 13.000 18.18%
482.sphinx3 (avg) (percentage) 1.630 10.88%
482.sphinx3 (max) 30.000 100.00%
482.sphinx3 (max) (percentage) 3.730 82.84%
482.sphinx3 (unexplained diff vs previous) 29.000 163.64%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.590 154.61%
483.xalancbmk (avg) (percentage) 1.100 -
483.xalancbmk (max) (percentage) 1.100 -
Geometric Mean 4.010 -32.22%