Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a5d8b7aeb6b360f20eec88715081ecfdb286b83d (+ 1 commits)
regression LLVM-1587
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os_LTO-build/293/
View Options
Report
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0293 (llvmorg-21-init-03087-ga5d8b7aeb6b3) 2025-02-26T00:31:05 0:00:00
Previous 0292 (llvmorg-21-init-03086-g3c4fa5a20aff) 2025-02-25T11:12:23 0:00:00
Baseline 0288 (llvmorg-21-init-02507-g6e5f26bba87b) 2025-02-21T02:39:38 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 61 2
Performance Improvements 99 4
Added Tests 5 127
Unchanged Tests 951 983
Total Tests 1116

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
473.astar 8.42% 25848.000 28024.000 - 8.42% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
445.gobmk 100.00% 1.000 2.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) (percentage) 1657.14% 0.070 1.230 - 0.00% -
436.cactusADM (unexplained diff vs previous) 1600.00% 1.000 17.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 440.91% 0.440 2.380 - 0.00% -
471.omnetpp (unexplained diff vs previous) 430.00% 10.000 53.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 200.00% 0.300 0.900 - 0.00% -
444.namd (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
471.omnetpp 145.45% 11.000 27.000 - 0.00% -
471.omnetpp (avg) 145.45% 11.000 27.000 - 0.00% -
471.omnetpp (max) (percentage) 139.18% 0.970 2.320 - 0.00% -
471.omnetpp (avg) (percentage) 138.46% 0.520 1.240 - 0.00% -
471.omnetpp (max) 131.82% 22.000 51.000 - 0.00% -
447.dealII (max) 100.00% 3.000 6.000 - 0.00% -
447.dealII (max) (percentage) 100.00% 0.230 0.460 - 0.00% -
447.dealII (unexplained diff vs previous) 100.00% 3.000 6.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 100.00% 0.230 0.460 - 0.00% -
416.gamess (max) 61.29% 31.000 50.000 - 0.00% -
416.gamess (unexplained diff vs previous) 59.38% 32.000 51.000 - 0.00% -
416.gamess (max) (percentage) 59.26% 0.270 0.430 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 59.26% 0.270 0.430 - 0.00% -
447.dealII (avg) (percentage) 56.52% 0.230 0.360 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 45.68% 2.430 3.540 - 0.00% -
429.mcf (avg) (percentage) 40.83% 1.690 2.380 - 0.00% -
429.mcf (unexplained diff vs previous) 40.54% 37.000 52.000 - 0.00% -
429.mcf (max) (percentage) 37.35% 2.490 3.420 - 0.00% -
429.mcf 36.00% 25.000 34.000 - 0.00% -
429.mcf (avg) 36.00% 25.000 34.000 - 0.00% -
416.gamess 35.48% 31.000 42.000 - 0.00% -
416.gamess (avg) 35.48% 31.000 42.000 - 0.00% -
429.mcf (max) 35.14% 37.000 50.000 - 0.00% -
410.bwaves 33.33% 9.000 12.000 - 0.00% -
410.bwaves (avg) 33.33% 9.000 12.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
444.namd 33.33% 3.000 4.000 - 0.00% -
444.namd (avg) 33.33% 3.000 4.000 - 0.00% -
447.dealII 33.33% 3.000 4.000 - 0.00% -
447.dealII (avg) 33.33% 3.000 4.000 - 0.00% -
416.gamess (avg) (percentage) 33.33% 0.270 0.360 - 0.00% -
444.namd (avg) (percentage) 32.65% 0.490 0.650 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 31.25% 0.160 0.210 - 0.00% -
410.bwaves (avg) (percentage) 28.57% 0.210 0.270 - 0.00% -
410.bwaves (max) 23.08% 13.000 16.000 - 0.00% -
436.cactusADM (avg) (percentage) 19.28% 0.830 0.990 - 0.00% -
436.cactusADM 18.18% 11.000 13.000 - 0.00% -
436.cactusADM (avg) 18.18% 11.000 13.000 - 0.00% -
410.bwaves (max) (percentage) 16.67% 0.300 0.350 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 16.67% 0.300 0.350 - 0.00% -
410.bwaves (unexplained diff vs previous) 14.29% 14.000 16.000 - 0.00% -
401.bzip2 10.00% 10.000 11.000 - 0.00% -
401.bzip2 (avg) 10.00% 10.000 11.000 - 0.00% -
458.sjeng (avg) (percentage) 7.69% 0.260 0.280 - 0.00% -
481.wrf (unexplained diff vs previous) 6.25% 16.000 17.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 6.12% 0.490 0.520 - 0.00% -
458.sjeng 5.88% 17.000 18.000 - 0.00% -
458.sjeng (avg) 5.88% 17.000 18.000 - 0.00% -
473.astar (avg) (percentage) 5.26% 0.190 0.200 - 0.00% -
401.bzip2 (avg) (percentage) 4.88% 0.410 0.430 - 0.00% -
437.leslie3d 1.33% 75.000 76.000 - 0.00% -
437.leslie3d (avg) 1.33% 75.000 76.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.02% 0.980 0.990 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.17% 58.000 55.000 - 0.00% -
429.mcf -3.42% 1522.000 1470.000 - -1.28% -
471.omnetpp -2.32% 2283.000 2230.000 - -1.50% -
453.povray -1.64% 427.000 420.000 - -1.41% -
436.cactusADM -1.22% 1395.000 1378.000 - -0.65% -
462.libquantum -1.15% 87.000 86.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (unexplained diff vs previous) -85.29% 34.000 5.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -83.33% 0.120 0.020 - 0.00% -
470.lbm (unexplained diff vs previous) -72.41% 29.000 8.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -72.22% 0.900 0.250 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -72.00% 0.250 0.070 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -70.59% 17.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -66.38% 3.450 1.160 - 0.00% -
433.milc (unexplained diff vs previous) -64.29% 14.000 5.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -64.29% 0.280 0.100 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -64.17% 1.200 0.430 - 0.00% -
450.soplex (unexplained diff vs previous) -63.64% 11.000 4.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -63.24% 2.040 0.750 - 0.00% -
456.hmmer (unexplained diff vs previous) -62.50% 8.000 3.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -55.26% 38.000 17.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -54.44% 0.900 0.410 - 0.00% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
465.tonto -50.00% 34.000 17.000 - 0.00% -
465.tonto (avg) -50.00% 34.000 17.000 - 0.00% -
465.tonto (avg) (percentage) -50.00% 0.120 0.060 - 0.00% -
464.h264ref (unexplained diff vs previous) -45.45% 11.000 6.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -44.44% 0.270 0.150 - 0.00% -
450.soplex -40.00% 10.000 6.000 - 0.00% -
450.soplex (avg) -40.00% 10.000 6.000 - 0.00% -
456.hmmer -37.50% 8.000 5.000 - 0.00% -
456.hmmer (avg) -37.50% 8.000 5.000 - 0.00% -
450.soplex (avg) (percentage) -36.00% 2.000 1.280 - 0.00% -
456.hmmer (avg) (percentage) -35.71% 0.280 0.180 - 0.00% -
459.GemsFDTD -33.33% 21.000 14.000 - 0.00% -
459.GemsFDTD (avg) -33.33% 21.000 14.000 - 0.00% -
435.gromacs -32.43% 37.000 25.000 - 0.00% -
435.gromacs (avg) -32.43% 37.000 25.000 - 0.00% -
435.gromacs (avg) (percentage) -32.22% 0.900 0.610 - 0.00% -
459.GemsFDTD (avg) (percentage) -31.25% 0.320 0.220 - 0.00% -
453.povray (unexplained diff vs previous) -30.00% 10.000 7.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -28.63% 2.340 1.670 - 0.00% -
433.milc -27.27% 11.000 8.000 - 0.00% -
433.milc (avg) -27.27% 11.000 8.000 - 0.00% -
464.h264ref (avg) (percentage) -25.93% 0.270 0.200 - 0.00% -
433.milc (avg) (percentage) -25.49% 1.020 0.760 - 0.00% -
470.lbm (max) -25.00% 28.000 21.000 - 0.00% -
462.libquantum (avg) (percentage) -24.92% 3.010 2.260 - 0.00% -
470.lbm (max) (percentage) -24.72% 0.890 0.670 - 0.00% -
453.povray -20.00% 10.000 8.000 - 0.00% -
453.povray (avg) -20.00% 10.000 8.000 - 0.00% -
453.povray (max) -20.00% 10.000 8.000 - 0.00% -
464.h264ref -20.00% 10.000 8.000 - 0.00% -
464.h264ref (avg) -20.00% 10.000 8.000 - 0.00% -
470.lbm -20.00% 15.000 12.000 - 0.00% -
470.lbm (avg) -20.00% 15.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -18.75% 0.480 0.390 - 0.00% -
453.povray (avg) (percentage) -17.92% 2.400 1.970 - 0.00% -
465.tonto (max) -17.65% 34.000 28.000 - 0.00% -
482.sphinx3 -16.67% 12.000 10.000 - 0.00% -
482.sphinx3 (avg) -16.67% 12.000 10.000 - 0.00% -
465.tonto (max) (percentage) -16.67% 0.120 0.100 - 0.00% -
482.sphinx3 (avg) (percentage) -14.86% 1.480 1.260 - 0.00% -
436.cactusADM (max) -14.29% 21.000 18.000 - 0.00% -
481.wrf (max) -14.29% 21.000 18.000 - 0.00% -
482.sphinx3 (max) -13.33% 15.000 13.000 - 0.00% -
462.libquantum (max) (percentage) -12.61% 3.330 2.910 - 0.00% -
433.milc (max) (percentage) -12.61% 1.190 1.040 - 0.00% -
403.gcc (max) (percentage) -12.57% 1.750 1.530 - 0.00% -
450.soplex (max) (percentage) -12.50% 2.000 1.750 - 0.00% -
456.hmmer (max) -12.50% 8.000 7.000 - 0.00% -
453.povray (max) (percentage) -12.50% 2.400 2.100 - 0.00% -
435.gromacs (max) (percentage) -12.22% 0.900 0.790 - 0.00% -
464.h264ref (max) (percentage) -11.11% 0.270 0.240 - 0.00% -
435.gromacs (max) -10.81% 37.000 33.000 - 0.00% -
481.wrf (max) (percentage) -10.77% 0.650 0.580 - 0.00% -
456.hmmer (max) (percentage) -10.71% 0.280 0.250 - 0.00% -
436.cactusADM (max) (percentage) -10.53% 1.520 1.360 - 0.00% -
482.sphinx3 (max) (percentage) -10.16% 1.870 1.680 - 0.00% -
450.soplex (max) -10.00% 10.000 9.000 - 0.00% -
464.h264ref (max) -10.00% 10.000 9.000 - 0.00% -
458.sjeng (max) (percentage) -9.09% 0.330 0.300 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -9.09% 0.330 0.300 - 0.00% -
458.sjeng (unexplained diff vs previous) -9.09% 22.000 20.000 - 0.00% -
434.zeusmp (max) (percentage) -8.57% 0.350 0.320 - 0.00% -
433.milc (max) -7.69% 13.000 12.000 - 0.00% -
437.leslie3d (max) (percentage) -6.58% 1.520 1.420 - 0.00% -
481.wrf (avg) (percentage) -6.56% 0.610 0.570 - 0.00% -
473.astar (max) -6.25% 16.000 15.000 - 0.00% -
473.astar (max) (percentage) -6.06% 0.330 0.310 - 0.00% -
444.namd (max) (percentage) -6.00% 1.000 0.940 - 0.00% -
437.leslie3d (max) -5.77% 260.000 245.000 - 0.00% -
481.wrf -5.26% 19.000 18.000 - 0.00% -
481.wrf (avg) -5.26% 19.000 18.000 - 0.00% -
459.GemsFDTD (max) (percentage) -5.13% 0.390 0.370 - 0.00% -
458.sjeng (max) -4.76% 21.000 20.000 - 0.00% -
434.zeusmp (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
459.GemsFDTD (max) -3.85% 26.000 25.000 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar 8.42% 25848.000 28024.000 - 8.42% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 2.30% 1479.000 1513.000 - 0.20% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -1.59% 17558.000 17278.000 - 0.77% -
471.omnetpp -1.50% 2264.000 2230.000 - -2.32% -
453.povray -1.41% 426.000 420.000 - -1.64% -
429.mcf -1.28% 1489.000 1470.000 - -3.42% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
400.perlbench 1513.000 -
401.bzip2 2669.000 -
403.gcc 55.000 -5.17%
410.bwaves 4591.000 -
416.gamess 11771.000 -
429.mcf 1470.000 -3.42%
433.milc 1169.000 -
434.zeusmp 1902.000 -
435.gromacs 4186.000 -
436.cactusADM 1378.000 -1.22%
437.leslie3d 17278.000 -
444.namd 670.000 -
445.gobmk 2.000 100.00%
447.dealII 1312.000 -
450.soplex 535.000 -
453.povray 420.000 -1.64%
456.hmmer 2899.000 -
458.sjeng 6670.000 -
459.GemsFDTD 6798.000 -
462.libquantum 86.000 -1.15%
464.h264ref 4045.000 -
465.tonto 28671.000 -
470.lbm 3232.000 -
471.omnetpp 2230.000 -2.32%
473.astar 4897.000 -
481.wrf 3245.000 -
482.sphinx3 805.000 -
Geometric Mean 1567.573 1.95%
Code Size (bytes)
Name Current %
400.perlbench 971931.000 -
401.bzip2 48400.000 -
403.gcc 2823264.000 -
410.bwaves 577677.000 -
416.gamess 7336051.000 -
429.mcf 9544.000 -
433.milc 66696.000 -
434.zeusmp 935612.000 -
435.gromacs 509062.000 -
436.cactusADM 996467.000 -
437.leslie3d 812621.000 -
444.namd 154447.000 -
447.dealII 373427.000 -
450.soplex 245975.000 -
453.povray 735268.000 -
456.hmmer 118425.000 -
458.sjeng 109174.000 -
459.GemsFDTD 2245055.000 -
462.libquantum 17857.000 -
464.h264ref 404097.000 -
465.tonto 9298776.000 -
470.lbm 10180.000 -
471.omnetpp 577395.000 -
473.astar 28024.000 8.42%
481.wrf 6507552.000 -
482.sphinx3 125594.000 -
Geometric Mean 332818.566 -
sample variability
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 11.000 10.00%
401.bzip2 (avg) 11.000 10.00%
401.bzip2 (avg) (percentage) 0.430 4.88%
401.bzip2 (max) 12.000 -
401.bzip2 (max) (percentage) 0.450 -
401.bzip2 (unexplained diff vs previous) 12.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.450 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.750 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 1.530 -12.57%
410.bwaves 12.000 33.33%
410.bwaves (avg) 12.000 33.33%
410.bwaves (avg) (percentage) 0.270 28.57%
410.bwaves (max) 16.000 23.08%
410.bwaves (max) (percentage) 0.350 16.67%
410.bwaves (unexplained diff vs previous) 16.000 14.29%
410.bwaves (unexplained diff vs previous) (percentage) 0.350 16.67%
416.gamess 42.000 35.48%
416.gamess (avg) 42.000 35.48%
416.gamess (avg) (percentage) 0.360 33.33%
416.gamess (max) 50.000 61.29%
416.gamess (max) (percentage) 0.430 59.26%
416.gamess (unexplained diff vs previous) 51.000 59.38%
416.gamess (unexplained diff vs previous) (percentage) 0.430 59.26%
429.mcf 34.000 36.00%
429.mcf (avg) 34.000 36.00%
429.mcf (avg) (percentage) 2.380 40.83%
429.mcf (max) 50.000 35.14%
429.mcf (max) (percentage) 3.420 37.35%
429.mcf (unexplained diff vs previous) 52.000 40.54%
429.mcf (unexplained diff vs previous) (percentage) 3.540 45.68%
433.milc 8.000 -27.27%
433.milc (avg) 8.000 -27.27%
433.milc (avg) (percentage) 0.760 -25.49%
433.milc (max) 12.000 -7.69%
433.milc (max) (percentage) 1.040 -12.61%
433.milc (unexplained diff vs previous) 5.000 -64.29%
433.milc (unexplained diff vs previous) (percentage) 0.430 -64.17%
434.zeusmp 4.000 -
434.zeusmp (avg) 4.000 -
434.zeusmp (avg) (percentage) 0.220 -4.35%
434.zeusmp (max) 6.000 -
434.zeusmp (max) (percentage) 0.320 -8.57%
434.zeusmp (unexplained diff vs previous) 4.000 33.33%
434.zeusmp (unexplained diff vs previous) (percentage) 0.210 31.25%
435.gromacs 25.000 -32.43%
435.gromacs (avg) 25.000 -32.43%
435.gromacs (avg) (percentage) 0.610 -32.22%
435.gromacs (max) 33.000 -10.81%
435.gromacs (max) (percentage) 0.790 -12.22%
435.gromacs (unexplained diff vs previous) 17.000 -55.26%
435.gromacs (unexplained diff vs previous) (percentage) 0.410 -54.44%
436.cactusADM 13.000 18.18%
436.cactusADM (avg) 13.000 18.18%
436.cactusADM (avg) (percentage) 0.990 19.28%
436.cactusADM (max) 18.000 -14.29%
436.cactusADM (max) (percentage) 1.360 -10.53%
436.cactusADM (unexplained diff vs previous) 17.000 1600.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.230 1657.14%
437.leslie3d 76.000 1.33%
437.leslie3d (avg) 76.000 1.33%
437.leslie3d (avg) (percentage) 0.440 -
437.leslie3d (max) 245.000 -5.77%
437.leslie3d (max) (percentage) 1.420 -6.58%
444.namd 4.000 33.33%
444.namd (avg) 4.000 33.33%
444.namd (avg) (percentage) 0.650 32.65%
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.940 -6.00%
444.namd (unexplained diff vs previous) 6.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 0.900 200.00%
447.dealII 4.000 33.33%
447.dealII (avg) 4.000 33.33%
447.dealII (avg) (percentage) 0.360 56.52%
447.dealII (max) 6.000 100.00%
447.dealII (max) (percentage) 0.460 100.00%
447.dealII (unexplained diff vs previous) 6.000 100.00%
447.dealII (unexplained diff vs previous) (percentage) 0.460 100.00%
450.soplex 6.000 -40.00%
450.soplex (avg) 6.000 -40.00%
450.soplex (avg) (percentage) 1.280 -36.00%
450.soplex (max) 9.000 -10.00%
450.soplex (max) (percentage) 1.750 -12.50%
450.soplex (unexplained diff vs previous) 4.000 -63.64%
450.soplex (unexplained diff vs previous) (percentage) 0.750 -63.24%
453.povray 8.000 -20.00%
453.povray (avg) 8.000 -20.00%
453.povray (avg) (percentage) 1.970 -17.92%
453.povray (max) 8.000 -20.00%
453.povray (max) (percentage) 2.100 -12.50%
453.povray (unexplained diff vs previous) 7.000 -30.00%
453.povray (unexplained diff vs previous) (percentage) 1.670 -28.63%
456.hmmer 5.000 -37.50%
456.hmmer (avg) 5.000 -37.50%
456.hmmer (avg) (percentage) 0.180 -35.71%
456.hmmer (max) 7.000 -12.50%
456.hmmer (max) (percentage) 0.250 -10.71%
456.hmmer (unexplained diff vs previous) 3.000 -62.50%
456.hmmer (unexplained diff vs previous) (percentage) 0.100 -64.29%
458.sjeng 18.000 5.88%
458.sjeng (avg) 18.000 5.88%
458.sjeng (avg) (percentage) 0.280 7.69%
458.sjeng (max) 20.000 -4.76%
458.sjeng (max) (percentage) 0.300 -9.09%
458.sjeng (unexplained diff vs previous) 20.000 -9.09%
458.sjeng (unexplained diff vs previous) (percentage) 0.300 -9.09%
459.GemsFDTD 14.000 -33.33%
459.GemsFDTD (avg) 14.000 -33.33%
459.GemsFDTD (avg) (percentage) 0.220 -31.25%
459.GemsFDTD (max) 25.000 -3.85%
459.GemsFDTD (max) (percentage) 0.370 -5.13%
459.GemsFDTD (unexplained diff vs previous) 5.000 -70.59%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.070 -72.00%
462.libquantum 1.000 -50.00%
462.libquantum (avg) 1.000 -50.00%
462.libquantum (avg) (percentage) 2.260 -24.92%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.910 -12.61%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 1.160 -66.38%
464.h264ref 8.000 -20.00%
464.h264ref (avg) 8.000 -20.00%
464.h264ref (avg) (percentage) 0.200 -25.93%
464.h264ref (max) 9.000 -10.00%
464.h264ref (max) (percentage) 0.240 -11.11%
464.h264ref (unexplained diff vs previous) 6.000 -45.45%
464.h264ref (unexplained diff vs previous) (percentage) 0.150 -44.44%
465.tonto 17.000 -50.00%
465.tonto (avg) 17.000 -50.00%
465.tonto (avg) (percentage) 0.060 -50.00%
465.tonto (max) 28.000 -17.65%
465.tonto (max) (percentage) 0.100 -16.67%
465.tonto (unexplained diff vs previous) 5.000 -85.29%
465.tonto (unexplained diff vs previous) (percentage) 0.020 -83.33%
470.lbm 12.000 -20.00%
470.lbm (avg) 12.000 -20.00%
470.lbm (avg) (percentage) 0.390 -18.75%
470.lbm (max) 21.000 -25.00%
470.lbm (max) (percentage) 0.670 -24.72%
470.lbm (unexplained diff vs previous) 8.000 -72.41%
470.lbm (unexplained diff vs previous) (percentage) 0.250 -72.22%
471.omnetpp 27.000 145.45%
471.omnetpp (avg) 27.000 145.45%
471.omnetpp (avg) (percentage) 1.240 138.46%
471.omnetpp (max) 51.000 131.82%
471.omnetpp (max) (percentage) 2.320 139.18%
471.omnetpp (unexplained diff vs previous) 53.000 430.00%
471.omnetpp (unexplained diff vs previous) (percentage) 2.380 440.91%
473.astar 9.000 -
473.astar (avg) 9.000 -
473.astar (avg) (percentage) 0.200 5.26%
473.astar (max) 15.000 -6.25%
473.astar (max) (percentage) 0.310 -6.06%
481.wrf 18.000 -5.26%
481.wrf (avg) 18.000 -5.26%
481.wrf (avg) (percentage) 0.570 -6.56%
481.wrf (max) 18.000 -14.29%
481.wrf (max) (percentage) 0.580 -10.77%
481.wrf (unexplained diff vs previous) 17.000 6.25%
481.wrf (unexplained diff vs previous) (percentage) 0.520 6.12%
482.sphinx3 10.000 -16.67%
482.sphinx3 (avg) 10.000 -16.67%
482.sphinx3 (avg) (percentage) 1.260 -14.86%
482.sphinx3 (max) 13.000 -13.33%
482.sphinx3 (max) (percentage) 1.680 -10.16%
482.sphinx3 (unexplained diff vs previous) 8.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.990 1.02%
Geometric Mean 2.294 -30.01%