Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/37f302348717d1cceb2708b50eb08d98789a3469 (+ 186 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/142/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0142 (llvmorg-19-init-12984-g37f302348717) 2024-05-30T12:26:25 0:00:00
Previous 0140 (no-change) 2024-05-29T07:23:37 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 44 10
Performance Improvements 86 16
Added Tests 7 157
Unchanged Tests 1003 957
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.72% 6256.000 6551.000 - 0.00% -
447.dealII 1.84% 979.000 997.000 - -0.40% -
434.zeusmp 1.05% 1903.000 1923.000 - 0.00% -
435.gromacs 1.04% 4507.000 4554.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 800.00% 1.000 9.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 700.00% 0.040 0.320 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 347.62% 0.840 3.760 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 333.33% 6.000 26.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 300.00% 6.000 24.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 300.00% 0.130 0.520 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 110.53% 19.000 40.000 0.000 0.00% 0.000
458.sjeng (max) (percentage) 110.00% 0.300 0.630 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 110.00% 0.300 0.630 0.000 0.00% 0.000
458.sjeng (max) 105.26% 19.000 39.000 - 0.00% -
447.dealII (unexplained diff vs previous) 63.64% 11.000 18.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) 61.61% 1.120 1.810 0.000 0.00% 0.000
447.dealII (max) 38.46% 13.000 18.000 - 0.00% -
447.dealII (max) (percentage) 34.31% 1.370 1.840 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 29.29% 5.190 6.710 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 28.57% 7.000 9.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 26.92% 0.260 0.330 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 22.22% 9.000 11.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 22.22% 0.270 0.330 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 21.01% 119.000 144.000 0.000 0.00% 0.000
482.sphinx3 (max) (percentage) 17.15% 3.090 3.620 - 0.00% -
456.hmmer 16.67% 6.000 7.000 - 0.00% -
456.hmmer (avg) 16.67% 6.000 7.000 - 0.00% -
456.hmmer (max) 14.29% 7.000 8.000 - 0.00% -
456.hmmer (max) (percentage) 14.29% 0.280 0.320 - 0.00% -
482.sphinx3 (max) 13.64% 22.000 25.000 - 0.00% -
447.dealII 9.09% 11.000 12.000 - 0.00% -
447.dealII (avg) 9.09% 11.000 12.000 - 0.00% -
471.omnetpp (avg) (percentage) 8.04% 2.860 3.090 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 5.33% 1.690 1.780 0.000 0.00% 0.000
447.dealII (avg) (percentage) 5.17% 1.160 1.220 - 0.00% -
437.leslie3d 4.69% 256.000 268.000 - 0.00% -
437.leslie3d (avg) 4.69% 256.000 268.000 - 0.00% -
456.hmmer (avg) (percentage) 4.00% 0.250 0.260 - 0.00% -
482.sphinx3 (avg) (percentage) 3.73% 2.410 2.500 - 0.00% -
473.astar (unexplained diff vs previous) 3.57% 84.000 87.000 0.000 0.00% 0.000
473.astar (max) (percentage) 1.74% 1.720 1.750 - 0.00% -
471.omnetpp (max) (percentage) 1.62% 6.190 6.290 - 0.00% -
471.omnetpp 1.54% 65.000 66.000 - 0.00% -
471.omnetpp (avg) 1.54% 65.000 66.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -6.29% 2291.000 2147.000 - -0.28% -
482.sphinx3 -3.62% 718.000 692.000 - 4.22% -
403.gcc -3.45% 58.000 56.000 - -5.08% -
473.astar -1.75% 4963.000 4876.000 - 5.13% -
400.perlbench -1.37% 1532.000 1511.000 - 2.51% -
459.GemsFDTD -1.35% 5251.000 5180.000 - 0.00% -
444.namd -1.31% 686.000 677.000 - 0.74% -
481.wrf -1.19% 3198.000 3160.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) -88.89% 9.000 1.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -88.41% 0.690 0.080 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -56.54% 2.370 1.030 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -56.07% 107.000 47.000 0.000 0.00% 0.000
403.gcc (unexplained diff vs previous) -50.00% 4.000 2.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -50.00% 6.000 3.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) -49.32% 2.190 1.110 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -49.31% 1.440 0.730 0.000 0.00% 0.000
403.gcc (unexplained diff vs previous) (percentage) -48.26% 6.900 3.570 0.000 0.00% 0.000
435.gromacs (max) (percentage) -46.50% 4.280 2.290 - 0.00% -
435.gromacs (max) -45.83% 192.000 104.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -35.48% 31.000 20.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -35.29% 0.680 0.440 0.000 0.00% 0.000
436.cactusADM (max) (percentage) -30.49% 0.820 0.570 - 0.00% -
436.cactusADM (max) -30.00% 10.000 7.000 - 0.00% -
403.gcc (max) -25.00% 4.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -25.00% 8.000 6.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -24.32% 0.740 0.560 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -18.18% 11.000 9.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -16.88% 1.600 1.330 0.000 0.00% 0.000
403.gcc (max) (percentage) -16.73% 7.410 6.170 - 0.00% -
453.povray (max) -16.67% 6.000 5.000 - 0.00% -
410.bwaves (max) -12.90% 31.000 27.000 - 0.00% -
433.milc (max) -12.50% 8.000 7.000 - 0.00% -
410.bwaves (max) (percentage) -10.14% 0.690 0.620 - 0.00% -
433.milc -10.00% 10.000 9.000 - 0.00% -
433.milc (avg) -10.00% 10.000 9.000 - 0.00% -
401.bzip2 (max) -9.09% 22.000 20.000 - 0.00% -
429.mcf (max) -9.09% 22.000 20.000 - 0.00% -
444.namd (max) -9.09% 11.000 10.000 - 0.00% -
433.milc (max) (percentage) -8.64% 0.810 0.740 - 0.00% -
444.namd (max) (percentage) -8.59% 1.630 1.490 - 0.00% -
450.soplex (max) (percentage) -8.44% 2.250 2.060 - 0.00% -
450.soplex (max) -8.33% 12.000 11.000 - 0.00% -
434.zeusmp (max) (percentage) -7.69% 0.780 0.720 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
401.bzip2 (max) (percentage) -7.32% 0.820 0.760 - 0.00% -
434.zeusmp (max) -7.14% 14.000 13.000 - 0.00% -
450.soplex (avg) (percentage) -6.80% 2.500 2.330 - 0.00% -
429.mcf (max) (percentage) -6.49% 1.540 1.440 - 0.00% -
459.GemsFDTD (max) -6.25% 64.000 60.000 - 0.00% -
435.gromacs (avg) (percentage) -6.05% 2.150 2.020 - 0.00% -
436.cactusADM (avg) (percentage) -5.95% 0.840 0.790 - 0.00% -
459.GemsFDTD (max) (percentage) -5.69% 1.230 1.160 - 0.00% -
401.bzip2 -5.56% 54.000 51.000 - 0.00% -
401.bzip2 (avg) -5.56% 54.000 51.000 - 0.00% -
464.h264ref (max) -5.56% 54.000 51.000 - 0.00% -
453.povray (max) (percentage) -5.48% 1.460 1.380 - 0.00% -
437.leslie3d (max) (percentage) -5.21% 7.290 6.910 - 0.00% -
435.gromacs -5.21% 96.000 91.000 - 0.00% -
435.gromacs (avg) -5.21% 96.000 91.000 - 0.00% -
401.bzip2 (avg) (percentage) -5.00% 2.000 1.900 - 0.00% -
445.gobmk (max) (percentage) -5.00% 0.800 0.760 - 0.00% -
462.libquantum (avg) (percentage) -4.94% 1.620 1.540 - 0.00% -
464.h264ref (max) (percentage) -4.93% 1.420 1.350 - 0.00% -
471.omnetpp (max) -4.26% 141.000 135.000 - 0.00% -
429.mcf -4.08% 49.000 47.000 - 0.00% -
429.mcf (avg) -4.08% 49.000 47.000 - 0.00% -
445.gobmk (avg) (percentage) -3.85% 1.040 1.000 - 0.00% -
429.mcf (avg) (percentage) -3.79% 3.430 3.300 - 0.00% -
410.bwaves -3.03% 33.000 32.000 - 0.00% -
410.bwaves (avg) -3.03% 33.000 32.000 - 0.00% -
481.wrf -3.03% 33.000 32.000 - 0.00% -
481.wrf (avg) -3.03% 33.000 32.000 - 0.00% -
470.lbm -2.94% 34.000 33.000 - 0.00% -
470.lbm (avg) -2.94% 34.000 33.000 - 0.00% -
453.povray (avg) (percentage) -2.83% 1.060 1.030 - 0.00% -
445.gobmk (max) -2.78% 36.000 35.000 - 0.00% -
410.bwaves (avg) (percentage) -2.67% 0.750 0.730 - 0.00% -
473.astar -2.17% 92.000 90.000 - 0.00% -
473.astar (avg) -2.17% 92.000 90.000 - 0.00% -
445.gobmk -2.13% 47.000 46.000 - 0.00% -
445.gobmk (avg) -2.13% 47.000 46.000 - 0.00% -
433.milc (avg) (percentage) -2.11% 0.950 0.930 - 0.00% -
481.wrf (max) -2.08% 48.000 47.000 - 0.00% -
470.lbm (avg) (percentage) -1.94% 1.030 1.010 - 0.00% -
403.gcc (avg) (percentage) -1.52% 3.940 3.880 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
462.libquantum (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.73% 128200.000 130424.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.05% 2510.000 2712.000 - -0.33% -
456.hmmer 5.92% 2637.000 2793.000 - 0.32% -
473.astar 5.13% 4638.000 4876.000 - -1.75% -
482.sphinx3 4.22% 664.000 692.000 - -3.62% -
470.lbm 2.60% 3235.000 3319.000 - -0.33% -
400.perlbench 2.51% 1474.000 1511.000 - -1.37% -
433.milc 1.52% 1054.000 1070.000 - -0.56% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.02% 45013.000 38251.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.12% 168697.000 165116.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
471.omnetpp -1.64% 754667.000 742320.000 - 0.00% -
450.soplex -1.42% 319083.000 314543.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.03% 1269683.000 1256624.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -25.93% 108.000 80.000 - 0.00% -
429.mcf -22.67% 1879.000 1453.000 - -0.07% -
403.gcc -5.08% 59.000 56.000 - -3.45% -
464.h264ref -3.93% 3965.000 3809.000 - -0.52% -
453.povray -1.90% 421.000 413.000 - -0.72% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1511.000 -1.37%
401.bzip2 2712.000 -
403.gcc 56.000 -3.45%
410.bwaves 4512.000 -
416.gamess 15210.000 -
429.mcf 1453.000 -
433.milc 1070.000 -
434.zeusmp 1923.000 1.05%
435.gromacs 4554.000 1.04%
436.cactusADM 1296.000 -
437.leslie3d 6551.000 4.72%
444.namd 677.000 -1.31%
445.gobmk 4611.000 -
447.dealII 997.000 1.84%
450.soplex 541.000 -
453.povray 413.000 -
456.hmmer 2793.000 -
458.sjeng 6349.000 -
459.GemsFDTD 5180.000 -1.35%
462.libquantum 80.000 -
464.h264ref 3809.000 -
465.tonto 20124.000 -
470.lbm 3319.000 -
471.omnetpp 2147.000 -6.29%
473.astar 4876.000 -1.75%
481.wrf 3160.000 -1.19%
482.sphinx3 692.000 -3.62%
Geometric Mean 1933.917 -
Name Current %
400.perlbench 1256624.000 -
401.bzip2 68318.000 -
403.gcc 3788143.000 -
410.bwaves 632124.000 -
416.gamess 8288905.000 -
429.mcf 11448.000 -
433.milc 130424.000 -
434.zeusmp 1011947.000 -
435.gromacs 701836.000 -
436.cactusADM 1141414.000 -
437.leslie3d 944605.000 -
444.namd 165116.000 -
445.gobmk 2238948.000 -
447.dealII 556182.000 -
450.soplex 314543.000 -
453.povray 1125697.000 -
456.hmmer 163763.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1244166.000 -
462.libquantum 38251.000 -
464.h264ref 768477.000 -
465.tonto 9844698.000 -
470.lbm 10777.000 -
471.omnetpp 742320.000 -
473.astar 32444.000 -
481.wrf 6124978.000 -
482.sphinx3 175838.000 -
Geometric Mean 443969.444 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 51.000 -5.56%
401.bzip2 (avg) 51.000 -5.56%
401.bzip2 (avg) (percentage) 1.900 -5.00%
401.bzip2 (max) 20.000 -9.09%
401.bzip2 (max) (percentage) 0.760 -7.32%
401.bzip2 (unexplained diff vs previous) 9.000 28.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.330 26.92%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.880 -1.52%
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 6.170 -16.73%
403.gcc (unexplained diff vs previous) 2.000 -50.00%
403.gcc (unexplained diff vs previous) (percentage) 3.570 -48.26%
410.bwaves 32.000 -3.03%
410.bwaves (avg) 32.000 -3.03%
410.bwaves (avg) (percentage) 0.730 -2.67%
410.bwaves (max) 27.000 -12.90%
410.bwaves (max) (percentage) 0.620 -10.14%
410.bwaves (unexplained diff vs previous) 20.000 -35.48%
410.bwaves (unexplained diff vs previous) (percentage) 0.440 -35.29%
416.gamess 16.000 -
416.gamess (avg) 16.000 -
416.gamess (avg) (percentage) 0.110 -
416.gamess (max) 25.000 -
416.gamess (max) (percentage) 0.170 -
429.mcf 47.000 -4.08%
429.mcf (avg) 47.000 -4.08%
429.mcf (avg) (percentage) 3.300 -3.79%
429.mcf (max) 20.000 -9.09%
429.mcf (max) (percentage) 1.440 -6.49%
429.mcf (unexplained diff vs previous) 1.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.070 -
433.milc 9.000 -10.00%
433.milc (avg) 9.000 -10.00%
433.milc (avg) (percentage) 0.930 -2.11%
433.milc (max) 7.000 -12.50%
433.milc (max) (percentage) 0.740 -8.64%
433.milc (unexplained diff vs previous) 6.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.560 -24.32%
434.zeusmp 10.000 -
434.zeusmp (avg) 10.000 -
434.zeusmp (avg) (percentage) 0.540 -
434.zeusmp (max) 13.000 -7.14%
434.zeusmp (max) (percentage) 0.720 -7.69%
435.gromacs 91.000 -5.21%
435.gromacs (avg) 91.000 -5.21%
435.gromacs (avg) (percentage) 2.020 -6.05%
435.gromacs (max) 104.000 -45.83%
435.gromacs (max) (percentage) 2.290 -46.50%
435.gromacs (unexplained diff vs previous) 47.000 -56.07%
435.gromacs (unexplained diff vs previous) (percentage) 1.030 -56.54%
436.cactusADM 10.000 -
436.cactusADM (avg) 10.000 -
436.cactusADM (avg) (percentage) 0.790 -5.95%
436.cactusADM (max) 7.000 -30.00%
436.cactusADM (max) (percentage) 0.570 -30.49%
436.cactusADM (unexplained diff vs previous) 1.000 -88.89%
436.cactusADM (unexplained diff vs previous) (percentage) 0.080 -88.41%
437.leslie3d 268.000 4.69%
437.leslie3d (avg) 268.000 4.69%
437.leslie3d (avg) (percentage) 4.100 -
437.leslie3d (max) 452.000 -
437.leslie3d (max) (percentage) 6.910 -5.21%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 10.000 -9.09%
444.namd (max) (percentage) 1.490 -8.59%
444.namd (unexplained diff vs previous) 9.000 -18.18%
444.namd (unexplained diff vs previous) (percentage) 1.330 -16.88%
445.gobmk 46.000 -2.13%
445.gobmk (avg) 46.000 -2.13%
445.gobmk (avg) (percentage) 1.000 -3.85%
445.gobmk (max) 35.000 -2.78%
445.gobmk (max) (percentage) 0.760 -5.00%
445.gobmk (unexplained diff vs previous) 24.000 300.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.520 300.00%
447.dealII 12.000 9.09%
447.dealII (avg) 12.000 9.09%
447.dealII (avg) (percentage) 1.220 5.17%
447.dealII (max) 18.000 38.46%
447.dealII (max) (percentage) 1.840 34.31%
447.dealII (unexplained diff vs previous) 18.000 63.64%
447.dealII (unexplained diff vs previous) (percentage) 1.810 61.61%
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.330 -6.80%
450.soplex (max) 11.000 -8.33%
450.soplex (max) (percentage) 2.060 -8.44%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.030 -2.83%
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.380 -5.48%
453.povray (unexplained diff vs previous) 3.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.730 -49.31%
456.hmmer 7.000 16.67%
456.hmmer (avg) 7.000 16.67%
456.hmmer (avg) (percentage) 0.260 4.00%
456.hmmer (max) 8.000 14.29%
456.hmmer (max) (percentage) 0.320 14.29%
456.hmmer (unexplained diff vs previous) 9.000 800.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.320 700.00%
458.sjeng 33.000 -
458.sjeng (avg) 33.000 -
458.sjeng (avg) (percentage) 0.520 -
458.sjeng (max) 39.000 105.26%
458.sjeng (max) (percentage) 0.630 110.00%
458.sjeng (unexplained diff vs previous) 40.000 110.53%
458.sjeng (unexplained diff vs previous) (percentage) 0.630 110.00%
459.GemsFDTD 34.000 -
459.GemsFDTD (avg) 34.000 -
459.GemsFDTD (avg) (percentage) 0.660 -
459.GemsFDTD (max) 60.000 -6.25%
459.GemsFDTD (max) (percentage) 1.160 -5.69%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.540 -4.94%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.110 -49.32%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 40.000 -
464.h264ref (avg) 40.000 -
464.h264ref (avg) (percentage) 1.060 -
464.h264ref (max) 51.000 -5.56%
464.h264ref (max) (percentage) 1.350 -4.93%
470.lbm 33.000 -2.94%
470.lbm (avg) 33.000 -2.94%
470.lbm (avg) (percentage) 1.010 -1.94%
470.lbm (max) 11.000 -
470.lbm (max) (percentage) 0.360 -
470.lbm (unexplained diff vs previous) 11.000 22.22%
470.lbm (unexplained diff vs previous) (percentage) 0.330 22.22%
471.omnetpp 66.000 1.54%
471.omnetpp (avg) 66.000 1.54%
471.omnetpp (avg) (percentage) 3.090 8.04%
471.omnetpp (max) 135.000 -4.26%
471.omnetpp (max) (percentage) 6.290 1.62%
471.omnetpp (unexplained diff vs previous) 144.000 21.01%
471.omnetpp (unexplained diff vs previous) (percentage) 6.710 29.29%
473.astar 90.000 -2.17%
473.astar (avg) 90.000 -2.17%
473.astar (avg) (percentage) 1.850 -
473.astar (max) 85.000 -
473.astar (max) (percentage) 1.750 1.74%
473.astar (unexplained diff vs previous) 87.000 3.57%
473.astar (unexplained diff vs previous) (percentage) 1.780 5.33%
481.wrf 32.000 -3.03%
481.wrf (avg) 32.000 -3.03%
481.wrf (avg) (percentage) 1.040 -
481.wrf (max) 47.000 -2.08%
481.wrf (max) (percentage) 1.510 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.500 3.73%
482.sphinx3 (max) 25.000 13.64%
482.sphinx3 (max) (percentage) 3.620 17.15%
482.sphinx3 (unexplained diff vs previous) 26.000 333.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.760 347.62%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 7.100 -
Geometric Mean 3.521 -30.08%