Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e21ab4d16b555c28ded307571d138f594f33e325 (+ 1 commits)
regression LLVM-1480
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/280/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0280 (llvmorg-20-init-14867-ge21ab4d16b55) 2024-12-09T14:03:52 0:00:00
Previous 0279 (llvmorg-20-init-14866-g322eb1a92e6d) 2024-12-08T19:06:55 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 36 7
Performance Improvements 80 21
Added Tests 18 174
Unchanged Tests 1030 962
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 6.56% 4117.000 4387.000 - 0.00% -
462.libquantum 3.80% 79.000 82.000 - -24.07% -
481.wrf 3.55% 2814.000 2914.000 - 0.00% -
450.soplex 2.29% 525.000 537.000 - -0.56% -
464.h264ref 1.78% 3755.000 3822.000 - -3.61% -
410.bwaves 1.56% 3858.000 3918.000 - 0.00% -
433.milc 1.27% 1023.000 1036.000 - -1.71% -
437.leslie3d 1.22% 6391.000 6469.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 1100.00% 1.000 12.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 1025.00% 0.040 0.450 - 0.00% -
464.h264ref (unexplained diff vs previous) 346.67% 15.000 67.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 337.50% 0.400 1.750 - 0.00% -
464.h264ref (max) 183.33% 24.000 68.000 - 0.00% -
464.h264ref (max) (percentage) 178.13% 0.640 1.780 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 166.67% 0.510 1.360 - 0.00% -
471.omnetpp (unexplained diff vs previous) 163.64% 11.000 29.000 - 0.00% -
462.libquantum 100.00% 1.000 2.000 - 0.00% -
462.libquantum (avg) 100.00% 1.000 2.000 - 0.00% -
462.libquantum (max) 50.00% 2.000 3.000 - 0.00% -
462.libquantum (max) (percentage) 40.74% 2.700 3.800 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 40.00% 10.000 14.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 36.84% 0.190 0.260 - 0.00% -
456.hmmer (max) 20.00% 5.000 6.000 - 0.00% -
456.hmmer (max) (percentage) 19.05% 0.210 0.250 - 0.00% -
456.hmmer (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 13.64% 0.220 0.250 - 0.00% -
435.gromacs 7.52% 133.000 143.000 - 0.00% -
435.gromacs (avg) 7.52% 133.000 143.000 - 0.00% -
450.soplex 5.56% 18.000 19.000 - 0.00% -
450.soplex (avg) 5.56% 18.000 19.000 - 0.00% -
481.wrf 2.56% 78.000 80.000 - 0.00% -
481.wrf (avg) 2.56% 78.000 80.000 - 0.00% -
464.h264ref 2.50% 40.000 41.000 - 0.00% -
464.h264ref (avg) 2.50% 40.000 41.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -18.42% 38.000 31.000 - 6.90% -
nb_execution_successful -4.00% 25.000 24.000 - 26.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.35% 2154.000 2125.000 - -1.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -82.02% 6.730 1.210 - 0.00% -
437.leslie3d (unexplained diff vs previous) -81.86% 430.000 78.000 - 0.00% -
470.lbm (unexplained diff vs previous) -75.56% 45.000 11.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -75.36% 1.380 0.340 - 0.00% -
453.povray (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -74.61% 1.930 0.490 - 0.00% -
473.astar (max) -71.05% 76.000 22.000 - 0.00% -
473.astar (max) (percentage) -70.70% 1.570 0.460 - 0.00% -
434.zeusmp (unexplained diff vs previous) -60.00% 15.000 6.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -59.76% 0.820 0.330 - 0.00% -
444.namd (max) (percentage) -43.93% 2.140 1.200 - 0.00% -
444.namd (max) -42.86% 14.000 8.000 - 0.00% -
436.cactusADM (max) -36.36% 11.000 7.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -36.22% 1.960 1.250 - 0.00% -
433.milc (unexplained diff vs previous) -35.00% 20.000 13.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -34.99% 3.430 2.230 - 0.00% -
436.cactusADM (max) (percentage) -33.72% 0.860 0.570 - 0.00% -
450.soplex (unexplained diff vs previous) -33.33% 18.000 12.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -22.22% 9.000 7.000 - 0.00% -
434.zeusmp (max) (percentage) -21.74% 0.920 0.720 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -21.74% 0.690 0.540 - 0.00% -
434.zeusmp (max) -18.75% 16.000 13.000 - 0.00% -
458.sjeng (max) -18.42% 38.000 31.000 - 0.00% -
437.leslie3d (max) (percentage) -16.67% 6.300 5.250 - 0.00% -
458.sjeng (max) (percentage) -16.67% 0.600 0.500 - 0.00% -
437.leslie3d (max) -15.67% 402.000 339.000 - 0.00% -
453.povray (max) -14.29% 7.000 6.000 - 0.00% -
453.povray (max) (percentage) -12.63% 1.900 1.660 - 0.00% -
433.milc (max) (percentage) -12.50% 1.920 1.680 - 0.00% -
433.milc (max) -10.53% 19.000 17.000 - 0.00% -
470.lbm (max) (percentage) -10.29% 1.360 1.220 - 0.00% -
435.gromacs (max) (percentage) -10.05% 6.470 5.820 - 0.00% -
470.lbm (max) -9.09% 44.000 40.000 - 0.00% -
429.mcf (max) (percentage) -8.77% 0.570 0.520 - 0.00% -
416.gamess (max) -8.00% 25.000 23.000 - 0.00% -
447.dealII (max) -6.67% 15.000 14.000 - 0.00% -
450.soplex (max) (percentage) -6.34% 3.310 3.100 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -6.13% 1.630 1.530 - 0.00% -
450.soplex (max) -5.88% 17.000 16.000 - 0.00% -
401.bzip2 (max) (percentage) -5.80% 0.690 0.650 - 0.00% -
401.bzip2 (max) -5.56% 18.000 17.000 - 0.00% -
471.omnetpp (max) -5.45% 55.000 52.000 - 0.00% -
447.dealII (max) (percentage) -4.94% 1.620 1.540 - 0.00% -
459.GemsFDTD (max) (percentage) -4.84% 0.620 0.590 - 0.00% -
410.bwaves (unexplained diff vs previous) -4.76% 63.000 60.000 - 0.00% -
471.omnetpp (max) (percentage) -4.63% 2.590 2.470 - 0.00% -
435.gromacs (max) -4.14% 266.000 255.000 - 0.00% -
481.wrf (max) (percentage) -3.94% 4.320 4.150 - 0.00% -
456.hmmer (avg) (percentage) -3.57% 0.280 0.270 - 0.00% -
416.gamess -3.23% 31.000 30.000 - 0.00% -
416.gamess (avg) -3.23% 31.000 30.000 - 0.00% -
459.GemsFDTD (max) -3.12% 32.000 31.000 - 0.00% -
410.bwaves (max) (percentage) -3.11% 1.610 1.560 - 0.00% -
458.sjeng (avg) (percentage) -2.70% 0.740 0.720 - 0.00% -
401.bzip2 -2.63% 38.000 37.000 - 0.00% -
401.bzip2 (avg) -2.63% 38.000 37.000 - 0.00% -
482.sphinx3 (max) (percentage) -2.22% 1.350 1.320 - 0.00% -
453.povray (avg) (percentage) -2.21% 1.360 1.330 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.17% 1.840 1.800 - 0.00% -
458.sjeng -2.17% 46.000 45.000 - 0.00% -
458.sjeng (avg) -2.17% 46.000 45.000 - 0.00% -
445.gobmk (max) (percentage) -2.08% 0.480 0.470 - 0.00% -
459.GemsFDTD -2.06% 97.000 95.000 - 0.00% -
459.GemsFDTD (avg) -2.06% 97.000 95.000 - 0.00% -
447.dealII (avg) (percentage) -1.97% 1.520 1.490 - 0.00% -
444.namd (avg) (percentage) -1.92% 1.040 1.020 - 0.00% -
429.mcf -1.83% 109.000 107.000 - 0.00% -
429.mcf (avg) -1.83% 109.000 107.000 - 0.00% -
471.omnetpp -1.67% 60.000 59.000 - 0.00% -
471.omnetpp (avg) -1.67% 60.000 59.000 - 0.00% -
429.mcf (avg) (percentage) -1.65% 7.890 7.760 - 0.00% -
410.bwaves (max) -1.61% 62.000 61.000 - 0.00% -
437.leslie3d (avg) (percentage) -1.53% 4.580 4.510 - 0.00% -
403.gcc (max) (percentage) -1.44% 4.850 4.780 - 0.00% -
401.bzip2 (avg) (percentage) -1.41% 1.420 1.400 - 0.00% -
473.astar (avg) (percentage) -1.33% 2.250 2.220 - 0.00% -
481.wrf (avg) (percentage) -1.08% 2.780 2.750 - 0.00% -
471.omnetpp (avg) (percentage) -1.06% 2.830 2.800 - 0.00% -
436.cactusADM (avg) (percentage) -1.05% 0.950 0.940 - 0.00% -

Added Tests - sample variability
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (max)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 4.36% 66682.000 69590.000 - 0.00% -
433.milc 2.41% 128200.000 131284.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.69% 2510.000 2678.000 - -0.45% -
456.hmmer 5.88% 2637.000 2792.000 - 0.25% -
473.astar 5.61% 4638.000 4898.000 - 0.89% -
400.perlbench 2.04% 1474.000 1504.000 - -0.53% -
470.lbm 1.39% 3235.000 3280.000 - 0.34% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.24% 45013.000 38155.000 - 0.00% -
444.namd -2.95% 168697.000 163728.000 - 0.00% -
458.sjeng -2.58% 131729.000 128329.000 - 0.04% -
464.h264ref -2.29% 774195.000 756503.000 - 0.00% -
471.omnetpp -1.49% 754667.000 743448.000 - 0.00% -
400.perlbench -1.29% 1269683.000 1253328.000 - 0.00% -
450.soplex -1.24% 319083.000 315111.000 - 0.00% -
456.hmmer -1.22% 165371.000 163351.000 - 0.00% -
470.lbm -1.03% 10901.000 10789.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.96% 4617.000 2.000 - 0.00% -
482.sphinx3 -99.55% 664.000 3.000 - 0.00% -
429.mcf -26.40% 1879.000 1383.000 - -0.14% -
462.libquantum -24.07% 108.000 82.000 - 3.80% -
464.h264ref -3.61% 3965.000 3822.000 - 1.78% -
447.dealII -3.00% 1001.000 971.000 - -0.31% -
453.povray -2.14% 421.000 412.000 - -0.48% -
433.milc -1.71% 1054.000 1036.000 - 1.27% -
471.omnetpp -1.30% 2153.000 2125.000 - -1.35% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 26.32% 19.000 24.000 - -4.00% -
nb_total_tests 6.90% 29.000 31.000 - -18.42% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1504.000 -
401.bzip2 2678.000 -
410.bwaves 3918.000 1.56%
416.gamess 11915.000 -
429.mcf 1383.000 -
433.milc 1036.000 1.27%
434.zeusmp 1827.000 -
435.gromacs 4387.000 6.56%
436.cactusADM 1307.000 -
437.leslie3d 6469.000 1.22%
444.namd 668.000 -
445.gobmk 2.000 -
447.dealII 971.000 -
450.soplex 537.000 2.29%
453.povray 412.000 -
456.hmmer 2792.000 -
458.sjeng 6310.000 -
459.GemsFDTD 5305.000 -
462.libquantum 82.000 3.80%
464.h264ref 3822.000 1.78%
465.tonto 12102.000 -
470.lbm 3280.000 -
471.omnetpp 2125.000 -1.35%
473.astar 4898.000 -
481.wrf 2914.000 3.55%
482.sphinx3 3.000 -
Geometric Mean 1275.061 -
Name Current %
400.perlbench 1253328.000 -
401.bzip2 69590.000 -
410.bwaves 570378.000 -
416.gamess 8178493.000 -
429.mcf 11496.000 -
433.milc 131284.000 -
434.zeusmp 921210.000 -
435.gromacs 699964.000 -
436.cactusADM 1084256.000 -
437.leslie3d 840084.000 -
444.namd 163728.000 -
447.dealII 547762.000 -
450.soplex 315111.000 -
453.povray 1126849.000 -
456.hmmer 163351.000 -
458.sjeng 128329.000 -
459.GemsFDTD 1151545.000 -
462.libquantum 38155.000 -
464.h264ref 756503.000 -
465.tonto 9338240.000 -
470.lbm 10789.000 -
471.omnetpp 743448.000 -
473.astar 32792.000 -
481.wrf 4370635.000 -
Geometric Mean 380701.793 -
Name Current %
nb_compile_successful 27.000 -
nb_execution_successful 24.000 -4.00%
nb_total_tests 31.000 -18.42%
Geometric Mean 27.184 -7.82%
Name Current %
400.perlbench 19.000 -
400.perlbench (avg) 19.000 -
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 14.000 -
400.perlbench (max) (percentage) 0.950 -
401.bzip2 37.000 -2.63%
401.bzip2 (avg) 37.000 -2.63%
401.bzip2 (avg) (percentage) 1.400 -1.41%
401.bzip2 (max) 17.000 -5.56%
401.bzip2 (max) (percentage) 0.650 -5.80%
401.bzip2 (unexplained diff vs previous) 12.000 1100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.450 1025.00%
403.gcc (avg) (percentage) 3.890 -
403.gcc (max) (percentage) 4.780 -1.44%
410.bwaves 48.000 -
410.bwaves (avg) 48.000 -
410.bwaves (avg) (percentage) 1.250 -
410.bwaves (max) 61.000 -1.61%
410.bwaves (max) (percentage) 1.560 -3.11%
410.bwaves (unexplained diff vs previous) 60.000 -4.76%
410.bwaves (unexplained diff vs previous) (percentage) 1.530 -6.13%
416.gamess 30.000 -3.23%
416.gamess (avg) 30.000 -3.23%
416.gamess (avg) (percentage) 0.260 -
416.gamess (max) 23.000 -8.00%
416.gamess (max) (percentage) 0.200 -
429.mcf 107.000 -1.83%
429.mcf (avg) 107.000 -1.83%
429.mcf (avg) (percentage) 7.760 -1.65%
429.mcf (max) 7.000 -
429.mcf (max) (percentage) 0.520 -8.77%
429.mcf (unexplained diff vs previous) 2.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.140 -
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.420 -
433.milc (max) 17.000 -10.53%
433.milc (max) (percentage) 1.680 -12.50%
433.milc (unexplained diff vs previous) 13.000 -35.00%
433.milc (unexplained diff vs previous) (percentage) 1.250 -36.22%
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.060 -
434.zeusmp (max) 13.000 -18.75%
434.zeusmp (max) (percentage) 0.720 -21.74%
434.zeusmp (unexplained diff vs previous) 6.000 -60.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.330 -59.76%
435.gromacs 143.000 7.52%
435.gromacs (avg) 143.000 7.52%
435.gromacs (avg) (percentage) 3.260 -
435.gromacs (max) 255.000 -4.14%
435.gromacs (max) (percentage) 5.820 -10.05%
435.gromacs (unexplained diff vs previous) 0.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.000 -
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.940 -1.05%
436.cactusADM (max) 7.000 -36.36%
436.cactusADM (max) (percentage) 0.570 -33.72%
436.cactusADM (unexplained diff vs previous) 7.000 -22.22%
436.cactusADM (unexplained diff vs previous) (percentage) 0.540 -21.74%
437.leslie3d 291.000 -
437.leslie3d (avg) 291.000 -
437.leslie3d (avg) (percentage) 4.510 -1.53%
437.leslie3d (max) 339.000 -15.67%
437.leslie3d (max) (percentage) 5.250 -16.67%
437.leslie3d (unexplained diff vs previous) 78.000 -81.86%
437.leslie3d (unexplained diff vs previous) (percentage) 1.210 -82.02%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.020 -1.92%
444.namd (max) 8.000 -42.86%
444.namd (max) (percentage) 1.200 -43.93%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 1.140 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 0.470 -2.08%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.490 -1.97%
447.dealII (max) 14.000 -6.67%
447.dealII (max) (percentage) 1.540 -4.94%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 19.000 5.56%
450.soplex (avg) 19.000 5.56%
450.soplex (avg) (percentage) 3.540 -
450.soplex (max) 16.000 -5.88%
450.soplex (max) (percentage) 3.100 -6.34%
450.soplex (unexplained diff vs previous) 12.000 -33.33%
450.soplex (unexplained diff vs previous) (percentage) 2.230 -34.99%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.330 -2.21%
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.660 -12.63%
453.povray (unexplained diff vs previous) 2.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.490 -74.61%
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.270 -3.57%
456.hmmer (max) 6.000 20.00%
456.hmmer (max) (percentage) 0.250 19.05%
456.hmmer (unexplained diff vs previous) 7.000 16.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.250 13.64%
458.sjeng 45.000 -2.17%
458.sjeng (avg) 45.000 -2.17%
458.sjeng (avg) (percentage) 0.720 -2.70%
458.sjeng (max) 31.000 -18.42%
458.sjeng (max) (percentage) 0.500 -16.67%
458.sjeng (unexplained diff vs previous) 0.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.000 -
459.GemsFDTD 95.000 -2.06%
459.GemsFDTD (avg) 95.000 -2.06%
459.GemsFDTD (avg) (percentage) 1.800 -2.17%
459.GemsFDTD (max) 31.000 -3.12%
459.GemsFDTD (max) (percentage) 0.590 -4.84%
459.GemsFDTD (unexplained diff vs previous) 14.000 40.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 36.84%
462.libquantum 2.000 100.00%
462.libquantum (avg) 2.000 100.00%
462.libquantum (avg) (percentage) 2.460 -
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 3.800 40.74%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.660 -
464.h264ref 41.000 2.50%
464.h264ref (avg) 41.000 2.50%
464.h264ref (avg) (percentage) 1.090 -
464.h264ref (max) 68.000 183.33%
464.h264ref (max) (percentage) 1.780 178.13%
464.h264ref (unexplained diff vs previous) 67.000 346.67%
464.h264ref (unexplained diff vs previous) (percentage) 1.750 337.50%
465.tonto 117.000 -
465.tonto (avg) 117.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 84.000 -
465.tonto (max) (percentage) 0.700 -
470.lbm 45.000 -
470.lbm (avg) 45.000 -
470.lbm (avg) (percentage) 1.390 -
470.lbm (max) 40.000 -9.09%
470.lbm (max) (percentage) 1.220 -10.29%
470.lbm (unexplained diff vs previous) 11.000 -75.56%
470.lbm (unexplained diff vs previous) (percentage) 0.340 -75.36%
471.omnetpp 59.000 -1.67%
471.omnetpp (avg) 59.000 -1.67%
471.omnetpp (avg) (percentage) 2.800 -1.06%
471.omnetpp (max) 52.000 -5.45%
471.omnetpp (max) (percentage) 2.470 -4.63%
471.omnetpp (unexplained diff vs previous) 29.000 163.64%
471.omnetpp (unexplained diff vs previous) (percentage) 1.360 166.67%
473.astar 108.000 -
473.astar (avg) 108.000 -
473.astar (avg) (percentage) 2.220 -1.33%
473.astar (max) 22.000 -71.05%
473.astar (max) (percentage) 0.460 -70.70%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf 80.000 2.56%
481.wrf (avg) 80.000 2.56%
481.wrf (avg) (percentage) 2.750 -1.08%
481.wrf (max) 120.000 -
481.wrf (max) (percentage) 4.150 -3.94%
481.wrf (unexplained diff vs previous) 0.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.000 -
482.sphinx3 0.000 -
482.sphinx3 (avg) 0.000 -
482.sphinx3 (avg) (percentage) 2.790 -
482.sphinx3 (max) 0.000 -
482.sphinx3 (max) (percentage) 1.320 -2.22%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 5.440 -
Geometric Mean 2.065 -64.48%