Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/195d8ac26d91ca798733c3a5f58d67992d43503d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/174/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0174 (no-change) 2024-05-08T03:23:33 0:00:00
Previous 0172 (llvmorg-19-init-10913-g195d8ac26d91) 2024-05-05T17:17:43 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 11
Performance Improvements 102 14
Added Tests 30 173
Unchanged Tests 1024 978
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 4.38% 2533.000 2644.000 - 1.15% -
437.leslie3d 2.05% 6331.000 6461.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 2120.00% 5.000 111.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 2000.00% 0.200 4.200 0.000 0.00% 0.000
471.omnetpp (max) 210.81% 37.000 115.000 - 0.00% -
471.omnetpp (max) (percentage) 195.95% 1.480 4.380 - 0.00% -
470.lbm (max) 46.15% 13.000 19.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 45.24% 0.420 0.610 0.000 0.00% 0.000
470.lbm (max) (percentage) 42.86% 0.420 0.600 - 0.00% -
470.lbm (unexplained diff vs previous) 42.86% 14.000 20.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 34.09% 0.440 0.590 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 0.00% 0.000
481.wrf (max) (percentage) 27.37% 1.790 2.280 - 0.00% -
481.wrf (max) 26.32% 57.000 72.000 - 0.00% -
481.wrf (avg) (percentage) 24.73% 0.930 1.160 - 0.00% -
481.wrf 20.00% 30.000 36.000 - 0.00% -
481.wrf (avg) 20.00% 30.000 36.000 - 0.00% -
471.omnetpp 8.00% 50.000 54.000 - 0.00% -
471.omnetpp (avg) 8.00% 50.000 54.000 - 0.00% -
471.omnetpp (avg) (percentage) 3.00% 2.000 2.060 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -6.35% 63.000 59.000 - -7.81% -
482.sphinx3 -2.55% 707.000 689.000 - 2.53% -
481.wrf -2.28% 3240.000 3166.000 - 0.00% -
435.gromacs -1.91% 4923.000 4829.000 - 0.00% -
401.bzip2 -1.34% 2682.000 2646.000 - 5.80% -
447.dealII -1.25% 1276.000 1260.000 - 3.28% -
450.soplex -1.10% 544.000 538.000 - 0.37% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -77.03% 8.750 2.010 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -76.53% 554.000 130.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -76.19% 1.050 0.250 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -75.93% 54.000 13.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -75.76% 33.000 8.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -75.76% 0.330 0.080 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -75.36% 0.690 0.170 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -75.00% 4.000 1.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -60.00% 15.000 6.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -60.00% 1.150 0.460 0.000 0.00% 0.000
462.libquantum (max) -50.00% 2.000 1.000 - 0.00% -
435.gromacs (max) -45.56% 169.000 92.000 - 0.00% -
435.gromacs (max) (percentage) -44.64% 3.450 1.910 - 0.00% -
429.mcf (unexplained diff vs previous) -41.18% 17.000 10.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -40.83% 1.200 0.710 0.000 0.00% 0.000
433.milc (max) (percentage) -32.43% 0.370 0.250 - 0.00% -
433.milc (max) -25.00% 4.000 3.000 - 0.00% -
473.astar (max) -23.73% 59.000 45.000 - 0.00% -
473.astar (max) (percentage) -23.48% 1.150 0.880 - 0.00% -
403.gcc (max) -20.00% 5.000 4.000 - 0.00% -
464.h264ref (max) -19.42% 103.000 83.000 - 0.00% -
464.h264ref (max) (percentage) -19.39% 2.630 2.120 - 0.00% -
410.bwaves (max) -18.18% 33.000 27.000 - 0.00% -
429.mcf (max) -17.65% 17.000 14.000 - 0.00% -
410.bwaves (max) (percentage) -17.14% 0.700 0.580 - 0.00% -
462.libquantum (max) (percentage) -16.80% 2.440 2.030 - 0.00% -
429.mcf (max) (percentage) -16.39% 1.220 1.020 - 0.00% -
416.gamess (max) -13.46% 52.000 45.000 - 0.00% -
416.gamess (max) (percentage) -12.50% 0.480 0.420 - 0.00% -
444.namd (max) -12.50% 8.000 7.000 - 0.00% -
436.cactusADM (max) -11.76% 17.000 15.000 - 0.00% -
450.soplex (max) -10.00% 10.000 9.000 - 0.00% -
459.GemsFDTD (max) -10.00% 50.000 45.000 - 0.00% -
445.gobmk (max) -9.30% 43.000 39.000 - 0.00% -
459.GemsFDTD (max) (percentage) -9.18% 0.980 0.890 - 0.00% -
445.gobmk (max) (percentage) -9.09% 0.880 0.800 - 0.00% -
436.cactusADM (max) (percentage) -8.96% 1.340 1.220 - 0.00% -
401.bzip2 (max) -7.89% 38.000 35.000 - 0.00% -
458.sjeng (max) -7.89% 38.000 35.000 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
434.zeusmp (max) -7.14% 14.000 13.000 - 0.00% -
458.sjeng (max) (percentage) -6.78% 0.590 0.550 - 0.00% -
444.namd (max) (percentage) -6.72% 1.190 1.110 - 0.00% -
437.leslie3d (max) (percentage) -6.50% 8.310 7.770 - 0.00% -
453.povray (max) (percentage) -6.49% 1.540 1.440 - 0.00% -
434.zeusmp -5.88% 17.000 16.000 - 0.00% -
434.zeusmp (avg) -5.88% 17.000 16.000 - 0.00% -
401.bzip2 (max) (percentage) -5.63% 1.420 1.340 - 0.00% -
482.sphinx3 (max) -5.56% 18.000 17.000 - 0.00% -
456.hmmer (max) (percentage) -5.06% 0.790 0.750 - 0.00% -
450.soplex (max) (percentage) -4.86% 1.850 1.760 - 0.00% -
436.cactusADM (avg) (percentage) -4.82% 0.830 0.790 - 0.00% -
456.hmmer (max) -4.76% 21.000 20.000 - 0.00% -
437.leslie3d (max) -4.56% 526.000 502.000 - 0.00% -
447.dealII -4.35% 23.000 22.000 - 0.00% -
447.dealII (avg) -4.35% 23.000 22.000 - 0.00% -
483.xalancbmk (max) (percentage) -3.81% 2.890 2.780 - 0.00% -
453.povray (avg) (percentage) -3.38% 1.480 1.430 - 0.00% -
464.h264ref (avg) (percentage) -3.12% 0.960 0.930 - 0.00% -
401.bzip2 -2.86% 35.000 34.000 - 0.00% -
401.bzip2 (avg) -2.86% 35.000 34.000 - 0.00% -
458.sjeng -2.86% 35.000 34.000 - 0.00% -
458.sjeng (avg) -2.86% 35.000 34.000 - 0.00% -
434.zeusmp (max) (percentage) -2.70% 0.740 0.720 - 0.00% -
464.h264ref -2.70% 37.000 36.000 - 0.00% -
464.h264ref (avg) -2.70% 37.000 36.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.63% 0.760 0.740 - 0.00% -
445.gobmk -2.63% 38.000 37.000 - 0.00% -
445.gobmk (avg) -2.63% 38.000 37.000 - 0.00% -
459.GemsFDTD -2.56% 39.000 38.000 - 0.00% -
459.GemsFDTD (avg) -2.56% 39.000 38.000 - 0.00% -
473.astar (avg) (percentage) -2.40% 1.250 1.220 - 0.00% -
462.libquantum (avg) (percentage) -2.34% 1.710 1.670 - 0.00% -
433.milc (avg) (percentage) -2.30% 0.870 0.850 - 0.00% -
429.mcf -2.27% 44.000 43.000 - 0.00% -
429.mcf (avg) -2.27% 44.000 43.000 - 0.00% -
482.sphinx3 (max) (percentage) -2.26% 2.650 2.590 - 0.00% -
435.gromacs -2.08% 96.000 94.000 - 0.00% -
435.gromacs (avg) -2.08% 96.000 94.000 - 0.00% -
465.tonto (max) (percentage) -2.00% 0.500 0.490 - 0.00% -
465.tonto (max) -2.00% 100.000 98.000 - 0.00% -
437.leslie3d (avg) (percentage) -1.92% 4.160 4.080 - 0.00% -
429.mcf (avg) (percentage) -1.92% 3.130 3.070 - 0.00% -
458.sjeng (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
410.bwaves -1.85% 54.000 53.000 - 0.00% -
410.bwaves (avg) -1.85% 54.000 53.000 - 0.00% -
410.bwaves (avg) (percentage) -1.75% 1.140 1.120 - 0.00% -
450.soplex (avg) (percentage) -1.65% 2.420 2.380 - 0.00% -
400.perlbench (max) -1.61% 62.000 61.000 - 0.00% -
473.astar -1.56% 64.000 63.000 - 0.00% -
473.astar (avg) -1.56% 64.000 63.000 - 0.00% -
403.gcc (max) (percentage) -1.52% 8.560 8.430 - 0.00% -
445.gobmk (avg) (percentage) -1.28% 0.780 0.770 - 0.00% -
447.dealII (avg) (percentage) -1.10% 1.810 1.790 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.82% 3240486.000 3299538.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
473.astar 6.19% 4865.000 5166.000 - 0.25% -
401.bzip2 5.80% 2501.000 2646.000 - -1.34% -
447.dealII 3.28% 1220.000 1260.000 - -1.25% -
456.hmmer 3.18% 2639.000 2723.000 - -0.11% -
482.sphinx3 2.53% 672.000 689.000 - -2.55% -
444.namd 2.11% 662.000 676.000 - -0.59% -
400.perlbench 1.92% 1664.000 1696.000 - -0.41% -
470.lbm 1.69% 3249.000 3304.000 - -0.60% -
471.omnetpp 1.15% 2614.000 2644.000 - 4.38% -
433.milc 1.00% 1198.000 1210.000 - 0.08% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.00% 42589.000 40458.000 - 0.00% -
464.h264ref -2.70% 749591.000 729369.000 - 0.00% -
444.namd -2.31% 212450.000 207537.000 - 0.00% -
458.sjeng -1.49% 146102.000 143918.000 - 0.00% -
450.soplex -1.31% 370392.000 365534.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.50% 1906.000 1401.000 - -0.71% -
462.libquantum -20.75% 106.000 84.000 - 0.00% -
403.gcc -7.81% 64.000 59.000 - -6.35% -
453.povray -6.24% 465.000 436.000 - -0.23% -
458.sjeng -3.57% 6752.000 6511.000 - -0.17% -
464.h264ref -2.68% 4036.000 3928.000 - 0.18% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1696.000 -
401.bzip2 2646.000 -1.34%
403.gcc 59.000 -6.35%
410.bwaves 4745.000 -
416.gamess 10938.000 -
429.mcf 1401.000 -
433.milc 1210.000 -
434.zeusmp 1929.000 -
435.gromacs 4829.000 -1.91%
436.cactusADM 1308.000 -
437.leslie3d 6461.000 2.05%
444.namd 676.000 -
445.gobmk 4929.000 -
447.dealII 1260.000 -1.25%
450.soplex 538.000 -1.10%
453.povray 436.000 -
456.hmmer 2723.000 -
458.sjeng 6511.000 -
459.GemsFDTD 5168.000 -
462.libquantum 84.000 -
464.h264ref 3928.000 -
465.tonto 20189.000 -
470.lbm 3304.000 -
471.omnetpp 2644.000 4.38%
473.astar 5166.000 -
481.wrf 3166.000 -2.28%
482.sphinx3 689.000 -2.55%
Geometric Mean 1984.314 -
Name Current %
400.perlbench 1184041.000 -
401.bzip2 76410.000 -
403.gcc 3429403.000 -
410.bwaves 632575.000 -
416.gamess 8877254.000 -
429.mcf 13255.000 -
433.milc 137200.000 -
434.zeusmp 1033056.000 -
435.gromacs 905052.000 -
436.cactusADM 1423512.000 -
437.leslie3d 951207.000 -
444.namd 207537.000 -
445.gobmk 2111921.000 -
447.dealII 3299538.000 -
450.soplex 365534.000 -
453.povray 960882.000 -
456.hmmer 299668.000 -
458.sjeng 143918.000 -
459.GemsFDTD 1289459.000 -
462.libquantum 40458.000 -
464.h264ref 729369.000 -
465.tonto 10951292.000 -
470.lbm 12117.000 -
471.omnetpp 680158.000 -
473.astar 41968.000 -
481.wrf 7290124.000 -
482.sphinx3 196385.000 -
Geometric Mean 516745.203 -
Name Current %
400.perlbench 22.000 -
400.perlbench (avg) 22.000 -
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 61.000 -1.61%
400.perlbench (max) (percentage) 3.630 -
401.bzip2 34.000 -2.86%
401.bzip2 (avg) 34.000 -2.86%
401.bzip2 (avg) (percentage) 1.320 -
401.bzip2 (max) 35.000 -7.89%
401.bzip2 (max) (percentage) 1.340 -5.63%
401.bzip2 (unexplained diff vs previous) 36.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.360 -
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.700 -
403.gcc (max) 4.000 -20.00%
403.gcc (max) (percentage) 8.430 -1.52%
410.bwaves 53.000 -1.85%
410.bwaves (avg) 53.000 -1.85%
410.bwaves (avg) (percentage) 1.120 -1.75%
410.bwaves (max) 27.000 -18.18%
410.bwaves (max) (percentage) 0.580 -17.14%
410.bwaves (unexplained diff vs previous) 8.000 -75.76%
410.bwaves (unexplained diff vs previous) (percentage) 0.170 -75.36%
416.gamess 25.000 -
416.gamess (avg) 25.000 -
416.gamess (avg) (percentage) 0.230 -
416.gamess (max) 45.000 -13.46%
416.gamess (max) (percentage) 0.420 -12.50%
416.gamess (unexplained diff vs previous) 19.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.170 -
429.mcf 43.000 -2.27%
429.mcf (avg) 43.000 -2.27%
429.mcf (avg) (percentage) 3.070 -1.92%
429.mcf (max) 14.000 -17.65%
429.mcf (max) (percentage) 1.020 -16.39%
429.mcf (unexplained diff vs previous) 10.000 -41.18%
429.mcf (unexplained diff vs previous) (percentage) 0.710 -40.83%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.850 -2.30%
433.milc (max) 3.000 -25.00%
433.milc (max) (percentage) 0.250 -32.43%
433.milc (unexplained diff vs previous) 1.000 -75.00%
433.milc (unexplained diff vs previous) (percentage) 0.080 -75.76%
434.zeusmp 16.000 -5.88%
434.zeusmp (avg) 16.000 -5.88%
434.zeusmp (avg) (percentage) 0.880 -
434.zeusmp (max) 13.000 -7.14%
434.zeusmp (max) (percentage) 0.720 -2.70%
434.zeusmp (unexplained diff vs previous) 14.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.730 -
435.gromacs 94.000 -2.08%
435.gromacs (avg) 94.000 -2.08%
435.gromacs (avg) (percentage) 1.950 -
435.gromacs (max) 92.000 -45.56%
435.gromacs (max) (percentage) 1.910 -44.64%
435.gromacs (unexplained diff vs previous) 94.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.950 -
436.cactusADM 10.000 -
436.cactusADM (avg) 10.000 -
436.cactusADM (avg) (percentage) 0.790 -4.82%
436.cactusADM (max) 15.000 -11.76%
436.cactusADM (max) (percentage) 1.220 -8.96%
436.cactusADM (unexplained diff vs previous) 6.000 -60.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.460 -60.00%
437.leslie3d 263.000 -
437.leslie3d (avg) 263.000 -
437.leslie3d (avg) (percentage) 4.080 -1.92%
437.leslie3d (max) 502.000 -4.56%
437.leslie3d (max) (percentage) 7.770 -6.50%
437.leslie3d (unexplained diff vs previous) 130.000 -76.53%
437.leslie3d (unexplained diff vs previous) (percentage) 2.010 -77.03%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.930 -
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 1.110 -6.72%
444.namd (unexplained diff vs previous) 4.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 0.590 34.09%
445.gobmk 37.000 -2.63%
445.gobmk (avg) 37.000 -2.63%
445.gobmk (avg) (percentage) 0.770 -1.28%
445.gobmk (max) 39.000 -9.30%
445.gobmk (max) (percentage) 0.800 -9.09%
445.gobmk (unexplained diff vs previous) 24.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.490 -
447.dealII 22.000 -4.35%
447.dealII (avg) 22.000 -4.35%
447.dealII (avg) (percentage) 1.790 -1.10%
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 1.250 -
447.dealII (unexplained diff vs previous) 16.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.270 -
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.380 -1.65%
450.soplex (max) 9.000 -10.00%
450.soplex (max) (percentage) 1.760 -4.86%
450.soplex (unexplained diff vs previous) 6.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.120 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.430 -3.38%
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.440 -6.49%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.230 -
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.340 -
456.hmmer (max) 20.000 -4.76%
456.hmmer (max) (percentage) 0.750 -5.06%
456.hmmer (unexplained diff vs previous) 3.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -
458.sjeng 34.000 -2.86%
458.sjeng (avg) 34.000 -2.86%
458.sjeng (avg) (percentage) 0.530 -1.85%
458.sjeng (max) 35.000 -7.89%
458.sjeng (max) (percentage) 0.550 -6.78%
458.sjeng (unexplained diff vs previous) 11.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.170 -
459.GemsFDTD 38.000 -2.56%
459.GemsFDTD (avg) 38.000 -2.56%
459.GemsFDTD (avg) (percentage) 0.740 -2.63%
459.GemsFDTD (max) 45.000 -10.00%
459.GemsFDTD (max) (percentage) 0.890 -9.18%
459.GemsFDTD (unexplained diff vs previous) 15.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.290 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.670 -2.34%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 2.030 -16.80%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 36.000 -2.70%
464.h264ref (avg) 36.000 -2.70%
464.h264ref (avg) (percentage) 0.930 -3.12%
464.h264ref (max) 83.000 -19.42%
464.h264ref (max) (percentage) 2.120 -19.39%
464.h264ref (unexplained diff vs previous) 7.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.180 -
465.tonto 56.000 -
465.tonto (avg) 56.000 -
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 98.000 -2.00%
465.tonto (max) (percentage) 0.490 -2.00%
470.lbm 25.000 -
470.lbm (avg) 25.000 -
470.lbm (avg) (percentage) 0.770 -
470.lbm (max) 19.000 46.15%
470.lbm (max) (percentage) 0.600 42.86%
470.lbm (unexplained diff vs previous) 20.000 42.86%
470.lbm (unexplained diff vs previous) (percentage) 0.610 45.24%
471.omnetpp 54.000 8.00%
471.omnetpp (avg) 54.000 8.00%
471.omnetpp (avg) (percentage) 2.060 3.00%
471.omnetpp (max) 115.000 210.81%
471.omnetpp (max) (percentage) 4.380 195.95%
471.omnetpp (unexplained diff vs previous) 111.000 2120.00%
471.omnetpp (unexplained diff vs previous) (percentage) 4.200 2000.00%
473.astar 63.000 -1.56%
473.astar (avg) 63.000 -1.56%
473.astar (avg) (percentage) 1.220 -2.40%
473.astar (max) 45.000 -23.73%
473.astar (max) (percentage) 0.880 -23.48%
473.astar (unexplained diff vs previous) 13.000 -75.93%
473.astar (unexplained diff vs previous) (percentage) 0.250 -76.19%
481.wrf 36.000 20.00%
481.wrf (avg) 36.000 20.00%
481.wrf (avg) (percentage) 1.160 24.73%
481.wrf (max) 72.000 26.32%
481.wrf (max) (percentage) 2.280 27.37%
481.wrf (unexplained diff vs previous) 74.000 -
481.wrf (unexplained diff vs previous) (percentage) 2.340 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 2.200 -
482.sphinx3 (max) 17.000 -5.56%
482.sphinx3 (max) (percentage) 2.590 -2.26%
482.sphinx3 (unexplained diff vs previous) 18.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.610 -
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.780 -3.81%
Geometric Mean 4.871 -26.55%