Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e1495283cf74590fbdeb6d46ad815b4d10b1902f (+ 165 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/319/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0319 (llvmorg-20-init-11693-ge1495283cf74) 2024-11-09T01:58:51 0:00:00
Previous 0317 (no-change) 2024-11-07T20:39:38 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 27 11
Performance Improvements 109 16
Added Tests 2 171
Unchanged Tests 1026 966
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 3.03% 660.000 680.000 - 2.72% -
403.gcc 1.67% 60.000 61.000 - -4.69% -
450.soplex 1.66% 541.000 550.000 - 2.61% -
482.sphinx3 1.59% 693.000 704.000 - 4.76% -
481.wrf 1.36% 3153.000 3196.000 - 0.00% -
464.h264ref 1.17% 3852.000 3897.000 - -3.44% -
400.perlbench 1.12% 1704.000 1723.000 - 3.55% -
436.cactusADM 1.09% 1288.000 1302.000 - 0.00% -
410.bwaves 1.06% 4627.000 4676.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (max) 110.34% 29.000 61.000 - 0.00% -
416.gamess (max) (percentage) 107.41% 0.270 0.560 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 107.41% 0.270 0.560 - 0.00% -
416.gamess (unexplained diff vs previous) 106.67% 30.000 62.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 44.44% 0.180 0.260 - 0.00% -
456.hmmer (max) 40.00% 5.000 7.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 40.00% 5.000 7.000 - 0.00% -
456.hmmer (max) (percentage) 18.18% 0.220 0.260 - 0.00% -
416.gamess (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -
416.gamess 4.17% 24.000 25.000 - 0.00% -
416.gamess (avg) 4.17% 24.000 25.000 - 0.00% -
464.h264ref 2.33% 43.000 44.000 - 0.00% -
464.h264ref (avg) 2.33% 43.000 44.000 - 0.00% -
400.perlbench (max) 2.22% 45.000 46.000 - 0.00% -
410.bwaves 2.04% 49.000 50.000 - 0.00% -
410.bwaves (avg) 2.04% 49.000 50.000 - 0.00% -
481.wrf 1.39% 72.000 73.000 - 0.00% -
481.wrf (avg) 1.39% 72.000 73.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -3.03% 5112.000 4957.000 - 0.00% -
453.povray -1.56% 448.000 441.000 - -5.16% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -99.13% 458.000 4.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.12% 32.830 0.290 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -97.57% 2.060 0.050 - 0.00% -
434.zeusmp (unexplained diff vs previous) -97.44% 39.000 1.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -94.52% 146.000 8.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -94.52% 2.920 0.160 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -93.33% 1.650 0.110 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -93.22% 1.770 0.120 - 0.00% -
401.bzip2 (unexplained diff vs previous) -93.18% 44.000 3.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -93.15% 4.380 0.300 - 0.00% -
437.leslie3d (unexplained diff vs previous) -93.14% 277.000 19.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -93.02% 86.000 6.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -88.26% 4.430 0.520 - 0.00% -
473.astar (unexplained diff vs previous) -88.11% 227.000 27.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -84.48% 3.350 0.520 - 0.00% -
471.omnetpp (unexplained diff vs previous) -84.34% 83.000 13.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -83.60% 10.000 1.640 - 0.00% -
403.gcc (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -78.36% 7.580 1.640 - 0.00% -
450.soplex (unexplained diff vs previous) -78.05% 41.000 9.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -73.91% 594.000 155.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -73.06% 11.620 3.130 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -70.41% 3.650 1.080 - 0.00% -
436.cactusADM (unexplained diff vs previous) -70.21% 47.000 14.000 - 0.00% -
453.povray (unexplained diff vs previous) -66.67% 21.000 7.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -66.10% 4.690 1.590 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -61.39% 4.040 1.560 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -61.26% 1.910 0.740 - 0.00% -
433.milc (unexplained diff vs previous) -60.87% 23.000 9.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -60.71% 28.000 11.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -58.05% 1.740 0.730 - 0.00% -
470.lbm (unexplained diff vs previous) -57.89% 57.000 24.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -51.88% 2.390 1.150 - 0.00% -
464.h264ref (unexplained diff vs previous) -51.09% 92.000 45.000 - 0.00% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -43.55% 1.860 1.050 - 0.00% -
410.bwaves (unexplained diff vs previous) -43.02% 86.000 49.000 - 0.00% -
410.bwaves (max) (percentage) -24.87% 1.890 1.420 - 0.00% -
410.bwaves (max) -24.14% 87.000 66.000 - 0.00% -
470.lbm (max) -17.24% 58.000 48.000 - 0.00% -
470.lbm (max) (percentage) -16.95% 1.770 1.470 - 0.00% -
444.namd (max) -16.67% 6.000 5.000 - 0.00% -
482.sphinx3 (max) -13.79% 29.000 25.000 - 0.00% -
453.povray (max) -13.64% 22.000 19.000 - 0.00% -
434.zeusmp (max) -12.82% 39.000 34.000 - 0.00% -
464.h264ref (max) (percentage) -12.65% 2.450 2.140 - 0.00% -
482.sphinx3 (max) (percentage) -12.59% 4.210 3.680 - 0.00% -
462.libquantum (max) -12.50% 8.000 7.000 - 0.00% -
434.zeusmp (max) (percentage) -12.32% 2.110 1.850 - 0.00% -
464.h264ref (max) -11.70% 94.000 83.000 - 0.00% -
471.omnetpp (max) (percentage) -11.09% 4.870 4.330 - 0.00% -
471.omnetpp (max) -10.83% 120.000 107.000 - 0.00% -
403.gcc (max) (percentage) -9.99% 11.110 10.000 - 0.00% -
462.libquantum (max) (percentage) -9.97% 10.530 9.480 - 0.00% -
453.povray (max) (percentage) -9.96% 4.920 4.430 - 0.00% -
473.astar (max) (percentage) -9.91% 4.640 4.180 - 0.00% -
473.astar (max) -9.28% 237.000 215.000 - 0.00% -
433.milc (max) -8.70% 23.000 21.000 - 0.00% -
435.gromacs (max) -8.48% 672.000 615.000 - 0.00% -
459.GemsFDTD (max) (percentage) -8.31% 3.010 2.760 - 0.00% -
433.milc (max) (percentage) -8.25% 1.940 1.780 - 0.00% -
436.cactusADM (max) (percentage) -8.24% 3.520 3.230 - 0.00% -
459.GemsFDTD (max) -8.00% 150.000 138.000 - 0.00% -
429.mcf (max) -7.75% 426.000 393.000 - 0.00% -
458.sjeng (max) (percentage) -7.45% 1.880 1.740 - 0.00% -
429.mcf (max) (percentage) -7.39% 30.580 28.320 - 0.00% -
447.dealII (max) -7.14% 14.000 13.000 - 0.00% -
401.bzip2 (max) -6.67% 45.000 42.000 - 0.00% -
436.cactusADM (max) -6.67% 45.000 42.000 - 0.00% -
458.sjeng (max) -6.61% 121.000 113.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -6.25% 0.800 0.750 - 0.00% -
450.soplex (max) (percentage) -6.22% 8.200 7.690 - 0.00% -
458.sjeng (unexplained diff vs previous) -5.77% 52.000 49.000 - 0.00% -
445.gobmk (max) -5.75% 87.000 82.000 - 0.00% -
445.gobmk (max) (percentage) -5.56% 1.800 1.700 - 0.00% -
435.gromacs (max) (percentage) -5.55% 13.150 12.420 - 0.00% -
437.leslie3d (max) -5.55% 541.000 511.000 - 0.00% -
444.namd (max) (percentage) -5.43% 0.920 0.870 - 0.00% -
447.dealII (max) (percentage) -5.41% 1.110 1.050 - 0.00% -
401.bzip2 (max) (percentage) -5.33% 1.690 1.600 - 0.00% -
437.leslie3d (max) (percentage) -5.25% 8.570 8.120 - 0.00% -
450.soplex (max) -4.55% 44.000 42.000 - 0.00% -
435.gromacs -3.47% 173.000 167.000 - 0.00% -
435.gromacs (avg) -3.47% 173.000 167.000 - 0.00% -
401.bzip2 -3.12% 32.000 31.000 - 0.00% -
401.bzip2 (avg) -3.12% 32.000 31.000 - 0.00% -
465.tonto (max) (percentage) -2.22% 0.450 0.440 - 0.00% -
465.tonto (max) -2.15% 93.000 91.000 - 0.00% -
403.gcc (avg) (percentage) -2.15% 4.190 4.100 - 0.00% -
437.leslie3d -2.05% 292.000 286.000 - 0.00% -
437.leslie3d (avg) -2.05% 292.000 286.000 - 0.00% -
429.mcf -1.96% 102.000 100.000 - 0.00% -
429.mcf (avg) -1.96% 102.000 100.000 - 0.00% -
434.zeusmp (avg) (percentage) -1.75% 1.140 1.120 - 0.00% -
437.leslie3d (avg) (percentage) -1.73% 4.630 4.550 - 0.00% -
401.bzip2 (avg) (percentage) -1.65% 1.210 1.190 - 0.00% -
462.libquantum (avg) (percentage) -1.65% 2.420 2.380 - 0.00% -
459.GemsFDTD -1.59% 63.000 62.000 - 0.00% -
459.GemsFDTD (avg) -1.59% 63.000 62.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.57% 1.270 1.250 - 0.00% -
481.wrf (max) (percentage) -1.39% 5.750 5.670 - 0.00% -
473.astar (avg) (percentage) -1.27% 1.570 1.550 - 0.00% -
473.astar -1.25% 80.000 79.000 - 0.00% -
473.astar (avg) -1.25% 80.000 79.000 - 0.00% -
429.mcf (avg) (percentage) -1.22% 7.350 7.260 - 0.00% -
471.omnetpp (avg) (percentage) -1.01% 1.990 1.970 - 0.00% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.21% 3240486.000 3279618.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.44% 2501.000 2662.000 - -0.11% -
473.astar 5.80% 4865.000 5147.000 - 0.53% -
447.dealII 5.41% 1220.000 1286.000 - 0.78% -
482.sphinx3 4.76% 672.000 704.000 - 1.59% -
400.perlbench 3.55% 1664.000 1723.000 - 1.12% -
456.hmmer 2.92% 2639.000 2716.000 - -0.26% -
444.namd 2.72% 662.000 680.000 - 3.03% -
450.soplex 2.61% 536.000 550.000 - 1.66% -
470.lbm 1.85% 3249.000 3309.000 - 0.73% -
433.milc 1.50% 1198.000 1216.000 - 0.75% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.73% 42589.000 40150.000 - 0.00% -
464.h264ref -3.30% 749591.000 724831.000 - 0.00% -
444.namd -3.02% 212450.000 206041.000 - -0.05% -
458.sjeng -1.68% 146102.000 143646.000 - 0.00% -
473.astar -1.45% 42348.000 41736.000 - 0.00% -
450.soplex -1.19% 370392.000 365970.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -27.02% 1906.000 1391.000 - -0.29% -
462.libquantum -20.75% 106.000 84.000 - 0.00% -
453.povray -5.16% 465.000 441.000 - -1.56% -
471.omnetpp -4.82% 2614.000 2488.000 - 0.53% -
403.gcc -4.69% 64.000 61.000 - 1.67% -
464.h264ref -3.44% 4036.000 3897.000 - 1.17% -
458.sjeng -3.39% 6752.000 6523.000 - 0.76% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 42.11% 19.000 27.000 - 0.00% -
nb_total_tests 6.90% 29.000 31.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1723.000 1.12%
401.bzip2 2662.000 -
403.gcc 61.000 1.67%
410.bwaves 4676.000 1.06%
416.gamess 11042.000 -
429.mcf 1391.000 -
433.milc 1216.000 -
434.zeusmp 1890.000 -
435.gromacs 4957.000 -3.03%
436.cactusADM 1302.000 1.09%
437.leslie3d 6304.000 -
444.namd 680.000 3.03%
445.gobmk 4857.000 -
447.dealII 1286.000 -
450.soplex 550.000 1.66%
453.povray 441.000 -1.56%
456.hmmer 2716.000 -
458.sjeng 6523.000 -
459.GemsFDTD 5004.000 -
462.libquantum 84.000 -
464.h264ref 3897.000 1.17%
465.tonto 20724.000 -
470.lbm 3309.000 -
471.omnetpp 2488.000 -
473.astar 5147.000 -
481.wrf 3196.000 1.36%
482.sphinx3 704.000 1.59%
Geometric Mean 1985.975 -
Name Current %
400.perlbench 1185325.000 -
401.bzip2 76390.000 -
403.gcc 3423267.000 -
410.bwaves 573179.000 -
416.gamess 8664467.000 -
429.mcf 13291.000 -
433.milc 138392.000 -
434.zeusmp 926933.000 -
435.gromacs 903180.000 -
436.cactusADM 1354396.000 -
437.leslie3d 840218.000 -
444.namd 206041.000 -
445.gobmk 2109225.000 -
447.dealII 3279618.000 -
450.soplex 365970.000 -
453.povray 962624.000 -
456.hmmer 299572.000 -
458.sjeng 143646.000 -
459.GemsFDTD 1196004.000 -
462.libquantum 40150.000 -
464.h264ref 724831.000 -
465.tonto 10606682.000 -
470.lbm 12145.000 -
471.omnetpp 682519.000 -
473.astar 41736.000 -
481.wrf 5288662.000 -
482.sphinx3 196269.000 -
Geometric Mean 500675.776 -
Name Current %
400.perlbench 30.000 -
400.perlbench (avg) 30.000 -
400.perlbench (avg) (percentage) 1.780 -
400.perlbench (max) 46.000 2.22%
400.perlbench (max) (percentage) 2.670 -
401.bzip2 31.000 -3.12%
401.bzip2 (avg) 31.000 -3.12%
401.bzip2 (avg) (percentage) 1.190 -1.65%
401.bzip2 (max) 42.000 -6.67%
401.bzip2 (max) (percentage) 1.600 -5.33%
401.bzip2 (unexplained diff vs previous) 3.000 -93.18%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 -93.33%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.100 -2.15%
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.000 -9.99%
403.gcc (unexplained diff vs previous) 1.000 -83.33%
403.gcc (unexplained diff vs previous) (percentage) 1.640 -83.60%
410.bwaves 50.000 2.04%
410.bwaves (avg) 50.000 2.04%
410.bwaves (avg) (percentage) 1.070 -
410.bwaves (max) 66.000 -24.14%
410.bwaves (max) (percentage) 1.420 -24.87%
410.bwaves (unexplained diff vs previous) 49.000 -43.02%
410.bwaves (unexplained diff vs previous) (percentage) 1.050 -43.55%
416.gamess 25.000 4.17%
416.gamess (avg) 25.000 4.17%
416.gamess (avg) (percentage) 0.230 4.55%
416.gamess (max) 61.000 110.34%
416.gamess (max) (percentage) 0.560 107.41%
416.gamess (unexplained diff vs previous) 62.000 106.67%
416.gamess (unexplained diff vs previous) (percentage) 0.560 107.41%
429.mcf 100.000 -1.96%
429.mcf (avg) 100.000 -1.96%
429.mcf (avg) (percentage) 7.260 -1.22%
429.mcf (max) 393.000 -7.75%
429.mcf (max) (percentage) 28.320 -7.39%
429.mcf (unexplained diff vs previous) 4.000 -99.13%
429.mcf (unexplained diff vs previous) (percentage) 0.290 -99.12%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 0.940 -
433.milc (max) 21.000 -8.70%
433.milc (max) (percentage) 1.780 -8.25%
433.milc (unexplained diff vs previous) 9.000 -60.87%
433.milc (unexplained diff vs previous) (percentage) 0.740 -61.26%
434.zeusmp 21.000 -
434.zeusmp (avg) 21.000 -
434.zeusmp (avg) (percentage) 1.120 -1.75%
434.zeusmp (max) 34.000 -12.82%
434.zeusmp (max) (percentage) 1.850 -12.32%
434.zeusmp (unexplained diff vs previous) 1.000 -97.44%
434.zeusmp (unexplained diff vs previous) (percentage) 0.050 -97.57%
435.gromacs 167.000 -3.47%
435.gromacs (avg) 167.000 -3.47%
435.gromacs (avg) (percentage) 3.380 -
435.gromacs (max) 615.000 -8.48%
435.gromacs (max) (percentage) 12.420 -5.55%
435.gromacs (unexplained diff vs previous) 155.000 -73.91%
435.gromacs (unexplained diff vs previous) (percentage) 3.130 -73.06%
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.940 -
436.cactusADM (max) 42.000 -6.67%
436.cactusADM (max) (percentage) 3.230 -8.24%
436.cactusADM (unexplained diff vs previous) 14.000 -70.21%
436.cactusADM (unexplained diff vs previous) (percentage) 1.080 -70.41%
437.leslie3d 286.000 -2.05%
437.leslie3d (avg) 286.000 -2.05%
437.leslie3d (avg) (percentage) 4.550 -1.73%
437.leslie3d (max) 511.000 -5.55%
437.leslie3d (max) (percentage) 8.120 -5.25%
437.leslie3d (unexplained diff vs previous) 19.000 -93.14%
437.leslie3d (unexplained diff vs previous) (percentage) 0.300 -93.15%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.760 -
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.870 -5.43%
445.gobmk 45.000 -
445.gobmk (avg) 45.000 -
445.gobmk (avg) (percentage) 0.930 -
445.gobmk (max) 82.000 -5.75%
445.gobmk (max) (percentage) 1.700 -5.56%
445.gobmk (unexplained diff vs previous) 6.000 -93.02%
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -93.22%
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.360 -
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 1.050 -5.41%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 3.080 -
450.soplex (max) 42.000 -4.55%
450.soplex (max) (percentage) 7.690 -6.22%
450.soplex (unexplained diff vs previous) 9.000 -78.05%
450.soplex (unexplained diff vs previous) (percentage) 1.640 -78.36%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.550 -
453.povray (max) 19.000 -13.64%
453.povray (max) (percentage) 4.430 -9.96%
453.povray (unexplained diff vs previous) 7.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 1.590 -66.10%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 7.000 40.00%
456.hmmer (max) (percentage) 0.260 18.18%
456.hmmer (unexplained diff vs previous) 7.000 40.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.260 44.44%
458.sjeng 42.000 -
458.sjeng (avg) 42.000 -
458.sjeng (avg) (percentage) 0.650 -
458.sjeng (max) 113.000 -6.61%
458.sjeng (max) (percentage) 1.740 -7.45%
458.sjeng (unexplained diff vs previous) 49.000 -5.77%
458.sjeng (unexplained diff vs previous) (percentage) 0.750 -6.25%
459.GemsFDTD 62.000 -1.59%
459.GemsFDTD (avg) 62.000 -1.59%
459.GemsFDTD (avg) (percentage) 1.250 -1.57%
459.GemsFDTD (max) 138.000 -8.00%
459.GemsFDTD (max) (percentage) 2.760 -8.31%
459.GemsFDTD (unexplained diff vs previous) 8.000 -94.52%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.160 -94.52%
462.libquantum 1.000 -50.00%
462.libquantum (avg) 1.000 -50.00%
462.libquantum (avg) (percentage) 2.380 -1.65%
462.libquantum (max) 7.000 -12.50%
462.libquantum (max) (percentage) 9.480 -9.97%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 44.000 2.33%
464.h264ref (avg) 44.000 2.33%
464.h264ref (avg) (percentage) 1.130 -
464.h264ref (max) 83.000 -11.70%
464.h264ref (max) (percentage) 2.140 -12.65%
464.h264ref (unexplained diff vs previous) 45.000 -51.09%
464.h264ref (unexplained diff vs previous) (percentage) 1.150 -51.88%
465.tonto 60.000 -
465.tonto (avg) 60.000 -
465.tonto (avg) (percentage) 0.290 -
465.tonto (max) 91.000 -2.15%
465.tonto (max) (percentage) 0.440 -2.22%
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 0.960 -
470.lbm (max) 48.000 -17.24%
470.lbm (max) (percentage) 1.470 -16.95%
470.lbm (unexplained diff vs previous) 24.000 -57.89%
470.lbm (unexplained diff vs previous) (percentage) 0.730 -58.05%
471.omnetpp 49.000 -
471.omnetpp (avg) 49.000 -
471.omnetpp (avg) (percentage) 1.970 -1.01%
471.omnetpp (max) 107.000 -10.83%
471.omnetpp (max) (percentage) 4.330 -11.09%
471.omnetpp (unexplained diff vs previous) 13.000 -84.34%
471.omnetpp (unexplained diff vs previous) (percentage) 0.520 -84.48%
473.astar 79.000 -1.25%
473.astar (avg) 79.000 -1.25%
473.astar (avg) (percentage) 1.550 -1.27%
473.astar (max) 215.000 -9.28%
473.astar (max) (percentage) 4.180 -9.91%
473.astar (unexplained diff vs previous) 27.000 -88.11%
473.astar (unexplained diff vs previous) (percentage) 0.520 -88.26%
481.wrf 73.000 1.39%
481.wrf (avg) 73.000 1.39%
481.wrf (avg) (percentage) 2.290 -
481.wrf (max) 181.000 -
481.wrf (max) (percentage) 5.670 -1.39%
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.400 -
482.sphinx3 (max) 25.000 -13.79%
482.sphinx3 (max) (percentage) 3.680 -12.59%
482.sphinx3 (unexplained diff vs previous) 11.000 -60.71%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.560 -61.39%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.020 -
Geometric Mean 6.505 -40.55%