Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/692ae5443b1778e138527ef55d799a4b535a36f9 (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/189/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0189 (llvmorg-19-init-12885-g692ae5443b17) 2024-05-28T20:15:26 0:00:00
Previous 0188 (llvmorg-19-init-12884-g270d95bfedc2) 2024-05-26T22:27:17 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 49 10
Performance Improvements 62 15
Added Tests 31 173
Unchanged Tests 1034 978
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 2.53% 1698.000 1741.000 - 4.63% -
450.soplex 2.25% 534.000 546.000 - 1.87% -
429.mcf 1.81% 1379.000 1404.000 - -26.34% -
434.zeusmp 1.71% 1926.000 1959.000 - 0.00% -
481.wrf 1.64% 3173.000 3225.000 - 0.00% -
482.sphinx3 1.45% 688.000 698.000 - 3.87% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (max) 120.00% 15.000 33.000 - 0.00% -
434.zeusmp (max) (percentage) 111.11% 0.810 1.710 - 0.00% -
450.soplex (max) 100.00% 6.000 12.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 90.09% 1.110 2.110 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 86.67% 30.000 56.000 0.000 0.00% 0.000
450.soplex (max) (percentage) 80.00% 1.250 2.250 - 0.00% -
470.lbm (max) 57.14% 14.000 22.000 - 0.00% -
429.mcf (max) 56.25% 16.000 25.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 55.56% 0.450 0.700 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 53.33% 15.000 23.000 0.000 0.00% 0.000
470.lbm (max) (percentage) 53.33% 0.450 0.690 - 0.00% -
429.mcf (max) (percentage) 47.15% 1.230 1.810 - 0.00% -
462.libquantum (max) (percentage) 35.56% 0.900 1.220 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 34.09% 0.440 0.590 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 27.18% 3.900 4.960 0.000 0.00% 0.000
401.bzip2 (max) (percentage) 24.70% 1.660 2.070 - 0.00% -
401.bzip2 (max) 22.73% 44.000 54.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 21.64% 1.710 2.080 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 21.00% 100.000 121.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 19.10% 89.000 106.000 0.000 0.00% 0.000
473.astar (max) (percentage) 16.67% 1.740 2.030 - 0.00% -
471.omnetpp (max) (percentage) 16.26% 4.060 4.720 - 0.00% -
473.astar (max) 14.44% 90.000 103.000 - 0.00% -
471.omnetpp (max) 11.65% 103.000 115.000 - 0.00% -
481.wrf (max) 10.64% 47.000 52.000 - 0.00% -
481.wrf (max) (percentage) 10.07% 1.490 1.640 - 0.00% -
481.wrf 9.38% 32.000 35.000 - 0.00% -
481.wrf (avg) 9.38% 32.000 35.000 - 0.00% -
450.soplex 9.09% 11.000 12.000 - 0.00% -
450.soplex (avg) 9.09% 11.000 12.000 - 0.00% -
481.wrf (avg) (percentage) 6.86% 1.020 1.090 - 0.00% -
400.perlbench 4.55% 22.000 23.000 - 0.00% -
400.perlbench (avg) 4.55% 22.000 23.000 - 0.00% -
434.zeusmp (avg) (percentage) 3.85% 0.780 0.810 - 0.00% -
471.omnetpp (avg) (percentage) 3.05% 1.970 2.030 - 0.00% -
473.astar (avg) (percentage) 2.78% 1.080 1.110 - 0.00% -
429.mcf 2.70% 37.000 38.000 - 0.00% -
429.mcf (avg) 2.70% 37.000 38.000 - 0.00% -
401.bzip2 (avg) (percentage) 2.33% 1.290 1.320 - 0.00% -
465.tonto 1.82% 55.000 56.000 - 0.00% -
465.tonto (avg) 1.82% 55.000 56.000 - 0.00% -
400.perlbench (max) 1.69% 59.000 60.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -4.72% 2561.000 2440.000 - -6.66% -
401.bzip2 -2.07% 2707.000 2651.000 - 6.00% -
473.astar -2.03% 5209.000 5103.000 - 4.89% -
462.libquantum -1.22% 82.000 81.000 - -23.58% -
453.povray -1.16% 432.000 427.000 - -8.17% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -62.17% 3.780 1.430 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -61.54% 26.000 10.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -59.14% 0.930 0.380 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -59.09% 44.000 18.000 0.000 0.00% 0.000
435.gromacs (max) -52.70% 74.000 35.000 - 0.00% -
435.gromacs (max) (percentage) -52.00% 1.500 0.720 - 0.00% -
445.gobmk (max) -38.24% 34.000 21.000 - 0.00% -
445.gobmk (max) (percentage) -38.03% 0.710 0.440 - 0.00% -
456.hmmer (max) -36.36% 11.000 7.000 - 0.00% -
456.hmmer (max) (percentage) -30.95% 0.420 0.290 - 0.00% -
453.povray (max) -20.00% 5.000 4.000 - 0.00% -
453.povray -16.67% 6.000 5.000 - 0.00% -
453.povray (avg) -16.67% 6.000 5.000 - 0.00% -
464.h264ref (max) (percentage) -15.25% 0.590 0.500 - 0.00% -
433.milc (max) -14.29% 7.000 6.000 - 0.00% -
458.sjeng (max) -13.79% 29.000 25.000 - 0.00% -
464.h264ref (max) -13.64% 22.000 19.000 - 0.00% -
433.milc (unexplained diff vs previous) -12.50% 8.000 7.000 0.000 0.00% 0.000
433.milc (max) (percentage) -12.12% 0.660 0.580 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -12.12% 0.660 0.580 0.000 0.00% 0.000
482.sphinx3 (max) -12.00% 25.000 22.000 - 0.00% -
458.sjeng (max) (percentage) -11.11% 0.450 0.400 - 0.00% -
482.sphinx3 (max) (percentage) -9.89% 3.640 3.280 - 0.00% -
410.bwaves (max) (percentage) -9.78% 0.920 0.830 - 0.00% -
410.bwaves (max) -9.30% 43.000 39.000 - 0.00% -
403.gcc (avg) (percentage) -7.65% 6.010 5.550 - 0.00% -
416.gamess (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
453.povray (max) (percentage) -4.92% 1.220 1.160 - 0.00% -
416.gamess -4.76% 21.000 20.000 - 0.00% -
416.gamess (avg) -4.76% 21.000 20.000 - 0.00% -
435.gromacs (avg) (percentage) -4.32% 1.390 1.330 - 0.00% -
458.sjeng (unexplained diff vs previous) -3.70% 27.000 26.000 0.000 0.00% 0.000
464.h264ref (avg) (percentage) -3.53% 0.850 0.820 - 0.00% -
437.leslie3d -3.45% 232.000 224.000 - 0.00% -
437.leslie3d (avg) -3.45% 232.000 224.000 - 0.00% -
464.h264ref -3.12% 32.000 31.000 - 0.00% -
464.h264ref (avg) -3.12% 32.000 31.000 - 0.00% -
437.leslie3d (avg) (percentage) -2.99% 3.680 3.570 - 0.00% -
435.gromacs -2.94% 68.000 66.000 - 0.00% -
435.gromacs (avg) -2.94% 68.000 66.000 - 0.00% -
445.gobmk -2.86% 35.000 34.000 - 0.00% -
445.gobmk (avg) -2.86% 35.000 34.000 - 0.00% -
459.GemsFDTD (max) -2.86% 35.000 34.000 - 0.00% -
445.gobmk (avg) (percentage) -2.74% 0.730 0.710 - 0.00% -
447.dealII (max) (percentage) -2.61% 1.530 1.490 - 0.00% -
444.namd (max) (percentage) -2.38% 0.840 0.820 - 0.00% -
447.dealII (avg) (percentage) -2.34% 1.710 1.670 - 0.00% -
465.tonto (max) (percentage) -2.08% 0.480 0.470 - 0.00% -
471.omnetpp -2.00% 50.000 49.000 - 0.00% -
471.omnetpp (avg) -2.00% 50.000 49.000 - 0.00% -
403.gcc (max) (percentage) -1.71% 11.720 11.520 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.54% 0.650 0.640 - 0.00% -
459.GemsFDTD (max) (percentage) -1.47% 0.680 0.670 - 0.00% -
433.milc (avg) (percentage) -1.27% 0.790 0.780 - 0.00% -
444.namd (avg) (percentage) -1.15% 0.870 0.860 - 0.00% -
465.tonto (max) -1.05% 95.000 94.000 - 0.00% -
410.bwaves (avg) (percentage) -1.04% 0.960 0.950 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.03% 3240486.000 3306130.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.00% 2501.000 2651.000 - -2.07% -
447.dealII 4.92% 1220.000 1280.000 - 0.87% -
473.astar 4.89% 4865.000 5103.000 - -2.03% -
400.perlbench 4.63% 1664.000 1741.000 - 2.53% -
482.sphinx3 3.87% 672.000 698.000 - 1.45% -
456.hmmer 3.07% 2639.000 2720.000 - -0.04% -
444.namd 2.42% 662.000 678.000 - -0.59% -
450.soplex 1.87% 536.000 546.000 - 2.25% -
470.lbm 1.60% 3249.000 3301.000 - -0.69% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.19% 42589.000 40378.000 - 0.00% -
464.h264ref -2.72% 749591.000 729177.000 - 0.00% -
444.namd -2.25% 212450.000 207669.000 - 0.00% -
458.sjeng -1.49% 146102.000 143918.000 - 0.00% -
450.soplex -1.35% 370392.000 365394.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.34% 1906.000 1404.000 - 1.81% -
462.libquantum -23.58% 106.000 81.000 - -1.22% -
453.povray -8.17% 465.000 427.000 - -1.16% -
471.omnetpp -6.66% 2614.000 2440.000 - -4.72% -
403.gcc -4.69% 64.000 61.000 - 0.00% -
464.h264ref -4.34% 4036.000 3861.000 - 0.08% -
458.sjeng -3.97% 6752.000 6484.000 - -0.40% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.39s
Name Current %
400.perlbench 1741.000 2.53%
401.bzip2 2651.000 -2.07%
403.gcc 61.000 -
410.bwaves 4754.000 -
416.gamess 10985.000 -
429.mcf 1404.000 1.81%
433.milc 1204.000 -
434.zeusmp 1959.000 1.71%
435.gromacs 4979.000 -
436.cactusADM 1306.000 -
437.leslie3d 6289.000 -
444.namd 678.000 -
445.gobmk 4887.000 -
447.dealII 1280.000 -
450.soplex 546.000 2.25%
453.povray 427.000 -1.16%
456.hmmer 2720.000 -
458.sjeng 6484.000 -
459.GemsFDTD 5170.000 -
462.libquantum 81.000 -1.22%
464.h264ref 3861.000 -
465.tonto 20084.000 -
470.lbm 3301.000 -
471.omnetpp 2440.000 -4.72%
473.astar 5103.000 -2.03%
481.wrf 3225.000 1.64%
482.sphinx3 698.000 1.45%
Geometric Mean 1981.422 -
Name Current %
400.perlbench 1184097.000 -
401.bzip2 76394.000 -
403.gcc 3429103.000 -
410.bwaves 633751.000 -
416.gamess 8876910.000 -
429.mcf 13255.000 -
433.milc 137212.000 -
434.zeusmp 1034200.000 -
435.gromacs 905388.000 -
436.cactusADM 1424672.000 -
437.leslie3d 954249.000 -
444.namd 207669.000 -
445.gobmk 2112017.000 -
447.dealII 3306130.000 -
450.soplex 365394.000 -
453.povray 961208.000 -
456.hmmer 299652.000 -
458.sjeng 143918.000 -
459.GemsFDTD 1289035.000 -
462.libquantum 40378.000 -
464.h264ref 729177.000 -
465.tonto 10954542.000 -
470.lbm 12117.000 -
471.omnetpp 682767.000 -
473.astar 41968.000 -
481.wrf 7291276.000 -
482.sphinx3 196345.000 -
Geometric Mean 516960.173 -
Name Current %
400.perlbench 23.000 4.55%
400.perlbench (avg) 23.000 4.55%
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 60.000 1.69%
400.perlbench (max) (percentage) 3.460 -
401.bzip2 34.000 -
401.bzip2 (avg) 34.000 -
401.bzip2 (avg) (percentage) 1.320 2.33%
401.bzip2 (max) 54.000 22.73%
401.bzip2 (max) (percentage) 2.070 24.70%
401.bzip2 (unexplained diff vs previous) 56.000 86.67%
401.bzip2 (unexplained diff vs previous) (percentage) 2.110 90.09%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.550 -7.65%
403.gcc (max) 7.000 -
403.gcc (max) (percentage) 11.520 -1.71%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
410.bwaves 45.000 -
410.bwaves (avg) 45.000 -
410.bwaves (avg) (percentage) 0.950 -1.04%
410.bwaves (max) 39.000 -9.30%
410.bwaves (max) (percentage) 0.830 -9.78%
410.bwaves (unexplained diff vs previous) 18.000 -59.09%
410.bwaves (unexplained diff vs previous) (percentage) 0.380 -59.14%
416.gamess 20.000 -4.76%
416.gamess (avg) 20.000 -4.76%
416.gamess (avg) (percentage) 0.190 -5.00%
416.gamess (max) 18.000 -
416.gamess (max) (percentage) 0.170 -
416.gamess (unexplained diff vs previous) 7.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.060 -
429.mcf 38.000 2.70%
429.mcf (avg) 38.000 2.70%
429.mcf (avg) (percentage) 2.720 -
429.mcf (max) 25.000 56.25%
429.mcf (max) (percentage) 1.810 47.15%
429.mcf (unexplained diff vs previous) 25.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.780 -
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.780 -1.27%
433.milc (max) 6.000 -14.29%
433.milc (max) (percentage) 0.580 -12.12%
433.milc (unexplained diff vs previous) 7.000 -12.50%
433.milc (unexplained diff vs previous) (percentage) 0.580 -12.12%
434.zeusmp 15.000 -
434.zeusmp (avg) 15.000 -
434.zeusmp (avg) (percentage) 0.810 3.85%
434.zeusmp (max) 33.000 120.00%
434.zeusmp (max) (percentage) 1.710 111.11%
434.zeusmp (unexplained diff vs previous) 33.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.680 -
435.gromacs 66.000 -2.94%
435.gromacs (avg) 66.000 -2.94%
435.gromacs (avg) (percentage) 1.330 -4.32%
435.gromacs (max) 35.000 -52.70%
435.gromacs (max) (percentage) 0.720 -52.00%
435.gromacs (unexplained diff vs previous) 28.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.560 -
436.cactusADM 7.000 -
436.cactusADM (avg) 7.000 -
436.cactusADM (avg) (percentage) 0.540 -
436.cactusADM (max) 7.000 -
436.cactusADM (max) (percentage) 0.580 -
436.cactusADM (unexplained diff vs previous) 7.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.540 -
437.leslie3d 224.000 -3.45%
437.leslie3d (avg) 224.000 -3.45%
437.leslie3d (avg) (percentage) 3.570 -2.99%
437.leslie3d (max) 253.000 -
437.leslie3d (max) (percentage) 4.030 -
437.leslie3d (unexplained diff vs previous) 26.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.410 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.860 -1.15%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.820 -2.38%
444.namd (unexplained diff vs previous) 4.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 0.590 34.09%
445.gobmk 34.000 -2.86%
445.gobmk (avg) 34.000 -2.86%
445.gobmk (avg) (percentage) 0.710 -2.74%
445.gobmk (max) 21.000 -38.24%
445.gobmk (max) (percentage) 0.440 -38.03%
445.gobmk (unexplained diff vs previous) 7.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.140 -
447.dealII 21.000 -
447.dealII (avg) 21.000 -
447.dealII (avg) (percentage) 1.670 -2.34%
447.dealII (max) 19.000 -
447.dealII (max) (percentage) 1.490 -2.61%
447.dealII (unexplained diff vs previous) 11.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.860 -
450.soplex 12.000 9.09%
450.soplex (avg) 12.000 9.09%
450.soplex (avg) (percentage) 2.220 -
450.soplex (max) 12.000 100.00%
450.soplex (max) (percentage) 2.250 80.00%
450.soplex (unexplained diff vs previous) 12.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.200 -
453.povray 5.000 -16.67%
453.povray (avg) 5.000 -16.67%
453.povray (avg) (percentage) 1.400 -
453.povray (max) 4.000 -20.00%
453.povray (max) (percentage) 1.160 -4.92%
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 1.170 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.310 -
456.hmmer (max) 7.000 -36.36%
456.hmmer (max) (percentage) 0.290 -30.95%
456.hmmer (unexplained diff vs previous) 1.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.040 -
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.490 -
458.sjeng (max) 25.000 -13.79%
458.sjeng (max) (percentage) 0.400 -11.11%
458.sjeng (unexplained diff vs previous) 26.000 -3.70%
458.sjeng (unexplained diff vs previous) (percentage) 0.400 -
459.GemsFDTD 33.000 -
459.GemsFDTD (avg) 33.000 -
459.GemsFDTD (avg) (percentage) 0.640 -1.54%
459.GemsFDTD (max) 34.000 -2.86%
459.GemsFDTD (max) (percentage) 0.670 -1.47%
459.GemsFDTD (unexplained diff vs previous) 24.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.460 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.520 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.220 35.56%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.230 -
464.h264ref 31.000 -3.12%
464.h264ref (avg) 31.000 -3.12%
464.h264ref (avg) (percentage) 0.820 -3.53%
464.h264ref (max) 19.000 -13.64%
464.h264ref (max) (percentage) 0.500 -15.25%
464.h264ref (unexplained diff vs previous) 3.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.080 -
465.tonto 56.000 1.82%
465.tonto (avg) 56.000 1.82%
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 94.000 -1.05%
465.tonto (max) (percentage) 0.470 -2.08%
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.670 -
470.lbm (max) 22.000 57.14%
470.lbm (max) (percentage) 0.690 53.33%
470.lbm (unexplained diff vs previous) 23.000 53.33%
470.lbm (unexplained diff vs previous) (percentage) 0.700 55.56%
471.omnetpp 49.000 -2.00%
471.omnetpp (avg) 49.000 -2.00%
471.omnetpp (avg) (percentage) 2.030 3.05%
471.omnetpp (max) 115.000 11.65%
471.omnetpp (max) (percentage) 4.720 16.26%
471.omnetpp (unexplained diff vs previous) 121.000 21.00%
471.omnetpp (unexplained diff vs previous) (percentage) 4.960 27.18%
473.astar 56.000 -
473.astar (avg) 56.000 -
473.astar (avg) (percentage) 1.110 2.78%
473.astar (max) 103.000 14.44%
473.astar (max) (percentage) 2.030 16.67%
473.astar (unexplained diff vs previous) 106.000 19.10%
473.astar (unexplained diff vs previous) (percentage) 2.080 21.64%
481.wrf 35.000 9.38%
481.wrf (avg) 35.000 9.38%
481.wrf (avg) (percentage) 1.090 6.86%
481.wrf (max) 52.000 10.64%
481.wrf (max) (percentage) 1.640 10.07%
481.wrf (unexplained diff vs previous) 52.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.610 -
482.sphinx3 13.000 -
482.sphinx3 (avg) 13.000 -
482.sphinx3 (avg) (percentage) 1.990 -
482.sphinx3 (max) 22.000 -12.00%
482.sphinx3 (max) (percentage) 3.280 -9.89%
482.sphinx3 (unexplained diff vs previous) 10.000 -61.54%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.430 -62.17%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.330 -
Geometric Mean 4.337 -28.02%