Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/baffaf000fd4667f33b3756d0d3b645b1d926b44 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/127/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0127 (no-change) 2024-05-06T03:55:24 0:00:00
Previous 0126 (llvmorg-19-init-10995-gbaffaf000fd4) 2024-04-30T13:02:17 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 32 12
Performance Improvements 91 14
Added Tests 34 167
Unchanged Tests 983 947
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 4.66% 4397.000 4602.000 - 0.00% -
403.gcc 3.51% 57.000 59.000 - 0.00% -
437.leslie3d 2.06% 6221.000 6349.000 - 0.00% -
453.povray 1.49% 403.000 409.000 - -2.85% -
445.gobmk 1.25% 4565.000 4622.000 - 0.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) 500.00% 1.000 6.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 475.00% 0.080 0.460 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 220.00% 0.050 0.160 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 0.00% 0.000
403.gcc (max) 100.00% 1.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 82.61% 0.690 1.260 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 80.00% 10.000 18.000 0.000 0.00% 0.000
435.gromacs (max) 62.12% 132.000 214.000 - 0.00% -
435.gromacs (max) (percentage) 54.82% 3.010 4.660 - 0.00% -
435.gromacs 51.89% 106.000 161.000 - 0.00% -
435.gromacs (avg) 51.89% 106.000 161.000 - 0.00% -
435.gromacs (avg) (percentage) 45.45% 2.420 3.520 - 0.00% -
437.leslie3d (unexplained diff vs previous) 28.00% 100.000 128.000 0.000 0.00% 0.000
403.gcc (avg) (percentage) 27.80% 2.050 2.620 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 25.47% 1.610 2.020 0.000 0.00% 0.000
459.GemsFDTD 16.67% 24.000 28.000 - 0.00% -
459.GemsFDTD (avg) 16.67% 24.000 28.000 - 0.00% -
470.lbm (unexplained diff vs previous) 16.67% 6.000 7.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 16.67% 0.180 0.210 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 15.38% 13.000 15.000 0.000 0.00% 0.000
459.GemsFDTD (avg) (percentage) 15.22% 0.460 0.530 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 13.79% 0.290 0.330 0.000 0.00% 0.000
403.gcc (max) (percentage) 11.78% 3.140 3.510 - 0.00% -
481.wrf (max) 8.33% 24.000 26.000 - 0.00% -
481.wrf (max) (percentage) 6.41% 0.780 0.830 - 0.00% -
481.wrf (avg) (percentage) 2.50% 0.800 0.820 - 0.00% -
453.povray (avg) (percentage) 1.43% 1.400 1.420 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -1.24% 1447.000 1429.000 - -23.95% -
400.perlbench -1.13% 1506.000 1489.000 - 1.02% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) -91.30% 1.840 0.160 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -91.11% 90.000 8.000 0.000 0.00% 0.000
456.hmmer (max) -89.66% 29.000 3.000 - 0.00% -
456.hmmer (max) (percentage) -89.62% 1.060 0.110 - 0.00% -
473.astar (max) -71.53% 281.000 80.000 - 0.00% -
473.astar (max) (percentage) -71.23% 5.770 1.660 - 0.00% -
450.soplex (max) -64.29% 42.000 15.000 - 0.00% -
450.soplex (max) (percentage) -64.17% 8.010 2.870 - 0.00% -
433.milc (max) -62.07% 29.000 11.000 - 0.00% -
433.milc (max) (percentage) -61.23% 2.760 1.070 - 0.00% -
471.omnetpp (max) -47.78% 180.000 94.000 - 0.00% -
471.omnetpp (max) (percentage) -47.14% 8.210 4.340 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -21.28% 0.470 0.370 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -20.00% 5.000 4.000 0.000 0.00% 0.000
434.zeusmp -20.00% 10.000 8.000 - 0.00% -
434.zeusmp (avg) -20.00% 10.000 8.000 - 0.00% -
447.dealII -15.79% 19.000 16.000 - 0.00% -
447.dealII (avg) -15.79% 19.000 16.000 - 0.00% -
447.dealII (avg) (percentage) -14.43% 2.010 1.720 - 0.00% -
482.sphinx3 -13.64% 22.000 19.000 - 0.00% -
482.sphinx3 (avg) -13.64% 22.000 19.000 - 0.00% -
434.zeusmp (avg) (percentage) -13.21% 0.530 0.460 - 0.00% -
482.sphinx3 (avg) (percentage) -11.18% 3.220 2.860 - 0.00% -
401.bzip2 -10.20% 98.000 88.000 - 0.00% -
401.bzip2 (avg) -10.20% 98.000 88.000 - 0.00% -
401.bzip2 (avg) (percentage) -9.47% 3.590 3.250 - 0.00% -
436.cactusADM -9.09% 11.000 10.000 - 0.00% -
436.cactusADM (avg) -9.09% 11.000 10.000 - 0.00% -
436.cactusADM (avg) (percentage) -8.79% 0.910 0.830 - 0.00% -
462.libquantum (max) (percentage) -8.61% 3.370 3.080 - 0.00% -
470.lbm (max) -8.33% 24.000 22.000 - 0.00% -
450.soplex (avg) (percentage) -8.09% 3.710 3.410 - 0.00% -
437.leslie3d (avg) (percentage) -7.94% 3.780 3.480 - 0.00% -
433.milc -7.69% 13.000 12.000 - 0.00% -
433.milc (avg) -7.69% 13.000 12.000 - 0.00% -
410.bwaves (avg) (percentage) -7.38% 1.220 1.130 - 0.00% -
471.omnetpp -6.90% 58.000 54.000 - 0.00% -
471.omnetpp (avg) -6.90% 58.000 54.000 - 0.00% -
473.astar (avg) (percentage) -6.79% 2.800 2.610 - 0.00% -
470.lbm (max) (percentage) -6.76% 0.740 0.690 - 0.00% -
437.leslie3d (max) (percentage) -6.68% 4.490 4.190 - 0.00% -
464.h264ref (avg) (percentage) -6.67% 1.500 1.400 - 0.00% -
473.astar -6.62% 136.000 127.000 - 0.00% -
473.astar (avg) -6.62% 136.000 127.000 - 0.00% -
456.hmmer (avg) (percentage) -6.45% 0.310 0.290 - 0.00% -
437.leslie3d -6.38% 235.000 220.000 - 0.00% -
437.leslie3d (avg) -6.38% 235.000 220.000 - 0.00% -
458.sjeng (avg) (percentage) -5.75% 0.870 0.820 - 0.00% -
429.mcf -5.71% 70.000 66.000 - 0.00% -
429.mcf (avg) -5.71% 70.000 66.000 - 0.00% -
471.omnetpp (avg) (percentage) -5.62% 2.670 2.520 - 0.00% -
462.libquantum (avg) (percentage) -5.56% 1.800 1.700 - 0.00% -
410.bwaves -5.56% 54.000 51.000 - 0.00% -
410.bwaves (avg) -5.56% 54.000 51.000 - 0.00% -
458.sjeng -5.56% 54.000 51.000 - 0.00% -
458.sjeng (avg) -5.56% 54.000 51.000 - 0.00% -
433.milc (avg) (percentage) -5.47% 1.280 1.210 - 0.00% -
464.h264ref -5.36% 56.000 53.000 - 0.00% -
464.h264ref (avg) -5.36% 56.000 53.000 - 0.00% -
450.soplex -5.26% 19.000 18.000 - 0.00% -
450.soplex (avg) -5.26% 19.000 18.000 - 0.00% -
437.leslie3d (max) -4.66% 279.000 266.000 - 0.00% -
416.gamess -4.55% 22.000 21.000 - 0.00% -
416.gamess (avg) -4.55% 22.000 21.000 - 0.00% -
470.lbm -4.55% 44.000 42.000 - 0.00% -
470.lbm (avg) -4.55% 44.000 42.000 - 0.00% -
447.dealII (max) -3.85% 26.000 25.000 - 0.00% -
470.lbm (avg) (percentage) -3.73% 1.340 1.290 - 0.00% -
429.mcf (avg) (percentage) -3.71% 4.850 4.670 - 0.00% -
445.gobmk (avg) (percentage) -3.43% 1.750 1.690 - 0.00% -
444.namd (avg) (percentage) -2.76% 1.450 1.410 - 0.00% -
458.sjeng (max) (percentage) -2.44% 2.050 2.000 - 0.00% -
458.sjeng (max) -2.33% 129.000 126.000 - 0.00% -
482.sphinx3 (max) -2.33% 43.000 42.000 - 0.00% -
464.h264ref (max) (percentage) -2.10% 4.290 4.200 - 0.00% -
482.sphinx3 (max) (percentage) -2.08% 6.240 6.110 - 0.00% -
444.namd (max) (percentage) -2.02% 1.980 1.940 - 0.00% -
410.bwaves (max) (percentage) -1.93% 6.210 6.090 - 0.00% -
453.povray (max) (percentage) -1.90% 2.100 2.060 - 0.00% -
447.dealII (max) (percentage) -1.86% 2.690 2.640 - 0.00% -
483.xalancbmk (max) (percentage) -1.71% 8.210 8.070 - 0.00% -
401.bzip2 (max) -1.69% 177.000 174.000 - 0.00% -
401.bzip2 (max) (percentage) -1.55% 6.470 6.370 - 0.00% -
410.bwaves (max) -1.43% 279.000 275.000 - 0.00% -
445.gobmk -1.27% 79.000 78.000 - 0.00% -
445.gobmk (avg) -1.27% 79.000 78.000 - 0.00% -
464.h264ref (max) -1.24% 161.000 159.000 - 0.00% -
429.mcf (max) -1.19% 84.000 83.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -1.12% 0.890 0.880 0.000 0.00% 0.000

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.43% 66682.000 68302.000 - 0.00% -
433.milc 1.74% 128200.000 130432.000 - 0.00% -
447.dealII 1.26% 548786.000 555682.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.88% 2510.000 2733.000 - -0.36% -
456.hmmer 5.61% 2637.000 2785.000 - -0.07% -
473.astar 5.17% 4638.000 4878.000 - -0.16% -
482.sphinx3 4.07% 664.000 691.000 - 0.00% -
470.lbm 2.69% 3235.000 3322.000 - 0.21% -
471.omnetpp 1.30% 2153.000 2181.000 - -0.91% -
433.milc 1.23% 1054.000 1067.000 - -0.37% -
444.namd 1.04% 672.000 679.000 - 0.89% -
400.perlbench 1.02% 1474.000 1489.000 - -1.13% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.00% 45013.000 38259.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.22% 168697.000 164956.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
450.soplex -1.40% 319083.000 314603.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -25.00% 108.000 81.000 - 0.00% -
429.mcf -23.95% 1879.000 1429.000 - -1.24% -
464.h264ref -4.19% 3965.000 3799.000 - 0.69% -
453.povray -2.85% 421.000 409.000 - 1.49% -
447.dealII -2.40% 1001.000 977.000 - -0.51% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1489.000 -1.13%
401.bzip2 2733.000 -
403.gcc 59.000 3.51%
410.bwaves 4518.000 -
416.gamess 15086.000 -
429.mcf 1429.000 -1.24%
433.milc 1067.000 -
434.zeusmp 1921.000 -
435.gromacs 4602.000 4.66%
436.cactusADM 1294.000 -
437.leslie3d 6349.000 2.06%
444.namd 679.000 -
445.gobmk 4622.000 1.25%
447.dealII 977.000 -
450.soplex 539.000 -
453.povray 409.000 1.49%
456.hmmer 2785.000 -
458.sjeng 6340.000 -
459.GemsFDTD 5379.000 -
462.libquantum 81.000 -
464.h264ref 3799.000 -
465.tonto 20359.000 -
470.lbm 3322.000 -
471.omnetpp 2181.000 -
473.astar 4878.000 -
481.wrf 3164.000 -
482.sphinx3 691.000 -
Geometric Mean 1936.697 -
Name Current %
400.perlbench 1257056.000 -
401.bzip2 68302.000 -
403.gcc 3783915.000 -
410.bwaves 630976.000 -
416.gamess 8287185.000 -
429.mcf 11448.000 -
433.milc 130432.000 -
434.zeusmp 1010803.000 -
435.gromacs 701664.000 -
436.cactusADM 1140382.000 -
437.leslie3d 941563.000 -
444.namd 164956.000 -
445.gobmk 2241992.000 -
447.dealII 555682.000 -
450.soplex 314603.000 -
453.povray 1125579.000 -
456.hmmer 163767.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1243006.000 -
462.libquantum 38259.000 -
464.h264ref 767333.000 -
465.tonto 9841492.000 -
470.lbm 10777.000 -
471.omnetpp 749727.000 -
473.astar 32444.000 -
481.wrf 6121814.000 -
482.sphinx3 175790.000 -
Geometric Mean 443931.994 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 88.000 -10.20%
401.bzip2 (avg) 88.000 -10.20%
401.bzip2 (avg) (percentage) 3.250 -9.47%
401.bzip2 (max) 174.000 -1.69%
401.bzip2 (max) (percentage) 6.370 -1.55%
401.bzip2 (unexplained diff vs previous) 10.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.370 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.620 27.80%
403.gcc (max) 2.000 100.00%
403.gcc (max) (percentage) 3.510 11.78%
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 3.390 -
410.bwaves 51.000 -5.56%
410.bwaves (avg) 51.000 -5.56%
410.bwaves (avg) (percentage) 1.130 -7.38%
410.bwaves (max) 275.000 -1.43%
410.bwaves (max) (percentage) 6.090 -1.93%
410.bwaves (unexplained diff vs previous) 15.000 15.38%
410.bwaves (unexplained diff vs previous) (percentage) 0.330 13.79%
416.gamess 21.000 -4.55%
416.gamess (avg) 21.000 -4.55%
416.gamess (avg) (percentage) 0.140 -
416.gamess (max) 22.000 -
416.gamess (max) (percentage) 0.150 -
416.gamess (unexplained diff vs previous) 20.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.130 -
429.mcf 66.000 -5.71%
429.mcf (avg) 66.000 -5.71%
429.mcf (avg) (percentage) 4.670 -3.71%
429.mcf (max) 83.000 -1.19%
429.mcf (max) (percentage) 5.840 -
429.mcf (unexplained diff vs previous) 18.000 80.00%
429.mcf (unexplained diff vs previous) (percentage) 1.260 82.61%
433.milc 12.000 -7.69%
433.milc (avg) 12.000 -7.69%
433.milc (avg) (percentage) 1.210 -5.47%
433.milc (max) 11.000 -62.07%
433.milc (max) (percentage) 1.070 -61.23%
433.milc (unexplained diff vs previous) 4.000 -20.00%
433.milc (unexplained diff vs previous) (percentage) 0.370 -21.28%
434.zeusmp 8.000 -20.00%
434.zeusmp (avg) 8.000 -20.00%
434.zeusmp (avg) (percentage) 0.460 -13.21%
434.zeusmp (max) 23.000 -
434.zeusmp (max) (percentage) 1.210 -
434.zeusmp (unexplained diff vs previous) 3.000 200.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 220.00%
435.gromacs 161.000 51.89%
435.gromacs (avg) 161.000 51.89%
435.gromacs (avg) (percentage) 3.520 45.45%
435.gromacs (max) 214.000 62.12%
435.gromacs (max) (percentage) 4.660 54.82%
435.gromacs (unexplained diff vs previous) 205.000 -
435.gromacs (unexplained diff vs previous) (percentage) 4.450 -
436.cactusADM 10.000 -9.09%
436.cactusADM (avg) 10.000 -9.09%
436.cactusADM (avg) (percentage) 0.830 -8.79%
436.cactusADM (max) 18.000 -
436.cactusADM (max) (percentage) 1.400 -
436.cactusADM (unexplained diff vs previous) 6.000 500.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.460 475.00%
437.leslie3d 220.000 -6.38%
437.leslie3d (avg) 220.000 -6.38%
437.leslie3d (avg) (percentage) 3.480 -7.94%
437.leslie3d (max) 266.000 -4.66%
437.leslie3d (max) (percentage) 4.190 -6.68%
437.leslie3d (unexplained diff vs previous) 128.000 28.00%
437.leslie3d (unexplained diff vs previous) (percentage) 2.020 25.47%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.410 -2.76%
444.namd (max) 13.000 -
444.namd (max) (percentage) 1.940 -2.02%
444.namd (unexplained diff vs previous) 6.000 -
444.namd (unexplained diff vs previous) (percentage) 0.880 -1.12%
445.gobmk 78.000 -1.27%
445.gobmk (avg) 78.000 -1.27%
445.gobmk (avg) (percentage) 1.690 -3.43%
445.gobmk (max) 189.000 -
445.gobmk (max) (percentage) 4.110 -
445.gobmk (unexplained diff vs previous) 57.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.230 -
447.dealII 16.000 -15.79%
447.dealII (avg) 16.000 -15.79%
447.dealII (avg) (percentage) 1.720 -14.43%
447.dealII (max) 25.000 -3.85%
447.dealII (max) (percentage) 2.640 -1.86%
447.dealII (unexplained diff vs previous) 5.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.510 -
450.soplex 18.000 -5.26%
450.soplex (avg) 18.000 -5.26%
450.soplex (avg) (percentage) 3.410 -8.09%
450.soplex (max) 15.000 -64.29%
450.soplex (max) (percentage) 2.870 -64.17%
450.soplex (unexplained diff vs previous) 3.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.560 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.420 1.43%
453.povray (max) 8.000 -
453.povray (max) (percentage) 2.060 -1.90%
453.povray (unexplained diff vs previous) 6.000 -
453.povray (unexplained diff vs previous) (percentage) 1.470 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.290 -6.45%
456.hmmer (max) 3.000 -89.66%
456.hmmer (max) (percentage) 0.110 -89.62%
456.hmmer (unexplained diff vs previous) 2.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.070 -
458.sjeng 51.000 -5.56%
458.sjeng (avg) 51.000 -5.56%
458.sjeng (avg) (percentage) 0.820 -5.75%
458.sjeng (max) 126.000 -2.33%
458.sjeng (max) (percentage) 2.000 -2.44%
458.sjeng (unexplained diff vs previous) 21.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.330 -
459.GemsFDTD 28.000 16.67%
459.GemsFDTD (avg) 28.000 16.67%
459.GemsFDTD (avg) (percentage) 0.530 15.22%
459.GemsFDTD (max) 53.000 -
459.GemsFDTD (max) (percentage) 1.000 -
459.GemsFDTD (unexplained diff vs previous) 38.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.710 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.700 -5.56%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 3.080 -8.61%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 53.000 -5.36%
464.h264ref (avg) 53.000 -5.36%
464.h264ref (avg) (percentage) 1.400 -6.67%
464.h264ref (max) 159.000 -1.24%
464.h264ref (max) (percentage) 4.200 -2.10%
464.h264ref (unexplained diff vs previous) 26.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.680 -
470.lbm 42.000 -4.55%
470.lbm (avg) 42.000 -4.55%
470.lbm (avg) (percentage) 1.290 -3.73%
470.lbm (max) 22.000 -8.33%
470.lbm (max) (percentage) 0.690 -6.76%
470.lbm (unexplained diff vs previous) 7.000 16.67%
470.lbm (unexplained diff vs previous) (percentage) 0.210 16.67%
471.omnetpp 54.000 -6.90%
471.omnetpp (avg) 54.000 -6.90%
471.omnetpp (avg) (percentage) 2.520 -5.62%
471.omnetpp (max) 94.000 -47.78%
471.omnetpp (max) (percentage) 4.340 -47.14%
471.omnetpp (unexplained diff vs previous) 20.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.920 -
473.astar 127.000 -6.62%
473.astar (avg) 127.000 -6.62%
473.astar (avg) (percentage) 2.610 -6.79%
473.astar (max) 80.000 -71.53%
473.astar (max) (percentage) 1.660 -71.23%
473.astar (unexplained diff vs previous) 8.000 -91.11%
473.astar (unexplained diff vs previous) (percentage) 0.160 -91.30%
481.wrf 25.000 -
481.wrf (avg) 25.000 -
481.wrf (avg) (percentage) 0.820 2.50%
481.wrf (max) 26.000 8.33%
481.wrf (max) (percentage) 0.830 6.41%
481.wrf (unexplained diff vs previous) 26.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.820 -
482.sphinx3 19.000 -13.64%
482.sphinx3 (avg) 19.000 -13.64%
482.sphinx3 (avg) (percentage) 2.860 -11.18%
482.sphinx3 (max) 42.000 -2.33%
482.sphinx3 (max) (percentage) 6.110 -2.08%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 8.070 -1.71%
Geometric Mean 4.390 -44.51%