Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/40c12648c6c0a39efce294e3fa763fd6c8ed4005 (+ 17 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/168/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0168 (llvmorg-19-init-16692-g40c12648c6c0) 2024-07-05T09:15:41 0:00:00
Previous 0166 (llvmorg-19-init-16675-gf90bac99e19d) 2024-07-03T20:57:05 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 102 7
Performance Improvements 48 22
Added Tests 22 171
Unchanged Tests 1004 976
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 32.40% 1395.000 1847.000 - -1.70% -
403.gcc 5.56% 54.000 57.000 - -3.39% -
436.cactusADM 1.77% 1301.000 1324.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 8940.00% 5.000 452.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 6697.22% 0.360 24.470 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 1944.74% 0.380 7.770 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 1800.00% 2.000 38.000 0.000 0.00% 0.000
458.sjeng (max) 1680.00% 5.000 89.000 - 0.00% -
458.sjeng (max) (percentage) 1511.11% 0.090 1.450 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 1095.24% 0.210 2.510 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 1075.00% 4.000 47.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) 666.67% 3.000 23.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 656.52% 0.230 1.740 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 454.76% 0.420 2.330 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 442.11% 19.000 103.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 372.73% 0.550 2.600 0.000 0.00% 0.000
436.cactusADM (max) 360.00% 5.000 23.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 358.33% 12.000 55.000 0.000 0.00% 0.000
464.h264ref (max) 340.00% 15.000 66.000 - 0.00% -
464.h264ref (max) (percentage) 326.19% 0.420 1.790 - 0.00% -
429.mcf (max) 304.05% 148.000 598.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 300.00% 0.750 3.000 0.000 0.00% 0.000
436.cactusADM (max) (percentage) 293.33% 0.450 1.770 - 0.00% -
470.lbm (unexplained diff vs previous) 288.00% 25.000 97.000 0.000 0.00% 0.000
470.lbm (max) (percentage) 282.89% 0.760 2.910 - 0.00% -
470.lbm (max) 276.00% 25.000 94.000 - 0.00% -
429.mcf (max) (percentage) 203.94% 10.660 32.400 - 0.00% -
416.gamess (max) (percentage) 197.30% 0.370 1.100 - 0.00% -
416.gamess (max) 193.18% 44.000 129.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 167.42% 0.890 2.380 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 162.50% 24.000 63.000 0.000 0.00% 0.000
435.gromacs (max) (percentage) 161.80% 2.670 6.990 - 0.00% -
445.gobmk (max) (percentage) 150.00% 0.700 1.750 - 0.00% -
435.gromacs (max) 143.97% 116.000 283.000 - 0.00% -
445.gobmk (max) 143.75% 32.000 78.000 - 0.00% -
401.bzip2 (max) (percentage) 137.76% 0.980 2.330 - 0.00% -
401.bzip2 (max) 134.62% 26.000 61.000 - 0.00% -
481.wrf (max) (percentage) 115.74% 2.350 5.070 - 0.00% -
434.zeusmp (max) (percentage) 105.04% 1.190 2.440 - 0.00% -
434.zeusmp (max) 104.55% 22.000 45.000 - 0.00% -
481.wrf (max) 104.05% 74.000 151.000 - 0.00% -
433.milc (max) (percentage) 82.96% 1.350 2.470 - 0.00% -
433.milc (max) 78.57% 14.000 25.000 - 0.00% -
473.astar (max) (percentage) 74.24% 2.640 4.600 - 0.00% -
447.dealII (max) (percentage) 73.75% 2.400 4.170 - 0.00% -
447.dealII (max) 66.67% 24.000 40.000 - 0.00% -
473.astar (max) 66.41% 128.000 213.000 - 0.00% -
429.mcf 64.71% 51.000 84.000 - 0.00% -
429.mcf (avg) 64.71% 51.000 84.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 59.63% 7.060 11.270 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 43.48% 483.000 693.000 0.000 0.00% 0.000
416.gamess 33.33% 21.000 28.000 - 0.00% -
416.gamess (avg) 33.33% 21.000 28.000 - 0.00% -
416.gamess (avg) (percentage) 33.33% 0.180 0.240 - 0.00% -
437.leslie3d (max) (percentage) 33.29% 7.600 10.130 - 0.00% -
450.soplex (max) (percentage) 28.29% 5.620 7.210 - 0.00% -
429.mcf (avg) (percentage) 23.66% 3.720 4.600 - 0.00% -
450.soplex (max) 20.69% 29.000 35.000 - 0.00% -
481.wrf (avg) (percentage) 20.16% 1.240 1.490 - 0.00% -
437.leslie3d (max) 19.85% 519.000 622.000 - 0.00% -
410.bwaves (max) (percentage) 14.57% 1.990 2.280 - 0.00% -
481.wrf 12.82% 39.000 44.000 - 0.00% -
481.wrf (avg) 12.82% 39.000 44.000 - 0.00% -
410.bwaves (max) 12.36% 89.000 100.000 - 0.00% -
435.gromacs (avg) (percentage) 11.95% 2.260 2.530 - 0.00% -
433.milc 11.11% 9.000 10.000 - 0.00% -
433.milc (avg) 11.11% 9.000 10.000 - 0.00% -
434.zeusmp (avg) (percentage) 10.53% 0.760 0.840 - 0.00% -
447.dealII (avg) (percentage) 9.79% 1.430 1.570 - 0.00% -
434.zeusmp 7.14% 14.000 15.000 - 0.00% -
434.zeusmp (avg) 7.14% 14.000 15.000 - 0.00% -
447.dealII 7.14% 14.000 15.000 - 0.00% -
447.dealII (avg) 7.14% 14.000 15.000 - 0.00% -
437.leslie3d (avg) (percentage) 7.04% 4.120 4.410 - 0.00% -
450.soplex (avg) (percentage) 6.76% 2.810 3.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 6.57% 1.370 1.460 - 0.00% -
473.astar (avg) (percentage) 6.40% 1.720 1.830 - 0.00% -
433.milc (avg) (percentage) 6.32% 0.950 1.010 - 0.00% -
458.sjeng (avg) (percentage) 6.25% 0.480 0.510 - 0.00% -
410.bwaves (avg) (percentage) 6.10% 0.820 0.870 - 0.00% -
470.lbm (avg) (percentage) 5.68% 0.880 0.930 - 0.00% -
464.h264ref (avg) (percentage) 4.76% 0.840 0.880 - 0.00% -
445.gobmk (avg) (percentage) 4.55% 0.880 0.920 - 0.00% -
456.hmmer (avg) (percentage) 4.17% 0.240 0.250 - 0.00% -
435.gromacs 4.08% 98.000 102.000 - 0.00% -
435.gromacs (avg) 4.08% 98.000 102.000 - 0.00% -
436.cactusADM (avg) (percentage) 3.45% 0.870 0.900 - 0.00% -
470.lbm 3.45% 29.000 30.000 - 0.00% -
470.lbm (avg) 3.45% 29.000 30.000 - 0.00% -
458.sjeng 3.33% 30.000 31.000 - 0.00% -
458.sjeng (avg) 3.33% 30.000 31.000 - 0.00% -
464.h264ref 3.23% 31.000 32.000 - 0.00% -
464.h264ref (avg) 3.23% 31.000 32.000 - 0.00% -
459.GemsFDTD 2.82% 71.000 73.000 - 0.00% -
459.GemsFDTD (avg) 2.82% 71.000 73.000 - 0.00% -
410.bwaves 2.70% 37.000 38.000 - 0.00% -
410.bwaves (avg) 2.70% 37.000 38.000 - 0.00% -
445.gobmk 2.50% 40.000 41.000 - 0.00% -
445.gobmk (avg) 2.50% 40.000 41.000 - 0.00% -
473.astar 2.41% 83.000 85.000 - 0.00% -
473.astar (avg) 2.41% 83.000 85.000 - 0.00% -
401.bzip2 (avg) (percentage) 1.84% 1.630 1.660 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -10.13% 6841.000 6148.000 - 0.00% -
450.soplex -7.21% 527.000 489.000 - -9.44% -
435.gromacs -6.99% 4363.000 4058.000 - 0.00% -
481.wrf -5.07% 3156.000 2996.000 - 0.00% -
473.astar -4.60% 4874.000 4650.000 - 0.26% -
447.dealII -4.17% 1006.000 964.000 - -3.70% -
482.sphinx3 -3.02% 695.000 674.000 - 1.51% -
459.GemsFDTD -3.00% 5204.000 5048.000 - 0.00% -
470.lbm -2.91% 3330.000 3233.000 - -0.06% -
462.libquantum -2.56% 78.000 76.000 - -29.63% -
471.omnetpp -2.53% 2174.000 2119.000 - -1.58% -
433.milc -2.47% 1051.000 1025.000 - -2.75% -
434.zeusmp -2.44% 1923.000 1876.000 - 0.00% -
401.bzip2 -2.33% 2708.000 2645.000 - 5.38% -
410.bwaves -2.28% 4519.000 4416.000 - 0.00% -
464.h264ref -1.79% 3803.000 3735.000 - -5.80% -
445.gobmk -1.75% 4574.000 4494.000 - -2.66% -
458.sjeng -1.45% 6286.000 6195.000 - -2.49% -
400.perlbench -1.43% 1536.000 1514.000 - 2.71% -
416.gamess -1.10% 11947.000 11816.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -50.00% 4.000 2.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -48.73% 5.130 2.630 0.000 0.00% 0.000
462.libquantum (max) (percentage) -11.35% 5.110 4.530 - 0.00% -
444.namd (max) -10.00% 10.000 9.000 - 0.00% -
482.sphinx3 (max) -10.00% 40.000 36.000 - 0.00% -
482.sphinx3 (max) (percentage) -8.86% 5.870 5.350 - 0.00% -
459.GemsFDTD (max) -7.93% 164.000 151.000 - 0.00% -
453.povray (max) (percentage) -7.14% 1.120 1.040 - 0.00% -
444.namd (max) (percentage) -5.37% 1.490 1.410 - 0.00% -
459.GemsFDTD (max) (percentage) -5.36% 3.170 3.000 - 0.00% -
471.omnetpp (max) -5.33% 75.000 71.000 - 0.00% -
482.sphinx3 -5.26% 19.000 18.000 - 0.00% -
482.sphinx3 (avg) -5.26% 19.000 18.000 - 0.00% -
400.perlbench -5.00% 20.000 19.000 - 0.00% -
400.perlbench (avg) -5.00% 20.000 19.000 - 0.00% -
437.leslie3d -3.56% 281.000 271.000 - 0.00% -
437.leslie3d (avg) -3.56% 281.000 271.000 - 0.00% -
453.povray (avg) (percentage) -3.54% 1.130 1.090 - 0.00% -
471.omnetpp -3.45% 58.000 56.000 - 0.00% -
471.omnetpp (avg) -3.45% 58.000 56.000 - 0.00% -
471.omnetpp (max) (percentage) -3.15% 3.490 3.380 - 0.00% -
444.namd (avg) (percentage) -3.06% 0.980 0.950 - 0.00% -
401.bzip2 -2.27% 44.000 43.000 - 0.00% -
401.bzip2 (avg) -2.27% 44.000 43.000 - 0.00% -
403.gcc (max) (percentage) -1.54% 8.430 8.300 - 0.00% -
465.tonto (max) -1.12% 179.000 177.000 - 0.00% -
465.tonto -1.03% 195.000 193.000 - 0.00% -
465.tonto (avg) -1.03% 195.000 193.000 - 0.00% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.12% 66682.000 68094.000 - 0.00% -
433.milc 1.57% 128200.000 130212.000 - 0.00% -
447.dealII 1.32% 548786.000 556022.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 5.73% 2637.000 2788.000 - -0.39% -
401.bzip2 5.38% 2510.000 2645.000 - -2.33% -
400.perlbench 2.71% 1474.000 1514.000 - -1.43% -
482.sphinx3 1.51% 664.000 674.000 - -3.02% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -14.82% 45013.000 38343.000 - 0.00% -
458.sjeng -2.22% 131729.000 128801.000 - 0.00% -
444.namd -2.22% 168697.000 164952.000 - 0.00% -
470.lbm -1.65% 10901.000 10721.000 - 0.00% -
471.omnetpp -1.63% 754667.000 742388.000 - 0.00% -
473.astar -1.55% 33048.000 32536.000 - 0.00% -
450.soplex -1.34% 319083.000 314807.000 - 0.00% -
400.perlbench -1.01% 1269683.000 1256852.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -29.63% 108.000 76.000 - -2.56% -
450.soplex -9.44% 540.000 489.000 - -7.21% -
464.h264ref -5.80% 3965.000 3735.000 - -1.79% -
453.povray -4.75% 421.000 401.000 - 0.25% -
447.dealII -3.70% 1001.000 964.000 - -4.17% -
403.gcc -3.39% 59.000 57.000 - 5.56% -
433.milc -2.75% 1054.000 1025.000 - -2.47% -
445.gobmk -2.66% 4617.000 4494.000 - -1.75% -
458.sjeng -2.49% 6353.000 6195.000 - -1.45% -
429.mcf -1.70% 1879.000 1847.000 - 32.40% -
471.omnetpp -1.58% 2153.000 2119.000 - -2.53% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1514.000 -1.43%
401.bzip2 2645.000 -2.33%
403.gcc 57.000 5.56%
410.bwaves 4416.000 -2.28%
416.gamess 11816.000 -1.10%
429.mcf 1847.000 32.40%
433.milc 1025.000 -2.47%
434.zeusmp 1876.000 -2.44%
435.gromacs 4058.000 -6.99%
436.cactusADM 1324.000 1.77%
437.leslie3d 6148.000 -10.13%
444.namd 671.000 -
445.gobmk 4494.000 -1.75%
447.dealII 964.000 -4.17%
450.soplex 489.000 -7.21%
453.povray 401.000 -
456.hmmer 2788.000 -
458.sjeng 6195.000 -1.45%
459.GemsFDTD 5048.000 -3.00%
462.libquantum 76.000 -2.56%
464.h264ref 3735.000 -1.79%
465.tonto 19989.000 -
470.lbm 3233.000 -2.91%
471.omnetpp 2119.000 -2.53%
473.astar 4650.000 -4.60%
481.wrf 2996.000 -5.07%
482.sphinx3 674.000 -3.02%
Geometric Mean 1880.264 -1.35%
Name Current %
400.perlbench 1256852.000 -
401.bzip2 68094.000 -
403.gcc 3787399.000 -
410.bwaves 657036.000 -
416.gamess 8283489.000 -
429.mcf 11448.000 -
433.milc 130212.000 -
434.zeusmp 1036783.000 -
435.gromacs 701856.000 -
436.cactusADM 1166478.000 -
437.leslie3d 953109.000 -
444.namd 164952.000 -
445.gobmk 2237340.000 -
447.dealII 556022.000 -
450.soplex 314807.000 -
453.povray 1125513.000 -
456.hmmer 163791.000 -
458.sjeng 128801.000 -
459.GemsFDTD 1247554.000 -
462.libquantum 38343.000 -
464.h264ref 768077.000 -
465.tonto 9821780.000 -
470.lbm 10721.000 -
471.omnetpp 742388.000 -
473.astar 32536.000 -
481.wrf 5870767.000 -
482.sphinx3 175830.000 -
Geometric Mean 444707.737 -
Name Current %
400.perlbench 19.000 -5.00%
400.perlbench (avg) 19.000 -5.00%
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 18.000 -
400.perlbench (max) (percentage) 1.210 -
401.bzip2 43.000 -2.27%
401.bzip2 (avg) 43.000 -2.27%
401.bzip2 (avg) (percentage) 1.660 1.84%
401.bzip2 (max) 61.000 134.62%
401.bzip2 (max) (percentage) 2.330 137.76%
401.bzip2 (unexplained diff vs previous) 63.000 162.50%
401.bzip2 (unexplained diff vs previous) (percentage) 2.380 167.42%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.150 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.300 -1.54%
410.bwaves 38.000 2.70%
410.bwaves (avg) 38.000 2.70%
410.bwaves (avg) (percentage) 0.870 6.10%
410.bwaves (max) 100.000 12.36%
410.bwaves (max) (percentage) 2.280 14.57%
410.bwaves (unexplained diff vs previous) 103.000 442.11%
410.bwaves (unexplained diff vs previous) (percentage) 2.330 454.76%
416.gamess 28.000 33.33%
416.gamess (avg) 28.000 33.33%
416.gamess (avg) (percentage) 0.240 33.33%
416.gamess (max) 129.000 193.18%
416.gamess (max) (percentage) 1.100 197.30%
416.gamess (unexplained diff vs previous) 131.000 -
416.gamess (unexplained diff vs previous) (percentage) 1.110 -
429.mcf 84.000 64.71%
429.mcf (avg) 84.000 64.71%
429.mcf (avg) (percentage) 4.600 23.66%
429.mcf (max) 598.000 304.05%
429.mcf (max) (percentage) 32.400 203.94%
429.mcf (unexplained diff vs previous) 452.000 8940.00%
429.mcf (unexplained diff vs previous) (percentage) 24.470 6697.22%
433.milc 10.000 11.11%
433.milc (avg) 10.000 11.11%
433.milc (avg) (percentage) 1.010 6.32%
433.milc (max) 25.000 78.57%
433.milc (max) (percentage) 2.470 82.96%
433.milc (unexplained diff vs previous) 26.000 -
433.milc (unexplained diff vs previous) (percentage) 2.540 -
434.zeusmp 15.000 7.14%
434.zeusmp (avg) 15.000 7.14%
434.zeusmp (avg) (percentage) 0.840 10.53%
434.zeusmp (max) 45.000 104.55%
434.zeusmp (max) (percentage) 2.440 105.04%
434.zeusmp (unexplained diff vs previous) 47.000 1075.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.510 1095.24%
435.gromacs 102.000 4.08%
435.gromacs (avg) 102.000 4.08%
435.gromacs (avg) (percentage) 2.530 11.95%
435.gromacs (max) 283.000 143.97%
435.gromacs (max) (percentage) 6.990 161.80%
435.gromacs (unexplained diff vs previous) 305.000 -
435.gromacs (unexplained diff vs previous) (percentage) 7.520 -
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.900 3.45%
436.cactusADM (max) 23.000 360.00%
436.cactusADM (max) (percentage) 1.770 293.33%
436.cactusADM (unexplained diff vs previous) 23.000 666.67%
436.cactusADM (unexplained diff vs previous) (percentage) 1.740 656.52%
437.leslie3d 271.000 -3.56%
437.leslie3d (avg) 271.000 -3.56%
437.leslie3d (avg) (percentage) 4.410 7.04%
437.leslie3d (max) 622.000 19.85%
437.leslie3d (max) (percentage) 10.130 33.29%
437.leslie3d (unexplained diff vs previous) 693.000 43.48%
437.leslie3d (unexplained diff vs previous) (percentage) 11.270 59.63%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 -3.06%
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.410 -5.37%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.150 -
445.gobmk 41.000 2.50%
445.gobmk (avg) 41.000 2.50%
445.gobmk (avg) (percentage) 0.920 4.55%
445.gobmk (max) 78.000 143.75%
445.gobmk (max) (percentage) 1.750 150.00%
445.gobmk (unexplained diff vs previous) 80.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.780 -
447.dealII 15.000 7.14%
447.dealII (avg) 15.000 7.14%
447.dealII (avg) (percentage) 1.570 9.79%
447.dealII (max) 40.000 66.67%
447.dealII (max) (percentage) 4.170 73.75%
447.dealII (unexplained diff vs previous) 42.000 -
447.dealII (unexplained diff vs previous) (percentage) 4.360 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 3.000 6.76%
450.soplex (max) 35.000 20.69%
450.soplex (max) (percentage) 7.210 28.29%
450.soplex (unexplained diff vs previous) 38.000 1800.00%
450.soplex (unexplained diff vs previous) (percentage) 7.770 1944.74%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.090 -3.54%
453.povray (max) 4.000 -
453.povray (max) (percentage) 1.040 -7.14%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.250 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.250 4.17%
456.hmmer (max) 10.000 -
456.hmmer (max) (percentage) 0.390 -
456.hmmer (unexplained diff vs previous) 11.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.390 -
458.sjeng 31.000 3.33%
458.sjeng (avg) 31.000 3.33%
458.sjeng (avg) (percentage) 0.510 6.25%
458.sjeng (max) 89.000 1680.00%
458.sjeng (max) (percentage) 1.450 1511.11%
458.sjeng (unexplained diff vs previous) 91.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.470 -
459.GemsFDTD 73.000 2.82%
459.GemsFDTD (avg) 73.000 2.82%
459.GemsFDTD (avg) (percentage) 1.460 6.57%
459.GemsFDTD (max) 151.000 -7.93%
459.GemsFDTD (max) (percentage) 3.000 -5.36%
459.GemsFDTD (unexplained diff vs previous) 156.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.090 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.060 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.530 -11.35%
462.libquantum (unexplained diff vs previous) 2.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.630 -48.73%
464.h264ref 32.000 3.23%
464.h264ref (avg) 32.000 3.23%
464.h264ref (avg) (percentage) 0.880 4.76%
464.h264ref (max) 66.000 340.00%
464.h264ref (max) (percentage) 1.790 326.19%
464.h264ref (unexplained diff vs previous) 68.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.820 -
465.tonto 193.000 -1.03%
465.tonto (avg) 193.000 -1.03%
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 177.000 -1.12%
465.tonto (max) (percentage) 0.890 -
470.lbm 30.000 3.45%
470.lbm (avg) 30.000 3.45%
470.lbm (avg) (percentage) 0.930 5.68%
470.lbm (max) 94.000 276.00%
470.lbm (max) (percentage) 2.910 282.89%
470.lbm (unexplained diff vs previous) 97.000 288.00%
470.lbm (unexplained diff vs previous) (percentage) 3.000 300.00%
471.omnetpp 56.000 -3.45%
471.omnetpp (avg) 56.000 -3.45%
471.omnetpp (avg) (percentage) 2.680 -
471.omnetpp (max) 71.000 -5.33%
471.omnetpp (max) (percentage) 3.380 -3.15%
471.omnetpp (unexplained diff vs previous) 55.000 358.33%
471.omnetpp (unexplained diff vs previous) (percentage) 2.600 372.73%
473.astar 85.000 2.41%
473.astar (avg) 85.000 2.41%
473.astar (avg) (percentage) 1.830 6.40%
473.astar (max) 213.000 66.41%
473.astar (max) (percentage) 4.600 74.24%
473.astar (unexplained diff vs previous) 224.000 -
473.astar (unexplained diff vs previous) (percentage) 4.820 -
481.wrf 44.000 12.82%
481.wrf (avg) 44.000 12.82%
481.wrf (avg) (percentage) 1.490 20.16%
481.wrf (max) 151.000 104.05%
481.wrf (max) (percentage) 5.070 115.74%
481.wrf (unexplained diff vs previous) 160.000 -
481.wrf (unexplained diff vs previous) (percentage) 5.340 -
482.sphinx3 18.000 -5.26%
482.sphinx3 (avg) 18.000 -5.26%
482.sphinx3 (avg) (percentage) 2.780 -
482.sphinx3 (max) 36.000 -10.00%
482.sphinx3 (max) (percentage) 5.350 -8.86%
482.sphinx3 (unexplained diff vs previous) 21.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 3.120 -
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.380 -
Geometric Mean 10.271 79.93%