Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3db1f3110e714ad24f7d72114b3a2c14f6c63651 (+ 1 commits)
regression LLVM-1224
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/138/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0138 (llvmorg-19-init-12798-g3db1f3110e71) 2024-05-28T10:41:42 0:00:00
Previous 0137 (llvmorg-19-init-12797-g17940465364e) 2024-05-26T17:17:53 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 39 10
Performance Improvements 85 18
Added Tests 24 163
Unchanged Tests 992 949
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.68% 1430.000 1454.000 - -22.62% -
400.perlbench 1.66% 1508.000 1533.000 - 4.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) (percentage) 300.00% 0.150 0.600 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 285.71% 7.000 27.000 0.000 0.00% 0.000
450.soplex (max) 225.00% 4.000 13.000 - 0.00% -
450.soplex (max) (percentage) 185.56% 0.900 2.570 - 0.00% -
464.h264ref (max) (percentage) 153.33% 0.600 1.520 - 0.00% -
464.h264ref (max) 152.17% 23.000 58.000 - 0.00% -
434.zeusmp (max) 125.00% 4.000 9.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 104.35% 0.460 0.940 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 101.69% 0.590 1.190 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 100.00% 5.000 10.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 100.00% 4.000 8.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 100.00% 6.000 12.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 100.00% 0.180 0.360 0.000 0.00% 0.000
444.namd (max) (percentage) 98.31% 0.590 1.170 - 0.00% -
433.milc (max) (percentage) 89.80% 0.490 0.930 - 0.00% -
429.mcf (unexplained diff vs previous) 84.62% 13.000 24.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 81.32% 0.910 1.650 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 80.77% 0.260 0.470 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 80.77% 0.260 0.470 0.000 0.00% 0.000
433.milc (max) 80.00% 5.000 9.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 80.00% 5.000 9.000 0.000 0.00% 0.000
444.namd (max) 75.00% 4.000 7.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 25.00% 4.000 5.000 0.000 0.00% 0.000
410.bwaves (max) 22.73% 22.000 27.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 22.58% 0.310 0.380 0.000 0.00% 0.000
429.mcf (max) 20.00% 20.000 24.000 - 0.00% -
410.bwaves (max) (percentage) 20.00% 0.500 0.600 - 0.00% -
429.mcf (max) (percentage) 15.86% 1.450 1.680 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 13.75% 0.800 0.910 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) 12.50% 8.000 9.000 0.000 0.00% 0.000
437.leslie3d (avg) (percentage) 10.44% 3.640 4.020 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 6.89% 7.840 8.380 0.000 0.00% 0.000
464.h264ref (avg) (percentage) 3.57% 1.120 1.160 - 0.00% -
464.h264ref 2.33% 43.000 44.000 - 0.00% -
464.h264ref (avg) 2.33% 43.000 44.000 - 0.00% -
437.leslie3d 1.93% 259.000 264.000 - 0.00% -
437.leslie3d (avg) 1.93% 259.000 264.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.73% 7130.000 6579.000 - 0.00% -
450.soplex -2.57% 544.000 530.000 - -1.85% -
482.sphinx3 -1.93% 726.000 712.000 - 7.23% -
403.gcc -1.82% 55.000 54.000 - -8.47% -
464.h264ref -1.52% 3886.000 3827.000 - -3.48% -
471.omnetpp -1.50% 2205.000 2172.000 - 0.88% -
462.libquantum -1.22% 82.000 81.000 - -25.00% -
444.namd -1.17% 683.000 675.000 - 0.45% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) (percentage) -78.24% 4.090 0.890 - 0.00% -
401.bzip2 (max) -78.18% 110.000 24.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -54.05% 0.370 0.170 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -52.63% 19.000 9.000 0.000 0.00% 0.000
403.gcc -50.00% 2.000 1.000 - 0.00% -
403.gcc (avg) -50.00% 2.000 1.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -48.15% 27.000 14.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -47.04% 3.720 1.970 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -32.14% 28.000 19.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -32.04% 1.030 0.700 0.000 0.00% 0.000
482.sphinx3 (max) -20.00% 30.000 24.000 - 0.00% -
482.sphinx3 (max) (percentage) -18.94% 4.170 3.380 - 0.00% -
471.omnetpp (max) -17.06% 170.000 141.000 - 0.00% -
471.omnetpp (max) (percentage) -15.69% 7.710 6.500 - 0.00% -
437.leslie3d (max) -15.35% 606.000 513.000 - 0.00% -
403.gcc (max) (percentage) -13.33% 6.600 5.720 - 0.00% -
473.astar (max) -12.73% 55.000 48.000 - 0.00% -
435.gromacs -12.38% 105.000 92.000 - 0.00% -
435.gromacs (avg) -12.38% 105.000 92.000 - 0.00% -
445.gobmk (max) -11.63% 43.000 38.000 - 0.00% -
435.gromacs (avg) (percentage) -11.34% 2.380 2.110 - 0.00% -
436.cactusADM (max) (percentage) -11.11% 0.990 0.880 - 0.00% -
473.astar (max) (percentage) -10.71% 1.120 1.000 - 0.00% -
445.gobmk (max) (percentage) -10.64% 0.940 0.840 - 0.00% -
473.astar (unexplained diff vs previous) -9.76% 41.000 37.000 0.000 0.00% 0.000
459.GemsFDTD (avg) (percentage) -9.38% 0.640 0.580 - 0.00% -
459.GemsFDTD -9.09% 33.000 30.000 - 0.00% -
459.GemsFDTD (avg) -9.09% 33.000 30.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -8.43% 0.830 0.760 0.000 0.00% 0.000
437.leslie3d (max) (percentage) -8.34% 8.510 7.800 - 0.00% -
436.cactusADM (max) -8.33% 12.000 11.000 - 0.00% -
470.lbm (max) (percentage) -7.94% 0.630 0.580 - 0.00% -
416.gamess (max) -7.41% 27.000 25.000 - 0.00% -
403.gcc (avg) (percentage) -7.32% 3.690 3.420 - 0.00% -
445.gobmk -7.27% 55.000 51.000 - 0.00% -
445.gobmk (avg) -7.27% 55.000 51.000 - 0.00% -
445.gobmk (avg) (percentage) -6.67% 1.200 1.120 - 0.00% -
453.povray (avg) (percentage) -6.48% 1.080 1.010 - 0.00% -
456.hmmer (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
481.wrf -6.45% 31.000 29.000 - 0.00% -
481.wrf (avg) -6.45% 31.000 29.000 - 0.00% -
458.sjeng -5.71% 35.000 33.000 - 0.00% -
458.sjeng (avg) -5.71% 35.000 33.000 - 0.00% -
459.GemsFDTD (max) -5.45% 55.000 52.000 - 0.00% -
458.sjeng (avg) (percentage) -5.36% 0.560 0.530 - 0.00% -
401.bzip2 -5.00% 60.000 57.000 - 0.00% -
401.bzip2 (avg) -5.00% 60.000 57.000 - 0.00% -
470.lbm (max) -5.00% 20.000 19.000 - 0.00% -
471.omnetpp -5.00% 60.000 57.000 - 0.00% -
471.omnetpp (avg) -5.00% 60.000 57.000 - 0.00% -
459.GemsFDTD (max) (percentage) -4.72% 1.060 1.010 - 0.00% -
401.bzip2 (avg) (percentage) -4.50% 2.220 2.120 - 0.00% -
436.cactusADM (avg) (percentage) -4.49% 0.890 0.850 - 0.00% -
458.sjeng (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
481.wrf (avg) (percentage) -4.04% 0.990 0.950 - 0.00% -
462.libquantum (max) (percentage) -3.85% 2.340 2.250 - 0.00% -
471.omnetpp (avg) (percentage) -3.26% 2.760 2.670 - 0.00% -
473.astar -3.19% 94.000 91.000 - 0.00% -
473.astar (avg) -3.19% 94.000 91.000 - 0.00% -
473.astar (avg) (percentage) -3.11% 1.930 1.870 - 0.00% -
410.bwaves -2.94% 34.000 33.000 - 0.00% -
410.bwaves (avg) -2.94% 34.000 33.000 - 0.00% -
470.lbm -2.78% 36.000 35.000 - 0.00% -
470.lbm (avg) -2.78% 36.000 35.000 - 0.00% -
453.povray (max) (percentage) -2.75% 1.090 1.060 - 0.00% -
470.lbm (avg) (percentage) -2.75% 1.090 1.060 - 0.00% -
447.dealII (avg) (percentage) -2.50% 1.200 1.170 - 0.00% -
482.sphinx3 (avg) (percentage) -2.31% 2.600 2.540 - 0.00% -
429.mcf (avg) (percentage) -2.19% 3.660 3.580 - 0.00% -
434.zeusmp (avg) (percentage) -1.92% 0.520 0.510 - 0.00% -
435.gromacs (max) -1.56% 192.000 189.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -1.43% 559.000 551.000 0.000 0.00% 0.000
447.dealII (max) (percentage) -1.43% 1.400 1.380 - 0.00% -
410.bwaves (avg) (percentage) -1.32% 0.760 0.750 - 0.00% -
462.libquantum (avg) (percentage) -1.20% 1.660 1.640 - 0.00% -
483.xalancbmk (max) (percentage) -1.09% 7.330 7.250 - 0.00% -
433.milc (avg) (percentage) -1.03% 0.970 0.960 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.73% 128200.000 130424.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.69% 2510.000 2728.000 - 0.70% -
482.sphinx3 7.23% 664.000 712.000 - -1.93% -
456.hmmer 5.61% 2637.000 2785.000 - -0.21% -
473.astar 5.20% 4638.000 4879.000 - -0.75% -
400.perlbench 4.00% 1474.000 1533.000 - 1.66% -
470.lbm 2.66% 3235.000 3321.000 - 0.36% -
433.milc 1.33% 1054.000 1068.000 - -0.93% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.02% 45013.000 38251.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.12% 168697.000 165116.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
471.omnetpp -1.64% 754667.000 742320.000 - 0.00% -
450.soplex -1.42% 319083.000 314543.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.03% 1269683.000 1256624.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -25.00% 108.000 81.000 - -1.22% -
429.mcf -22.62% 1879.000 1454.000 - 1.68% -
403.gcc -8.47% 59.000 54.000 - -1.82% -
464.h264ref -3.48% 3965.000 3827.000 - -1.52% -
453.povray -2.61% 421.000 410.000 - -0.49% -
450.soplex -1.85% 540.000 530.000 - -2.57% -
447.dealII -1.10% 1001.000 990.000 - -0.90% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1533.000 1.66%
401.bzip2 2728.000 -
403.gcc 54.000 -1.82%
410.bwaves 4501.000 -
416.gamess 15160.000 -
429.mcf 1454.000 1.68%
433.milc 1068.000 -
434.zeusmp 1918.000 -
435.gromacs 4400.000 -
436.cactusADM 1306.000 -
437.leslie3d 6579.000 -7.73%
444.namd 675.000 -1.17%
445.gobmk 4581.000 -
447.dealII 990.000 -
450.soplex 530.000 -2.57%
453.povray 410.000 -
456.hmmer 2785.000 -
458.sjeng 6370.000 -
459.GemsFDTD 5187.000 -
462.libquantum 81.000 -1.22%
464.h264ref 3827.000 -1.52%
465.tonto 20256.000 -
470.lbm 3321.000 -
471.omnetpp 2172.000 -1.50%
473.astar 4879.000 -
481.wrf 3150.000 -
482.sphinx3 712.000 -1.93%
Geometric Mean 1931.856 -
Name Current %
400.perlbench 1256624.000 -
401.bzip2 68318.000 -
403.gcc 3788143.000 -
410.bwaves 631632.000 -
416.gamess 8288113.000 -
429.mcf 11448.000 -
433.milc 130424.000 -
434.zeusmp 1011455.000 -
435.gromacs 701836.000 -
436.cactusADM 1140922.000 -
437.leslie3d 944113.000 -
444.namd 165116.000 -
445.gobmk 2238948.000 -
447.dealII 556182.000 -
450.soplex 314543.000 -
453.povray 1125697.000 -
456.hmmer 163763.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1243674.000 -
462.libquantum 38251.000 -
464.h264ref 768049.000 -
465.tonto 9844834.000 -
470.lbm 10777.000 -
471.omnetpp 742320.000 -
473.astar 32444.000 -
481.wrf 6124406.000 -
482.sphinx3 175838.000 -
Geometric Mean 443914.447 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 57.000 -5.00%
401.bzip2 (avg) 57.000 -5.00%
401.bzip2 (avg) (percentage) 2.120 -4.50%
401.bzip2 (max) 24.000 -78.18%
401.bzip2 (max) (percentage) 0.890 -78.24%
401.bzip2 (unexplained diff vs previous) 19.000 -32.14%
401.bzip2 (unexplained diff vs previous) (percentage) 0.700 -32.04%
403.gcc 1.000 -50.00%
403.gcc (avg) 1.000 -50.00%
403.gcc (avg) (percentage) 3.420 -7.32%
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.720 -13.33%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.850 -
410.bwaves 33.000 -2.94%
410.bwaves (avg) 33.000 -2.94%
410.bwaves (avg) (percentage) 0.750 -1.32%
410.bwaves (max) 27.000 22.73%
410.bwaves (max) (percentage) 0.600 20.00%
410.bwaves (unexplained diff vs previous) 27.000 285.71%
410.bwaves (unexplained diff vs previous) (percentage) 0.600 300.00%
416.gamess 18.000 -
416.gamess (avg) 18.000 -
416.gamess (avg) (percentage) 0.120 -
416.gamess (max) 25.000 -7.41%
416.gamess (max) (percentage) 0.170 -
416.gamess (unexplained diff vs previous) 22.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.150 -
429.mcf 52.000 -
429.mcf (avg) 52.000 -
429.mcf (avg) (percentage) 3.580 -2.19%
429.mcf (max) 24.000 20.00%
429.mcf (max) (percentage) 1.680 15.86%
429.mcf (unexplained diff vs previous) 24.000 84.62%
429.mcf (unexplained diff vs previous) (percentage) 1.650 81.32%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.960 -1.03%
433.milc (max) 9.000 80.00%
433.milc (max) (percentage) 0.930 89.80%
433.milc (unexplained diff vs previous) 10.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.940 104.35%
434.zeusmp 9.000 -
434.zeusmp (avg) 9.000 -
434.zeusmp (avg) (percentage) 0.510 -1.92%
434.zeusmp (max) 9.000 125.00%
434.zeusmp (max) (percentage) 0.470 80.77%
434.zeusmp (unexplained diff vs previous) 9.000 80.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.470 80.77%
435.gromacs 92.000 -12.38%
435.gromacs (avg) 92.000 -12.38%
435.gromacs (avg) (percentage) 2.110 -11.34%
435.gromacs (max) 189.000 -1.56%
435.gromacs (max) (percentage) 4.310 -
435.gromacs (unexplained diff vs previous) 29.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.660 -
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.850 -4.49%
436.cactusADM (max) 11.000 -8.33%
436.cactusADM (max) (percentage) 0.880 -11.11%
436.cactusADM (unexplained diff vs previous) 5.000 25.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.380 22.58%
437.leslie3d 264.000 1.93%
437.leslie3d (avg) 264.000 1.93%
437.leslie3d (avg) (percentage) 4.020 10.44%
437.leslie3d (max) 513.000 -15.35%
437.leslie3d (max) (percentage) 7.800 -8.34%
437.leslie3d (unexplained diff vs previous) 551.000 -1.43%
437.leslie3d (unexplained diff vs previous) (percentage) 8.380 6.89%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.120 -
444.namd (max) 7.000 75.00%
444.namd (max) (percentage) 1.170 98.31%
444.namd (unexplained diff vs previous) 8.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 1.190 101.69%
445.gobmk 51.000 -7.27%
445.gobmk (avg) 51.000 -7.27%
445.gobmk (avg) (percentage) 1.120 -6.67%
445.gobmk (max) 38.000 -11.63%
445.gobmk (max) (percentage) 0.840 -10.64%
445.gobmk (unexplained diff vs previous) 11.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 1.170 -2.50%
447.dealII (max) 13.000 -
447.dealII (max) (percentage) 1.380 -1.43%
447.dealII (unexplained diff vs previous) 9.000 12.50%
447.dealII (unexplained diff vs previous) (percentage) 0.910 13.75%
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.530 -
450.soplex (max) 13.000 225.00%
450.soplex (max) (percentage) 2.570 185.56%
450.soplex (unexplained diff vs previous) 14.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.640 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.010 -6.48%
453.povray (max) 4.000 -
453.povray (max) (percentage) 1.060 -2.75%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.490 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.270 -
456.hmmer (max) 8.000 -
456.hmmer (max) (percentage) 0.290 -6.45%
456.hmmer (unexplained diff vs previous) 6.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.220 -
458.sjeng 33.000 -5.71%
458.sjeng (avg) 33.000 -5.71%
458.sjeng (avg) (percentage) 0.530 -5.36%
458.sjeng (max) 14.000 -
458.sjeng (max) (percentage) 0.220 -4.35%
458.sjeng (unexplained diff vs previous) 3.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.050 -
459.GemsFDTD 30.000 -9.09%
459.GemsFDTD (avg) 30.000 -9.09%
459.GemsFDTD (avg) (percentage) 0.580 -9.38%
459.GemsFDTD (max) 52.000 -5.45%
459.GemsFDTD (max) (percentage) 1.010 -4.72%
459.GemsFDTD (unexplained diff vs previous) 9.000 -52.63%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.170 -54.05%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.640 -1.20%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 2.250 -3.85%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.230 -
464.h264ref 44.000 2.33%
464.h264ref (avg) 44.000 2.33%
464.h264ref (avg) (percentage) 1.160 3.57%
464.h264ref (max) 58.000 152.17%
464.h264ref (max) (percentage) 1.520 153.33%
464.h264ref (unexplained diff vs previous) 59.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.540 -
470.lbm 35.000 -2.78%
470.lbm (avg) 35.000 -2.78%
470.lbm (avg) (percentage) 1.060 -2.75%
470.lbm (max) 19.000 -5.00%
470.lbm (max) (percentage) 0.580 -7.94%
470.lbm (unexplained diff vs previous) 12.000 100.00%
470.lbm (unexplained diff vs previous) (percentage) 0.360 100.00%
471.omnetpp 57.000 -5.00%
471.omnetpp (avg) 57.000 -5.00%
471.omnetpp (avg) (percentage) 2.670 -3.26%
471.omnetpp (max) 141.000 -17.06%
471.omnetpp (max) (percentage) 6.500 -15.69%
471.omnetpp (unexplained diff vs previous) 33.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.520 -
473.astar 91.000 -3.19%
473.astar (avg) 91.000 -3.19%
473.astar (avg) (percentage) 1.870 -3.11%
473.astar (max) 48.000 -12.73%
473.astar (max) (percentage) 1.000 -10.71%
473.astar (unexplained diff vs previous) 37.000 -9.76%
473.astar (unexplained diff vs previous) (percentage) 0.760 -8.43%
481.wrf 29.000 -6.45%
481.wrf (avg) 29.000 -6.45%
481.wrf (avg) (percentage) 0.950 -4.04%
481.wrf (max) 47.000 -
481.wrf (max) (percentage) 1.500 -
481.wrf (unexplained diff vs previous) 25.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.790 -
482.sphinx3 18.000 -
482.sphinx3 (avg) 18.000 -
482.sphinx3 (avg) (percentage) 2.540 -2.31%
482.sphinx3 (max) 24.000 -20.00%
482.sphinx3 (max) (percentage) 3.380 -18.94%
482.sphinx3 (unexplained diff vs previous) 14.000 -48.15%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.970 -47.04%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 7.250 -1.09%
Geometric Mean 4.605 -16.37%