Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8c0341df029d7eb8e60d1e4f49edd3e4af1b1e11 (+ 1 commits)
regression LLVM-1205
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/160/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0160 (llvmorg-19-init-08966-g8c0341df029d) 2024-04-20T16:10:20 0:00:00
Previous 0159 (llvmorg-19-init-08965-ge095d978ba47) 2024-04-19T19:46:53 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 47 8
Performance Improvements 83 17
Added Tests 13 159
Unchanged Tests 997 956
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk 1.69% 3541.000 3601.000 - 0.81% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 358.14% 0.430 1.970 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 350.00% 6.000 27.000 0.000 0.00% 0.000
429.mcf (max) (percentage) 348.84% 0.430 1.930 - 0.00% -
429.mcf (max) 333.33% 6.000 26.000 - 0.00% -
410.bwaves (unexplained diff vs previous) 316.67% 6.000 25.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 307.69% 0.130 0.530 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 233.33% 3.000 10.000 0.000 0.00% 0.000
483.xalancbmk (unexplained diff vs previous) 215.79% 19.000 60.000 0.000 0.00% 0.000
483.xalancbmk (unexplained diff vs previous) (percentage) 209.26% 0.540 1.670 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 207.69% 1.690 5.200 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 200.00% 0.150 0.450 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 200.00% 6.000 18.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 200.00% 0.050 0.150 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 192.86% 112.000 328.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 191.30% 0.230 0.670 0.000 0.00% 0.000
483.xalancbmk (max) 150.00% 24.000 60.000 - 0.00% -
483.xalancbmk (max) (percentage) 141.43% 0.700 1.690 - 0.00% -
445.gobmk (max) 130.00% 20.000 46.000 - 0.00% -
445.gobmk (unexplained diff vs previous) 119.05% 21.000 46.000 0.000 0.00% 0.000
445.gobmk (max) (percentage) 118.60% 0.430 0.940 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 118.60% 0.430 0.940 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 95.65% 0.230 0.450 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 91.67% 12.000 23.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 64.09% 2.200 3.610 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 58.33% 12.000 19.000 0.000 0.00% 0.000
450.soplex (max) (percentage) 54.67% 2.250 3.480 - 0.00% -
450.soplex (max) 50.00% 12.000 18.000 - 0.00% -
459.GemsFDTD (max) (percentage) 41.94% 0.310 0.440 - 0.00% -
459.GemsFDTD (max) 37.50% 16.000 22.000 - 0.00% -
403.gcc (max) (percentage) 9.45% 8.990 9.840 - 0.00% -
400.perlbench 9.09% 11.000 12.000 - 0.00% -
400.perlbench (avg) 9.09% 11.000 12.000 - 0.00% -
403.gcc (avg) (percentage) 8.36% 5.620 6.090 - 0.00% -
470.lbm (max) 6.25% 16.000 17.000 - 0.00% -
416.gamess (avg) (percentage) 3.33% 0.300 0.310 - 0.00% -
416.gamess 3.12% 32.000 33.000 - 0.00% -
416.gamess (avg) 3.12% 32.000 33.000 - 0.00% -
470.lbm (max) (percentage) 1.96% 0.510 0.520 - 0.00% -
483.xalancbmk 1.67% 60.000 61.000 - 0.00% -
483.xalancbmk (avg) 1.67% 60.000 61.000 - 0.00% -
437.leslie3d (max) (percentage) 1.64% 4.870 4.950 - 0.00% -
453.povray (avg) (percentage) 1.39% 1.440 1.460 - 0.00% -
450.soplex (avg) (percentage) 1.16% 2.590 2.620 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.85% 52.000 50.000 - 163.16% -
nb_execution_successful -3.85% 52.000 50.000 - 163.16% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -9.84% 61.000 55.000 - -14.06% -
437.leslie3d -4.95% 6631.000 6303.000 - 0.00% -
450.soplex -3.48% 546.000 527.000 - -1.68% -
447.dealII -2.40% 1293.000 1262.000 - 3.44% -
429.mcf -1.93% 1400.000 1373.000 - -27.96% -
453.povray -1.82% 440.000 432.000 - -7.10% -
462.libquantum -1.22% 82.000 81.000 - -23.58% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -97.50% 40.000 1.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -97.17% 1.060 0.030 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -77.78% 18.000 4.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -77.14% 0.700 0.160 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -62.50% 8.000 3.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -62.12% 0.660 0.250 0.000 0.00% 0.000
456.hmmer (max) (percentage) -34.78% 0.230 0.150 - 0.00% -
456.hmmer (max) -33.33% 6.000 4.000 - 0.00% -
433.milc (max) -25.00% 8.000 6.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -23.81% 21.000 16.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -23.15% 1.080 0.830 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -22.50% 40.000 31.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -20.39% 3.090 2.460 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -20.00% 10.000 8.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) -20.00% 5.000 4.000 0.000 0.00% 0.000
434.zeusmp (max) -19.05% 21.000 17.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -18.50% 2.270 1.850 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -16.67% 0.180 0.150 0.000 0.00% 0.000
434.zeusmp (max) (percentage) -16.51% 1.090 0.910 - 0.00% -
433.milc (max) (percentage) -16.42% 0.670 0.560 - 0.00% -
444.namd (max) -14.29% 7.000 6.000 - 0.00% -
410.bwaves (max) -12.12% 33.000 29.000 - 0.00% -
447.dealII (max) -11.63% 43.000 38.000 - 0.00% -
447.dealII (max) (percentage) -10.32% 3.390 3.040 - 0.00% -
453.povray (max) -10.00% 10.000 9.000 - 0.00% -
410.bwaves (max) (percentage) -10.00% 0.700 0.630 - 0.00% -
453.povray (max) (percentage) -9.87% 2.330 2.100 - 0.00% -
462.libquantum (max) (percentage) -9.62% 2.080 1.880 - 0.00% -
401.bzip2 (max) -8.70% 23.000 21.000 - 0.00% -
464.h264ref (max) (percentage) -8.65% 1.040 0.950 - 0.00% -
401.bzip2 (max) (percentage) -7.87% 0.890 0.820 - 0.00% -
464.h264ref (max) -7.69% 39.000 36.000 - 0.00% -
444.namd (max) (percentage) -7.62% 1.050 0.970 - 0.00% -
450.soplex -7.14% 14.000 13.000 - 0.00% -
450.soplex (avg) -7.14% 14.000 13.000 - 0.00% -
471.omnetpp (max) (percentage) -6.18% 3.400 3.190 - 0.00% -
471.omnetpp (max) -5.75% 87.000 82.000 - 0.00% -
473.astar (max) -5.45% 55.000 52.000 - 0.00% -
473.astar (max) (percentage) -4.59% 1.090 1.040 - 0.00% -
458.sjeng (max) (percentage) -4.55% 0.440 0.420 - 0.00% -
464.h264ref (avg) (percentage) -4.35% 0.920 0.880 - 0.00% -
437.leslie3d -4.09% 269.000 258.000 - 0.00% -
437.leslie3d (avg) -4.09% 269.000 258.000 - 0.00% -
429.mcf -4.00% 50.000 48.000 - 0.00% -
429.mcf (avg) -4.00% 50.000 48.000 - 0.00% -
458.sjeng (avg) (percentage) -3.57% 0.560 0.540 - 0.00% -
458.sjeng (max) -3.57% 28.000 27.000 - 0.00% -
437.leslie3d (max) -3.42% 322.000 311.000 - 0.00% -
471.omnetpp -3.39% 59.000 57.000 - 0.00% -
471.omnetpp (avg) -3.39% 59.000 57.000 - 0.00% -
473.astar (avg) (percentage) -2.94% 1.360 1.320 - 0.00% -
464.h264ref -2.94% 34.000 33.000 - 0.00% -
464.h264ref (avg) -2.94% 34.000 33.000 - 0.00% -
473.astar -2.90% 69.000 67.000 - 0.00% -
473.astar (avg) -2.90% 69.000 67.000 - 0.00% -
458.sjeng -2.78% 36.000 35.000 - 0.00% -
458.sjeng (avg) -2.78% 36.000 35.000 - 0.00% -
401.bzip2 -2.63% 38.000 37.000 - 0.00% -
401.bzip2 (avg) -2.63% 38.000 37.000 - 0.00% -
471.omnetpp (avg) (percentage) -2.60% 2.310 2.250 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.41% 0.830 0.810 - 0.00% -
459.GemsFDTD -2.38% 42.000 41.000 - 0.00% -
459.GemsFDTD (avg) -2.38% 42.000 41.000 - 0.00% -
410.bwaves (avg) (percentage) -2.16% 1.390 1.360 - 0.00% -
401.bzip2 (avg) (percentage) -2.10% 1.430 1.400 - 0.00% -
433.milc (avg) (percentage) -2.06% 0.970 0.950 - 0.00% -
444.namd (avg) (percentage) -2.02% 0.990 0.970 - 0.00% -
416.gamess (max) (percentage) -2.00% 0.500 0.490 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -1.92% 0.520 0.510 0.000 0.00% 0.000
416.gamess (max) -1.85% 54.000 53.000 - 0.00% -
410.bwaves -1.54% 65.000 64.000 - 0.00% -
410.bwaves (avg) -1.54% 65.000 64.000 - 0.00% -
482.sphinx3 (max) (percentage) -1.33% 3.760 3.710 - 0.00% -
470.lbm (avg) (percentage) -1.20% 0.830 0.820 - 0.00% -
429.mcf (avg) (percentage) -1.11% 3.590 3.550 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.12% 64.000 66.000 - 127.59% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.83% 3240486.000 3299862.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 7.12% 2501.000 2679.000 - 0.68% -
473.astar 4.44% 4865.000 5081.000 - 0.00% -
447.dealII 3.44% 1220.000 1262.000 - -2.40% -
456.hmmer 3.33% 2639.000 2727.000 - 0.15% -
400.perlbench 3.06% 1664.000 1715.000 - 0.94% -
470.lbm 1.85% 3249.000 3309.000 - 0.52% -
444.namd 1.66% 662.000 673.000 - -0.44% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.00% 42589.000 40458.000 - 0.00% -
444.namd -2.70% 212450.000 206705.000 - 0.00% -
464.h264ref -2.54% 749591.000 730527.000 - 0.00% -
458.sjeng -2.44% 146102.000 142538.000 - 0.00% -
450.soplex -1.95% 370392.000 363178.000 - 0.00% -
401.bzip2 -1.19% 76998.000 76078.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -27.96% 1906.000 1373.000 - -1.93% -
462.libquantum -23.58% 106.000 81.000 - -1.22% -
403.gcc -14.06% 64.000 55.000 - -9.84% -
453.povray -7.10% 465.000 432.000 - -1.82% -
464.h264ref -6.10% 4036.000 3790.000 - -0.03% -
458.sjeng -3.18% 6752.000 6537.000 - -0.15% -
450.soplex -1.68% 536.000 527.000 - -3.48% -
471.omnetpp -1.64% 2614.000 2571.000 - 0.16% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 163.16% 19.000 50.000 - -3.85% -
nb_execution_successful 163.16% 19.000 50.000 - -3.85% -
nb_total_tests 127.59% 29.000 66.000 - 3.12% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (avg) (percentage)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1715.000 -
401.bzip2 2679.000 -
403.gcc 55.000 -9.84%
410.bwaves 4717.000 -
416.gamess 10872.000 -
429.mcf 1373.000 -1.93%
433.milc 1205.000 -
434.zeusmp 1925.000 -
437.leslie3d 6303.000 -4.95%
444.namd 673.000 -
445.gobmk 4919.000 -
447.dealII 1262.000 -2.40%
450.soplex 527.000 -3.48%
453.povray 432.000 -1.82%
456.hmmer 2727.000 -
458.sjeng 6537.000 -
459.GemsFDTD 5156.000 -
462.libquantum 81.000 -1.22%
464.h264ref 3790.000 -
465.tonto 20239.000 -
470.lbm 3309.000 -
471.omnetpp 2571.000 -
473.astar 5081.000 -
481.wrf 3192.000 -
483.xalancbmk 3601.000 1.69%
Geometric Mean 2059.943 -
Name Current %
400.perlbench 1183926.000 -
401.bzip2 76078.000 -
403.gcc 3427779.000 -
410.bwaves 632163.000 -
416.gamess 8878010.000 -
429.mcf 13263.000 -
433.milc 137344.000 -
434.zeusmp 1032620.000 -
437.leslie3d 950819.000 -
444.namd 206705.000 -
445.gobmk 2112057.000 -
447.dealII 3299862.000 -
450.soplex 363178.000 -
453.povray 962102.000 -
456.hmmer 298872.000 -
458.sjeng 142538.000 -
459.GemsFDTD 1288847.000 -
462.libquantum 40458.000 -
464.h264ref 730527.000 -
465.tonto 10950104.000 -
470.lbm 12117.000 -
471.omnetpp 680246.000 -
473.astar 41996.000 -
481.wrf 7292420.000 -
483.xalancbmk 4314660.000 -
Geometric Mean 548523.832 -
Name Current %
nb_compile_successful 50.000 -3.85%
nb_execution_successful 50.000 -3.85%
nb_total_tests 66.000 3.12%
Geometric Mean 54.848 -1.58%
Name Current %
400.perlbench 12.000 9.09%
400.perlbench (avg) 12.000 9.09%
400.perlbench (avg) (percentage) 0.700 -
400.perlbench (max) 19.000 -
400.perlbench (max) (percentage) 1.140 -
401.bzip2 37.000 -2.63%
401.bzip2 (avg) 37.000 -2.63%
401.bzip2 (avg) (percentage) 1.400 -2.10%
401.bzip2 (max) 21.000 -8.70%
401.bzip2 (max) (percentage) 0.820 -7.87%
401.bzip2 (unexplained diff vs previous) 18.000 200.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.670 191.30%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.090 8.36%
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 9.840 9.45%
403.gcc (unexplained diff vs previous) 6.000 -
403.gcc (unexplained diff vs previous) (percentage) 10.910 -
410.bwaves 64.000 -1.54%
410.bwaves (avg) 64.000 -1.54%
410.bwaves (avg) (percentage) 1.360 -2.16%
410.bwaves (max) 29.000 -12.12%
410.bwaves (max) (percentage) 0.630 -10.00%
410.bwaves (unexplained diff vs previous) 25.000 316.67%
410.bwaves (unexplained diff vs previous) (percentage) 0.530 307.69%
416.gamess 33.000 3.12%
416.gamess (avg) 33.000 3.12%
416.gamess (avg) (percentage) 0.310 3.33%
416.gamess (max) 53.000 -1.85%
416.gamess (max) (percentage) 0.490 -2.00%
416.gamess (unexplained diff vs previous) 36.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.330 -
429.mcf 48.000 -4.00%
429.mcf (avg) 48.000 -4.00%
429.mcf (avg) (percentage) 3.550 -1.11%
429.mcf (max) 26.000 333.33%
429.mcf (max) (percentage) 1.930 348.84%
429.mcf (unexplained diff vs previous) 27.000 350.00%
429.mcf (unexplained diff vs previous) (percentage) 1.970 358.14%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 0.950 -2.06%
433.milc (max) 6.000 -25.00%
433.milc (max) (percentage) 0.560 -16.42%
433.milc (unexplained diff vs previous) 3.000 -62.50%
433.milc (unexplained diff vs previous) (percentage) 0.250 -62.12%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.890 -
434.zeusmp (max) 17.000 -19.05%
434.zeusmp (max) (percentage) 0.910 -16.51%
434.zeusmp (unexplained diff vs previous) 16.000 -23.81%
434.zeusmp (unexplained diff vs previous) (percentage) 0.830 -23.15%
435.gromacs (avg) (percentage) 0.680 -
435.gromacs (max) (percentage) 0.670 -
436.cactusADM (avg) (percentage) 0.670 -
436.cactusADM (max) (percentage) 0.740 -
437.leslie3d 258.000 -4.09%
437.leslie3d (avg) 258.000 -4.09%
437.leslie3d (avg) (percentage) 4.100 -
437.leslie3d (max) 311.000 -3.42%
437.leslie3d (max) (percentage) 4.950 1.64%
437.leslie3d (unexplained diff vs previous) 328.000 192.86%
437.leslie3d (unexplained diff vs previous) (percentage) 5.200 207.69%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.970 -2.02%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.970 -7.62%
444.namd (unexplained diff vs previous) 3.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 0.450 200.00%
445.gobmk 36.000 -
445.gobmk (avg) 36.000 -
445.gobmk (avg) (percentage) 0.740 -
445.gobmk (max) 46.000 130.00%
445.gobmk (max) (percentage) 0.940 118.60%
445.gobmk (unexplained diff vs previous) 46.000 119.05%
445.gobmk (unexplained diff vs previous) (percentage) 0.940 118.60%
447.dealII 26.000 -
447.dealII (avg) 26.000 -
447.dealII (avg) (percentage) 2.080 -
447.dealII (max) 38.000 -11.63%
447.dealII (max) (percentage) 3.040 -10.32%
447.dealII (unexplained diff vs previous) 31.000 -22.50%
447.dealII (unexplained diff vs previous) (percentage) 2.460 -20.39%
450.soplex 13.000 -7.14%
450.soplex (avg) 13.000 -7.14%
450.soplex (avg) (percentage) 2.620 1.16%
450.soplex (max) 18.000 50.00%
450.soplex (max) (percentage) 3.480 54.67%
450.soplex (unexplained diff vs previous) 19.000 58.33%
450.soplex (unexplained diff vs previous) (percentage) 3.610 64.09%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.460 1.39%
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 2.100 -9.87%
453.povray (unexplained diff vs previous) 8.000 -20.00%
453.povray (unexplained diff vs previous) (percentage) 1.850 -18.50%
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.340 -
456.hmmer (max) 4.000 -33.33%
456.hmmer (max) (percentage) 0.150 -34.78%
456.hmmer (unexplained diff vs previous) 4.000 -20.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.150 -16.67%
458.sjeng 35.000 -2.78%
458.sjeng (avg) 35.000 -2.78%
458.sjeng (avg) (percentage) 0.540 -3.57%
458.sjeng (max) 27.000 -3.57%
458.sjeng (max) (percentage) 0.420 -4.55%
458.sjeng (unexplained diff vs previous) 10.000 233.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.150 200.00%
459.GemsFDTD 41.000 -2.38%
459.GemsFDTD (avg) 41.000 -2.38%
459.GemsFDTD (avg) (percentage) 0.810 -2.41%
459.GemsFDTD (max) 22.000 37.50%
459.GemsFDTD (max) (percentage) 0.440 41.94%
459.GemsFDTD (unexplained diff vs previous) 23.000 91.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.450 95.65%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.730 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.880 -9.62%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.230 -
464.h264ref 33.000 -2.94%
464.h264ref (avg) 33.000 -2.94%
464.h264ref (avg) (percentage) 0.880 -4.35%
464.h264ref (max) 36.000 -7.69%
464.h264ref (max) (percentage) 0.950 -8.65%
464.h264ref (unexplained diff vs previous) 1.000 -97.50%
464.h264ref (unexplained diff vs previous) (percentage) 0.030 -97.17%
465.tonto 109.000 -
465.tonto (avg) 109.000 -
465.tonto (avg) (percentage) 0.540 -
465.tonto (max) 105.000 -
465.tonto (max) (percentage) 0.520 -
470.lbm 27.000 -
470.lbm (avg) 27.000 -
470.lbm (avg) (percentage) 0.820 -1.20%
470.lbm (max) 17.000 6.25%
470.lbm (max) (percentage) 0.520 1.96%
470.lbm (unexplained diff vs previous) 17.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.510 -1.92%
471.omnetpp 57.000 -3.39%
471.omnetpp (avg) 57.000 -3.39%
471.omnetpp (avg) (percentage) 2.250 -2.60%
471.omnetpp (max) 82.000 -5.75%
471.omnetpp (max) (percentage) 3.190 -6.18%
471.omnetpp (unexplained diff vs previous) 4.000 -77.78%
471.omnetpp (unexplained diff vs previous) (percentage) 0.160 -77.14%
473.astar 67.000 -2.90%
473.astar (avg) 67.000 -2.90%
473.astar (avg) (percentage) 1.320 -2.94%
473.astar (max) 52.000 -5.45%
473.astar (max) (percentage) 1.040 -4.59%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf 15.000 -
481.wrf (avg) 15.000 -
481.wrf (avg) (percentage) 0.500 -
481.wrf (max) 15.000 -
481.wrf (max) (percentage) 0.500 -
481.wrf (unexplained diff vs previous) 16.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.500 -
482.sphinx3 (avg) (percentage) 2.320 -
482.sphinx3 (max) (percentage) 3.710 -1.33%
483.xalancbmk 61.000 1.67%
483.xalancbmk (avg) 61.000 1.67%
483.xalancbmk (avg) (percentage) 1.700 -
483.xalancbmk (max) 60.000 150.00%
483.xalancbmk (max) (percentage) 1.690 141.43%
483.xalancbmk (unexplained diff vs previous) 60.000 215.79%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.670 209.26%
Geometric Mean 4.609 4.15%