Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/22530e7985083032fe708848abb88b77be78e5ce (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/209/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0209 (no-change) 2024-06-15T20:48:49 0:00:00
Previous 0207 (no-change) 2024-06-15T11:10:03 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 35 9
Performance Improvements 100 16
Added Tests 5 171
Unchanged Tests 1024 968
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 22.07% 6347.000 7748.000 - 0.00% -
447.dealII 1.18% 1266.000 1281.000 - 5.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) 23250.00% 6.000 1401.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 19988.89% 0.090 18.080 0.000 0.00% 0.000
437.leslie3d (max) 479.32% 295.000 1709.000 - 0.00% -
437.leslie3d (max) (percentage) 374.62% 4.650 22.070 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 189.57% 1.150 3.330 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) 180.00% 5.000 14.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 166.67% 3.000 8.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 162.50% 0.160 0.420 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 66.67% 0.150 0.250 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 60.00% 10.000 16.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 54.90% 0.510 0.790 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 52.94% 17.000 26.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 44.58% 0.830 1.200 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 42.86% 21.000 30.000 0.000 0.00% 0.000
437.leslie3d 42.18% 211.000 300.000 - 0.00% -
437.leslie3d (avg) 42.18% 211.000 300.000 - 0.00% -
447.dealII (unexplained diff vs previous) 36.36% 11.000 15.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) 34.48% 0.870 1.170 0.000 0.00% 0.000
453.povray (max) (percentage) 31.43% 2.450 3.220 - 0.00% -
453.povray (max) 30.00% 10.000 13.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 25.00% 16.000 20.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 24.39% 0.410 0.510 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 23.88% 1.340 1.660 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 22.22% 36.000 44.000 0.000 0.00% 0.000
401.bzip2 (max) (percentage) 20.59% 1.360 1.640 - 0.00% -
401.bzip2 (max) 19.44% 36.000 43.000 - 0.00% -
437.leslie3d (avg) (percentage) 16.52% 3.330 3.880 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 16.16% 0.990 1.150 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 14.29% 49.000 56.000 0.000 0.00% 0.000
453.povray (avg) (percentage) 3.60% 1.390 1.440 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 1.96% 1.020 1.040 0.000 0.00% 0.000
444.namd (avg) (percentage) 1.20% 0.830 0.840 - 0.00% -
445.gobmk (avg) (percentage) 1.10% 0.910 0.920 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -3.22% 435.000 421.000 - -9.46% -
435.gromacs -2.32% 5007.000 4891.000 - 0.00% -
401.bzip2 -1.64% 2691.000 2647.000 - 5.84% -
462.libquantum -1.22% 82.000 81.000 - -23.58% -
471.omnetpp -1.19% 2523.000 2493.000 - -4.63% -
445.gobmk -1.13% 4936.000 4880.000 - -0.14% -
444.namd -1.02% 683.000 676.000 - 2.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -92.93% 297.000 21.000 - 0.00% -
429.mcf (max) (percentage) -92.79% 21.090 1.520 - 0.00% -
473.astar (max) -90.06% 181.000 18.000 - 0.00% -
473.astar (max) (percentage) -89.77% 3.520 0.360 - 0.00% -
410.bwaves (unexplained diff vs previous) -85.94% 64.000 9.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -85.93% 1.350 0.190 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -84.71% 2.420 0.370 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -84.62% 13.000 2.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -84.09% 0.440 0.070 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) -83.33% 12.000 2.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -66.94% 1.240 0.410 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -66.67% 15.000 5.000 0.000 0.00% 0.000
450.soplex (max) (percentage) -66.55% 5.560 1.860 - 0.00% -
433.milc (max) -65.62% 32.000 11.000 - 0.00% -
450.soplex (max) -65.52% 29.000 10.000 - 0.00% -
433.milc (max) (percentage) -65.06% 2.690 0.940 - 0.00% -
473.astar (unexplained diff vs previous) -64.00% 25.000 9.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -63.27% 0.490 0.180 0.000 0.00% 0.000
462.libquantum (max) (percentage) -61.88% 3.200 1.220 - 0.00% -
403.gcc (max) -60.00% 5.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) -57.14% 28.000 12.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -56.78% 1.990 0.860 0.000 0.00% 0.000
403.gcc (max) (percentage) -53.70% 10.130 4.690 - 0.00% -
459.GemsFDTD (max) -40.91% 110.000 65.000 - 0.00% -
459.GemsFDTD (max) (percentage) -40.09% 2.120 1.270 - 0.00% -
403.gcc -33.33% 3.000 2.000 - 0.00% -
403.gcc (avg) -33.33% 3.000 2.000 - 0.00% -
435.gromacs (max) -27.16% 162.000 118.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -26.11% 157.000 116.000 0.000 0.00% 0.000
416.gamess (max) -25.58% 43.000 32.000 - 0.00% -
416.gamess (max) (percentage) -25.00% 0.400 0.300 - 0.00% -
435.gromacs (max) (percentage) -25.00% 3.240 2.430 - 0.00% -
444.namd (max) -25.00% 8.000 6.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -24.52% 3.140 2.370 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) (percentage) -21.05% 0.380 0.300 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) -19.51% 41.000 33.000 0.000 0.00% 0.000
444.namd (max) (percentage) -18.40% 1.250 1.020 - 0.00% -
436.cactusADM (max) (percentage) -16.98% 1.590 1.320 - 0.00% -
456.hmmer (max) -16.67% 12.000 10.000 - 0.00% -
436.cactusADM (max) -15.00% 20.000 17.000 - 0.00% -
436.cactusADM -10.00% 10.000 9.000 - 0.00% -
436.cactusADM (avg) -10.00% 10.000 9.000 - 0.00% -
456.hmmer (max) (percentage) -9.09% 0.440 0.400 - 0.00% -
445.gobmk (max) -7.69% 143.000 132.000 - 0.00% -
470.lbm (max) -7.58% 66.000 61.000 - 0.00% -
458.sjeng (max) -6.90% 87.000 81.000 - 0.00% -
482.sphinx3 (max) (percentage) -6.72% 3.570 3.330 - 0.00% -
458.sjeng (max) (percentage) -6.67% 1.350 1.260 - 0.00% -
434.zeusmp (max) (percentage) -6.63% 1.660 1.550 - 0.00% -
410.bwaves (max) (percentage) -6.58% 2.430 2.270 - 0.00% -
470.lbm (max) (percentage) -6.50% 2.000 1.870 - 0.00% -
434.zeusmp (max) -6.45% 31.000 29.000 - 0.00% -
403.gcc (avg) (percentage) -6.43% 5.130 4.800 - 0.00% -
447.dealII (max) (percentage) -6.29% 1.750 1.640 - 0.00% -
445.gobmk (max) (percentage) -6.21% 2.900 2.720 - 0.00% -
410.bwaves (max) -6.14% 114.000 107.000 - 0.00% -
434.zeusmp -5.88% 17.000 16.000 - 0.00% -
434.zeusmp (avg) -5.88% 17.000 16.000 - 0.00% -
471.omnetpp (max) -5.26% 76.000 72.000 - 0.00% -
447.dealII (max) -4.55% 22.000 21.000 - 0.00% -
481.wrf (max) (percentage) -4.24% 5.890 5.640 - 0.00% -
482.sphinx3 (max) -4.17% 24.000 23.000 - 0.00% -
471.omnetpp (max) (percentage) -3.97% 3.020 2.900 - 0.00% -
481.wrf (max) -3.83% 183.000 176.000 - 0.00% -
436.cactusADM (avg) (percentage) -3.75% 0.800 0.770 - 0.00% -
429.mcf -3.64% 55.000 53.000 - 0.00% -
429.mcf (avg) -3.64% 55.000 53.000 - 0.00% -
401.bzip2 -2.94% 34.000 33.000 - 0.00% -
401.bzip2 (avg) -2.94% 34.000 33.000 - 0.00% -
464.h264ref (max) (percentage) -2.55% 2.740 2.670 - 0.00% -
459.GemsFDTD -2.27% 44.000 43.000 - 0.00% -
459.GemsFDTD (avg) -2.27% 44.000 43.000 - 0.00% -
434.zeusmp (avg) (percentage) -2.25% 0.890 0.870 - 0.00% -
465.tonto (max) (percentage) -2.17% 0.460 0.450 - 0.00% -
465.tonto (max) -2.17% 92.000 90.000 - 0.00% -
450.soplex (avg) (percentage) -2.17% 2.760 2.700 - 0.00% -
471.omnetpp -1.92% 52.000 51.000 - 0.00% -
471.omnetpp (avg) -1.92% 52.000 51.000 - 0.00% -
482.sphinx3 (avg) (percentage) -1.90% 2.100 2.060 - 0.00% -
410.bwaves -1.89% 53.000 52.000 - 0.00% -
410.bwaves (avg) -1.89% 53.000 52.000 - 0.00% -
435.gromacs -1.89% 106.000 104.000 - 0.00% -
435.gromacs (avg) -1.89% 106.000 104.000 - 0.00% -
464.h264ref (max) -1.89% 106.000 104.000 - 0.00% -
410.bwaves (avg) (percentage) -1.77% 1.130 1.110 - 0.00% -
473.astar (avg) (percentage) -1.63% 1.230 1.210 - 0.00% -
473.astar -1.59% 63.000 62.000 - 0.00% -
473.astar (avg) -1.59% 63.000 62.000 - 0.00% -
429.mcf (avg) (percentage) -1.53% 3.920 3.860 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -1.37% 0.730 0.720 0.000 0.00% 0.000
459.GemsFDTD (avg) (percentage) -1.16% 0.860 0.850 - 0.00% -
433.milc (avg) (percentage) -1.14% 0.880 0.870 - 0.00% -
464.h264ref (avg) (percentage) -1.09% 0.920 0.910 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
462.libquantum (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.10% 3240486.000 3308530.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.84% 2501.000 2647.000 - -1.64% -
473.astar 5.55% 4865.000 5135.000 - -0.17% -
447.dealII 5.00% 1220.000 1281.000 - 1.18% -
456.hmmer 3.49% 2639.000 2731.000 - 0.07% -
482.sphinx3 3.27% 672.000 694.000 - 0.73% -
444.namd 2.11% 662.000 676.000 - -1.02% -
400.perlbench 1.74% 1664.000 1693.000 - 0.36% -
470.lbm 1.51% 3249.000 3298.000 - -0.78% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.16% 42589.000 40390.000 - 0.00% -
464.h264ref -2.62% 749591.000 729973.000 - 0.00% -
444.namd -2.22% 212450.000 207733.000 - 0.00% -
458.sjeng -1.54% 146102.000 143846.000 - 0.00% -
450.soplex -1.31% 370392.000 365554.000 - 0.00% -
470.lbm -1.28% 12229.000 12073.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.65% 1906.000 1398.000 - -0.85% -
462.libquantum -23.58% 106.000 81.000 - -1.22% -
453.povray -9.46% 465.000 421.000 - -3.22% -
403.gcc -7.81% 64.000 59.000 - 0.00% -
471.omnetpp -4.63% 2614.000 2493.000 - -1.19% -
458.sjeng -4.21% 6752.000 6468.000 - -0.25% -
464.h264ref -2.80% 4036.000 3923.000 - 0.51% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.46s
Name Current %
400.perlbench 1693.000 -
401.bzip2 2647.000 -1.64%
403.gcc 59.000 -
410.bwaves 4739.000 -
416.gamess 10951.000 -
429.mcf 1398.000 -
433.milc 1208.000 -
434.zeusmp 1926.000 -
435.gromacs 4891.000 -2.32%
436.cactusADM 1298.000 -
437.leslie3d 7748.000 22.07%
444.namd 676.000 -1.02%
445.gobmk 4880.000 -1.13%
447.dealII 1281.000 1.18%
450.soplex 539.000 -
453.povray 421.000 -3.22%
456.hmmer 2731.000 -
458.sjeng 6468.000 -
459.GemsFDTD 5163.000 -
462.libquantum 81.000 -1.22%
464.h264ref 3923.000 -
465.tonto 20070.000 -
470.lbm 3298.000 -
471.omnetpp 2493.000 -1.19%
473.astar 5135.000 -
481.wrf 3123.000 -
482.sphinx3 694.000 -
Geometric Mean 1986.666 -
Name Current %
400.perlbench 1184453.000 -
401.bzip2 76494.000 -
403.gcc 3428767.000 -
410.bwaves 634491.000 -
416.gamess 8882418.000 -
429.mcf 13243.000 -
433.milc 137560.000 -
434.zeusmp 1032180.000 -
435.gromacs 905528.000 -
436.cactusADM 1425332.000 -
437.leslie3d 954461.000 -
444.namd 207733.000 -
445.gobmk 2112105.000 -
447.dealII 3308530.000 -
450.soplex 365554.000 -
453.povray 962684.000 -
456.hmmer 299772.000 -
458.sjeng 143846.000 -
459.GemsFDTD 1289767.000 -
462.libquantum 40390.000 -
464.h264ref 729973.000 -
465.tonto 10991344.000 -
470.lbm 12073.000 -
471.omnetpp 682759.000 -
473.astar 41996.000 -
481.wrf 7420693.000 -
482.sphinx3 196273.000 -
Geometric Mean 517464.206 -
Name Current %
400.perlbench 30.000 -
400.perlbench (avg) 30.000 -
400.perlbench (avg) (percentage) 1.780 -
400.perlbench (max) 54.000 -
400.perlbench (max) (percentage) 3.190 -
401.bzip2 33.000 -2.94%
401.bzip2 (avg) 33.000 -2.94%
401.bzip2 (avg) (percentage) 1.270 -
401.bzip2 (max) 43.000 19.44%
401.bzip2 (max) (percentage) 1.640 20.59%
401.bzip2 (unexplained diff vs previous) 44.000 22.22%
401.bzip2 (unexplained diff vs previous) (percentage) 1.660 23.88%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 4.800 -6.43%
403.gcc (max) 2.000 -60.00%
403.gcc (max) (percentage) 4.690 -53.70%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
410.bwaves 52.000 -1.89%
410.bwaves (avg) 52.000 -1.89%
410.bwaves (avg) (percentage) 1.110 -1.77%
410.bwaves (max) 107.000 -6.14%
410.bwaves (max) (percentage) 2.270 -6.58%
410.bwaves (unexplained diff vs previous) 9.000 -85.94%
410.bwaves (unexplained diff vs previous) (percentage) 0.190 -85.93%
416.gamess 22.000 -
416.gamess (avg) 22.000 -
416.gamess (avg) (percentage) 0.210 -
416.gamess (max) 32.000 -25.58%
416.gamess (max) (percentage) 0.300 -25.00%
416.gamess (unexplained diff vs previous) 33.000 -19.51%
416.gamess (unexplained diff vs previous) (percentage) 0.300 -21.05%
429.mcf 53.000 -3.64%
429.mcf (avg) 53.000 -3.64%
429.mcf (avg) (percentage) 3.860 -1.53%
429.mcf (max) 21.000 -92.93%
429.mcf (max) (percentage) 1.520 -92.79%
429.mcf (unexplained diff vs previous) 12.000 -57.14%
429.mcf (unexplained diff vs previous) (percentage) 0.860 -56.78%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.870 -1.14%
433.milc (max) 11.000 -65.62%
433.milc (max) (percentage) 0.940 -65.06%
433.milc (unexplained diff vs previous) 5.000 -66.67%
433.milc (unexplained diff vs previous) (percentage) 0.410 -66.94%
434.zeusmp 16.000 -5.88%
434.zeusmp (avg) 16.000 -5.88%
434.zeusmp (avg) (percentage) 0.870 -2.25%
434.zeusmp (max) 29.000 -6.45%
434.zeusmp (max) (percentage) 1.550 -6.63%
434.zeusmp (unexplained diff vs previous) 8.000 166.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.420 162.50%
435.gromacs 104.000 -1.89%
435.gromacs (avg) 104.000 -1.89%
435.gromacs (avg) (percentage) 2.130 -
435.gromacs (max) 118.000 -27.16%
435.gromacs (max) (percentage) 2.430 -25.00%
435.gromacs (unexplained diff vs previous) 116.000 -26.11%
435.gromacs (unexplained diff vs previous) (percentage) 2.370 -24.52%
436.cactusADM 9.000 -10.00%
436.cactusADM (avg) 9.000 -10.00%
436.cactusADM (avg) (percentage) 0.770 -3.75%
436.cactusADM (max) 17.000 -15.00%
436.cactusADM (max) (percentage) 1.320 -16.98%
436.cactusADM (unexplained diff vs previous) 0.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.000 -
437.leslie3d 300.000 42.18%
437.leslie3d (avg) 300.000 42.18%
437.leslie3d (avg) (percentage) 3.880 16.52%
437.leslie3d (max) 1709.000 479.32%
437.leslie3d (max) (percentage) 22.070 374.62%
437.leslie3d (unexplained diff vs previous) 1401.000 23250.00%
437.leslie3d (unexplained diff vs previous) (percentage) 18.080 19988.89%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.840 1.20%
444.namd (max) 6.000 -25.00%
444.namd (max) (percentage) 1.020 -18.40%
444.namd (unexplained diff vs previous) 7.000 -
444.namd (unexplained diff vs previous) (percentage) 1.040 1.96%
445.gobmk 44.000 -
445.gobmk (avg) 44.000 -
445.gobmk (avg) (percentage) 0.920 1.10%
445.gobmk (max) 132.000 -7.69%
445.gobmk (max) (percentage) 2.720 -6.21%
445.gobmk (unexplained diff vs previous) 56.000 14.29%
445.gobmk (unexplained diff vs previous) (percentage) 1.150 16.16%
447.dealII 20.000 -
447.dealII (avg) 20.000 -
447.dealII (avg) (percentage) 1.580 -
447.dealII (max) 21.000 -4.55%
447.dealII (max) (percentage) 1.640 -6.29%
447.dealII (unexplained diff vs previous) 15.000 36.36%
447.dealII (unexplained diff vs previous) (percentage) 1.170 34.48%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.700 -2.17%
450.soplex (max) 10.000 -65.52%
450.soplex (max) (percentage) 1.860 -66.55%
450.soplex (unexplained diff vs previous) 2.000 -84.62%
450.soplex (unexplained diff vs previous) (percentage) 0.370 -84.71%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.440 3.60%
453.povray (max) 13.000 30.00%
453.povray (max) (percentage) 3.220 31.43%
453.povray (unexplained diff vs previous) 14.000 180.00%
453.povray (unexplained diff vs previous) (percentage) 3.330 189.57%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 10.000 -16.67%
456.hmmer (max) (percentage) 0.400 -9.09%
456.hmmer (unexplained diff vs previous) 2.000 -83.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.070 -84.09%
458.sjeng 36.000 -
458.sjeng (avg) 36.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 81.000 -6.90%
458.sjeng (max) (percentage) 1.260 -6.67%
458.sjeng (unexplained diff vs previous) 16.000 60.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.250 66.67%
459.GemsFDTD 43.000 -2.27%
459.GemsFDTD (avg) 43.000 -2.27%
459.GemsFDTD (avg) (percentage) 0.850 -1.16%
459.GemsFDTD (max) 65.000 -40.91%
459.GemsFDTD (max) (percentage) 1.270 -40.09%
459.GemsFDTD (unexplained diff vs previous) 26.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.500 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.820 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.220 -61.88%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.230 -
464.h264ref 35.000 -
464.h264ref (avg) 35.000 -
464.h264ref (avg) (percentage) 0.910 -1.09%
464.h264ref (max) 104.000 -1.89%
464.h264ref (max) (percentage) 2.670 -2.55%
464.h264ref (unexplained diff vs previous) 20.000 25.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.510 24.39%
465.tonto 56.000 -
465.tonto (avg) 56.000 -
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 90.000 -2.17%
465.tonto (max) (percentage) 0.450 -2.17%
470.lbm 26.000 -
470.lbm (avg) 26.000 -
470.lbm (avg) (percentage) 0.790 -
470.lbm (max) 61.000 -7.58%
470.lbm (max) (percentage) 1.870 -6.50%
470.lbm (unexplained diff vs previous) 26.000 52.94%
470.lbm (unexplained diff vs previous) (percentage) 0.790 54.90%
471.omnetpp 51.000 -1.92%
471.omnetpp (avg) 51.000 -1.92%
471.omnetpp (avg) (percentage) 2.080 -
471.omnetpp (max) 72.000 -5.26%
471.omnetpp (max) (percentage) 2.900 -3.97%
471.omnetpp (unexplained diff vs previous) 30.000 42.86%
471.omnetpp (unexplained diff vs previous) (percentage) 1.200 44.58%
473.astar 62.000 -1.59%
473.astar (avg) 62.000 -1.59%
473.astar (avg) (percentage) 1.210 -1.63%
473.astar (max) 18.000 -90.06%
473.astar (max) (percentage) 0.360 -89.77%
473.astar (unexplained diff vs previous) 9.000 -64.00%
473.astar (unexplained diff vs previous) (percentage) 0.180 -63.27%
481.wrf 56.000 -
481.wrf (avg) 56.000 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) 176.000 -3.83%
481.wrf (max) (percentage) 5.640 -4.24%
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.060 -1.90%
482.sphinx3 (max) 23.000 -4.17%
482.sphinx3 (max) (percentage) 3.330 -6.72%
482.sphinx3 (unexplained diff vs previous) 5.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.720 -1.37%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.180 -
Geometric Mean 4.796 -24.25%