Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d70254a623d7c23c493cc793756a5a9d758b0a14 (+ 1 commits)
regression LLVM-1161
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/132/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0132 (llvmorg-19-init-04339-gd70254a623d7) 2024-03-03T17:52:10 0:00:00
Previous 0131 (llvmorg-19-init-04338-g6e27dd47e1fc) 2024-03-01T02:31:09 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 38 12
Performance Improvements 100 13
Added Tests 4 139
Unchanged Tests 902 880
Total Tests 1044

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 3.66% 1968.000 2040.000 - 7.03% -
483.xalancbmk 1.14% 3612.000 3653.000 - 2.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (max) 168.18% 22.000 59.000 - 0.00% -
445.gobmk (max) (percentage) 165.22% 0.460 1.220 - 0.00% -
434.zeusmp (unexplained diff vs previous) 160.00% 5.000 13.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 157.69% 0.260 0.670 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 138.81% 0.670 1.600 - 0.00% -
453.povray (unexplained diff vs previous) 133.33% 3.000 7.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 29.41% 0.510 0.660 - 0.00% -
456.hmmer (unexplained diff vs previous) 28.57% 14.000 18.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 23.26% 2.150 2.650 - 0.00% -
444.namd (unexplained diff vs previous) 20.00% 15.000 18.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 10.22% 1.370 1.510 - 0.00% -
464.h264ref (unexplained diff vs previous) 9.26% 54.000 59.000 - 0.00% -
444.namd (avg) (percentage) 6.54% 1.070 1.140 - 0.00% -
447.dealII (avg) (percentage) 6.31% 2.060 2.190 - 0.00% -
482.sphinx3 (avg) (percentage) 6.11% 2.620 2.780 - 0.00% -
458.sjeng 5.41% 37.000 39.000 - 0.00% -
458.sjeng (avg) 5.41% 37.000 39.000 - 0.00% -
458.sjeng (avg) (percentage) 5.36% 0.560 0.590 - 0.00% -
464.h264ref (avg) (percentage) 5.00% 0.800 0.840 - 0.00% -
410.bwaves (avg) (percentage) 4.76% 1.260 1.320 - 0.00% -
444.namd (max) (percentage) 4.03% 2.480 2.580 - 0.00% -
445.gobmk (avg) (percentage) 3.80% 0.790 0.820 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 3.57% 0.840 0.870 - 0.00% -
470.lbm (unexplained diff vs previous) 3.57% 28.000 29.000 - 0.00% -
464.h264ref 3.23% 31.000 32.000 - 0.00% -
464.h264ref (avg) 3.23% 31.000 32.000 - 0.00% -
456.hmmer (avg) (percentage) 2.86% 0.350 0.360 - 0.00% -
429.mcf 2.74% 73.000 75.000 - 0.00% -
429.mcf (avg) 2.74% 73.000 75.000 - 0.00% -
445.gobmk 2.63% 38.000 39.000 - 0.00% -
445.gobmk (avg) 2.63% 38.000 39.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 1.74% 1.150 1.170 - 0.00% -
410.bwaves 1.64% 61.000 62.000 - 0.00% -
410.bwaves (avg) 1.64% 61.000 62.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 1.30% 77.000 78.000 - 0.00% -
473.astar (avg) (percentage) 1.23% 1.620 1.640 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 -5.80% 759.000 715.000 - 6.40% -
400.perlbench -4.03% 1735.000 1665.000 - 0.06% -
447.dealII -3.93% 1323.000 1271.000 - 4.18% -
450.soplex -3.79% 581.000 559.000 - 4.29% -
437.leslie3d -3.39% 6805.000 6574.000 - 0.00% -
403.gcc -3.23% 62.000 60.000 - -6.25% -
444.namd -2.58% 697.000 679.000 - 2.57% -
410.bwaves -2.26% 4865.000 4755.000 - 0.00% -
473.astar -2.18% 5193.000 5080.000 - 4.42% -
471.omnetpp -2.11% 2657.000 2601.000 - -0.50% -
453.povray -1.57% 445.000 438.000 - -5.81% -
464.h264ref -1.49% 3956.000 3897.000 - -3.44% -
433.milc -1.38% 1235.000 1218.000 - 1.67% -
445.gobmk -1.22% 4936.000 4876.000 - -0.23% -
458.sjeng -1.16% 6718.000 6640.000 - -1.66% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -88.89% 36.000 4.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -88.72% 1.330 0.150 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -52.24% 67.000 32.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -51.94% 1.290 0.620 - 0.00% -
462.libquantum (max) -50.00% 2.000 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -47.17% 106.000 56.000 - 0.00% -
450.soplex (unexplained diff vs previous) -46.34% 41.000 22.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -46.12% 3.990 2.150 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -44.19% 7.060 3.940 - 0.00% -
459.GemsFDTD (max) -39.81% 103.000 62.000 - 0.00% -
459.GemsFDTD (max) (percentage) -38.69% 1.990 1.220 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -37.78% 1.800 1.120 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -36.92% 65.000 41.000 - 0.00% -
433.milc (unexplained diff vs previous) -29.17% 24.000 17.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -27.84% 1.940 1.400 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -26.92% 4.830 3.530 - 0.00% -
437.leslie3d (unexplained diff vs previous) -26.67% 315.000 231.000 - 0.00% -
429.mcf (unexplained diff vs previous) -24.21% 95.000 72.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -24.19% 4.630 3.510 - 0.00% -
482.sphinx3 (max) -22.64% 53.000 41.000 - 0.00% -
450.soplex (max) -20.45% 44.000 35.000 - 0.00% -
447.dealII (max) -19.67% 61.000 49.000 - 0.00% -
471.omnetpp (max) -18.18% 110.000 90.000 - 0.00% -
401.bzip2 (max) (percentage) -17.04% 1.350 1.120 - 0.00% -
429.mcf (max) (percentage) -16.74% 4.600 3.830 - 0.00% -
482.sphinx3 (max) (percentage) -16.74% 7.050 5.870 - 0.00% -
450.soplex (max) (percentage) -16.73% 7.590 6.320 - 0.00% -
433.milc (max) (percentage) -16.67% 1.980 1.650 - 0.00% -
401.bzip2 (max) -16.67% 36.000 30.000 - 0.00% -
433.milc (max) -16.67% 24.000 20.000 - 0.00% -
471.omnetpp (max) (percentage) -16.59% 4.160 3.470 - 0.00% -
410.bwaves (max) -16.41% 128.000 107.000 - 0.00% -
447.dealII (max) (percentage) -15.85% 4.670 3.930 - 0.00% -
410.bwaves (max) (percentage) -14.39% 2.640 2.260 - 0.00% -
403.gcc (max) -14.29% 7.000 6.000 - 0.00% -
429.mcf (max) -13.33% 90.000 78.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -12.00% 125.000 110.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -12.00% 50.000 44.000 - 0.00% -
447.dealII (unexplained diff vs previous) -11.86% 59.000 52.000 - 0.00% -
473.astar (max) -10.57% 123.000 110.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -10.12% 2.570 2.310 - 0.00% -
437.leslie3d (max) -8.46% 508.000 465.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -8.30% 4.460 4.090 - 0.00% -
473.astar (max) (percentage) -8.02% 2.370 2.180 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -6.68% 6.590 6.150 - 0.00% -
462.libquantum (max) (percentage) -6.15% 2.440 2.290 - 0.00% -
473.astar (unexplained diff vs previous) -5.83% 120.000 113.000 - 0.00% -
450.soplex -5.56% 18.000 17.000 - 0.00% -
450.soplex (avg) -5.56% 18.000 17.000 - 0.00% -
453.povray (max) -5.56% 18.000 17.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -5.31% 1.130 1.070 - 0.00% -
434.zeusmp -5.26% 19.000 18.000 - 0.00% -
434.zeusmp (avg) -5.26% 19.000 18.000 - 0.00% -
437.leslie3d (max) (percentage) -5.22% 7.470 7.080 - 0.00% -
459.GemsFDTD -5.17% 58.000 55.000 - 0.00% -
459.GemsFDTD (avg) -5.17% 58.000 55.000 - 0.00% -
400.perlbench -5.00% 20.000 19.000 - 0.00% -
400.perlbench (avg) -5.00% 20.000 19.000 - 0.00% -
400.perlbench (max) -5.00% 20.000 19.000 - 0.00% -
453.povray (max) (percentage) -4.80% 4.170 3.970 - 0.00% -
401.bzip2 (avg) (percentage) -4.62% 1.730 1.650 - 0.00% -
401.bzip2 -4.35% 46.000 44.000 - 0.00% -
401.bzip2 (avg) -4.35% 46.000 44.000 - 0.00% -
462.libquantum (avg) (percentage) -4.05% 1.480 1.420 - 0.00% -
437.leslie3d -3.95% 253.000 243.000 - 0.00% -
437.leslie3d (avg) -3.95% 253.000 243.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -3.90% 2.310 2.220 - 0.00% -
483.xalancbmk (max) (percentage) -3.42% 2.630 2.540 - 0.00% -
470.lbm -3.33% 30.000 29.000 - 0.00% -
470.lbm (avg) -3.33% 30.000 29.000 - 0.00% -
464.h264ref (max) -2.94% 68.000 66.000 - 0.00% -
456.hmmer (max) (percentage) -2.90% 0.690 0.670 - 0.00% -
470.lbm (max) -2.86% 35.000 34.000 - 0.00% -
403.gcc (max) (percentage) -2.45% 11.850 11.560 - 0.00% -
464.h264ref (max) (percentage) -2.30% 1.740 1.700 - 0.00% -
483.xalancbmk (max) -2.13% 94.000 92.000 - 0.00% -
434.zeusmp (avg) (percentage) -2.00% 1.000 0.980 - 0.00% -
483.xalancbmk -1.75% 57.000 56.000 - 0.00% -
483.xalancbmk (avg) -1.75% 57.000 56.000 - 0.00% -
471.omnetpp -1.64% 61.000 60.000 - 0.00% -
471.omnetpp (avg) -1.64% 61.000 60.000 - 0.00% -
435.gromacs (max) (percentage) -1.41% 0.710 0.700 - 0.00% -
483.xalancbmk (avg) (percentage) -1.27% 1.580 1.560 - 0.00% -
473.astar -1.19% 84.000 83.000 - 0.00% -
473.astar (avg) -1.19% 84.000 83.000 - 0.00% -

Added Tests - sample variability
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.89% 3240486.000 3301626.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.24% 2501.000 2707.000 - 0.15% -
429.mcf 7.03% 1906.000 2040.000 - 3.66% -
482.sphinx3 6.40% 672.000 715.000 - -5.80% -
473.astar 4.42% 4865.000 5080.000 - -2.18% -
450.soplex 4.29% 536.000 559.000 - -3.79% -
447.dealII 4.18% 1220.000 1271.000 - -3.93% -
456.hmmer 3.15% 2639.000 2722.000 - -0.66% -
444.namd 2.57% 662.000 679.000 - -2.58% -
483.xalancbmk 2.27% 3572.000 3653.000 - 1.14% -
470.lbm 2.09% 3249.000 3317.000 - -0.87% -
433.milc 1.67% 1198.000 1218.000 - -1.38% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.04% 42589.000 40442.000 - 0.00% -
444.namd -2.57% 212450.000 206981.000 - 0.00% -
458.sjeng -2.00% 146102.000 143174.000 - 0.00% -
464.h264ref -1.69% 749591.000 736915.000 - 0.00% -
450.soplex -1.17% 370392.000 366062.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -20.75% 106.000 84.000 - 0.00% -
403.gcc -6.25% 64.000 60.000 - -3.23% -
453.povray -5.81% 465.000 438.000 - -1.57% -
464.h264ref -3.44% 4036.000 3897.000 - -1.49% -
458.sjeng -1.66% 6752.000 6640.000 - -1.16% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 26.32% 19.000 24.000 - 0.00% -
nb_execution_successful 26.32% 19.000 24.000 - 0.00% -
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Added Tests - Code Size
410.bwaves
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto

Added Tests - Execution
410.bwaves
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (avg) (percentage)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
400.perlbench 1665.000 -4.03%
401.bzip2 2707.000 -
403.gcc 60.000 -3.23%
410.bwaves 4755.000 -2.26%
429.mcf 2040.000 3.66%
433.milc 1218.000 -1.38%
434.zeusmp 1929.000 -
437.leslie3d 6574.000 -3.39%
444.namd 679.000 -2.58%
445.gobmk 4876.000 -1.22%
447.dealII 1271.000 -3.93%
450.soplex 559.000 -3.79%
453.povray 438.000 -1.57%
456.hmmer 2722.000 -
458.sjeng 6640.000 -1.16%
459.GemsFDTD 5156.000 -
462.libquantum 84.000 -
464.h264ref 3897.000 -1.49%
465.tonto 20101.000 -
470.lbm 3317.000 -
471.omnetpp 2601.000 -2.11%
473.astar 5080.000 -2.18%
482.sphinx3 715.000 -5.80%
483.xalancbmk 3653.000 1.14%
Geometric Mean 1859.750 -1.55%
Name Current %
400.perlbench 1186078.000 -
401.bzip2 76454.000 -
403.gcc 3432007.000 -
410.bwaves 616115.000 -
429.mcf 13267.000 -
433.milc 137296.000 -
434.zeusmp 1018524.000 -
437.leslie3d 934787.000 -
444.namd 206981.000 -
445.gobmk 2113313.000 -
447.dealII 3301626.000 -
450.soplex 366062.000 -
453.povray 962370.000 -
456.hmmer 300740.000 -
458.sjeng 143174.000 -
459.GemsFDTD 1274231.000 -
462.libquantum 40442.000 -
464.h264ref 736915.000 -
465.tonto 10930709.000 -
470.lbm 12117.000 -
471.omnetpp 680034.000 -
473.astar 42000.000 -
482.sphinx3 196733.000 -
483.xalancbmk 4310708.000 -
Geometric Mean 419604.351 -
Name Current %
400.perlbench 19.000 -5.00%
400.perlbench (avg) 19.000 -5.00%
400.perlbench (avg) (percentage) 1.160 -
400.perlbench (max) 19.000 -5.00%
400.perlbench (max) (percentage) 1.200 -
401.bzip2 44.000 -4.35%
401.bzip2 (avg) 44.000 -4.35%
401.bzip2 (avg) (percentage) 1.650 -4.62%
401.bzip2 (max) 30.000 -16.67%
401.bzip2 (max) (percentage) 1.120 -17.04%
401.bzip2 (unexplained diff vs previous) 4.000 -88.89%
401.bzip2 (unexplained diff vs previous) (percentage) 0.150 -88.72%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.320 -
403.gcc (max) 6.000 -14.29%
403.gcc (max) (percentage) 11.560 -2.45%
410.bwaves 62.000 1.64%
410.bwaves (avg) 62.000 1.64%
410.bwaves (avg) (percentage) 1.320 4.76%
410.bwaves (max) 107.000 -16.41%
410.bwaves (max) (percentage) 2.260 -14.39%
410.bwaves (unexplained diff vs previous) 110.000 -12.00%
410.bwaves (unexplained diff vs previous) (percentage) 2.310 -10.12%
429.mcf 75.000 2.74%
429.mcf (avg) 75.000 2.74%
429.mcf (avg) (percentage) 3.710 -
429.mcf (max) 78.000 -13.33%
429.mcf (max) (percentage) 3.830 -16.74%
429.mcf (unexplained diff vs previous) 72.000 -24.21%
429.mcf (unexplained diff vs previous) (percentage) 3.530 -26.92%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.100 -
433.milc (max) 20.000 -16.67%
433.milc (max) (percentage) 1.650 -16.67%
433.milc (unexplained diff vs previous) 17.000 -29.17%
433.milc (unexplained diff vs previous) (percentage) 1.400 -27.84%
434.zeusmp 18.000 -5.26%
434.zeusmp (avg) 18.000 -5.26%
434.zeusmp (avg) (percentage) 0.980 -2.00%
434.zeusmp (max) 29.000 -
434.zeusmp (max) (percentage) 1.520 -
434.zeusmp (unexplained diff vs previous) 13.000 160.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.670 157.69%
435.gromacs (avg) (percentage) 0.680 -
435.gromacs (max) (percentage) 0.700 -1.41%
436.cactusADM (avg) (percentage) 0.670 -
436.cactusADM (max) (percentage) 0.750 -
437.leslie3d 243.000 -3.95%
437.leslie3d (avg) 243.000 -3.95%
437.leslie3d (avg) (percentage) 3.700 -
437.leslie3d (max) 465.000 -8.46%
437.leslie3d (max) (percentage) 7.080 -5.22%
437.leslie3d (unexplained diff vs previous) 231.000 -26.67%
437.leslie3d (unexplained diff vs previous) (percentage) 3.510 -24.19%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.140 6.54%
444.namd (max) 17.000 -
444.namd (max) (percentage) 2.580 4.03%
444.namd (unexplained diff vs previous) 18.000 20.00%
444.namd (unexplained diff vs previous) (percentage) 2.650 23.26%
445.gobmk 39.000 2.63%
445.gobmk (avg) 39.000 2.63%
445.gobmk (avg) (percentage) 0.820 3.80%
445.gobmk (max) 59.000 168.18%
445.gobmk (max) (percentage) 1.220 165.22%
445.gobmk (unexplained diff vs previous) 60.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.230 -
447.dealII 27.000 -
447.dealII (avg) 27.000 -
447.dealII (avg) (percentage) 2.190 6.31%
447.dealII (max) 49.000 -19.67%
447.dealII (max) (percentage) 3.930 -15.85%
447.dealII (unexplained diff vs previous) 52.000 -11.86%
447.dealII (unexplained diff vs previous) (percentage) 4.090 -8.30%
450.soplex 17.000 -5.56%
450.soplex (avg) 17.000 -5.56%
450.soplex (avg) (percentage) 3.220 -
450.soplex (max) 35.000 -20.45%
450.soplex (max) (percentage) 6.320 -16.73%
450.soplex (unexplained diff vs previous) 22.000 -46.34%
450.soplex (unexplained diff vs previous) (percentage) 3.940 -44.19%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.720 -
453.povray (max) 17.000 -5.56%
453.povray (max) (percentage) 3.970 -4.80%
453.povray (unexplained diff vs previous) 7.000 133.33%
453.povray (unexplained diff vs previous) (percentage) 1.600 138.81%
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.360 2.86%
456.hmmer (max) 18.000 -
456.hmmer (max) (percentage) 0.670 -2.90%
456.hmmer (unexplained diff vs previous) 18.000 28.57%
456.hmmer (unexplained diff vs previous) (percentage) 0.660 29.41%
458.sjeng 39.000 5.41%
458.sjeng (avg) 39.000 5.41%
458.sjeng (avg) (percentage) 0.590 5.36%
458.sjeng (max) 77.000 -
458.sjeng (max) (percentage) 1.160 -
458.sjeng (unexplained diff vs previous) 78.000 1.30%
458.sjeng (unexplained diff vs previous) (percentage) 1.170 1.74%
459.GemsFDTD 55.000 -5.17%
459.GemsFDTD (avg) 55.000 -5.17%
459.GemsFDTD (avg) (percentage) 1.070 -5.31%
459.GemsFDTD (max) 62.000 -39.81%
459.GemsFDTD (max) (percentage) 1.220 -38.69%
459.GemsFDTD (unexplained diff vs previous) 32.000 -52.24%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.620 -51.94%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.420 -4.05%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 2.290 -6.15%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 32.000 3.23%
464.h264ref (avg) 32.000 3.23%
464.h264ref (avg) (percentage) 0.840 5.00%
464.h264ref (max) 66.000 -2.94%
464.h264ref (max) (percentage) 1.700 -2.30%
464.h264ref (unexplained diff vs previous) 59.000 9.26%
464.h264ref (unexplained diff vs previous) (percentage) 1.510 10.22%
470.lbm 29.000 -3.33%
470.lbm (avg) 29.000 -3.33%
470.lbm (avg) (percentage) 0.900 -
470.lbm (max) 34.000 -2.86%
470.lbm (max) (percentage) 1.050 -
470.lbm (unexplained diff vs previous) 29.000 3.57%
470.lbm (unexplained diff vs previous) (percentage) 0.870 3.57%
471.omnetpp 60.000 -1.64%
471.omnetpp (avg) 60.000 -1.64%
471.omnetpp (avg) (percentage) 2.320 -
471.omnetpp (max) 90.000 -18.18%
471.omnetpp (max) (percentage) 3.470 -16.59%
471.omnetpp (unexplained diff vs previous) 56.000 -47.17%
471.omnetpp (unexplained diff vs previous) (percentage) 2.150 -46.12%
473.astar 83.000 -1.19%
473.astar (avg) 83.000 -1.19%
473.astar (avg) (percentage) 1.640 1.23%
473.astar (max) 110.000 -10.57%
473.astar (max) (percentage) 2.180 -8.02%
473.astar (unexplained diff vs previous) 113.000 -5.83%
473.astar (unexplained diff vs previous) (percentage) 2.220 -3.90%
482.sphinx3 19.000 -
482.sphinx3 (avg) 19.000 -
482.sphinx3 (avg) (percentage) 2.780 6.11%
482.sphinx3 (max) 41.000 -22.64%
482.sphinx3 (max) (percentage) 5.870 -16.74%
482.sphinx3 (unexplained diff vs previous) 44.000 -12.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 6.150 -6.68%
483.xalancbmk 56.000 -1.75%
483.xalancbmk (avg) 56.000 -1.75%
483.xalancbmk (avg) (percentage) 1.560 -1.27%
483.xalancbmk (max) 92.000 -2.13%
483.xalancbmk (max) (percentage) 2.540 -3.42%
483.xalancbmk (unexplained diff vs previous) 41.000 -36.92%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.120 -37.78%
Geometric Mean 7.246 -18.92%