Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/13b6284b9321ea684b4df299f430124681a14d90 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/145/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0145 (no-change) 2024-05-31T10:18:40 0:00:00
Previous 0143 (llvmorg-19-init-12985-g13b6284b9321) 2024-05-31T03:01:15 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 49 10
Performance Improvements 100 18
Added Tests 4 163
Unchanged Tests 987 949
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 3.58% 6205.000 6427.000 - 0.00% -
400.perlbench 3.14% 1496.000 1543.000 - 4.68% -
453.povray 1.99% 402.000 410.000 - -2.61% -
403.gcc 1.75% 57.000 58.000 - -1.69% -
435.gromacs 1.69% 4509.000 4585.000 - 0.00% -
434.zeusmp 1.68% 1910.000 1942.000 - 0.00% -
462.libquantum 1.23% 81.000 82.000 - -24.07% -
473.astar 1.00% 4895.000 4944.000 - 6.60% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) 2450.00% 2.000 51.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 2350.00% 0.040 0.980 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) 1900.00% 1.000 20.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 1400.00% 1.000 15.000 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) (percentage) 1200.00% 0.010 0.130 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 1100.00% 0.020 0.240 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) (percentage) 177.78% 0.090 0.250 0.000 0.00% 0.000
434.zeusmp (max) 166.67% 12.000 32.000 - 0.00% -
481.wrf (unexplained diff vs previous) 166.67% 3.000 8.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 157.89% 19.000 49.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 153.85% 0.390 0.990 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 147.06% 0.680 1.680 - 0.00% -
434.zeusmp (unexplained diff vs previous) 146.15% 13.000 32.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 142.65% 0.680 1.650 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 140.43% 0.470 1.130 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 140.00% 5.000 12.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 119.05% 0.420 0.920 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) 118.75% 16.000 35.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 68.89% 45.000 76.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 66.00% 1.000 1.660 0.000 0.00% 0.000
433.milc (max) (percentage) 60.00% 0.700 1.120 - 0.00% -
433.milc (max) 57.14% 7.000 11.000 - 0.00% -
453.povray 25.00% 4.000 5.000 - 0.00% -
453.povray (avg) 25.00% 4.000 5.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 21.59% 0.880 1.070 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 20.83% 24.000 29.000 0.000 0.00% 0.000
401.bzip2 (max) (percentage) 20.45% 0.880 1.060 - 0.00% -
434.zeusmp 20.00% 10.000 12.000 - 0.00% -
434.zeusmp (avg) 20.00% 10.000 12.000 - 0.00% -
401.bzip2 (max) 16.67% 24.000 28.000 - 0.00% -
434.zeusmp (avg) (percentage) 16.36% 0.550 0.640 - 0.00% -
416.gamess 15.38% 13.000 15.000 - 0.00% -
416.gamess (avg) 15.38% 13.000 15.000 - 0.00% -
416.gamess (avg) (percentage) 11.11% 0.090 0.100 - 0.00% -
459.GemsFDTD (avg) (percentage) 6.78% 0.590 0.630 - 0.00% -
459.GemsFDTD 6.67% 30.000 32.000 - 0.00% -
459.GemsFDTD (avg) 6.67% 30.000 32.000 - 0.00% -
453.povray (avg) (percentage) 5.98% 1.170 1.240 - 0.00% -
437.leslie3d 2.31% 260.000 266.000 - 0.00% -
437.leslie3d (avg) 2.31% 260.000 266.000 - 0.00% -
433.milc (avg) (percentage) 1.10% 0.910 0.920 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
433.milc -1.12% 1075.000 1063.000 - 0.85% -
401.bzip2 -1.06% 2736.000 2707.000 - 7.85% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -86.36% 22.000 3.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -86.36% 1.540 0.210 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -85.98% 1.070 0.150 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -85.71% 14.000 2.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -81.65% 2.780 0.510 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -81.48% 27.000 5.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -77.17% 2.190 0.500 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -77.08% 48.000 11.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -75.47% 0.530 0.130 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -75.00% 24.000 6.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -73.90% 3.640 0.950 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -73.68% 19.000 5.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -50.00% 2.000 1.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -50.00% 0.040 0.020 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -50.00% 10.000 5.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -49.30% 1.420 0.720 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -38.17% 5.580 3.450 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -35.84% 346.000 222.000 0.000 0.00% 0.000
410.bwaves (max) -32.00% 25.000 17.000 - 0.00% -
437.leslie3d (max) (percentage) -30.21% 6.620 4.620 - 0.00% -
410.bwaves (max) (percentage) -29.82% 0.570 0.400 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -28.83% 2.740 1.950 0.000 0.00% 0.000
436.cactusADM (max) -28.57% 14.000 10.000 - 0.00% -
437.leslie3d (max) -27.80% 410.000 296.000 - 0.00% -
453.povray (unexplained diff vs previous) -27.27% 11.000 8.000 0.000 0.00% 0.000
436.cactusADM (max) (percentage) -25.00% 1.080 0.810 - 0.00% -
453.povray (max) (percentage) -24.81% 2.660 2.000 - 0.00% -
453.povray (max) -20.00% 10.000 8.000 - 0.00% -
429.mcf (max) -19.05% 21.000 17.000 - 0.00% -
450.soplex (max) (percentage) -16.81% 3.510 2.920 - 0.00% -
450.soplex (max) -16.67% 18.000 15.000 - 0.00% -
429.mcf (max) (percentage) -16.56% 1.510 1.260 - 0.00% -
482.sphinx3 (max) -14.29% 21.000 18.000 - 0.00% -
470.lbm (max) -12.50% 8.000 7.000 - 0.00% -
470.lbm (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
444.namd (max) -11.11% 9.000 8.000 - 0.00% -
458.sjeng (max) -11.11% 36.000 32.000 - 0.00% -
436.cactusADM -10.00% 10.000 9.000 - 0.00% -
436.cactusADM (avg) -10.00% 10.000 9.000 - 0.00% -
482.sphinx3 (max) (percentage) -9.93% 3.020 2.720 - 0.00% -
481.wrf (avg) (percentage) -9.89% 0.910 0.820 - 0.00% -
445.gobmk (max) -9.52% 21.000 19.000 - 0.00% -
458.sjeng (max) (percentage) -8.77% 0.570 0.520 - 0.00% -
445.gobmk (max) (percentage) -8.70% 0.460 0.420 - 0.00% -
473.astar (max) (percentage) -8.50% 1.530 1.400 - 0.00% -
447.dealII (max) -7.69% 26.000 24.000 - 0.00% -
445.gobmk (avg) (percentage) -7.53% 0.930 0.860 - 0.00% -
471.omnetpp (max) (percentage) -7.42% 5.660 5.240 - 0.00% -
471.omnetpp (max) -7.26% 124.000 115.000 - 0.00% -
456.hmmer (max) (percentage) -7.14% 0.280 0.260 - 0.00% -
445.gobmk -7.14% 42.000 39.000 - 0.00% -
445.gobmk (avg) -7.14% 42.000 39.000 - 0.00% -
481.wrf -7.14% 28.000 26.000 - 0.00% -
481.wrf (avg) -7.14% 28.000 26.000 - 0.00% -
447.dealII (max) (percentage) -7.01% 2.710 2.520 - 0.00% -
473.astar (max) -6.76% 74.000 69.000 - 0.00% -
403.gcc (max) (percentage) -6.65% 5.560 5.190 - 0.00% -
481.wrf (max) (percentage) -6.56% 1.220 1.140 - 0.00% -
436.cactusADM (avg) (percentage) -6.17% 0.810 0.760 - 0.00% -
464.h264ref (max) -6.12% 49.000 46.000 - 0.00% -
403.gcc (avg) (percentage) -5.93% 3.880 3.650 - 0.00% -
482.sphinx3 -5.88% 17.000 16.000 - 0.00% -
482.sphinx3 (avg) -5.88% 17.000 16.000 - 0.00% -
444.namd (max) (percentage) -5.71% 1.400 1.320 - 0.00% -
481.wrf (max) -5.26% 38.000 36.000 - 0.00% -
471.omnetpp (avg) (percentage) -4.95% 3.030 2.880 - 0.00% -
471.omnetpp -4.55% 66.000 63.000 - 0.00% -
471.omnetpp (avg) -4.55% 66.000 63.000 - 0.00% -
482.sphinx3 (avg) (percentage) -4.53% 2.430 2.320 - 0.00% -
444.namd (avg) (percentage) -4.50% 1.110 1.060 - 0.00% -
447.dealII (avg) (percentage) -4.48% 1.340 1.280 - 0.00% -
429.mcf -4.35% 46.000 44.000 - 0.00% -
429.mcf (avg) -4.35% 46.000 44.000 - 0.00% -
410.bwaves (avg) (percentage) -4.17% 0.720 0.690 - 0.00% -
456.hmmer (avg) (percentage) -4.00% 0.250 0.240 - 0.00% -
401.bzip2 -4.00% 50.000 48.000 - 0.00% -
401.bzip2 (avg) -4.00% 50.000 48.000 - 0.00% -
459.GemsFDTD (max) (percentage) -3.92% 1.020 0.980 - 0.00% -
464.h264ref (max) (percentage) -3.88% 1.290 1.240 - 0.00% -
450.soplex (avg) (percentage) -3.73% 2.410 2.320 - 0.00% -
429.mcf (avg) (percentage) -3.41% 3.230 3.120 - 0.00% -
410.bwaves -3.12% 32.000 31.000 - 0.00% -
410.bwaves (avg) -3.12% 32.000 31.000 - 0.00% -
470.lbm -3.12% 32.000 31.000 - 0.00% -
470.lbm (avg) -3.12% 32.000 31.000 - 0.00% -
470.lbm (avg) (percentage) -3.09% 0.970 0.940 - 0.00% -
401.bzip2 (avg) (percentage) -2.72% 1.840 1.790 - 0.00% -
464.h264ref -2.63% 38.000 37.000 - 0.00% -
464.h264ref (avg) -2.63% 38.000 37.000 - 0.00% -
458.sjeng (avg) (percentage) -2.00% 0.500 0.490 - 0.00% -
459.GemsFDTD (max) -1.92% 52.000 51.000 - 0.00% -
435.gromacs (max) (percentage) -1.81% 2.210 2.170 - 0.00% -
473.astar (avg) (percentage) -1.69% 1.780 1.750 - 0.00% -
462.libquantum (max) (percentage) -1.60% 1.250 1.230 - 0.00% -
435.gromacs (avg) (percentage) -1.57% 1.910 1.880 - 0.00% -
437.leslie3d (avg) (percentage) -1.19% 4.200 4.150 - 0.00% -
473.astar -1.15% 87.000 86.000 - 0.00% -
473.astar (avg) -1.15% 87.000 86.000 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.73% 128200.000 130424.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 7.85% 2510.000 2707.000 - -1.06% -
473.astar 6.60% 4638.000 4944.000 - 1.00% -
456.hmmer 5.92% 2637.000 2793.000 - -0.07% -
482.sphinx3 4.97% 664.000 697.000 - -0.71% -
400.perlbench 4.68% 1474.000 1543.000 - 3.14% -
470.lbm 2.69% 3235.000 3322.000 - 0.09% -
471.omnetpp 2.46% 2153.000 2206.000 - 0.50% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.02% 45013.000 38251.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.12% 168697.000 165116.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
471.omnetpp -1.64% 754667.000 742320.000 - 0.00% -
450.soplex -1.42% 319083.000 314543.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.03% 1269683.000 1256624.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -24.07% 108.000 82.000 - 1.23% -
429.mcf -24.00% 1879.000 1428.000 - -0.21% -
464.h264ref -4.41% 3965.000 3790.000 - -0.92% -
453.povray -2.61% 421.000 410.000 - 1.99% -
447.dealII -2.60% 1001.000 975.000 - 0.52% -
450.soplex -2.41% 540.000 527.000 - 0.96% -
403.gcc -1.69% 59.000 58.000 - 1.75% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1543.000 3.14%
401.bzip2 2707.000 -1.06%
403.gcc 58.000 1.75%
410.bwaves 4494.000 -
416.gamess 15191.000 -
429.mcf 1428.000 -
433.milc 1063.000 -1.12%
434.zeusmp 1942.000 1.68%
435.gromacs 4585.000 1.69%
436.cactusADM 1308.000 -
437.leslie3d 6427.000 3.58%
444.namd 677.000 -
445.gobmk 4612.000 -
447.dealII 975.000 -
450.soplex 527.000 -
453.povray 410.000 1.99%
456.hmmer 2793.000 -
458.sjeng 6335.000 -
459.GemsFDTD 5229.000 -
462.libquantum 82.000 1.23%
464.h264ref 3790.000 -
465.tonto 20290.000 -
470.lbm 3322.000 -
471.omnetpp 2206.000 -
473.astar 4944.000 1.00%
481.wrf 3171.000 -
482.sphinx3 697.000 -
Geometric Mean 1938.492 -
Name Current %
400.perlbench 1256624.000 -
401.bzip2 68318.000 -
403.gcc 3788143.000 -
410.bwaves 632124.000 -
416.gamess 8288905.000 -
429.mcf 11448.000 -
433.milc 130424.000 -
434.zeusmp 1011947.000 -
435.gromacs 701836.000 -
436.cactusADM 1141414.000 -
437.leslie3d 944605.000 -
444.namd 165116.000 -
445.gobmk 2238948.000 -
447.dealII 556182.000 -
450.soplex 314543.000 -
453.povray 1125697.000 -
456.hmmer 163763.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1244166.000 -
462.libquantum 38251.000 -
464.h264ref 768477.000 -
465.tonto 9844722.000 -
470.lbm 10777.000 -
471.omnetpp 742320.000 -
473.astar 32444.000 -
481.wrf 6124978.000 -
482.sphinx3 175838.000 -
Geometric Mean 443969.484 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 48.000 -4.00%
401.bzip2 (avg) 48.000 -4.00%
401.bzip2 (avg) (percentage) 1.790 -2.72%
401.bzip2 (max) 28.000 16.67%
401.bzip2 (max) (percentage) 1.060 20.45%
401.bzip2 (unexplained diff vs previous) 29.000 20.83%
401.bzip2 (unexplained diff vs previous) (percentage) 1.070 21.59%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.650 -5.93%
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.190 -6.65%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.720 -
410.bwaves 31.000 -3.12%
410.bwaves (avg) 31.000 -3.12%
410.bwaves (avg) (percentage) 0.690 -4.17%
410.bwaves (max) 17.000 -32.00%
410.bwaves (max) (percentage) 0.400 -29.82%
410.bwaves (unexplained diff vs previous) 6.000 -75.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.130 -75.47%
416.gamess 15.000 15.38%
416.gamess (avg) 15.000 15.38%
416.gamess (avg) (percentage) 0.100 11.11%
416.gamess (max) 25.000 -
416.gamess (max) (percentage) 0.170 -
416.gamess (unexplained diff vs previous) 20.000 1900.00%
416.gamess (unexplained diff vs previous) (percentage) 0.130 1200.00%
429.mcf 44.000 -4.35%
429.mcf (avg) 44.000 -4.35%
429.mcf (avg) (percentage) 3.120 -3.41%
429.mcf (max) 17.000 -19.05%
429.mcf (max) (percentage) 1.260 -16.56%
429.mcf (unexplained diff vs previous) 3.000 -86.36%
429.mcf (unexplained diff vs previous) (percentage) 0.210 -86.36%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.920 1.10%
433.milc (max) 11.000 57.14%
433.milc (max) (percentage) 1.120 60.00%
433.milc (unexplained diff vs previous) 12.000 140.00%
433.milc (unexplained diff vs previous) (percentage) 1.130 140.43%
434.zeusmp 12.000 20.00%
434.zeusmp (avg) 12.000 20.00%
434.zeusmp (avg) (percentage) 0.640 16.36%
434.zeusmp (max) 32.000 166.67%
434.zeusmp (max) (percentage) 1.680 147.06%
434.zeusmp (unexplained diff vs previous) 32.000 146.15%
434.zeusmp (unexplained diff vs previous) (percentage) 1.650 142.65%
435.gromacs 86.000 -
435.gromacs (avg) 86.000 -
435.gromacs (avg) (percentage) 1.880 -1.57%
435.gromacs (max) 99.000 -
435.gromacs (max) (percentage) 2.170 -1.81%
435.gromacs (unexplained diff vs previous) 76.000 68.89%
435.gromacs (unexplained diff vs previous) (percentage) 1.660 66.00%
436.cactusADM 9.000 -10.00%
436.cactusADM (avg) 9.000 -10.00%
436.cactusADM (avg) (percentage) 0.760 -6.17%
436.cactusADM (max) 10.000 -28.57%
436.cactusADM (max) (percentage) 0.810 -25.00%
436.cactusADM (unexplained diff vs previous) 2.000 -85.71%
436.cactusADM (unexplained diff vs previous) (percentage) 0.150 -85.98%
437.leslie3d 266.000 2.31%
437.leslie3d (avg) 266.000 2.31%
437.leslie3d (avg) (percentage) 4.150 -1.19%
437.leslie3d (max) 296.000 -27.80%
437.leslie3d (max) (percentage) 4.620 -30.21%
437.leslie3d (unexplained diff vs previous) 222.000 -35.84%
437.leslie3d (unexplained diff vs previous) (percentage) 3.450 -38.17%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.060 -4.50%
444.namd (max) 8.000 -11.11%
444.namd (max) (percentage) 1.320 -5.71%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.150 -
445.gobmk 39.000 -7.14%
445.gobmk (avg) 39.000 -7.14%
445.gobmk (avg) (percentage) 0.860 -7.53%
445.gobmk (max) 19.000 -9.52%
445.gobmk (max) (percentage) 0.420 -8.70%
445.gobmk (unexplained diff vs previous) 1.000 -50.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -50.00%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.280 -4.48%
447.dealII (max) 24.000 -7.69%
447.dealII (max) (percentage) 2.520 -7.01%
447.dealII (unexplained diff vs previous) 5.000 -81.48%
447.dealII (unexplained diff vs previous) (percentage) 0.510 -81.65%
450.soplex 12.000 -
450.soplex (avg) 12.000 -
450.soplex (avg) (percentage) 2.320 -3.73%
450.soplex (max) 15.000 -16.67%
450.soplex (max) (percentage) 2.920 -16.81%
450.soplex (unexplained diff vs previous) 5.000 -73.68%
450.soplex (unexplained diff vs previous) (percentage) 0.950 -73.90%
453.povray 5.000 25.00%
453.povray (avg) 5.000 25.00%
453.povray (avg) (percentage) 1.240 5.98%
453.povray (max) 8.000 -20.00%
453.povray (max) (percentage) 2.000 -24.81%
453.povray (unexplained diff vs previous) 8.000 -27.27%
453.povray (unexplained diff vs previous) (percentage) 1.950 -28.83%
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.240 -4.00%
456.hmmer (max) 7.000 -
456.hmmer (max) (percentage) 0.260 -7.14%
456.hmmer (unexplained diff vs previous) 2.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.070 -
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.490 -2.00%
458.sjeng (max) 32.000 -11.11%
458.sjeng (max) (percentage) 0.520 -8.77%
458.sjeng (unexplained diff vs previous) 15.000 1400.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.240 1100.00%
459.GemsFDTD 32.000 6.67%
459.GemsFDTD (avg) 32.000 6.67%
459.GemsFDTD (avg) (percentage) 0.630 6.78%
459.GemsFDTD (max) 51.000 -1.92%
459.GemsFDTD (max) (percentage) 0.980 -3.92%
459.GemsFDTD (unexplained diff vs previous) 51.000 2450.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.980 2350.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.520 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.230 -1.60%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.220 -
464.h264ref 37.000 -2.63%
464.h264ref (avg) 37.000 -2.63%
464.h264ref (avg) (percentage) 1.000 -
464.h264ref (max) 46.000 -6.12%
464.h264ref (max) (percentage) 1.240 -3.88%
464.h264ref (unexplained diff vs previous) 35.000 118.75%
464.h264ref (unexplained diff vs previous) (percentage) 0.920 119.05%
470.lbm 31.000 -3.12%
470.lbm (avg) 31.000 -3.12%
470.lbm (avg) (percentage) 0.940 -3.09%
470.lbm (max) 7.000 -12.50%
470.lbm (max) (percentage) 0.220 -12.00%
470.lbm (unexplained diff vs previous) 3.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.090 -
471.omnetpp 63.000 -4.55%
471.omnetpp (avg) 63.000 -4.55%
471.omnetpp (avg) (percentage) 2.880 -4.95%
471.omnetpp (max) 115.000 -7.26%
471.omnetpp (max) (percentage) 5.240 -7.42%
471.omnetpp (unexplained diff vs previous) 11.000 -77.08%
471.omnetpp (unexplained diff vs previous) (percentage) 0.500 -77.17%
473.astar 86.000 -1.15%
473.astar (avg) 86.000 -1.15%
473.astar (avg) (percentage) 1.750 -1.69%
473.astar (max) 69.000 -6.76%
473.astar (max) (percentage) 1.400 -8.50%
473.astar (unexplained diff vs previous) 49.000 157.89%
473.astar (unexplained diff vs previous) (percentage) 0.990 153.85%
481.wrf 26.000 -7.14%
481.wrf (avg) 26.000 -7.14%
481.wrf (avg) (percentage) 0.820 -9.89%
481.wrf (max) 36.000 -5.26%
481.wrf (max) (percentage) 1.140 -6.56%
481.wrf (unexplained diff vs previous) 8.000 166.67%
481.wrf (unexplained diff vs previous) (percentage) 0.250 177.78%
482.sphinx3 16.000 -5.88%
482.sphinx3 (avg) 16.000 -5.88%
482.sphinx3 (avg) (percentage) 2.320 -4.53%
482.sphinx3 (max) 18.000 -14.29%
482.sphinx3 (max) (percentage) 2.720 -9.93%
482.sphinx3 (unexplained diff vs previous) 5.000 -50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.720 -49.30%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.970 -
Geometric Mean 4.013 -2.93%