Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f33536468b7f05c05c8cf8088427b0b5b665eb65 (+ 1 commits)
regression LLVM-1463
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/240/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0240 (llvmorg-20-init-14084-gf33536468b7f) 2024-11-30T17:59:48 0:00:00
Previous 0239 (llvmorg-20-init-14083-g81d82cac8c4c) 2024-11-27T22:30:40 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 79 4
Performance Improvements 62 22
Added Tests 13 151
Unchanged Tests 1010 987
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 7.32% 82.000 88.000 - -1.12% -
450.soplex 6.25% 480.000 510.000 - -2.49% -
473.astar 3.05% 4986.000 5138.000 - -1.02% -
447.dealII 1.67% 1561.000 1587.000 - -0.81% -
482.sphinx3 1.43% 767.000 778.000 - -2.51% -
458.sjeng 1.28% 6935.000 7024.000 - -2.32% -
444.namd 1.06% 662.000 669.000 - -1.33% -
470.lbm 1.05% 3140.000 3173.000 - -0.41% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) (percentage) 1046.21% 1.320 15.130 - 0.00% -
429.mcf (max) 914.29% 21.000 213.000 - 0.00% -
416.gamess (max) 180.00% 30.000 84.000 - 0.00% -
416.gamess (max) (percentage) 175.00% 0.080 0.220 - 0.00% -
459.GemsFDTD (max) 147.95% 73.000 181.000 - 0.00% -
459.GemsFDTD (max) (percentage) 144.44% 0.360 0.880 - 0.00% -
462.libquantum 100.00% 1.000 2.000 - 0.00% -
462.libquantum (avg) 100.00% 1.000 2.000 - 0.00% -
462.libquantum (max) 100.00% 3.000 6.000 - 0.00% -
464.h264ref (max) 85.71% 21.000 39.000 - 0.00% -
464.h264ref (max) (percentage) 84.62% 0.520 0.960 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 75.00% 0.600 1.050 - 0.00% -
444.namd (unexplained diff vs previous) 75.00% 4.000 7.000 - 0.00% -
462.libquantum (max) (percentage) 57.42% 4.650 7.320 - 0.00% -
462.libquantum (unexplained diff vs previous) 50.00% 4.000 6.000 - 0.00% -
464.h264ref 50.00% 10.000 15.000 - 0.00% -
464.h264ref (avg) 50.00% 10.000 15.000 - 0.00% -
429.mcf (avg) (percentage) 46.98% 1.490 2.190 - 0.00% -
458.sjeng (unexplained diff vs previous) 43.55% 62.000 89.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 42.70% 0.890 1.270 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 39.75% 4.880 6.820 - 0.00% -
436.cactusADM (unexplained diff vs previous) 38.46% 13.000 18.000 - 0.00% -
464.h264ref (avg) (percentage) 37.04% 0.270 0.370 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 35.00% 0.200 0.270 - 0.00% -
458.sjeng (max) 34.85% 66.000 89.000 - 0.00% -
458.sjeng (max) (percentage) 33.33% 0.960 1.280 - 0.00% -
429.mcf 25.00% 24.000 30.000 - 0.00% -
429.mcf (avg) 25.00% 24.000 30.000 - 0.00% -
450.soplex 20.00% 10.000 12.000 - 0.00% -
450.soplex (avg) 20.00% 10.000 12.000 - 0.00% -
473.astar 17.14% 35.000 41.000 - 0.00% -
473.astar (avg) 17.14% 35.000 41.000 - 0.00% -
459.GemsFDTD 14.75% 61.000 70.000 - 0.00% -
459.GemsFDTD (avg) 14.75% 61.000 70.000 - 0.00% -
436.cactusADM (avg) (percentage) 14.29% 0.140 0.160 - 0.00% -
459.GemsFDTD (avg) (percentage) 13.33% 0.300 0.340 - 0.00% -
473.astar (avg) (percentage) 12.50% 0.720 0.810 - 0.00% -
416.gamess 11.76% 34.000 38.000 - 0.00% -
416.gamess (avg) 11.76% 34.000 38.000 - 0.00% -
458.sjeng 11.76% 34.000 38.000 - 0.00% -
458.sjeng (avg) 11.76% 34.000 38.000 - 0.00% -
416.gamess (avg) (percentage) 11.11% 0.090 0.100 - 0.00% -
436.cactusADM 11.11% 9.000 10.000 - 0.00% -
436.cactusADM (avg) 11.11% 9.000 10.000 - 0.00% -
458.sjeng (avg) (percentage) 10.00% 0.500 0.550 - 0.00% -
434.zeusmp 10.00% 10.000 11.000 - 0.00% -
434.zeusmp (avg) 10.00% 10.000 11.000 - 0.00% -
462.libquantum (avg) (percentage) 9.62% 2.390 2.620 - 0.00% -
450.soplex (avg) (percentage) 8.81% 2.270 2.470 - 0.00% -
435.gromacs 8.57% 70.000 76.000 - 0.00% -
435.gromacs (avg) 8.57% 70.000 76.000 - 0.00% -
435.gromacs (avg) (percentage) 7.32% 0.410 0.440 - 0.00% -
447.dealII (avg) (percentage) 7.07% 0.990 1.060 - 0.00% -
410.bwaves (avg) (percentage) 6.67% 0.150 0.160 - 0.00% -
410.bwaves 6.67% 30.000 32.000 - 0.00% -
410.bwaves (avg) 6.67% 30.000 32.000 - 0.00% -
447.dealII 6.67% 15.000 16.000 - 0.00% -
447.dealII (avg) 6.67% 15.000 16.000 - 0.00% -
470.lbm 5.88% 17.000 18.000 - 0.00% -
470.lbm (avg) 5.88% 17.000 18.000 - 0.00% -
437.leslie3d (avg) (percentage) 4.76% 0.210 0.220 - 0.00% -
437.leslie3d 4.35% 92.000 96.000 - 0.00% -
437.leslie3d (avg) 4.35% 92.000 96.000 - 0.00% -
433.milc (avg) (percentage) 3.77% 0.530 0.550 - 0.00% -
410.bwaves (unexplained diff vs previous) 3.66% 82.000 85.000 - 0.00% -
470.lbm (avg) (percentage) 3.51% 0.570 0.590 - 0.00% -
444.namd (avg) (percentage) 2.56% 0.780 0.800 - 0.00% -
400.perlbench 2.50% 40.000 41.000 - 0.00% -
400.perlbench (avg) 2.50% 40.000 41.000 - 0.00% -
410.bwaves (max) 2.44% 82.000 84.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -3.70% 27.000 26.000 - 8.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
445.gobmk -99.96% 4885.000 2.000 - -99.96% -
429.mcf -15.13% 1666.000 1414.000 - -26.35% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -76.11% 3.140 0.750 - 0.00% -
401.bzip2 (unexplained diff vs previous) -75.95% 79.000 19.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -75.46% 2.730 0.670 - 0.00% -
471.omnetpp (unexplained diff vs previous) -75.36% 69.000 17.000 - 0.00% -
456.hmmer (max) -50.00% 14.000 7.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -48.42% 1.900 0.980 - 0.00% -
433.milc (unexplained diff vs previous) -47.83% 23.000 12.000 - 0.00% -
456.hmmer (max) (percentage) -45.10% 0.510 0.280 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -43.42% 0.760 0.430 - 0.00% -
437.leslie3d (unexplained diff vs previous) -42.90% 331.000 189.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -42.11% 0.380 0.220 - 0.00% -
434.zeusmp (unexplained diff vs previous) -40.62% 32.000 19.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -34.38% 8.960 5.880 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -33.33% 1.560 1.040 - 0.00% -
470.lbm (unexplained diff vs previous) -32.65% 49.000 33.000 - 0.00% -
450.soplex (unexplained diff vs previous) -30.23% 43.000 30.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -29.10% 1.340 0.950 - 0.00% -
447.dealII (max) (percentage) -28.69% 2.510 1.790 - 0.00% -
435.gromacs (unexplained diff vs previous) -28.57% 231.000 165.000 - 0.00% -
447.dealII (max) -28.21% 39.000 28.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -28.06% 1.960 1.410 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -26.67% 15.000 11.000 - 0.00% -
435.gromacs (max) (percentage) -25.00% 1.320 0.990 - 0.00% -
435.gromacs (max) -24.23% 227.000 172.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -23.12% 3.850 2.960 - 0.00% -
456.hmmer (unexplained diff vs previous) -22.22% 9.000 7.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -21.88% 0.320 0.250 - 0.00% -
473.astar (unexplained diff vs previous) -20.83% 192.000 152.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -17.59% 1.990 1.640 - 0.00% -
447.dealII (unexplained diff vs previous) -16.13% 31.000 26.000 - 0.00% -
470.lbm (max) -12.50% 48.000 42.000 - 0.00% -
473.astar (max) (percentage) -12.40% 3.710 3.250 - 0.00% -
470.lbm (max) (percentage) -12.34% 1.540 1.350 - 0.00% -
433.milc (max) (percentage) -12.30% 1.870 1.640 - 0.00% -
437.leslie3d (max) (percentage) -12.00% 0.750 0.660 - 0.00% -
437.leslie3d (max) -11.59% 328.000 290.000 - 0.00% -
471.omnetpp (max) -10.45% 67.000 60.000 - 0.00% -
471.omnetpp (max) (percentage) -10.15% 2.660 2.390 - 0.00% -
450.soplex (max) (percentage) -9.98% 8.220 7.400 - 0.00% -
473.astar (max) -9.78% 184.000 166.000 - 0.00% -
433.milc (max) -9.09% 22.000 20.000 - 0.00% -
453.povray (avg) (percentage) -8.39% 1.550 1.420 - 0.00% -
453.povray (max) (percentage) -8.09% 3.090 2.840 - 0.00% -
453.povray (max) -7.69% 13.000 12.000 - 0.00% -
434.zeusmp (max) -6.25% 32.000 30.000 - 0.00% -
482.sphinx3 (max) -6.25% 16.000 15.000 - 0.00% -
401.bzip2 (max) (percentage) -6.23% 3.050 2.860 - 0.00% -
434.zeusmp (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
401.bzip2 (max) -5.26% 76.000 72.000 - 0.00% -
450.soplex (max) -5.13% 39.000 37.000 - 0.00% -
481.wrf (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
444.namd (max) (percentage) -3.60% 1.110 1.070 - 0.00% -
481.wrf (max) -3.39% 59.000 57.000 - 0.00% -
445.gobmk (max) (percentage) -3.07% 1.630 1.580 - 0.00% -
482.sphinx3 (max) (percentage) -2.86% 2.100 2.040 - 0.00% -
471.omnetpp -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (avg) -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (avg) (percentage) -2.16% 1.390 1.360 - 0.00% -
403.gcc (max) (percentage) -1.08% 7.390 7.310 - 0.00% -
401.bzip2 (avg) (percentage) -1.03% 0.970 0.960 - 0.00% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (max)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd 1.60% 193170.000 196267.000 - 0.00% -
401.bzip2 1.51% 53812.000 54624.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 4.04% 3935.000 4094.000 - 0.96% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.82% 34.000 31.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -18.20% 1135066.000 928441.000 - 0.00% -
465.tonto -17.53% 14243435.000 11746689.000 - 0.00% -
410.bwaves -9.49% 670624.000 606952.000 - 0.00% -
434.zeusmp -7.13% 1365588.000 1268237.000 - 0.00% -
459.GemsFDTD -3.64% 2149275.000 2071052.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.96% 5066.000 2.000 - -99.96% -
429.mcf -26.35% 1920.000 1414.000 - -15.13% -
437.leslie3d -22.53% 56799.000 44005.000 - 0.43% -
459.GemsFDTD -12.92% 23686.000 20626.000 - 0.88% -
465.tonto -5.70% 68481.000 64577.000 - 0.15% -
403.gcc -4.92% 61.000 58.000 - 0.00% -
410.bwaves -4.13% 21502.000 20614.000 - 0.41% -
482.sphinx3 -2.51% 798.000 778.000 - 1.43% -
450.soplex -2.49% 523.000 510.000 - 6.25% -
458.sjeng -2.32% 7191.000 7024.000 - 1.28% -
433.milc -1.61% 1241.000 1221.000 - 0.99% -
444.namd -1.33% 678.000 669.000 - 1.06% -
401.bzip2 -1.21% 2563.000 2532.000 - 0.76% -
462.libquantum -1.12% 89.000 88.000 - 7.32% -
473.astar -1.02% 5191.000 5138.000 - 3.05% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 12.50% 24.000 27.000 - 0.00% -
nb_execution_successful 8.33% 24.000 26.000 - -3.70% -

Added Tests - Code Size
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - Execution
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1643.000 -
401.bzip2 2532.000 -
403.gcc 58.000 -
410.bwaves 20614.000 -
416.gamess 38205.000 -
429.mcf 1414.000 -15.13%
433.milc 1221.000 -
434.zeusmp 8467.000 -
435.gromacs 17377.000 -
436.cactusADM 6639.000 -
437.leslie3d 44005.000 -
444.namd 669.000 1.06%
445.gobmk 2.000 -99.96%
447.dealII 1587.000 1.67%
450.soplex 510.000 6.25%
453.povray 442.000 -
456.hmmer 2826.000 -
458.sjeng 7024.000 1.28%
459.GemsFDTD 20626.000 -
462.libquantum 88.000 7.32%
464.h264ref 4094.000 -
465.tonto 64577.000 -
470.lbm 3173.000 1.05%
471.omnetpp 2542.000 -
473.astar 5138.000 3.05%
481.wrf 24028.000 -
482.sphinx3 778.000 1.43%
Geometric Mean 2489.993 -24.69%
Name Current %
400.perlbench 1041110.000 -
401.bzip2 54624.000 -
403.gcc 2998072.000 -
410.bwaves 606952.000 -
416.gamess 12742743.000 -
429.mcf 11531.000 -
433.milc 103684.000 -
434.zeusmp 1268237.000 -
435.gromacs 978504.000 -
436.cactusADM 1239536.000 -
437.leslie3d 928441.000 -
444.namd 196267.000 -
447.dealII 2630869.000 -
450.soplex 305306.000 -
453.povray 773027.000 -
456.hmmer 251142.000 -
458.sjeng 124339.000 -
459.GemsFDTD 2071052.000 -
462.libquantum 35820.000 -
464.h264ref 460549.000 -
465.tonto 11746689.000 -
470.lbm 11388.000 -
471.omnetpp 633870.000 -
473.astar 34592.000 -
481.wrf 9388455.000 -
482.sphinx3 167561.000 -
Geometric Mean 455899.466 -
Name Current %
nb_compile_successful 27.000 -
nb_execution_successful 26.000 -3.70%
nb_total_tests 31.000 -
Geometric Mean 27.919 -1.25%
Name Current %
400.perlbench 41.000 2.50%
400.perlbench (avg) 41.000 2.50%
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) 41.000 -
400.perlbench (max) (percentage) 2.550 -
401.bzip2 24.000 -
401.bzip2 (avg) 24.000 -
401.bzip2 (avg) (percentage) 0.960 -1.03%
401.bzip2 (max) 72.000 -5.26%
401.bzip2 (max) (percentage) 2.860 -6.23%
401.bzip2 (unexplained diff vs previous) 19.000 -75.95%
401.bzip2 (unexplained diff vs previous) (percentage) 0.750 -76.11%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.540 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.310 -1.08%
410.bwaves 32.000 6.67%
410.bwaves (avg) 32.000 6.67%
410.bwaves (avg) (percentage) 0.160 6.67%
410.bwaves (max) 84.000 2.44%
410.bwaves (max) (percentage) 0.410 -
410.bwaves (unexplained diff vs previous) 85.000 3.66%
410.bwaves (unexplained diff vs previous) (percentage) 0.410 -
416.gamess 38.000 11.76%
416.gamess (avg) 38.000 11.76%
416.gamess (avg) (percentage) 0.100 11.11%
416.gamess (max) 84.000 180.00%
416.gamess (max) (percentage) 0.220 175.00%
416.gamess (unexplained diff vs previous) 84.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.220 -
429.mcf 30.000 25.00%
429.mcf (avg) 30.000 25.00%
429.mcf (avg) (percentage) 2.190 46.98%
429.mcf (max) 213.000 914.29%
429.mcf (max) (percentage) 15.130 1046.21%
429.mcf (unexplained diff vs previous) 252.000 -
429.mcf (unexplained diff vs previous) (percentage) 17.820 -
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.550 3.77%
433.milc (max) 20.000 -9.09%
433.milc (max) (percentage) 1.640 -12.30%
433.milc (unexplained diff vs previous) 12.000 -47.83%
433.milc (unexplained diff vs previous) (percentage) 0.980 -48.42%
434.zeusmp 11.000 10.00%
434.zeusmp (avg) 11.000 10.00%
434.zeusmp (avg) (percentage) 0.130 -
434.zeusmp (max) 30.000 -6.25%
434.zeusmp (max) (percentage) 0.360 -5.26%
434.zeusmp (unexplained diff vs previous) 19.000 -40.62%
434.zeusmp (unexplained diff vs previous) (percentage) 0.220 -42.11%
435.gromacs 76.000 8.57%
435.gromacs (avg) 76.000 8.57%
435.gromacs (avg) (percentage) 0.440 7.32%
435.gromacs (max) 172.000 -24.23%
435.gromacs (max) (percentage) 0.990 -25.00%
435.gromacs (unexplained diff vs previous) 165.000 -28.57%
435.gromacs (unexplained diff vs previous) (percentage) 0.950 -29.10%
436.cactusADM 10.000 11.11%
436.cactusADM (avg) 10.000 11.11%
436.cactusADM (avg) (percentage) 0.160 14.29%
436.cactusADM (max) 17.000 -
436.cactusADM (max) (percentage) 0.270 -
436.cactusADM (unexplained diff vs previous) 18.000 38.46%
436.cactusADM (unexplained diff vs previous) (percentage) 0.270 35.00%
437.leslie3d 96.000 4.35%
437.leslie3d (avg) 96.000 4.35%
437.leslie3d (avg) (percentage) 0.220 4.76%
437.leslie3d (max) 290.000 -11.59%
437.leslie3d (max) (percentage) 0.660 -12.00%
437.leslie3d (unexplained diff vs previous) 189.000 -42.90%
437.leslie3d (unexplained diff vs previous) (percentage) 0.430 -43.42%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.800 2.56%
444.namd (max) 7.000 -
444.namd (max) (percentage) 1.070 -3.60%
444.namd (unexplained diff vs previous) 7.000 75.00%
444.namd (unexplained diff vs previous) (percentage) 1.050 75.00%
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 0.490 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 1.580 -3.07%
447.dealII 16.000 6.67%
447.dealII (avg) 16.000 6.67%
447.dealII (avg) (percentage) 1.060 7.07%
447.dealII (max) 28.000 -28.21%
447.dealII (max) (percentage) 1.790 -28.69%
447.dealII (unexplained diff vs previous) 26.000 -16.13%
447.dealII (unexplained diff vs previous) (percentage) 1.640 -17.59%
450.soplex 12.000 20.00%
450.soplex (avg) 12.000 20.00%
450.soplex (avg) (percentage) 2.470 8.81%
450.soplex (max) 37.000 -5.13%
450.soplex (max) (percentage) 7.400 -9.98%
450.soplex (unexplained diff vs previous) 30.000 -30.23%
450.soplex (unexplained diff vs previous) (percentage) 5.880 -34.38%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.420 -8.39%
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 2.840 -8.09%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.680 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.290 -
456.hmmer (max) 7.000 -50.00%
456.hmmer (max) (percentage) 0.280 -45.10%
456.hmmer (unexplained diff vs previous) 7.000 -22.22%
456.hmmer (unexplained diff vs previous) (percentage) 0.250 -21.88%
458.sjeng 38.000 11.76%
458.sjeng (avg) 38.000 11.76%
458.sjeng (avg) (percentage) 0.550 10.00%
458.sjeng (max) 89.000 34.85%
458.sjeng (max) (percentage) 1.280 33.33%
458.sjeng (unexplained diff vs previous) 89.000 43.55%
458.sjeng (unexplained diff vs previous) (percentage) 1.270 42.70%
459.GemsFDTD 70.000 14.75%
459.GemsFDTD (avg) 70.000 14.75%
459.GemsFDTD (avg) (percentage) 0.340 13.33%
459.GemsFDTD (max) 181.000 147.95%
459.GemsFDTD (max) (percentage) 0.880 144.44%
459.GemsFDTD (unexplained diff vs previous) 179.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.870 -
462.libquantum 2.000 100.00%
462.libquantum (avg) 2.000 100.00%
462.libquantum (avg) (percentage) 2.620 9.62%
462.libquantum (max) 6.000 100.00%
462.libquantum (max) (percentage) 7.320 57.42%
462.libquantum (unexplained diff vs previous) 6.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 6.820 39.75%
464.h264ref 15.000 50.00%
464.h264ref (avg) 15.000 50.00%
464.h264ref (avg) (percentage) 0.370 37.04%
464.h264ref (max) 39.000 85.71%
464.h264ref (max) (percentage) 0.960 84.62%
464.h264ref (unexplained diff vs previous) 39.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.950 -
465.tonto 90.000 -
465.tonto (avg) 90.000 -
465.tonto (avg) (percentage) 0.140 -
465.tonto (max) 116.000 -
465.tonto (max) (percentage) 0.180 -
470.lbm 18.000 5.88%
470.lbm (avg) 18.000 5.88%
470.lbm (avg) (percentage) 0.590 3.51%
470.lbm (max) 42.000 -12.50%
470.lbm (max) (percentage) 1.350 -12.34%
470.lbm (unexplained diff vs previous) 33.000 -32.65%
470.lbm (unexplained diff vs previous) (percentage) 1.040 -33.33%
471.omnetpp 34.000 -2.86%
471.omnetpp (avg) 34.000 -2.86%
471.omnetpp (avg) (percentage) 1.360 -2.16%
471.omnetpp (max) 60.000 -10.45%
471.omnetpp (max) (percentage) 2.390 -10.15%
471.omnetpp (unexplained diff vs previous) 17.000 -75.36%
471.omnetpp (unexplained diff vs previous) (percentage) 0.670 -75.46%
473.astar 41.000 17.14%
473.astar (avg) 41.000 17.14%
473.astar (avg) (percentage) 0.810 12.50%
473.astar (max) 166.000 -9.78%
473.astar (max) (percentage) 3.250 -12.40%
473.astar (unexplained diff vs previous) 152.000 -20.83%
473.astar (unexplained diff vs previous) (percentage) 2.960 -23.12%
481.wrf 38.000 -
481.wrf (avg) 38.000 -
481.wrf (avg) (percentage) 0.160 -
481.wrf (max) 57.000 -3.39%
481.wrf (max) (percentage) 0.240 -4.00%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.470 -
482.sphinx3 (max) 15.000 -6.25%
482.sphinx3 (max) (percentage) 2.040 -2.86%
482.sphinx3 (unexplained diff vs previous) 11.000 -26.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.410 -28.06%
483.xalancbmk (avg) (percentage) 1.100 -
483.xalancbmk (max) (percentage) 1.100 -
Geometric Mean 4.931 -13.34%