Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b6532accdd8e24329cc69bb58bc2883796008776 (+ 10 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/877fb9bdb06d18df51c6043f74dde66fe6f46b78 (+ 44 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e64a1e81aadf6c401174ac9471ced0f0125c2912 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/25cd1b6c4571a4d82346fe97e81e280f64129355 (+ 120 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3_LTO-build/434/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0434 (3-changed-components) 2024-09-15T11:20:07 0:00:00
Previous 0433 (3-changed-components) 2024-09-11T16:27:24 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T00:55:39 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 52 20
Performance Improvements 90 24
Added Tests 0 128
Unchanged Tests 1010 980
Total Tests 1152

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.38% 9773.000 10201.000 - 15.64% -
429.mcf 2.75% 1275.000 1310.000 - 7.91% -
450.soplex 1.87% 535.000 545.000 - 5.42% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) 1900.00% 1.000 20.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 1850.00% 0.020 0.390 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 350.00% 2.000 9.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 333.33% 0.030 0.130 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 258.33% 12.000 43.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 252.17% 0.230 0.810 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 218.18% 0.220 0.700 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 216.67% 6.000 19.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 195.24% 0.210 0.620 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 190.00% 10.000 29.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 169.23% 13.000 35.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 161.76% 1.020 2.670 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 150.68% 0.730 1.830 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 150.29% 171.000 428.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 147.06% 17.000 42.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 140.00% 1.750 4.200 0.000 0.00% 0.000
410.bwaves (max) (percentage) 138.24% 0.340 0.810 - 0.00% -
410.bwaves (max) 133.33% 18.000 42.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 122.79% 1.360 3.030 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) 116.67% 6.000 13.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 104.26% 0.940 1.920 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 101.54% 0.650 1.310 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 100.00% 6.000 12.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 66.67% 6.000 10.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 63.39% 1.120 1.830 0.000 0.00% 0.000
434.zeusmp (max) 51.85% 27.000 41.000 - 0.00% -
434.zeusmp (max) (percentage) 51.69% 1.180 1.790 - 0.00% -
453.povray (max) (percentage) 51.55% 1.940 2.940 - 0.00% -
453.povray (max) 50.00% 8.000 12.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 46.15% 0.260 0.380 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 44.44% 9.000 13.000 0.000 0.00% 0.000
450.soplex (max) 42.86% 7.000 10.000 - 0.00% -
401.bzip2 (max) (percentage) 42.86% 0.490 0.700 - 0.00% -
401.bzip2 (max) 38.46% 13.000 18.000 - 0.00% -
444.namd (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 33.33% 0.390 0.520 0.000 0.00% 0.000
450.soplex (max) (percentage) 29.86% 1.440 1.870 - 0.00% -
444.namd (max) (percentage) 26.83% 0.410 0.520 - 0.00% -
453.povray 25.00% 4.000 5.000 - 0.00% -
453.povray (avg) 25.00% 4.000 5.000 - 0.00% -
456.hmmer (max) (percentage) 8.70% 0.230 0.250 - 0.00% -
453.povray (avg) (percentage) 4.46% 1.120 1.170 - 0.00% -
437.leslie3d 3.80% 552.000 573.000 - 0.00% -
437.leslie3d (avg) 3.80% 552.000 573.000 - 0.00% -
434.zeusmp (avg) (percentage) 1.90% 1.050 1.070 - 0.00% -
429.mcf 1.71% 117.000 119.000 - 0.00% -
429.mcf (avg) 1.71% 117.000 119.000 - 0.00% -
429.mcf (max) 1.25% 80.000 81.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -2.94% 442.000 429.000 - -1.83% -
462.libquantum -1.89% 106.000 104.000 - -8.77% -
434.zeusmp -1.79% 2340.000 2298.000 - 3.05% -
435.gromacs -1.59% 5781.000 5689.000 - 3.66% -
471.omnetpp -1.38% 2101.000 2072.000 - 2.27% -
433.milc -1.29% 927.000 915.000 - -2.66% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -93.01% 1.860 0.130 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -92.86% 14.000 1.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -84.00% 25.000 4.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -83.97% 2.370 0.380 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) -57.32% 164.000 70.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) -57.23% 1.730 0.740 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -53.54% 0.990 0.460 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -53.33% 45.000 21.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -51.72% 29.000 14.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -51.72% 0.580 0.280 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) -50.00% 2.000 1.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -50.00% 0.140 0.070 0.000 0.00% 0.000
435.gromacs (max) -41.63% 209.000 122.000 - 0.00% -
435.gromacs (max) (percentage) -40.61% 3.620 2.150 - 0.00% -
436.cactusADM (unexplained diff vs previous) -40.00% 5.000 3.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -38.10% 0.210 0.130 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -35.56% 45.000 29.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -34.58% 2.140 1.400 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -31.85% 135.000 92.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -30.77% 2.340 1.620 0.000 0.00% 0.000
462.libquantum (max) -25.00% 4.000 3.000 - 0.00% -
445.gobmk (max) -22.00% 50.000 39.000 - 0.00% -
445.gobmk (max) (percentage) -20.00% 1.100 0.880 - 0.00% -
471.omnetpp (max) -15.22% 46.000 39.000 - 0.00% -
482.sphinx3 (max) -14.29% 14.000 12.000 - 0.00% -
471.omnetpp (max) (percentage) -12.33% 2.190 1.920 - 0.00% -
482.sphinx3 (max) (percentage) -10.05% 1.890 1.700 - 0.00% -
433.milc -10.00% 10.000 9.000 - 0.00% -
433.milc (avg) -10.00% 10.000 9.000 - 0.00% -
436.cactusADM (max) -10.00% 10.000 9.000 - 0.00% -
436.cactusADM (max) (percentage) -9.30% 0.430 0.390 - 0.00% -
462.libquantum (max) (percentage) -8.54% 3.980 3.640 - 0.00% -
447.dealII (max) -8.00% 25.000 23.000 - 0.00% -
447.dealII (max) (percentage) -7.56% 2.380 2.200 - 0.00% -
459.GemsFDTD (max) -6.98% 43.000 40.000 - 0.00% -
459.GemsFDTD (max) (percentage) -6.90% 0.870 0.810 - 0.00% -
433.milc (max) -6.67% 15.000 14.000 - 0.00% -
473.astar (max) -6.45% 31.000 29.000 - 0.00% -
473.astar (max) (percentage) -6.06% 0.660 0.620 - 0.00% -
465.tonto (max) -5.99% 167.000 157.000 - 0.00% -
465.tonto (max) (percentage) -5.11% 1.760 1.670 - 0.00% -
470.lbm (max) -4.84% 62.000 59.000 - 0.00% -
400.perlbench -4.17% 24.000 23.000 - 0.00% -
400.perlbench (avg) -4.17% 24.000 23.000 - 0.00% -
437.leslie3d (max) (percentage) -3.94% 15.210 14.610 - 0.00% -
470.lbm (max) (percentage) -3.83% 1.830 1.760 - 0.00% -
470.lbm -3.23% 31.000 30.000 - 0.00% -
470.lbm (avg) -3.23% 31.000 30.000 - 0.00% -
433.milc (max) (percentage) -3.03% 1.650 1.600 - 0.00% -
400.perlbench (avg) (percentage) -2.99% 1.670 1.620 - 0.00% -
464.h264ref (max) (percentage) -2.83% 1.060 1.030 - 0.00% -
471.omnetpp -2.78% 36.000 35.000 - 0.00% -
471.omnetpp (avg) -2.78% 36.000 35.000 - 0.00% -
482.sphinx3 (avg) (percentage) -2.56% 2.340 2.280 - 0.00% -
458.sjeng -2.56% 39.000 38.000 - 0.00% -
458.sjeng (avg) -2.56% 39.000 38.000 - 0.00% -
435.gromacs -2.29% 131.000 128.000 - 0.00% -
435.gromacs (avg) -2.29% 131.000 128.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.13% 1.410 1.380 - 0.00% -
445.gobmk -2.13% 47.000 46.000 - 0.00% -
445.gobmk (avg) -2.13% 47.000 46.000 - 0.00% -
401.bzip2 -2.08% 48.000 47.000 - 0.00% -
401.bzip2 (avg) -2.08% 48.000 47.000 - 0.00% -
429.mcf (max) (percentage) -2.05% 6.330 6.200 - 0.00% -
436.cactusADM (avg) (percentage) -2.04% 0.490 0.480 - 0.00% -
447.dealII (avg) (percentage) -1.92% 1.560 1.530 - 0.00% -
445.gobmk (avg) (percentage) -1.90% 1.050 1.030 - 0.00% -
464.h264ref (max) -1.89% 53.000 52.000 - 0.00% -
458.sjeng (avg) (percentage) -1.82% 0.550 0.540 - 0.00% -
410.bwaves -1.54% 65.000 64.000 - 0.00% -
410.bwaves (avg) -1.54% 65.000 64.000 - 0.00% -
429.mcf (avg) (percentage) -1.52% 9.230 9.090 - 0.00% -
464.h264ref (avg) (percentage) -1.49% 0.670 0.660 - 0.00% -
459.GemsFDTD -1.45% 69.000 68.000 - 0.00% -
459.GemsFDTD (avg) -1.45% 69.000 68.000 - 0.00% -
473.astar -1.22% 82.000 81.000 - 0.00% -
473.astar (avg) -1.22% 82.000 81.000 - 0.00% -
444.namd (avg) (percentage) -1.19% 0.840 0.830 - 0.00% -
473.astar (avg) (percentage) -1.14% 1.750 1.730 - 0.00% -
401.bzip2 (avg) (percentage) -1.12% 1.790 1.770 - 0.00% -
470.lbm (avg) (percentage) -1.09% 0.920 0.910 - 0.00% -
450.soplex (avg) (percentage) -1.07% 2.810 2.780 - 0.00% -
465.tonto -1.01% 99.000 98.000 - 0.00% -
465.tonto (avg) -1.01% 99.000 98.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum 4.63% 21437.000 22429.000 - 0.00% -
410.bwaves 1.85% 22757.000 23178.000 - 0.00% -
444.namd 1.53% 232647.000 236214.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 18.77% 634.000 753.000 - -0.13% -
437.leslie3d 15.64% 8821.000 10201.000 - 4.38% -
410.bwaves 15.44% 4574.000 5280.000 - -0.81% -
400.perlbench 14.74% 1289.000 1479.000 - 0.07% -
429.mcf 7.91% 1214.000 1310.000 - 2.75% -
458.sjeng 7.83% 6628.000 7147.000 - 0.13% -
447.dealII 7.36% 978.000 1050.000 - -0.38% -
450.soplex 5.42% 517.000 545.000 - 1.87% -
465.tonto 3.89% 9078.000 9431.000 - -0.74% -
435.gromacs 3.66% 5488.000 5689.000 - -1.59% -
434.zeusmp 3.05% 2230.000 2298.000 - -1.79% -
459.GemsFDTD 2.44% 4827.000 4945.000 - -0.28% -
473.astar 2.33% 4595.000 4702.000 - -0.61% -
471.omnetpp 2.27% 2026.000 2072.000 - -1.38% -
470.lbm 1.71% 3330.000 3387.000 - -0.38% -
464.h264ref 1.48% 5004.000 5078.000 - 0.40% -
445.gobmk 1.29% 4479.000 4537.000 - -0.46% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -17.06% 398314.000 330351.000 - 0.00% -
437.leslie3d -16.68% 95053.000 79202.000 - 0.00% -
434.zeusmp -14.41% 325184.000 278326.000 - 0.00% -
436.cactusADM -12.60% 520390.000 454826.000 - 0.00% -
401.bzip2 -12.04% 71216.000 62644.000 - 0.00% -
450.soplex -10.08% 330413.000 297097.000 - 0.00% -
465.tonto -10.04% 3073566.000 2765102.000 - 0.00% -
482.sphinx3 -8.75% 156955.000 143215.000 - 0.00% -
433.milc -7.31% 105180.000 97488.000 - 0.00% -
456.hmmer -6.41% 156743.000 146691.000 - 0.00% -
435.gromacs -5.67% 733280.000 691704.000 - 0.00% -
473.astar -5.03% 30208.000 28688.000 - 0.00% -
464.h264ref -2.50% 782902.000 763366.000 - 0.00% -
447.dealII -2.35% 460638.000 449832.000 - 0.00% -
458.sjeng -1.27% 154123.000 152167.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -8.77% 114.000 104.000 - -1.89% -
456.hmmer -5.48% 3374.000 3189.000 - 0.25% -
433.milc -2.66% 940.000 915.000 - -1.29% -
453.povray -1.83% 437.000 429.000 - -2.94% -
401.bzip2 -1.35% 2733.000 2696.000 - -0.70% -
436.cactusADM -1.27% 2359.000 2329.000 - -0.13% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 142.86% 28.000 68.000 - 0.00% -
nb_compile_successful 71.43% 28.000 48.000 - 0.00% -
nb_execution_successful 71.43% 28.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1479.000 -
401.bzip2 2696.000 -
410.bwaves 5280.000 -
429.mcf 1310.000 2.75%
433.milc 915.000 -1.29%
434.zeusmp 2298.000 -1.79%
435.gromacs 5689.000 -1.59%
436.cactusADM 2329.000 -
437.leslie3d 10201.000 4.38%
444.namd 767.000 -
445.gobmk 4537.000 -
447.dealII 1050.000 -
450.soplex 545.000 1.87%
453.povray 429.000 -2.94%
456.hmmer 3189.000 -
458.sjeng 7147.000 -
459.GemsFDTD 4945.000 -
462.libquantum 104.000 -1.89%
464.h264ref 5078.000 -
465.tonto 9431.000 -
470.lbm 3387.000 -
471.omnetpp 2072.000 -1.38%
473.astar 4702.000 -
482.sphinx3 753.000 -
Geometric Mean 2148.311 -
Name Current %
400.perlbench 1257381.000 -
401.bzip2 62644.000 -
410.bwaves 23178.000 -
429.mcf 10059.000 -
433.milc 97488.000 -
434.zeusmp 278326.000 -
435.gromacs 691704.000 -
436.cactusADM 454826.000 -
437.leslie3d 79202.000 -
444.namd 236214.000 -
445.gobmk 1717341.000 -
447.dealII 449832.000 -
450.soplex 297097.000 -
453.povray 1078408.000 -
456.hmmer 146691.000 -
458.sjeng 152167.000 -
459.GemsFDTD 330351.000 -
462.libquantum 22429.000 -
464.h264ref 763366.000 -
465.tonto 2765102.000 -
470.lbm 11035.000 -
471.omnetpp 585906.000 -
473.astar 28688.000 -
482.sphinx3 143215.000 -
Geometric Mean 192532.925 -
Name Current %
400.perlbench 23.000 -4.17%
400.perlbench (avg) 23.000 -4.17%
400.perlbench (avg) (percentage) 1.620 -2.99%
400.perlbench (max) 29.000 -
400.perlbench (max) (percentage) 2.020 -
400.perlbench (unexplained diff vs previous) 1.000 -50.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.070 -50.00%
401.bzip2 47.000 -2.08%
401.bzip2 (avg) 47.000 -2.08%
401.bzip2 (avg) (percentage) 1.770 -1.12%
401.bzip2 (max) 18.000 38.46%
401.bzip2 (max) (percentage) 0.700 42.86%
401.bzip2 (unexplained diff vs previous) 19.000 216.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.700 218.18%
403.gcc (avg) (percentage) 6.060 -
403.gcc (max) (percentage) 8.350 -
410.bwaves 64.000 -1.54%
410.bwaves (avg) 64.000 -1.54%
410.bwaves (avg) (percentage) 1.220 -
410.bwaves (max) 42.000 133.33%
410.bwaves (max) (percentage) 0.810 138.24%
410.bwaves (unexplained diff vs previous) 43.000 258.33%
410.bwaves (unexplained diff vs previous) (percentage) 0.810 252.17%
416.gamess (avg) (percentage) 0.180 -
416.gamess (max) (percentage) 0.680 -
429.mcf 119.000 1.71%
429.mcf (avg) 119.000 1.71%
429.mcf (avg) (percentage) 9.090 -1.52%
429.mcf (max) 81.000 1.25%
429.mcf (max) (percentage) 6.200 -2.05%
429.mcf (unexplained diff vs previous) 35.000 169.23%
429.mcf (unexplained diff vs previous) (percentage) 2.670 161.76%
433.milc 9.000 -10.00%
433.milc (avg) 9.000 -10.00%
433.milc (avg) (percentage) 1.090 -
433.milc (max) 14.000 -6.67%
433.milc (max) (percentage) 1.600 -3.03%
433.milc (unexplained diff vs previous) 12.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 1.310 101.54%
434.zeusmp 24.000 -
434.zeusmp (avg) 24.000 -
434.zeusmp (avg) (percentage) 1.070 1.90%
434.zeusmp (max) 41.000 51.85%
434.zeusmp (max) (percentage) 1.790 51.69%
434.zeusmp (unexplained diff vs previous) 42.000 147.06%
434.zeusmp (unexplained diff vs previous) (percentage) 1.830 150.68%
435.gromacs 128.000 -2.29%
435.gromacs (avg) 128.000 -2.29%
435.gromacs (avg) (percentage) 2.260 -
435.gromacs (max) 122.000 -41.63%
435.gromacs (max) (percentage) 2.150 -40.61%
435.gromacs (unexplained diff vs previous) 92.000 -31.85%
435.gromacs (unexplained diff vs previous) (percentage) 1.620 -30.77%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.480 -2.04%
436.cactusADM (max) 9.000 -10.00%
436.cactusADM (max) (percentage) 0.390 -9.30%
436.cactusADM (unexplained diff vs previous) 3.000 -40.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.130 -38.10%
437.leslie3d 573.000 3.80%
437.leslie3d (avg) 573.000 3.80%
437.leslie3d (avg) (percentage) 5.620 -
437.leslie3d (max) 1490.000 -
437.leslie3d (max) (percentage) 14.610 -3.94%
437.leslie3d (unexplained diff vs previous) 428.000 150.29%
437.leslie3d (unexplained diff vs previous) (percentage) 4.200 140.00%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.830 -1.19%
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.520 26.83%
444.namd (unexplained diff vs previous) 4.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 0.520 33.33%
445.gobmk 46.000 -2.13%
445.gobmk (avg) 46.000 -2.13%
445.gobmk (avg) (percentage) 1.030 -1.90%
445.gobmk (max) 39.000 -22.00%
445.gobmk (max) (percentage) 0.880 -20.00%
445.gobmk (unexplained diff vs previous) 21.000 -53.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.460 -53.54%
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 1.530 -1.92%
447.dealII (max) 23.000 -8.00%
447.dealII (max) (percentage) 2.200 -7.56%
447.dealII (unexplained diff vs previous) 4.000 -84.00%
447.dealII (unexplained diff vs previous) (percentage) 0.380 -83.97%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.780 -1.07%
450.soplex (max) 10.000 42.86%
450.soplex (max) (percentage) 1.870 29.86%
450.soplex (unexplained diff vs previous) 10.000 66.67%
450.soplex (unexplained diff vs previous) (percentage) 1.830 63.39%
453.povray 5.000 25.00%
453.povray (avg) 5.000 25.00%
453.povray (avg) (percentage) 1.170 4.46%
453.povray (max) 12.000 50.00%
453.povray (max) (percentage) 2.940 51.55%
453.povray (unexplained diff vs previous) 13.000 116.67%
453.povray (unexplained diff vs previous) (percentage) 3.030 122.79%
454.calculix (avg) (percentage) 2.820 -
454.calculix (max) (percentage) 3.480 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 7.000 -
456.hmmer (max) (percentage) 0.250 8.70%
456.hmmer (unexplained diff vs previous) 8.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.250 -
458.sjeng 38.000 -2.56%
458.sjeng (avg) 38.000 -2.56%
458.sjeng (avg) (percentage) 0.540 -1.82%
458.sjeng (max) 9.000 -
458.sjeng (max) (percentage) 0.130 -
458.sjeng (unexplained diff vs previous) 9.000 350.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 333.33%
459.GemsFDTD 68.000 -1.45%
459.GemsFDTD (avg) 68.000 -1.45%
459.GemsFDTD (avg) (percentage) 1.380 -2.13%
459.GemsFDTD (max) 40.000 -6.98%
459.GemsFDTD (max) (percentage) 0.810 -6.90%
459.GemsFDTD (unexplained diff vs previous) 14.000 -51.72%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.280 -51.72%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.160 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 3.640 -8.54%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.920 104.26%
464.h264ref 33.000 -
464.h264ref (avg) 33.000 -
464.h264ref (avg) (percentage) 0.660 -1.49%
464.h264ref (max) 52.000 -1.89%
464.h264ref (max) (percentage) 1.030 -2.83%
464.h264ref (unexplained diff vs previous) 20.000 1900.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.390 1850.00%
465.tonto 98.000 -1.01%
465.tonto (avg) 98.000 -1.01%
465.tonto (avg) (percentage) 1.040 -
465.tonto (max) 157.000 -5.99%
465.tonto (max) (percentage) 1.670 -5.11%
465.tonto (unexplained diff vs previous) 70.000 -57.32%
465.tonto (unexplained diff vs previous) (percentage) 0.740 -57.23%
470.lbm 30.000 -3.23%
470.lbm (avg) 30.000 -3.23%
470.lbm (avg) (percentage) 0.910 -1.09%
470.lbm (max) 59.000 -4.84%
470.lbm (max) (percentage) 1.760 -3.83%
470.lbm (unexplained diff vs previous) 13.000 44.44%
470.lbm (unexplained diff vs previous) (percentage) 0.380 46.15%
471.omnetpp 35.000 -2.78%
471.omnetpp (avg) 35.000 -2.78%
471.omnetpp (avg) (percentage) 1.730 -
471.omnetpp (max) 39.000 -15.22%
471.omnetpp (max) (percentage) 1.920 -12.33%
471.omnetpp (unexplained diff vs previous) 29.000 -35.56%
471.omnetpp (unexplained diff vs previous) (percentage) 1.400 -34.58%
473.astar 81.000 -1.22%
473.astar (avg) 81.000 -1.22%
473.astar (avg) (percentage) 1.730 -1.14%
473.astar (max) 29.000 -6.45%
473.astar (max) (percentage) 0.620 -6.06%
473.astar (unexplained diff vs previous) 29.000 190.00%
473.astar (unexplained diff vs previous) (percentage) 0.620 195.24%
481.wrf (avg) (percentage) 1.520 -
481.wrf (max) (percentage) 3.800 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.280 -2.56%
482.sphinx3 (max) 12.000 -14.29%
482.sphinx3 (max) (percentage) 1.700 -10.05%
482.sphinx3 (unexplained diff vs previous) 1.000 -92.86%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.130 -93.01%
Geometric Mean 5.897 19.10%