Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7c0de4c1e0304fe2a67942745b584dbcd5e72950 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/616627245fb06106f7c5bc4a36784acc8ec166f0 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=910aae6e5a2196938fc30fa54dd1e96f16774ce7 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/1413c372d6b7faed82cb533a704db281ef0f5483 (unchanged)
regression GNU-1285
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/208/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0208 (basepoints/gcc-15-02066-g616627245fb) 2024-07-17T06:41:35 0:00:00
Previous 0207 (basepoints/gcc-15-02065-g016c947b02e) 2024-07-16T13:22:54 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 32 15
Performance Improvements 94 15
Added Tests 0 128
Unchanged Tests 1014 982
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 3.78% 1507.000 1564.000 - 14.49% -
429.mcf 1.13% 1235.000 1249.000 - 35.17% -
437.leslie3d 1.08% 10072.000 10181.000 - -1.60% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 511.11% 0.090 0.550 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 500.00% 1.000 6.000 0.000 0.00% 0.000
433.milc (max) 200.00% 2.000 6.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 200.00% 5.000 15.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 195.24% 0.210 0.620 0.000 0.00% 0.000
433.milc (max) (percentage) 175.00% 0.200 0.550 - 0.00% -
400.perlbench (unexplained diff vs previous) 78.12% 32.000 57.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 76.32% 0.380 0.670 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 72.22% 18.000 31.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) 71.70% 2.120 3.640 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 66.67% 3.000 5.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 65.00% 0.400 0.660 0.000 0.00% 0.000
445.gobmk (max) (percentage) 32.00% 0.500 0.660 - 0.00% -
445.gobmk (max) 30.43% 23.000 30.000 - 0.00% -
434.zeusmp (max) 25.00% 12.000 15.000 - 0.00% -
434.zeusmp (max) (percentage) 21.15% 0.520 0.630 - 0.00% -
400.perlbench 8.00% 25.000 27.000 - 0.00% -
400.perlbench (avg) 8.00% 25.000 27.000 - 0.00% -
470.lbm (max) (percentage) 5.88% 0.510 0.540 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 5.88% 0.510 0.540 0.000 0.00% 0.000
470.lbm (max) 5.00% 20.000 21.000 - 0.00% -
470.lbm (unexplained diff vs previous) 5.00% 20.000 21.000 0.000 0.00% 0.000
400.perlbench (avg) (percentage) 4.19% 1.670 1.740 - 0.00% -
445.gobmk 4.17% 24.000 25.000 - 0.00% -
445.gobmk (avg) 4.17% 24.000 25.000 - 0.00% -
400.perlbench (max) 3.51% 57.000 59.000 - 0.00% -
445.gobmk (avg) (percentage) 1.89% 0.530 0.540 - 0.00% -
437.leslie3d 1.12% 356.000 360.000 - 0.00% -
437.leslie3d (avg) 1.12% 356.000 360.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.25% 79261.000 75098.000 - -5.75% -
459.GemsFDTD -2.23% 328163.000 320835.000 - -1.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -94.44% 18.000 1.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -94.12% 0.340 0.020 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -88.24% 0.340 0.040 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -87.50% 16.000 2.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -83.33% 6.000 1.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) -83.22% 1.430 0.240 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -80.00% 15.000 3.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -79.93% 2.790 0.560 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -76.92% 39.000 9.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -76.36% 0.550 0.130 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -61.11% 18.000 7.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -61.04% 0.770 0.300 0.000 0.00% 0.000
464.h264ref (max) -57.58% 33.000 14.000 - 0.00% -
473.astar (max) -57.14% 28.000 12.000 - 0.00% -
473.astar (max) (percentage) -56.67% 0.600 0.260 - 0.00% -
453.povray (max) -55.56% 9.000 4.000 - 0.00% -
464.h264ref (max) (percentage) -54.84% 0.620 0.280 - 0.00% -
453.povray (max) (percentage) -52.19% 2.280 1.090 - 0.00% -
456.hmmer (unexplained diff vs previous) -50.00% 8.000 4.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -50.00% 0.240 0.120 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -50.00% 20.000 10.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -50.00% 0.920 0.460 0.000 0.00% 0.000
429.mcf (max) (percentage) -48.85% 3.050 1.560 - 0.00% -
429.mcf (max) -48.65% 37.000 19.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -45.79% 1.070 0.580 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -45.16% 62.000 34.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -45.04% 1.310 0.720 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -44.44% 18.000 10.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -41.30% 46.000 27.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -40.72% 1.670 0.990 0.000 0.00% 0.000
471.omnetpp (max) -38.30% 47.000 29.000 - 0.00% -
471.omnetpp (max) (percentage) -36.82% 2.200 1.390 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -34.72% 0.720 0.470 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -34.21% 38.000 25.000 0.000 0.00% 0.000
458.sjeng (max) -25.64% 39.000 29.000 - 0.00% -
458.sjeng (max) (percentage) -25.45% 0.550 0.410 - 0.00% -
435.gromacs (max) -20.55% 73.000 58.000 - 0.00% -
435.gromacs (max) (percentage) -20.47% 1.270 1.010 - 0.00% -
450.soplex (max) -20.00% 15.000 12.000 - 0.00% -
453.povray -20.00% 5.000 4.000 - 0.00% -
453.povray (avg) -20.00% 5.000 4.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -18.84% 1.380 1.120 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -17.65% 17.000 14.000 0.000 0.00% 0.000
410.bwaves (max) (percentage) -16.90% 0.710 0.590 - 0.00% -
450.soplex (max) (percentage) -16.72% 2.870 2.390 - 0.00% -
410.bwaves (max) -16.22% 37.000 31.000 - 0.00% -
456.hmmer (max) (percentage) -15.38% 0.260 0.220 - 0.00% -
436.cactusADM (max) (percentage) -13.16% 0.760 0.660 - 0.00% -
456.hmmer (max) -12.50% 8.000 7.000 - 0.00% -
447.dealII (max) (percentage) -12.40% 1.290 1.130 - 0.00% -
436.cactusADM (max) -11.76% 17.000 15.000 - 0.00% -
447.dealII (max) -11.76% 17.000 15.000 - 0.00% -
401.bzip2 (max) -10.64% 47.000 42.000 - 0.00% -
459.GemsFDTD (max) (percentage) -10.00% 0.400 0.360 - 0.00% -
459.GemsFDTD (max) -10.00% 20.000 18.000 - 0.00% -
401.bzip2 (max) (percentage) -8.77% 1.710 1.560 - 0.00% -
436.cactusADM -7.69% 13.000 12.000 - 0.00% -
436.cactusADM (avg) -7.69% 13.000 12.000 - 0.00% -
464.h264ref -6.67% 15.000 14.000 - 0.00% -
464.h264ref (avg) -6.67% 15.000 14.000 - 0.00% -
465.tonto (max) -6.11% 131.000 123.000 - 0.00% -
465.tonto (max) (percentage) -6.02% 1.330 1.250 - 0.00% -
444.namd (max) (percentage) -5.10% 0.980 0.930 - 0.00% -
462.libquantum (max) (percentage) -5.01% 3.390 3.220 - 0.00% -
437.leslie3d (max) (percentage) -4.63% 4.320 4.120 - 0.00% -
458.sjeng -4.55% 22.000 21.000 - 0.00% -
458.sjeng (avg) -4.55% 22.000 21.000 - 0.00% -
437.leslie3d (max) -3.68% 435.000 419.000 - 0.00% -
473.astar (avg) (percentage) -3.30% 0.910 0.880 - 0.00% -
453.povray (avg) (percentage) -3.25% 1.230 1.190 - 0.00% -
458.sjeng (avg) (percentage) -3.23% 0.310 0.300 - 0.00% -
401.bzip2 -3.03% 33.000 32.000 - 0.00% -
401.bzip2 (avg) -3.03% 33.000 32.000 - 0.00% -
429.mcf -2.94% 34.000 33.000 - 0.00% -
429.mcf (avg) -2.94% 34.000 33.000 - 0.00% -
471.omnetpp -2.94% 34.000 33.000 - 0.00% -
471.omnetpp (avg) -2.94% 34.000 33.000 - 0.00% -
482.sphinx3 (max) (percentage) -2.79% 1.790 1.740 - 0.00% -
471.omnetpp (avg) (percentage) -2.50% 1.600 1.560 - 0.00% -
473.astar -2.38% 42.000 41.000 - 0.00% -
473.astar (avg) -2.38% 42.000 41.000 - 0.00% -
450.soplex (avg) (percentage) -2.33% 1.720 1.680 - 0.00% -
435.gromacs (avg) (percentage) -2.05% 1.460 1.430 - 0.00% -
429.mcf (avg) (percentage) -1.81% 2.760 2.710 - 0.00% -
436.cactusADM (avg) (percentage) -1.79% 0.560 0.550 - 0.00% -
447.dealII (avg) (percentage) -1.75% 1.140 1.120 - 0.00% -
444.namd (avg) (percentage) -1.67% 0.600 0.590 - 0.00% -
462.libquantum (avg) (percentage) -1.42% 1.410 1.390 - 0.00% -
435.gromacs -1.19% 84.000 83.000 - 0.00% -
435.gromacs (avg) -1.19% 84.000 83.000 - 0.00% -
482.sphinx3 (avg) (percentage) -1.05% 0.950 0.940 - 0.00% -
400.perlbench (max) (percentage) -1.05% 3.820 3.780 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.75% 2255286.000 2339910.000 - -0.05% -
447.dealII 3.58% 381188.000 394837.000 - 0.00% -
462.libquantum 3.45% 19841.000 20525.000 - 0.00% -
444.namd 3.34% 225019.000 232529.000 - 0.00% -
410.bwaves 2.21% 22626.000 23127.000 - 0.00% -
400.perlbench 1.58% 1025894.000 1042077.000 - 0.00% -
464.h264ref 1.57% 448678.000 455730.000 - 0.00% -
473.astar 1.50% 23768.000 24124.000 - 0.00% -
470.lbm 1.26% 10803.000 10939.000 - 0.00% -
450.soplex 1.11% 245125.000 247837.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.17% 924.000 1249.000 - 1.13% -
400.perlbench 14.49% 1366.000 1564.000 - 3.78% -
458.sjeng 5.83% 6725.000 7117.000 - 0.13% -
435.gromacs 1.89% 5720.000 5828.000 - 0.59% -
450.soplex 1.50% 532.000 540.000 - 0.56% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -5.75% 79677.000 75098.000 - -5.25% -
459.GemsFDTD -1.75% 326542.000 320835.000 - -2.23% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -6.19% 113.000 106.000 - 0.95% -
473.astar -3.34% 4883.000 4720.000 - 0.04% -
445.gobmk -2.37% 4771.000 4658.000 - -0.66% -
453.povray -2.33% 430.000 420.000 - -0.24% -
433.milc -1.88% 1119.000 1098.000 - 0.55% -
447.dealII -1.77% 1409.000 1384.000 - 0.73% -
437.leslie3d -1.60% 10347.000 10181.000 - 1.08% -
410.bwaves -1.39% 5409.000 5334.000 - 0.47% -
464.h264ref -1.29% 5407.000 5337.000 - -0.02% -
436.cactusADM -1.22% 2378.000 2349.000 - 0.30% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 142.86% 28.000 68.000 - 0.00% -
nb_compile_successful 71.43% 28.000 48.000 - 0.00% -
nb_execution_successful 71.43% 28.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1564.000 3.78%
401.bzip2 2727.000 -
410.bwaves 5334.000 -
429.mcf 1249.000 1.13%
433.milc 1098.000 -
434.zeusmp 2400.000 -
435.gromacs 5828.000 -
436.cactusADM 2349.000 -
437.leslie3d 10181.000 1.08%
444.namd 769.000 -
445.gobmk 4658.000 -
447.dealII 1384.000 -
450.soplex 540.000 -
453.povray 420.000 -
456.hmmer 3395.000 -
458.sjeng 7117.000 -
459.GemsFDTD 5153.000 -
462.libquantum 106.000 -
464.h264ref 5337.000 -
465.tonto 9916.000 -
470.lbm 3904.000 -
471.omnetpp 2157.000 -
473.astar 4720.000 -
482.sphinx3 758.000 -
Geometric Mean 2237.123 -
Name Current %
400.perlbench 1042077.000 -
401.bzip2 49268.000 -
410.bwaves 23127.000 -
429.mcf 9703.000 -
433.milc 70785.000 -
434.zeusmp 217758.000 -
435.gromacs 577636.000 -
436.cactusADM 413114.000 -
437.leslie3d 75098.000 -5.25%
444.namd 232529.000 -
445.gobmk 1404513.000 -
447.dealII 394837.000 -
450.soplex 247837.000 -
453.povray 793733.000 -
456.hmmer 125539.000 -
458.sjeng 117827.000 -
459.GemsFDTD 320835.000 -2.23%
462.libquantum 20525.000 -
464.h264ref 455730.000 -
465.tonto 2339910.000 -
470.lbm 10939.000 -
471.omnetpp 525497.000 -
473.astar 24124.000 -
482.sphinx3 128775.000 -
Geometric Mean 164300.657 -
Name Current %
400.perlbench 27.000 8.00%
400.perlbench (avg) 27.000 8.00%
400.perlbench (avg) (percentage) 1.740 4.19%
400.perlbench (max) 59.000 3.51%
400.perlbench (max) (percentage) 3.780 -1.05%
400.perlbench (unexplained diff vs previous) 57.000 78.12%
400.perlbench (unexplained diff vs previous) (percentage) 3.640 71.70%
401.bzip2 32.000 -3.03%
401.bzip2 (avg) 32.000 -3.03%
401.bzip2 (avg) (percentage) 1.190 -
401.bzip2 (max) 42.000 -10.64%
401.bzip2 (max) (percentage) 1.560 -8.77%
401.bzip2 (unexplained diff vs previous) 27.000 -41.30%
401.bzip2 (unexplained diff vs previous) (percentage) 0.990 -40.72%
403.gcc (avg) (percentage) 4.080 -
403.gcc (max) (percentage) 5.540 -
410.bwaves 30.000 -
410.bwaves (avg) 30.000 -
410.bwaves (avg) (percentage) 0.580 -
410.bwaves (max) 31.000 -16.22%
410.bwaves (max) (percentage) 0.590 -16.90%
410.bwaves (unexplained diff vs previous) 25.000 -34.21%
410.bwaves (unexplained diff vs previous) (percentage) 0.470 -34.72%
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) (percentage) 0.100 -
429.mcf 33.000 -2.94%
429.mcf (avg) 33.000 -2.94%
429.mcf (avg) (percentage) 2.710 -1.81%
429.mcf (max) 19.000 -48.65%
429.mcf (max) (percentage) 1.560 -48.85%
429.mcf (unexplained diff vs previous) 14.000 -17.65%
429.mcf (unexplained diff vs previous) (percentage) 1.120 -18.84%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.520 -
433.milc (max) 6.000 200.00%
433.milc (max) (percentage) 0.550 175.00%
433.milc (unexplained diff vs previous) 6.000 500.00%
433.milc (unexplained diff vs previous) (percentage) 0.550 511.11%
434.zeusmp 13.000 -
434.zeusmp (avg) 13.000 -
434.zeusmp (avg) (percentage) 0.550 -
434.zeusmp (max) 15.000 25.00%
434.zeusmp (max) (percentage) 0.630 21.15%
434.zeusmp (unexplained diff vs previous) 15.000 200.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.620 195.24%
435.gromacs 83.000 -1.19%
435.gromacs (avg) 83.000 -1.19%
435.gromacs (avg) (percentage) 1.430 -2.05%
435.gromacs (max) 58.000 -20.55%
435.gromacs (max) (percentage) 1.010 -20.47%
435.gromacs (unexplained diff vs previous) 34.000 -45.16%
435.gromacs (unexplained diff vs previous) (percentage) 0.580 -45.79%
436.cactusADM 12.000 -7.69%
436.cactusADM (avg) 12.000 -7.69%
436.cactusADM (avg) (percentage) 0.550 -1.79%
436.cactusADM (max) 15.000 -11.76%
436.cactusADM (max) (percentage) 0.660 -13.16%
436.cactusADM (unexplained diff vs previous) 7.000 -61.11%
436.cactusADM (unexplained diff vs previous) (percentage) 0.300 -61.04%
437.leslie3d 360.000 1.12%
437.leslie3d (avg) 360.000 1.12%
437.leslie3d (avg) (percentage) 3.540 -
437.leslie3d (max) 419.000 -3.68%
437.leslie3d (max) (percentage) 4.120 -4.63%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.590 -1.67%
444.namd (max) 7.000 -
444.namd (max) (percentage) 0.930 -5.10%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.260 -
445.gobmk 25.000 4.17%
445.gobmk (avg) 25.000 4.17%
445.gobmk (avg) (percentage) 0.540 1.89%
445.gobmk (max) 30.000 30.43%
445.gobmk (max) (percentage) 0.660 32.00%
445.gobmk (unexplained diff vs previous) 31.000 72.22%
445.gobmk (unexplained diff vs previous) (percentage) 0.670 76.32%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 1.120 -1.75%
447.dealII (max) 15.000 -11.76%
447.dealII (max) (percentage) 1.130 -12.40%
447.dealII (unexplained diff vs previous) 10.000 -44.44%
447.dealII (unexplained diff vs previous) (percentage) 0.720 -45.04%
450.soplex 9.000 -
450.soplex (avg) 9.000 -
450.soplex (avg) (percentage) 1.680 -2.33%
450.soplex (max) 12.000 -20.00%
450.soplex (max) (percentage) 2.390 -16.72%
450.soplex (unexplained diff vs previous) 3.000 -80.00%
450.soplex (unexplained diff vs previous) (percentage) 0.560 -79.93%
453.povray 4.000 -20.00%
453.povray (avg) 4.000 -20.00%
453.povray (avg) (percentage) 1.190 -3.25%
453.povray (max) 4.000 -55.56%
453.povray (max) (percentage) 1.090 -52.19%
453.povray (unexplained diff vs previous) 1.000 -83.33%
453.povray (unexplained diff vs previous) (percentage) 0.240 -83.22%
454.calculix (avg) (percentage) 3.640 -
454.calculix (max) (percentage) 4.720 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 7.000 -12.50%
456.hmmer (max) (percentage) 0.220 -15.38%
456.hmmer (unexplained diff vs previous) 4.000 -50.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.120 -50.00%
458.sjeng 21.000 -4.55%
458.sjeng (avg) 21.000 -4.55%
458.sjeng (avg) (percentage) 0.300 -3.23%
458.sjeng (max) 29.000 -25.64%
458.sjeng (max) (percentage) 0.410 -25.45%
458.sjeng (unexplained diff vs previous) 9.000 -76.92%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 -76.36%
459.GemsFDTD 32.000 -
459.GemsFDTD (avg) 32.000 -
459.GemsFDTD (avg) (percentage) 0.630 -
459.GemsFDTD (max) 18.000 -10.00%
459.GemsFDTD (max) (percentage) 0.360 -10.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.390 -1.42%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.220 -5.01%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.940 -
464.h264ref 14.000 -6.67%
464.h264ref (avg) 14.000 -6.67%
464.h264ref (avg) (percentage) 0.280 -
464.h264ref (max) 14.000 -57.58%
464.h264ref (max) (percentage) 0.280 -54.84%
464.h264ref (unexplained diff vs previous) 1.000 -94.44%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -94.12%
465.tonto 65.000 -
465.tonto (avg) 65.000 -
465.tonto (avg) (percentage) 0.660 -
465.tonto (max) 123.000 -6.11%
465.tonto (max) (percentage) 1.250 -6.02%
470.lbm 18.000 -
470.lbm (avg) 18.000 -
470.lbm (avg) (percentage) 0.480 -
470.lbm (max) 21.000 5.00%
470.lbm (max) (percentage) 0.540 5.88%
470.lbm (unexplained diff vs previous) 21.000 5.00%
470.lbm (unexplained diff vs previous) (percentage) 0.540 5.88%
471.omnetpp 33.000 -2.94%
471.omnetpp (avg) 33.000 -2.94%
471.omnetpp (avg) (percentage) 1.560 -2.50%
471.omnetpp (max) 29.000 -38.30%
471.omnetpp (max) (percentage) 1.390 -36.82%
471.omnetpp (unexplained diff vs previous) 10.000 -50.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.460 -50.00%
473.astar 41.000 -2.38%
473.astar (avg) 41.000 -2.38%
473.astar (avg) (percentage) 0.880 -3.30%
473.astar (max) 12.000 -57.14%
473.astar (max) (percentage) 0.260 -56.67%
473.astar (unexplained diff vs previous) 2.000 -87.50%
473.astar (unexplained diff vs previous) (percentage) 0.040 -88.24%
481.wrf (avg) (percentage) 1.060 -
481.wrf (max) (percentage) 0.750 -
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.940 -1.05%
482.sphinx3 (max) 13.000 -
482.sphinx3 (max) (percentage) 1.740 -2.79%
482.sphinx3 (unexplained diff vs previous) 5.000 66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.660 65.00%
Geometric Mean 3.795 -5.69%