Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7c0de4c1e0304fe2a67942745b584dbcd5e72950 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/016c947b02e79a5c0c0c2d4ad5cb71aa04db3efd (+ 38 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=910aae6e5a2196938fc30fa54dd1e96f16774ce7 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/1413c372d6b7faed82cb533a704db281ef0f5483 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/207/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0207 (basepoints/gcc-15-02065-g016c947b02e) 2024-07-16T13:22:54 0:00:00
Previous 0205 (3-changed-components) 2024-07-15T02:45:31 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 67 14
Performance Improvements 66 13
Added Tests 2 130
Unchanged Tests 1005 983
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.32% 9655.000 10072.000 - -2.66% -
450.soplex 2.87% 522.000 537.000 - 0.94% -
453.povray 1.45% 415.000 421.000 - -2.09% -
465.tonto 1.33% 9794.000 9924.000 - 0.20% -
435.gromacs 1.08% 5732.000 5794.000 - 1.29% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) 1850.00% 2.000 39.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 1850.00% 2.000 39.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 1733.33% 0.030 0.550 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 1625.00% 0.080 1.380 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 1600.00% 1.000 17.000 0.000 0.00% 0.000
458.sjeng (max) (percentage) 1275.00% 0.040 0.550 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 850.00% 0.040 0.380 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 800.00% 2.000 18.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 209.09% 0.110 0.340 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) 200.00% 6.000 18.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 145.59% 0.680 1.670 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 142.11% 19.000 46.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) 132.97% 0.910 2.120 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 129.63% 27.000 62.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) 128.57% 14.000 32.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 127.66% 0.470 1.070 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 103.41% 205.000 417.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) 101.54% 0.650 1.310 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) 100.00% 9.000 18.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 95.28% 2.120 4.140 0.000 0.00% 0.000
465.tonto (max) 74.67% 75.000 131.000 - 0.00% -
465.tonto (max) (percentage) 72.73% 0.770 1.330 - 0.00% -
465.tonto (unexplained diff vs previous) 71.05% 76.000 130.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) 67.95% 0.780 1.310 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 66.67% 12.000 20.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 64.52% 0.310 0.510 0.000 0.00% 0.000
450.soplex (max) 50.00% 10.000 15.000 - 0.00% -
450.soplex (max) (percentage) 39.32% 2.060 2.870 - 0.00% -
450.soplex (unexplained diff vs previous) 36.36% 11.000 15.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 33.33% 0.690 0.920 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 33.33% 15.000 20.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 32.23% 2.110 2.790 0.000 0.00% 0.000
470.lbm (max) 25.00% 16.000 20.000 - 0.00% -
470.lbm (max) (percentage) 21.43% 0.420 0.510 - 0.00% -
453.povray (unexplained diff vs previous) 20.00% 5.000 6.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) 19.17% 1.200 1.430 0.000 0.00% 0.000
437.leslie3d (max) 15.08% 378.000 435.000 - 0.00% -
450.soplex 12.50% 8.000 9.000 - 0.00% -
450.soplex (avg) 12.50% 8.000 9.000 - 0.00% -
437.leslie3d (max) (percentage) 10.20% 3.920 4.320 - 0.00% -
447.dealII (max) (percentage) 8.40% 1.190 1.290 - 0.00% -
436.cactusADM 8.33% 12.000 13.000 - 0.00% -
436.cactusADM (avg) 8.33% 12.000 13.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 6.94% 0.720 0.770 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 6.67% 15.000 16.000 0.000 0.00% 0.000
465.tonto 6.56% 61.000 65.000 - 0.00% -
465.tonto (avg) 6.56% 61.000 65.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 6.25% 0.320 0.340 0.000 0.00% 0.000
447.dealII (max) 6.25% 16.000 17.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 5.88% 17.000 18.000 0.000 0.00% 0.000
437.leslie3d 5.33% 338.000 356.000 - 0.00% -
437.leslie3d (avg) 5.33% 338.000 356.000 - 0.00% -
465.tonto (avg) (percentage) 4.76% 0.630 0.660 - 0.00% -
458.sjeng 4.76% 21.000 22.000 - 0.00% -
458.sjeng (avg) 4.76% 21.000 22.000 - 0.00% -
436.cactusADM (max) (percentage) 4.11% 0.730 0.760 - 0.00% -
458.sjeng (avg) (percentage) 3.33% 0.300 0.310 - 0.00% -
450.soplex (avg) (percentage) 2.38% 1.680 1.720 - 0.00% -
436.cactusADM (avg) (percentage) 1.82% 0.550 0.560 - 0.00% -
410.bwaves (avg) (percentage) 1.75% 0.570 0.580 - 0.00% -
401.bzip2 (avg) (percentage) 1.69% 1.180 1.200 - 0.00% -
400.perlbench (avg) (percentage) 1.21% 1.650 1.670 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -2.08% 1539.000 1507.000 - 10.32% -
401.bzip2 -1.64% 2800.000 2754.000 - 0.95% -
429.mcf -1.36% 1252.000 1235.000 - 33.66% -
447.dealII -1.29% 1392.000 1374.000 - -2.48% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -74.76% 1.030 0.260 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -66.67% 0.630 0.210 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -66.67% 15.000 5.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -53.70% 0.540 0.250 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -53.57% 28.000 13.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -50.00% 2.000 1.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -50.00% 0.180 0.090 0.000 0.00% 0.000
459.GemsFDTD (max) -31.03% 29.000 20.000 - 0.00% -
459.GemsFDTD (max) (percentage) -29.82% 0.570 0.400 - 0.00% -
434.zeusmp (max) (percentage) -17.46% 0.630 0.520 - 0.00% -
434.zeusmp (max) -14.29% 14.000 12.000 - 0.00% -
444.namd (max) -12.50% 8.000 7.000 - 0.00% -
456.hmmer (max) -11.11% 9.000 8.000 - 0.00% -
453.povray (max) -10.00% 10.000 9.000 - 0.00% -
433.milc (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
471.omnetpp (max) -7.84% 51.000 47.000 - 0.00% -
429.mcf (max) -7.50% 40.000 37.000 - 0.00% -
482.sphinx3 (max) -7.14% 14.000 13.000 - 0.00% -
444.namd (max) (percentage) -6.67% 1.050 0.980 - 0.00% -
473.astar (max) -6.67% 30.000 28.000 - 0.00% -
462.libquantum (max) (percentage) -6.61% 3.630 3.390 - 0.00% -
471.omnetpp (max) (percentage) -6.38% 2.350 2.200 - 0.00% -
473.astar (max) (percentage) -6.25% 0.640 0.600 - 0.00% -
453.povray (max) (percentage) -5.79% 2.420 2.280 - 0.00% -
445.gobmk (max) (percentage) -5.66% 0.530 0.500 - 0.00% -
429.mcf (max) (percentage) -5.57% 3.230 3.050 - 0.00% -
410.bwaves (max) -5.13% 39.000 37.000 - 0.00% -
400.perlbench (max) -5.00% 60.000 57.000 - 0.00% -
445.gobmk (max) -4.17% 24.000 23.000 - 0.00% -
445.gobmk -4.00% 25.000 24.000 - 0.00% -
445.gobmk (avg) -4.00% 25.000 24.000 - 0.00% -
482.sphinx3 (max) (percentage) -3.76% 1.860 1.790 - 0.00% -
456.hmmer (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
464.h264ref (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
459.GemsFDTD (avg) (percentage) -3.08% 0.650 0.630 - 0.00% -
459.GemsFDTD -3.03% 33.000 32.000 - 0.00% -
459.GemsFDTD (avg) -3.03% 33.000 32.000 - 0.00% -
464.h264ref (max) -2.94% 34.000 33.000 - 0.00% -
429.mcf -2.86% 35.000 34.000 - 0.00% -
429.mcf (avg) -2.86% 35.000 34.000 - 0.00% -
471.omnetpp -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (avg) -2.86% 35.000 34.000 - 0.00% -
462.libquantum (avg) (percentage) -2.76% 1.450 1.410 - 0.00% -
410.bwaves (max) (percentage) -2.74% 0.730 0.710 - 0.00% -
410.bwaves (unexplained diff vs previous) -2.56% 39.000 38.000 0.000 0.00% 0.000
473.astar -2.33% 43.000 42.000 - 0.00% -
473.astar (avg) -2.33% 43.000 42.000 - 0.00% -
400.perlbench (max) (percentage) -2.30% 3.910 3.820 - 0.00% -
401.bzip2 (max) -2.08% 48.000 47.000 - 0.00% -
482.sphinx3 (avg) (percentage) -2.06% 0.970 0.950 - 0.00% -
433.milc (avg) (percentage) -1.89% 0.530 0.520 - 0.00% -
445.gobmk (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
434.zeusmp (avg) (percentage) -1.79% 0.560 0.550 - 0.00% -
401.bzip2 (max) (percentage) -1.72% 1.740 1.710 - 0.00% -
444.namd (avg) (percentage) -1.64% 0.610 0.600 - 0.00% -
435.gromacs (max) (percentage) -1.55% 1.290 1.270 - 0.00% -
429.mcf (avg) (percentage) -1.43% 2.800 2.760 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -1.37% 0.730 0.720 0.000 0.00% 0.000
481.wrf (max) (percentage) -1.32% 0.760 0.750 - 0.00% -
471.omnetpp (avg) (percentage) -1.23% 1.620 1.600 - 0.00% -
473.astar (avg) (percentage) -1.09% 0.920 0.910 - 0.00% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.81% 2255286.000 2341166.000 - 0.00% -
447.dealII 3.58% 381188.000 394837.000 - 0.00% -
462.libquantum 3.45% 19841.000 20525.000 - 0.00% -
444.namd 3.34% 225019.000 232529.000 - 0.00% -
410.bwaves 2.21% 22626.000 23127.000 - 0.00% -
400.perlbench 1.58% 1025894.000 1042077.000 - 0.00% -
464.h264ref 1.57% 448678.000 455730.000 - 0.00% -
473.astar 1.50% 23768.000 24124.000 - 0.00% -
470.lbm 1.26% 10803.000 10939.000 - 0.00% -
450.soplex 1.11% 245125.000 247837.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 33.66% 924.000 1235.000 - -1.36% -
400.perlbench 10.32% 1366.000 1507.000 - -2.08% -
458.sjeng 5.70% 6725.000 7108.000 - 0.55% -
435.gromacs 1.29% 5720.000 5794.000 - 1.08% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -7.08% 113.000 105.000 - 0.00% -
473.astar -3.38% 4883.000 4718.000 - 0.34% -
437.leslie3d -2.66% 10347.000 10072.000 - 4.32% -
447.dealII -2.48% 1409.000 1374.000 - -1.29% -
433.milc -2.41% 1119.000 1092.000 - -0.09% -
453.povray -2.09% 430.000 421.000 - 1.45% -
410.bwaves -1.85% 5409.000 5309.000 - -0.71% -
445.gobmk -1.72% 4771.000 4689.000 - 0.39% -
436.cactusADM -1.51% 2378.000 2342.000 - -0.76% -
464.h264ref -1.28% 5407.000 5338.000 - -0.34% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 142.86% 28.000 68.000 - 0.00% -
nb_compile_successful 71.43% 28.000 48.000 - 0.00% -
nb_execution_successful 71.43% 28.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1507.000 -2.08%
401.bzip2 2754.000 -1.64%
410.bwaves 5309.000 -
429.mcf 1235.000 -1.36%
433.milc 1092.000 -
434.zeusmp 2385.000 -
435.gromacs 5794.000 1.08%
436.cactusADM 2342.000 -
437.leslie3d 10072.000 4.32%
444.namd 771.000 -
445.gobmk 4689.000 -
447.dealII 1374.000 -1.29%
450.soplex 537.000 2.87%
453.povray 421.000 1.45%
456.hmmer 3391.000 -
458.sjeng 7108.000 -
459.GemsFDTD 5173.000 -
462.libquantum 105.000 -
464.h264ref 5338.000 -
465.tonto 9924.000 1.33%
470.lbm 3925.000 -
471.omnetpp 2167.000 -
473.astar 4718.000 -
482.sphinx3 753.000 -
Geometric Mean 2229.686 -
Name Current %
400.perlbench 1042077.000 -
401.bzip2 49268.000 -
410.bwaves 23127.000 -
429.mcf 9703.000 -
433.milc 70785.000 -
434.zeusmp 217758.000 -
435.gromacs 577636.000 -
436.cactusADM 413114.000 -
437.leslie3d 79261.000 -
444.namd 232529.000 -
445.gobmk 1404513.000 -
447.dealII 394837.000 -
450.soplex 247837.000 -
453.povray 793733.000 -
456.hmmer 125539.000 -
458.sjeng 117827.000 -
459.GemsFDTD 328163.000 -
462.libquantum 20525.000 -
464.h264ref 455730.000 -
465.tonto 2341166.000 -
470.lbm 10939.000 -
471.omnetpp 525497.000 -
473.astar 24124.000 -
482.sphinx3 128775.000 -
Geometric Mean 164829.132 -
Name Current %
400.perlbench 25.000 -
400.perlbench (avg) 25.000 -
400.perlbench (avg) (percentage) 1.670 1.21%
400.perlbench (max) 57.000 -5.00%
400.perlbench (max) (percentage) 3.820 -2.30%
400.perlbench (unexplained diff vs previous) 32.000 128.57%
400.perlbench (unexplained diff vs previous) (percentage) 2.120 132.97%
401.bzip2 33.000 -
401.bzip2 (avg) 33.000 -
401.bzip2 (avg) (percentage) 1.200 1.69%
401.bzip2 (max) 47.000 -2.08%
401.bzip2 (max) (percentage) 1.710 -1.72%
401.bzip2 (unexplained diff vs previous) 46.000 142.11%
401.bzip2 (unexplained diff vs previous) (percentage) 1.670 145.59%
403.gcc (avg) (percentage) 4.080 -
403.gcc (max) (percentage) 5.570 -
410.bwaves 30.000 -
410.bwaves (avg) 30.000 -
410.bwaves (avg) (percentage) 0.580 1.75%
410.bwaves (max) 37.000 -5.13%
410.bwaves (max) (percentage) 0.710 -2.74%
410.bwaves (unexplained diff vs previous) 38.000 -2.56%
410.bwaves (unexplained diff vs previous) (percentage) 0.720 -1.37%
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) (percentage) 0.100 -
429.mcf 34.000 -2.86%
429.mcf (avg) 34.000 -2.86%
429.mcf (avg) (percentage) 2.760 -1.43%
429.mcf (max) 37.000 -7.50%
429.mcf (max) (percentage) 3.050 -5.57%
429.mcf (unexplained diff vs previous) 17.000 1600.00%
429.mcf (unexplained diff vs previous) (percentage) 1.380 1625.00%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.520 -1.89%
433.milc (max) 2.000 -
433.milc (max) (percentage) 0.200 -9.09%
433.milc (unexplained diff vs previous) 1.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -50.00%
434.zeusmp 13.000 -
434.zeusmp (avg) 13.000 -
434.zeusmp (avg) (percentage) 0.550 -1.79%
434.zeusmp (max) 12.000 -14.29%
434.zeusmp (max) (percentage) 0.520 -17.46%
434.zeusmp (unexplained diff vs previous) 5.000 -66.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.210 -66.67%
435.gromacs 84.000 -
435.gromacs (avg) 84.000 -
435.gromacs (avg) (percentage) 1.460 -
435.gromacs (max) 73.000 -
435.gromacs (max) (percentage) 1.270 -1.55%
435.gromacs (unexplained diff vs previous) 62.000 129.63%
435.gromacs (unexplained diff vs previous) (percentage) 1.070 127.66%
436.cactusADM 13.000 8.33%
436.cactusADM (avg) 13.000 8.33%
436.cactusADM (avg) (percentage) 0.560 1.82%
436.cactusADM (max) 17.000 -
436.cactusADM (max) (percentage) 0.760 4.11%
436.cactusADM (unexplained diff vs previous) 18.000 5.88%
436.cactusADM (unexplained diff vs previous) (percentage) 0.770 6.94%
437.leslie3d 356.000 5.33%
437.leslie3d (avg) 356.000 5.33%
437.leslie3d (avg) (percentage) 3.540 -
437.leslie3d (max) 435.000 15.08%
437.leslie3d (max) (percentage) 4.320 10.20%
437.leslie3d (unexplained diff vs previous) 417.000 103.41%
437.leslie3d (unexplained diff vs previous) (percentage) 4.140 95.28%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.600 -1.64%
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 0.980 -6.67%
444.namd (unexplained diff vs previous) 2.000 -75.00%
444.namd (unexplained diff vs previous) (percentage) 0.260 -74.76%
445.gobmk 24.000 -4.00%
445.gobmk (avg) 24.000 -4.00%
445.gobmk (avg) (percentage) 0.530 -1.85%
445.gobmk (max) 23.000 -4.17%
445.gobmk (max) (percentage) 0.500 -5.66%
445.gobmk (unexplained diff vs previous) 18.000 800.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.380 850.00%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 1.140 -
447.dealII (max) 17.000 6.25%
447.dealII (max) (percentage) 1.290 8.40%
447.dealII (unexplained diff vs previous) 18.000 100.00%
447.dealII (unexplained diff vs previous) (percentage) 1.310 101.54%
450.soplex 9.000 12.50%
450.soplex (avg) 9.000 12.50%
450.soplex (avg) (percentage) 1.720 2.38%
450.soplex (max) 15.000 50.00%
450.soplex (max) (percentage) 2.870 39.32%
450.soplex (unexplained diff vs previous) 15.000 36.36%
450.soplex (unexplained diff vs previous) (percentage) 2.790 32.23%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.230 -
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 2.280 -5.79%
453.povray (unexplained diff vs previous) 6.000 20.00%
453.povray (unexplained diff vs previous) (percentage) 1.430 19.17%
454.calculix (avg) (percentage) 3.640 -
454.calculix (max) (percentage) 4.720 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 8.000 -11.11%
456.hmmer (max) (percentage) 0.260 -3.70%
456.hmmer (unexplained diff vs previous) 8.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.240 -
458.sjeng 22.000 4.76%
458.sjeng (avg) 22.000 4.76%
458.sjeng (avg) (percentage) 0.310 3.33%
458.sjeng (max) 39.000 1850.00%
458.sjeng (max) (percentage) 0.550 1275.00%
458.sjeng (unexplained diff vs previous) 39.000 1850.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.550 1733.33%
459.GemsFDTD 32.000 -3.03%
459.GemsFDTD (avg) 32.000 -3.03%
459.GemsFDTD (avg) (percentage) 0.630 -3.08%
459.GemsFDTD (max) 20.000 -31.03%
459.GemsFDTD (max) (percentage) 0.400 -29.82%
459.GemsFDTD (unexplained diff vs previous) 13.000 -53.57%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.250 -53.70%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.410 -2.76%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.390 -6.61%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 15.000 -
464.h264ref (avg) 15.000 -
464.h264ref (avg) (percentage) 0.290 -
464.h264ref (max) 33.000 -2.94%
464.h264ref (max) (percentage) 0.620 -3.13%
464.h264ref (unexplained diff vs previous) 18.000 200.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.340 209.09%
465.tonto 65.000 6.56%
465.tonto (avg) 65.000 6.56%
465.tonto (avg) (percentage) 0.660 4.76%
465.tonto (max) 131.000 74.67%
465.tonto (max) (percentage) 1.330 72.73%
465.tonto (unexplained diff vs previous) 130.000 71.05%
465.tonto (unexplained diff vs previous) (percentage) 1.310 67.95%
470.lbm 18.000 -
470.lbm (avg) 18.000 -
470.lbm (avg) (percentage) 0.480 -
470.lbm (max) 20.000 25.00%
470.lbm (max) (percentage) 0.510 21.43%
470.lbm (unexplained diff vs previous) 20.000 66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.510 64.52%
471.omnetpp 34.000 -2.86%
471.omnetpp (avg) 34.000 -2.86%
471.omnetpp (avg) (percentage) 1.600 -1.23%
471.omnetpp (max) 47.000 -7.84%
471.omnetpp (max) (percentage) 2.200 -6.38%
471.omnetpp (unexplained diff vs previous) 20.000 33.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.920 33.33%
473.astar 42.000 -2.33%
473.astar (avg) 42.000 -2.33%
473.astar (avg) (percentage) 0.910 -1.09%
473.astar (max) 28.000 -6.67%
473.astar (max) (percentage) 0.600 -6.25%
473.astar (unexplained diff vs previous) 16.000 6.67%
473.astar (unexplained diff vs previous) (percentage) 0.340 6.25%
481.wrf (avg) (percentage) 1.060 -
481.wrf (max) (percentage) 0.750 -1.32%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.950 -2.06%
482.sphinx3 (max) 13.000 -7.14%
482.sphinx3 (max) (percentage) 1.790 -3.76%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.400 -
Geometric Mean 4.149 3.96%