Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=24e5f9742611dbda04bb7e40c94c48637ecc0a21 (+ 25 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/8ed8c342fba682286159f56d0e53a05db95762a0 (+ 59 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c9154cad66aa0b11ede62cc9190d3485c5ef6941 (+ 5 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9739e4ba56b76b88e31eb0382ef512d32ea67fea (+ 375 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2_LTO-build/254/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0254 (4-changed-components) 2024-09-09T20:12:35 0:00:00
Previous 0253 (4-changed-components) 2024-09-05T23:54:04 0:00:00
Baseline 0001 (4-changed-components) 2023-03-25T19:03:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 9
Performance Improvements 121 26
Added Tests 6 136
Unchanged Tests 1023 993
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.81% 8152.000 8544.000 - 1.42% -
459.GemsFDTD 2.13% 4266.000 4357.000 - 3.39% -
400.perlbench 1.22% 1308.000 1324.000 - -5.90% -
447.dealII 1.19% 1093.000 1106.000 - 0.18% -
465.tonto 1.10% 8668.000 8763.000 - -5.02% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) 50.00% 0.500 0.750 0.000 0.00% 0.000
453.povray (max) (percentage) 48.00% 0.500 0.740 - 0.00% -
447.dealII 9.09% 11.000 12.000 - 0.00% -
447.dealII (avg) 9.09% 11.000 12.000 - 0.00% -
437.leslie3d 3.89% 591.000 614.000 - 0.00% -
437.leslie3d (avg) 3.89% 591.000 614.000 - 0.00% -
459.GemsFDTD 2.56% 78.000 80.000 - 0.00% -
459.GemsFDTD (avg) 2.56% 78.000 80.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -2.07% 1740.000 1704.000 - 19.16% -
410.bwaves -1.24% 4259.000 4206.000 - -4.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -98.86% 88.000 1.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -98.78% 4.110 0.050 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) -97.62% 84.000 2.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -97.58% 2.070 0.050 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -96.13% 5.170 0.200 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -96.04% 227.000 9.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -93.48% 46.000 3.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -93.42% 2.280 0.150 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -93.26% 89.000 6.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -93.20% 3.380 0.230 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -92.35% 3.530 0.270 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) -92.31% 117.000 9.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -89.25% 1.860 0.200 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -89.02% 82.000 9.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -87.18% 35.790 4.590 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -86.57% 2918.000 392.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -82.78% 209.000 36.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -82.43% 12.010 2.110 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) -80.99% 5.680 1.080 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) -80.69% 492.000 95.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -80.54% 4.110 0.800 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -80.39% 204.000 40.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -77.86% 1.400 0.310 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -77.78% 27.000 6.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -75.00% 28.000 7.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -74.66% 3.670 0.930 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -64.00% 25.000 9.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -63.83% 2.350 0.850 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -58.53% 5.040 2.090 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -57.67% 215.000 91.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -50.93% 108.000 53.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -50.75% 1.340 0.660 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -50.39% 2.540 1.260 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -50.00% 82.000 41.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -47.16% 2.290 1.210 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) -46.67% 30.000 16.000 0.000 0.00% 0.000
456.hmmer (max) -43.75% 16.000 9.000 - 0.00% -
456.hmmer (max) (percentage) -39.34% 0.610 0.370 - 0.00% -
436.cactusADM (max) -25.93% 27.000 20.000 - 0.00% -
436.cactusADM (max) (percentage) -25.35% 1.420 1.060 - 0.00% -
456.hmmer (unexplained diff vs previous) -25.00% 12.000 9.000 0.000 0.00% 0.000
462.libquantum (max) -25.00% 4.000 3.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -24.44% 0.450 0.340 0.000 0.00% 0.000
429.mcf (max) -18.28% 186.000 152.000 - 0.00% -
473.astar (max) (percentage) -16.70% 4.910 4.090 - 0.00% -
429.mcf (max) (percentage) -16.70% 10.720 8.930 - 0.00% -
434.zeusmp (max) (percentage) -16.59% 2.230 1.860 - 0.00% -
473.astar (max) -16.28% 215.000 180.000 - 0.00% -
434.zeusmp (max) -15.91% 44.000 37.000 - 0.00% -
471.omnetpp (max) -13.10% 84.000 73.000 - 0.00% -
401.bzip2 (max) -12.79% 86.000 75.000 - 0.00% -
401.bzip2 (max) (percentage) -12.54% 3.270 2.860 - 0.00% -
459.GemsFDTD (max) (percentage) -12.50% 4.800 4.200 - 0.00% -
471.omnetpp (max) (percentage) -12.44% 3.940 3.450 - 0.00% -
462.libquantum (max) (percentage) -12.41% 5.480 4.800 - 0.00% -
458.sjeng (max) -12.35% 81.000 71.000 - 0.00% -
458.sjeng (max) (percentage) -12.12% 1.320 1.160 - 0.00% -
447.dealII (max) -11.11% 9.000 8.000 - 0.00% -
459.GemsFDTD (max) -10.78% 204.000 182.000 - 0.00% -
400.perlbench (max) -10.34% 29.000 26.000 - 0.00% -
450.soplex (max) (percentage) -10.04% 7.470 6.720 - 0.00% -
444.namd (max) (percentage) -10.04% 2.490 2.240 - 0.00% -
445.gobmk (max) -10.00% 80.000 72.000 - 0.00% -
445.gobmk (max) (percentage) -9.84% 1.830 1.650 - 0.00% -
400.perlbench (max) (percentage) -9.82% 2.240 2.020 - 0.00% -
437.leslie3d (max) (percentage) -8.35% 26.360 24.160 - 0.00% -
450.soplex (max) -8.11% 37.000 34.000 - 0.00% -
470.lbm (max) -7.08% 113.000 105.000 - 0.00% -
470.lbm (max) (percentage) -7.04% 3.410 3.170 - 0.00% -
444.namd (max) -6.67% 15.000 14.000 - 0.00% -
464.h264ref (max) (percentage) -6.40% 2.030 1.900 - 0.00% -
465.tonto (max) (percentage) -6.33% 5.370 5.030 - 0.00% -
464.h264ref (max) -6.10% 82.000 77.000 - 0.00% -
410.bwaves (max) -6.04% 149.000 140.000 - 0.00% -
482.sphinx3 -5.88% 17.000 16.000 - 0.00% -
482.sphinx3 (avg) -5.88% 17.000 16.000 - 0.00% -
482.sphinx3 (max) (percentage) -5.86% 4.950 4.660 - 0.00% -
436.cactusADM -5.56% 18.000 17.000 - 0.00% -
436.cactusADM (avg) -5.56% 18.000 17.000 - 0.00% -
482.sphinx3 (max) -5.41% 37.000 35.000 - 0.00% -
465.tonto (max) -5.38% 465.000 440.000 - 0.00% -
435.gromacs (max) (percentage) -4.64% 5.170 4.930 - 0.00% -
410.bwaves (max) (percentage) -4.57% 3.500 3.340 - 0.00% -
433.milc (max) (percentage) -4.45% 3.370 3.220 - 0.00% -
429.mcf -4.12% 97.000 93.000 - 0.00% -
429.mcf (avg) -4.12% 97.000 93.000 - 0.00% -
471.omnetpp -4.08% 49.000 47.000 - 0.00% -
471.omnetpp (avg) -4.08% 49.000 47.000 - 0.00% -
437.leslie3d (max) -3.91% 2148.000 2064.000 - 0.00% -
435.gromacs (max) -3.91% 256.000 246.000 - 0.00% -
401.bzip2 -3.85% 52.000 50.000 - 0.00% -
401.bzip2 (avg) -3.85% 52.000 50.000 - 0.00% -
447.dealII (max) (percentage) -3.57% 0.840 0.810 - 0.00% -
400.perlbench -3.23% 31.000 30.000 - 0.00% -
400.perlbench (avg) -3.23% 31.000 30.000 - 0.00% -
444.namd (avg) (percentage) -2.97% 1.010 0.980 - 0.00% -
464.h264ref -2.94% 34.000 33.000 - 0.00% -
464.h264ref (avg) -2.94% 34.000 33.000 - 0.00% -
433.milc (max) -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (avg) (percentage) -2.62% 2.290 2.230 - 0.00% -
401.bzip2 (avg) (percentage) -2.51% 1.990 1.940 - 0.00% -
434.zeusmp (avg) (percentage) -2.46% 1.220 1.190 - 0.00% -
450.soplex (avg) (percentage) -2.45% 3.680 3.590 - 0.00% -
464.h264ref (avg) (percentage) -2.38% 0.840 0.820 - 0.00% -
445.gobmk -2.22% 45.000 44.000 - 0.00% -
445.gobmk (avg) -2.22% 45.000 44.000 - 0.00% -
462.libquantum (avg) (percentage) -2.16% 2.310 2.260 - 0.00% -
473.astar (avg) (percentage) -2.07% 2.420 2.370 - 0.00% -
445.gobmk (avg) (percentage) -1.94% 1.030 1.010 - 0.00% -
435.gromacs (avg) (percentage) -1.92% 2.610 2.560 - 0.00% -
473.astar -1.89% 106.000 104.000 - 0.00% -
473.astar (avg) -1.89% 106.000 104.000 - 0.00% -
400.perlbench (avg) (percentage) -1.68% 2.380 2.340 - 0.00% -
429.mcf (avg) (percentage) -1.61% 5.590 5.500 - 0.00% -
470.lbm (avg) (percentage) -1.52% 1.320 1.300 - 0.00% -
453.povray (avg) (percentage) -1.41% 1.420 1.400 - 0.00% -
410.bwaves -1.39% 72.000 71.000 - 0.00% -
410.bwaves (avg) -1.39% 72.000 71.000 - 0.00% -
482.sphinx3 (avg) (percentage) -1.34% 2.240 2.210 - 0.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.61% 2314060.000 2397671.000 - 0.00% -
482.sphinx3 2.47% 136204.000 139564.000 - 0.00% -
456.hmmer 1.82% 134037.000 136477.000 - 0.00% -
429.mcf 1.26% 9840.000 9964.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 19.16% 1430.000 1704.000 - -2.07% -
436.cactusADM 4.39% 1847.000 1928.000 - -0.31% -
459.GemsFDTD 3.39% 4214.000 4357.000 - 2.13% -
437.leslie3d 1.42% 8424.000 8544.000 - 4.81% -
434.zeusmp 1.36% 1991.000 2018.000 - 0.15% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -10.35% 72512.000 65004.000 - 0.00% -
462.libquantum -3.54% 20328.000 19608.000 - 0.00% -
473.astar -3.18% 27173.000 26309.000 - 0.00% -
401.bzip2 -2.81% 51213.000 49773.000 - 0.00% -
434.zeusmp -2.11% 191785.000 187731.000 - 0.00% -
470.lbm -1.86% 10968.000 10764.000 - 0.00% -
433.milc -1.39% 72058.000 71054.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -8.81% 556.000 507.000 - 0.00% -
435.gromacs -6.87% 5372.000 5003.000 - 0.81% -
473.astar -6.54% 4709.000 4401.000 - 0.20% -
462.libquantum -6.10% 82.000 77.000 - 0.00% -
400.perlbench -5.90% 1407.000 1324.000 - 1.22% -
465.tonto -5.02% 9226.000 8763.000 - 1.10% -
470.lbm -4.86% 3496.000 3326.000 - 0.27% -
445.gobmk -4.58% 4627.000 4415.000 - 0.20% -
410.bwaves -4.30% 4395.000 4206.000 - -1.24% -
401.bzip2 -4.16% 2741.000 2627.000 - -0.23% -
453.povray -4.08% 417.000 400.000 - -0.74% -
464.h264ref -4.02% 4232.000 4062.000 - 0.05% -
482.sphinx3 -3.08% 780.000 756.000 - -0.92% -
433.milc -2.58% 1084.000 1056.000 - -0.85% -
458.sjeng -2.46% 6338.000 6182.000 - 0.67% -
471.omnetpp -2.01% 2186.000 2142.000 - -0.05% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1324.000 1.22%
401.bzip2 2627.000 -
410.bwaves 4206.000 -1.24%
429.mcf 1704.000 -2.07%
433.milc 1056.000 -
434.zeusmp 2018.000 -
435.gromacs 5003.000 -
436.cactusADM 1928.000 -
437.leslie3d 8544.000 4.81%
444.namd 626.000 -
445.gobmk 4415.000 -
447.dealII 1106.000 1.19%
450.soplex 507.000 -
453.povray 400.000 -
456.hmmer 2682.000 -
458.sjeng 6182.000 -
459.GemsFDTD 4357.000 2.13%
462.libquantum 77.000 -
464.h264ref 4062.000 -
465.tonto 8763.000 1.10%
470.lbm 3326.000 -
471.omnetpp 2142.000 -
473.astar 4401.000 -
482.sphinx3 756.000 -
Geometric Mean 1977.173 -
Name Current %
400.perlbench 1121852.000 -
401.bzip2 49773.000 -
410.bwaves 20580.000 -
429.mcf 9964.000 -
433.milc 71054.000 -
434.zeusmp 187731.000 -
435.gromacs 585495.000 -
436.cactusADM 430937.000 -
437.leslie3d 65004.000 -
444.namd 225557.000 -
445.gobmk 1571295.000 -
447.dealII 412909.000 -
450.soplex 275415.000 -
453.povray 834991.000 -
456.hmmer 136477.000 -
458.sjeng 119890.000 -
459.GemsFDTD 303760.000 -
462.libquantum 19608.000 -
464.h264ref 437960.000 -
465.tonto 2397671.000 -
470.lbm 10764.000 -
471.omnetpp 595830.000 -
473.astar 26309.000 -
482.sphinx3 139564.000 -
Geometric Mean 166402.750 -
Name Current %
400.perlbench 30.000 -3.23%
400.perlbench (avg) 30.000 -3.23%
400.perlbench (avg) (percentage) 2.340 -1.68%
400.perlbench (max) 26.000 -10.34%
400.perlbench (max) (percentage) 2.020 -9.82%
400.perlbench (unexplained diff vs previous) 16.000 -46.67%
400.perlbench (unexplained diff vs previous) (percentage) 1.210 -47.16%
401.bzip2 50.000 -3.85%
401.bzip2 (avg) 50.000 -3.85%
401.bzip2 (avg) (percentage) 1.940 -2.51%
401.bzip2 (max) 75.000 -12.79%
401.bzip2 (max) (percentage) 2.860 -12.54%
401.bzip2 (unexplained diff vs previous) 6.000 -93.26%
401.bzip2 (unexplained diff vs previous) (percentage) 0.230 -93.20%
403.gcc (avg) (percentage) 4.710 -
403.gcc (max) (percentage) 4.450 -
410.bwaves 71.000 -1.39%
410.bwaves (avg) 71.000 -1.39%
410.bwaves (avg) (percentage) 1.690 -
410.bwaves (max) 140.000 -6.04%
410.bwaves (max) (percentage) 3.340 -4.57%
410.bwaves (unexplained diff vs previous) 53.000 -50.93%
410.bwaves (unexplained diff vs previous) (percentage) 1.260 -50.39%
416.gamess (avg) (percentage) 0.220 -
416.gamess (max) (percentage) 0.270 -
429.mcf 93.000 -4.12%
429.mcf (avg) 93.000 -4.12%
429.mcf (avg) (percentage) 5.500 -1.61%
429.mcf (max) 152.000 -18.28%
429.mcf (max) (percentage) 8.930 -16.70%
429.mcf (unexplained diff vs previous) 36.000 -82.78%
429.mcf (unexplained diff vs previous) (percentage) 2.110 -82.43%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.350 -
433.milc (max) 34.000 -2.86%
433.milc (max) (percentage) 3.220 -4.45%
433.milc (unexplained diff vs previous) 9.000 -64.00%
433.milc (unexplained diff vs previous) (percentage) 0.850 -63.83%
434.zeusmp 24.000 -
434.zeusmp (avg) 24.000 -
434.zeusmp (avg) (percentage) 1.190 -2.46%
434.zeusmp (max) 37.000 -15.91%
434.zeusmp (max) (percentage) 1.860 -16.59%
434.zeusmp (unexplained diff vs previous) 3.000 -93.48%
434.zeusmp (unexplained diff vs previous) (percentage) 0.150 -93.42%
435.gromacs 128.000 -
435.gromacs (avg) 128.000 -
435.gromacs (avg) (percentage) 2.560 -1.92%
435.gromacs (max) 246.000 -3.91%
435.gromacs (max) (percentage) 4.930 -4.64%
435.gromacs (unexplained diff vs previous) 40.000 -80.39%
435.gromacs (unexplained diff vs previous) (percentage) 0.800 -80.54%
436.cactusADM 17.000 -5.56%
436.cactusADM (avg) 17.000 -5.56%
436.cactusADM (avg) (percentage) 0.930 -
436.cactusADM (max) 20.000 -25.93%
436.cactusADM (max) (percentage) 1.060 -25.35%
436.cactusADM (unexplained diff vs previous) 6.000 -77.78%
436.cactusADM (unexplained diff vs previous) (percentage) 0.310 -77.86%
437.leslie3d 614.000 3.89%
437.leslie3d (avg) 614.000 3.89%
437.leslie3d (avg) (percentage) 7.190 -
437.leslie3d (max) 2064.000 -3.91%
437.leslie3d (max) (percentage) 24.160 -8.35%
437.leslie3d (unexplained diff vs previous) 392.000 -86.57%
437.leslie3d (unexplained diff vs previous) (percentage) 4.590 -87.18%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.980 -2.97%
444.namd (max) 14.000 -6.67%
444.namd (max) (percentage) 2.240 -10.04%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 44.000 -2.22%
445.gobmk (avg) 44.000 -2.22%
445.gobmk (avg) (percentage) 1.010 -1.94%
445.gobmk (max) 72.000 -10.00%
445.gobmk (max) (percentage) 1.650 -9.84%
445.gobmk (unexplained diff vs previous) 9.000 -89.02%
445.gobmk (unexplained diff vs previous) (percentage) 0.200 -89.25%
447.dealII 12.000 9.09%
447.dealII (avg) 12.000 9.09%
447.dealII (avg) (percentage) 1.090 -
447.dealII (max) 8.000 -11.11%
447.dealII (max) (percentage) 0.810 -3.57%
450.soplex 18.000 -
450.soplex (avg) 18.000 -
450.soplex (avg) (percentage) 3.590 -2.45%
450.soplex (max) 34.000 -8.11%
450.soplex (max) (percentage) 6.720 -10.04%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.400 -1.41%
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.740 48.00%
453.povray (unexplained diff vs previous) 3.000 50.00%
453.povray (unexplained diff vs previous) (percentage) 0.750 50.00%
454.calculix (avg) (percentage) 2.260 -
454.calculix (max) (percentage) 2.960 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.290 -
456.hmmer (max) 9.000 -43.75%
456.hmmer (max) (percentage) 0.370 -39.34%
456.hmmer (unexplained diff vs previous) 9.000 -25.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 -24.44%
458.sjeng 50.000 -
458.sjeng (avg) 50.000 -
458.sjeng (avg) (percentage) 0.810 -
458.sjeng (max) 71.000 -12.35%
458.sjeng (max) (percentage) 1.160 -12.12%
458.sjeng (unexplained diff vs previous) 41.000 -50.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.660 -50.75%
459.GemsFDTD 80.000 2.56%
459.GemsFDTD (avg) 80.000 2.56%
459.GemsFDTD (avg) (percentage) 1.840 -
459.GemsFDTD (max) 182.000 -10.78%
459.GemsFDTD (max) (percentage) 4.200 -12.50%
459.GemsFDTD (unexplained diff vs previous) 91.000 -57.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.090 -58.53%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.260 -2.16%
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 4.800 -12.41%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 33.000 -2.94%
464.h264ref (avg) 33.000 -2.94%
464.h264ref (avg) (percentage) 0.820 -2.38%
464.h264ref (max) 77.000 -6.10%
464.h264ref (max) (percentage) 1.900 -6.40%
464.h264ref (unexplained diff vs previous) 2.000 -97.62%
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -97.58%
465.tonto 116.000 -
465.tonto (avg) 116.000 -
465.tonto (avg) (percentage) 1.330 -
465.tonto (max) 440.000 -5.38%
465.tonto (max) (percentage) 5.030 -6.33%
465.tonto (unexplained diff vs previous) 95.000 -80.69%
465.tonto (unexplained diff vs previous) (percentage) 1.080 -80.99%
470.lbm 43.000 -
470.lbm (avg) 43.000 -
470.lbm (avg) (percentage) 1.300 -1.52%
470.lbm (max) 105.000 -7.08%
470.lbm (max) (percentage) 3.170 -7.04%
470.lbm (unexplained diff vs previous) 9.000 -92.31%
470.lbm (unexplained diff vs previous) (percentage) 0.270 -92.35%
471.omnetpp 47.000 -4.08%
471.omnetpp (avg) 47.000 -4.08%
471.omnetpp (avg) (percentage) 2.230 -2.62%
471.omnetpp (max) 73.000 -13.10%
471.omnetpp (max) (percentage) 3.450 -12.44%
471.omnetpp (unexplained diff vs previous) 1.000 -98.86%
471.omnetpp (unexplained diff vs previous) (percentage) 0.050 -98.78%
473.astar 104.000 -1.89%
473.astar (avg) 104.000 -1.89%
473.astar (avg) (percentage) 2.370 -2.07%
473.astar (max) 180.000 -16.28%
473.astar (max) (percentage) 4.090 -16.70%
473.astar (unexplained diff vs previous) 9.000 -96.04%
473.astar (unexplained diff vs previous) (percentage) 0.200 -96.13%
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) (percentage) 0.770 -
482.sphinx3 16.000 -5.88%
482.sphinx3 (avg) 16.000 -5.88%
482.sphinx3 (avg) (percentage) 2.210 -1.34%
482.sphinx3 (max) 35.000 -5.41%
482.sphinx3 (max) (percentage) 4.660 -5.86%
482.sphinx3 (unexplained diff vs previous) 7.000 -75.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.930 -74.66%
483.xalancbmk (avg) (percentage) 1.490 -
483.xalancbmk (max) (percentage) 1.000 -
Geometric Mean 4.927 -56.64%