Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=bb067ddfca63ee2d0472d71129a7bde268128110 (+ 24 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/16dda95e39fa04e5ab43486a980e8866ee12efd7 (+ 85 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=751a5502bea1d13551c62c47bb9bd25bff870cda (+ 3 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/25cd1b6c4571a4d82346fe97e81e280f64129355 (+ 120 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2_LTO-build/256/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0256 (4-changed-components) 2024-09-14T18:33:04 0:00:00
Previous 0254 (4-changed-components) 2024-09-09T20:12:35 0:00:00
Baseline 0001 (4-changed-components) 2023-03-25T19:03:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 21 8
Performance Improvements 118 27
Added Tests 8 136
Unchanged Tests 1017 993
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.36% 1324.000 1342.000 - -4.62% -
429.mcf 1.29% 1704.000 1726.000 - 20.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 1900.00% 1.000 20.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 1780.00% 0.050 0.940 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 200.00% 6.000 18.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 200.00% 0.230 0.690 0.000 0.00% 0.000
456.hmmer (max) 144.44% 9.000 22.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 144.44% 9.000 22.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 138.24% 0.340 0.810 0.000 0.00% 0.000
456.hmmer (max) (percentage) 121.62% 0.370 0.820 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 75.00% 0.800 1.400 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 72.50% 40.000 69.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) 16.67% 6.000 7.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 16.13% 0.310 0.360 0.000 0.00% 0.000
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
400.perlbench (unexplained diff vs previous) 12.50% 16.000 18.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) 10.74% 1.210 1.340 0.000 0.00% 0.000
456.hmmer (avg) (percentage) 6.90% 0.290 0.310 - 0.00% -
400.perlbench 3.33% 30.000 31.000 - 0.00% -
400.perlbench (avg) 3.33% 30.000 31.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.90% 8544.000 8211.000 - -2.53% -
435.gromacs -1.38% 5003.000 4934.000 - -8.15% -
462.libquantum -1.30% 77.000 76.000 - -7.32% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) -86.79% 53.000 7.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -86.51% 1.260 0.170 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -77.78% 9.000 2.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -77.65% 0.850 0.190 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -73.68% 2.090 0.550 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -73.63% 91.000 24.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -66.67% 3.000 1.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) -66.67% 0.750 0.250 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -58.54% 41.000 17.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -57.58% 0.660 0.280 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -45.00% 0.200 0.110 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -44.44% 9.000 5.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -39.81% 2.110 1.270 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -38.89% 36.000 22.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) -33.68% 95.000 63.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) -33.33% 1.080 0.720 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -29.03% 0.930 0.660 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -28.57% 7.000 5.000 0.000 0.00% 0.000
453.povray (max) (percentage) -16.22% 0.740 0.620 - 0.00% -
437.leslie3d (unexplained diff vs previous) -15.05% 392.000 333.000 0.000 0.00% 0.000
444.namd (max) -14.29% 14.000 12.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -11.55% 4.590 4.060 0.000 0.00% 0.000
434.zeusmp (max) -10.81% 37.000 33.000 - 0.00% -
473.astar (max) -10.56% 180.000 161.000 - 0.00% -
436.cactusADM (max) (percentage) -10.38% 1.060 0.950 - 0.00% -
434.zeusmp (max) (percentage) -10.22% 1.860 1.670 - 0.00% -
437.leslie3d (max) -10.17% 2064.000 1854.000 - 0.00% -
473.astar (max) (percentage) -10.02% 4.090 3.680 - 0.00% -
436.cactusADM (max) -10.00% 20.000 18.000 - 0.00% -
429.mcf (max) (percentage) -9.97% 8.930 8.040 - 0.00% -
471.omnetpp (max) -9.59% 73.000 66.000 - 0.00% -
429.mcf (max) -9.21% 152.000 138.000 - 0.00% -
450.soplex (max) -8.82% 34.000 31.000 - 0.00% -
459.GemsFDTD (max) -8.79% 182.000 166.000 - 0.00% -
462.libquantum (max) (percentage) -8.75% 4.800 4.380 - 0.00% -
471.omnetpp (max) (percentage) -8.70% 3.450 3.150 - 0.00% -
458.sjeng (max) (percentage) -8.62% 1.160 1.060 - 0.00% -
459.GemsFDTD (max) (percentage) -8.57% 4.200 3.840 - 0.00% -
458.sjeng (max) -8.45% 71.000 65.000 - 0.00% -
447.dealII -8.33% 12.000 11.000 - 0.00% -
447.dealII (avg) -8.33% 12.000 11.000 - 0.00% -
401.bzip2 (max) -8.00% 75.000 69.000 - 0.00% -
445.gobmk (max) (percentage) -7.88% 1.650 1.520 - 0.00% -
444.namd (max) (percentage) -7.59% 2.240 2.070 - 0.00% -
433.milc -7.14% 14.000 13.000 - 0.00% -
433.milc (avg) -7.14% 14.000 13.000 - 0.00% -
445.gobmk (max) -6.94% 72.000 67.000 - 0.00% -
450.soplex (max) (percentage) -6.70% 6.720 6.270 - 0.00% -
401.bzip2 (max) (percentage) -6.64% 2.860 2.670 - 0.00% -
437.leslie3d (max) (percentage) -6.50% 24.160 22.590 - 0.00% -
470.lbm (max) (percentage) -5.99% 3.170 2.980 - 0.00% -
400.perlbench (max) (percentage) -5.94% 2.020 1.900 - 0.00% -
465.tonto (max) -5.91% 440.000 414.000 - 0.00% -
433.milc (max) -5.88% 34.000 32.000 - 0.00% -
470.lbm (max) -5.71% 105.000 99.000 - 0.00% -
482.sphinx3 (max) -5.71% 35.000 33.000 - 0.00% -
450.soplex -5.56% 18.000 17.000 - 0.00% -
450.soplex (avg) -5.56% 18.000 17.000 - 0.00% -
464.h264ref (max) (percentage) -5.26% 1.900 1.800 - 0.00% -
437.leslie3d -5.21% 614.000 582.000 - 0.00% -
437.leslie3d (avg) -5.21% 614.000 582.000 - 0.00% -
464.h264ref (max) -5.19% 77.000 73.000 - 0.00% -
465.tonto (max) (percentage) -5.17% 5.030 4.770 - 0.00% -
435.gromacs (max) -4.88% 246.000 234.000 - 0.00% -
482.sphinx3 (max) (percentage) -4.72% 4.660 4.440 - 0.00% -
434.zeusmp -4.17% 24.000 23.000 - 0.00% -
434.zeusmp (avg) -4.17% 24.000 23.000 - 0.00% -
400.perlbench (max) -3.85% 26.000 25.000 - 0.00% -
459.GemsFDTD -3.75% 80.000 77.000 - 0.00% -
459.GemsFDTD (avg) -3.75% 80.000 77.000 - 0.00% -
433.milc (max) (percentage) -3.73% 3.220 3.100 - 0.00% -
435.gromacs (max) (percentage) -3.65% 4.930 4.750 - 0.00% -
410.bwaves (max) (percentage) -3.59% 3.340 3.220 - 0.00% -
410.bwaves (max) -3.57% 140.000 135.000 - 0.00% -
435.gromacs -3.12% 128.000 124.000 - 0.00% -
435.gromacs (avg) -3.12% 128.000 124.000 - 0.00% -
445.gobmk (avg) (percentage) -2.97% 1.010 0.980 - 0.00% -
410.bwaves -2.82% 71.000 69.000 - 0.00% -
410.bwaves (avg) -2.82% 71.000 69.000 - 0.00% -
465.tonto -2.59% 116.000 113.000 - 0.00% -
465.tonto (avg) -2.59% 116.000 113.000 - 0.00% -
434.zeusmp (avg) (percentage) -2.52% 1.190 1.160 - 0.00% -
447.dealII (max) (percentage) -2.47% 0.810 0.790 - 0.00% -
410.bwaves (avg) (percentage) -2.37% 1.690 1.650 - 0.00% -
470.lbm -2.33% 43.000 42.000 - 0.00% -
470.lbm (avg) -2.33% 43.000 42.000 - 0.00% -
470.lbm (avg) (percentage) -2.31% 1.300 1.270 - 0.00% -
445.gobmk -2.27% 44.000 43.000 - 0.00% -
445.gobmk (avg) -2.27% 44.000 43.000 - 0.00% -
433.milc (avg) (percentage) -2.22% 1.350 1.320 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.17% 1.840 1.800 - 0.00% -
436.cactusADM (avg) (percentage) -2.15% 0.930 0.910 - 0.00% -
453.povray (avg) (percentage) -2.14% 1.400 1.370 - 0.00% -
471.omnetpp -2.13% 47.000 46.000 - 0.00% -
471.omnetpp (avg) -2.13% 47.000 46.000 - 0.00% -
473.astar (avg) (percentage) -2.11% 2.370 2.320 - 0.00% -
401.bzip2 -2.00% 50.000 49.000 - 0.00% -
401.bzip2 (avg) -2.00% 50.000 49.000 - 0.00% -
458.sjeng -2.00% 50.000 49.000 - 0.00% -
458.sjeng (avg) -2.00% 50.000 49.000 - 0.00% -
450.soplex (avg) (percentage) -1.95% 3.590 3.520 - 0.00% -
473.astar -1.92% 104.000 102.000 - 0.00% -
473.astar (avg) -1.92% 104.000 102.000 - 0.00% -
447.dealII (avg) (percentage) -1.83% 1.090 1.070 - 0.00% -
482.sphinx3 (avg) (percentage) -1.81% 2.210 2.170 - 0.00% -
429.mcf (avg) (percentage) -1.64% 5.500 5.410 - 0.00% -
435.gromacs (avg) (percentage) -1.56% 2.560 2.520 - 0.00% -
401.bzip2 (avg) (percentage) -1.55% 1.940 1.910 - 0.00% -
465.tonto (avg) (percentage) -1.50% 1.330 1.310 - 0.00% -
471.omnetpp (avg) (percentage) -1.35% 2.230 2.200 - 0.00% -
462.libquantum (avg) (percentage) -1.33% 2.260 2.230 - 0.00% -
400.perlbench (avg) (percentage) -1.28% 2.340 2.310 - 0.00% -
437.leslie3d (avg) (percentage) -1.25% 7.190 7.100 - 0.00% -
458.sjeng (avg) (percentage) -1.23% 0.810 0.800 - 0.00% -
444.namd (avg) (percentage) -1.02% 0.980 0.970 - 0.00% -

Added Tests - sample variability
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.61% 2314060.000 2397671.000 - 0.00% -
482.sphinx3 2.47% 136204.000 139564.000 - 0.00% -
456.hmmer 1.82% 134037.000 136477.000 - 0.00% -
429.mcf 1.26% 9840.000 9964.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 20.70% 1430.000 1726.000 - 1.29% -
436.cactusADM 4.01% 1847.000 1921.000 - -0.36% -
459.GemsFDTD 2.82% 4214.000 4333.000 - -0.55% -
434.zeusmp 1.36% 1991.000 2018.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -10.35% 72512.000 65004.000 - 0.00% -
462.libquantum -3.54% 20328.000 19608.000 - 0.00% -
473.astar -3.18% 27173.000 26309.000 - 0.00% -
401.bzip2 -2.81% 51213.000 49773.000 - 0.00% -
434.zeusmp -2.11% 191785.000 187731.000 - 0.00% -
470.lbm -1.86% 10968.000 10764.000 - 0.00% -
433.milc -1.39% 72058.000 71054.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -9.53% 556.000 503.000 - -0.79% -
435.gromacs -8.15% 5372.000 4934.000 - -1.38% -
462.libquantum -7.32% 82.000 76.000 - -1.30% -
473.astar -6.54% 4709.000 4401.000 - 0.00% -
465.tonto -5.70% 9226.000 8700.000 - -0.72% -
470.lbm -4.86% 3496.000 3326.000 - 0.00% -
401.bzip2 -4.82% 2741.000 2609.000 - -0.69% -
400.perlbench -4.62% 1407.000 1342.000 - 1.36% -
445.gobmk -4.47% 4627.000 4420.000 - 0.11% -
410.bwaves -4.14% 4395.000 4213.000 - 0.17% -
464.h264ref -4.11% 4232.000 4058.000 - -0.10% -
453.povray -3.84% 417.000 401.000 - 0.25% -
471.omnetpp -2.93% 2186.000 2122.000 - -0.93% -
433.milc -2.77% 1084.000 1054.000 - -0.19% -
458.sjeng -2.73% 6338.000 6165.000 - -0.27% -
437.leslie3d -2.53% 8424.000 8211.000 - -3.90% -
482.sphinx3 -2.44% 780.000 761.000 - 0.66% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1342.000 1.36%
401.bzip2 2609.000 -
410.bwaves 4213.000 -
429.mcf 1726.000 1.29%
433.milc 1054.000 -
434.zeusmp 2018.000 -
435.gromacs 4934.000 -1.38%
436.cactusADM 1921.000 -
437.leslie3d 8211.000 -3.90%
444.namd 623.000 -
445.gobmk 4420.000 -
447.dealII 1110.000 -
450.soplex 503.000 -
453.povray 401.000 -
456.hmmer 2704.000 -
458.sjeng 6165.000 -
459.GemsFDTD 4333.000 -
462.libquantum 76.000 -1.30%
464.h264ref 4058.000 -
465.tonto 8700.000 -
470.lbm 3326.000 -
471.omnetpp 2122.000 -
473.astar 4401.000 -
482.sphinx3 761.000 -
Geometric Mean 1971.603 -
Name Current %
400.perlbench 1121852.000 -
401.bzip2 49773.000 -
410.bwaves 20580.000 -
429.mcf 9964.000 -
433.milc 71054.000 -
434.zeusmp 187731.000 -
435.gromacs 585495.000 -
436.cactusADM 430937.000 -
437.leslie3d 65004.000 -
444.namd 225557.000 -
445.gobmk 1571295.000 -
447.dealII 412909.000 -
450.soplex 275415.000 -
453.povray 834991.000 -
456.hmmer 136477.000 -
458.sjeng 119890.000 -
459.GemsFDTD 303760.000 -
462.libquantum 19608.000 -
464.h264ref 437992.000 -
465.tonto 2397671.000 -
470.lbm 10764.000 -
471.omnetpp 595830.000 -
473.astar 26309.000 -
482.sphinx3 139564.000 -
Geometric Mean 166403.257 -
Name Current %
400.perlbench 31.000 3.33%
400.perlbench (avg) 31.000 3.33%
400.perlbench (avg) (percentage) 2.310 -1.28%
400.perlbench (max) 25.000 -3.85%
400.perlbench (max) (percentage) 1.900 -5.94%
400.perlbench (unexplained diff vs previous) 18.000 12.50%
400.perlbench (unexplained diff vs previous) (percentage) 1.340 10.74%
401.bzip2 49.000 -2.00%
401.bzip2 (avg) 49.000 -2.00%
401.bzip2 (avg) (percentage) 1.910 -1.55%
401.bzip2 (max) 69.000 -8.00%
401.bzip2 (max) (percentage) 2.670 -6.64%
401.bzip2 (unexplained diff vs previous) 18.000 200.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.690 200.00%
403.gcc (avg) (percentage) 4.710 -
403.gcc (max) (percentage) 4.440 -
410.bwaves 69.000 -2.82%
410.bwaves (avg) 69.000 -2.82%
410.bwaves (avg) (percentage) 1.650 -2.37%
410.bwaves (max) 135.000 -3.57%
410.bwaves (max) (percentage) 3.220 -3.59%
410.bwaves (unexplained diff vs previous) 7.000 -86.79%
410.bwaves (unexplained diff vs previous) (percentage) 0.170 -86.51%
416.gamess (avg) (percentage) 0.220 -
416.gamess (max) (percentage) 0.270 -
429.mcf 93.000 -
429.mcf (avg) 93.000 -
429.mcf (avg) (percentage) 5.410 -1.64%
429.mcf (max) 138.000 -9.21%
429.mcf (max) (percentage) 8.040 -9.97%
429.mcf (unexplained diff vs previous) 22.000 -38.89%
429.mcf (unexplained diff vs previous) (percentage) 1.270 -39.81%
433.milc 13.000 -7.14%
433.milc (avg) 13.000 -7.14%
433.milc (avg) (percentage) 1.320 -2.22%
433.milc (max) 32.000 -5.88%
433.milc (max) (percentage) 3.100 -3.73%
433.milc (unexplained diff vs previous) 2.000 -77.78%
433.milc (unexplained diff vs previous) (percentage) 0.190 -77.65%
434.zeusmp 23.000 -4.17%
434.zeusmp (avg) 23.000 -4.17%
434.zeusmp (avg) (percentage) 1.160 -2.52%
434.zeusmp (max) 33.000 -10.81%
434.zeusmp (max) (percentage) 1.670 -10.22%
434.zeusmp (unexplained diff vs previous) 0.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.000 -
435.gromacs 124.000 -3.12%
435.gromacs (avg) 124.000 -3.12%
435.gromacs (avg) (percentage) 2.520 -1.56%
435.gromacs (max) 234.000 -4.88%
435.gromacs (max) (percentage) 4.750 -3.65%
435.gromacs (unexplained diff vs previous) 69.000 72.50%
435.gromacs (unexplained diff vs previous) (percentage) 1.400 75.00%
436.cactusADM 17.000 -
436.cactusADM (avg) 17.000 -
436.cactusADM (avg) (percentage) 0.910 -2.15%
436.cactusADM (max) 18.000 -10.00%
436.cactusADM (max) (percentage) 0.950 -10.38%
436.cactusADM (unexplained diff vs previous) 7.000 16.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.360 16.13%
437.leslie3d 582.000 -5.21%
437.leslie3d (avg) 582.000 -5.21%
437.leslie3d (avg) (percentage) 7.100 -1.25%
437.leslie3d (max) 1854.000 -10.17%
437.leslie3d (max) (percentage) 22.590 -6.50%
437.leslie3d (unexplained diff vs previous) 333.000 -15.05%
437.leslie3d (unexplained diff vs previous) (percentage) 4.060 -11.55%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.970 -1.02%
444.namd (max) 12.000 -14.29%
444.namd (max) (percentage) 2.070 -7.59%
444.namd (unexplained diff vs previous) 3.000 -
444.namd (unexplained diff vs previous) (percentage) 0.480 -
445.gobmk 43.000 -2.27%
445.gobmk (avg) 43.000 -2.27%
445.gobmk (avg) (percentage) 0.980 -2.97%
445.gobmk (max) 67.000 -6.94%
445.gobmk (max) (percentage) 1.520 -7.88%
445.gobmk (unexplained diff vs previous) 5.000 -44.44%
445.gobmk (unexplained diff vs previous) (percentage) 0.110 -45.00%
447.dealII 11.000 -8.33%
447.dealII (avg) 11.000 -8.33%
447.dealII (avg) (percentage) 1.070 -1.83%
447.dealII (max) 8.000 -
447.dealII (max) (percentage) 0.790 -2.47%
447.dealII (unexplained diff vs previous) 4.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.360 -
450.soplex 17.000 -5.56%
450.soplex (avg) 17.000 -5.56%
450.soplex (avg) (percentage) 3.520 -1.95%
450.soplex (max) 31.000 -8.82%
450.soplex (max) (percentage) 6.270 -6.70%
450.soplex (unexplained diff vs previous) 4.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.800 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.370 -2.14%
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.620 -16.22%
453.povray (unexplained diff vs previous) 1.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 0.250 -66.67%
454.calculix (avg) (percentage) 2.260 -
454.calculix (max) (percentage) 2.950 -
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.310 6.90%
456.hmmer (max) 22.000 144.44%
456.hmmer (max) (percentage) 0.820 121.62%
456.hmmer (unexplained diff vs previous) 22.000 144.44%
456.hmmer (unexplained diff vs previous) (percentage) 0.810 138.24%
458.sjeng 49.000 -2.00%
458.sjeng (avg) 49.000 -2.00%
458.sjeng (avg) (percentage) 0.800 -1.23%
458.sjeng (max) 65.000 -8.45%
458.sjeng (max) (percentage) 1.060 -8.62%
458.sjeng (unexplained diff vs previous) 17.000 -58.54%
458.sjeng (unexplained diff vs previous) (percentage) 0.280 -57.58%
459.GemsFDTD 77.000 -3.75%
459.GemsFDTD (avg) 77.000 -3.75%
459.GemsFDTD (avg) (percentage) 1.800 -2.17%
459.GemsFDTD (max) 166.000 -8.79%
459.GemsFDTD (max) (percentage) 3.840 -8.57%
459.GemsFDTD (unexplained diff vs previous) 24.000 -73.63%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.550 -73.68%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.230 -1.33%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.380 -8.75%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.320 -
464.h264ref 33.000 -
464.h264ref (avg) 33.000 -
464.h264ref (avg) (percentage) 0.820 -
464.h264ref (max) 73.000 -5.19%
464.h264ref (max) (percentage) 1.800 -5.26%
465.tonto 113.000 -2.59%
465.tonto (avg) 113.000 -2.59%
465.tonto (avg) (percentage) 1.310 -1.50%
465.tonto (max) 414.000 -5.91%
465.tonto (max) (percentage) 4.770 -5.17%
465.tonto (unexplained diff vs previous) 63.000 -33.68%
465.tonto (unexplained diff vs previous) (percentage) 0.720 -33.33%
470.lbm 42.000 -2.33%
470.lbm (avg) 42.000 -2.33%
470.lbm (avg) (percentage) 1.270 -2.31%
470.lbm (max) 99.000 -5.71%
470.lbm (max) (percentage) 2.980 -5.99%
470.lbm (unexplained diff vs previous) 0.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.000 -
471.omnetpp 46.000 -2.13%
471.omnetpp (avg) 46.000 -2.13%
471.omnetpp (avg) (percentage) 2.200 -1.35%
471.omnetpp (max) 66.000 -9.59%
471.omnetpp (max) (percentage) 3.150 -8.70%
471.omnetpp (unexplained diff vs previous) 20.000 1900.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.940 1780.00%
473.astar 102.000 -1.92%
473.astar (avg) 102.000 -1.92%
473.astar (avg) (percentage) 2.320 -2.11%
473.astar (max) 161.000 -10.56%
473.astar (max) (percentage) 3.680 -10.02%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) (percentage) 0.770 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.170 -1.81%
482.sphinx3 (max) 33.000 -5.71%
482.sphinx3 (max) (percentage) 4.440 -4.72%
482.sphinx3 (unexplained diff vs previous) 5.000 -28.57%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.660 -29.03%
483.xalancbmk (avg) (percentage) 1.490 -
483.xalancbmk (max) (percentage) 1.000 -
Geometric Mean 4.785 -10.84%