Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=917ed12066382c48459f85124cbeca1286c3bb53 (+ 40 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/9252fc398c86ec0eac2c56283e2ded8ea6cfb70c (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7796e378c47b840d9c2e8af4fc6c209ed97f555b (+ 15 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/a56a17fef0e450ef64524066bc166ac1c0b5cee4 (+ 136 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/303/
View Options
Report
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0303 (3-changed-components) 2024-10-21T07:27:44 0:00:00
Previous 0299 (3-changed-components) 2024-10-14T11:41:45 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 35 12
Performance Improvements 96 14
Added Tests 2 132
Unchanged Tests 1043 1018
Total Tests 1176

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 3.42% 8351.000 8637.000 - -3.27% -
436.cactusADM 1.59% 1882.000 1912.000 - 4.82% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) (percentage) 3040.00% 0.050 1.570 - 0.00% -
436.cactusADM (unexplained diff vs previous) 2900.00% 1.000 30.000 - 0.00% -
470.lbm (unexplained diff vs previous) 240.00% 5.000 17.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 233.33% 0.150 0.500 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 118.75% 0.320 0.700 - 0.00% -
465.tonto (unexplained diff vs previous) 117.24% 29.000 63.000 - 0.00% -
436.cactusADM (max) 87.50% 16.000 30.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 86.93% 153.000 286.000 - 0.00% -
436.cactusADM (max) (percentage) 82.76% 0.870 1.590 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 80.87% 1.830 3.310 - 0.00% -
464.h264ref (unexplained diff vs previous) 71.43% 7.000 12.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 70.59% 0.170 0.290 - 0.00% -
458.sjeng (unexplained diff vs previous) 66.67% 27.000 45.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 64.29% 0.420 0.690 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 50.00% 4.000 6.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 44.44% 0.090 0.130 - 0.00% -
458.sjeng (max) 36.36% 33.000 45.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 36.13% 3.100 4.220 - 0.00% -
458.sjeng (max) (percentage) 32.69% 0.520 0.690 - 0.00% -
435.gromacs (unexplained diff vs previous) 30.36% 168.000 219.000 - 0.00% -
435.gromacs (max) (percentage) 26.56% 3.200 4.050 - 0.00% -
435.gromacs (max) 21.39% 173.000 210.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 20.45% 0.440 0.530 - 0.00% -
433.milc (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
436.cactusADM 7.14% 14.000 15.000 - 0.00% -
436.cactusADM (avg) 7.14% 14.000 15.000 - 0.00% -
458.sjeng 3.12% 32.000 33.000 - 0.00% -
458.sjeng (avg) 3.12% 32.000 33.000 - 0.00% -
435.gromacs (avg) (percentage) 2.73% 1.830 1.880 - 0.00% -
437.leslie3d 2.53% 514.000 527.000 - 0.00% -
437.leslie3d (avg) 2.53% 514.000 527.000 - 0.00% -
458.sjeng (avg) (percentage) 2.00% 0.500 0.510 - 0.00% -
436.cactusADM (avg) (percentage) 1.27% 0.790 0.800 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -4.05% 5411.000 5192.000 - -1.03% -
462.libquantum -2.53% 79.000 77.000 - -4.94% -
482.sphinx3 -1.38% 795.000 784.000 - 0.13% -
471.omnetpp -1.18% 2465.000 2436.000 - -8.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) -92.59% 27.000 2.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -91.94% 0.620 0.050 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -87.56% 2.250 0.280 - 0.00% -
400.perlbench (unexplained diff vs previous) -87.50% 32.000 4.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -85.05% 1.940 0.290 - 0.00% -
401.bzip2 (unexplained diff vs previous) -84.91% 53.000 8.000 - 0.00% -
453.povray (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -83.10% 1.420 0.240 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -70.27% 0.370 0.110 - 0.00% -
456.hmmer (unexplained diff vs previous) -70.00% 10.000 3.000 - 0.00% -
473.astar (unexplained diff vs previous) -62.50% 40.000 15.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -62.03% 0.790 0.300 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -57.89% 0.190 0.080 - 0.00% -
445.gobmk (unexplained diff vs previous) -55.56% 9.000 4.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -54.69% 64.000 29.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -54.23% 2.600 1.190 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -46.76% 1.390 0.740 - 0.00% -
429.mcf (unexplained diff vs previous) -46.43% 28.000 15.000 - 0.00% -
410.bwaves (max) -46.34% 41.000 22.000 - 0.00% -
410.bwaves (max) (percentage) -44.68% 0.940 0.520 - 0.00% -
434.zeusmp (max) (percentage) -42.31% 0.780 0.450 - 0.00% -
434.zeusmp (max) -40.00% 15.000 9.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -37.04% 0.540 0.340 - 0.00% -
434.zeusmp (unexplained diff vs previous) -36.36% 11.000 7.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -35.29% 17.000 11.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -34.58% 2.140 1.400 - 0.00% -
444.namd (max) -33.33% 3.000 2.000 - 0.00% -
444.namd (max) (percentage) -31.37% 0.510 0.350 - 0.00% -
473.astar (max) (percentage) -25.00% 0.800 0.600 - 0.00% -
462.libquantum (max) -25.00% 4.000 3.000 - 0.00% -
473.astar (max) -25.00% 40.000 30.000 - 0.00% -
401.bzip2 (max) -17.31% 52.000 43.000 - 0.00% -
401.bzip2 (max) (percentage) -16.84% 1.900 1.580 - 0.00% -
400.perlbench (max) (percentage) -16.52% 2.300 1.920 - 0.00% -
400.perlbench (max) -15.62% 32.000 27.000 - 0.00% -
464.h264ref (max) -15.38% 13.000 11.000 - 0.00% -
482.sphinx3 (max) -11.76% 17.000 15.000 - 0.00% -
447.dealII (max) -11.11% 9.000 8.000 - 0.00% -
453.povray (max) -11.11% 9.000 8.000 - 0.00% -
471.omnetpp (max) -10.77% 65.000 58.000 - 0.00% -
471.omnetpp (max) (percentage) -10.11% 2.670 2.400 - 0.00% -
482.sphinx3 (max) (percentage) -10.05% 2.190 1.970 - 0.00% -
470.lbm (max) -9.52% 21.000 19.000 - 0.00% -
464.h264ref (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
465.tonto (max) -8.45% 71.000 65.000 - 0.00% -
470.lbm (max) (percentage) -7.94% 0.630 0.580 - 0.00% -
465.tonto (max) (percentage) -7.69% 0.780 0.720 - 0.00% -
433.milc (max) -7.69% 13.000 12.000 - 0.00% -
453.povray (max) (percentage) -7.44% 2.150 1.990 - 0.00% -
456.hmmer (max) (percentage) -7.25% 0.690 0.640 - 0.00% -
459.GemsFDTD (max) (percentage) -6.60% 1.060 0.990 - 0.00% -
433.milc (max) (percentage) -6.50% 1.230 1.150 - 0.00% -
459.GemsFDTD (max) -6.38% 47.000 44.000 - 0.00% -
437.leslie3d (max) (percentage) -6.26% 13.420 12.580 - 0.00% -
447.dealII (max) (percentage) -6.06% 0.660 0.620 - 0.00% -
450.soplex (max) (percentage) -5.71% 0.700 0.660 - 0.00% -
456.hmmer (max) -5.56% 18.000 17.000 - 0.00% -
462.libquantum (max) (percentage) -4.64% 5.170 4.930 - 0.00% -
429.mcf (max) (percentage) -4.45% 2.920 2.790 - 0.00% -
400.perlbench -4.00% 25.000 24.000 - 0.00% -
400.perlbench (avg) -4.00% 25.000 24.000 - 0.00% -
429.mcf (max) -3.45% 58.000 56.000 - 0.00% -
437.leslie3d (max) -3.04% 1120.000 1086.000 - 0.00% -
401.bzip2 -2.94% 34.000 33.000 - 0.00% -
401.bzip2 (avg) -2.94% 34.000 33.000 - 0.00% -
445.gobmk -2.78% 36.000 35.000 - 0.00% -
445.gobmk (avg) -2.78% 36.000 35.000 - 0.00% -
410.bwaves -2.44% 41.000 40.000 - 0.00% -
410.bwaves (avg) -2.44% 41.000 40.000 - 0.00% -
447.dealII (avg) (percentage) -2.20% 0.910 0.890 - 0.00% -
453.povray (avg) (percentage) -2.19% 1.370 1.340 - 0.00% -
410.bwaves (avg) (percentage) -2.11% 0.950 0.930 - 0.00% -
471.omnetpp -2.04% 49.000 48.000 - 0.00% -
471.omnetpp (avg) -2.04% 49.000 48.000 - 0.00% -
435.gromacs -2.02% 99.000 97.000 - 0.00% -
435.gromacs (avg) -2.02% 99.000 97.000 - 0.00% -
473.astar -2.00% 50.000 49.000 - 0.00% -
473.astar (avg) -2.00% 50.000 49.000 - 0.00% -
464.h264ref (avg) (percentage) -1.92% 0.520 0.510 - 0.00% -
400.perlbench (avg) (percentage) -1.70% 1.760 1.730 - 0.00% -
401.bzip2 (avg) (percentage) -1.60% 1.250 1.230 - 0.00% -
465.tonto -1.39% 72.000 71.000 - 0.00% -
465.tonto (avg) -1.39% 72.000 71.000 - 0.00% -
433.milc (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
445.gobmk (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
444.namd (avg) (percentage) -1.32% 0.760 0.750 - 0.00% -
429.mcf (avg) (percentage) -1.26% 3.970 3.920 - 0.00% -
429.mcf -1.25% 80.000 79.000 - 0.00% -
429.mcf (avg) -1.25% 80.000 79.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.10% 0.910 0.900 - 0.00% -
450.soplex (avg) (percentage) -1.08% 1.850 1.830 - 0.00% -
473.astar (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 5.87% 21532.000 22796.000 - 0.00% -
400.perlbench 2.46% 1087835.000 1114612.000 - 0.00% -
447.dealII 2.19% 2802286.000 2863739.000 - 0.00% -
465.tonto 2.05% 3263584.000 3330541.000 - 0.00% -
429.mcf 1.76% 12072.000 12284.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 38.51% 1467.000 2032.000 - 0.74% -
459.GemsFDTD 5.69% 4220.000 4460.000 - -0.13% -
436.cactusADM 4.82% 1824.000 1912.000 - 1.59% -
434.zeusmp 2.66% 1991.000 2044.000 - 0.34% -
473.astar 1.96% 4941.000 5038.000 - -0.30% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.53% 79330.000 71770.000 - 0.00% -
473.astar -2.92% 37101.000 36017.000 - 0.00% -
434.zeusmp -1.78% 203703.000 200077.000 - 0.00% -
453.povray -1.12% 842399.000 832958.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -8.76% 2670.000 2436.000 - -1.18% -
462.libquantum -4.94% 81.000 77.000 - -2.53% -
464.h264ref -3.51% 4272.000 4122.000 - -0.29% -
447.dealII -3.51% 1426.000 1376.000 - -0.22% -
437.leslie3d -3.27% 8929.000 8637.000 - 3.42% -
445.gobmk -1.51% 4909.000 4835.000 - -0.08% -
453.povray -1.17% 428.000 423.000 - 0.24% -
444.namd -1.10% 636.000 629.000 - 0.00% -
435.gromacs -1.03% 5246.000 5192.000 - -4.05% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.47s
Execution (seconds)
Name Current %
400.perlbench 1427.000 -
401.bzip2 2747.000 -
410.bwaves 4368.000 -
429.mcf 2032.000 -
433.milc 1126.000 -
434.zeusmp 2044.000 -
435.gromacs 5192.000 -4.05%
436.cactusADM 1912.000 1.59%
437.leslie3d 8637.000 3.42%
444.namd 629.000 -
445.gobmk 4835.000 -
447.dealII 1376.000 -
450.soplex 535.000 -
453.povray 423.000 -
456.hmmer 2671.000 -
458.sjeng 6527.000 -
459.GemsFDTD 4460.000 -
462.libquantum 77.000 -2.53%
464.h264ref 4122.000 -
465.tonto 9057.000 -
470.lbm 3368.000 -
471.omnetpp 2436.000 -1.18%
473.astar 5038.000 -
482.sphinx3 784.000 -1.38%
Geometric Mean 2087.890 -
Code Size (bytes)
Name Current %
400.perlbench 1114612.000 -
401.bzip2 58437.000 -
410.bwaves 22796.000 -
429.mcf 12284.000 -
433.milc 111411.000 -
434.zeusmp 200077.000 -
435.gromacs 788690.000 -
436.cactusADM 656997.000 -
437.leslie3d 71770.000 -
444.namd 228254.000 -
445.gobmk 1546911.000 -
447.dealII 2863739.000 -
450.soplex 347879.000 -
453.povray 832958.000 -
456.hmmer 271331.000 -
458.sjeng 131503.000 -
459.GemsFDTD 292726.000 -
462.libquantum 37816.000 -
464.h264ref 472954.000 -
465.tonto 3330541.000 -
470.lbm 11617.000 -
471.omnetpp 633635.000 -
473.astar 36017.000 -
482.sphinx3 176888.000 -
Geometric Mean 217759.720 -
sample variability
Name Current %
400.perlbench 24.000 -4.00%
400.perlbench (avg) 24.000 -4.00%
400.perlbench (avg) (percentage) 1.730 -1.70%
400.perlbench (max) 27.000 -15.62%
400.perlbench (max) (percentage) 1.920 -16.52%
400.perlbench (unexplained diff vs previous) 4.000 -87.50%
400.perlbench (unexplained diff vs previous) (percentage) 0.280 -87.56%
401.bzip2 33.000 -2.94%
401.bzip2 (avg) 33.000 -2.94%
401.bzip2 (avg) (percentage) 1.230 -1.60%
401.bzip2 (max) 43.000 -17.31%
401.bzip2 (max) (percentage) 1.580 -16.84%
401.bzip2 (unexplained diff vs previous) 8.000 -84.91%
401.bzip2 (unexplained diff vs previous) (percentage) 0.290 -85.05%
403.gcc (avg) (percentage) 4.780 -
403.gcc (max) (percentage) 3.890 -
410.bwaves 40.000 -2.44%
410.bwaves (avg) 40.000 -2.44%
410.bwaves (avg) (percentage) 0.930 -2.11%
410.bwaves (max) 22.000 -46.34%
410.bwaves (max) (percentage) 0.520 -44.68%
410.bwaves (unexplained diff vs previous) 2.000 -92.59%
410.bwaves (unexplained diff vs previous) (percentage) 0.050 -91.94%
416.gamess (avg) (percentage) 0.310 -
416.gamess (max) (percentage) 0.350 -
429.mcf 79.000 -1.25%
429.mcf (avg) 79.000 -1.25%
429.mcf (avg) (percentage) 3.920 -1.26%
429.mcf (max) 56.000 -3.45%
429.mcf (max) (percentage) 2.790 -4.45%
429.mcf (unexplained diff vs previous) 15.000 -46.43%
429.mcf (unexplained diff vs previous) (percentage) 0.740 -46.76%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.740 -1.33%
433.milc (max) 12.000 -7.69%
433.milc (max) (percentage) 1.150 -6.50%
433.milc (unexplained diff vs previous) 6.000 20.00%
433.milc (unexplained diff vs previous) (percentage) 0.530 20.45%
434.zeusmp 15.000 -
434.zeusmp (avg) 15.000 -
434.zeusmp (avg) (percentage) 0.750 -
434.zeusmp (max) 9.000 -40.00%
434.zeusmp (max) (percentage) 0.450 -42.31%
434.zeusmp (unexplained diff vs previous) 7.000 -36.36%
434.zeusmp (unexplained diff vs previous) (percentage) 0.340 -37.04%
435.gromacs 97.000 -2.02%
435.gromacs (avg) 97.000 -2.02%
435.gromacs (avg) (percentage) 1.880 2.73%
435.gromacs (max) 210.000 21.39%
435.gromacs (max) (percentage) 4.050 26.56%
435.gromacs (unexplained diff vs previous) 219.000 30.36%
435.gromacs (unexplained diff vs previous) (percentage) 4.220 36.13%
436.cactusADM 15.000 7.14%
436.cactusADM (avg) 15.000 7.14%
436.cactusADM (avg) (percentage) 0.800 1.27%
436.cactusADM (max) 30.000 87.50%
436.cactusADM (max) (percentage) 1.590 82.76%
436.cactusADM (unexplained diff vs previous) 30.000 2900.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.570 3040.00%
437.leslie3d 527.000 2.53%
437.leslie3d (avg) 527.000 2.53%
437.leslie3d (avg) (percentage) 6.110 -
437.leslie3d (max) 1086.000 -3.04%
437.leslie3d (max) (percentage) 12.580 -6.26%
437.leslie3d (unexplained diff vs previous) 286.000 86.93%
437.leslie3d (unexplained diff vs previous) (percentage) 3.310 80.87%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.750 -1.32%
444.namd (max) 2.000 -33.33%
444.namd (max) (percentage) 0.350 -31.37%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 35.000 -2.78%
445.gobmk (avg) 35.000 -2.78%
445.gobmk (avg) (percentage) 0.740 -1.33%
445.gobmk (max) 26.000 -
445.gobmk (max) (percentage) 0.540 -
445.gobmk (unexplained diff vs previous) 4.000 -55.56%
445.gobmk (unexplained diff vs previous) (percentage) 0.080 -57.89%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.890 -2.20%
447.dealII (max) 8.000 -11.11%
447.dealII (max) (percentage) 0.620 -6.06%
447.dealII (unexplained diff vs previous) 3.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.220 -
450.soplex 9.000 -
450.soplex (avg) 9.000 -
450.soplex (avg) (percentage) 1.830 -1.08%
450.soplex (max) 3.000 -
450.soplex (max) (percentage) 0.660 -5.71%
450.soplex (unexplained diff vs previous) 2.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.370 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.340 -2.19%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.990 -7.44%
453.povray (unexplained diff vs previous) 1.000 -83.33%
453.povray (unexplained diff vs previous) (percentage) 0.240 -83.10%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.650 -
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.360 -
456.hmmer (max) 17.000 -5.56%
456.hmmer (max) (percentage) 0.640 -7.25%
456.hmmer (unexplained diff vs previous) 3.000 -70.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -70.27%
458.sjeng 33.000 3.12%
458.sjeng (avg) 33.000 3.12%
458.sjeng (avg) (percentage) 0.510 2.00%
458.sjeng (max) 45.000 36.36%
458.sjeng (max) (percentage) 0.690 32.69%
458.sjeng (unexplained diff vs previous) 45.000 66.67%
458.sjeng (unexplained diff vs previous) (percentage) 0.690 64.29%
459.GemsFDTD 40.000 -
459.GemsFDTD (avg) 40.000 -
459.GemsFDTD (avg) (percentage) 0.900 -1.10%
459.GemsFDTD (max) 44.000 -6.38%
459.GemsFDTD (max) (percentage) 0.990 -6.60%
459.GemsFDTD (unexplained diff vs previous) 6.000 50.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.130 44.44%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.000 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 4.930 -4.64%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.600 -
464.h264ref 21.000 -
464.h264ref (avg) 21.000 -
464.h264ref (avg) (percentage) 0.510 -1.92%
464.h264ref (max) 11.000 -15.38%
464.h264ref (max) (percentage) 0.290 -9.38%
464.h264ref (unexplained diff vs previous) 12.000 71.43%
464.h264ref (unexplained diff vs previous) (percentage) 0.290 70.59%
465.tonto 71.000 -1.39%
465.tonto (avg) 71.000 -1.39%
465.tonto (avg) (percentage) 0.790 -
465.tonto (max) 65.000 -8.45%
465.tonto (max) (percentage) 0.720 -7.69%
465.tonto (unexplained diff vs previous) 63.000 117.24%
465.tonto (unexplained diff vs previous) (percentage) 0.700 118.75%
470.lbm 25.000 -
470.lbm (avg) 25.000 -
470.lbm (avg) (percentage) 0.750 -
470.lbm (max) 19.000 -9.52%
470.lbm (max) (percentage) 0.580 -7.94%
470.lbm (unexplained diff vs previous) 17.000 240.00%
470.lbm (unexplained diff vs previous) (percentage) 0.500 233.33%
471.omnetpp 48.000 -2.04%
471.omnetpp (avg) 48.000 -2.04%
471.omnetpp (avg) (percentage) 2.010 -
471.omnetpp (max) 58.000 -10.77%
471.omnetpp (max) (percentage) 2.400 -10.11%
471.omnetpp (unexplained diff vs previous) 29.000 -54.69%
471.omnetpp (unexplained diff vs previous) (percentage) 1.190 -54.23%
473.astar 49.000 -2.00%
473.astar (avg) 49.000 -2.00%
473.astar (avg) (percentage) 0.990 -1.00%
473.astar (max) 30.000 -25.00%
473.astar (max) (percentage) 0.600 -25.00%
473.astar (unexplained diff vs previous) 15.000 -62.50%
473.astar (unexplained diff vs previous) (percentage) 0.300 -62.03%
481.wrf (avg) (percentage) 1.320 -
481.wrf (max) (percentage) 0.670 -
482.sphinx3 10.000 -
482.sphinx3 (avg) 10.000 -
482.sphinx3 (avg) (percentage) 1.290 -
482.sphinx3 (max) 15.000 -11.76%
482.sphinx3 (max) (percentage) 1.970 -10.05%
482.sphinx3 (unexplained diff vs previous) 11.000 -35.29%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.400 -34.58%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.440 -
Geometric Mean 4.099 -9.45%