Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8cb16b68584e14aade8de166c75e1d85e38507bd (+ 44 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/3d104d93a7011146b0870ab160613147adb8d9b3 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d0aefec49941cf6d97e2244d6aa20bafc26d5942 (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/164/
View Options
Report
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0164 (2-changed-components) 2023-12-08T23:44:24 0:00:00
Previous 0161 (2-changed-components) 2023-12-03T14:34:29 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 44 21
Performance Improvements 70 24
Added Tests 50 142
Unchanged Tests 1060 1037
Total Tests 1224

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 6.14% 2491.000 2644.000 - -4.69% -
403.gcc 1.92% 52.000 53.000 - -7.02% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) 1146.15% 13.000 162.000 - 0.00% -
401.bzip2 (max) (percentage) 996.43% 0.560 6.140 - 0.00% -
401.bzip2 (unexplained diff vs previous) 992.86% 14.000 153.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 950.00% 0.020 0.210 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 933.93% 0.560 5.790 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 912.50% 0.080 0.810 - 0.00% -
445.gobmk (unexplained diff vs previous) 900.00% 1.000 10.000 - 0.00% -
473.astar (unexplained diff vs previous) 900.00% 4.000 40.000 - 0.00% -
473.astar (max) 207.69% 13.000 40.000 - 0.00% -
473.astar (max) (percentage) 192.86% 0.280 0.820 - 0.00% -
482.sphinx3 (max) 100.00% 5.000 10.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 87.18% 0.780 1.460 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 85.92% 0.710 1.320 - 0.00% -
456.hmmer (unexplained diff vs previous) 84.21% 19.000 35.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 83.33% 6.000 11.000 - 0.00% -
482.sphinx3 (max) (percentage) 83.33% 0.780 1.430 - 0.00% -
456.hmmer (max) (percentage) 83.10% 0.710 1.300 - 0.00% -
456.hmmer (max) 78.95% 19.000 34.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 53.12% 0.320 0.490 - 0.00% -
444.namd (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -
464.h264ref (max) (percentage) 41.67% 0.120 0.170 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 41.67% 0.120 0.170 - 0.00% -
464.h264ref (max) 40.00% 5.000 7.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 40.00% 5.000 7.000 - 0.00% -
401.bzip2 20.59% 34.000 41.000 - 0.00% -
401.bzip2 (avg) 20.59% 34.000 41.000 - 0.00% -
470.lbm (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 20.00% 0.150 0.180 - 0.00% -
433.milc (max) (percentage) 16.55% 1.390 1.620 - 0.00% -
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
401.bzip2 (avg) (percentage) 13.87% 1.370 1.560 - 0.00% -
433.milc (max) 13.33% 15.000 17.000 - 0.00% -
433.milc 12.50% 8.000 9.000 - 0.00% -
433.milc (avg) 12.50% 8.000 9.000 - 0.00% -
456.hmmer (avg) (percentage) 10.71% 0.280 0.310 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 7.14% 0.280 0.300 - 0.00% -
458.sjeng (unexplained diff vs previous) 5.56% 18.000 19.000 - 0.00% -
462.libquantum (avg) (percentage) 5.10% 1.570 1.650 - 0.00% -
433.milc (avg) (percentage) 2.47% 0.810 0.830 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 1.91% 1.570 1.600 - 0.00% -
450.soplex (max) (percentage) 1.29% 1.550 1.570 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -3.95% 76.000 73.000 - -9.88% -
433.milc -1.62% 1111.000 1093.000 - -3.19% -
450.soplex -1.57% 509.000 501.000 - -5.83% -
400.perlbench -1.56% 1411.000 1389.000 - -2.53% -
482.sphinx3 -1.43% 767.000 756.000 - -3.45% -
456.hmmer -1.30% 2687.000 2652.000 - -1.01% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) (percentage) -86.14% 1.010 0.140 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -86.06% 1.650 0.230 - 0.00% -
447.dealII (unexplained diff vs previous) -85.71% 14.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) -85.71% 7.000 1.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -83.62% 11.540 1.890 - 0.00% -
403.gcc (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -68.63% 51.000 16.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -68.27% 2.080 0.660 - 0.00% -
429.mcf (unexplained diff vs previous) -51.43% 35.000 17.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -50.80% 1.870 0.920 - 0.00% -
453.povray (max) -25.00% 8.000 6.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -25.00% 4.000 3.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -21.86% 5.260 4.110 - 0.00% -
453.povray (max) (percentage) -21.16% 1.890 1.490 - 0.00% -
400.perlbench (max) -12.50% 24.000 21.000 - 0.00% -
471.omnetpp (max) -12.00% 50.000 44.000 - 0.00% -
400.perlbench (max) (percentage) -11.86% 1.770 1.560 - 0.00% -
482.sphinx3 -11.11% 9.000 8.000 - 0.00% -
482.sphinx3 (avg) -11.11% 9.000 8.000 - 0.00% -
429.mcf (max) -10.75% 428.000 382.000 - 0.00% -
429.mcf (max) (percentage) -10.02% 22.960 20.660 - 0.00% -
450.soplex -10.00% 10.000 9.000 - 0.00% -
450.soplex (avg) -10.00% 10.000 9.000 - 0.00% -
462.libquantum (max) (percentage) -10.00% 5.000 4.500 - 0.00% -
471.omnetpp (max) (percentage) -9.80% 2.040 1.840 - 0.00% -
444.namd (max) (percentage) -9.78% 1.840 1.660 - 0.00% -
470.lbm (max) (percentage) -9.66% 2.070 1.870 - 0.00% -
444.namd (max) -9.09% 11.000 10.000 - 0.00% -
470.lbm (max) -8.96% 67.000 61.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -8.33% 24.000 22.000 - 0.00% -
458.sjeng (max) -7.23% 83.000 77.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -7.06% 1.700 1.580 - 0.00% -
458.sjeng (max) (percentage) -6.87% 1.310 1.220 - 0.00% -
447.dealII -6.67% 15.000 14.000 - 0.00% -
447.dealII (avg) -6.67% 15.000 14.000 - 0.00% -
403.gcc (max) (percentage) -6.29% 10.340 9.690 - 0.00% -
447.dealII (max) -5.26% 19.000 18.000 - 0.00% -
447.dealII (avg) (percentage) -4.59% 1.090 1.040 - 0.00% -
471.omnetpp -4.26% 47.000 45.000 - 0.00% -
471.omnetpp (avg) -4.26% 47.000 45.000 - 0.00% -
453.povray (avg) (percentage) -3.80% 1.580 1.520 - 0.00% -
429.mcf -3.77% 106.000 102.000 - 0.00% -
429.mcf (avg) -3.77% 106.000 102.000 - 0.00% -
447.dealII (max) (percentage) -3.52% 1.420 1.370 - 0.00% -
403.gcc (avg) (percentage) -3.42% 4.390 4.240 - 0.00% -
458.sjeng -3.12% 32.000 31.000 - 0.00% -
458.sjeng (avg) -3.12% 32.000 31.000 - 0.00% -
470.lbm (avg) (percentage) -2.90% 0.690 0.670 - 0.00% -
445.gobmk -2.86% 35.000 34.000 - 0.00% -
445.gobmk (avg) -2.86% 35.000 34.000 - 0.00% -
445.gobmk (avg) (percentage) -2.67% 0.750 0.730 - 0.00% -
429.mcf (avg) (percentage) -2.63% 5.710 5.560 - 0.00% -
464.h264ref (avg) (percentage) -2.22% 0.450 0.440 - 0.00% -
471.omnetpp (avg) (percentage) -2.08% 1.920 1.880 - 0.00% -
458.sjeng (avg) (percentage) -2.00% 0.500 0.490 - 0.00% -
454.calculix (max) (percentage) -1.62% 3.080 3.030 - 0.00% -
435.gromacs (max) (percentage) -1.55% 2.580 2.540 - 0.00% -
465.tonto (max) (percentage) -1.50% 1.330 1.310 - 0.00% -
436.cactusADM (max) (percentage) -1.39% 1.440 1.420 - 0.00% -
400.perlbench (avg) (percentage) -1.37% 2.190 2.160 - 0.00% -
444.namd (avg) (percentage) -1.27% 0.790 0.780 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 55.56% 18.000 28.000 - -3.45% -
nb_execution_successful 55.56% 18.000 28.000 - -3.45% -
nb_total_tests 50.00% 20.000 30.000 - 3.45% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
410.bwaves
410.bwaves (avg)
410.bwaves (max)
416.gamess
416.gamess (avg)
416.gamess (max)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (max)
435.gromacs
435.gromacs (avg)
435.gromacs (max)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (max)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (max)
454.calculix
454.calculix (avg)
454.calculix (max)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (max)
465.tonto
465.tonto (avg)
465.tonto (max)
481.wrf
481.wrf (avg)
481.wrf (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 5.48% 21532.000 22712.000 - 0.00% -
481.wrf 3.74% 4016025.000 4166424.000 - 0.00% -
447.dealII 3.19% 2802286.000 2891817.000 - 0.00% -
459.GemsFDTD 3.15% 295414.000 304718.000 - 0.00% -
456.hmmer 2.09% 270823.000 276471.000 - 0.00% -
400.perlbench 1.77% 1087835.000 1107054.000 - 0.00% -
436.cactusADM 1.73% 652261.000 663565.000 - 0.00% -
429.mcf 1.49% 12072.000 12252.000 - 0.00% -
416.gamess 1.49% 7063623.000 7168843.000 - 0.00% -
465.tonto 1.44% 3263584.000 3310619.000 - 0.00% -
444.namd 1.27% 226710.000 229582.000 - 0.00% -
464.h264ref 1.20% 472362.000 478042.000 - 0.00% -
482.sphinx3 1.15% 175488.000 177512.000 - 0.00% -
434.zeusmp 1.09% 203703.000 205919.000 - 0.00% -
470.lbm 1.03% 11601.000 11721.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 26.18% 1467.000 1851.000 - -0.91% -
437.leslie3d 4.33% 8929.000 9316.000 - 0.00% -
416.gamess 2.28% 10494.000 10733.000 - 0.00% -
436.cactusADM 1.43% 1824.000 1850.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 55.56% -
nb_execution_successful -3.45% 29.000 28.000 - 55.56% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.25% 37101.000 36265.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.88% 81.000 73.000 - -3.95% -
471.omnetpp -8.65% 2670.000 2439.000 - -0.65% -
403.gcc -7.02% 57.000 53.000 - 1.92% -
450.soplex -5.83% 532.000 501.000 - -1.57% -
465.tonto -4.94% 9089.000 8640.000 - 0.00% -
401.bzip2 -4.69% 2774.000 2644.000 - 6.14% -
459.GemsFDTD -4.34% 4220.000 4037.000 - 0.00% -
445.gobmk -3.71% 4909.000 4727.000 - 0.21% -
482.sphinx3 -3.45% 783.000 756.000 - -1.43% -
444.namd -3.30% 636.000 615.000 - -0.49% -
447.dealII -3.23% 1426.000 1380.000 - -0.14% -
435.gromacs -3.20% 5246.000 5078.000 - 0.00% -
433.milc -3.19% 1129.000 1093.000 - -1.62% -
481.wrf -2.98% 4124.000 4001.000 - 0.00% -
400.perlbench -2.53% 1425.000 1389.000 - -1.56% -
458.sjeng -2.44% 6549.000 6389.000 - -0.30% -
410.bwaves -2.23% 4341.000 4244.000 - 0.00% -
464.h264ref -2.01% 4272.000 4186.000 - -0.17% -
470.lbm -1.88% 3354.000 3291.000 - 0.18% -
454.calculix -1.67% 60.000 59.000 - 0.00% -
434.zeusmp -1.31% 1991.000 1965.000 - 0.00% -
456.hmmer -1.01% 2679.000 2652.000 - -1.30% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.45% 29.000 30.000 - 50.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1389.000 -1.56%
401.bzip2 2644.000 6.14%
403.gcc 53.000 1.92%
410.bwaves 4244.000 -
416.gamess 10733.000 -
429.mcf 1851.000 -
433.milc 1093.000 -1.62%
434.zeusmp 1965.000 -
435.gromacs 5078.000 -
436.cactusADM 1850.000 -
437.leslie3d 9316.000 -
444.namd 615.000 -
445.gobmk 4727.000 -
447.dealII 1380.000 -
450.soplex 501.000 -1.57%
453.povray 426.000 -
454.calculix 59.000 -
456.hmmer 2652.000 -1.30%
458.sjeng 6389.000 -
459.GemsFDTD 4037.000 -
462.libquantum 73.000 -3.95%
464.h264ref 4186.000 -
465.tonto 8640.000 -
470.lbm 3291.000 -
471.omnetpp 2439.000 -
473.astar 4915.000 -
481.wrf 4001.000 -
482.sphinx3 756.000 -1.43%
Geometric Mean 1710.313 36.94%
Code Size (bytes)
Name Current %
400.perlbench 1107054.000 -
401.bzip2 59225.000 -
403.gcc 3179212.000 -
410.bwaves 22712.000 -
416.gamess 7168843.000 -
429.mcf 12252.000 -
433.milc 112703.000 -
434.zeusmp 205919.000 -
435.gromacs 793838.000 -
436.cactusADM 663565.000 -
437.leslie3d 79506.000 -
444.namd 229582.000 -
445.gobmk 1553991.000 -
447.dealII 2891817.000 -
450.soplex 350435.000 -
453.povray 835055.000 -
454.calculix 1457241.000 -
456.hmmer 276471.000 -
458.sjeng 130631.000 -
459.GemsFDTD 304718.000 -
462.libquantum 38392.000 -
464.h264ref 478042.000 -
465.tonto 3310619.000 -
470.lbm 11721.000 -
471.omnetpp 634607.000 -
473.astar 36265.000 -
481.wrf 4166424.000 -
482.sphinx3 177512.000 -
Geometric Mean 326134.837 43.08%
Score
Name Current %
nb_compile_successful 28.000 55.56%
nb_execution_successful 28.000 55.56%
nb_total_tests 30.000 50.00%
Geometric Mean 28.651 53.68%
sample variability
Name Current %
400.perlbench 30.000 -
400.perlbench (avg) 30.000 -
400.perlbench (avg) (percentage) 2.160 -1.37%
400.perlbench (max) 21.000 -12.50%
400.perlbench (max) (percentage) 1.560 -11.86%
400.perlbench (unexplained diff vs previous) 22.000 -8.33%
400.perlbench (unexplained diff vs previous) (percentage) 1.580 -7.06%
401.bzip2 41.000 20.59%
401.bzip2 (avg) 41.000 20.59%
401.bzip2 (avg) (percentage) 1.560 13.87%
401.bzip2 (max) 162.000 1146.15%
401.bzip2 (max) (percentage) 6.140 996.43%
401.bzip2 (unexplained diff vs previous) 153.000 992.86%
401.bzip2 (unexplained diff vs previous) (percentage) 5.790 933.93%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.240 -3.42%
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 9.690 -6.29%
403.gcc (unexplained diff vs previous) 1.000 -83.33%
403.gcc (unexplained diff vs previous) (percentage) 1.890 -83.62%
410.bwaves 28.000 -
410.bwaves (avg) 28.000 -
410.bwaves (avg) (percentage) 0.680 -
410.bwaves (max) 32.000 -
410.bwaves (max) (percentage) 0.760 -
416.gamess 28.000 -
416.gamess (avg) 28.000 -
416.gamess (avg) (percentage) 0.270 -
416.gamess (max) 70.000 -
416.gamess (max) (percentage) 0.660 -
429.mcf 102.000 -3.77%
429.mcf (avg) 102.000 -3.77%
429.mcf (avg) (percentage) 5.560 -2.63%
429.mcf (max) 382.000 -10.75%
429.mcf (max) (percentage) 20.660 -10.02%
429.mcf (unexplained diff vs previous) 17.000 -51.43%
429.mcf (unexplained diff vs previous) (percentage) 0.920 -50.80%
433.milc 9.000 12.50%
433.milc (avg) 9.000 12.50%
433.milc (avg) (percentage) 0.830 2.47%
433.milc (max) 17.000 13.33%
433.milc (max) (percentage) 1.620 16.55%
433.milc (unexplained diff vs previous) 18.000 -
433.milc (unexplained diff vs previous) (percentage) 1.650 -
434.zeusmp 14.000 -
434.zeusmp (avg) 14.000 -
434.zeusmp (avg) (percentage) 0.750 -
434.zeusmp (max) 20.000 -
434.zeusmp (max) (percentage) 1.030 -
435.gromacs 106.000 -
435.gromacs (avg) 106.000 -
435.gromacs (avg) (percentage) 2.090 -
435.gromacs (max) 128.000 -
435.gromacs (max) (percentage) 2.540 -1.55%
436.cactusADM 17.000 -
436.cactusADM (avg) 17.000 -
436.cactusADM (avg) (percentage) 0.970 -
436.cactusADM (max) 26.000 -
436.cactusADM (max) (percentage) 1.420 -1.39%
437.leslie3d 356.000 -
437.leslie3d (avg) 356.000 -
437.leslie3d (avg) (percentage) 3.830 -
437.leslie3d (max) 178.000 -
437.leslie3d (max) (percentage) 1.920 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.780 -1.27%
444.namd (max) 10.000 -9.09%
444.namd (max) (percentage) 1.660 -9.78%
444.namd (unexplained diff vs previous) 3.000 50.00%
444.namd (unexplained diff vs previous) (percentage) 0.490 53.12%
445.gobmk 34.000 -2.86%
445.gobmk (avg) 34.000 -2.86%
445.gobmk (avg) (percentage) 0.730 -2.67%
445.gobmk (max) 13.000 -
445.gobmk (max) (percentage) 0.280 -
445.gobmk (unexplained diff vs previous) 10.000 900.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.210 950.00%
447.dealII 14.000 -6.67%
447.dealII (avg) 14.000 -6.67%
447.dealII (avg) (percentage) 1.040 -4.59%
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.370 -3.52%
447.dealII (unexplained diff vs previous) 2.000 -85.71%
447.dealII (unexplained diff vs previous) (percentage) 0.140 -86.14%
450.soplex 9.000 -10.00%
450.soplex (avg) 9.000 -10.00%
450.soplex (avg) (percentage) 1.990 -
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.570 1.29%
450.soplex (unexplained diff vs previous) 8.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.600 1.91%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.520 -3.80%
453.povray (max) 6.000 -25.00%
453.povray (max) (percentage) 1.490 -21.16%
453.povray (unexplained diff vs previous) 1.000 -85.71%
453.povray (unexplained diff vs previous) (percentage) 0.230 -86.06%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 3.200 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.030 -1.62%
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.310 10.71%
456.hmmer (max) 34.000 78.95%
456.hmmer (max) (percentage) 1.300 83.10%
456.hmmer (unexplained diff vs previous) 35.000 84.21%
456.hmmer (unexplained diff vs previous) (percentage) 1.320 85.92%
458.sjeng 31.000 -3.12%
458.sjeng (avg) 31.000 -3.12%
458.sjeng (avg) (percentage) 0.490 -2.00%
458.sjeng (max) 77.000 -7.23%
458.sjeng (max) (percentage) 1.220 -6.87%
458.sjeng (unexplained diff vs previous) 19.000 5.56%
458.sjeng (unexplained diff vs previous) (percentage) 0.300 7.14%
459.GemsFDTD 38.000 -
459.GemsFDTD (avg) 38.000 -
459.GemsFDTD (avg) (percentage) 0.960 -
459.GemsFDTD (max) 74.000 -
459.GemsFDTD (max) (percentage) 1.840 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.650 5.10%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.500 -10.00%
462.libquantum (unexplained diff vs previous) 3.000 -25.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.110 -21.86%
464.h264ref 18.000 -
464.h264ref (avg) 18.000 -
464.h264ref (avg) (percentage) 0.440 -2.22%
464.h264ref (max) 7.000 40.00%
464.h264ref (max) (percentage) 0.170 41.67%
464.h264ref (unexplained diff vs previous) 7.000 40.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.170 41.67%
465.tonto 89.000 -
465.tonto (avg) 89.000 -
465.tonto (avg) (percentage) 1.040 -
465.tonto (max) 113.000 -
465.tonto (max) (percentage) 1.310 -1.50%
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.670 -2.90%
470.lbm (max) 61.000 -8.96%
470.lbm (max) (percentage) 1.870 -9.66%
470.lbm (unexplained diff vs previous) 6.000 20.00%
470.lbm (unexplained diff vs previous) (percentage) 0.180 20.00%
471.omnetpp 45.000 -4.26%
471.omnetpp (avg) 45.000 -4.26%
471.omnetpp (avg) (percentage) 1.880 -2.08%
471.omnetpp (max) 44.000 -12.00%
471.omnetpp (max) (percentage) 1.840 -9.80%
471.omnetpp (unexplained diff vs previous) 16.000 -68.63%
471.omnetpp (unexplained diff vs previous) (percentage) 0.660 -68.27%
473.astar 55.000 -
473.astar (avg) 55.000 -
473.astar (avg) (percentage) 1.130 -
473.astar (max) 40.000 207.69%
473.astar (max) (percentage) 0.820 192.86%
473.astar (unexplained diff vs previous) 40.000 900.00%
473.astar (unexplained diff vs previous) (percentage) 0.810 912.50%
481.wrf 59.000 -
481.wrf (avg) 59.000 -
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) 126.000 -
481.wrf (max) (percentage) 3.160 -
482.sphinx3 8.000 -11.11%
482.sphinx3 (avg) 8.000 -11.11%
482.sphinx3 (avg) (percentage) 1.190 -
482.sphinx3 (max) 10.000 100.00%
482.sphinx3 (max) (percentage) 1.430 83.33%
482.sphinx3 (unexplained diff vs previous) 11.000 83.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.460 87.18%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.680 -
Geometric Mean 5.821 80.83%