Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0824937af0c0822e629a7076c3f5dd39df3b16be (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=513331b788a3fa633f1d0417d43915e16a0c88f0 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (unchanged)
regression GNU-1055
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/197/
View Options
Report
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0197 (basepoints/gcc-14-06033-g55e94561e97e) 2024-03-06T04:25:28 0:00:00
Previous 0194 (3-changed-components) 2024-02-29T11:48:42 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 47 18
Performance Improvements 105 15
Added Tests 2 136
Unchanged Tests 1058 1043
Total Tests 1212

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.56% 78.000 80.000 - -1.23% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 5400.00% 1.000 55.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 4150.00% 0.020 0.850 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 1400.00% 0.060 0.900 - 0.00% -
470.lbm (unexplained diff vs previous) 1400.00% 2.000 30.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 1138.89% 0.180 2.230 - 0.00% -
450.soplex (unexplained diff vs previous) 1100.00% 1.000 12.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 302.63% 0.380 1.530 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 300.00% 3.000 12.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 265.22% 0.230 0.840 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 264.00% 0.250 0.910 - 0.00% -
401.bzip2 (unexplained diff vs previous) 257.14% 7.000 25.000 - 0.00% -
465.tonto (unexplained diff vs previous) 257.14% 21.000 75.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 218.84% 0.690 2.200 - 0.00% -
400.perlbench (unexplained diff vs previous) 210.00% 10.000 31.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 163.64% 0.440 1.160 - 0.00% -
436.cactusADM (unexplained diff vs previous) 162.50% 8.000 21.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 120.00% 5.000 11.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 110.00% 0.100 0.210 - 0.00% -
462.libquantum (max) 100.00% 1.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 95.31% 1.280 2.500 - 0.00% -
470.lbm (max) (percentage) 71.15% 0.520 0.890 - 0.00% -
470.lbm (max) 70.59% 17.000 29.000 - 0.00% -
462.libquantum (max) (percentage) 49.71% 1.710 2.560 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 45.34% 5.580 8.110 - 0.00% -
400.perlbench (max) (percentage) 45.27% 1.480 2.150 - 0.00% -
400.perlbench (max) 42.86% 21.000 30.000 - 0.00% -
465.tonto (max) (percentage) 42.37% 0.590 0.840 - 0.00% -
465.tonto (max) 42.31% 52.000 74.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 34.36% 521.000 700.000 - 0.00% -
456.hmmer (max) 11.11% 9.000 10.000 - 0.00% -
456.hmmer (max) (percentage) 10.81% 0.370 0.410 - 0.00% -
456.hmmer (unexplained diff vs previous) 10.00% 10.000 11.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 7.89% 0.380 0.410 - 0.00% -
445.gobmk (unexplained diff vs previous) 7.41% 27.000 29.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 7.14% 0.560 0.600 - 0.00% -
445.gobmk (max) (percentage) 5.26% 0.570 0.600 - 0.00% -
458.sjeng (max) (percentage) 5.00% 0.800 0.840 - 0.00% -
458.sjeng (max) 3.85% 52.000 54.000 - 0.00% -
445.gobmk (max) 3.70% 27.000 28.000 - 0.00% -
403.gcc (max) (percentage) 3.24% 6.800 7.020 - 0.00% -
403.gcc (avg) (percentage) 2.58% 4.660 4.780 - 0.00% -
458.sjeng (avg) (percentage) 1.85% 0.540 0.550 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 1.06% 0.940 0.950 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.70% 27.000 26.000 - -10.34% -
nb_execution_successful -3.70% 27.000 26.000 - -10.34% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.50% 9335.000 8635.000 - -3.29% -
403.gcc -7.02% 57.000 53.000 - -7.02% -
450.soplex -2.19% 549.000 537.000 - 0.94% -
400.perlbench -2.15% 1440.000 1409.000 - -1.12% -
482.sphinx3 -1.51% 794.000 782.000 - -0.13% -
436.cactusADM -1.15% 1830.000 1809.000 - -0.82% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) (percentage) -80.00% 0.350 0.070 - 0.00% -
416.gamess (unexplained diff vs previous) -78.95% 38.000 8.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -75.58% 0.860 0.210 - 0.00% -
447.dealII (unexplained diff vs previous) -75.00% 12.000 3.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -72.50% 40.000 11.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -72.34% 0.940 0.260 - 0.00% -
471.omnetpp (max) -60.29% 68.000 27.000 - 0.00% -
429.mcf (unexplained diff vs previous) -60.00% 25.000 10.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -59.65% 1.710 0.690 - 0.00% -
471.omnetpp (unexplained diff vs previous) -59.38% 32.000 13.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -59.38% 1.280 0.520 - 0.00% -
471.omnetpp (max) (percentage) -59.34% 2.730 1.110 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -58.68% 1.210 0.500 - 0.00% -
434.zeusmp (unexplained diff vs previous) -58.33% 24.000 10.000 - 0.00% -
444.namd (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -50.00% 0.640 0.320 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -47.00% 1.000 0.530 - 0.00% -
410.bwaves (unexplained diff vs previous) -46.51% 43.000 23.000 - 0.00% -
429.mcf (max) -41.69% 295.000 172.000 - 0.00% -
429.mcf (max) (percentage) -41.27% 20.160 11.840 - 0.00% -
444.namd (max) (percentage) -32.91% 0.790 0.530 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -29.41% 0.170 0.120 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -28.57% 7.000 5.000 - 0.00% -
410.bwaves (max) (percentage) -25.25% 0.990 0.740 - 0.00% -
433.milc (unexplained diff vs previous) -25.00% 4.000 3.000 - 0.00% -
444.namd (max) -25.00% 4.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -25.00% 0.360 0.270 - 0.00% -
464.h264ref (max) (percentage) -24.77% 1.090 0.820 - 0.00% -
464.h264ref (max) -23.91% 46.000 35.000 - 0.00% -
410.bwaves (max) -23.81% 42.000 32.000 - 0.00% -
416.gamess (max) (percentage) -20.51% 0.390 0.310 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -20.00% 0.100 0.080 - 0.00% -
444.namd -20.00% 5.000 4.000 - 0.00% -
444.namd (avg) -20.00% 5.000 4.000 - 0.00% -
473.astar (unexplained diff vs previous) -20.00% 5.000 4.000 - 0.00% -
416.gamess (max) -19.51% 41.000 33.000 - 0.00% -
453.povray -16.67% 6.000 5.000 - 0.00% -
453.povray (avg) -16.67% 6.000 5.000 - 0.00% -
433.milc (max) -14.29% 7.000 6.000 - 0.00% -
437.leslie3d (max) -13.28% 1393.000 1208.000 - 0.00% -
434.zeusmp (max) -13.04% 23.000 20.000 - 0.00% -
434.zeusmp (max) (percentage) -12.61% 1.190 1.040 - 0.00% -
481.wrf (max) (percentage) -10.24% 1.270 1.140 - 0.00% -
433.milc -10.00% 10.000 9.000 - 0.00% -
433.milc (avg) -10.00% 10.000 9.000 - 0.00% -
450.soplex (max) -8.33% 12.000 11.000 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
437.leslie3d -6.96% 589.000 548.000 - 0.00% -
437.leslie3d (avg) -6.96% 589.000 548.000 - 0.00% -
416.gamess (avg) (percentage) -6.67% 0.300 0.280 - 0.00% -
447.dealII (max) (percentage) -6.38% 1.410 1.320 - 0.00% -
437.leslie3d (max) (percentage) -6.30% 14.930 13.990 - 0.00% -
416.gamess -6.25% 32.000 30.000 - 0.00% -
416.gamess (avg) -6.25% 32.000 30.000 - 0.00% -
433.milc (max) (percentage) -6.15% 0.650 0.610 - 0.00% -
447.dealII (max) -5.26% 19.000 18.000 - 0.00% -
435.gromacs -4.42% 113.000 108.000 - 0.00% -
435.gromacs (avg) -4.42% 113.000 108.000 - 0.00% -
459.GemsFDTD -4.26% 47.000 45.000 - 0.00% -
459.GemsFDTD (avg) -4.26% 47.000 45.000 - 0.00% -
473.astar -4.23% 71.000 68.000 - 0.00% -
473.astar (avg) -4.23% 71.000 68.000 - 0.00% -
435.gromacs (avg) (percentage) -4.09% 2.200 2.110 - 0.00% -
447.dealII (avg) (percentage) -3.77% 1.060 1.020 - 0.00% -
436.cactusADM (max) -3.70% 27.000 26.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -3.54% 1.130 1.090 - 0.00% -
400.perlbench -3.33% 30.000 29.000 - 0.00% -
400.perlbench (avg) -3.33% 30.000 29.000 - 0.00% -
429.mcf -3.12% 96.000 93.000 - 0.00% -
429.mcf (avg) -3.12% 96.000 93.000 - 0.00% -
473.astar (avg) (percentage) -2.92% 1.370 1.330 - 0.00% -
435.gromacs (max) (percentage) -2.82% 2.840 2.760 - 0.00% -
482.sphinx3 (max) (percentage) -2.80% 2.140 2.080 - 0.00% -
435.gromacs (max) -2.74% 146.000 142.000 - 0.00% -
436.cactusADM (max) (percentage) -2.61% 1.530 1.490 - 0.00% -
444.namd (avg) (percentage) -2.50% 0.800 0.780 - 0.00% -
445.gobmk -2.50% 40.000 39.000 - 0.00% -
445.gobmk (avg) -2.50% 40.000 39.000 - 0.00% -
473.astar (max) (percentage) -2.47% 4.050 3.950 - 0.00% -
471.omnetpp (avg) (percentage) -2.45% 2.040 1.990 - 0.00% -
429.mcf (avg) (percentage) -2.44% 6.570 6.410 - 0.00% -
473.astar (max) -2.39% 209.000 204.000 - 0.00% -
433.milc (avg) (percentage) -2.20% 0.910 0.890 - 0.00% -
401.bzip2 -2.08% 48.000 47.000 - 0.00% -
401.bzip2 (avg) -2.08% 48.000 47.000 - 0.00% -
471.omnetpp -2.00% 50.000 49.000 - 0.00% -
471.omnetpp (avg) -2.00% 50.000 49.000 - 0.00% -
465.tonto -1.82% 110.000 108.000 - 0.00% -
465.tonto (avg) -1.82% 110.000 108.000 - 0.00% -
401.bzip2 (avg) (percentage) -1.72% 1.740 1.710 - 0.00% -
465.tonto (avg) (percentage) -1.61% 1.240 1.220 - 0.00% -
464.h264ref (avg) (percentage) -1.56% 0.640 0.630 - 0.00% -
453.povray (avg) (percentage) -1.41% 1.420 1.400 - 0.00% -
410.bwaves (avg) (percentage) -1.32% 0.760 0.750 - 0.00% -
401.bzip2 (max) -1.20% 83.000 82.000 - 0.00% -
445.gobmk (avg) (percentage) -1.19% 0.840 0.830 - 0.00% -
434.zeusmp (avg) (percentage) -1.15% 0.870 0.860 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.23% 31.000 32.000 - 10.34% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 5.48% 21532.000 22712.000 - 0.00% -
447.dealII 3.19% 2802286.000 2891817.000 - 0.00% -
459.GemsFDTD 3.15% 295414.000 304718.000 - 0.00% -
456.hmmer 2.09% 270823.000 276471.000 - 0.00% -
400.perlbench 1.76% 1087835.000 1107020.000 - 0.00% -
436.cactusADM 1.73% 652261.000 663565.000 - 0.00% -
429.mcf 1.49% 12072.000 12252.000 - 0.00% -
416.gamess 1.32% 7063623.000 7156920.000 - 0.00% -
465.tonto 1.31% 3263584.000 3306331.000 - 0.00% -
444.namd 1.27% 226710.000 229582.000 - 0.00% -
464.h264ref 1.20% 472362.000 478042.000 - 0.00% -
482.sphinx3 1.15% 175488.000 177512.000 - 0.00% -
434.zeusmp 1.09% 203703.000 205919.000 - 0.00% -
470.lbm 1.03% 11601.000 11721.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
473.astar 4.98% 4941.000 5187.000 - 0.08% -
416.gamess 2.44% 10494.000 10750.000 - 0.07% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - -3.70% -
nb_execution_successful -10.34% 29.000 26.000 - -3.70% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.25% 37101.000 36265.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -7.12% 2670.000 2480.000 - -0.52% -
403.gcc -7.02% 57.000 53.000 - -7.02% -
437.leslie3d -3.29% 8929.000 8635.000 - -7.50% -
465.tonto -2.34% 9089.000 8876.000 - -0.84% -
445.gobmk -2.28% 4909.000 4797.000 - -0.60% -
444.namd -2.04% 636.000 623.000 - -0.32% -
447.dealII -1.89% 1426.000 1399.000 - 0.21% -
435.gromacs -1.73% 5246.000 5155.000 - -0.21% -
458.sjeng -1.33% 6549.000 6462.000 - -0.84% -
433.milc -1.24% 1129.000 1115.000 - -0.27% -
462.libquantum -1.23% 81.000 80.000 - 2.56% -
453.povray -1.17% 428.000 423.000 - -0.94% -
400.perlbench -1.12% 1425.000 1409.000 - -2.15% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 3.23% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1409.000 -2.15%
401.bzip2 2761.000 -
403.gcc 53.000 -7.02%
410.bwaves 4344.000 -
416.gamess 10750.000 -
429.mcf 1456.000 -
433.milc 1115.000 -
434.zeusmp 1999.000 -
435.gromacs 5155.000 -
436.cactusADM 1809.000 -1.15%
437.leslie3d 8635.000 -7.50%
444.namd 623.000 -
445.gobmk 4797.000 -
447.dealII 1399.000 -
450.soplex 537.000 -2.19%
453.povray 423.000 -
456.hmmer 2671.000 -
458.sjeng 6462.000 -
459.GemsFDTD 4191.000 -
462.libquantum 80.000 2.56%
464.h264ref 4289.000 -
465.tonto 8876.000 -
470.lbm 3327.000 -
471.omnetpp 2480.000 -
473.astar 5187.000 -
482.sphinx3 782.000 -1.51%
Geometric Mean 1899.727 -
Code Size (bytes)
Name Current %
400.perlbench 1107020.000 -
401.bzip2 59225.000 -
403.gcc 3179212.000 -
410.bwaves 22712.000 -
416.gamess 7156920.000 -
429.mcf 12252.000 -
433.milc 112703.000 -
434.zeusmp 205919.000 -
435.gromacs 793838.000 -
436.cactusADM 663565.000 -
437.leslie3d 79506.000 -
444.namd 229582.000 -
445.gobmk 1553991.000 -
447.dealII 2891817.000 -
450.soplex 350435.000 -
453.povray 835055.000 -
456.hmmer 276471.000 -
458.sjeng 130631.000 -
459.GemsFDTD 304718.000 -
462.libquantum 38392.000 -
464.h264ref 478042.000 -
465.tonto 3306331.000 -
470.lbm 11721.000 -
471.omnetpp 634607.000 -
473.astar 36265.000 -
482.sphinx3 177512.000 -
Geometric Mean 279119.074 -
Score
Name Current %
nb_compile_successful 26.000 -3.70%
nb_execution_successful 26.000 -3.70%
nb_total_tests 32.000 3.23%
Geometric Mean 27.863 -1.45%
sample variability
Name Current %
400.perlbench 29.000 -3.33%
400.perlbench (avg) 29.000 -3.33%
400.perlbench (avg) (percentage) 2.100 -
400.perlbench (max) 30.000 42.86%
400.perlbench (max) (percentage) 2.150 45.27%
400.perlbench (unexplained diff vs previous) 31.000 210.00%
400.perlbench (unexplained diff vs previous) (percentage) 2.200 218.84%
401.bzip2 47.000 -2.08%
401.bzip2 (avg) 47.000 -2.08%
401.bzip2 (avg) (percentage) 1.710 -1.72%
401.bzip2 (max) 82.000 -1.20%
401.bzip2 (max) (percentage) 3.000 -
401.bzip2 (unexplained diff vs previous) 25.000 257.14%
401.bzip2 (unexplained diff vs previous) (percentage) 0.910 264.00%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.780 2.58%
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 7.020 3.24%
403.gcc (unexplained diff vs previous) 4.000 -
403.gcc (unexplained diff vs previous) (percentage) 7.550 -
410.bwaves 32.000 -
410.bwaves (avg) 32.000 -
410.bwaves (avg) (percentage) 0.750 -1.32%
410.bwaves (max) 32.000 -23.81%
410.bwaves (max) (percentage) 0.740 -25.25%
410.bwaves (unexplained diff vs previous) 23.000 -46.51%
410.bwaves (unexplained diff vs previous) (percentage) 0.530 -47.00%
416.gamess 30.000 -6.25%
416.gamess (avg) 30.000 -6.25%
416.gamess (avg) (percentage) 0.280 -6.67%
416.gamess (max) 33.000 -19.51%
416.gamess (max) (percentage) 0.310 -20.51%
416.gamess (unexplained diff vs previous) 8.000 -78.95%
416.gamess (unexplained diff vs previous) (percentage) 0.070 -80.00%
429.mcf 93.000 -3.12%
429.mcf (avg) 93.000 -3.12%
429.mcf (avg) (percentage) 6.410 -2.44%
429.mcf (max) 172.000 -41.69%
429.mcf (max) (percentage) 11.840 -41.27%
429.mcf (unexplained diff vs previous) 10.000 -60.00%
429.mcf (unexplained diff vs previous) (percentage) 0.690 -59.65%
433.milc 9.000 -10.00%
433.milc (avg) 9.000 -10.00%
433.milc (avg) (percentage) 0.890 -2.20%
433.milc (max) 6.000 -14.29%
433.milc (max) (percentage) 0.610 -6.15%
433.milc (unexplained diff vs previous) 3.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.270 -25.00%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.860 -1.15%
434.zeusmp (max) 20.000 -13.04%
434.zeusmp (max) (percentage) 1.040 -12.61%
434.zeusmp (unexplained diff vs previous) 10.000 -58.33%
434.zeusmp (unexplained diff vs previous) (percentage) 0.500 -58.68%
435.gromacs 108.000 -4.42%
435.gromacs (avg) 108.000 -4.42%
435.gromacs (avg) (percentage) 2.110 -4.09%
435.gromacs (max) 142.000 -2.74%
435.gromacs (max) (percentage) 2.760 -2.82%
435.gromacs (unexplained diff vs previous) 11.000 120.00%
435.gromacs (unexplained diff vs previous) (percentage) 0.210 110.00%
436.cactusADM 18.000 -
436.cactusADM (avg) 18.000 -
436.cactusADM (avg) (percentage) 1.010 -
436.cactusADM (max) 26.000 -3.70%
436.cactusADM (max) (percentage) 1.490 -2.61%
436.cactusADM (unexplained diff vs previous) 21.000 162.50%
436.cactusADM (unexplained diff vs previous) (percentage) 1.160 163.64%
437.leslie3d 548.000 -6.96%
437.leslie3d (avg) 548.000 -6.96%
437.leslie3d (avg) (percentage) 6.350 -
437.leslie3d (max) 1208.000 -13.28%
437.leslie3d (max) (percentage) 13.990 -6.30%
437.leslie3d (unexplained diff vs previous) 700.000 34.36%
437.leslie3d (unexplained diff vs previous) (percentage) 8.110 45.34%
444.namd 4.000 -20.00%
444.namd (avg) 4.000 -20.00%
444.namd (avg) (percentage) 0.780 -2.50%
444.namd (max) 3.000 -25.00%
444.namd (max) (percentage) 0.530 -32.91%
444.namd (unexplained diff vs previous) 2.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.320 -50.00%
445.gobmk 39.000 -2.50%
445.gobmk (avg) 39.000 -2.50%
445.gobmk (avg) (percentage) 0.830 -1.19%
445.gobmk (max) 28.000 3.70%
445.gobmk (max) (percentage) 0.600 5.26%
445.gobmk (unexplained diff vs previous) 29.000 7.41%
445.gobmk (unexplained diff vs previous) (percentage) 0.600 7.14%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.020 -3.77%
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.320 -6.38%
447.dealII (unexplained diff vs previous) 3.000 -75.00%
447.dealII (unexplained diff vs previous) (percentage) 0.210 -75.58%
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.370 -
450.soplex (max) 11.000 -8.33%
450.soplex (max) (percentage) 2.190 -
450.soplex (unexplained diff vs previous) 12.000 1100.00%
450.soplex (unexplained diff vs previous) (percentage) 2.230 1138.89%
453.povray 5.000 -16.67%
453.povray (avg) 5.000 -16.67%
453.povray (avg) (percentage) 1.400 -1.41%
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.940 -
453.povray (unexplained diff vs previous) 4.000 -
453.povray (unexplained diff vs previous) (percentage) 0.950 1.06%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.830 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 10.000 11.11%
456.hmmer (max) (percentage) 0.410 10.81%
456.hmmer (unexplained diff vs previous) 11.000 10.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.410 7.89%
458.sjeng 35.000 -
458.sjeng (avg) 35.000 -
458.sjeng (avg) (percentage) 0.550 1.85%
458.sjeng (max) 54.000 3.85%
458.sjeng (max) (percentage) 0.840 5.00%
458.sjeng (unexplained diff vs previous) 55.000 5400.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.850 4150.00%
459.GemsFDTD 45.000 -4.26%
459.GemsFDTD (avg) 45.000 -4.26%
459.GemsFDTD (avg) (percentage) 1.090 -3.54%
459.GemsFDTD (max) 63.000 -
459.GemsFDTD (max) (percentage) 1.520 -
459.GemsFDTD (unexplained diff vs previous) 5.000 -28.57%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.120 -29.41%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.030 -
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 2.560 49.71%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.500 95.31%
464.h264ref 27.000 -
464.h264ref (avg) 27.000 -
464.h264ref (avg) (percentage) 0.630 -1.56%
464.h264ref (max) 35.000 -23.91%
464.h264ref (max) (percentage) 0.820 -24.77%
464.h264ref (unexplained diff vs previous) 11.000 -72.50%
464.h264ref (unexplained diff vs previous) (percentage) 0.260 -72.34%
465.tonto 108.000 -1.82%
465.tonto (avg) 108.000 -1.82%
465.tonto (avg) (percentage) 1.220 -1.61%
465.tonto (max) 74.000 42.31%
465.tonto (max) (percentage) 0.840 42.37%
465.tonto (unexplained diff vs previous) 75.000 257.14%
465.tonto (unexplained diff vs previous) (percentage) 0.840 265.22%
470.lbm 26.000 -
470.lbm (avg) 26.000 -
470.lbm (avg) (percentage) 0.800 -
470.lbm (max) 29.000 70.59%
470.lbm (max) (percentage) 0.890 71.15%
470.lbm (unexplained diff vs previous) 30.000 1400.00%
470.lbm (unexplained diff vs previous) (percentage) 0.900 1400.00%
471.omnetpp 49.000 -2.00%
471.omnetpp (avg) 49.000 -2.00%
471.omnetpp (avg) (percentage) 1.990 -2.45%
471.omnetpp (max) 27.000 -60.29%
471.omnetpp (max) (percentage) 1.110 -59.34%
471.omnetpp (unexplained diff vs previous) 13.000 -59.38%
471.omnetpp (unexplained diff vs previous) (percentage) 0.520 -59.38%
473.astar 68.000 -4.23%
473.astar (avg) 68.000 -4.23%
473.astar (avg) (percentage) 1.330 -2.92%
473.astar (max) 204.000 -2.39%
473.astar (max) (percentage) 3.950 -2.47%
473.astar (unexplained diff vs previous) 4.000 -20.00%
473.astar (unexplained diff vs previous) (percentage) 0.080 -20.00%
481.wrf (avg) (percentage) 1.320 -
481.wrf (max) (percentage) 1.140 -10.24%
482.sphinx3 10.000 -
482.sphinx3 (avg) 10.000 -
482.sphinx3 (avg) (percentage) 1.330 -
482.sphinx3 (max) 16.000 -
482.sphinx3 (max) (percentage) 2.080 -2.80%
482.sphinx3 (unexplained diff vs previous) 12.000 300.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.530 302.63%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.610 -
Geometric Mean 5.558 6.18%