Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=708aee5ec64bea2c84449f63f3cdaa6d2b0b5892 (+ 78 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/73e2bdbf9bed48b2b30691f03e79230bff4850c6 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4369019520a3396304f5382f29da667cebb98695 (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3_LTO-build/152/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0152 (2-changed-components) 2023-12-02T07:44:04 0:00:00
Previous 0149 (3-changed-components) 2023-11-27T11:31:40 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T00:55:39 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 79 20
Performance Improvements 70 13
Added Tests 24 142
Unchanged Tests 1027 1025
Total Tests 1200

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 32.81% 890.000 1182.000 - -2.64% -
436.cactusADM 1.56% 2302.000 2338.000 - -0.89% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 1120.69% 0.290 3.540 - 0.00% -
471.omnetpp (unexplained diff vs previous) 1083.33% 6.000 71.000 - 0.00% -
481.wrf (max) (percentage) 538.89% 0.900 5.750 - 0.00% -
481.wrf (max) 507.32% 41.000 249.000 - 0.00% -
436.cactusADM (max) 227.27% 11.000 36.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 227.27% 11.000 36.000 - 0.00% -
436.cactusADM (max) (percentage) 225.00% 0.480 1.560 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 220.83% 0.480 1.540 - 0.00% -
459.GemsFDTD (max) (percentage) 101.09% 0.920 1.850 - 0.00% -
459.GemsFDTD (max) 100.00% 46.000 92.000 - 0.00% -
429.mcf (max) 80.84% 214.000 387.000 - 0.00% -
450.soplex (max) 80.00% 10.000 18.000 - 0.00% -
450.soplex (max) (percentage) 73.46% 2.110 3.660 - 0.00% -
464.h264ref (max) (percentage) 68.25% 0.630 1.060 - 0.00% -
464.h264ref (max) 65.62% 32.000 53.000 - 0.00% -
429.mcf 43.33% 90.000 129.000 - 0.00% -
429.mcf (avg) 43.33% 90.000 129.000 - 0.00% -
471.omnetpp (max) (percentage) 42.50% 2.400 3.420 - 0.00% -
471.omnetpp (max) 38.78% 49.000 68.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 38.49% 2.780 3.850 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 36.90% 0.840 1.150 - 0.00% -
429.mcf (max) (percentage) 35.97% 24.130 32.810 - 0.00% -
458.sjeng (unexplained diff vs previous) 35.00% 60.000 81.000 - 0.00% -
458.sjeng (max) (percentage) 34.12% 0.850 1.140 - 0.00% -
458.sjeng (max) 33.33% 60.000 80.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
481.wrf (avg) (percentage) 29.91% 1.070 1.390 - 0.00% -
462.libquantum (max) (percentage) 29.37% 2.860 3.700 - 0.00% -
410.bwaves (max) (percentage) 23.56% 1.910 2.360 - 0.00% -
481.wrf 22.45% 49.000 60.000 - 0.00% -
481.wrf (avg) 22.45% 49.000 60.000 - 0.00% -
410.bwaves (max) 20.69% 87.000 105.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 18.90% 1.270 1.510 - 0.00% -
445.gobmk (unexplained diff vs previous) 17.54% 57.000 67.000 - 0.00% -
416.gamess (max) 16.67% 18.000 21.000 - 0.00% -
416.gamess (max) (percentage) 15.38% 0.130 0.150 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 12.00% 4.750 5.320 - 0.00% -
465.tonto (avg) (percentage) 10.42% 0.960 1.060 - 0.00% -
436.cactusADM 10.00% 10.000 11.000 - 0.00% -
436.cactusADM (avg) 10.00% 10.000 11.000 - 0.00% -
465.tonto 7.95% 88.000 95.000 - 0.00% -
465.tonto (avg) 7.95% 88.000 95.000 - 0.00% -
429.mcf (unexplained diff vs previous) 7.75% 271.000 292.000 - 0.00% -
429.mcf (avg) (percentage) 7.75% 10.200 10.990 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 7.51% 1.730 1.860 - 0.00% -
454.calculix (avg) (percentage) 7.39% 2.570 2.760 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 6.45% 31.000 33.000 - 0.00% -
436.cactusADM (avg) (percentage) 6.38% 0.470 0.500 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 5.56% 0.900 0.950 - 0.00% -
471.omnetpp (avg) (percentage) 5.13% 1.560 1.640 - 0.00% -
470.lbm (unexplained diff vs previous) 5.08% 59.000 62.000 - 0.00% -
473.astar (avg) (percentage) 5.06% 1.780 1.870 - 0.00% -
434.zeusmp (unexplained diff vs previous) 5.00% 20.000 21.000 - 0.00% -
482.sphinx3 (avg) (percentage) 4.85% 2.270 2.380 - 0.00% -
464.h264ref (avg) (percentage) 4.62% 0.650 0.680 - 0.00% -
462.libquantum (avg) (percentage) 4.49% 1.780 1.860 - 0.00% -
434.zeusmp (max) (percentage) 4.44% 0.900 0.940 - 0.00% -
454.calculix (max) (percentage) 4.21% 5.230 5.450 - 0.00% -
470.lbm (max) (percentage) 3.41% 1.760 1.820 - 0.00% -
410.bwaves (avg) (percentage) 3.33% 1.200 1.240 - 0.00% -
458.sjeng (avg) (percentage) 3.33% 0.600 0.620 - 0.00% -
401.bzip2 (avg) (percentage) 3.33% 1.800 1.860 - 0.00% -
464.h264ref 3.03% 33.000 34.000 - 0.00% -
464.h264ref (avg) 3.03% 33.000 34.000 - 0.00% -
458.sjeng 2.38% 42.000 43.000 - 0.00% -
458.sjeng (avg) 2.38% 42.000 43.000 - 0.00% -
470.lbm (avg) (percentage) 1.96% 1.020 1.040 - 0.00% -
445.gobmk (avg) (percentage) 1.85% 1.080 1.100 - 0.00% -
410.bwaves 1.85% 54.000 55.000 - 0.00% -
410.bwaves (avg) 1.85% 54.000 55.000 - 0.00% -
470.lbm (max) 1.69% 59.000 60.000 - 0.00% -
450.soplex (avg) (percentage) 1.44% 2.770 2.810 - 0.00% -
482.sphinx3 (max) (percentage) 1.41% 4.980 5.050 - 0.00% -
459.GemsFDTD (avg) (percentage) 1.36% 1.470 1.490 - 0.00% -
435.gromacs (avg) (percentage) 1.18% 2.550 2.580 - 0.00% -
447.dealII (avg) (percentage) 1.17% 1.710 1.730 - 0.00% -
437.leslie3d (avg) (percentage) 1.01% 4.930 4.980 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -6.06% 9137.000 8583.000 - -2.70% -
481.wrf -5.75% 4612.000 4347.000 - -0.91% -
454.calculix -5.45% 55.000 52.000 - -5.45% -
482.sphinx3 -5.05% 653.000 620.000 - -2.21% -
473.astar -4.65% 4815.000 4591.000 - -0.09% -
462.libquantum -3.70% 108.000 104.000 - -8.77% -
450.soplex -3.66% 519.000 500.000 - -3.29% -
471.omnetpp -3.42% 2079.000 2008.000 - -0.89% -
401.bzip2 -3.32% 2834.000 2740.000 - 0.26% -
435.gromacs -3.14% 5642.000 5465.000 - -0.42% -
410.bwaves -2.36% 4575.000 4467.000 - -2.34% -
465.tonto -2.25% 9193.000 8986.000 - -1.01% -
447.dealII -2.12% 1131.000 1107.000 - 13.19% -
403.gcc -1.92% 52.000 51.000 - 4.08% -
459.GemsFDTD -1.85% 5091.000 4997.000 - 3.52% -
470.lbm -1.82% 3403.000 3341.000 - 0.33% -
445.gobmk -1.49% 4498.000 4431.000 - -1.07% -
453.povray -1.37% 439.000 433.000 - -0.92% -
458.sjeng -1.14% 7103.000 7022.000 - 5.94% -
464.h264ref -1.06% 5099.000 5045.000 - 0.82% -
444.namd -1.04% 769.000 761.000 - -0.65% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) -93.75% 0.480 0.030 - 0.00% -
456.hmmer (unexplained diff vs previous) -93.33% 15.000 1.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -41.98% 162.000 94.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -40.03% 5.720 3.430 - 0.00% -
447.dealII (unexplained diff vs previous) -22.58% 31.000 24.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -20.80% 2.740 2.170 - 0.00% -
473.astar (max) -19.62% 265.000 213.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -18.88% 30.450 24.700 - 0.00% -
400.perlbench (unexplained diff vs previous) -16.67% 12.000 10.000 - 0.00% -
453.povray (max) -16.67% 6.000 5.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -16.25% 0.800 0.670 - 0.00% -
473.astar (max) (percentage) -15.76% 5.520 4.650 - 0.00% -
401.bzip2 (max) -15.20% 171.000 145.000 - 0.00% -
456.hmmer (max) -13.33% 15.000 13.000 - 0.00% -
401.bzip2 (max) (percentage) -12.54% 6.060 5.300 - 0.00% -
400.perlbench (max) (percentage) -12.50% 0.800 0.700 - 0.00% -
473.astar (unexplained diff vs previous) -11.11% 252.000 224.000 - 0.00% -
456.hmmer (max) (percentage) -10.42% 0.480 0.430 - 0.00% -
433.milc -10.00% 10.000 9.000 - 0.00% -
433.milc (avg) -10.00% 10.000 9.000 - 0.00% -
400.perlbench (max) -9.09% 11.000 10.000 - 0.00% -
437.leslie3d (max) -8.55% 655.000 599.000 - 0.00% -
444.namd (max) -7.69% 13.000 12.000 - 0.00% -
444.namd (max) (percentage) -7.47% 1.740 1.610 - 0.00% -
447.dealII (max) (percentage) -7.09% 2.820 2.620 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -6.69% 5.230 4.880 - 0.00% -
447.dealII (max) -6.45% 31.000 29.000 - 0.00% -
453.povray (max) (percentage) -6.16% 1.460 1.370 - 0.00% -
433.milc (avg) (percentage) -5.41% 1.110 1.050 - 0.00% -
437.leslie3d -5.11% 450.000 427.000 - 0.00% -
437.leslie3d (avg) -5.11% 450.000 427.000 - 0.00% -
400.perlbench -5.00% 20.000 19.000 - 0.00% -
400.perlbench (avg) -5.00% 20.000 19.000 - 0.00% -
465.tonto (max) -4.41% 227.000 217.000 - 0.00% -
435.gromacs (max) -4.17% 240.000 230.000 - 0.00% -
456.hmmer (avg) (percentage) -3.70% 0.270 0.260 - 0.00% -
445.gobmk (max) -3.28% 122.000 118.000 - 0.00% -
482.sphinx3 (max) -3.12% 32.000 31.000 - 0.00% -
437.leslie3d (max) (percentage) -2.51% 7.170 6.990 - 0.00% -
400.perlbench (avg) (percentage) -2.22% 1.350 1.320 - 0.00% -
435.gromacs -2.10% 143.000 140.000 - 0.00% -
435.gromacs (avg) -2.10% 143.000 140.000 - 0.00% -
465.tonto (max) (percentage) -2.02% 2.470 2.420 - 0.00% -
433.milc (max) (percentage) -1.96% 0.510 0.500 - 0.00% -
401.bzip2 -1.96% 51.000 50.000 - 0.00% -
401.bzip2 (avg) -1.96% 51.000 50.000 - 0.00% -
445.gobmk (max) (percentage) -1.84% 2.720 2.670 - 0.00% -
435.gromacs (max) (percentage) -1.41% 4.270 4.210 - 0.00% -
403.gcc (max) (percentage) -1.39% 5.040 4.970 - 0.00% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 7.06% 95053.000 101761.000 - 0.00% -
447.dealII 4.72% 460638.000 482397.000 - 0.00% -
436.cactusADM 3.49% 520390.000 538554.000 - 0.00% -
433.milc 3.11% 105180.000 108452.000 - 0.00% -
444.namd 2.56% 232647.000 238594.000 - 0.00% -
416.gamess 2.51% 8947804.000 9172197.000 - 0.00% -
481.wrf 2.06% 5813871.000 5933818.000 - 0.00% -
462.libquantum 1.94% 21437.000 21853.000 - 0.00% -
410.bwaves 1.89% 22757.000 23186.000 - 0.00% -
473.astar 1.80% 30208.000 30752.000 - 0.00% -
429.mcf 1.55% 10087.000 10243.000 - 0.00% -
464.h264ref 1.41% 782902.000 793966.000 - 0.00% -
454.calculix 1.17% 1295314.000 1310473.000 - 0.00% -
445.gobmk 1.15% 1706409.000 1726029.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 14.97% 1289.000 1482.000 - -0.67% -
447.dealII 13.19% 978.000 1107.000 - -2.12% -
458.sjeng 5.94% 6628.000 7022.000 - -1.14% -
403.gcc 4.08% 49.000 51.000 - -1.92% -
459.GemsFDTD 3.52% 4827.000 4997.000 - -1.85% -
416.gamess 1.63% 14028.000 14257.000 - -0.15% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.53% 325184.000 320212.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -8.77% 114.000 104.000 - -3.70% -
456.hmmer -7.32% 3374.000 3127.000 - -0.03% -
454.calculix -5.45% 55.000 52.000 - -5.45% -
433.milc -3.51% 940.000 907.000 - 0.00% -
450.soplex -3.29% 517.000 500.000 - -3.66% -
437.leslie3d -2.70% 8821.000 8583.000 - -6.06% -
429.mcf -2.64% 1214.000 1182.000 - 32.81% -
410.bwaves -2.34% 4574.000 4467.000 - -2.36% -
482.sphinx3 -2.21% 634.000 620.000 - -5.05% -
445.gobmk -1.07% 4479.000 4431.000 - -1.49% -
465.tonto -1.01% 9078.000 8986.000 - -2.25% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.49s
Name Current %
400.perlbench 1482.000 -
401.bzip2 2740.000 -3.32%
403.gcc 51.000 -1.92%
410.bwaves 4467.000 -2.36%
416.gamess 14257.000 -
429.mcf 1182.000 32.81%
433.milc 907.000 -
434.zeusmp 2211.000 -
435.gromacs 5465.000 -3.14%
436.cactusADM 2338.000 1.56%
437.leslie3d 8583.000 -6.06%
444.namd 761.000 -1.04%
445.gobmk 4431.000 -1.49%
447.dealII 1107.000 -2.12%
450.soplex 500.000 -3.66%
453.povray 433.000 -1.37%
454.calculix 52.000 -5.45%
456.hmmer 3127.000 -
458.sjeng 7022.000 -1.14%
459.GemsFDTD 4997.000 -1.85%
462.libquantum 104.000 -3.70%
464.h264ref 5045.000 -1.06%
465.tonto 8986.000 -2.25%
470.lbm 3341.000 -1.82%
471.omnetpp 2008.000 -3.42%
473.astar 4591.000 -4.65%
481.wrf 4347.000 -5.75%
482.sphinx3 620.000 -5.05%
Geometric Mean 1748.047 -1.27%
Name Current %
400.perlbench 1256633.000 -
401.bzip2 71700.000 -
403.gcc 3714413.000 -
410.bwaves 23186.000 -
416.gamess 9172197.000 -
429.mcf 10243.000 -
433.milc 108452.000 -
434.zeusmp 320212.000 -
435.gromacs 738688.000 -
436.cactusADM 538554.000 -
437.leslie3d 101761.000 -
444.namd 238594.000 -
445.gobmk 1726029.000 -
447.dealII 482397.000 -
450.soplex 328548.000 -
453.povray 1084688.000 -
454.calculix 1310473.000 -
456.hmmer 155735.000 -
458.sjeng 153511.000 -
459.GemsFDTD 398487.000 -
462.libquantum 21853.000 -
464.h264ref 793966.000 -
465.tonto 3087182.000 -
470.lbm 11043.000 -
471.omnetpp 587707.000 -
473.astar 30752.000 -
481.wrf 5933818.000 -
482.sphinx3 157067.000 -
Geometric Mean 315072.411 -
Name Current %
400.perlbench 19.000 -5.00%
400.perlbench (avg) 19.000 -5.00%
400.perlbench (avg) (percentage) 1.320 -2.22%
400.perlbench (max) 10.000 -9.09%
400.perlbench (max) (percentage) 0.700 -12.50%
400.perlbench (unexplained diff vs previous) 10.000 -16.67%
400.perlbench (unexplained diff vs previous) (percentage) 0.670 -16.25%
401.bzip2 50.000 -1.96%
401.bzip2 (avg) 50.000 -1.96%
401.bzip2 (avg) (percentage) 1.860 3.33%
401.bzip2 (max) 145.000 -15.20%
401.bzip2 (max) (percentage) 5.300 -12.54%
401.bzip2 (unexplained diff vs previous) 94.000 -41.98%
401.bzip2 (unexplained diff vs previous) (percentage) 3.430 -40.03%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.010 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.970 -1.39%
410.bwaves 55.000 1.85%
410.bwaves (avg) 55.000 1.85%
410.bwaves (avg) (percentage) 1.240 3.33%
410.bwaves (max) 105.000 20.69%
410.bwaves (max) (percentage) 2.360 23.56%
410.bwaves (unexplained diff vs previous) 108.000 -
410.bwaves (unexplained diff vs previous) (percentage) 2.420 -
416.gamess 19.000 -
416.gamess (avg) 19.000 -
416.gamess (avg) (percentage) 0.140 -
416.gamess (max) 21.000 16.67%
416.gamess (max) (percentage) 0.150 15.38%
416.gamess (unexplained diff vs previous) 22.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.150 -
429.mcf 129.000 43.33%
429.mcf (avg) 129.000 43.33%
429.mcf (avg) (percentage) 10.990 7.75%
429.mcf (max) 387.000 80.84%
429.mcf (max) (percentage) 32.810 35.97%
429.mcf (unexplained diff vs previous) 292.000 7.75%
429.mcf (unexplained diff vs previous) (percentage) 24.700 -18.88%
433.milc 9.000 -10.00%
433.milc (avg) 9.000 -10.00%
433.milc (avg) (percentage) 1.050 -5.41%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.500 -1.96%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
434.zeusmp 24.000 -
434.zeusmp (avg) 24.000 -
434.zeusmp (avg) (percentage) 1.120 -
434.zeusmp (max) 20.000 -
434.zeusmp (max) (percentage) 0.940 4.44%
434.zeusmp (unexplained diff vs previous) 21.000 5.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.950 5.56%
435.gromacs 140.000 -2.10%
435.gromacs (avg) 140.000 -2.10%
435.gromacs (avg) (percentage) 2.580 1.18%
435.gromacs (max) 230.000 -4.17%
435.gromacs (max) (percentage) 4.210 -1.41%
435.gromacs (unexplained diff vs previous) 177.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.240 -
436.cactusADM 11.000 10.00%
436.cactusADM (avg) 11.000 10.00%
436.cactusADM (avg) (percentage) 0.500 6.38%
436.cactusADM (max) 36.000 227.27%
436.cactusADM (max) (percentage) 1.560 225.00%
436.cactusADM (unexplained diff vs previous) 36.000 227.27%
436.cactusADM (unexplained diff vs previous) (percentage) 1.540 220.83%
437.leslie3d 427.000 -5.11%
437.leslie3d (avg) 427.000 -5.11%
437.leslie3d (avg) (percentage) 4.980 1.01%
437.leslie3d (max) 599.000 -8.55%
437.leslie3d (max) (percentage) 6.990 -2.51%
437.leslie3d (unexplained diff vs previous) 554.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 6.450 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.850 -
444.namd (max) 12.000 -7.69%
444.namd (max) (percentage) 1.610 -7.47%
444.namd (unexplained diff vs previous) 8.000 -
444.namd (unexplained diff vs previous) (percentage) 1.050 -
445.gobmk 48.000 -
445.gobmk (avg) 48.000 -
445.gobmk (avg) (percentage) 1.100 1.85%
445.gobmk (max) 118.000 -3.28%
445.gobmk (max) (percentage) 2.670 -1.84%
445.gobmk (unexplained diff vs previous) 67.000 17.54%
445.gobmk (unexplained diff vs previous) (percentage) 1.510 18.90%
447.dealII 19.000 -
447.dealII (avg) 19.000 -
447.dealII (avg) (percentage) 1.730 1.17%
447.dealII (max) 29.000 -6.45%
447.dealII (max) (percentage) 2.620 -7.09%
447.dealII (unexplained diff vs previous) 24.000 -22.58%
447.dealII (unexplained diff vs previous) (percentage) 2.170 -20.80%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.810 1.44%
450.soplex (max) 18.000 80.00%
450.soplex (max) (percentage) 3.660 73.46%
450.soplex (unexplained diff vs previous) 19.000 -
450.soplex (unexplained diff vs previous) (percentage) 3.800 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.400 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.370 -6.16%
453.povray (unexplained diff vs previous) 6.000 -
453.povray (unexplained diff vs previous) (percentage) 1.390 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.760 7.39%
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 5.450 4.21%
454.calculix (unexplained diff vs previous) 3.000 -
454.calculix (unexplained diff vs previous) (percentage) 5.770 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.260 -3.70%
456.hmmer (max) 13.000 -13.33%
456.hmmer (max) (percentage) 0.430 -10.42%
456.hmmer (unexplained diff vs previous) 1.000 -93.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -93.75%
458.sjeng 43.000 2.38%
458.sjeng (avg) 43.000 2.38%
458.sjeng (avg) (percentage) 0.620 3.33%
458.sjeng (max) 80.000 33.33%
458.sjeng (max) (percentage) 1.140 34.12%
458.sjeng (unexplained diff vs previous) 81.000 35.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.150 36.90%
459.GemsFDTD 74.000 -
459.GemsFDTD (avg) 74.000 -
459.GemsFDTD (avg) (percentage) 1.490 1.36%
459.GemsFDTD (max) 92.000 100.00%
459.GemsFDTD (max) (percentage) 1.850 101.09%
459.GemsFDTD (unexplained diff vs previous) 94.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.880 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.860 4.49%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.700 29.37%
462.libquantum (unexplained diff vs previous) 4.000 33.33%
462.libquantum (unexplained diff vs previous) (percentage) 3.850 38.49%
464.h264ref 34.000 3.03%
464.h264ref (avg) 34.000 3.03%
464.h264ref (avg) (percentage) 0.680 4.62%
464.h264ref (max) 53.000 65.62%
464.h264ref (max) (percentage) 1.060 68.25%
464.h264ref (unexplained diff vs previous) 54.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.070 -
465.tonto 95.000 7.95%
465.tonto (avg) 95.000 7.95%
465.tonto (avg) (percentage) 1.060 10.42%
465.tonto (max) 217.000 -4.41%
465.tonto (max) (percentage) 2.420 -2.02%
465.tonto (unexplained diff vs previous) 207.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.300 -
470.lbm 34.000 -
470.lbm (avg) 34.000 -
470.lbm (avg) (percentage) 1.040 1.96%
470.lbm (max) 60.000 1.69%
470.lbm (max) (percentage) 1.820 3.41%
470.lbm (unexplained diff vs previous) 62.000 5.08%
470.lbm (unexplained diff vs previous) (percentage) 1.860 7.51%
471.omnetpp 32.000 -
471.omnetpp (avg) 32.000 -
471.omnetpp (avg) (percentage) 1.640 5.13%
471.omnetpp (max) 68.000 38.78%
471.omnetpp (max) (percentage) 3.420 42.50%
471.omnetpp (unexplained diff vs previous) 71.000 1083.33%
471.omnetpp (unexplained diff vs previous) (percentage) 3.540 1120.69%
473.astar 85.000 -
473.astar (avg) 85.000 -
473.astar (avg) (percentage) 1.870 5.06%
473.astar (max) 213.000 -19.62%
473.astar (max) (percentage) 4.650 -15.76%
473.astar (unexplained diff vs previous) 224.000 -11.11%
473.astar (unexplained diff vs previous) (percentage) 4.880 -6.69%
481.wrf 60.000 22.45%
481.wrf (avg) 60.000 22.45%
481.wrf (avg) (percentage) 1.390 29.91%
481.wrf (max) 249.000 507.32%
481.wrf (max) (percentage) 5.750 538.89%
481.wrf (unexplained diff vs previous) 265.000 -
481.wrf (unexplained diff vs previous) (percentage) 6.100 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.380 4.85%
482.sphinx3 (max) 31.000 -3.12%
482.sphinx3 (max) (percentage) 5.050 1.41%
482.sphinx3 (unexplained diff vs previous) 33.000 6.45%
482.sphinx3 (unexplained diff vs previous) (percentage) 5.320 12.00%
Geometric Mean 8.091 -