Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=bc0d0a5596224491ac6f507f758c4be106b6b5b2 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/370432688259aed1c99f9b29d8d09e534fb94037 (+ 90 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=57581acd9559217e859fdac693145ce6399f4d70 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f13102b78850c48082dca7202b8402d9dd6745b5 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/172/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0172 (basepoints/gcc-14-06031-g37043268825) 2024-03-29T11:53:34 0:00:00
Previous 0143 (3-changed-components) 2024-03-20T23:46:59 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 68 15
Performance Improvements 83 15
Added Tests 4 138
Unchanged Tests 1033 1020
Total Tests 1188

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 37.39% 904.000 1242.000 - 34.42% -
462.libquantum 2.91% 103.000 106.000 - -6.19% -
454.calculix 1.75% 57.000 58.000 - -1.69% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 11166.67% 3.000 338.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 8145.45% 0.330 27.210 0.000 0.00% 0.000
429.mcf (max) 5700.00% 8.000 464.000 - 0.00% -
429.mcf (max) (percentage) 3835.79% 0.950 37.390 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 1177.78% 0.090 1.150 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 1150.00% 2.000 25.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 550.00% 0.040 0.260 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 500.00% 2.000 12.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 351.72% 0.290 1.310 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 350.00% 8.000 36.000 0.000 0.00% 0.000
464.h264ref (max) 300.00% 11.000 44.000 - 0.00% -
464.h264ref (max) (percentage) 281.82% 0.220 0.840 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 281.82% 0.220 0.840 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) 275.00% 12.000 45.000 0.000 0.00% 0.000
401.bzip2 (max) 169.23% 13.000 35.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 161.90% 0.210 0.550 0.000 0.00% 0.000
401.bzip2 (max) (percentage) 160.00% 0.500 1.300 - 0.00% -
436.cactusADM (unexplained diff vs previous) 160.00% 5.000 13.000 0.000 0.00% 0.000
429.mcf 142.11% 19.000 46.000 - 0.00% -
429.mcf (avg) 142.11% 19.000 46.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 129.73% 0.740 1.700 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 126.92% 0.260 0.590 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 125.00% 4.000 9.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) 122.22% 9.000 20.000 0.000 0.00% 0.000
450.soplex (max) (percentage) 112.66% 0.790 1.680 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 103.12% 0.640 1.300 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 100.00% 5.000 10.000 0.000 0.00% 0.000
450.soplex (max) 100.00% 4.000 8.000 - 0.00% -
444.namd (max) (percentage) 96.92% 0.650 1.280 - 0.00% -
456.hmmer (max) (percentage) 90.32% 0.310 0.590 - 0.00% -
456.hmmer (max) 90.00% 10.000 19.000 - 0.00% -
444.namd (max) 80.00% 5.000 9.000 - 0.00% -
429.mcf (avg) (percentage) 68.64% 2.200 3.710 - 0.00% -
462.libquantum (max) 50.00% 2.000 3.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 34.92% 0.630 0.850 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) 34.78% 0.690 0.930 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 34.29% 0.350 0.470 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 0.00% 0.000
458.sjeng (max) 33.33% 24.000 32.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 33.33% 33.000 44.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 32.00% 25.000 33.000 0.000 0.00% 0.000
458.sjeng (max) (percentage) 31.43% 0.350 0.460 - 0.00% -
459.GemsFDTD (max) (percentage) 16.44% 0.730 0.850 - 0.00% -
459.GemsFDTD (max) 16.22% 37.000 43.000 - 0.00% -
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) 14.29% 0.210 0.240 - 0.00% -
464.h264ref 12.50% 16.000 18.000 - 0.00% -
464.h264ref (avg) 12.50% 16.000 18.000 - 0.00% -
464.h264ref (avg) (percentage) 9.68% 0.310 0.340 - 0.00% -
470.lbm (max) 9.52% 21.000 23.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 9.40% 8.510 9.310 0.000 0.00% 0.000
462.libquantum (avg) (percentage) 8.41% 1.070 1.160 - 0.00% -
437.leslie3d (avg) (percentage) 6.54% 3.670 3.910 - 0.00% -
444.namd (avg) (percentage) 6.38% 0.470 0.500 - 0.00% -
470.lbm 5.56% 18.000 19.000 - 0.00% -
470.lbm (avg) 5.56% 18.000 19.000 - 0.00% -
470.lbm (max) (percentage) 5.36% 0.560 0.590 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 5.36% 0.560 0.590 0.000 0.00% 0.000
458.sjeng 5.26% 19.000 20.000 - 0.00% -
458.sjeng (avg) 5.26% 19.000 20.000 - 0.00% -
470.lbm (unexplained diff vs previous) 4.55% 22.000 23.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) 2.83% 2.830 2.910 - 0.00% -
470.lbm (avg) (percentage) 2.08% 0.480 0.490 - 0.00% -
459.GemsFDTD (avg) (percentage) 1.35% 0.740 0.750 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -8.52% 11273.000 10313.000 - -0.33% -
403.gcc -7.27% 55.000 51.000 - -1.92% -
465.tonto -1.70% 9851.000 9684.000 - -2.22% -
450.soplex -1.68% 537.000 528.000 - -0.75% -
401.bzip2 -1.30% 2776.000 2740.000 - 0.44% -
444.namd -1.28% 781.000 771.000 - -0.64% -
447.dealII -1.24% 1376.000 1359.000 - -3.55% -
435.gromacs -1.20% 5752.000 5683.000 - -0.65% -
471.omnetpp -1.14% 2201.000 2176.000 - 0.23% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) -81.82% 11.000 2.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -80.95% 0.210 0.040 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -78.92% 1.850 0.390 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) -78.57% 28.000 6.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -61.54% 13.000 5.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -61.02% 1.180 0.460 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -51.43% 35.000 17.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -50.79% 2.540 1.250 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -42.00% 0.500 0.290 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -41.67% 12.000 7.000 0.000 0.00% 0.000
447.dealII (max) -26.47% 34.000 25.000 - 0.00% -
403.gcc (max) -25.00% 4.000 3.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -25.00% 92.000 69.000 0.000 0.00% 0.000
447.dealII (max) (percentage) -25.00% 2.480 1.860 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -24.38% 1.600 1.210 0.000 0.00% 0.000
434.zeusmp (max) -16.67% 12.000 10.000 - 0.00% -
473.astar (max) (percentage) -16.59% 2.170 1.810 - 0.00% -
473.astar (max) -16.50% 103.000 86.000 - 0.00% -
437.leslie3d (max) -16.22% 1048.000 878.000 - 0.00% -
434.zeusmp (max) (percentage) -16.00% 0.500 0.420 - 0.00% -
433.milc (max) -15.38% 13.000 11.000 - 0.00% -
482.sphinx3 -12.50% 8.000 7.000 - 0.00% -
482.sphinx3 (avg) -12.50% 8.000 7.000 - 0.00% -
433.milc (max) (percentage) -12.50% 1.200 1.050 - 0.00% -
435.gromacs (max) -11.11% 99.000 88.000 - 0.00% -
482.sphinx3 (max) -11.11% 9.000 8.000 - 0.00% -
400.perlbench (max) (percentage) -10.98% 2.460 2.190 - 0.00% -
400.perlbench (max) -10.81% 37.000 33.000 - 0.00% -
482.sphinx3 (max) (percentage) -10.61% 1.320 1.180 - 0.00% -
435.gromacs (max) (percentage) -9.83% 1.730 1.560 - 0.00% -
436.cactusADM (max) (percentage) -8.96% 0.670 0.610 - 0.00% -
465.tonto (max) -8.82% 68.000 62.000 - 0.00% -
437.leslie3d (max) (percentage) -8.39% 9.300 8.520 - 0.00% -
445.gobmk (max) -7.69% 26.000 24.000 - 0.00% -
465.tonto (max) (percentage) -7.14% 0.700 0.650 - 0.00% -
471.omnetpp (max) -6.94% 72.000 67.000 - 0.00% -
436.cactusADM (max) -6.67% 15.000 14.000 - 0.00% -
471.omnetpp (max) (percentage) -6.10% 3.280 3.080 - 0.00% -
447.dealII -5.88% 17.000 16.000 - 0.00% -
447.dealII (avg) -5.88% 17.000 16.000 - 0.00% -
453.povray (max) (percentage) -5.71% 1.050 0.990 - 0.00% -
473.astar -5.56% 54.000 51.000 - 0.00% -
473.astar (avg) -5.56% 54.000 51.000 - 0.00% -
445.gobmk (max) (percentage) -5.36% 0.560 0.530 - 0.00% -
482.sphinx3 (avg) (percentage) -4.59% 1.090 1.040 - 0.00% -
473.astar (avg) (percentage) -4.42% 1.130 1.080 - 0.00% -
400.perlbench -4.35% 23.000 22.000 - 0.00% -
400.perlbench (avg) -4.35% 23.000 22.000 - 0.00% -
481.wrf (max) (percentage) -3.88% 1.030 0.990 - 0.00% -
400.perlbench (avg) (percentage) -3.87% 1.550 1.490 - 0.00% -
435.gromacs -3.74% 107.000 103.000 - 0.00% -
435.gromacs (avg) -3.74% 107.000 103.000 - 0.00% -
445.gobmk -3.45% 29.000 28.000 - 0.00% -
445.gobmk (avg) -3.45% 29.000 28.000 - 0.00% -
410.bwaves (max) (percentage) -3.45% 0.580 0.560 - 0.00% -
410.bwaves (max) -3.33% 30.000 29.000 - 0.00% -
410.bwaves (avg) (percentage) -3.23% 0.620 0.600 - 0.00% -
445.gobmk (avg) (percentage) -3.17% 0.630 0.610 - 0.00% -
471.omnetpp -3.12% 32.000 31.000 - 0.00% -
471.omnetpp (avg) -3.12% 32.000 31.000 - 0.00% -
410.bwaves -3.03% 33.000 32.000 - 0.00% -
410.bwaves (avg) -3.03% 33.000 32.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -2.75% 2.910 2.830 0.000 0.00% 0.000
403.gcc (max) (percentage) -2.68% 7.470 7.270 - 0.00% -
437.leslie3d -2.42% 413.000 403.000 - 0.00% -
437.leslie3d (avg) -2.42% 413.000 403.000 - 0.00% -
435.gromacs (avg) (percentage) -2.14% 1.870 1.830 - 0.00% -
465.tonto -1.67% 60.000 59.000 - 0.00% -
465.tonto (avg) -1.67% 60.000 59.000 - 0.00% -
434.zeusmp (avg) (percentage) -1.64% 0.610 0.600 - 0.00% -
433.milc (avg) (percentage) -1.49% 0.670 0.660 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 113.33% 30.000 64.000 - 128.57% -
nb_compile_successful 85.71% 28.000 52.000 - 85.71% -
nb_execution_successful 85.71% 28.000 52.000 - 85.71% -

Added Tests - sample variability
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.98% 381188.000 392530.000 - 0.00% -
444.namd 2.50% 225019.000 230649.000 - 0.00% -
437.leslie3d 2.42% 79677.000 81609.000 - 0.00% -
459.GemsFDTD 2.27% 326542.000 333963.000 - 0.00% -
410.bwaves 2.07% 22626.000 23095.000 - 0.00% -
464.h264ref 1.79% 448678.000 456710.000 - 0.00% -
465.tonto 1.70% 2255286.000 2293594.000 - -0.01% -
401.bzip2 1.45% 48792.000 49500.000 - 0.00% -
470.lbm 1.33% 10803.000 10947.000 - 0.00% -
433.milc 1.20% 70133.000 70977.000 - 0.00% -
436.cactusADM 1.08% 409394.000 413814.000 - -0.01% -
473.astar 1.03% 23768.000 24012.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 34.42% 924.000 1242.000 - 37.39% -
400.perlbench 11.27% 1366.000 1520.000 - 0.40% -
458.sjeng 5.26% 6725.000 7079.000 - -0.46% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
403.gcc -1.35% 2947961.000 2908053.000 - -0.12% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -6.19% 113.000 106.000 - 2.91% -
447.dealII -3.55% 1409.000 1359.000 - -1.24% -
465.tonto -2.22% 9904.000 9684.000 - -1.70% -
433.milc -2.14% 1119.000 1095.000 - -0.45% -
473.astar -2.05% 4883.000 4783.000 - 0.00% -
403.gcc -1.92% 52.000 51.000 - -7.27% -
482.sphinx3 -1.71% 760.000 747.000 - 0.00% -
454.calculix -1.69% 59.000 58.000 - 1.75% -
445.gobmk -1.61% 4771.000 4694.000 - -0.25% -
410.bwaves -1.37% 5409.000 5335.000 - -0.04% -
464.h264ref -1.20% 5407.000 5342.000 - -0.84% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 128.57% 28.000 64.000 - 113.33% -
nb_compile_successful 85.71% 28.000 52.000 - 85.71% -
nb_execution_successful 85.71% 28.000 52.000 - 85.71% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1520.000 -
401.bzip2 2740.000 -1.30%
403.gcc 51.000 -7.27%
410.bwaves 5335.000 -
429.mcf 1242.000 37.39%
433.milc 1095.000 -
434.zeusmp 2397.000 -
435.gromacs 5683.000 -1.20%
436.cactusADM 2368.000 -
437.leslie3d 10313.000 -8.52%
444.namd 771.000 -1.28%
445.gobmk 4694.000 -
447.dealII 1359.000 -1.24%
450.soplex 528.000 -1.68%
453.povray 429.000 -
454.calculix 58.000 1.75%
456.hmmer 3378.000 -
458.sjeng 7079.000 -
459.GemsFDTD 5161.000 -
462.libquantum 106.000 2.91%
464.h264ref 5342.000 -
465.tonto 9684.000 -1.70%
470.lbm 3926.000 -
471.omnetpp 2176.000 -1.14%
473.astar 4783.000 -
482.sphinx3 747.000 -
Geometric Mean 1676.612 -
Name Current %
400.perlbench 1029373.000 -
401.bzip2 49500.000 -
403.gcc 2908053.000 -
410.bwaves 23095.000 -
429.mcf 9683.000 -
433.milc 70977.000 -
434.zeusmp 218524.000 -
435.gromacs 575764.000 -
436.cactusADM 413814.000 -
437.leslie3d 81609.000 -
444.namd 230649.000 -
445.gobmk 1398265.000 -
447.dealII 392530.000 -
450.soplex 245216.000 -
453.povray 784813.000 -
454.calculix 1000545.000 -
456.hmmer 126535.000 -
458.sjeng 118523.000 -
459.GemsFDTD 333963.000 -
462.libquantum 19961.000 -
464.h264ref 456710.000 -
465.tonto 2293594.000 -
470.lbm 10947.000 -
471.omnetpp 524889.000 -
473.astar 24012.000 -
482.sphinx3 129035.000 -
Geometric Mean 197019.294 -
Name Current %
nb_compile_successful 52.000 85.71%
nb_execution_successful 52.000 85.71%
nb_total_tests 64.000 113.33%
Geometric Mean 55.727 94.50%
Name Current %
400.perlbench 22.000 -4.35%
400.perlbench (avg) 22.000 -4.35%
400.perlbench (avg) (percentage) 1.490 -3.87%
400.perlbench (max) 33.000 -10.81%
400.perlbench (max) (percentage) 2.190 -10.98%
400.perlbench (unexplained diff vs previous) 6.000 -78.57%
400.perlbench (unexplained diff vs previous) (percentage) 0.390 -78.92%
401.bzip2 29.000 -
401.bzip2 (avg) 29.000 -
401.bzip2 (avg) (percentage) 1.060 -
401.bzip2 (max) 35.000 169.23%
401.bzip2 (max) (percentage) 1.300 160.00%
401.bzip2 (unexplained diff vs previous) 36.000 350.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.310 351.72%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.080 -
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 7.270 -2.68%
410.bwaves 32.000 -3.03%
410.bwaves (avg) 32.000 -3.03%
410.bwaves (avg) (percentage) 0.600 -3.23%
410.bwaves (max) 29.000 -3.33%
410.bwaves (max) (percentage) 0.560 -3.45%
410.bwaves (unexplained diff vs previous) 2.000 -81.82%
410.bwaves (unexplained diff vs previous) (percentage) 0.040 -80.95%
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) (percentage) 0.110 -
429.mcf 46.000 142.11%
429.mcf (avg) 46.000 142.11%
429.mcf (avg) (percentage) 3.710 68.64%
429.mcf (max) 464.000 5700.00%
429.mcf (max) (percentage) 37.390 3835.79%
429.mcf (unexplained diff vs previous) 338.000 11166.67%
429.mcf (unexplained diff vs previous) (percentage) 27.210 8145.45%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.660 -1.49%
433.milc (max) 11.000 -15.38%
433.milc (max) (percentage) 1.050 -12.50%
433.milc (unexplained diff vs previous) 5.000 -61.54%
433.milc (unexplained diff vs previous) (percentage) 0.460 -61.02%
434.zeusmp 14.000 -
434.zeusmp (avg) 14.000 -
434.zeusmp (avg) (percentage) 0.600 -1.64%
434.zeusmp (max) 10.000 -16.67%
434.zeusmp (max) (percentage) 0.420 -16.00%
434.zeusmp (unexplained diff vs previous) 7.000 -41.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.290 -42.00%
435.gromacs 103.000 -3.74%
435.gromacs (avg) 103.000 -3.74%
435.gromacs (avg) (percentage) 1.830 -2.14%
435.gromacs (max) 88.000 -11.11%
435.gromacs (max) (percentage) 1.560 -9.83%
435.gromacs (unexplained diff vs previous) 69.000 -25.00%
435.gromacs (unexplained diff vs previous) (percentage) 1.210 -24.38%
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.530 -
436.cactusADM (max) 14.000 -6.67%
436.cactusADM (max) (percentage) 0.610 -8.96%
436.cactusADM (unexplained diff vs previous) 13.000 160.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.550 161.90%
437.leslie3d 403.000 -2.42%
437.leslie3d (avg) 403.000 -2.42%
437.leslie3d (avg) (percentage) 3.910 6.54%
437.leslie3d (max) 878.000 -16.22%
437.leslie3d (max) (percentage) 8.520 -8.39%
437.leslie3d (unexplained diff vs previous) 960.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 9.310 9.40%
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.500 6.38%
444.namd (max) 9.000 80.00%
444.namd (max) (percentage) 1.280 96.92%
444.namd (unexplained diff vs previous) 10.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 1.300 103.12%
445.gobmk 28.000 -3.45%
445.gobmk (avg) 28.000 -3.45%
445.gobmk (avg) (percentage) 0.610 -3.17%
445.gobmk (max) 24.000 -7.69%
445.gobmk (max) (percentage) 0.530 -5.36%
445.gobmk (unexplained diff vs previous) 12.000 500.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.260 550.00%
447.dealII 16.000 -5.88%
447.dealII (avg) 16.000 -5.88%
447.dealII (avg) (percentage) 1.240 -
447.dealII (max) 25.000 -26.47%
447.dealII (max) (percentage) 1.860 -25.00%
447.dealII (unexplained diff vs previous) 17.000 -51.43%
447.dealII (unexplained diff vs previous) (percentage) 1.250 -50.79%
450.soplex 9.000 -
450.soplex (avg) 9.000 -
450.soplex (avg) (percentage) 1.710 -
450.soplex (max) 8.000 100.00%
450.soplex (max) (percentage) 1.680 112.66%
450.soplex (unexplained diff vs previous) 9.000 125.00%
450.soplex (unexplained diff vs previous) (percentage) 1.700 129.73%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.980 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.990 -5.71%
453.povray (unexplained diff vs previous) 4.000 33.33%
453.povray (unexplained diff vs previous) (percentage) 0.930 34.78%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.640 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.720 -
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.240 14.29%
456.hmmer (max) 19.000 90.00%
456.hmmer (max) (percentage) 0.590 90.32%
456.hmmer (unexplained diff vs previous) 20.000 122.22%
456.hmmer (unexplained diff vs previous) (percentage) 0.590 126.92%
458.sjeng 20.000 5.26%
458.sjeng (avg) 20.000 5.26%
458.sjeng (avg) (percentage) 0.290 -
458.sjeng (max) 32.000 33.33%
458.sjeng (max) (percentage) 0.460 31.43%
458.sjeng (unexplained diff vs previous) 33.000 32.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.470 34.29%
459.GemsFDTD 38.000 -
459.GemsFDTD (avg) 38.000 -
459.GemsFDTD (avg) (percentage) 0.750 1.35%
459.GemsFDTD (max) 43.000 16.22%
459.GemsFDTD (max) (percentage) 0.850 16.44%
459.GemsFDTD (unexplained diff vs previous) 44.000 33.33%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.850 34.92%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.160 8.41%
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 2.910 2.83%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.830 -2.75%
464.h264ref 18.000 12.50%
464.h264ref (avg) 18.000 12.50%
464.h264ref (avg) (percentage) 0.340 9.68%
464.h264ref (max) 44.000 300.00%
464.h264ref (max) (percentage) 0.840 281.82%
464.h264ref (unexplained diff vs previous) 45.000 275.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.840 281.82%
465.tonto 59.000 -1.67%
465.tonto (avg) 59.000 -1.67%
465.tonto (avg) (percentage) 0.610 -
465.tonto (max) 62.000 -8.82%
465.tonto (max) (percentage) 0.650 -7.14%
470.lbm 19.000 5.56%
470.lbm (avg) 19.000 5.56%
470.lbm (avg) (percentage) 0.490 2.08%
470.lbm (max) 23.000 9.52%
470.lbm (max) (percentage) 0.590 5.36%
470.lbm (unexplained diff vs previous) 23.000 4.55%
470.lbm (unexplained diff vs previous) (percentage) 0.590 5.36%
471.omnetpp 31.000 -3.12%
471.omnetpp (avg) 31.000 -3.12%
471.omnetpp (avg) (percentage) 1.450 -
471.omnetpp (max) 67.000 -6.94%
471.omnetpp (max) (percentage) 3.080 -6.10%
471.omnetpp (unexplained diff vs previous) 25.000 1150.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.150 1177.78%
473.astar 51.000 -5.56%
473.astar (avg) 51.000 -5.56%
473.astar (avg) (percentage) 1.080 -4.42%
473.astar (max) 86.000 -16.50%
473.astar (max) (percentage) 1.810 -16.59%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf (avg) (percentage) 1.060 -
481.wrf (max) (percentage) 0.990 -3.88%
482.sphinx3 7.000 -12.50%
482.sphinx3 (avg) 7.000 -12.50%
482.sphinx3 (avg) (percentage) 1.040 -4.59%
482.sphinx3 (max) 8.000 -11.11%
482.sphinx3 (max) (percentage) 1.180 -10.61%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
Geometric Mean 4.081 -3.05%