Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2b53203690f3c6baa92b4c6007bc587c3c39844f (+ 16 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/218d17496122abe1fd831bd003f129310b32ca83 (+ 52 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4b0860d029f3cd61485d97c3620a5935b398b178 (+ 6 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3_LTO-build/202/
View Options
Report
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0202 (3-changed-components) 2024-03-13T09:18:35 0:00:00
Previous 0201 (3-changed-components) 2024-03-10T04:20:37 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T00:55:39 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 45 31
Performance Improvements 87 7
Added Tests 8 131
Unchanged Tests 1024 995
Total Tests 1164

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 3.05% 8807.000 9076.000 - 2.89% -
450.soplex 2.13% 517.000 528.000 - 2.13% -
471.omnetpp 1.54% 2077.000 2109.000 - 4.10% -
447.dealII 1.54% 1105.000 1122.000 - 14.72% -
444.namd 1.31% 764.000 774.000 - 1.04% -
453.povray 1.15% 435.000 440.000 - 0.69% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 750.00% 0.060 0.510 - 0.00% -
456.hmmer (unexplained diff vs previous) 700.00% 2.000 16.000 - 0.00% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 395.65% 0.230 1.140 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 350.00% 0.040 0.180 - 0.00% -
458.sjeng (unexplained diff vs previous) 333.33% 3.000 13.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 300.00% 8.000 32.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 289.74% 0.390 1.520 - 0.00% -
456.hmmer (max) 200.00% 5.000 15.000 - 0.00% -
456.hmmer (max) (percentage) 183.33% 0.180 0.510 - 0.00% -
447.dealII (unexplained diff vs previous) 183.33% 6.000 17.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 181.48% 0.540 1.520 - 0.00% -
400.perlbench (unexplained diff vs previous) 120.00% 5.000 11.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 117.65% 0.340 0.740 - 0.00% -
444.namd (max) 100.00% 5.000 10.000 - 0.00% -
444.namd (unexplained diff vs previous) 100.00% 5.000 10.000 - 0.00% -
471.omnetpp (max) 100.00% 16.000 32.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 100.00% 3.000 6.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 98.46% 0.650 1.290 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 97.83% 0.460 0.910 - 0.00% -
471.omnetpp (max) (percentage) 94.94% 0.790 1.540 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 94.64% 0.560 1.090 - 0.00% -
444.namd (max) (percentage) 92.65% 0.680 1.310 - 0.00% -
436.cactusADM (unexplained diff vs previous) 92.31% 13.000 25.000 - 0.00% -
436.cactusADM (max) (percentage) 91.07% 0.560 1.070 - 0.00% -
436.cactusADM (max) 84.62% 13.000 24.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 45.83% 0.240 0.350 - 0.00% -
410.bwaves (unexplained diff vs previous) 45.45% 11.000 16.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 7.77% 1.030 1.110 - 0.00% -
445.gobmk (unexplained diff vs previous) 6.38% 47.000 50.000 - 0.00% -
445.gobmk (max) (percentage) 4.81% 1.040 1.090 - 0.00% -
456.hmmer (avg) (percentage) 4.76% 0.210 0.220 - 0.00% -
436.cactusADM (avg) (percentage) 4.55% 0.440 0.460 - 0.00% -
445.gobmk (max) 4.26% 47.000 49.000 - 0.00% -
471.omnetpp 2.78% 36.000 37.000 - 0.00% -
471.omnetpp (avg) 2.78% 36.000 37.000 - 0.00% -
437.leslie3d 1.58% 505.000 513.000 - 0.00% -
437.leslie3d (avg) 1.58% 505.000 513.000 - 0.00% -
444.namd (avg) (percentage) 1.18% 0.850 0.860 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
445.gobmk -1.09% 4571.000 4521.000 - 0.94% -
436.cactusADM -1.07% 2327.000 2302.000 - -2.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -94.23% 104.000 6.000 - 0.00% -
429.mcf (max) (percentage) -93.97% 11.280 0.680 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -90.00% 0.400 0.040 - 0.00% -
434.zeusmp (unexplained diff vs previous) -88.89% 9.000 1.000 - 0.00% -
429.mcf (unexplained diff vs previous) -85.71% 7.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) -85.71% 35.000 5.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -85.53% 0.760 0.110 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -85.14% 0.740 0.110 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -83.31% 17.740 2.960 - 0.00% -
437.leslie3d (unexplained diff vs previous) -82.78% 1562.000 269.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -66.43% 2.830 0.950 - 0.00% -
435.gromacs (unexplained diff vs previous) -56.67% 90.000 39.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -56.05% 1.570 0.690 - 0.00% -
434.zeusmp (max) -55.00% 40.000 18.000 - 0.00% -
434.zeusmp (max) (percentage) -54.10% 1.830 0.840 - 0.00% -
433.milc (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -50.00% 0.220 0.110 - 0.00% -
464.h264ref (max) (percentage) -48.21% 1.120 0.580 - 0.00% -
464.h264ref (max) -48.21% 56.000 29.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -47.62% 0.630 0.330 - 0.00% -
464.h264ref (unexplained diff vs previous) -46.88% 32.000 17.000 - 0.00% -
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
470.lbm (max) -21.05% 19.000 15.000 - 0.00% -
470.lbm (max) (percentage) -17.54% 0.570 0.470 - 0.00% -
459.GemsFDTD (max) -16.22% 37.000 31.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -16.07% 0.560 0.470 - 0.00% -
470.lbm (unexplained diff vs previous) -15.79% 19.000 16.000 - 0.00% -
459.GemsFDTD (max) (percentage) -15.07% 0.730 0.620 - 0.00% -
453.povray (max) -14.29% 7.000 6.000 - 0.00% -
462.libquantum (max) (percentage) -13.74% 3.130 2.700 - 0.00% -
433.milc (max) (percentage) -11.90% 0.420 0.370 - 0.00% -
450.soplex (max) -11.76% 17.000 15.000 - 0.00% -
453.povray (max) (percentage) -11.24% 1.690 1.500 - 0.00% -
435.gromacs (max) -10.99% 91.000 81.000 - 0.00% -
450.soplex (max) (percentage) -10.88% 3.400 3.030 - 0.00% -
437.leslie3d (max) (percentage) -10.03% 15.060 13.550 - 0.00% -
435.gromacs (max) (percentage) -10.00% 1.600 1.440 - 0.00% -
482.sphinx3 (max) -7.69% 13.000 12.000 - 0.00% -
437.leslie3d (max) -7.32% 1326.000 1229.000 - 0.00% -
482.sphinx3 (max) (percentage) -6.80% 2.060 1.920 - 0.00% -
447.dealII (max) (percentage) -5.86% 2.220 2.090 - 0.00% -
473.astar (max) (percentage) -5.43% 1.840 1.740 - 0.00% -
410.bwaves (max) (percentage) -5.07% 1.380 1.310 - 0.00% -
410.bwaves (max) -4.84% 62.000 59.000 - 0.00% -
473.astar (max) -4.65% 86.000 82.000 - 0.00% -
458.sjeng (max) (percentage) -4.23% 0.710 0.680 - 0.00% -
400.perlbench -4.17% 24.000 23.000 - 0.00% -
400.perlbench (avg) -4.17% 24.000 23.000 - 0.00% -
447.dealII (max) -4.17% 24.000 23.000 - 0.00% -
458.sjeng (max) -4.00% 50.000 48.000 - 0.00% -
434.zeusmp -3.85% 26.000 25.000 - 0.00% -
434.zeusmp (avg) -3.85% 26.000 25.000 - 0.00% -
435.gromacs -3.55% 141.000 136.000 - 0.00% -
435.gromacs (avg) -3.55% 141.000 136.000 - 0.00% -
429.mcf -3.30% 91.000 88.000 - 0.00% -
429.mcf (avg) -3.30% 91.000 88.000 - 0.00% -
473.astar -3.30% 91.000 88.000 - 0.00% -
473.astar (avg) -3.30% 91.000 88.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -3.11% 1.610 1.560 - 0.00% -
464.h264ref (avg) (percentage) -2.67% 0.750 0.730 - 0.00% -
464.h264ref -2.63% 38.000 37.000 - 0.00% -
464.h264ref (avg) -2.63% 38.000 37.000 - 0.00% -
473.astar (avg) (percentage) -2.59% 1.930 1.880 - 0.00% -
401.bzip2 (avg) (percentage) -2.58% 1.940 1.890 - 0.00% -
434.zeusmp (avg) (percentage) -2.54% 1.180 1.150 - 0.00% -
429.mcf (avg) (percentage) -2.54% 9.860 9.610 - 0.00% -
433.milc (avg) (percentage) -2.52% 1.190 1.160 - 0.00% -
465.tonto (max) (percentage) -2.52% 1.190 1.160 - 0.00% -
459.GemsFDTD -2.47% 81.000 79.000 - 0.00% -
459.GemsFDTD (avg) -2.47% 81.000 79.000 - 0.00% -
435.gromacs (avg) (percentage) -2.43% 2.470 2.410 - 0.00% -
482.sphinx3 (avg) (percentage) -2.04% 2.450 2.400 - 0.00% -
401.bzip2 -1.89% 53.000 52.000 - 0.00% -
401.bzip2 (avg) -1.89% 53.000 52.000 - 0.00% -
400.perlbench (avg) (percentage) -1.85% 1.620 1.590 - 0.00% -
465.tonto (avg) (percentage) -1.82% 1.100 1.080 - 0.00% -
465.tonto (max) -1.82% 110.000 108.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -1.72% 0.580 0.570 - 0.00% -
458.sjeng (avg) (percentage) -1.61% 0.620 0.610 - 0.00% -
410.bwaves (avg) (percentage) -1.40% 1.430 1.410 - 0.00% -
437.leslie3d (avg) (percentage) -1.39% 5.740 5.660 - 0.00% -
462.libquantum (avg) (percentage) -1.33% 2.260 2.230 - 0.00% -
454.calculix (max) (percentage) -1.02% 3.910 3.870 - 0.00% -
470.lbm (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 6.86% 95053.000 101577.000 - 0.00% -
447.dealII 4.72% 460638.000 482389.000 - 0.00% -
436.cactusADM 3.51% 520390.000 538674.000 - 0.00% -
433.milc 3.07% 105180.000 108404.000 - 0.00% -
416.gamess 2.55% 8947804.000 9176269.000 - 0.00% -
444.namd 2.40% 232647.000 238226.000 - 0.00% -
410.bwaves 1.83% 22757.000 23174.000 - 0.00% -
462.libquantum 1.81% 21437.000 21825.000 - 0.00% -
473.astar 1.64% 30208.000 30704.000 - 0.00% -
429.mcf 1.55% 10087.000 10243.000 - 0.00% -
464.h264ref 1.46% 782902.000 794326.000 - 0.00% -
445.gobmk 1.14% 1706409.000 1725901.000 - 0.00% -
465.tonto 1.10% 3073566.000 3107382.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
447.dealII 14.72% 978.000 1122.000 - 1.54% -
400.perlbench 14.66% 1289.000 1478.000 - -0.74% -
458.sjeng 6.74% 6628.000 7075.000 - -0.18% -
459.GemsFDTD 5.57% 4827.000 5096.000 - 0.20% -
471.omnetpp 4.10% 2026.000 2109.000 - 1.54% -
482.sphinx3 3.94% 634.000 659.000 - 0.92% -
435.gromacs 3.44% 5488.000 5677.000 - -0.68% -
437.leslie3d 2.89% 8821.000 9076.000 - 3.05% -
473.astar 2.85% 4595.000 4726.000 - 0.11% -
465.tonto 2.63% 9078.000 9317.000 - 0.78% -
401.bzip2 2.38% 2733.000 2798.000 - 0.58% -
450.soplex 2.13% 517.000 528.000 - 2.13% -
464.h264ref 2.04% 5004.000 5106.000 - 0.33% -
416.gamess 2.00% 14028.000 14308.000 - -0.19% -
470.lbm 1.50% 3330.000 3380.000 - -0.47% -
444.namd 1.04% 766.000 774.000 - 1.31% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.71% 28.000 25.000 - 0.00% -
nb_execution_successful -10.71% 28.000 25.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.70% 325184.000 319652.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -23.89% 1214.000 924.000 - 0.11% -
462.libquantum -7.89% 114.000 105.000 - -0.94% -
456.hmmer -7.77% 3374.000 3112.000 - -0.51% -
433.milc -4.68% 940.000 896.000 - -0.11% -
436.cactusADM -2.42% 2359.000 2302.000 - -1.07% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.86% 28.000 33.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1478.000 -
401.bzip2 2798.000 -
410.bwaves 4557.000 -
416.gamess 14308.000 -
429.mcf 924.000 -
433.milc 896.000 -
434.zeusmp 2233.000 -
435.gromacs 5677.000 -
436.cactusADM 2302.000 -1.07%
437.leslie3d 9076.000 3.05%
444.namd 774.000 1.31%
445.gobmk 4521.000 -1.09%
447.dealII 1122.000 1.54%
450.soplex 528.000 2.13%
453.povray 440.000 1.15%
456.hmmer 3112.000 -
458.sjeng 7075.000 -
459.GemsFDTD 5096.000 -
462.libquantum 105.000 -
464.h264ref 5106.000 -
465.tonto 9317.000 -
470.lbm 3380.000 -
471.omnetpp 2109.000 1.54%
473.astar 4726.000 -
482.sphinx3 659.000 -
Geometric Mean 2254.600 -
Code Size (bytes)
Name Current %
400.perlbench 1257157.000 -
401.bzip2 71700.000 -
410.bwaves 23174.000 -
416.gamess 9176269.000 -
429.mcf 10243.000 -
433.milc 108404.000 -
434.zeusmp 319652.000 -
435.gromacs 738956.000 -
436.cactusADM 538674.000 -
437.leslie3d 101577.000 -
444.namd 238226.000 -
445.gobmk 1725901.000 -
447.dealII 482389.000 -
450.soplex 328729.000 -
453.povray 1084292.000 -
456.hmmer 155671.000 -
458.sjeng 153443.000 -
459.GemsFDTD 398599.000 -
462.libquantum 21825.000 -
464.h264ref 794326.000 -
465.tonto 3107382.000 -
470.lbm 11043.000 -
471.omnetpp 587699.000 -
473.astar 30704.000 -
482.sphinx3 157099.000 -
Geometric Mean 239761.838 -
sample variability
Name Current %
400.perlbench 23.000 -4.17%
400.perlbench (avg) 23.000 -4.17%
400.perlbench (avg) (percentage) 1.590 -1.85%
400.perlbench (max) 18.000 -
400.perlbench (max) (percentage) 1.240 -
400.perlbench (unexplained diff vs previous) 11.000 120.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.740 117.65%
401.bzip2 52.000 -1.89%
401.bzip2 (avg) 52.000 -1.89%
401.bzip2 (avg) (percentage) 1.890 -2.58%
401.bzip2 (max) 37.000 -
401.bzip2 (max) (percentage) 1.350 -
401.bzip2 (unexplained diff vs previous) 16.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.570 -1.72%
403.gcc (avg) (percentage) 6.060 -
403.gcc (max) (percentage) 9.390 -
410.bwaves 64.000 -
410.bwaves (avg) 64.000 -
410.bwaves (avg) (percentage) 1.410 -1.40%
410.bwaves (max) 59.000 -4.84%
410.bwaves (max) (percentage) 1.310 -5.07%
410.bwaves (unexplained diff vs previous) 16.000 45.45%
410.bwaves (unexplained diff vs previous) (percentage) 0.350 45.83%
416.gamess 21.000 -
416.gamess (avg) 21.000 -
416.gamess (avg) (percentage) 0.150 -
416.gamess (max) 30.000 -
416.gamess (max) (percentage) 0.210 -
416.gamess (unexplained diff vs previous) 27.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.190 -
429.mcf 88.000 -3.30%
429.mcf (avg) 88.000 -3.30%
429.mcf (avg) (percentage) 9.610 -2.54%
429.mcf (max) 6.000 -94.23%
429.mcf (max) (percentage) 0.680 -93.97%
429.mcf (unexplained diff vs previous) 1.000 -85.71%
429.mcf (unexplained diff vs previous) (percentage) 0.110 -85.53%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.160 -2.52%
433.milc (max) 3.000 -
433.milc (max) (percentage) 0.370 -11.90%
433.milc (unexplained diff vs previous) 1.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.110 -50.00%
434.zeusmp 25.000 -3.85%
434.zeusmp (avg) 25.000 -3.85%
434.zeusmp (avg) (percentage) 1.150 -2.54%
434.zeusmp (max) 18.000 -55.00%
434.zeusmp (max) (percentage) 0.840 -54.10%
434.zeusmp (unexplained diff vs previous) 1.000 -88.89%
434.zeusmp (unexplained diff vs previous) (percentage) 0.040 -90.00%
435.gromacs 136.000 -3.55%
435.gromacs (avg) 136.000 -3.55%
435.gromacs (avg) (percentage) 2.410 -2.43%
435.gromacs (max) 81.000 -10.99%
435.gromacs (max) (percentage) 1.440 -10.00%
435.gromacs (unexplained diff vs previous) 39.000 -56.67%
435.gromacs (unexplained diff vs previous) (percentage) 0.690 -56.05%
436.cactusADM 10.000 -
436.cactusADM (avg) 10.000 -
436.cactusADM (avg) (percentage) 0.460 4.55%
436.cactusADM (max) 24.000 84.62%
436.cactusADM (max) (percentage) 1.070 91.07%
436.cactusADM (unexplained diff vs previous) 25.000 92.31%
436.cactusADM (unexplained diff vs previous) (percentage) 1.090 94.64%
437.leslie3d 513.000 1.58%
437.leslie3d (avg) 513.000 1.58%
437.leslie3d (avg) (percentage) 5.660 -1.39%
437.leslie3d (max) 1229.000 -7.32%
437.leslie3d (max) (percentage) 13.550 -10.03%
437.leslie3d (unexplained diff vs previous) 269.000 -82.78%
437.leslie3d (unexplained diff vs previous) (percentage) 2.960 -83.31%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.860 1.18%
444.namd (max) 10.000 100.00%
444.namd (max) (percentage) 1.310 92.65%
444.namd (unexplained diff vs previous) 10.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 1.290 98.46%
445.gobmk 50.000 -
445.gobmk (avg) 50.000 -
445.gobmk (avg) (percentage) 1.110 -
445.gobmk (max) 49.000 4.26%
445.gobmk (max) (percentage) 1.090 4.81%
445.gobmk (unexplained diff vs previous) 50.000 6.38%
445.gobmk (unexplained diff vs previous) (percentage) 1.110 7.77%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 1.390 -
447.dealII (max) 23.000 -4.17%
447.dealII (max) (percentage) 2.090 -5.86%
447.dealII (unexplained diff vs previous) 17.000 183.33%
447.dealII (unexplained diff vs previous) (percentage) 1.520 181.48%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.940 -
450.soplex (max) 15.000 -11.76%
450.soplex (max) (percentage) 3.030 -10.88%
450.soplex (unexplained diff vs previous) 11.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.080 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.210 -
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.500 -11.24%
453.povray (unexplained diff vs previous) 5.000 400.00%
453.povray (unexplained diff vs previous) (percentage) 1.140 395.65%
454.calculix (avg) (percentage) 2.820 -
454.calculix (max) (percentage) 3.870 -1.02%
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.220 4.76%
456.hmmer (max) 15.000 200.00%
456.hmmer (max) (percentage) 0.510 183.33%
456.hmmer (unexplained diff vs previous) 16.000 700.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.510 750.00%
458.sjeng 43.000 -
458.sjeng (avg) 43.000 -
458.sjeng (avg) (percentage) 0.610 -1.61%
458.sjeng (max) 48.000 -4.00%
458.sjeng (max) (percentage) 0.680 -4.23%
458.sjeng (unexplained diff vs previous) 13.000 333.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.180 350.00%
459.GemsFDTD 79.000 -2.47%
459.GemsFDTD (avg) 79.000 -2.47%
459.GemsFDTD (avg) (percentage) 1.560 -3.11%
459.GemsFDTD (max) 31.000 -16.22%
459.GemsFDTD (max) (percentage) 0.620 -15.07%
459.GemsFDTD (unexplained diff vs previous) 10.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.200 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.230 -1.33%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.700 -13.74%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 0.950 -66.43%
464.h264ref 37.000 -2.63%
464.h264ref (avg) 37.000 -2.63%
464.h264ref (avg) (percentage) 0.730 -2.67%
464.h264ref (max) 29.000 -48.21%
464.h264ref (max) (percentage) 0.580 -48.21%
464.h264ref (unexplained diff vs previous) 17.000 -46.88%
464.h264ref (unexplained diff vs previous) (percentage) 0.330 -47.62%
465.tonto 100.000 -
465.tonto (avg) 100.000 -
465.tonto (avg) (percentage) 1.080 -1.82%
465.tonto (max) 108.000 -1.82%
465.tonto (max) (percentage) 1.160 -2.52%
465.tonto (unexplained diff vs previous) 72.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.770 -
470.lbm 33.000 -
470.lbm (avg) 33.000 -
470.lbm (avg) (percentage) 0.990 -1.00%
470.lbm (max) 15.000 -21.05%
470.lbm (max) (percentage) 0.470 -17.54%
470.lbm (unexplained diff vs previous) 16.000 -15.79%
470.lbm (unexplained diff vs previous) (percentage) 0.470 -16.07%
471.omnetpp 37.000 2.78%
471.omnetpp (avg) 37.000 2.78%
471.omnetpp (avg) (percentage) 1.770 -
471.omnetpp (max) 32.000 100.00%
471.omnetpp (max) (percentage) 1.540 94.94%
471.omnetpp (unexplained diff vs previous) 32.000 300.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.520 289.74%
473.astar 88.000 -3.30%
473.astar (avg) 88.000 -3.30%
473.astar (avg) (percentage) 1.880 -2.59%
473.astar (max) 82.000 -4.65%
473.astar (max) (percentage) 1.740 -5.43%
473.astar (unexplained diff vs previous) 5.000 -85.71%
473.astar (unexplained diff vs previous) (percentage) 0.110 -85.14%
481.wrf (avg) (percentage) 1.520 -
481.wrf (max) (percentage) 4.230 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 2.400 -2.04%
482.sphinx3 (max) 12.000 -7.69%
482.sphinx3 (max) (percentage) 1.920 -6.80%
482.sphinx3 (unexplained diff vs previous) 6.000 100.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.910 97.83%
Geometric Mean 5.536 -6.24%