Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3026cdbdde0e1937f811b52ba18fe3fbb1419ef9 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/69044e11ac52e93622c3d368ae2fd9ef8c3ec015 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=09b382122288e706c5fa2c0412910f71c78b7d63 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2_LTO-build/7/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0007 (basepoints/gcc-13-06968-g69044e11ac5) 2023-03-31T21:41:11 0:00:00
Previous 0006 (basepoints/gcc-13-06967-g5fe05ffefd2) 2023-03-31T05:39:25 0:00:00
Baseline 0001 (4-changed-components) 2023-03-25T19:03:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 51 3
Performance Improvements 86 9
Added Tests 43 149
Unchanged Tests 1056 1075
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 5.63% 2185.000 2308.000 - 5.58% -
403.gcc 1.82% 55.000 56.000 - 0.00% -
435.gromacs 1.43% 5327.000 5403.000 - 0.58% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) (percentage) 1330.77% 0.130 1.860 - 0.00% -
471.omnetpp (max) 892.31% 13.000 129.000 - 0.00% -
471.omnetpp (max) (percentage) 822.95% 0.610 5.630 - 0.00% -
444.namd (avg) (percentage) 706.25% 0.160 1.290 - 0.00% -
444.namd 700.00% 1.000 8.000 - 0.00% -
444.namd (avg) 700.00% 1.000 8.000 - 0.00% -
436.cactusADM (max) (percentage) 577.78% 0.270 1.830 - 0.00% -
436.cactusADM 566.67% 3.000 20.000 - 0.00% -
436.cactusADM (avg) 566.67% 3.000 20.000 - 0.00% -
436.cactusADM (max) 560.00% 5.000 33.000 - 0.00% -
471.omnetpp 558.33% 12.000 79.000 - 0.00% -
471.omnetpp (avg) 558.33% 12.000 79.000 - 0.00% -
445.gobmk (max) 520.00% 5.000 31.000 - 0.00% -
445.gobmk (max) (percentage) 518.18% 0.110 0.680 - 0.00% -
471.omnetpp (avg) (percentage) 517.86% 0.560 3.460 - 0.00% -
436.cactusADM (avg) (percentage) 442.86% 0.210 1.140 - 0.00% -
445.gobmk 340.00% 5.000 22.000 - 0.00% -
445.gobmk (avg) 340.00% 5.000 22.000 - 0.00% -
429.mcf (max) 300.00% 1.000 4.000 - 0.00% -
445.gobmk (avg) (percentage) 284.62% 0.130 0.500 - 0.00% -
470.lbm (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 233.33% 0.060 0.200 - 0.00% -
459.GemsFDTD (max) 228.57% 7.000 23.000 - 0.00% -
429.mcf (max) (percentage) 211.11% 0.090 0.280 - 0.00% -
459.GemsFDTD (max) (percentage) 205.56% 0.180 0.550 - 0.00% -
482.sphinx3 (max) 200.00% 1.000 3.000 - 0.00% -
429.mcf (avg) (percentage) 180.00% 0.050 0.140 - 0.00% -
459.GemsFDTD 100.00% 9.000 18.000 - 0.00% -
459.GemsFDTD (avg) 100.00% 9.000 18.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 100.00% 0.220 0.440 - 0.00% -
410.bwaves (avg) (percentage) 96.67% 0.300 0.590 - 0.00% -
410.bwaves 92.31% 13.000 25.000 - 0.00% -
410.bwaves (avg) 92.31% 13.000 25.000 - 0.00% -
447.dealII (max) (percentage) 67.57% 0.740 1.240 - 0.00% -
447.dealII (max) 62.50% 8.000 13.000 - 0.00% -
410.bwaves (max) (percentage) 62.00% 0.500 0.810 - 0.00% -
410.bwaves (max) 59.09% 22.000 35.000 - 0.00% -
482.sphinx3 (max) (percentage) 56.00% 0.250 0.390 - 0.00% -
464.h264ref (max) (percentage) 44.07% 0.590 0.850 - 0.00% -
464.h264ref (max) 40.00% 25.000 35.000 - 0.00% -
447.dealII (avg) (percentage) 25.84% 0.890 1.120 - 0.00% -
447.dealII 20.00% 10.000 12.000 - 0.00% -
447.dealII (avg) 20.00% 10.000 12.000 - 0.00% -
403.gcc (max) (percentage) 19.74% 1.520 1.820 - 0.00% -
482.sphinx3 (avg) (percentage) 16.67% 0.300 0.350 - 0.00% -
464.h264ref (avg) (percentage) 12.68% 0.710 0.800 - 0.00% -
464.h264ref 10.00% 30.000 33.000 - 0.00% -
464.h264ref (avg) 10.00% 30.000 33.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -6.67% 60.000 56.000 - -1.75% -
400.perlbench -1.91% 1415.000 1388.000 - -1.35% -
453.povray -1.89% 423.000 415.000 - -0.48% -
444.namd -1.86% 646.000 634.000 - 1.60% -
436.cactusADM -1.83% 1862.000 1828.000 - -1.03% -
447.dealII -1.24% 1131.000 1117.000 - 1.18% -
437.leslie3d -1.15% 8344.000 8248.000 - -2.09% -
483.xalancbmk -1.13% 2663.000 2633.000 - -1.64% -
473.astar -1.01% 4776.000 4728.000 - 0.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) -81.82% 22.000 4.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -81.71% 0.820 0.150 - 0.00% -
433.milc -60.00% 5.000 2.000 - 0.00% -
433.milc (avg) -60.00% 5.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -59.32% 118.000 48.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -58.70% 2.470 1.020 - 0.00% -
401.bzip2 (unexplained diff vs previous) -55.56% 27.000 12.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -55.10% 0.980 0.440 - 0.00% -
437.leslie3d -53.54% 1315.000 611.000 - 0.00% -
437.leslie3d (avg) -53.54% 1315.000 611.000 - 0.00% -
433.milc (avg) (percentage) -53.19% 0.470 0.220 - 0.00% -
437.leslie3d (avg) (percentage) -52.98% 15.760 7.410 - 0.00% -
450.soplex -50.00% 10.000 5.000 - 0.00% -
450.soplex (avg) -50.00% 10.000 5.000 - 0.00% -
481.wrf -46.67% 15.000 8.000 - 0.00% -
481.wrf (avg) -46.67% 15.000 8.000 - 0.00% -
450.soplex (avg) (percentage) -46.15% 1.950 1.050 - 0.00% -
481.wrf (avg) (percentage) -45.95% 0.370 0.200 - 0.00% -
462.libquantum (avg) (percentage) -40.04% 4.570 2.740 - 0.00% -
462.libquantum -33.33% 3.000 2.000 - 0.00% -
462.libquantum (avg) -33.33% 3.000 2.000 - 0.00% -
456.hmmer (avg) (percentage) -31.94% 0.720 0.490 - 0.00% -
456.hmmer -31.58% 19.000 13.000 - 0.00% -
456.hmmer (avg) -31.58% 19.000 13.000 - 0.00% -
400.perlbench -31.25% 48.000 33.000 - 0.00% -
400.perlbench (avg) -31.25% 48.000 33.000 - 0.00% -
400.perlbench (avg) (percentage) -29.33% 3.410 2.410 - 0.00% -
435.gromacs (avg) (percentage) -28.82% 2.880 2.050 - 0.00% -
435.gromacs -28.10% 153.000 110.000 - 0.00% -
435.gromacs (avg) -28.10% 153.000 110.000 - 0.00% -
401.bzip2 (max) -25.93% 27.000 20.000 - 0.00% -
401.bzip2 (max) (percentage) -25.25% 0.990 0.740 - 0.00% -
433.milc (max) -25.00% 4.000 3.000 - 0.00% -
458.sjeng -21.43% 28.000 22.000 - 0.00% -
458.sjeng (avg) -21.43% 28.000 22.000 - 0.00% -
458.sjeng (avg) (percentage) -20.45% 0.440 0.350 - 0.00% -
462.libquantum (max) -20.00% 5.000 4.000 - 0.00% -
473.astar -19.57% 92.000 74.000 - 0.00% -
473.astar (avg) -19.57% 92.000 74.000 - 0.00% -
473.astar (avg) (percentage) -19.07% 1.940 1.570 - 0.00% -
453.povray (max) -18.18% 11.000 9.000 - 0.00% -
483.xalancbmk -13.51% 37.000 32.000 - 0.00% -
483.xalancbmk (avg) -13.51% 37.000 32.000 - 0.00% -
483.xalancbmk (avg) (percentage) -13.48% 1.410 1.220 - 0.00% -
473.astar (max) -13.33% 120.000 104.000 - 0.00% -
473.astar (max) (percentage) -12.65% 2.530 2.210 - 0.00% -
400.perlbench (max) -12.50% 40.000 35.000 - 0.00% -
456.hmmer (max) (percentage) -12.35% 0.810 0.710 - 0.00% -
434.zeusmp (max) (percentage) -11.43% 0.350 0.310 - 0.00% -
416.gamess (max) -11.11% 9.000 8.000 - 0.00% -
437.leslie3d (max) -11.09% 1037.000 922.000 - 0.00% -
458.sjeng (max) (percentage) -10.87% 0.460 0.410 - 0.00% -
458.sjeng (max) -10.34% 29.000 26.000 - 0.00% -
433.milc (max) (percentage) -10.26% 0.390 0.350 - 0.00% -
462.libquantum (max) (percentage) -9.98% 6.410 5.770 - 0.00% -
437.leslie3d (max) (percentage) -9.98% 12.430 11.190 - 0.00% -
453.povray (max) (percentage) -9.92% 2.620 2.360 - 0.00% -
435.gromacs (max) (percentage) -9.88% 3.240 2.920 - 0.00% -
400.perlbench (max) (percentage) -9.86% 2.840 2.560 - 0.00% -
454.calculix (max) (percentage) -9.79% 1.430 1.290 - 0.00% -
481.wrf (max) (percentage) -9.68% 0.310 0.280 - 0.00% -
456.hmmer (max) -9.52% 21.000 19.000 - 0.00% -
470.lbm (max) (percentage) -9.30% 0.430 0.390 - 0.00% -
450.soplex (max) -9.09% 11.000 10.000 - 0.00% -
401.bzip2 (avg) (percentage) -8.77% 0.570 0.520 - 0.00% -
435.gromacs (max) -8.72% 172.000 157.000 - 0.00% -
481.wrf (max) -8.33% 12.000 11.000 - 0.00% -
470.lbm (max) -7.14% 14.000 13.000 - 0.00% -
401.bzip2 -6.67% 15.000 14.000 - 0.00% -
401.bzip2 (avg) -6.67% 15.000 14.000 - 0.00% -
450.soplex (max) (percentage) -6.48% 2.160 2.020 - 0.00% -
483.xalancbmk (max) -6.45% 31.000 29.000 - 0.00% -
470.lbm (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
483.xalancbmk (max) (percentage) -3.42% 1.170 1.130 - 0.00% -
465.tonto -2.08% 48.000 47.000 - 0.00% -
465.tonto (avg) -2.08% 48.000 47.000 - 0.00% -
465.tonto (avg) (percentage) -1.92% 0.520 0.510 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
454.calculix
454.calculix (avg)
454.calculix (max)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 5.58% 2186.000 2308.000 - 5.63% -
444.namd 1.60% 624.000 634.000 - -1.86% -
447.dealII 1.18% 1104.000 1117.000 - -1.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
453.povray -1.04% 837751.000 829031.000 - -0.98% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -3.42% 556.000 537.000 - -0.37% -
437.leslie3d -2.09% 8424.000 8248.000 - -1.15% -
454.calculix -1.75% 57.000 56.000 - -6.67% -
483.xalancbmk -1.64% 2677.000 2633.000 - -1.13% -
400.perlbench -1.35% 1407.000 1388.000 - -1.91% -
481.wrf -1.29% 4106.000 4053.000 - -0.12% -
436.cactusADM -1.03% 1847.000 1828.000 - -1.83% -
433.milc -1.01% 1084.000 1073.000 - 0.09% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1388.000 -1.91%
401.bzip2 2746.000 -
403.gcc 56.000 1.82%
410.bwaves 4384.000 -
416.gamess 10397.000 -
429.mcf 1433.000 -
433.milc 1073.000 -
434.zeusmp 1995.000 -
435.gromacs 5403.000 1.43%
436.cactusADM 1828.000 -1.83%
437.leslie3d 8248.000 -1.15%
444.namd 634.000 -1.86%
445.gobmk 4596.000 -
447.dealII 1117.000 -1.24%
450.soplex 537.000 -
453.povray 415.000 -1.89%
454.calculix 56.000 -6.67%
456.hmmer 2702.000 -
458.sjeng 6398.000 -
459.GemsFDTD 4199.000 -
462.libquantum 82.000 -
464.h264ref 4207.000 -
465.tonto 9302.000 -
470.lbm 3482.000 -
471.omnetpp 2308.000 5.63%
473.astar 4728.000 -1.01%
481.wrf 4053.000 -
482.sphinx3 775.000 -
483.xalancbmk 2633.000 -1.13%
Geometric Mean 1723.927 -
Name Current %
400.perlbench 1111817.000 -
401.bzip2 51213.000 -
403.gcc 3165936.000 -
410.bwaves 20352.000 -
416.gamess 6515925.000 -
429.mcf 9840.000 -
433.milc 71898.000 -
434.zeusmp 191769.000 -
435.gromacs 585535.000 -
436.cactusADM 427177.000 -
437.leslie3d 72288.000 -
444.namd 224161.000 -
445.gobmk 1573823.000 -
447.dealII 412228.000 -
450.soplex 275133.000 -
453.povray 829031.000 -
454.calculix 966605.000 -
456.hmmer 134029.000 -
458.sjeng 118674.000 -
459.GemsFDTD 305684.000 -
462.libquantum 20328.000 -
464.h264ref 437228.000 -
465.tonto 2323036.000 -
470.lbm 10968.000 -
471.omnetpp 594830.000 -
473.astar 27173.000 -
481.wrf 3175675.000 -
482.sphinx3 136188.000 -
483.xalancbmk 3209169.000 -
Geometric Mean 273395.359 -
Name Current %
400.perlbench 33.000 -31.25%
400.perlbench (avg) 33.000 -31.25%
400.perlbench (avg) (percentage) 2.410 -29.33%
400.perlbench (max) 35.000 -12.50%
400.perlbench (max) (percentage) 2.560 -9.86%
400.perlbench (unexplained diff vs previous) 27.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.950 -
401.bzip2 14.000 -6.67%
401.bzip2 (avg) 14.000 -6.67%
401.bzip2 (avg) (percentage) 0.520 -8.77%
401.bzip2 (max) 20.000 -25.93%
401.bzip2 (max) (percentage) 0.740 -25.25%
401.bzip2 (unexplained diff vs previous) 12.000 -55.56%
401.bzip2 (unexplained diff vs previous) (percentage) 0.440 -55.10%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.820 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 1.820 19.74%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.790 -
410.bwaves 25.000 92.31%
410.bwaves (avg) 25.000 92.31%
410.bwaves (avg) (percentage) 0.590 96.67%
410.bwaves (max) 35.000 59.09%
410.bwaves (max) (percentage) 0.810 62.00%
410.bwaves (unexplained diff vs previous) 36.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.820 -
416.gamess 11.000 -
416.gamess (avg) 11.000 -
416.gamess (avg) (percentage) 0.110 -
416.gamess (max) 8.000 -11.11%
416.gamess (max) (percentage) 0.080 -
429.mcf 2.000 -
429.mcf (avg) 2.000 -
429.mcf (avg) (percentage) 0.140 180.00%
429.mcf (max) 4.000 300.00%
429.mcf (max) (percentage) 0.280 211.11%
429.mcf (unexplained diff vs previous) 4.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.280 -
433.milc 2.000 -60.00%
433.milc (avg) 2.000 -60.00%
433.milc (avg) (percentage) 0.220 -53.19%
433.milc (max) 3.000 -25.00%
433.milc (max) (percentage) 0.350 -10.26%
433.milc (unexplained diff vs previous) 1.000 -
433.milc (unexplained diff vs previous) (percentage) 0.090 -
434.zeusmp 7.000 -
434.zeusmp (avg) 7.000 -
434.zeusmp (avg) (percentage) 0.370 -
434.zeusmp (max) 6.000 -
434.zeusmp (max) (percentage) 0.310 -11.43%
435.gromacs 110.000 -28.10%
435.gromacs (avg) 110.000 -28.10%
435.gromacs (avg) (percentage) 2.050 -28.82%
435.gromacs (max) 157.000 -8.72%
435.gromacs (max) (percentage) 2.920 -9.88%
435.gromacs (unexplained diff vs previous) 76.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.410 -
436.cactusADM 20.000 566.67%
436.cactusADM (avg) 20.000 566.67%
436.cactusADM (avg) (percentage) 1.140 442.86%
436.cactusADM (max) 33.000 560.00%
436.cactusADM (max) (percentage) 1.830 577.78%
436.cactusADM (unexplained diff vs previous) 34.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 1.860 -
437.leslie3d 611.000 -53.54%
437.leslie3d (avg) 611.000 -53.54%
437.leslie3d (avg) (percentage) 7.410 -52.98%
437.leslie3d (max) 922.000 -11.09%
437.leslie3d (max) (percentage) 11.190 -9.98%
437.leslie3d (unexplained diff vs previous) 96.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 1.160 -
444.namd 8.000 700.00%
444.namd (avg) 8.000 700.00%
444.namd (avg) (percentage) 1.290 706.25%
444.namd (max) 11.000 -
444.namd (max) (percentage) 1.860 1330.77%
444.namd (unexplained diff vs previous) 12.000 -
444.namd (unexplained diff vs previous) (percentage) 1.890 -
445.gobmk 22.000 340.00%
445.gobmk (avg) 22.000 340.00%
445.gobmk (avg) (percentage) 0.500 284.62%
445.gobmk (max) 31.000 520.00%
445.gobmk (max) (percentage) 0.680 518.18%
445.gobmk (unexplained diff vs previous) 31.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.670 -
447.dealII 12.000 20.00%
447.dealII (avg) 12.000 20.00%
447.dealII (avg) (percentage) 1.120 25.84%
447.dealII (max) 13.000 62.50%
447.dealII (max) (percentage) 1.240 67.57%
447.dealII (unexplained diff vs previous) 14.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.250 -
450.soplex 5.000 -50.00%
450.soplex (avg) 5.000 -50.00%
450.soplex (avg) (percentage) 1.050 -46.15%
450.soplex (max) 10.000 -9.09%
450.soplex (max) (percentage) 2.020 -6.48%
450.soplex (unexplained diff vs previous) 2.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.370 -
453.povray 13.000 -
453.povray (avg) 13.000 -
453.povray (avg) (percentage) 3.150 -
453.povray (max) 9.000 -18.18%
453.povray (max) (percentage) 2.360 -9.92%
454.calculix 0.000 -
454.calculix (avg) 0.000 -
454.calculix (avg) (percentage) 1.720 -
454.calculix (max) 0.000 -
454.calculix (max) (percentage) 1.290 -9.79%
456.hmmer 13.000 -31.58%
456.hmmer (avg) 13.000 -31.58%
456.hmmer (avg) (percentage) 0.490 -31.94%
456.hmmer (max) 19.000 -9.52%
456.hmmer (max) (percentage) 0.710 -12.35%
456.hmmer (unexplained diff vs previous) 4.000 -81.82%
456.hmmer (unexplained diff vs previous) (percentage) 0.150 -81.71%
458.sjeng 22.000 -21.43%
458.sjeng (avg) 22.000 -21.43%
458.sjeng (avg) (percentage) 0.350 -20.45%
458.sjeng (max) 26.000 -10.34%
458.sjeng (max) (percentage) 0.410 -10.87%
458.sjeng (unexplained diff vs previous) 18.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.280 -
459.GemsFDTD 18.000 100.00%
459.GemsFDTD (avg) 18.000 100.00%
459.GemsFDTD (avg) (percentage) 0.440 100.00%
459.GemsFDTD (max) 23.000 228.57%
459.GemsFDTD (max) (percentage) 0.550 205.56%
459.GemsFDTD (unexplained diff vs previous) 23.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.550 -
462.libquantum 2.000 -33.33%
462.libquantum (avg) 2.000 -33.33%
462.libquantum (avg) (percentage) 2.740 -40.04%
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 5.770 -9.98%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 33.000 10.00%
464.h264ref (avg) 33.000 10.00%
464.h264ref (avg) (percentage) 0.800 12.68%
464.h264ref (max) 35.000 40.00%
464.h264ref (max) (percentage) 0.850 44.07%
464.h264ref (unexplained diff vs previous) 36.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.860 -
465.tonto 47.000 -2.08%
465.tonto (avg) 47.000 -2.08%
465.tonto (avg) (percentage) 0.510 -1.92%
465.tonto (max) 46.000 -
465.tonto (max) (percentage) 0.500 -
465.tonto (unexplained diff vs previous) 46.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.490 -
470.lbm 7.000 -
470.lbm (avg) 7.000 -
470.lbm (avg) (percentage) 0.220 -4.35%
470.lbm (max) 13.000 -7.14%
470.lbm (max) (percentage) 0.390 -9.30%
470.lbm (unexplained diff vs previous) 7.000 250.00%
470.lbm (unexplained diff vs previous) (percentage) 0.200 233.33%
471.omnetpp 79.000 558.33%
471.omnetpp (avg) 79.000 558.33%
471.omnetpp (avg) (percentage) 3.460 517.86%
471.omnetpp (max) 129.000 892.31%
471.omnetpp (max) (percentage) 5.630 822.95%
471.omnetpp (unexplained diff vs previous) 123.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 5.330 -
473.astar 74.000 -19.57%
473.astar (avg) 74.000 -19.57%
473.astar (avg) (percentage) 1.570 -19.07%
473.astar (max) 104.000 -13.33%
473.astar (max) (percentage) 2.210 -12.65%
473.astar (unexplained diff vs previous) 48.000 -59.32%
473.astar (unexplained diff vs previous) (percentage) 1.020 -58.70%
481.wrf 8.000 -46.67%
481.wrf (avg) 8.000 -46.67%
481.wrf (avg) (percentage) 0.200 -45.95%
481.wrf (max) 11.000 -8.33%
481.wrf (max) (percentage) 0.280 -9.68%
481.wrf (unexplained diff vs previous) 5.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.120 -
482.sphinx3 2.000 -
482.sphinx3 (avg) 2.000 -
482.sphinx3 (avg) (percentage) 0.350 16.67%
482.sphinx3 (max) 3.000 200.00%
482.sphinx3 (max) (percentage) 0.390 56.00%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.390 -
483.xalancbmk 32.000 -13.51%
483.xalancbmk (avg) 32.000 -13.51%
483.xalancbmk (avg) (percentage) 1.220 -13.48%
483.xalancbmk (max) 29.000 -6.45%
483.xalancbmk (max) (percentage) 1.130 -3.42%
483.xalancbmk (unexplained diff vs previous) 30.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 1.140 -
Geometric Mean 3.275 28.36%