Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=abee4501ebe519270ad52a436ad1fc8229e963bc (+ 40 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6bf80413deb5c1eacbefd685e106c6351b75ecf2 (+ 76 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9e2ff880f3cbc0b4ec8505ad2ce4a1c92d7f6d56 (+ 2 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b30cc06d289046dd2fdea5a56930d52b76c89bda (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/4/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0004 (3-changed-components) 2023-03-14T10:12:16 0:00:00
Previous 0003 (4-changed-components) 2023-03-11T20:01:31 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 29 4
Performance Improvements 144 4
Added Tests 12 147
Unchanged Tests 1051 1081
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 4.35% 46.000 48.000 - -2.04% -
447.dealII 1.43% 978.000 992.000 - -0.40% -
481.wrf 1.31% 2983.000 3022.000 - 0.77% -
462.libquantum 1.30% 77.000 78.000 - -2.50% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) 162.50% 8.000 21.000 - 0.00% -
416.gamess (max) 150.00% 8.000 20.000 - 0.00% -
416.gamess (max) (percentage) 150.00% 0.080 0.200 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 150.00% 0.080 0.200 - 0.00% -
454.calculix 100.00% 1.000 2.000 - 0.00% -
454.calculix (avg) 100.00% 1.000 2.000 - 0.00% -
454.calculix (max) 100.00% 1.000 2.000 - 0.00% -
416.gamess 87.50% 8.000 15.000 - 0.00% -
416.gamess (avg) 87.50% 8.000 15.000 - 0.00% -
416.gamess (avg) (percentage) 87.50% 0.080 0.150 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 31.13% 6.520 8.550 - 0.00% -
437.leslie3d (avg) (percentage) 22.96% 5.400 6.640 - 0.00% -
437.leslie3d (unexplained diff vs previous) 20.83% 480.000 580.000 - 0.00% -
456.hmmer (max) 20.00% 5.000 6.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
456.hmmer (max) (percentage) 19.23% 0.260 0.310 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 19.23% 0.260 0.310 - 0.00% -
437.leslie3d 13.35% 397.000 450.000 - 0.00% -
437.leslie3d (avg) 13.35% 397.000 450.000 - 0.00% -
437.leslie3d (max) (percentage) 12.89% 6.980 7.880 - 0.00% -
456.hmmer (avg) (percentage) 11.54% 0.260 0.290 - 0.00% -
454.calculix (max) (percentage) 4.32% 4.170 4.350 - 0.00% -
437.leslie3d (max) 4.09% 513.000 534.000 - 0.00% -
454.calculix (avg) (percentage) 2.64% 4.170 4.280 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 1.56% 0.640 0.650 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.88% 7360.000 6780.000 - 0.74% -
403.gcc -5.88% 51.000 48.000 - 0.00% -
450.soplex -2.15% 511.000 500.000 - 1.42% -
433.milc -1.18% 932.000 921.000 - -1.18% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -98.82% 6.780 0.080 - 0.00% -
410.bwaves (unexplained diff vs previous) -98.79% 165.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.79% 247.000 3.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -98.78% 4.100 0.050 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -93.12% 2.470 0.170 - 0.00% -
473.astar (unexplained diff vs previous) -92.92% 113.000 8.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -91.13% 4.960 0.440 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -91.11% 225.000 20.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -88.99% 3.360 0.370 - 0.00% -
436.cactusADM (unexplained diff vs previous) -88.89% 54.000 6.000 - 0.00% -
429.mcf (unexplained diff vs previous) -87.50% 120.000 15.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -87.44% 6.770 0.850 - 0.00% -
401.bzip2 (unexplained diff vs previous) -86.89% 61.000 8.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -86.70% 2.330 0.310 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -86.46% 2.880 0.390 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -86.36% 22.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -84.93% 73.000 11.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -84.80% 7.830 1.190 - 0.00% -
453.povray (unexplained diff vs previous) -80.00% 5.000 1.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -79.84% 1.290 0.260 - 0.00% -
458.sjeng (unexplained diff vs previous) -78.43% 51.000 11.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -78.31% 0.830 0.180 - 0.00% -
434.zeusmp (unexplained diff vs previous) -73.77% 61.000 16.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -73.60% 3.560 0.940 - 0.00% -
450.soplex (unexplained diff vs previous) -66.67% 33.000 11.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.04% 0.530 0.180 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -65.94% 6.460 2.200 - 0.00% -
445.gobmk (unexplained diff vs previous) -65.22% 23.000 8.000 - 0.00% -
464.h264ref -61.54% 26.000 10.000 - 0.00% -
464.h264ref (avg) -61.54% 26.000 10.000 - 0.00% -
453.povray -60.00% 5.000 2.000 - 0.00% -
453.povray (avg) -60.00% 5.000 2.000 - 0.00% -
464.h264ref (avg) (percentage) -59.70% 0.670 0.270 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -58.65% 3.120 1.290 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -58.16% 3.370 1.410 - 0.00% -
481.wrf (unexplained diff vs previous) -58.06% 93.000 39.000 - 0.00% -
447.dealII (unexplained diff vs previous) -57.58% 33.000 14.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -54.98% 5.220 2.350 - 0.00% -
459.GemsFDTD -54.66% 236.000 107.000 - 0.00% -
459.GemsFDTD (avg) -54.66% 236.000 107.000 - 0.00% -
482.sphinx3 -54.55% 22.000 10.000 - 0.00% -
482.sphinx3 (avg) -54.55% 22.000 10.000 - 0.00% -
429.mcf -52.68% 112.000 53.000 - 0.00% -
429.mcf (avg) -52.68% 112.000 53.000 - 0.00% -
401.bzip2 -52.54% 59.000 28.000 - 0.00% -
401.bzip2 (avg) -52.54% 59.000 28.000 - 0.00% -
482.sphinx3 (avg) (percentage) -52.19% 2.970 1.420 - 0.00% -
429.mcf (avg) (percentage) -51.89% 6.340 3.050 - 0.00% -
401.bzip2 (avg) (percentage) -51.75% 2.280 1.100 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -50.77% 2.600 1.280 - 0.00% -
433.milc -50.75% 67.000 33.000 - 0.00% -
433.milc (avg) -50.75% 67.000 33.000 - 0.00% -
433.milc (avg) (percentage) -50.28% 7.260 3.610 - 0.00% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
410.bwaves -49.70% 165.000 83.000 - 0.00% -
410.bwaves (avg) -49.70% 165.000 83.000 - 0.00% -
410.bwaves (avg) (percentage) -49.51% 4.100 2.070 - 0.00% -
470.lbm (avg) (percentage) -49.44% 7.120 3.600 - 0.00% -
470.lbm -49.42% 259.000 131.000 - 0.00% -
470.lbm (avg) -49.42% 259.000 131.000 - 0.00% -
458.sjeng -49.02% 51.000 26.000 - 0.00% -
458.sjeng (avg) -49.02% 51.000 26.000 - 0.00% -
453.povray (avg) (percentage) -48.09% 1.310 0.680 - 0.00% -
458.sjeng (avg) (percentage) -47.62% 0.840 0.440 - 0.00% -
473.astar -47.01% 117.000 62.000 - 0.00% -
473.astar (avg) -47.01% 117.000 62.000 - 0.00% -
473.astar (avg) (percentage) -46.69% 2.570 1.370 - 0.00% -
434.zeusmp -44.83% 58.000 32.000 - 0.00% -
434.zeusmp (avg) -44.83% 58.000 32.000 - 0.00% -
434.zeusmp (avg) (percentage) -43.90% 3.440 1.930 - 0.00% -
436.cactusADM (avg) (percentage) -43.85% 3.010 1.690 - 0.00% -
436.cactusADM -43.75% 48.000 27.000 - 0.00% -
436.cactusADM (avg) -43.75% 48.000 27.000 - 0.00% -
445.gobmk -40.91% 22.000 13.000 - 0.00% -
445.gobmk (avg) -40.91% 22.000 13.000 - 0.00% -
445.gobmk (avg) (percentage) -38.46% 0.520 0.320 - 0.00% -
450.soplex -36.84% 38.000 24.000 - 0.00% -
450.soplex (avg) -36.84% 38.000 24.000 - 0.00% -
481.wrf (avg) (percentage) -35.71% 3.220 2.070 - 0.00% -
450.soplex (avg) (percentage) -35.65% 7.490 4.820 - 0.00% -
481.wrf -35.42% 96.000 62.000 - 0.00% -
481.wrf (avg) -35.42% 96.000 62.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -33.83% 1.330 0.880 - 0.00% -
447.dealII (avg) (percentage) -33.74% 3.260 2.160 - 0.00% -
400.perlbench (unexplained diff vs previous) -33.33% 18.000 12.000 - 0.00% -
447.dealII -32.26% 31.000 21.000 - 0.00% -
447.dealII (avg) -32.26% 31.000 21.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -30.00% 1.000 0.700 - 0.00% -
435.gromacs (unexplained diff vs previous) -30.00% 50.000 35.000 - 0.00% -
453.povray (max) -20.00% 5.000 4.000 - 0.00% -
483.xalancbmk (max) -19.35% 31.000 25.000 - 0.00% -
464.h264ref (max) -19.23% 26.000 21.000 - 0.00% -
400.perlbench (avg) (percentage) -19.08% 1.310 1.060 - 0.00% -
462.libquantum (avg) (percentage) -19.05% 2.100 1.700 - 0.00% -
435.gromacs (avg) (percentage) -18.81% 1.010 0.820 - 0.00% -
445.gobmk (max) -18.18% 22.000 18.000 - 0.00% -
482.sphinx3 (max) -18.18% 22.000 18.000 - 0.00% -
435.gromacs -18.00% 50.000 41.000 - 0.00% -
435.gromacs (avg) -18.00% 50.000 41.000 - 0.00% -
433.milc (max) -17.91% 67.000 55.000 - 0.00% -
429.mcf (max) -17.86% 112.000 92.000 - 0.00% -
400.perlbench -17.65% 17.000 14.000 - 0.00% -
400.perlbench (avg) -17.65% 17.000 14.000 - 0.00% -
400.perlbench (max) -17.65% 17.000 14.000 - 0.00% -
458.sjeng (max) -17.65% 51.000 42.000 - 0.00% -
445.gobmk (max) (percentage) -17.31% 0.520 0.430 - 0.00% -
436.cactusADM (max) -17.31% 52.000 43.000 - 0.00% -
434.zeusmp (max) -17.24% 58.000 48.000 - 0.00% -
401.bzip2 (max) -16.95% 59.000 49.000 - 0.00% -
482.sphinx3 (max) (percentage) -16.84% 2.970 2.470 - 0.00% -
435.gromacs (max) (percentage) -16.83% 1.010 0.840 - 0.00% -
483.xalancbmk (max) (percentage) -16.81% 1.130 0.940 - 0.00% -
400.perlbench (max) (percentage) -16.79% 1.310 1.090 - 0.00% -
453.povray (max) (percentage) -16.79% 1.310 1.090 - 0.00% -
481.wrf (max) (percentage) -16.77% 3.220 2.680 - 0.00% -
410.bwaves (max) (percentage) -16.75% 3.940 3.280 - 0.00% -
429.mcf (max) (percentage) -16.72% 6.340 5.280 - 0.00% -
458.sjeng (max) (percentage) -16.67% 0.840 0.700 - 0.00% -
459.GemsFDTD (max) (percentage) -16.67% 5.220 4.350 - 0.00% -
433.milc (max) (percentage) -16.67% 7.260 6.050 - 0.00% -
470.lbm (max) -16.67% 264.000 220.000 - 0.00% -
481.wrf (max) -16.67% 96.000 80.000 - 0.00% -
401.bzip2 (max) (percentage) -16.67% 2.280 1.900 - 0.00% -
470.lbm (max) (percentage) -16.64% 7.270 6.060 - 0.00% -
436.cactusADM (max) (percentage) -16.62% 3.250 2.710 - 0.00% -
462.libquantum (max) (percentage) -16.60% 2.530 2.110 - 0.00% -
473.astar (max) (percentage) -16.60% 2.530 2.110 - 0.00% -
434.zeusmp (max) (percentage) -16.57% 3.440 2.870 - 0.00% -
447.dealII (max) (percentage) -16.56% 3.260 2.720 - 0.00% -
473.astar (max) -16.52% 115.000 96.000 - 0.00% -
410.bwaves (max) -16.46% 158.000 132.000 - 0.00% -
464.h264ref (max) (percentage) -16.42% 0.670 0.560 - 0.00% -
447.dealII (max) -16.13% 31.000 26.000 - 0.00% -
459.GemsFDTD (max) -16.10% 236.000 198.000 - 0.00% -
435.gromacs (max) -16.00% 50.000 42.000 - 0.00% -
450.soplex (max) -12.82% 39.000 34.000 - 0.00% -
471.omnetpp (max) -12.50% 8.000 7.000 - 0.00% -
471.omnetpp (max) (percentage) -11.36% 0.440 0.390 - 0.00% -
450.soplex (max) (percentage) -11.21% 7.760 6.890 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -4.14% 4.350 4.170 - 0.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 2.64% 153776.000 157840.000 - 0.00% -
444.namd 1.66% 235533.000 239453.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
453.povray 2.93% 375.000 386.000 - -0.26% -
450.soplex 1.42% 493.000 500.000 - -2.15% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -2.50% 80.000 78.000 - 1.30% -
454.calculix -2.04% 49.000 48.000 - 4.35% -
429.mcf -1.79% 1790.000 1758.000 - -0.85% -
433.milc -1.18% 932.000 921.000 - -1.18% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1363.000 -
401.bzip2 2606.000 -
403.gcc 48.000 -5.88%
410.bwaves 4026.000 -
416.gamess 10426.000 -
429.mcf 1758.000 -
433.milc 921.000 -1.18%
434.zeusmp 1697.000 -
435.gromacs 5025.000 -
436.cactusADM 1614.000 -
437.leslie3d 6780.000 -7.88%
444.namd 619.000 -
445.gobmk 4367.000 -
447.dealII 992.000 1.43%
450.soplex 500.000 -2.15%
453.povray 386.000 -
454.calculix 48.000 4.35%
456.hmmer 1946.000 -
458.sjeng 6123.000 -
459.GemsFDTD 4555.000 -
462.libquantum 78.000 1.30%
464.h264ref 3917.000 -
465.tonto 8684.000 -
470.lbm 3646.000 -
471.omnetpp 2042.000 -
473.astar 4586.000 -
481.wrf 3022.000 1.31%
482.sphinx3 766.000 -
483.xalancbmk 2745.000 -
Geometric Mean 1600.556 -
Name Current %
400.perlbench 1324165.000 -
401.bzip2 72953.000 -
403.gcc 3929992.000 -
410.bwaves 26143.000 -
416.gamess 8078657.000 -
429.mcf 10100.000 -
433.milc 93945.000 -
434.zeusmp 296597.000 -
435.gromacs 736559.000 -
436.cactusADM 528481.000 -
437.leslie3d 100088.000 -
444.namd 239453.000 -
445.gobmk 1882255.000 -
447.dealII 480882.000 -
450.soplex 326173.000 -
453.povray 1083450.000 -
454.calculix 1148449.000 -
456.hmmer 165317.000 -
458.sjeng 156466.000 -
459.GemsFDTD 376572.000 -
462.libquantum 22168.000 -
464.h264ref 698904.000 -
465.tonto 2786793.000 -
470.lbm 11256.000 -
471.omnetpp 652774.000 -
473.astar 31105.000 -
481.wrf 3968443.000 -
482.sphinx3 157840.000 -
483.xalancbmk 3494206.000 -
Geometric Mean 334602.739 -
Name Current %
400.perlbench 14.000 -17.65%
400.perlbench (avg) 14.000 -17.65%
400.perlbench (avg) (percentage) 1.060 -19.08%
400.perlbench (max) 14.000 -17.65%
400.perlbench (max) (percentage) 1.090 -16.79%
400.perlbench (unexplained diff vs previous) 12.000 -33.33%
400.perlbench (unexplained diff vs previous) (percentage) 0.880 -33.83%
401.bzip2 28.000 -52.54%
401.bzip2 (avg) 28.000 -52.54%
401.bzip2 (avg) (percentage) 1.100 -51.75%
401.bzip2 (max) 49.000 -16.95%
401.bzip2 (max) (percentage) 1.900 -16.67%
401.bzip2 (unexplained diff vs previous) 8.000 -86.89%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 -86.70%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.000 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
410.bwaves 83.000 -49.70%
410.bwaves (avg) 83.000 -49.70%
410.bwaves (avg) (percentage) 2.070 -49.51%
410.bwaves (max) 132.000 -16.46%
410.bwaves (max) (percentage) 3.280 -16.75%
410.bwaves (unexplained diff vs previous) 2.000 -98.79%
410.bwaves (unexplained diff vs previous) (percentage) 0.050 -98.78%
416.gamess 15.000 87.50%
416.gamess (avg) 15.000 87.50%
416.gamess (avg) (percentage) 0.150 87.50%
416.gamess (max) 20.000 150.00%
416.gamess (max) (percentage) 0.200 150.00%
416.gamess (unexplained diff vs previous) 21.000 162.50%
416.gamess (unexplained diff vs previous) (percentage) 0.200 150.00%
429.mcf 53.000 -52.68%
429.mcf (avg) 53.000 -52.68%
429.mcf (avg) (percentage) 3.050 -51.89%
429.mcf (max) 92.000 -17.86%
429.mcf (max) (percentage) 5.280 -16.72%
429.mcf (unexplained diff vs previous) 15.000 -87.50%
429.mcf (unexplained diff vs previous) (percentage) 0.850 -87.44%
433.milc 33.000 -50.75%
433.milc (avg) 33.000 -50.75%
433.milc (avg) (percentage) 3.610 -50.28%
433.milc (max) 55.000 -17.91%
433.milc (max) (percentage) 6.050 -16.67%
433.milc (unexplained diff vs previous) 11.000 -84.93%
433.milc (unexplained diff vs previous) (percentage) 1.190 -84.80%
434.zeusmp 32.000 -44.83%
434.zeusmp (avg) 32.000 -44.83%
434.zeusmp (avg) (percentage) 1.930 -43.90%
434.zeusmp (max) 48.000 -17.24%
434.zeusmp (max) (percentage) 2.870 -16.57%
434.zeusmp (unexplained diff vs previous) 16.000 -73.77%
434.zeusmp (unexplained diff vs previous) (percentage) 0.940 -73.60%
435.gromacs 41.000 -18.00%
435.gromacs (avg) 41.000 -18.00%
435.gromacs (avg) (percentage) 0.820 -18.81%
435.gromacs (max) 42.000 -16.00%
435.gromacs (max) (percentage) 0.840 -16.83%
435.gromacs (unexplained diff vs previous) 35.000 -30.00%
435.gromacs (unexplained diff vs previous) (percentage) 0.700 -30.00%
436.cactusADM 27.000 -43.75%
436.cactusADM (avg) 27.000 -43.75%
436.cactusADM (avg) (percentage) 1.690 -43.85%
436.cactusADM (max) 43.000 -17.31%
436.cactusADM (max) (percentage) 2.710 -16.62%
436.cactusADM (unexplained diff vs previous) 6.000 -88.89%
436.cactusADM (unexplained diff vs previous) (percentage) 0.370 -88.99%
437.leslie3d 450.000 13.35%
437.leslie3d (avg) 450.000 13.35%
437.leslie3d (avg) (percentage) 6.640 22.96%
437.leslie3d (max) 534.000 4.09%
437.leslie3d (max) (percentage) 7.880 12.89%
437.leslie3d (unexplained diff vs previous) 580.000 20.83%
437.leslie3d (unexplained diff vs previous) (percentage) 8.550 31.13%
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.640 -
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.640 -
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.650 1.56%
445.gobmk 13.000 -40.91%
445.gobmk (avg) 13.000 -40.91%
445.gobmk (avg) (percentage) 0.320 -38.46%
445.gobmk (max) 18.000 -18.18%
445.gobmk (max) (percentage) 0.430 -17.31%
445.gobmk (unexplained diff vs previous) 8.000 -65.22%
445.gobmk (unexplained diff vs previous) (percentage) 0.180 -66.04%
447.dealII 21.000 -32.26%
447.dealII (avg) 21.000 -32.26%
447.dealII (avg) (percentage) 2.160 -33.74%
447.dealII (max) 26.000 -16.13%
447.dealII (max) (percentage) 2.720 -16.56%
447.dealII (unexplained diff vs previous) 14.000 -57.58%
447.dealII (unexplained diff vs previous) (percentage) 1.410 -58.16%
450.soplex 24.000 -36.84%
450.soplex (avg) 24.000 -36.84%
450.soplex (avg) (percentage) 4.820 -35.65%
450.soplex (max) 34.000 -12.82%
450.soplex (max) (percentage) 6.890 -11.21%
450.soplex (unexplained diff vs previous) 11.000 -66.67%
450.soplex (unexplained diff vs previous) (percentage) 2.200 -65.94%
453.povray 2.000 -60.00%
453.povray (avg) 2.000 -60.00%
453.povray (avg) (percentage) 0.680 -48.09%
453.povray (max) 4.000 -20.00%
453.povray (max) (percentage) 1.090 -16.79%
453.povray (unexplained diff vs previous) 1.000 -80.00%
453.povray (unexplained diff vs previous) (percentage) 0.260 -79.84%
454.calculix 2.000 100.00%
454.calculix (avg) 2.000 100.00%
454.calculix (avg) (percentage) 4.280 2.64%
454.calculix (max) 2.000 100.00%
454.calculix (max) (percentage) 4.350 4.32%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 4.170 -4.14%
456.hmmer 5.000 -
456.hmmer (avg) 5.000 -
456.hmmer (avg) (percentage) 0.290 11.54%
456.hmmer (max) 6.000 20.00%
456.hmmer (max) (percentage) 0.310 19.23%
456.hmmer (unexplained diff vs previous) 6.000 20.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 19.23%
458.sjeng 26.000 -49.02%
458.sjeng (avg) 26.000 -49.02%
458.sjeng (avg) (percentage) 0.440 -47.62%
458.sjeng (max) 42.000 -17.65%
458.sjeng (max) (percentage) 0.700 -16.67%
458.sjeng (unexplained diff vs previous) 11.000 -78.43%
458.sjeng (unexplained diff vs previous) (percentage) 0.180 -78.31%
459.GemsFDTD 107.000 -54.66%
459.GemsFDTD (avg) 107.000 -54.66%
459.GemsFDTD (avg) (percentage) 2.350 -54.98%
459.GemsFDTD (max) 198.000 -16.10%
459.GemsFDTD (max) (percentage) 4.350 -16.67%
459.GemsFDTD (unexplained diff vs previous) 20.000 -91.11%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.440 -91.13%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.700 -19.05%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 2.110 -16.60%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.280 -50.77%
464.h264ref 10.000 -61.54%
464.h264ref (avg) 10.000 -61.54%
464.h264ref (avg) (percentage) 0.270 -59.70%
464.h264ref (max) 21.000 -19.23%
464.h264ref (max) (percentage) 0.560 -16.42%
464.h264ref (unexplained diff vs previous) 0.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.000 -
465.tonto 1.000 -
465.tonto (avg) 1.000 -
465.tonto (avg) (percentage) 0.020 -
465.tonto (max) 1.000 -
465.tonto (max) (percentage) 0.020 -
465.tonto (unexplained diff vs previous) 2.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.020 -
470.lbm 131.000 -49.42%
470.lbm (avg) 131.000 -49.42%
470.lbm (avg) (percentage) 3.600 -49.44%
470.lbm (max) 220.000 -16.67%
470.lbm (max) (percentage) 6.060 -16.64%
470.lbm (unexplained diff vs previous) 3.000 -98.79%
470.lbm (unexplained diff vs previous) (percentage) 0.080 -98.82%
471.omnetpp 9.000 -
471.omnetpp (avg) 9.000 -
471.omnetpp (avg) (percentage) 0.450 -
471.omnetpp (max) 7.000 -12.50%
471.omnetpp (max) (percentage) 0.390 -11.36%
473.astar 62.000 -47.01%
473.astar (avg) 62.000 -47.01%
473.astar (avg) (percentage) 1.370 -46.69%
473.astar (max) 96.000 -16.52%
473.astar (max) (percentage) 2.110 -16.60%
473.astar (unexplained diff vs previous) 8.000 -92.92%
473.astar (unexplained diff vs previous) (percentage) 0.170 -93.12%
481.wrf 62.000 -35.42%
481.wrf (avg) 62.000 -35.42%
481.wrf (avg) (percentage) 2.070 -35.71%
481.wrf (max) 80.000 -16.67%
481.wrf (max) (percentage) 2.680 -16.77%
481.wrf (unexplained diff vs previous) 39.000 -58.06%
481.wrf (unexplained diff vs previous) (percentage) 1.290 -58.65%
482.sphinx3 10.000 -54.55%
482.sphinx3 (avg) 10.000 -54.55%
482.sphinx3 (avg) (percentage) 1.420 -52.19%
482.sphinx3 (max) 18.000 -18.18%
482.sphinx3 (max) (percentage) 2.470 -16.84%
482.sphinx3 (unexplained diff vs previous) 3.000 -86.36%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.390 -86.46%
483.xalancbmk 26.000 -
483.xalancbmk (avg) 26.000 -
483.xalancbmk (avg) (percentage) 0.950 -
483.xalancbmk (max) 25.000 -19.35%
483.xalancbmk (max) (percentage) 0.940 -16.81%
Geometric Mean 3.289 -60.60%