Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eb53cbeca8cf456b4a79f33d7a2a586a99b4b2e3 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/c9377734b798d8d311dfd3a5618dc49407703b93 (+ 139 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=55cd51d971b84fbb2cc0fe8140cc8581f98582c7 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/3b6df5ec957d4f6d871ecd63a14fdc98bd24dc2d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2_LTO-build/247/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0247 (-00000-) 2024-08-20T11:15:21 0:00:00
Previous 0246 (3-changed-components) 2024-08-18T03:17:13 0:00:00
Baseline 0001 (4-changed-components) 2023-03-25T19:03:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 95 9
Performance Improvements 63 27
Added Tests 0 130
Unchanged Tests 1006 998
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
436.cactusADM 1.16% 1897.000 1919.000 - 3.90% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 4033.33% 0.090 3.720 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 3800.00% 1.000 39.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 2200.00% 0.050 1.150 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) 2100.00% 1.000 22.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 1370.00% 0.200 2.940 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 1311.11% 9.000 127.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) 1300.00% 1.000 14.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 1200.00% 0.040 0.520 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 781.82% 0.330 2.910 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 744.44% 9.000 76.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 645.65% 0.460 3.430 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 620.00% 20.000 144.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 457.69% 0.260 1.450 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 456.25% 16.000 89.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 449.48% 1.940 10.660 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 412.20% 0.410 2.100 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 400.00% 14.000 70.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 397.30% 37.000 184.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 302.56% 1.170 4.710 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 283.33% 54.000 207.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 268.97% 0.580 2.140 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 258.33% 12.000 43.000 0.000 0.00% 0.000
456.hmmer (max) 225.00% 4.000 13.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 208.72% 3.440 10.620 0.000 0.00% 0.000
456.hmmer (max) (percentage) 205.88% 0.170 0.520 - 0.00% -
433.milc (max) (percentage) 195.87% 1.210 3.580 - 0.00% -
433.milc (max) 184.62% 13.000 37.000 - 0.00% -
450.soplex (unexplained diff vs previous) 178.95% 19.000 53.000 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 167.95% 0.780 2.090 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 167.19% 2.530 6.760 0.000 0.00% 0.000
434.zeusmp (max) 162.50% 16.000 42.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 159.23% 2.330 6.040 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 150.00% 2.000 5.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 143.90% 123.000 300.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) 143.46% 2.600 6.330 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 142.22% 0.450 1.090 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) 140.00% 5.000 12.000 0.000 0.00% 0.000
464.h264ref (max) (percentage) 132.99% 0.970 2.260 - 0.00% -
464.h264ref (max) 127.50% 40.000 91.000 - 0.00% -
410.bwaves (max) (percentage) 125.85% 1.470 3.320 - 0.00% -
410.bwaves (max) 120.63% 63.000 139.000 - 0.00% -
462.libquantum (max) 100.00% 2.000 4.000 - 0.00% -
450.soplex (max) (percentage) 95.92% 4.900 9.600 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 76.42% 2.120 3.740 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 74.10% 1.660 2.890 0.000 0.00% 0.000
450.soplex (max) 74.07% 27.000 47.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 70.21% 47.000 80.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 69.23% 13.000 22.000 0.000 0.00% 0.000
471.omnetpp (max) (percentage) 67.13% 2.160 3.610 - 0.00% -
471.omnetpp (max) 63.83% 47.000 77.000 - 0.00% -
436.cactusADM (max) 46.67% 15.000 22.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 45.04% 2.420 3.510 0.000 0.00% 0.000
436.cactusADM (max) (percentage) 41.46% 0.820 1.160 - 0.00% -
453.povray (unexplained diff vs previous) 40.00% 10.000 14.000 0.000 0.00% 0.000
458.sjeng (max) (percentage) 37.50% 1.040 1.430 - 0.00% -
459.GemsFDTD (max) (percentage) 37.02% 2.080 2.850 - 0.00% -
453.povray (max) (percentage) 36.69% 2.480 3.390 - 0.00% -
458.sjeng (max) 35.94% 64.000 87.000 - 0.00% -
459.GemsFDTD (max) 33.70% 92.000 123.000 - 0.00% -
453.povray (max) 30.00% 10.000 13.000 - 0.00% -
429.mcf (max) (percentage) 29.78% 7.420 9.630 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 24.47% 6.130 7.630 0.000 0.00% 0.000
482.sphinx3 (max) 23.53% 17.000 21.000 - 0.00% -
482.sphinx3 (max) (percentage) 22.17% 2.300 2.810 - 0.00% -
435.gromacs (max) (percentage) 21.84% 4.670 5.690 - 0.00% -
453.povray 20.00% 5.000 6.000 - 0.00% -
453.povray (avg) 20.00% 5.000 6.000 - 0.00% -
473.astar (max) (percentage) 18.73% 3.790 4.500 - 0.00% -
429.mcf (max) 17.73% 141.000 166.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 15.62% 557.000 644.000 0.000 0.00% 0.000
435.gromacs (max) 14.63% 246.000 282.000 - 0.00% -
473.astar (max) 13.22% 174.000 197.000 - 0.00% -
470.lbm (max) (percentage) 8.47% 1.890 2.050 - 0.00% -
464.h264ref (avg) (percentage) 7.04% 0.710 0.760 - 0.00% -
470.lbm (max) 6.25% 64.000 68.000 - 0.00% -
450.soplex (avg) (percentage) 6.00% 3.000 3.180 - 0.00% -
433.milc (avg) (percentage) 5.22% 1.150 1.210 - 0.00% -
462.libquantum (avg) (percentage) 4.95% 2.020 2.120 - 0.00% -
435.gromacs (avg) (percentage) 4.26% 2.350 2.450 - 0.00% -
453.povray (avg) (percentage) 4.14% 1.450 1.510 - 0.00% -
456.hmmer (avg) (percentage) 3.70% 0.270 0.280 - 0.00% -
464.h264ref 3.45% 29.000 30.000 - 0.00% -
464.h264ref (avg) 3.45% 29.000 30.000 - 0.00% -
410.bwaves (avg) (percentage) 3.21% 1.560 1.610 - 0.00% -
473.astar (avg) (percentage) 2.87% 2.090 2.150 - 0.00% -
429.mcf (avg) (percentage) 2.14% 5.140 5.250 - 0.00% -
434.zeusmp (avg) (percentage) 1.80% 1.110 1.130 - 0.00% -
459.GemsFDTD (avg) (percentage) 1.78% 1.690 1.720 - 0.00% -
470.lbm (avg) (percentage) 1.75% 1.140 1.160 - 0.00% -
401.bzip2 (avg) (percentage) 1.62% 1.850 1.880 - 0.00% -
471.omnetpp (avg) (percentage) 1.33% 2.260 2.290 - 0.00% -
458.sjeng (avg) (percentage) 1.30% 0.770 0.780 - 0.00% -
436.cactusADM (avg) (percentage) 1.09% 0.920 0.930 - 0.00% -
445.gobmk (avg) (percentage) 1.06% 0.940 0.950 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -9.63% 1910.000 1726.000 - 20.70% -
450.soplex -9.60% 552.000 499.000 - -10.25% -
437.leslie3d -7.09% 9081.000 8437.000 - 0.15% -
462.libquantum -6.33% 79.000 74.000 - -9.76% -
435.gromacs -5.69% 5268.000 4968.000 - -7.52% -
473.astar -4.50% 4599.000 4392.000 - -6.73% -
465.tonto -3.94% 9011.000 8656.000 - -6.18% -
471.omnetpp -3.61% 2219.000 2139.000 - -2.15% -
433.milc -3.58% 1088.000 1049.000 - -3.23% -
453.povray -3.39% 413.000 399.000 - -4.32% -
410.bwaves -3.32% 4340.000 4196.000 - -4.53% -
459.GemsFDTD -2.85% 4450.000 4323.000 - 2.59% -
401.bzip2 -2.82% 2691.000 2615.000 - -4.60% -
482.sphinx3 -2.81% 782.000 760.000 - -2.56% -
464.h264ref -2.26% 4157.000 4063.000 - -3.99% -
434.zeusmp -2.09% 2053.000 2010.000 - 0.95% -
470.lbm -2.05% 3411.000 3341.000 - -4.43% -
458.sjeng -1.43% 6241.000 6152.000 - -2.93% -
445.gobmk -1.41% 4480.000 4417.000 - -4.54% -
447.dealII -1.08% 1113.000 1101.000 - -0.27% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) -81.82% 55.000 10.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -81.80% 4.120 0.750 0.000 0.00% 0.000
444.namd (max) -53.33% 15.000 7.000 - 0.00% -
444.namd (max) (percentage) -49.80% 2.450 1.230 - 0.00% -
444.namd (unexplained diff vs previous) -33.33% 6.000 4.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -33.33% 0.960 0.640 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -30.00% 90.000 63.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -28.86% 2.010 1.430 0.000 0.00% 0.000
437.leslie3d (max) -16.44% 1259.000 1052.000 - 0.00% -
437.leslie3d (max) (percentage) -10.02% 13.870 12.480 - 0.00% -
429.mcf -8.16% 98.000 90.000 - 0.00% -
429.mcf (avg) -8.16% 98.000 90.000 - 0.00% -
465.tonto (max) -7.44% 215.000 199.000 - 0.00% -
437.leslie3d -6.91% 608.000 566.000 - 0.00% -
437.leslie3d (avg) -6.91% 608.000 566.000 - 0.00% -
445.gobmk (max) -6.82% 88.000 82.000 - 0.00% -
401.bzip2 (max) -6.41% 78.000 73.000 - 0.00% -
447.dealII (max) -6.25% 16.000 15.000 - 0.00% -
450.soplex -6.25% 16.000 15.000 - 0.00% -
450.soplex (avg) -6.25% 16.000 15.000 - 0.00% -
445.gobmk (max) (percentage) -5.08% 1.970 1.870 - 0.00% -
471.omnetpp -4.00% 50.000 48.000 - 0.00% -
471.omnetpp (avg) -4.00% 50.000 48.000 - 0.00% -
400.perlbench (max) -3.85% 52.000 50.000 - 0.00% -
465.tonto (max) (percentage) -3.77% 2.390 2.300 - 0.00% -
465.tonto -3.74% 107.000 103.000 - 0.00% -
465.tonto (avg) -3.74% 107.000 103.000 - 0.00% -
400.perlbench (max) (percentage) -3.54% 3.960 3.820 - 0.00% -
447.dealII (max) (percentage) -3.42% 1.460 1.410 - 0.00% -
400.perlbench -3.12% 32.000 31.000 - 0.00% -
400.perlbench (avg) -3.12% 32.000 31.000 - 0.00% -
401.bzip2 (max) (percentage) -3.09% 2.910 2.820 - 0.00% -
400.perlbench (avg) (percentage) -2.49% 2.410 2.350 - 0.00% -
445.gobmk -2.38% 42.000 41.000 - 0.00% -
445.gobmk (avg) -2.38% 42.000 41.000 - 0.00% -
458.sjeng -2.08% 48.000 47.000 - 0.00% -
458.sjeng (avg) -2.08% 48.000 47.000 - 0.00% -
473.astar -2.08% 96.000 94.000 - 0.00% -
473.astar (avg) -2.08% 96.000 94.000 - 0.00% -
435.gromacs -1.63% 123.000 121.000 - 0.00% -
435.gromacs (avg) -1.63% 123.000 121.000 - 0.00% -
459.GemsFDTD -1.33% 75.000 74.000 - 0.00% -
459.GemsFDTD (avg) -1.33% 75.000 74.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.79% 2314060.000 2401831.000 - 0.17% -
482.sphinx3 2.47% 136204.000 139564.000 - 0.00% -
456.hmmer 1.82% 134037.000 136477.000 - 0.00% -
400.perlbench 1.60% 1116257.000 1134156.000 - 0.00% -
429.mcf 1.26% 9840.000 9964.000 - 0.00% -
464.h264ref 1.16% 437100.000 442152.000 - -0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 20.70% 1430.000 1726.000 - -9.63% -
436.cactusADM 3.90% 1847.000 1919.000 - 1.16% -
459.GemsFDTD 2.59% 4214.000 4323.000 - -2.85% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -10.35% 72512.000 65004.000 - 0.00% -
462.libquantum -3.86% 20328.000 19544.000 - 0.00% -
473.astar -3.18% 27173.000 26309.000 - 0.00% -
401.bzip2 -2.81% 51213.000 49773.000 - 0.00% -
434.zeusmp -2.13% 191785.000 187699.000 - 0.00% -
459.GemsFDTD -1.99% 305748.000 299664.000 - 0.00% -
470.lbm -1.86% 10968.000 10764.000 - 0.00% -
433.milc -1.53% 72058.000 70958.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -10.25% 556.000 499.000 - -9.60% -
462.libquantum -9.76% 82.000 74.000 - -6.33% -
435.gromacs -7.52% 5372.000 4968.000 - -5.69% -
473.astar -6.73% 4709.000 4392.000 - -4.50% -
465.tonto -6.18% 9226.000 8656.000 - -3.94% -
400.perlbench -5.83% 1407.000 1325.000 - -0.75% -
401.bzip2 -4.60% 2741.000 2615.000 - -2.82% -
445.gobmk -4.54% 4627.000 4417.000 - -1.41% -
410.bwaves -4.53% 4395.000 4196.000 - -3.32% -
470.lbm -4.43% 3496.000 3341.000 - -2.05% -
453.povray -4.32% 417.000 399.000 - -3.39% -
464.h264ref -3.99% 4232.000 4063.000 - -2.26% -
433.milc -3.23% 1084.000 1049.000 - -3.58% -
458.sjeng -2.93% 6338.000 6152.000 - -1.43% -
482.sphinx3 -2.56% 780.000 760.000 - -2.81% -
471.omnetpp -2.15% 2186.000 2139.000 - -3.61% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1325.000 -
401.bzip2 2615.000 -2.82%
410.bwaves 4196.000 -3.32%
429.mcf 1726.000 -9.63%
433.milc 1049.000 -3.58%
434.zeusmp 2010.000 -2.09%
435.gromacs 4968.000 -5.69%
436.cactusADM 1919.000 1.16%
437.leslie3d 8437.000 -7.09%
444.namd 624.000 -
445.gobmk 4417.000 -1.41%
447.dealII 1101.000 -1.08%
450.soplex 499.000 -9.60%
453.povray 399.000 -3.39%
456.hmmer 2684.000 -
458.sjeng 6152.000 -1.43%
459.GemsFDTD 4323.000 -2.85%
462.libquantum 74.000 -6.33%
464.h264ref 4063.000 -2.26%
465.tonto 8656.000 -3.94%
470.lbm 3341.000 -2.05%
471.omnetpp 2139.000 -3.61%
473.astar 4392.000 -4.50%
482.sphinx3 760.000 -2.81%
Geometric Mean 1968.018 -3.38%
Name Current %
400.perlbench 1134156.000 -
401.bzip2 49773.000 -
410.bwaves 20548.000 -
429.mcf 9964.000 -
433.milc 70958.000 -
434.zeusmp 187699.000 -
435.gromacs 585399.000 -
436.cactusADM 430905.000 -
437.leslie3d 65004.000 -
444.namd 225589.000 -
445.gobmk 1571295.000 -
447.dealII 412521.000 -
450.soplex 275415.000 -
453.povray 834775.000 -
456.hmmer 136477.000 -
458.sjeng 119890.000 -
459.GemsFDTD 299664.000 -
462.libquantum 19544.000 -
464.h264ref 442152.000 -
465.tonto 2401831.000 -
470.lbm 10764.000 -
471.omnetpp 599954.000 -
473.astar 26309.000 -
482.sphinx3 139564.000 -
Geometric Mean 166457.158 -
Name Current %
400.perlbench 31.000 -3.12%
400.perlbench (avg) 31.000 -3.12%
400.perlbench (avg) (percentage) 2.350 -2.49%
400.perlbench (max) 50.000 -3.85%
400.perlbench (max) (percentage) 3.820 -3.54%
400.perlbench (unexplained diff vs previous) 10.000 -81.82%
400.perlbench (unexplained diff vs previous) (percentage) 0.750 -81.80%
401.bzip2 49.000 -
401.bzip2 (avg) 49.000 -
401.bzip2 (avg) (percentage) 1.880 1.62%
401.bzip2 (max) 73.000 -6.41%
401.bzip2 (max) (percentage) 2.820 -3.09%
401.bzip2 (unexplained diff vs previous) 76.000 744.44%
401.bzip2 (unexplained diff vs previous) (percentage) 2.910 781.82%
403.gcc (avg) (percentage) 4.710 -
403.gcc (max) (percentage) 4.470 -
410.bwaves 67.000 -
410.bwaves (avg) 67.000 -
410.bwaves (avg) (percentage) 1.610 3.21%
410.bwaves (max) 139.000 120.63%
410.bwaves (max) (percentage) 3.320 125.85%
410.bwaves (unexplained diff vs previous) 144.000 620.00%
410.bwaves (unexplained diff vs previous) (percentage) 3.430 645.65%
416.gamess (avg) (percentage) 0.220 -
416.gamess (max) (percentage) 0.270 -
429.mcf 90.000 -8.16%
429.mcf (avg) 90.000 -8.16%
429.mcf (avg) (percentage) 5.250 2.14%
429.mcf (max) 166.000 17.73%
429.mcf (max) (percentage) 9.630 29.78%
429.mcf (unexplained diff vs previous) 184.000 397.30%
429.mcf (unexplained diff vs previous) (percentage) 10.660 449.48%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.210 5.22%
433.milc (max) 37.000 184.62%
433.milc (max) (percentage) 3.580 195.87%
433.milc (unexplained diff vs previous) 39.000 3800.00%
433.milc (unexplained diff vs previous) (percentage) 3.720 4033.33%
434.zeusmp 22.000 -
434.zeusmp (avg) 22.000 -
434.zeusmp (avg) (percentage) 1.130 1.80%
434.zeusmp (max) 42.000 162.50%
434.zeusmp (max) (percentage) 2.090 167.95%
434.zeusmp (unexplained diff vs previous) 43.000 258.33%
434.zeusmp (unexplained diff vs previous) (percentage) 2.140 268.97%
435.gromacs 121.000 -1.63%
435.gromacs (avg) 121.000 -1.63%
435.gromacs (avg) (percentage) 2.450 4.26%
435.gromacs (max) 282.000 14.63%
435.gromacs (max) (percentage) 5.690 21.84%
435.gromacs (unexplained diff vs previous) 300.000 143.90%
435.gromacs (unexplained diff vs previous) (percentage) 6.040 159.23%
436.cactusADM 17.000 -
436.cactusADM (avg) 17.000 -
436.cactusADM (avg) (percentage) 0.930 1.09%
436.cactusADM (max) 22.000 46.67%
436.cactusADM (max) (percentage) 1.160 41.46%
436.cactusADM (unexplained diff vs previous) 22.000 2100.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.150 2200.00%
437.leslie3d 566.000 -6.91%
437.leslie3d (avg) 566.000 -6.91%
437.leslie3d (avg) (percentage) 6.710 -
437.leslie3d (max) 1052.000 -16.44%
437.leslie3d (max) (percentage) 12.480 -10.02%
437.leslie3d (unexplained diff vs previous) 644.000 15.62%
437.leslie3d (unexplained diff vs previous) (percentage) 7.630 24.47%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.920 -
444.namd (max) 7.000 -53.33%
444.namd (max) (percentage) 1.230 -49.80%
444.namd (unexplained diff vs previous) 4.000 -33.33%
444.namd (unexplained diff vs previous) (percentage) 0.640 -33.33%
445.gobmk 41.000 -2.38%
445.gobmk (avg) 41.000 -2.38%
445.gobmk (avg) (percentage) 0.950 1.06%
445.gobmk (max) 82.000 -6.82%
445.gobmk (max) (percentage) 1.870 -5.08%
445.gobmk (unexplained diff vs previous) 63.000 -30.00%
445.gobmk (unexplained diff vs previous) (percentage) 1.430 -28.86%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.120 -
447.dealII (max) 15.000 -6.25%
447.dealII (max) (percentage) 1.410 -3.42%
447.dealII (unexplained diff vs previous) 12.000 140.00%
447.dealII (unexplained diff vs previous) (percentage) 1.090 142.22%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 3.180 6.00%
450.soplex (max) 47.000 74.07%
450.soplex (max) (percentage) 9.600 95.92%
450.soplex (unexplained diff vs previous) 53.000 178.95%
450.soplex (unexplained diff vs previous) (percentage) 10.620 208.72%
453.povray 6.000 20.00%
453.povray (avg) 6.000 20.00%
453.povray (avg) (percentage) 1.510 4.14%
453.povray (max) 13.000 30.00%
453.povray (max) (percentage) 3.390 36.69%
453.povray (unexplained diff vs previous) 14.000 40.00%
453.povray (unexplained diff vs previous) (percentage) 3.510 45.04%
454.calculix (avg) (percentage) 2.260 -
454.calculix (max) (percentage) 2.990 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.280 3.70%
456.hmmer (max) 13.000 225.00%
456.hmmer (max) (percentage) 0.520 205.88%
456.hmmer (unexplained diff vs previous) 14.000 1300.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.520 1200.00%
458.sjeng 47.000 -2.08%
458.sjeng (avg) 47.000 -2.08%
458.sjeng (avg) (percentage) 0.780 1.30%
458.sjeng (max) 87.000 35.94%
458.sjeng (max) (percentage) 1.430 37.50%
458.sjeng (unexplained diff vs previous) 89.000 456.25%
458.sjeng (unexplained diff vs previous) (percentage) 1.450 457.69%
459.GemsFDTD 74.000 -1.33%
459.GemsFDTD (avg) 74.000 -1.33%
459.GemsFDTD (avg) (percentage) 1.720 1.78%
459.GemsFDTD (max) 123.000 33.70%
459.GemsFDTD (max) (percentage) 2.850 37.02%
459.GemsFDTD (unexplained diff vs previous) 127.000 1311.11%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.940 1370.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.120 4.95%
462.libquantum (max) 4.000 100.00%
462.libquantum (max) (percentage) 6.330 143.46%
462.libquantum (unexplained diff vs previous) 5.000 150.00%
462.libquantum (unexplained diff vs previous) (percentage) 6.760 167.19%
464.h264ref 30.000 3.45%
464.h264ref (avg) 30.000 3.45%
464.h264ref (avg) (percentage) 0.760 7.04%
464.h264ref (max) 91.000 127.50%
464.h264ref (max) (percentage) 2.260 132.99%
464.h264ref (unexplained diff vs previous) 94.000 -
464.h264ref (unexplained diff vs previous) (percentage) 2.310 -
465.tonto 103.000 -3.74%
465.tonto (avg) 103.000 -3.74%
465.tonto (avg) (percentage) 1.190 -
465.tonto (max) 199.000 -7.44%
465.tonto (max) (percentage) 2.300 -3.77%
470.lbm 38.000 -
470.lbm (avg) 38.000 -
470.lbm (avg) (percentage) 1.160 1.75%
470.lbm (max) 68.000 6.25%
470.lbm (max) (percentage) 2.050 8.47%
470.lbm (unexplained diff vs previous) 70.000 400.00%
470.lbm (unexplained diff vs previous) (percentage) 2.100 412.20%
471.omnetpp 48.000 -4.00%
471.omnetpp (avg) 48.000 -4.00%
471.omnetpp (avg) (percentage) 2.290 1.33%
471.omnetpp (max) 77.000 63.83%
471.omnetpp (max) (percentage) 3.610 67.13%
471.omnetpp (unexplained diff vs previous) 80.000 70.21%
471.omnetpp (unexplained diff vs previous) (percentage) 3.740 76.42%
473.astar 94.000 -2.08%
473.astar (avg) 94.000 -2.08%
473.astar (avg) (percentage) 2.150 2.87%
473.astar (max) 197.000 13.22%
473.astar (max) (percentage) 4.500 18.73%
473.astar (unexplained diff vs previous) 207.000 283.33%
473.astar (unexplained diff vs previous) (percentage) 4.710 302.56%
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 2.030 -
482.sphinx3 (max) 21.000 23.53%
482.sphinx3 (max) (percentage) 2.810 22.17%
482.sphinx3 (unexplained diff vs previous) 22.000 69.23%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.890 74.10%
483.xalancbmk (avg) (percentage) 1.490 -
483.xalancbmk (max) (percentage) 1.010 -
Geometric Mean 10.188 69.63%