Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=428c21e99a3a8e6b2c7fd204664764d7724f6272 (+ 38 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/de2ade6908c6f18b821d6d25b4f4833c850fa19c (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9fc639f654dc004736836613be703e6bed0c36a8 (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (+ 226 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/196/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0196 (3-changed-components) 2024-07-01T14:05:42 0:00:00
Previous 0193 (3-changed-components) 2024-06-27T02:59:55 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 47 15
Performance Improvements 83 13
Added Tests 4 132
Unchanged Tests 1006 980
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 2.11% 5634.000 5753.000 - 0.58% -
401.bzip2 1.25% 2723.000 2757.000 - 1.06% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 800.00% 1.000 9.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 789.47% 0.190 1.690 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) 787.50% 0.080 0.710 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) 775.00% 8.000 70.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) 650.00% 2.000 15.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 633.33% 0.060 0.440 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 434.38% 0.320 1.710 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 426.88% 0.930 4.900 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 425.00% 4.000 21.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) 396.81% 0.940 4.670 - 0.00% -
462.libquantum (max) 300.00% 1.000 4.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 205.13% 39.000 119.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 200.00% 0.690 2.070 0.000 0.00% 0.000
435.gromacs (max) 137.25% 51.000 121.000 - 0.00% -
435.gromacs (max) (percentage) 129.35% 0.920 2.110 - 0.00% -
464.h264ref (unexplained diff vs previous) 85.71% 7.000 13.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 84.62% 0.130 0.240 0.000 0.00% 0.000
456.hmmer (max) (percentage) 62.96% 0.270 0.440 - 0.00% -
464.h264ref (max) (percentage) 60.00% 0.150 0.240 - 0.00% -
456.hmmer (max) 55.56% 9.000 14.000 - 0.00% -
464.h264ref (max) 50.00% 8.000 12.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 34.51% 4.520 6.080 0.000 0.00% 0.000
482.sphinx3 (max) 33.33% 3.000 4.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 31.82% 0.660 0.870 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 30.77% 26.000 34.000 0.000 0.00% 0.000
470.lbm (max) (percentage) 29.85% 0.670 0.870 - 0.00% -
470.lbm (max) 26.92% 26.000 33.000 - 0.00% -
400.perlbench (unexplained diff vs previous) 26.76% 71.000 90.000 0.000 0.00% 0.000
400.perlbench (max) (percentage) 21.14% 4.730 5.730 - 0.00% -
429.mcf (max) (percentage) 18.31% 1.420 1.680 - 0.00% -
429.mcf (max) 17.65% 17.000 20.000 - 0.00% -
482.sphinx3 (max) (percentage) 15.22% 0.460 0.530 - 0.00% -
456.hmmer 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) 14.29% 7.000 8.000 - 0.00% -
400.perlbench (max) 13.51% 74.000 84.000 - 0.00% -
400.perlbench (avg) (percentage) 10.46% 1.530 1.690 - 0.00% -
462.libquantum (avg) (percentage) 9.76% 1.230 1.350 - 0.00% -
450.soplex (max) (percentage) 7.05% 1.560 1.670 - 0.00% -
400.perlbench 4.17% 24.000 25.000 - 0.00% -
400.perlbench (avg) 4.17% 24.000 25.000 - 0.00% -
470.lbm (avg) (percentage) 4.08% 0.490 0.510 - 0.00% -
435.gromacs 3.33% 90.000 93.000 - 0.00% -
435.gromacs (avg) 3.33% 90.000 93.000 - 0.00% -
435.gromacs (avg) (percentage) 1.25% 1.600 1.620 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -5.73% 1571.000 1481.000 - 8.42% -
462.libquantum -4.67% 107.000 102.000 - -9.73% -
437.leslie3d -3.57% 10794.000 10409.000 - 0.60% -
429.mcf -1.68% 1249.000 1228.000 - 32.90% -
450.soplex -1.67% 540.000 531.000 - -0.19% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) -83.33% 18.000 3.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -82.35% 0.340 0.060 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -72.37% 76.000 21.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -72.09% 3.440 0.960 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -68.00% 25.000 8.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -67.96% 1.810 0.580 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -66.67% 45.000 15.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.960 0.320 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -50.00% 6.000 3.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -50.00% 4.000 2.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -50.00% 0.060 0.030 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -50.00% 34.000 17.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.720 0.360 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -49.35% 0.770 0.390 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -45.85% 711.000 385.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -43.85% 6.590 3.700 0.000 0.00% 0.000
434.zeusmp (max) -40.00% 20.000 12.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -39.11% 2.020 1.230 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -38.18% 55.000 34.000 0.000 0.00% 0.000
459.GemsFDTD (max) -37.93% 29.000 18.000 - 0.00% -
459.GemsFDTD (max) (percentage) -37.50% 0.560 0.350 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -36.84% 19.000 12.000 0.000 0.00% 0.000
434.zeusmp (max) (percentage) -36.47% 0.850 0.540 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -36.11% 0.360 0.230 0.000 0.00% 0.000
444.namd (max) -33.33% 6.000 4.000 - 0.00% -
453.povray (max) -33.33% 6.000 4.000 - 0.00% -
453.povray (max) (percentage) -31.97% 1.470 1.000 - 0.00% -
437.leslie3d (max) -27.63% 760.000 550.000 - 0.00% -
444.namd (max) (percentage) -25.64% 0.780 0.580 - 0.00% -
436.cactusADM (unexplained diff vs previous) -25.00% 4.000 3.000 0.000 0.00% 0.000
447.dealII (max) -25.00% 24.000 18.000 - 0.00% -
437.leslie3d (max) (percentage) -24.96% 7.050 5.290 - 0.00% -
447.dealII (max) (percentage) -24.72% 1.780 1.340 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -23.53% 0.170 0.130 0.000 0.00% 0.000
453.povray -20.00% 5.000 4.000 - 0.00% -
453.povray (avg) -20.00% 5.000 4.000 - 0.00% -
473.astar (max) (percentage) -16.90% 0.710 0.590 - 0.00% -
473.astar (max) -15.15% 33.000 28.000 - 0.00% -
445.gobmk (max) -13.33% 45.000 39.000 - 0.00% -
445.gobmk (max) (percentage) -12.37% 0.970 0.850 - 0.00% -
471.omnetpp (max) -10.26% 78.000 70.000 - 0.00% -
471.omnetpp (max) (percentage) -10.11% 3.560 3.200 - 0.00% -
401.bzip2 (max) (percentage) -7.11% 2.390 2.220 - 0.00% -
458.sjeng (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
447.dealII -6.25% 16.000 15.000 - 0.00% -
447.dealII (avg) -6.25% 16.000 15.000 - 0.00% -
401.bzip2 (max) -6.15% 65.000 61.000 - 0.00% -
453.povray (avg) (percentage) -4.96% 1.210 1.150 - 0.00% -
458.sjeng (max) -4.76% 21.000 20.000 - 0.00% -
436.cactusADM (max) -4.00% 25.000 24.000 - 0.00% -
437.leslie3d -3.90% 410.000 394.000 - 0.00% -
437.leslie3d (avg) -3.90% 410.000 394.000 - 0.00% -
410.bwaves (max) (percentage) -3.77% 1.060 1.020 - 0.00% -
445.gobmk -3.70% 27.000 26.000 - 0.00% -
445.gobmk (avg) -3.70% 27.000 26.000 - 0.00% -
436.cactusADM (max) (percentage) -3.64% 1.100 1.060 - 0.00% -
410.bwaves (max) -3.57% 56.000 54.000 - 0.00% -
436.cactusADM (avg) (percentage) -3.39% 0.590 0.570 - 0.00% -
410.bwaves (avg) (percentage) -3.28% 0.610 0.590 - 0.00% -
434.zeusmp (avg) (percentage) -3.23% 0.620 0.600 - 0.00% -
410.bwaves -3.12% 32.000 31.000 - 0.00% -
410.bwaves (avg) -3.12% 32.000 31.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.82% 0.710 0.690 - 0.00% -
459.GemsFDTD -2.78% 36.000 35.000 - 0.00% -
459.GemsFDTD (avg) -2.78% 36.000 35.000 - 0.00% -
465.tonto (max) -2.78% 72.000 70.000 - 0.00% -
465.tonto (max) (percentage) -2.74% 0.730 0.710 - 0.00% -
429.mcf -2.70% 37.000 36.000 - 0.00% -
429.mcf (avg) -2.70% 37.000 36.000 - 0.00% -
447.dealII (avg) (percentage) -2.56% 1.170 1.140 - 0.00% -
473.astar -2.08% 48.000 47.000 - 0.00% -
473.astar (avg) -2.08% 48.000 47.000 - 0.00% -
482.sphinx3 (avg) (percentage) -2.06% 0.970 0.950 - 0.00% -
473.astar (avg) (percentage) -1.96% 1.020 1.000 - 0.00% -
445.gobmk (avg) (percentage) -1.72% 0.580 0.570 - 0.00% -
429.mcf (avg) (percentage) -1.67% 2.990 2.940 - 0.00% -
444.namd (avg) (percentage) -1.61% 0.620 0.610 - 0.00% -
471.omnetpp (avg) (percentage) -1.31% 1.530 1.510 - 0.00% -

Added Tests - sample variability
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.89% 2255286.000 2343034.000 - 0.00% -
444.namd 3.77% 225019.000 233513.000 - 0.00% -
447.dealII 2.96% 381188.000 392490.000 - 0.00% -
410.bwaves 2.59% 22626.000 23211.000 - 0.00% -
464.h264ref 1.74% 448678.000 456494.000 - 0.00% -
401.bzip2 1.37% 48792.000 49460.000 - 0.00% -
470.lbm 1.33% 10803.000 10947.000 - 0.00% -
462.libquantum 1.25% 19841.000 20089.000 - 0.00% -
459.GemsFDTD 1.18% 326542.000 330379.000 - 0.00% -
433.milc 1.11% 70133.000 70913.000 - 0.00% -
436.cactusADM 1.11% 409394.000 413918.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 32.90% 924.000 1228.000 - -1.68% -
400.perlbench 8.42% 1366.000 1481.000 - -5.73% -
458.sjeng 5.03% 6725.000 7063.000 - 0.03% -
401.bzip2 1.06% 2728.000 2757.000 - 1.25% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
453.povray -1.09% 792591.000 783965.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.73% 113.000 102.000 - -4.67% -
473.astar -2.42% 4883.000 4765.000 - 0.36% -
433.milc -2.23% 1119.000 1094.000 - -0.55% -
445.gobmk -2.05% 4771.000 4673.000 - -0.32% -
447.dealII -1.49% 1409.000 1388.000 - 0.58% -
464.h264ref -1.44% 5407.000 5329.000 - -0.24% -
410.bwaves -1.39% 5409.000 5334.000 - 0.06% -
436.cactusADM -1.22% 2378.000 2349.000 - -0.13% -
470.lbm -1.14% 3941.000 3896.000 - -0.87% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 142.86% 28.000 68.000 - 0.00% -
nb_compile_successful 71.43% 28.000 48.000 - 0.00% -
nb_execution_successful 71.43% 28.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1481.000 -5.73%
401.bzip2 2757.000 1.25%
410.bwaves 5334.000 -
429.mcf 1228.000 -1.68%
433.milc 1094.000 -
434.zeusmp 2397.000 -
435.gromacs 5753.000 2.11%
436.cactusADM 2349.000 -
437.leslie3d 10409.000 -3.57%
444.namd 772.000 -
445.gobmk 4673.000 -
447.dealII 1388.000 -
450.soplex 531.000 -1.67%
453.povray 432.000 -
456.hmmer 3379.000 -
458.sjeng 7063.000 -
459.GemsFDTD 5194.000 -
462.libquantum 102.000 -4.67%
464.h264ref 5329.000 -
465.tonto 9878.000 -
470.lbm 3896.000 -
471.omnetpp 2190.000 -
473.astar 4765.000 -
482.sphinx3 765.000 -
Geometric Mean 2232.346 -
Name Current %
400.perlbench 1028741.000 -
401.bzip2 49460.000 -
410.bwaves 23211.000 -
429.mcf 9695.000 -
433.milc 70913.000 -
434.zeusmp 218430.000 -
435.gromacs 577352.000 -
436.cactusADM 413918.000 -
437.leslie3d 80237.000 -
444.namd 233513.000 -
445.gobmk 1397777.000 -
447.dealII 392490.000 -
450.soplex 244657.000 -
453.povray 783965.000 -
456.hmmer 126503.000 -
458.sjeng 117927.000 -
459.GemsFDTD 330379.000 -
462.libquantum 20089.000 -
464.h264ref 456494.000 -
465.tonto 2343034.000 -
470.lbm 10947.000 -
471.omnetpp 519249.000 -
473.astar 24004.000 -
482.sphinx3 129159.000 -
Geometric Mean 164578.890 -
Name Current %
400.perlbench 25.000 4.17%
400.perlbench (avg) 25.000 4.17%
400.perlbench (avg) (percentage) 1.690 10.46%
400.perlbench (max) 84.000 13.51%
400.perlbench (max) (percentage) 5.730 21.14%
400.perlbench (unexplained diff vs previous) 90.000 26.76%
400.perlbench (unexplained diff vs previous) (percentage) 6.080 34.51%
401.bzip2 34.000 -
401.bzip2 (avg) 34.000 -
401.bzip2 (avg) (percentage) 1.260 -
401.bzip2 (max) 61.000 -6.15%
401.bzip2 (max) (percentage) 2.220 -7.11%
401.bzip2 (unexplained diff vs previous) 34.000 -38.18%
401.bzip2 (unexplained diff vs previous) (percentage) 1.230 -39.11%
403.gcc (avg) (percentage) 4.080 -
403.gcc (max) (percentage) 5.820 -
410.bwaves 31.000 -3.12%
410.bwaves (avg) 31.000 -3.12%
410.bwaves (avg) (percentage) 0.590 -3.28%
410.bwaves (max) 54.000 -3.57%
410.bwaves (max) (percentage) 1.020 -3.77%
410.bwaves (unexplained diff vs previous) 3.000 -83.33%
410.bwaves (unexplained diff vs previous) (percentage) 0.060 -82.35%
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) (percentage) 0.100 -
429.mcf 36.000 -2.70%
429.mcf (avg) 36.000 -2.70%
429.mcf (avg) (percentage) 2.940 -1.67%
429.mcf (max) 20.000 17.65%
429.mcf (max) (percentage) 1.680 18.31%
429.mcf (unexplained diff vs previous) 21.000 425.00%
429.mcf (unexplained diff vs previous) (percentage) 1.710 434.38%
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.580 -
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.550 -
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.550 -
434.zeusmp 14.000 -
434.zeusmp (avg) 14.000 -
434.zeusmp (avg) (percentage) 0.600 -3.23%
434.zeusmp (max) 12.000 -40.00%
434.zeusmp (max) (percentage) 0.540 -36.47%
434.zeusmp (unexplained diff vs previous) 0.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.000 -
435.gromacs 93.000 3.33%
435.gromacs (avg) 93.000 3.33%
435.gromacs (avg) (percentage) 1.620 1.25%
435.gromacs (max) 121.000 137.25%
435.gromacs (max) (percentage) 2.110 129.35%
435.gromacs (unexplained diff vs previous) 119.000 205.13%
435.gromacs (unexplained diff vs previous) (percentage) 2.070 200.00%
436.cactusADM 13.000 -
436.cactusADM (avg) 13.000 -
436.cactusADM (avg) (percentage) 0.570 -3.39%
436.cactusADM (max) 24.000 -4.00%
436.cactusADM (max) (percentage) 1.060 -3.64%
436.cactusADM (unexplained diff vs previous) 3.000 -25.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.130 -23.53%
437.leslie3d 394.000 -3.90%
437.leslie3d (avg) 394.000 -3.90%
437.leslie3d (avg) (percentage) 3.790 -
437.leslie3d (max) 550.000 -27.63%
437.leslie3d (max) (percentage) 5.290 -24.96%
437.leslie3d (unexplained diff vs previous) 385.000 -45.85%
437.leslie3d (unexplained diff vs previous) (percentage) 3.700 -43.85%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.610 -1.61%
444.namd (max) 4.000 -33.33%
444.namd (max) (percentage) 0.580 -25.64%
444.namd (unexplained diff vs previous) 3.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.390 -49.35%
445.gobmk 26.000 -3.70%
445.gobmk (avg) 26.000 -3.70%
445.gobmk (avg) (percentage) 0.570 -1.72%
445.gobmk (max) 39.000 -13.33%
445.gobmk (max) (percentage) 0.850 -12.37%
445.gobmk (unexplained diff vs previous) 15.000 -66.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.320 -66.67%
447.dealII 15.000 -6.25%
447.dealII (avg) 15.000 -6.25%
447.dealII (avg) (percentage) 1.140 -2.56%
447.dealII (max) 18.000 -25.00%
447.dealII (max) (percentage) 1.340 -24.72%
447.dealII (unexplained diff vs previous) 8.000 -68.00%
447.dealII (unexplained diff vs previous) (percentage) 0.580 -67.96%
450.soplex 9.000 -
450.soplex (avg) 9.000 -
450.soplex (avg) (percentage) 1.760 -
450.soplex (max) 8.000 -
450.soplex (max) (percentage) 1.670 7.05%
450.soplex (unexplained diff vs previous) 9.000 800.00%
450.soplex (unexplained diff vs previous) (percentage) 1.690 789.47%
453.povray 4.000 -20.00%
453.povray (avg) 4.000 -20.00%
453.povray (avg) (percentage) 1.150 -4.96%
453.povray (max) 4.000 -33.33%
453.povray (max) (percentage) 1.000 -31.97%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix (avg) (percentage) 3.640 -
454.calculix (max) (percentage) 4.720 -
456.hmmer 8.000 14.29%
456.hmmer (avg) 8.000 14.29%
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 14.000 55.56%
456.hmmer (max) (percentage) 0.440 62.96%
456.hmmer (unexplained diff vs previous) 15.000 650.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.440 633.33%
458.sjeng 24.000 -
458.sjeng (avg) 24.000 -
458.sjeng (avg) (percentage) 0.340 -
458.sjeng (max) 20.000 -4.76%
458.sjeng (max) (percentage) 0.290 -6.45%
458.sjeng (unexplained diff vs previous) 2.000 -50.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.030 -50.00%
459.GemsFDTD 35.000 -2.78%
459.GemsFDTD (avg) 35.000 -2.78%
459.GemsFDTD (avg) (percentage) 0.690 -2.82%
459.GemsFDTD (max) 18.000 -37.93%
459.GemsFDTD (max) (percentage) 0.350 -37.50%
459.GemsFDTD (unexplained diff vs previous) 12.000 -36.84%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.230 -36.11%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.350 9.76%
462.libquantum (max) 4.000 300.00%
462.libquantum (max) (percentage) 4.670 396.81%
462.libquantum (unexplained diff vs previous) 5.000 400.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.900 426.88%
464.h264ref 15.000 -
464.h264ref (avg) 15.000 -
464.h264ref (avg) (percentage) 0.290 -
464.h264ref (max) 12.000 50.00%
464.h264ref (max) (percentage) 0.240 60.00%
464.h264ref (unexplained diff vs previous) 13.000 85.71%
464.h264ref (unexplained diff vs previous) (percentage) 0.240 84.62%
465.tonto 65.000 -
465.tonto (avg) 65.000 -
465.tonto (avg) (percentage) 0.660 -
465.tonto (max) 70.000 -2.78%
465.tonto (max) (percentage) 0.710 -2.74%
465.tonto (unexplained diff vs previous) 70.000 775.00%
465.tonto (unexplained diff vs previous) (percentage) 0.710 787.50%
470.lbm 19.000 -
470.lbm (avg) 19.000 -
470.lbm (avg) (percentage) 0.510 4.08%
470.lbm (max) 33.000 26.92%
470.lbm (max) (percentage) 0.870 29.85%
470.lbm (unexplained diff vs previous) 34.000 30.77%
470.lbm (unexplained diff vs previous) (percentage) 0.870 31.82%
471.omnetpp 33.000 -
471.omnetpp (avg) 33.000 -
471.omnetpp (avg) (percentage) 1.510 -1.31%
471.omnetpp (max) 70.000 -10.26%
471.omnetpp (max) (percentage) 3.200 -10.11%
471.omnetpp (unexplained diff vs previous) 21.000 -72.37%
471.omnetpp (unexplained diff vs previous) (percentage) 0.960 -72.09%
473.astar 47.000 -2.08%
473.astar (avg) 47.000 -2.08%
473.astar (avg) (percentage) 1.000 -1.96%
473.astar (max) 28.000 -15.15%
473.astar (max) (percentage) 0.590 -16.90%
473.astar (unexplained diff vs previous) 17.000 -50.00%
473.astar (unexplained diff vs previous) (percentage) 0.360 -50.00%
481.wrf (avg) (percentage) 1.060 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.950 -2.06%
482.sphinx3 (max) 4.000 33.33%
482.sphinx3 (max) (percentage) 0.530 15.22%
482.sphinx3 (unexplained diff vs previous) 4.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.520 -
Geometric Mean 3.599 -8.69%