Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=93dc0c27608d2758c06e7356e5e5cfff2b159c23 (+ 50 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5176a830e70140cb3390c62b7d41f75dbbf33c7c (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=138574c99c479ecabd4ad4cbdac9db35ea048d4c (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/118/
View Options
Report
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0118 (2-changed-components) 2024-01-14T22:06:48 0:00:00
Previous 0115 (3-changed-components) 2024-01-04T00:29:42 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 47 25
Performance Improvements 119 10
Added Tests 0 136
Unchanged Tests 1034 1029
Total Tests 1200

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 6.14% 10504.000 11149.000 - 13.06% -
401.bzip2 1.91% 2723.000 2775.000 - 6.04% -
434.zeusmp 1.09% 2384.000 2410.000 - 1.09% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) (percentage) 8833.33% 0.030 2.680 - 0.00% -
435.gromacs (unexplained diff vs previous) 7550.00% 2.000 153.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) 5100.00% 1.000 52.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 4575.00% 0.040 1.870 - 0.00% -
435.gromacs (max) (percentage) 401.92% 0.520 2.610 - 0.00% -
435.gromacs (max) 393.33% 30.000 148.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 288.89% 0.270 1.050 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 285.71% 14.000 54.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 252.38% 0.420 1.480 - 0.00% -
436.cactusADM (unexplained diff vs previous) 250.00% 10.000 35.000 - 0.00% -
444.namd (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 250.00% 0.260 0.910 - 0.00% -
444.namd (max) 133.33% 3.000 7.000 - 0.00% -
444.namd (max) (percentage) 113.95% 0.430 0.920 - 0.00% -
434.zeusmp (unexplained diff vs previous) 100.00% 13.000 26.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 96.36% 0.550 1.080 - 0.00% -
470.lbm (unexplained diff vs previous) 70.00% 10.000 17.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 69.23% 0.260 0.440 - 0.00% -
434.zeusmp (max) 62.50% 16.000 26.000 - 0.00% -
434.zeusmp (max) (percentage) 57.97% 0.690 1.090 - 0.00% -
436.cactusADM (max) (percentage) 31.53% 1.110 1.460 - 0.00% -
436.cactusADM (max) 30.77% 26.000 34.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 30.77% 0.910 1.190 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 28.57% 7.000 9.000 - 0.00% -
482.sphinx3 (max) (percentage) 27.17% 0.920 1.170 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 21.89% 1.690 2.060 - 0.00% -
471.omnetpp (max) (percentage) 21.69% 1.660 2.020 - 0.00% -
459.GemsFDTD (max) (percentage) 20.93% 0.860 1.040 - 0.00% -
459.GemsFDTD (max) 20.45% 44.000 53.000 - 0.00% -
471.omnetpp (max) 20.00% 40.000 48.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 19.51% 41.000 49.000 - 0.00% -
482.sphinx3 (max) 14.29% 7.000 8.000 - 0.00% -
436.cactusADM (avg) (percentage) 8.20% 0.610 0.660 - 0.00% -
437.leslie3d 7.87% 508.000 548.000 - 0.00% -
437.leslie3d (avg) 7.87% 508.000 548.000 - 0.00% -
436.cactusADM 7.14% 14.000 15.000 - 0.00% -
436.cactusADM (avg) 7.14% 14.000 15.000 - 0.00% -
465.tonto 2.44% 82.000 84.000 - 0.00% -
465.tonto (avg) 2.44% 82.000 84.000 - 0.00% -
437.leslie3d (avg) (percentage) 1.65% 4.840 4.920 - 0.00% -
444.namd (avg) (percentage) 1.37% 0.730 0.740 - 0.00% -
462.libquantum (avg) (percentage) 1.20% 1.660 1.680 - 0.00% -
465.tonto (avg) (percentage) 1.18% 0.850 0.860 - 0.00% -
434.zeusmp (avg) (percentage) 1.12% 0.890 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -2.61% 5853.000 5700.000 - 5.03% -
471.omnetpp -2.02% 2431.000 2382.000 - 1.32% -
462.libquantum -1.98% 101.000 99.000 - -10.81% -
436.cactusADM -1.46% 2395.000 2360.000 - -1.01% -
482.sphinx3 -1.17% 768.000 759.000 - 2.99% -
459.GemsFDTD -1.04% 5186.000 5132.000 - 1.06% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) -92.00% 25.000 2.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -92.00% 0.500 0.040 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -88.37% 0.430 0.050 - 0.00% -
464.h264ref (unexplained diff vs previous) -88.00% 25.000 3.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -87.50% 16.000 2.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -85.71% 0.210 0.030 - 0.00% -
416.gamess (unexplained diff vs previous) -85.45% 55.000 8.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -84.21% 0.380 0.060 - 0.00% -
429.mcf (max) (percentage) -79.11% 3.160 0.660 - 0.00% -
400.perlbench (unexplained diff vs previous) -78.57% 14.000 3.000 - 0.00% -
429.mcf (max) -78.57% 28.000 6.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -78.26% 0.920 0.200 - 0.00% -
433.milc (max) -66.67% 6.000 2.000 - 0.00% -
433.milc (max) (percentage) -66.67% 0.600 0.200 - 0.00% -
429.mcf (unexplained diff vs previous) -62.50% 8.000 3.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -62.07% 0.870 0.330 - 0.00% -
450.soplex (unexplained diff vs previous) -60.00% 5.000 2.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -59.57% 0.940 0.380 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -50.36% 1.370 0.680 - 0.00% -
453.povray (max) -50.00% 8.000 4.000 - 0.00% -
453.povray (unexplained diff vs previous) -50.00% 6.000 3.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -47.31% 1.860 0.980 - 0.00% -
447.dealII (unexplained diff vs previous) -46.88% 32.000 17.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -43.90% 0.410 0.230 - 0.00% -
410.bwaves (unexplained diff vs previous) -42.86% 21.000 12.000 - 0.00% -
453.povray (max) (percentage) -39.78% 1.860 1.120 - 0.00% -
473.astar (unexplained diff vs previous) -36.36% 55.000 35.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -36.11% 1.080 0.690 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -34.29% 0.350 0.230 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -33.33% 0.270 0.180 - 0.00% -
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -33.33% 12.000 8.000 - 0.00% -
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -33.33% 3.000 2.000 - 0.00% -
462.libquantum (max) (percentage) -32.75% 3.420 2.300 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -31.99% 2.970 2.020 - 0.00% -
464.h264ref (max) -31.25% 32.000 22.000 - 0.00% -
464.h264ref (max) (percentage) -29.09% 0.550 0.390 - 0.00% -
447.dealII (max) -25.81% 31.000 23.000 - 0.00% -
473.astar (max) -25.45% 55.000 41.000 - 0.00% -
447.dealII (max) (percentage) -25.14% 1.830 1.370 - 0.00% -
450.soplex (max) -25.00% 4.000 3.000 - 0.00% -
473.astar (max) (percentage) -24.77% 1.090 0.820 - 0.00% -
450.soplex (max) (percentage) -24.73% 0.930 0.700 - 0.00% -
445.gobmk (max) -20.69% 58.000 46.000 - 0.00% -
445.gobmk (max) (percentage) -20.51% 1.170 0.930 - 0.00% -
416.gamess (max) -16.67% 54.000 45.000 - 0.00% -
416.gamess (max) (percentage) -15.79% 0.380 0.320 - 0.00% -
400.perlbench -10.00% 20.000 18.000 - 0.00% -
400.perlbench (avg) -10.00% 20.000 18.000 - 0.00% -
410.bwaves (max) -7.87% 89.000 82.000 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
456.hmmer (max) -7.69% 13.000 12.000 - 0.00% -
437.leslie3d (max) (percentage) -7.67% 6.650 6.140 - 0.00% -
445.gobmk (avg) (percentage) -7.61% 0.920 0.850 - 0.00% -
410.bwaves (max) (percentage) -7.47% 1.740 1.610 - 0.00% -
400.perlbench (max) -7.41% 27.000 25.000 - 0.00% -
464.h264ref (avg) (percentage) -7.32% 0.410 0.380 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -7.21% 6.240 5.790 - 0.00% -
458.sjeng -6.82% 44.000 41.000 - 0.00% -
458.sjeng (avg) -6.82% 44.000 41.000 - 0.00% -
433.milc -6.67% 15.000 14.000 - 0.00% -
433.milc (avg) -6.67% 15.000 14.000 - 0.00% -
445.gobmk -6.67% 45.000 42.000 - 0.00% -
445.gobmk (avg) -6.67% 45.000 42.000 - 0.00% -
458.sjeng (avg) (percentage) -6.67% 0.600 0.560 - 0.00% -
400.perlbench (max) (percentage) -6.59% 1.820 1.700 - 0.00% -
400.perlbench (avg) (percentage) -6.06% 1.320 1.240 - 0.00% -
401.bzip2 (max) (percentage) -5.98% 2.340 2.200 - 0.00% -
416.gamess -5.88% 34.000 32.000 - 0.00% -
416.gamess (avg) -5.88% 34.000 32.000 - 0.00% -
470.lbm (max) -5.88% 17.000 16.000 - 0.00% -
450.soplex (avg) (percentage) -5.81% 2.580 2.430 - 0.00% -
429.mcf -5.80% 69.000 65.000 - 0.00% -
429.mcf (avg) -5.80% 69.000 65.000 - 0.00% -
458.sjeng (max) (percentage) -5.56% 0.540 0.510 - 0.00% -
429.mcf (avg) (percentage) -5.37% 7.640 7.230 - 0.00% -
456.hmmer (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
470.lbm -5.26% 38.000 36.000 - 0.00% -
470.lbm (avg) -5.26% 38.000 36.000 - 0.00% -
410.bwaves -5.17% 58.000 55.000 - 0.00% -
410.bwaves (avg) -5.17% 58.000 55.000 - 0.00% -
458.sjeng (max) -5.00% 40.000 38.000 - 0.00% -
473.astar -4.49% 89.000 85.000 - 0.00% -
473.astar (avg) -4.49% 89.000 85.000 - 0.00% -
433.milc (avg) (percentage) -4.44% 1.350 1.290 - 0.00% -
410.bwaves (avg) (percentage) -4.39% 1.140 1.090 - 0.00% -
470.lbm (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
464.h264ref -4.35% 23.000 22.000 - 0.00% -
464.h264ref (avg) -4.35% 23.000 22.000 - 0.00% -
473.astar (avg) (percentage) -3.43% 1.750 1.690 - 0.00% -
401.bzip2 (max) -3.17% 63.000 61.000 - 0.00% -
470.lbm (avg) (percentage) -3.03% 0.990 0.960 - 0.00% -
453.povray (avg) (percentage) -2.97% 1.010 0.980 - 0.00% -
459.GemsFDTD -2.70% 74.000 72.000 - 0.00% -
459.GemsFDTD (avg) -2.70% 74.000 72.000 - 0.00% -
435.gromacs -2.58% 155.000 151.000 - 0.00% -
435.gromacs (avg) -2.58% 155.000 151.000 - 0.00% -
471.omnetpp -2.38% 42.000 41.000 - 0.00% -
471.omnetpp (avg) -2.38% 42.000 41.000 - 0.00% -
481.wrf (max) (percentage) -2.35% 0.850 0.830 - 0.00% -
401.bzip2 (avg) (percentage) -2.25% 2.670 2.610 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -2.20% 0.910 0.890 - 0.00% -
483.xalancbmk (max) (percentage) -2.16% 1.390 1.360 - 0.00% -
437.leslie3d (max) -2.01% 698.000 684.000 - 0.00% -
454.calculix (max) (percentage) -1.81% 4.430 4.350 - 0.00% -
403.gcc (max) (percentage) -1.79% 18.390 18.060 - 0.00% -
447.dealII (avg) (percentage) -1.69% 1.180 1.160 - 0.00% -
437.leslie3d (unexplained diff vs previous) -1.53% 655.000 645.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.40% 1.430 1.410 - 0.00% -
482.sphinx3 (avg) (percentage) -1.30% 1.540 1.520 - 0.00% -
465.tonto (unexplained diff vs previous) -1.12% 89.000 88.000 - 0.00% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.91% 23410.000 24559.000 - 0.00% -
459.GemsFDTD 3.30% 332309.000 343277.000 - 0.00% -
437.leslie3d 2.31% 82727.000 84635.000 - 0.00% -
444.namd 2.13% 223054.000 227802.000 - 0.00% -
465.tonto 1.52% 3107830.000 3155098.000 - 0.00% -
416.gamess 1.32% 7145862.000 7240451.000 - 0.00% -
447.dealII 1.02% 2447503.000 2472572.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 13.06% 9861.000 11149.000 - 6.14% -
400.perlbench 11.61% 1369.000 1528.000 - 0.20% -
473.astar 7.62% 4714.000 5073.000 - -0.69% -
403.gcc 7.55% 53.000 57.000 - 0.00% -
458.sjeng 6.09% 7048.000 7477.000 - 0.03% -
401.bzip2 6.04% 2617.000 2775.000 - 1.91% -
435.gromacs 5.03% 5427.000 5700.000 - -2.61% -
465.tonto 3.39% 9514.000 9837.000 - 0.90% -
482.sphinx3 2.99% 737.000 759.000 - -1.17% -
450.soplex 2.91% 515.000 530.000 - -0.38% -
416.gamess 2.12% 14025.000 14323.000 - -0.06% -
433.milc 1.64% 1096.000 1114.000 - -0.18% -
471.omnetpp 1.32% 2351.000 2382.000 - -2.02% -
434.zeusmp 1.09% 2384.000 2410.000 - 1.09% -
459.GemsFDTD 1.06% 5078.000 5132.000 - -1.04% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - 0.00% -
nb_execution_successful -10.34% 29.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.40% 31376.000 30624.000 - 0.00% -
453.povray -2.38% 768026.000 749779.000 - 0.00% -
403.gcc -1.51% 2862353.000 2819205.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -18.28% 1116.000 912.000 - -0.33% -
462.libquantum -10.81% 111.000 99.000 - -1.98% -
410.bwaves -2.32% 5252.000 5130.000 - 0.23% -
453.povray -1.57% 447.000 440.000 - 0.69% -
447.dealII -1.20% 1757.000 1736.000 - 0.99% -
436.cactusADM -1.01% 2384.000 2360.000 - -1.46% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
400.perlbench 1528.000 -
401.bzip2 2775.000 1.91%
403.gcc 57.000 -
410.bwaves 5130.000 -
416.gamess 14323.000 -
429.mcf 912.000 -
433.milc 1114.000 -
434.zeusmp 2410.000 1.09%
435.gromacs 5700.000 -2.61%
436.cactusADM 2360.000 -1.46%
437.leslie3d 11149.000 6.14%
444.namd 772.000 -
445.gobmk 4962.000 -
447.dealII 1736.000 -
450.soplex 530.000 -
453.povray 440.000 -
456.hmmer 3480.000 -
458.sjeng 7477.000 -
459.GemsFDTD 5132.000 -1.04%
462.libquantum 99.000 -1.98%
464.h264ref 5827.000 -
465.tonto 9837.000 -
470.lbm 3854.000 -
471.omnetpp 2382.000 -2.02%
473.astar 5073.000 -
482.sphinx3 759.000 -1.17%
Geometric Mean 2110.269 -
Code Size (bytes)
Name Current %
400.perlbench 986215.000 -
401.bzip2 52540.000 -
403.gcc 2819205.000 -
410.bwaves 24559.000 -
416.gamess 7240451.000 -
429.mcf 10363.000 -
433.milc 98558.000 -
434.zeusmp 234146.000 -
435.gromacs 741177.000 -
436.cactusADM 586571.000 -
437.leslie3d 84635.000 -
444.namd 227802.000 -
445.gobmk 1359853.000 -
447.dealII 2472572.000 -
450.soplex 298173.000 -
453.povray 749779.000 -
456.hmmer 234745.000 -
458.sjeng 126084.000 -
459.GemsFDTD 343277.000 -
462.libquantum 32383.000 -
464.h264ref 472436.000 -
465.tonto 3155098.000 -
470.lbm 11190.000 -
471.omnetpp 502098.000 -
473.astar 30624.000 -
482.sphinx3 153287.000 -
Geometric Mean 258051.843 -
sample variability
Name Current %
400.perlbench 18.000 -10.00%
400.perlbench (avg) 18.000 -10.00%
400.perlbench (avg) (percentage) 1.240 -6.06%
400.perlbench (max) 25.000 -7.41%
400.perlbench (max) (percentage) 1.700 -6.59%
400.perlbench (unexplained diff vs previous) 3.000 -78.57%
400.perlbench (unexplained diff vs previous) (percentage) 0.200 -78.26%
401.bzip2 72.000 -
401.bzip2 (avg) 72.000 -
401.bzip2 (avg) (percentage) 2.610 -2.25%
401.bzip2 (max) 61.000 -3.17%
401.bzip2 (max) (percentage) 2.200 -5.98%
401.bzip2 (unexplained diff vs previous) 52.000 5100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.870 4575.00%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.990 -
403.gcc (max) 10.000 -
403.gcc (max) (percentage) 18.060 -1.79%
410.bwaves 55.000 -5.17%
410.bwaves (avg) 55.000 -5.17%
410.bwaves (avg) (percentage) 1.090 -4.39%
410.bwaves (max) 82.000 -7.87%
410.bwaves (max) (percentage) 1.610 -7.47%
410.bwaves (unexplained diff vs previous) 12.000 -42.86%
410.bwaves (unexplained diff vs previous) (percentage) 0.230 -43.90%
416.gamess 32.000 -5.88%
416.gamess (avg) 32.000 -5.88%
416.gamess (avg) (percentage) 0.230 -
416.gamess (max) 45.000 -16.67%
416.gamess (max) (percentage) 0.320 -15.79%
416.gamess (unexplained diff vs previous) 8.000 -85.45%
416.gamess (unexplained diff vs previous) (percentage) 0.060 -84.21%
429.mcf 65.000 -5.80%
429.mcf (avg) 65.000 -5.80%
429.mcf (avg) (percentage) 7.230 -5.37%
429.mcf (max) 6.000 -78.57%
429.mcf (max) (percentage) 0.660 -79.11%
429.mcf (unexplained diff vs previous) 3.000 -62.50%
429.mcf (unexplained diff vs previous) (percentage) 0.330 -62.07%
433.milc 14.000 -6.67%
433.milc (avg) 14.000 -6.67%
433.milc (avg) (percentage) 1.290 -4.44%
433.milc (max) 2.000 -66.67%
433.milc (max) (percentage) 0.200 -66.67%
433.milc (unexplained diff vs previous) 2.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.180 -33.33%
434.zeusmp 21.000 -
434.zeusmp (avg) 21.000 -
434.zeusmp (avg) (percentage) 0.900 1.12%
434.zeusmp (max) 26.000 62.50%
434.zeusmp (max) (percentage) 1.090 57.97%
434.zeusmp (unexplained diff vs previous) 26.000 100.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.080 96.36%
435.gromacs 151.000 -2.58%
435.gromacs (avg) 151.000 -2.58%
435.gromacs (avg) (percentage) 2.650 -
435.gromacs (max) 148.000 393.33%
435.gromacs (max) (percentage) 2.610 401.92%
435.gromacs (unexplained diff vs previous) 153.000 7550.00%
435.gromacs (unexplained diff vs previous) (percentage) 2.680 8833.33%
436.cactusADM 15.000 7.14%
436.cactusADM (avg) 15.000 7.14%
436.cactusADM (avg) (percentage) 0.660 8.20%
436.cactusADM (max) 34.000 30.77%
436.cactusADM (max) (percentage) 1.460 31.53%
436.cactusADM (unexplained diff vs previous) 35.000 250.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.480 252.38%
437.leslie3d 548.000 7.87%
437.leslie3d (avg) 548.000 7.87%
437.leslie3d (avg) (percentage) 4.920 1.65%
437.leslie3d (max) 684.000 -2.01%
437.leslie3d (max) (percentage) 6.140 -7.67%
437.leslie3d (unexplained diff vs previous) 645.000 -1.53%
437.leslie3d (unexplained diff vs previous) (percentage) 5.790 -7.21%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.740 1.37%
444.namd (max) 7.000 133.33%
444.namd (max) (percentage) 0.920 113.95%
444.namd (unexplained diff vs previous) 7.000 250.00%
444.namd (unexplained diff vs previous) (percentage) 0.910 250.00%
445.gobmk 42.000 -6.67%
445.gobmk (avg) 42.000 -6.67%
445.gobmk (avg) (percentage) 0.850 -7.61%
445.gobmk (max) 46.000 -20.69%
445.gobmk (max) (percentage) 0.930 -20.51%
445.gobmk (unexplained diff vs previous) 2.000 -92.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.040 -92.00%
447.dealII 20.000 -
447.dealII (avg) 20.000 -
447.dealII (avg) (percentage) 1.160 -1.69%
447.dealII (max) 23.000 -25.81%
447.dealII (max) (percentage) 1.370 -25.14%
447.dealII (unexplained diff vs previous) 17.000 -46.88%
447.dealII (unexplained diff vs previous) (percentage) 0.980 -47.31%
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.430 -5.81%
450.soplex (max) 3.000 -25.00%
450.soplex (max) (percentage) 0.700 -24.73%
450.soplex (unexplained diff vs previous) 2.000 -60.00%
450.soplex (unexplained diff vs previous) (percentage) 0.380 -59.57%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.980 -2.97%
453.povray (max) 4.000 -50.00%
453.povray (max) (percentage) 1.120 -39.78%
453.povray (unexplained diff vs previous) 3.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.680 -50.36%
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 4.350 -1.81%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.360 -5.26%
456.hmmer (unexplained diff vs previous) 8.000 -33.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.230 -34.29%
458.sjeng 41.000 -6.82%
458.sjeng (avg) 41.000 -6.82%
458.sjeng (avg) (percentage) 0.560 -6.67%
458.sjeng (max) 38.000 -5.00%
458.sjeng (max) (percentage) 0.510 -5.56%
458.sjeng (unexplained diff vs previous) 2.000 -87.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.030 -85.71%
459.GemsFDTD 72.000 -2.70%
459.GemsFDTD (avg) 72.000 -2.70%
459.GemsFDTD (avg) (percentage) 1.410 -1.40%
459.GemsFDTD (max) 53.000 20.45%
459.GemsFDTD (max) (percentage) 1.040 20.93%
459.GemsFDTD (unexplained diff vs previous) 54.000 285.71%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.050 288.89%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.680 1.20%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.300 -32.75%
462.libquantum (unexplained diff vs previous) 2.000 -33.33%
462.libquantum (unexplained diff vs previous) (percentage) 2.020 -31.99%
464.h264ref 22.000 -4.35%
464.h264ref (avg) 22.000 -4.35%
464.h264ref (avg) (percentage) 0.380 -7.32%
464.h264ref (max) 22.000 -31.25%
464.h264ref (max) (percentage) 0.390 -29.09%
464.h264ref (unexplained diff vs previous) 3.000 -88.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -88.37%
465.tonto 84.000 2.44%
465.tonto (avg) 84.000 2.44%
465.tonto (avg) (percentage) 0.860 1.18%
465.tonto (max) 112.000 -
465.tonto (max) (percentage) 1.140 -
465.tonto (unexplained diff vs previous) 88.000 -1.12%
465.tonto (unexplained diff vs previous) (percentage) 0.890 -2.20%
470.lbm 36.000 -5.26%
470.lbm (avg) 36.000 -5.26%
470.lbm (avg) (percentage) 0.960 -3.03%
470.lbm (max) 16.000 -5.88%
470.lbm (max) (percentage) 0.440 -4.35%
470.lbm (unexplained diff vs previous) 17.000 70.00%
470.lbm (unexplained diff vs previous) (percentage) 0.440 69.23%
471.omnetpp 41.000 -2.38%
471.omnetpp (avg) 41.000 -2.38%
471.omnetpp (avg) (percentage) 1.750 -
471.omnetpp (max) 48.000 20.00%
471.omnetpp (max) (percentage) 2.020 21.69%
471.omnetpp (unexplained diff vs previous) 49.000 19.51%
471.omnetpp (unexplained diff vs previous) (percentage) 2.060 21.89%
473.astar 85.000 -4.49%
473.astar (avg) 85.000 -4.49%
473.astar (avg) (percentage) 1.690 -3.43%
473.astar (max) 41.000 -25.45%
473.astar (max) (percentage) 0.820 -24.77%
473.astar (unexplained diff vs previous) 35.000 -36.36%
473.astar (unexplained diff vs previous) (percentage) 0.690 -36.11%
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.830 -2.35%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.520 -1.30%
482.sphinx3 (max) 8.000 14.29%
482.sphinx3 (max) (percentage) 1.170 27.17%
482.sphinx3 (unexplained diff vs previous) 9.000 28.57%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.190 30.77%
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.360 -2.16%
Geometric Mean 5.167 -4.93%