Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0e46a09d12aa9c2c77d783ace336866e429ffa73 (+ 44 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/80cf2c5e8f496bed9c6facf55f9ae31d0d90fd28 (+ 95 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0d50f477f47ba637b54fb03ac48d769ec4543e8d (+ 5 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7d29b7d082c9a9f66a6e5f3fc34827053e8d3cb7 (+ 190 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-arm-master-Os_LTO-build/5/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0005 (4-changed-components) 2023-01-21T18:31:44 0:00:00
Previous 0004 (glibc-2.37.9000-00125-g2ce48fbd5a1) 2023-02-22T22:50:20 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 87 122
Performance Improvements 134 100
Added Tests 9 0
Unchanged Tests 1006 1014
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 50939.68% 63.000 32155.000 - -1.03% -
403.gcc 14248.33% 60.000 8609.000 - -3.16% -
462.libquantum 10727.44% 164.000 17757.000 - 4.42% -
482.sphinx3 3562.38% 925.000 33877.000 - -7.40% -
450.soplex 2474.79% 595.000 15320.000 - -2.48% -
444.namd 1626.08% 901.000 15552.000 - -2.54% -
429.mcf 1471.01% 928.000 14579.000 - 24.32% -
453.povray 1360.75% 558.000 8151.000 - 10.22% -
433.milc 1067.82% 1125.000 13138.000 - -3.88% -
436.cactusADM 818.80% 2591.000 23806.000 - -2.42% -
434.zeusmp 670.55% 2727.000 21013.000 - 0.39% -
400.perlbench 610.32% 1580.000 11223.000 - 0.07% -
401.bzip2 434.66% 3006.000 16072.000 - -5.30% -
447.dealII 371.89% 1960.000 9249.000 - 1.63% -
470.lbm 356.59% 3743.000 17090.000 - 4.77% -
456.hmmer 321.63% 4461.000 18809.000 - -0.98% -
471.omnetpp 299.25% 2817.000 11247.000 - 21.39% -
481.wrf 255.00% 6291.000 22333.000 - 1.56% -
459.GemsFDTD 241.37% 7165.000 24459.000 - -3.57% -
473.astar 173.98% 4893.000 13406.000 - 3.26% -
445.gobmk 144.00% 5077.000 12388.000 - -0.06% -
410.bwaves 134.88% 5981.000 14048.000 - -4.73% -
464.h264ref 122.51% 6225.000 13851.000 - -8.92% -
458.sjeng 118.17% 7690.000 16777.000 - 4.74% -
435.gromacs 99.22% 7666.000 15272.000 - -9.38% -
416.gamess 87.33% 14820.000 27762.000 - -5.60% -
437.leslie3d 39.67% 12758.000 17819.000 - -1.39% -
465.tonto 2.71% 12963.000 13314.000 - 2.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) 14900.00% 1.000 150.000 - 188.46% -
454.calculix 14200.00% 4.000 572.000 - -13.20% -
454.calculix (avg) 14200.00% 4.000 572.000 - -13.20% -
436.cactusADM (unexplained diff vs previous) 5600.00% 1.000 57.000 - -95.14% -
482.sphinx3 (unexplained diff vs previous) 2550.00% 2.000 53.000 - -95.26% -
458.sjeng (unexplained diff vs previous) 2300.00% 2.000 48.000 - 0.00% -
429.mcf (unexplained diff vs previous) 1350.00% 2.000 29.000 - 190.00% -
450.soplex (unexplained diff vs previous) 1300.00% 2.000 28.000 - -59.42% -
459.GemsFDTD (unexplained diff vs previous) 1016.67% 6.000 67.000 - -88.53% -
482.sphinx3 1001.59% 63.000 694.000 - -19.21% -
482.sphinx3 (avg) 1001.59% 63.000 694.000 - -19.21% -
458.sjeng (unexplained diff vs previous) (percentage) 866.67% 0.030 0.290 - -3.33% -
481.wrf (unexplained diff vs previous) 708.33% 12.000 97.000 - -89.15% -
462.libquantum (unexplained diff vs previous) 700.00% 1.000 8.000 - -42.86% -
462.libquantum 644.44% 9.000 67.000 - 109.38% -
462.libquantum (avg) 644.44% 9.000 67.000 - 109.38% -
444.namd 636.36% 66.000 486.000 - 17.39% -
444.namd (avg) 636.36% 66.000 486.000 - 17.39% -
444.namd (unexplained diff vs previous) 600.00% 2.000 14.000 - -98.32% -
454.calculix (unexplained diff vs previous) 600.00% 1.000 7.000 - -97.13% -
454.calculix (max) 536.36% 55.000 350.000 - 28.68% -
436.cactusADM (unexplained diff vs previous) (percentage) 500.00% 0.040 0.240 - -95.01% -
471.omnetpp (unexplained diff vs previous) 362.50% 8.000 37.000 - -40.32% -
410.bwaves (unexplained diff vs previous) 360.00% 20.000 92.000 - -64.20% -
453.povray (unexplained diff vs previous) 333.33% 3.000 13.000 - -92.31% -
453.povray 315.79% 38.000 158.000 - 39.82% -
453.povray (avg) 315.79% 38.000 158.000 - 39.82% -
465.tonto (max) 308.33% 132.000 539.000 - 141.70% -
465.tonto (max) (percentage) 297.06% 1.020 4.050 - 136.84% -
436.cactusADM 268.02% 172.000 633.000 - 8.21% -
436.cactusADM (avg) 268.02% 172.000 633.000 - 8.21% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 237.50% 0.080 0.270 - -88.26% -
429.mcf 224.00% 75.000 243.000 - 333.93% -
429.mcf (avg) 224.00% 75.000 243.000 - 333.93% -
433.milc (unexplained diff vs previous) 200.00% 3.000 9.000 - -90.62% -
400.perlbench (unexplained diff vs previous) 190.00% 10.000 29.000 - -17.14% -
470.lbm 139.30% 257.000 615.000 - 1.15% -
470.lbm (avg) 139.30% 257.000 615.000 - 1.15% -
481.wrf (unexplained diff vs previous) (percentage) 126.32% 0.190 0.430 - -89.43% -
450.soplex 118.75% 32.000 70.000 - 89.19% -
450.soplex (avg) 118.75% 32.000 70.000 - 89.19% -
401.bzip2 (unexplained diff vs previous) 100.00% 6.000 12.000 - -82.61% -
410.bwaves (unexplained diff vs previous) (percentage) 96.97% 0.330 0.650 - -62.64% -
433.milc 95.08% 61.000 119.000 - 26.60% -
433.milc (avg) 95.08% 61.000 119.000 - 26.60% -
434.zeusmp 94.74% 152.000 296.000 - 16.08% -
434.zeusmp (avg) 94.74% 152.000 296.000 - 16.08% -
483.xalancbmk (max) (percentage) 76.50% 2.340 4.130 - 348.91% -
481.wrf 37.22% 395.000 542.000 - -4.07% -
481.wrf (avg) 37.22% 395.000 542.000 - -4.07% -
464.h264ref (unexplained diff vs previous) 33.33% 9.000 12.000 - -79.31% -
482.sphinx3 (max) 29.73% 676.000 877.000 - -23.87% -
471.omnetpp (unexplained diff vs previous) (percentage) 17.86% 0.280 0.330 - -50.75% -
410.bwaves 17.01% 288.000 337.000 - 16.61% -
410.bwaves (avg) 17.01% 288.000 337.000 - 16.61% -
471.omnetpp 14.01% 207.000 236.000 - 116.51% -
471.omnetpp (avg) 14.01% 207.000 236.000 - 116.51% -
459.GemsFDTD 4.82% 394.000 413.000 - 17.33% -
459.GemsFDTD (avg) 4.82% 394.000 413.000 - 17.33% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) (percentage) -99.88% 74.280 0.090 - 12.50% -
429.mcf (max) (percentage) -99.54% 69.030 0.320 - 0.00% -
445.gobmk (max) (percentage) -99.40% 43.170 0.260 - -3.70% -
458.sjeng (max) (percentage) -99.36% 45.210 0.290 - -3.33% -
450.soplex (max) (percentage) -99.17% 72.170 0.600 - 36.36% -
400.perlbench (max) (percentage) -98.95% 64.820 0.680 - -15.00% -
454.calculix (max) (percentage) -98.75% 87.320 1.090 - 29.76% -
454.calculix (unexplained diff vs previous) (percentage) -98.74% 1.590 0.020 - -97.33% -
464.h264ref (max) (percentage) -98.65% 43.660 0.590 - 51.28% -
458.sjeng (max) -98.62% 3476.000 48.000 - 0.00% -
456.hmmer (max) (percentage) -98.56% 57.730 0.830 - 59.62% -
445.gobmk (max) -98.54% 2191.000 32.000 - -3.03% -
473.astar (unexplained diff vs previous) (percentage) -98.46% 0.650 0.010 - -97.87% -
401.bzip2 (max) (percentage) -97.96% 61.280 1.250 - 212.50% -
433.milc (max) (percentage) -97.78% 68.810 1.530 - 115.49% -
453.povray (max) (percentage) -97.52% 77.460 1.920 - -25.87% -
434.zeusmp (max) (percentage) -97.04% 65.200 1.930 - -16.09% -
464.h264ref (max) -97.02% 2717.000 81.000 - 37.29% -
434.zeusmp (unexplained diff vs previous) (percentage) -96.97% 0.660 0.020 - -99.11% -
447.dealII (max) (percentage) -96.80% 73.530 2.350 - 42.42% -
482.sphinx3 (max) (percentage) -96.46% 73.120 2.590 - -17.78% -
473.astar (max) (percentage) -96.30% 45.900 1.700 - 261.70% -
435.gromacs (max) (percentage) -95.94% 44.330 1.800 - 2.27% -
447.dealII (unexplained diff vs previous) (percentage) -95.93% 3.930 0.160 - -78.67% -
459.GemsFDTD (max) (percentage) -95.66% 53.920 2.340 - 2.63% -
416.gamess (max) (percentage) -94.52% 40.890 2.240 - -28.66% -
444.namd (max) (percentage) -94.25% 78.580 4.520 - -17.97% -
445.gobmk (avg) (percentage) -94.01% 3.840 0.230 - 4.55% -
481.wrf (max) (percentage) -93.98% 53.510 3.220 - -22.60% -
456.hmmer (max) -93.94% 2575.000 156.000 - 59.18% -
473.astar (unexplained diff vs previous) -93.75% 32.000 2.000 - -96.72% -
436.cactusADM (max) (percentage) -93.68% 67.050 4.240 - -16.04% -
462.libquantum (avg) (percentage) -93.19% 5.580 0.380 - 100.00% -
429.mcf (max) -92.81% 640.000 46.000 - 24.32% -
400.perlbench (max) -92.58% 1024.000 76.000 - -14.61% -
456.hmmer (avg) (percentage) -92.44% 4.100 0.310 - 3.33% -
435.gromacs (max) -91.94% 3398.000 274.000 - -7.43% -
462.libquantum (unexplained diff vs previous) (percentage) -91.80% 0.610 0.050 - -37.50% -
450.soplex (avg) (percentage) -91.67% 5.520 0.460 - 91.67% -
437.leslie3d (unexplained diff vs previous) (percentage) -91.45% 4.560 0.390 - -62.14% -
400.perlbench (avg) (percentage) -91.02% 5.120 0.460 - 17.95% -
470.lbm (max) (percentage) -90.20% 57.860 5.670 - 3.47% -
473.astar (max) -89.89% 2245.000 227.000 - 272.13% -
416.gamess (max) -89.75% 6059.000 621.000 - -32.72% -
401.bzip2 (max) -89.14% 1842.000 200.000 - 198.51% -
410.bwaves (max) (percentage) -88.17% 45.050 5.330 - 201.13% -
437.leslie3d (unexplained diff vs previous) -88.14% 582.000 69.000 - -63.10% -
401.bzip2 (avg) (percentage) -88.14% 5.480 0.650 - 140.74% -
462.libquantum (max) -87.60% 121.000 15.000 - 15.38% -
473.astar (avg) (percentage) -87.34% 3.950 0.500 - 25.00% -
437.leslie3d (max) (percentage) -86.98% 27.340 3.560 - 14.84% -
458.sjeng (avg) (percentage) -85.60% 3.610 0.520 - 126.09% -
445.gobmk -85.57% 194.000 28.000 - 3.70% -
445.gobmk (avg) -85.57% 194.000 28.000 - 3.70% -
459.GemsFDTD (max) -85.19% 3863.000 572.000 - -1.04% -
447.dealII (max) -84.94% 1441.000 217.000 - 44.67% -
433.milc (avg) (percentage) -83.24% 5.430 0.910 - 31.88% -
437.leslie3d (max) -81.82% 3488.000 634.000 - 13.21% -
416.gamess (unexplained diff vs previous) (percentage) -81.82% 0.220 0.040 - -98.69% -
464.h264ref (avg) (percentage) -81.80% 4.560 0.830 - 112.82% -
447.dealII (unexplained diff vs previous) -80.52% 77.000 15.000 - -77.94% -
447.dealII (avg) (percentage) -79.61% 5.590 1.140 - 31.03% -
429.mcf (avg) (percentage) -79.46% 8.130 1.670 - 247.92% -
450.soplex (max) -78.79% 429.000 91.000 - 31.88% -
481.wrf (max) -78.64% 3366.000 719.000 - -21.33% -
470.lbm (unexplained diff vs previous) (percentage) -77.36% 0.530 0.120 - -97.62% -
434.zeusmp (max) -77.22% 1778.000 405.000 - -15.80% -
471.omnetpp (max) (percentage) -75.89% 51.810 12.490 - 571.51% -
434.zeusmp (avg) (percentage) -74.78% 5.590 1.410 - 15.57% -
433.milc (unexplained diff vs previous) (percentage) -74.07% 0.270 0.070 - -90.00% -
433.milc (max) -74.03% 774.000 201.000 - 107.22% -
454.calculix (avg) (percentage) -74.01% 6.850 1.780 - -12.32% -
410.bwaves (max) -72.23% 2694.000 748.000 - 187.69% -
434.zeusmp (unexplained diff vs previous) -72.22% 18.000 5.000 - -98.94% -
453.povray (avg) (percentage) -71.74% 6.900 1.950 - 27.45% -
471.omnetpp (avg) (percentage) -71.43% 7.350 2.100 - 77.97% -
435.gromacs (avg) (percentage) -71.20% 5.070 1.460 - 53.68% -
445.gobmk (unexplained diff vs previous) (percentage) -70.59% 0.510 0.150 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -70.37% 0.540 0.160 - -93.01% -
482.sphinx3 (avg) (percentage) -70.25% 6.890 2.050 - -12.77% -
459.GemsFDTD (avg) (percentage) -69.33% 5.510 1.690 - 21.58% -
458.sjeng -68.59% 277.000 87.000 - 141.67% -
458.sjeng (avg) -68.59% 277.000 87.000 - 141.67% -
456.hmmer -68.13% 182.000 58.000 - 3.57% -
456.hmmer (avg) -68.13% 182.000 58.000 - 3.57% -
435.gromacs (unexplained diff vs previous) (percentage) -65.57% 0.610 0.210 - -87.86% -
473.astar -65.28% 193.000 67.000 - 31.37% -
473.astar (avg) -65.28% 193.000 67.000 - 31.37% -
401.bzip2 (unexplained diff vs previous) (percentage) -65.00% 0.200 0.070 - -82.93% -
453.povray (max) -63.89% 432.000 156.000 - -18.32% -
416.gamess (unexplained diff vs previous) -63.64% 33.000 12.000 - -98.66% -
481.wrf (avg) (percentage) -61.31% 6.280 2.430 - -5.45% -
436.cactusADM (avg) (percentage) -60.06% 6.660 2.660 - 10.83% -
464.h264ref -59.72% 283.000 114.000 - 93.22% -
464.h264ref (avg) -59.72% 283.000 114.000 - 93.22% -
444.namd (unexplained diff vs previous) (percentage) -59.09% 0.220 0.090 - -98.28% -
400.perlbench (unexplained diff vs previous) (percentage) -58.73% 0.630 0.260 - -16.13% -
444.namd (avg) (percentage) -57.53% 7.370 3.130 - 20.38% -
416.gamess (avg) (percentage) -56.43% 4.200 1.830 - 10.91% -
470.lbm (max) -55.24% 2165.000 969.000 - 8.51% -
410.bwaves (avg) (percentage) -50.21% 4.820 2.400 - 22.45% -
437.leslie3d (avg) (percentage) -47.63% 3.170 1.660 - -0.60% -
470.lbm (avg) (percentage) -47.60% 6.870 3.600 - -3.49% -
450.soplex (unexplained diff vs previous) (percentage) -47.06% 0.340 0.180 - -59.09% -
435.gromacs -42.78% 388.000 222.000 - 38.75% -
435.gromacs (avg) -42.78% 388.000 222.000 - 38.75% -
436.cactusADM (max) -41.91% 1737.000 1009.000 - -18.03% -
403.gcc (avg) (percentage) -41.49% 0.940 0.550 - 27.91% -
401.bzip2 -36.59% 164.000 104.000 - 131.11% -
401.bzip2 (avg) -36.59% 164.000 104.000 - 131.11% -
400.perlbench -36.25% 80.000 51.000 - 18.60% -
400.perlbench (avg) -36.25% 80.000 51.000 - 18.60% -
464.h264ref (unexplained diff vs previous) (percentage) -35.71% 0.140 0.090 - -76.32% -
435.gromacs (unexplained diff vs previous) -31.91% 47.000 32.000 - -89.04% -
482.sphinx3 (unexplained diff vs previous) (percentage) -27.27% 0.220 0.160 - -94.77% -
437.leslie3d -26.98% 404.000 295.000 - -1.99% -
437.leslie3d (avg) -26.98% 404.000 295.000 - -1.99% -
445.gobmk (unexplained diff vs previous) -26.92% 26.000 19.000 - 5.56% -
465.tonto (unexplained diff vs previous) (percentage) -23.08% 0.260 0.200 - -82.30% -
465.tonto (unexplained diff vs previous) -20.59% 34.000 27.000 - -81.76% -
416.gamess -18.33% 622.000 508.000 - 4.74% -
416.gamess (avg) -18.33% 622.000 508.000 - 4.74% -
465.tonto (avg) (percentage) -16.23% 1.540 1.290 - 13.16% -
465.tonto -14.07% 199.000 171.000 - 15.54% -
465.tonto (avg) -14.07% 199.000 171.000 - 15.54% -
483.xalancbmk (avg) (percentage) -11.40% 1.140 1.010 - 80.36% -
403.gcc (max) (percentage) -11.17% 1.970 1.750 - 196.61% -
429.mcf (unexplained diff vs previous) (percentage) -9.09% 0.220 0.200 - 122.22% -
471.omnetpp (max) -3.77% 1459.000 1404.000 - 716.28% -
447.dealII -3.67% 109.000 105.000 - 32.91% -
447.dealII (avg) -3.67% 109.000 105.000 - 32.91% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 3.57% 28.000 29.000 - 0.00% -
nb_execution_successful 3.57% 28.000 29.000 - 0.00% -
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.32% 11727.000 14579.000 - 1471.01% -
471.omnetpp 21.39% 9265.000 11247.000 - 299.25% -
453.povray 10.22% 7395.000 8151.000 - 1360.75% -
483.xalancbmk 7.69% 8027.000 8644.000 - 0.00% -
470.lbm 4.77% 16312.000 17090.000 - 356.59% -
458.sjeng 4.74% 16018.000 16777.000 - 118.17% -
462.libquantum 4.42% 17005.000 17757.000 - 10727.44% -
473.astar 3.26% 12983.000 13406.000 - 173.98% -
465.tonto 2.07% 13044.000 13314.000 - 2.71% -
447.dealII 1.63% 9101.000 9249.000 - 371.89% -
481.wrf 1.56% 21991.000 22333.000 - 255.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (max) 716.28% 172.000 1404.000 - -3.77% -
471.omnetpp (max) (percentage) 571.51% 1.860 12.490 - -75.89% -
483.xalancbmk (max) 387.67% 73.000 356.000 - 0.00% -
483.xalancbmk (max) (percentage) 348.91% 0.920 4.130 - 76.50% -
429.mcf 333.93% 56.000 243.000 - 224.00% -
429.mcf (avg) 333.93% 56.000 243.000 - 224.00% -
473.astar (max) 272.13% 61.000 227.000 - -89.89% -
473.astar (max) (percentage) 261.70% 0.470 1.700 - -96.30% -
429.mcf (avg) (percentage) 247.92% 0.480 1.670 - -79.46% -
401.bzip2 (max) (percentage) 212.50% 0.400 1.250 - -97.96% -
410.bwaves (max) (percentage) 201.13% 1.770 5.330 - -88.17% -
401.bzip2 (max) 198.51% 67.000 200.000 - -89.14% -
403.gcc (max) (percentage) 196.61% 0.590 1.750 - -11.17% -
429.mcf (unexplained diff vs previous) 190.00% 10.000 29.000 - 1350.00% -
403.gcc (max) 188.46% 52.000 150.000 - 14900.00% -
410.bwaves (max) 187.69% 260.000 748.000 - -72.23% -
465.tonto (max) 141.70% 223.000 539.000 - 308.33% -
458.sjeng 141.67% 36.000 87.000 - -68.59% -
458.sjeng (avg) 141.67% 36.000 87.000 - -68.59% -
401.bzip2 (avg) (percentage) 140.74% 0.270 0.650 - -88.14% -
465.tonto (max) (percentage) 136.84% 1.710 4.050 - 297.06% -
401.bzip2 131.11% 45.000 104.000 - -36.59% -
401.bzip2 (avg) 131.11% 45.000 104.000 - -36.59% -
458.sjeng (avg) (percentage) 126.09% 0.230 0.520 - -85.60% -
429.mcf (unexplained diff vs previous) (percentage) 122.22% 0.090 0.200 - -9.09% -
471.omnetpp 116.51% 109.000 236.000 - 14.01% -
471.omnetpp (avg) 116.51% 109.000 236.000 - 14.01% -
433.milc (max) (percentage) 115.49% 0.710 1.530 - -97.78% -
464.h264ref (avg) (percentage) 112.82% 0.390 0.830 - -81.80% -
462.libquantum 109.38% 32.000 67.000 - 644.44% -
462.libquantum (avg) 109.38% 32.000 67.000 - 644.44% -
433.milc (max) 107.22% 97.000 201.000 - -74.03% -
462.libquantum (avg) (percentage) 100.00% 0.190 0.380 - -93.19% -
483.xalancbmk 97.73% 44.000 87.000 - 0.00% -
483.xalancbmk (avg) 97.73% 44.000 87.000 - 0.00% -
464.h264ref 93.22% 59.000 114.000 - -59.72% -
464.h264ref (avg) 93.22% 59.000 114.000 - -59.72% -
450.soplex (avg) (percentage) 91.67% 0.240 0.460 - -91.67% -
450.soplex 89.19% 37.000 70.000 - 118.75% -
450.soplex (avg) 89.19% 37.000 70.000 - 118.75% -
483.xalancbmk (avg) (percentage) 80.36% 0.560 1.010 - -11.40% -
471.omnetpp (avg) (percentage) 77.97% 1.180 2.100 - -71.43% -
456.hmmer (max) (percentage) 59.62% 0.520 0.830 - -98.56% -
456.hmmer (max) 59.18% 98.000 156.000 - -93.94% -
435.gromacs (avg) (percentage) 53.68% 0.950 1.460 - -71.20% -
464.h264ref (max) (percentage) 51.28% 0.390 0.590 - -98.65% -
447.dealII (max) 44.67% 150.000 217.000 - -84.94% -
447.dealII (max) (percentage) 42.42% 1.650 2.350 - -96.80% -
453.povray 39.82% 113.000 158.000 - 315.79% -
453.povray (avg) 39.82% 113.000 158.000 - 315.79% -
435.gromacs 38.75% 160.000 222.000 - -42.78% -
435.gromacs (avg) 38.75% 160.000 222.000 - -42.78% -
464.h264ref (max) 37.29% 59.000 81.000 - -97.02% -
450.soplex (max) (percentage) 36.36% 0.440 0.600 - -99.17% -
447.dealII 32.91% 79.000 105.000 - -3.67% -
447.dealII (avg) 32.91% 79.000 105.000 - -3.67% -
433.milc (avg) (percentage) 31.88% 0.690 0.910 - -83.24% -
450.soplex (max) 31.88% 69.000 91.000 - -78.79% -
473.astar 31.37% 51.000 67.000 - -65.28% -
473.astar (avg) 31.37% 51.000 67.000 - -65.28% -
447.dealII (avg) (percentage) 31.03% 0.870 1.140 - -79.61% -
454.calculix (max) (percentage) 29.76% 0.840 1.090 - -98.75% -
454.calculix (max) 28.68% 272.000 350.000 - 536.36% -
403.gcc (avg) (percentage) 27.91% 0.430 0.550 - -41.49% -
453.povray (avg) (percentage) 27.45% 1.530 1.950 - -71.74% -
433.milc 26.60% 94.000 119.000 - 95.08% -
433.milc (avg) 26.60% 94.000 119.000 - 95.08% -
473.astar (avg) (percentage) 25.00% 0.400 0.500 - -87.34% -
429.mcf (max) 24.32% 37.000 46.000 - -92.81% -
403.gcc 23.68% 38.000 47.000 - 0.00% -
403.gcc (avg) 23.68% 38.000 47.000 - 0.00% -
410.bwaves (avg) (percentage) 22.45% 1.960 2.400 - -50.21% -
459.GemsFDTD (avg) (percentage) 21.58% 1.390 1.690 - -69.33% -
444.namd (avg) (percentage) 20.38% 2.600 3.130 - -57.53% -
400.perlbench 18.60% 43.000 51.000 - -36.25% -
400.perlbench (avg) 18.60% 43.000 51.000 - -36.25% -
400.perlbench (avg) (percentage) 17.95% 0.390 0.460 - -91.02% -
444.namd 17.39% 414.000 486.000 - 636.36% -
444.namd (avg) 17.39% 414.000 486.000 - 636.36% -
459.GemsFDTD 17.33% 352.000 413.000 - 4.82% -
459.GemsFDTD (avg) 17.33% 352.000 413.000 - 4.82% -
410.bwaves 16.61% 289.000 337.000 - 17.01% -
410.bwaves (avg) 16.61% 289.000 337.000 - 17.01% -
434.zeusmp 16.08% 255.000 296.000 - 94.74% -
434.zeusmp (avg) 16.08% 255.000 296.000 - 94.74% -
434.zeusmp (avg) (percentage) 15.57% 1.220 1.410 - -74.78% -
465.tonto 15.54% 148.000 171.000 - -14.07% -
465.tonto (avg) 15.54% 148.000 171.000 - -14.07% -
462.libquantum (max) 15.38% 13.000 15.000 - -87.60% -
437.leslie3d (max) (percentage) 14.84% 3.100 3.560 - -86.98% -
437.leslie3d (max) 13.21% 560.000 634.000 - -81.82% -
465.tonto (avg) (percentage) 13.16% 1.140 1.290 - -16.23% -
416.gamess (avg) (percentage) 10.91% 1.650 1.830 - -56.43% -
436.cactusADM (avg) (percentage) 10.83% 2.400 2.660 - -60.06% -
470.lbm (max) 8.51% 893.000 969.000 - -55.24% -
436.cactusADM 8.21% 585.000 633.000 - 268.02% -
436.cactusADM (avg) 8.21% 585.000 633.000 - 268.02% -
445.gobmk (unexplained diff vs previous) 5.56% 18.000 19.000 - -26.92% -
416.gamess 4.74% 485.000 508.000 - -18.33% -
416.gamess (avg) 4.74% 485.000 508.000 - -18.33% -
445.gobmk (avg) (percentage) 4.55% 0.220 0.230 - -94.01% -
445.gobmk 3.70% 27.000 28.000 - -85.57% -
445.gobmk (avg) 3.70% 27.000 28.000 - -85.57% -
456.hmmer 3.57% 56.000 58.000 - -68.13% -
456.hmmer (avg) 3.57% 56.000 58.000 - -68.13% -
470.lbm (max) (percentage) 3.47% 5.480 5.670 - -90.20% -
456.hmmer (avg) (percentage) 3.33% 0.300 0.310 - -92.44% -
459.GemsFDTD (max) (percentage) 2.63% 2.280 2.340 - -95.66% -
435.gromacs (max) (percentage) 2.27% 1.760 1.800 - -95.94% -
470.lbm 1.15% 608.000 615.000 - 139.30% -
470.lbm (avg) 1.15% 608.000 615.000 - 139.30% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
435.gromacs -9.38% 16853.000 15272.000 - 99.22% -
464.h264ref -8.92% 15208.000 13851.000 - 122.51% -
482.sphinx3 -7.40% 36586.000 33877.000 - 3562.38% -
416.gamess -5.60% 29409.000 27762.000 - 87.33% -
401.bzip2 -5.30% 16971.000 16072.000 - 434.66% -
410.bwaves -4.73% 14745.000 14048.000 - 134.88% -
433.milc -3.88% 13668.000 13138.000 - 1067.82% -
459.GemsFDTD -3.57% 25364.000 24459.000 - 241.37% -
403.gcc -3.16% 8890.000 8609.000 - 14248.33% -
444.namd -2.54% 15957.000 15552.000 - 1626.08% -
450.soplex -2.48% 15709.000 15320.000 - 2474.79% -
436.cactusADM -2.42% 24396.000 23806.000 - 818.80% -
437.leslie3d -1.39% 18070.000 17819.000 - 39.67% -
454.calculix -1.03% 32491.000 32155.000 - 50939.68% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp (unexplained diff vs previous) (percentage) -99.11% 2.250 0.020 - -96.97% -
434.zeusmp (unexplained diff vs previous) -98.94% 470.000 5.000 - -72.22% -
416.gamess (unexplained diff vs previous) (percentage) -98.69% 3.050 0.040 - -81.82% -
416.gamess (unexplained diff vs previous) -98.66% 896.000 12.000 - -63.64% -
444.namd (unexplained diff vs previous) -98.32% 834.000 14.000 - 600.00% -
444.namd (unexplained diff vs previous) (percentage) -98.28% 5.230 0.090 - -59.09% -
473.astar (unexplained diff vs previous) (percentage) -97.87% 0.470 0.010 - -98.46% -
470.lbm (unexplained diff vs previous) (percentage) -97.62% 5.040 0.120 - -77.36% -
470.lbm (unexplained diff vs previous) -97.57% 822.000 20.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -97.33% 0.750 0.020 - -98.74% -
454.calculix (unexplained diff vs previous) -97.13% 244.000 7.000 - 600.00% -
473.astar (unexplained diff vs previous) -96.72% 61.000 2.000 - -93.75% -
482.sphinx3 (unexplained diff vs previous) -95.26% 1118.000 53.000 - 2550.00% -
436.cactusADM (unexplained diff vs previous) -95.14% 1173.000 57.000 - 5600.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -95.01% 4.810 0.240 - 500.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -94.77% 3.060 0.160 - -27.27% -
453.povray (unexplained diff vs previous) (percentage) -93.01% 2.290 0.160 - -70.37% -
453.povray (unexplained diff vs previous) -92.31% 169.000 13.000 - 333.33% -
433.milc (unexplained diff vs previous) -90.62% 96.000 9.000 - 200.00% -
433.milc (unexplained diff vs previous) (percentage) -90.00% 0.700 0.070 - -74.07% -
481.wrf (unexplained diff vs previous) (percentage) -89.43% 4.070 0.430 - 126.32% -
481.wrf (unexplained diff vs previous) -89.15% 894.000 97.000 - 708.33% -
435.gromacs (unexplained diff vs previous) -89.04% 292.000 32.000 - -31.91% -
459.GemsFDTD (unexplained diff vs previous) -88.53% 584.000 67.000 - 1016.67% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -88.26% 2.300 0.270 - 237.50% -
435.gromacs (unexplained diff vs previous) (percentage) -87.86% 1.730 0.210 - -65.57% -
401.bzip2 (unexplained diff vs previous) (percentage) -82.93% 0.410 0.070 - -65.00% -
401.bzip2 (unexplained diff vs previous) -82.61% 69.000 12.000 - 100.00% -
465.tonto (unexplained diff vs previous) (percentage) -82.30% 1.130 0.200 - -23.08% -
465.tonto (unexplained diff vs previous) -81.76% 148.000 27.000 - -20.59% -
464.h264ref (unexplained diff vs previous) -79.31% 58.000 12.000 - 33.33% -
447.dealII (unexplained diff vs previous) (percentage) -78.67% 0.750 0.160 - -95.93% -
447.dealII (unexplained diff vs previous) -77.94% 68.000 15.000 - -80.52% -
464.h264ref (unexplained diff vs previous) (percentage) -76.32% 0.380 0.090 - -35.71% -
403.gcc (unexplained diff vs previous) -67.31% 52.000 17.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -65.52% 0.580 0.200 - 0.00% -
410.bwaves (unexplained diff vs previous) -64.20% 257.000 92.000 - 360.00% -
437.leslie3d (unexplained diff vs previous) -63.10% 187.000 69.000 - -88.14% -
410.bwaves (unexplained diff vs previous) (percentage) -62.64% 1.740 0.650 - 96.97% -
437.leslie3d (unexplained diff vs previous) (percentage) -62.14% 1.030 0.390 - -91.45% -
450.soplex (unexplained diff vs previous) -59.42% 69.000 28.000 - 1300.00% -
450.soplex (unexplained diff vs previous) (percentage) -59.09% 0.440 0.180 - -47.06% -
471.omnetpp (unexplained diff vs previous) (percentage) -50.75% 0.670 0.330 - 17.86% -
462.libquantum (unexplained diff vs previous) -42.86% 14.000 8.000 - 700.00% -
471.omnetpp (unexplained diff vs previous) -40.32% 62.000 37.000 - 362.50% -
456.hmmer (unexplained diff vs previous) (percentage) -38.46% 0.520 0.320 - 0.00% -
456.hmmer (unexplained diff vs previous) -37.76% 98.000 61.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -37.50% 0.080 0.050 - -91.80% -
416.gamess (max) -32.72% 923.000 621.000 - -89.75% -
416.gamess (max) (percentage) -28.66% 3.140 2.240 - -94.52% -
453.povray (max) (percentage) -25.87% 2.590 1.920 - -97.52% -
483.xalancbmk (unexplained diff vs previous) (percentage) -24.59% 0.610 0.460 - 0.00% -
482.sphinx3 (max) -23.87% 1152.000 877.000 - 29.73% -
481.wrf (max) (percentage) -22.60% 4.160 3.220 - -93.98% -
481.wrf (max) -21.33% 914.000 719.000 - -78.64% -
444.namd (max) -20.14% 879.000 702.000 - -0.85% -
482.sphinx3 -19.21% 859.000 694.000 - 1001.59% -
482.sphinx3 (avg) -19.21% 859.000 694.000 - 1001.59% -
483.xalancbmk (unexplained diff vs previous) -18.37% 49.000 40.000 - 0.00% -
453.povray (max) -18.32% 191.000 156.000 - -63.89% -
436.cactusADM (max) -18.03% 1231.000 1009.000 - -41.91% -
444.namd (max) (percentage) -17.97% 5.510 4.520 - -94.25% -
482.sphinx3 (max) (percentage) -17.78% 3.150 2.590 - -96.46% -
400.perlbench (unexplained diff vs previous) -17.14% 35.000 29.000 - 190.00% -
400.perlbench (unexplained diff vs previous) (percentage) -16.13% 0.310 0.260 - -58.73% -
434.zeusmp (max) (percentage) -16.09% 2.300 1.930 - -97.04% -
436.cactusADM (max) (percentage) -16.04% 5.050 4.240 - -93.68% -
434.zeusmp (max) -15.80% 481.000 405.000 - -77.22% -
400.perlbench (max) (percentage) -15.00% 0.800 0.680 - -98.95% -
400.perlbench (max) -14.61% 89.000 76.000 - -92.58% -
454.calculix -13.20% 659.000 572.000 - 14200.00% -
454.calculix (avg) -13.20% 659.000 572.000 - 14200.00% -
482.sphinx3 (avg) (percentage) -12.77% 2.350 2.050 - -70.25% -
454.calculix (avg) (percentage) -12.32% 2.030 1.780 - -74.01% -
435.gromacs (max) -7.43% 296.000 274.000 - -91.94% -
481.wrf (avg) (percentage) -5.45% 2.570 2.430 - -61.31% -
481.wrf -4.07% 565.000 542.000 - 37.22% -
481.wrf (avg) -4.07% 565.000 542.000 - 37.22% -
445.gobmk (max) (percentage) -3.70% 0.270 0.260 - -99.40% -
470.lbm (avg) (percentage) -3.49% 3.730 3.600 - -47.60% -
458.sjeng (max) (percentage) -3.33% 0.300 0.290 - -99.36% -
458.sjeng (unexplained diff vs previous) (percentage) -3.33% 0.300 0.290 - 866.67% -
445.gobmk (max) -3.03% 33.000 32.000 - -98.54% -
437.leslie3d -1.99% 301.000 295.000 - -26.98% -
437.leslie3d (avg) -1.99% 301.000 295.000 - -26.98% -
459.GemsFDTD (max) -1.04% 578.000 572.000 - -85.19% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 11223.000 610.32%
401.bzip2 16072.000 434.66%
403.gcc 8609.000 14248.33%
410.bwaves 14048.000 134.88%
416.gamess 27762.000 87.33%
429.mcf 14579.000 1471.01%
433.milc 13138.000 1067.82%
434.zeusmp 21013.000 670.55%
435.gromacs 15272.000 99.22%
436.cactusADM 23806.000 818.80%
437.leslie3d 17819.000 39.67%
444.namd 15552.000 1626.08%
445.gobmk 12388.000 144.00%
447.dealII 9249.000 371.89%
450.soplex 15320.000 2474.79%
453.povray 8151.000 1360.75%
454.calculix 32155.000 50939.68%
456.hmmer 18809.000 321.63%
458.sjeng 16777.000 118.17%
459.GemsFDTD 24459.000 241.37%
462.libquantum 17757.000 10727.44%
464.h264ref 13851.000 122.51%
465.tonto 13314.000 2.71%
470.lbm 17090.000 356.59%
471.omnetpp 11247.000 299.25%
473.astar 13406.000 173.98%
481.wrf 22333.000 255.00%
482.sphinx3 33877.000 3562.38%
483.xalancbmk 8644.000 -
Geometric Mean 15701.547 617.50%
Code Size (bytes)
Name Current %
400.perlbench 563471.000 -
401.bzip2 33660.000 -
403.gcc 1589843.000 -
410.bwaves 14722.000 -
416.gamess 4554464.000 -
429.mcf 7717.000 -
433.milc 47493.000 -
434.zeusmp 141060.000 -
435.gromacs 393982.000 -
436.cactusADM 256968.000 -
437.leslie3d 48001.000 -
444.namd 162769.000 -
445.gobmk 1088192.000 -
447.dealII 191120.000 -
450.soplex 135592.000 -
453.povray 488965.000 -
454.calculix 682304.000 -
456.hmmer 74969.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195766.000 -
462.libquantum 13066.000 -
464.h264ref 301358.000 -
465.tonto 1436045.000 -
470.lbm 10845.000 -
471.omnetpp 295648.000 -
473.astar 15549.000 -
481.wrf 1539717.000 -
482.sphinx3 80058.000 -
483.xalancbmk 1462834.000 -
Geometric Mean 169867.008 7.99%
Score
Name Current %
nb_compile_successful 29.000 3.57%
nb_execution_successful 29.000 3.57%
nb_total_tests 29.000 3.57%
Geometric Mean 29.000 3.57%
sample variability
Name Current %
400.perlbench 51.000 -36.25%
400.perlbench (avg) 51.000 -36.25%
400.perlbench (avg) (percentage) 0.460 -91.02%
400.perlbench (max) 76.000 -92.58%
400.perlbench (max) (percentage) 0.680 -98.95%
400.perlbench (unexplained diff vs previous) 29.000 190.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.260 -58.73%
401.bzip2 104.000 -36.59%
401.bzip2 (avg) 104.000 -36.59%
401.bzip2 (avg) (percentage) 0.650 -88.14%
401.bzip2 (max) 200.000 -89.14%
401.bzip2 (max) (percentage) 1.250 -97.96%
401.bzip2 (unexplained diff vs previous) 12.000 100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -65.00%
403.gcc 47.000 -
403.gcc (avg) 47.000 -
403.gcc (avg) (percentage) 0.550 -41.49%
403.gcc (max) 150.000 14900.00%
403.gcc (max) (percentage) 1.750 -11.17%
403.gcc (unexplained diff vs previous) 17.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.200 -
410.bwaves 337.000 17.01%
410.bwaves (avg) 337.000 17.01%
410.bwaves (avg) (percentage) 2.400 -50.21%
410.bwaves (max) 748.000 -72.23%
410.bwaves (max) (percentage) 5.330 -88.17%
410.bwaves (unexplained diff vs previous) 92.000 360.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.650 96.97%
416.gamess 508.000 -18.33%
416.gamess (avg) 508.000 -18.33%
416.gamess (avg) (percentage) 1.830 -56.43%
416.gamess (max) 621.000 -89.75%
416.gamess (max) (percentage) 2.240 -94.52%
416.gamess (unexplained diff vs previous) 12.000 -63.64%
416.gamess (unexplained diff vs previous) (percentage) 0.040 -81.82%
429.mcf 243.000 224.00%
429.mcf (avg) 243.000 224.00%
429.mcf (avg) (percentage) 1.670 -79.46%
429.mcf (max) 46.000 -92.81%
429.mcf (max) (percentage) 0.320 -99.54%
429.mcf (unexplained diff vs previous) 29.000 1350.00%
429.mcf (unexplained diff vs previous) (percentage) 0.200 -9.09%
433.milc 119.000 95.08%
433.milc (avg) 119.000 95.08%
433.milc (avg) (percentage) 0.910 -83.24%
433.milc (max) 201.000 -74.03%
433.milc (max) (percentage) 1.530 -97.78%
433.milc (unexplained diff vs previous) 9.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 0.070 -74.07%
434.zeusmp 296.000 94.74%
434.zeusmp (avg) 296.000 94.74%
434.zeusmp (avg) (percentage) 1.410 -74.78%
434.zeusmp (max) 405.000 -77.22%
434.zeusmp (max) (percentage) 1.930 -97.04%
434.zeusmp (unexplained diff vs previous) 5.000 -72.22%
434.zeusmp (unexplained diff vs previous) (percentage) 0.020 -96.97%
435.gromacs 222.000 -42.78%
435.gromacs (avg) 222.000 -42.78%
435.gromacs (avg) (percentage) 1.460 -71.20%
435.gromacs (max) 274.000 -91.94%
435.gromacs (max) (percentage) 1.800 -95.94%
435.gromacs (unexplained diff vs previous) 32.000 -31.91%
435.gromacs (unexplained diff vs previous) (percentage) 0.210 -65.57%
436.cactusADM 633.000 268.02%
436.cactusADM (avg) 633.000 268.02%
436.cactusADM (avg) (percentage) 2.660 -60.06%
436.cactusADM (max) 1009.000 -41.91%
436.cactusADM (max) (percentage) 4.240 -93.68%
436.cactusADM (unexplained diff vs previous) 57.000 5600.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.240 500.00%
437.leslie3d 295.000 -26.98%
437.leslie3d (avg) 295.000 -26.98%
437.leslie3d (avg) (percentage) 1.660 -47.63%
437.leslie3d (max) 634.000 -81.82%
437.leslie3d (max) (percentage) 3.560 -86.98%
437.leslie3d (unexplained diff vs previous) 69.000 -88.14%
437.leslie3d (unexplained diff vs previous) (percentage) 0.390 -91.45%
444.namd 486.000 636.36%
444.namd (avg) 486.000 636.36%
444.namd (avg) (percentage) 3.130 -57.53%
444.namd (max) 702.000 -
444.namd (max) (percentage) 4.520 -94.25%
444.namd (unexplained diff vs previous) 14.000 600.00%
444.namd (unexplained diff vs previous) (percentage) 0.090 -59.09%
445.gobmk 28.000 -85.57%
445.gobmk (avg) 28.000 -85.57%
445.gobmk (avg) (percentage) 0.230 -94.01%
445.gobmk (max) 32.000 -98.54%
445.gobmk (max) (percentage) 0.260 -99.40%
445.gobmk (unexplained diff vs previous) 19.000 -26.92%
445.gobmk (unexplained diff vs previous) (percentage) 0.150 -70.59%
447.dealII 105.000 -3.67%
447.dealII (avg) 105.000 -3.67%
447.dealII (avg) (percentage) 1.140 -79.61%
447.dealII (max) 217.000 -84.94%
447.dealII (max) (percentage) 2.350 -96.80%
447.dealII (unexplained diff vs previous) 15.000 -80.52%
447.dealII (unexplained diff vs previous) (percentage) 0.160 -95.93%
450.soplex 70.000 118.75%
450.soplex (avg) 70.000 118.75%
450.soplex (avg) (percentage) 0.460 -91.67%
450.soplex (max) 91.000 -78.79%
450.soplex (max) (percentage) 0.600 -99.17%
450.soplex (unexplained diff vs previous) 28.000 1300.00%
450.soplex (unexplained diff vs previous) (percentage) 0.180 -47.06%
453.povray 158.000 315.79%
453.povray (avg) 158.000 315.79%
453.povray (avg) (percentage) 1.950 -71.74%
453.povray (max) 156.000 -63.89%
453.povray (max) (percentage) 1.920 -97.52%
453.povray (unexplained diff vs previous) 13.000 333.33%
453.povray (unexplained diff vs previous) (percentage) 0.160 -70.37%
454.calculix 572.000 14200.00%
454.calculix (avg) 572.000 14200.00%
454.calculix (avg) (percentage) 1.780 -74.01%
454.calculix (max) 350.000 536.36%
454.calculix (max) (percentage) 1.090 -98.75%
454.calculix (unexplained diff vs previous) 7.000 600.00%
454.calculix (unexplained diff vs previous) (percentage) 0.020 -98.74%
456.hmmer 58.000 -68.13%
456.hmmer (avg) 58.000 -68.13%
456.hmmer (avg) (percentage) 0.310 -92.44%
456.hmmer (max) 156.000 -93.94%
456.hmmer (max) (percentage) 0.830 -98.56%
456.hmmer (unexplained diff vs previous) 61.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.320 -
458.sjeng 87.000 -68.59%
458.sjeng (avg) 87.000 -68.59%
458.sjeng (avg) (percentage) 0.520 -85.60%
458.sjeng (max) 48.000 -98.62%
458.sjeng (max) (percentage) 0.290 -99.36%
458.sjeng (unexplained diff vs previous) 48.000 2300.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.290 866.67%
459.GemsFDTD 413.000 4.82%
459.GemsFDTD (avg) 413.000 4.82%
459.GemsFDTD (avg) (percentage) 1.690 -69.33%
459.GemsFDTD (max) 572.000 -85.19%
459.GemsFDTD (max) (percentage) 2.340 -95.66%
459.GemsFDTD (unexplained diff vs previous) 67.000 1016.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.270 237.50%
462.libquantum 67.000 644.44%
462.libquantum (avg) 67.000 644.44%
462.libquantum (avg) (percentage) 0.380 -93.19%
462.libquantum (max) 15.000 -87.60%
462.libquantum (max) (percentage) 0.090 -99.88%
462.libquantum (unexplained diff vs previous) 8.000 700.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.050 -91.80%
464.h264ref 114.000 -59.72%
464.h264ref (avg) 114.000 -59.72%
464.h264ref (avg) (percentage) 0.830 -81.80%
464.h264ref (max) 81.000 -97.02%
464.h264ref (max) (percentage) 0.590 -98.65%
464.h264ref (unexplained diff vs previous) 12.000 33.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.090 -35.71%
465.tonto 171.000 -14.07%
465.tonto (avg) 171.000 -14.07%
465.tonto (avg) (percentage) 1.290 -16.23%
465.tonto (max) 539.000 308.33%
465.tonto (max) (percentage) 4.050 297.06%
465.tonto (unexplained diff vs previous) 27.000 -20.59%
465.tonto (unexplained diff vs previous) (percentage) 0.200 -23.08%
470.lbm 615.000 139.30%
470.lbm (avg) 615.000 139.30%
470.lbm (avg) (percentage) 3.600 -47.60%
470.lbm (max) 969.000 -55.24%
470.lbm (max) (percentage) 5.670 -90.20%
470.lbm (unexplained diff vs previous) 20.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.120 -77.36%
471.omnetpp 236.000 14.01%
471.omnetpp (avg) 236.000 14.01%
471.omnetpp (avg) (percentage) 2.100 -71.43%
471.omnetpp (max) 1404.000 -3.77%
471.omnetpp (max) (percentage) 12.490 -75.89%
471.omnetpp (unexplained diff vs previous) 37.000 362.50%
471.omnetpp (unexplained diff vs previous) (percentage) 0.330 17.86%
473.astar 67.000 -65.28%
473.astar (avg) 67.000 -65.28%
473.astar (avg) (percentage) 0.500 -87.34%
473.astar (max) 227.000 -89.89%
473.astar (max) (percentage) 1.700 -96.30%
473.astar (unexplained diff vs previous) 2.000 -93.75%
473.astar (unexplained diff vs previous) (percentage) 0.010 -98.46%
481.wrf 542.000 37.22%
481.wrf (avg) 542.000 37.22%
481.wrf (avg) (percentage) 2.430 -61.31%
481.wrf (max) 719.000 -78.64%
481.wrf (max) (percentage) 3.220 -93.98%
481.wrf (unexplained diff vs previous) 97.000 708.33%
481.wrf (unexplained diff vs previous) (percentage) 0.430 126.32%
482.sphinx3 694.000 1001.59%
482.sphinx3 (avg) 694.000 1001.59%
482.sphinx3 (avg) (percentage) 2.050 -70.25%
482.sphinx3 (max) 877.000 29.73%
482.sphinx3 (max) (percentage) 2.590 -96.46%
482.sphinx3 (unexplained diff vs previous) 53.000 2550.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.160 -27.27%
483.xalancbmk 87.000 -
483.xalancbmk (avg) 87.000 -
483.xalancbmk (avg) (percentage) 1.010 -11.40%
483.xalancbmk (max) 356.000 -
483.xalancbmk (max) (percentage) 4.130 76.50%
483.xalancbmk (unexplained diff vs previous) 40.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.460 -
Geometric Mean 12.337 -41.21%