Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e686338105177046975bcff8fe6199536e80caf9 (+ 59 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (efae253b9f863b066e899106d7f3ad9ef0cd3c58) (+ 261 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ab564362d0470d10947c24155ec048c4e14a009d (+ 16 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b4645e814de433b501c7e83de709a6e08e83388e (+ 771 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/306/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0306 (4-changed-components) 2024-10-12T22:52:42 0:00:00
Previous 0305 (3-changed-components) 2022-09-17T22:15:28 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 46 12
Performance Improvements 166 196
Added Tests 4 2
Unchanged Tests 1020 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.81% 1945391.000 1980515.000 - 1.77% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 31.68% 8412.000 11077.000 - 1.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) (percentage) 2612.50% 0.080 2.170 - -97.66% -
403.gcc (avg) (percentage) 1655.17% 0.290 5.090 - -30.46% -
429.mcf (avg) (percentage) 1412.50% 0.320 4.840 - -36.90% -
483.xalancbmk (avg) (percentage) 886.67% 0.300 2.960 - -54.46% -
403.gcc (max) (percentage) 786.05% 0.430 3.810 - -96.17% -
454.calculix (avg) (percentage) 665.96% 0.470 3.600 - -55.11% -
473.astar (max) (percentage) 505.26% 0.190 1.150 - -98.27% -
473.astar (avg) (percentage) 492.59% 0.270 1.600 - -61.54% -
401.bzip2 (avg) (percentage) 348.48% 0.330 1.480 - -72.99% -
483.xalancbmk (max) (percentage) 293.33% 0.450 1.770 - -97.42% -
429.mcf (unexplained diff vs previous) (percentage) 280.00% 0.050 0.190 - -99.99% -
473.astar (unexplained diff vs previous) (percentage) 262.50% 0.160 0.580 - -99.71% -
429.mcf (max) 238.46% 13.000 44.000 - -96.67% -
471.omnetpp (unexplained diff vs previous) (percentage) 195.52% 0.670 1.980 - -99.49% -
401.bzip2 (max) (percentage) 145.45% 0.330 0.810 - -98.97% -
401.bzip2 (unexplained diff vs previous) (percentage) 145.45% 0.330 0.810 - -99.78% -
458.sjeng (avg) (percentage) 138.46% 0.260 0.620 - -80.56% -
450.soplex (avg) (percentage) 127.93% 1.110 2.530 - -60.65% -
462.libquantum (avg) (percentage) 126.25% 0.800 1.810 - -76.37% -
473.astar (max) 123.08% 26.000 58.000 - -98.30% -
473.astar 115.79% 38.000 82.000 - -61.50% -
473.astar (avg) 115.79% 38.000 82.000 - -61.50% -
462.libquantum (unexplained diff vs previous) (percentage) 111.43% 0.350 0.740 - -99.99% -
464.h264ref (avg) (percentage) 97.37% 0.380 0.750 - -85.27% -
429.mcf 81.82% 55.000 100.000 - -8.26% -
429.mcf (avg) 81.82% 55.000 100.000 - -8.26% -
437.leslie3d (avg) (percentage) 73.83% 2.560 4.450 - 45.90% -
450.soplex (unexplained diff vs previous) (percentage) 67.55% 1.880 3.150 - -99.88% -
450.soplex (max) (percentage) 66.30% 1.840 3.060 - -96.82% -
462.libquantum (max) (percentage) 44.72% 1.230 1.780 - -98.20% -
400.perlbench (avg) (percentage) 42.14% 1.400 1.990 - -68.66% -
447.dealII (avg) (percentage) 41.86% 0.860 1.220 - -78.86% -
465.tonto 39.58% 96.000 134.000 - -63.29% -
465.tonto (avg) 39.58% 96.000 134.000 - -63.29% -
437.leslie3d 36.57% 361.000 493.000 - 38.87% -
437.leslie3d (avg) 36.57% 361.000 493.000 - 38.87% -
473.astar (unexplained diff vs previous) 36.36% 22.000 30.000 - -99.70% -
445.gobmk (avg) (percentage) 33.33% 0.660 0.880 - -77.49% -
454.calculix (max) (percentage) 25.76% 0.660 0.830 - -99.17% -
458.sjeng 25.00% 36.000 45.000 - -81.33% -
458.sjeng (avg) 25.00% 36.000 45.000 - -81.33% -
465.tonto (avg) (percentage) 5.22% 1.150 1.210 - -63.77% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -7.71% 252076.000 232648.000 - -4.94% -
434.zeusmp -4.70% 153897.000 146667.000 - -3.53% -
435.gromacs -2.88% 504291.000 489749.000 - -1.91% -
450.soplex -2.13% 206988.000 202574.000 - -1.22% -
464.h264ref -1.98% 387188.000 379508.000 - -2.13% -
447.dealII -1.89% 312932.000 307028.000 - -1.46% -
453.povray -1.83% 661943.000 649825.000 - -1.75% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
458.sjeng -1.67% 104024.000 102284.000 - -1.70% -
471.omnetpp -1.47% 482480.000 475388.000 - -0.55% -
444.namd -1.35% 188301.000 185768.000 - -1.39% -
456.hmmer -1.33% 108631.000 107191.000 - -1.38% -
436.cactusADM -1.23% 352679.000 348331.000 - -1.29% -
433.milc -1.18% 61230.000 60509.000 - -1.42% -
401.bzip2 -1.14% 44221.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111659.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.82% 11556.000 136.000 - -2.86% -
482.sphinx3 -97.26% 30176.000 826.000 - -12.59% -
450.soplex -96.38% 15755.000 571.000 - 0.71% -
453.povray -91.55% 6543.000 553.000 - 1.10% -
444.namd -91.36% 9013.000 779.000 - 4.28% -
433.milc -91.15% 12956.000 1146.000 - -0.43% -
436.cactusADM -88.05% 17681.000 2113.000 - 1.44% -
429.mcf -88.01% 17283.000 2072.000 - 45.51% -
400.perlbench -85.71% 10957.000 1566.000 - -5.83% -
434.zeusmp -81.26% 13487.000 2528.000 - 0.56% -
447.dealII -81.22% 8838.000 1660.000 - -3.71% -
401.bzip2 -80.30% 14997.000 2955.000 - 0.48% -
459.GemsFDTD -77.26% 23642.000 5376.000 - -12.91% -
471.omnetpp -75.14% 10769.000 2677.000 - -1.73% -
456.hmmer -74.13% 11090.000 2869.000 - -0.45% -
470.lbm -70.43% 12804.000 3786.000 - -0.05% -
473.astar -63.79% 14167.000 5130.000 - 0.04% -
464.h264ref -57.71% 13740.000 5810.000 - 0.85% -
410.bwaves -57.59% 13997.000 5936.000 - 5.02% -
445.gobmk -57.15% 11551.000 4950.000 - -1.45% -
435.gromacs -53.55% 15323.000 7117.000 - -2.09% -
458.sjeng -47.55% 14036.000 7362.000 - -2.71% -
437.leslie3d -21.57% 14138.000 11089.000 - -4.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) -99.42% 520.000 3.000 - -99.98% -
470.lbm (unexplained diff vs previous) -99.41% 510.000 3.000 - -99.97% -
444.namd (max) -99.40% 664.000 4.000 - -99.42% -
462.libquantum (max) -98.59% 142.000 2.000 - -98.55% -
482.sphinx3 (max) -98.54% 751.000 11.000 - -98.79% -
459.GemsFDTD (unexplained diff vs previous) -98.38% 308.000 5.000 - -99.97% -
482.sphinx3 -98.14% 751.000 14.000 - -81.08% -
482.sphinx3 (avg) -98.14% 751.000 14.000 - -81.08% -
482.sphinx3 (unexplained diff vs previous) -98.07% 623.000 12.000 - -99.95% -
444.namd -98.07% 466.000 9.000 - -86.76% -
444.namd (avg) -98.07% 466.000 9.000 - -86.76% -
433.milc (unexplained diff vs previous) -98.02% 455.000 9.000 - -99.92% -
470.lbm (unexplained diff vs previous) (percentage) -97.99% 3.980 0.080 - -99.97% -
462.libquantum -97.83% 92.000 2.000 - -80.00% -
462.libquantum (avg) -97.83% 92.000 2.000 - -80.00% -
433.milc (max) -97.72% 439.000 10.000 - -99.04% -
462.libquantum (unexplained diff vs previous) -97.50% 40.000 1.000 - -99.99% -
470.lbm (max) -97.18% 531.000 15.000 - -99.45% -
436.cactusADM (max) -96.83% 505.000 16.000 - -99.13% -
453.povray (unexplained diff vs previous) -96.05% 177.000 7.000 - -99.88% -
433.milc -95.38% 303.000 14.000 - -79.71% -
433.milc (avg) -95.38% 303.000 14.000 - -79.71% -
436.cactusADM (unexplained diff vs previous) (percentage) -95.24% 2.940 0.140 - -99.98% -
456.hmmer (max) -94.49% 127.000 7.000 - -99.67% -
456.hmmer (unexplained diff vs previous) -94.17% 103.000 6.000 - -99.93% -
450.soplex (max) -94.12% 289.000 17.000 - -96.88% -
453.povray (max) -93.92% 181.000 11.000 - -97.80% -
450.soplex (unexplained diff vs previous) -93.92% 296.000 18.000 - -99.88% -
436.cactusADM -93.45% 351.000 23.000 - -81.45% -
436.cactusADM (avg) -93.45% 351.000 23.000 - -81.45% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -93.08% 1.300 0.090 - -99.96% -
434.zeusmp (unexplained diff vs previous) -92.91% 268.000 19.000 - -99.83% -
453.povray -92.79% 111.000 8.000 - -80.95% -
453.povray (avg) -92.79% 111.000 8.000 - -80.95% -
434.zeusmp (max) -92.75% 262.000 19.000 - -99.08% -
450.soplex -91.95% 174.000 14.000 - -61.11% -
450.soplex (avg) -91.95% 174.000 14.000 - -61.11% -
444.namd (max) (percentage) -91.86% 7.370 0.600 - -99.35% -
435.gromacs (unexplained diff vs previous) -91.20% 432.000 38.000 - -99.46% -
470.lbm -90.99% 355.000 32.000 - -86.61% -
470.lbm (avg) -90.99% 355.000 32.000 - -86.61% -
400.perlbench (unexplained diff vs previous) -90.87% 252.000 23.000 - -99.74% -
459.GemsFDTD (max) -90.81% 359.000 33.000 - -99.25% -
470.lbm (max) (percentage) -90.12% 4.150 0.410 - -99.43% -
434.zeusmp -89.14% 221.000 24.000 - -83.67% -
434.zeusmp (avg) -89.14% 221.000 24.000 - -83.67% -
410.bwaves (unexplained diff vs previous) -87.78% 90.000 11.000 - -99.86% -
471.omnetpp (max) -87.75% 596.000 73.000 - -96.63% -
416.gamess (max) (percentage) -87.41% 2.940 0.370 - -99.04% -
464.h264ref (max) -86.89% 61.000 8.000 - -99.74% -
400.perlbench (max) -85.77% 246.000 35.000 - -97.49% -
410.bwaves (max) -85.56% 187.000 27.000 - -99.18% -
447.dealII (max) -85.00% 140.000 21.000 - -98.48% -
458.sjeng (max) -83.08% 65.000 11.000 - -99.69% -
465.tonto (max) (percentage) -82.24% 2.590 0.460 - -97.62% -
456.hmmer -81.25% 80.000 15.000 - -88.19% -
456.hmmer (avg) -81.25% 80.000 15.000 - -88.19% -
435.gromacs (unexplained diff vs previous) (percentage) -81.21% 2.820 0.530 - -99.45% -
471.omnetpp -79.79% 287.000 58.000 - -73.99% -
471.omnetpp (avg) -79.79% 287.000 58.000 - -73.99% -
400.perlbench -79.74% 153.000 31.000 - -70.48% -
400.perlbench (avg) -79.74% 153.000 31.000 - -70.48% -
445.gobmk (max) -79.05% 105.000 22.000 - -99.17% -
459.GemsFDTD -78.33% 323.000 70.000 - -80.56% -
459.GemsFDTD (avg) -78.33% 323.000 70.000 - -80.56% -
433.milc (unexplained diff vs previous) (percentage) -77.49% 3.510 0.790 - -99.92% -
456.hmmer (unexplained diff vs previous) (percentage) -77.42% 0.930 0.210 - -99.92% -
456.hmmer (max) (percentage) -77.39% 1.150 0.260 - -99.65% -
435.gromacs (max) -77.09% 419.000 96.000 - -97.31% -
465.tonto (max) -76.96% 217.000 50.000 - -97.63% -
444.namd (avg) (percentage) -76.64% 5.180 1.210 - -86.88% -
437.leslie3d (unexplained diff vs previous) -75.68% 555.000 135.000 - -94.17% -
447.dealII -73.68% 76.000 20.000 - -79.80% -
447.dealII (avg) -73.68% 76.000 20.000 - -79.80% -
436.cactusADM (max) (percentage) -73.08% 2.860 0.770 - -99.13% -
433.milc (max) (percentage) -72.86% 3.390 0.920 - -98.99% -
410.bwaves (unexplained diff vs previous) (percentage) -70.31% 0.640 0.190 - -99.86% -
437.leslie3d (unexplained diff vs previous) (percentage) -68.96% 3.930 1.220 - -93.86% -
464.h264ref (max) (percentage) -68.89% 0.450 0.140 - -99.74% -
470.lbm (avg) (percentage) -68.71% 2.780 0.870 - -86.26% -
481.wrf (max) (percentage) -67.70% 2.570 0.830 - -98.79% -
458.sjeng (max) (percentage) -65.96% 0.470 0.160 - -99.66% -
410.bwaves (max) (percentage) -65.67% 1.340 0.460 - -99.21% -
434.zeusmp (unexplained diff vs previous) (percentage) -62.31% 1.990 0.750 - -99.83% -
434.zeusmp (max) (percentage) -61.03% 1.950 0.760 - -99.07% -
459.GemsFDTD (max) (percentage) -59.21% 1.520 0.620 - -99.13% -
410.bwaves -58.59% 128.000 53.000 - -78.71% -
410.bwaves (avg) -58.59% 128.000 53.000 - -78.71% -
416.gamess (avg) (percentage) -58.47% 1.830 0.760 - -82.81% -
429.mcf (unexplained diff vs previous) -55.56% 9.000 4.000 - -99.98% -
458.sjeng (unexplained diff vs previous) -53.85% 26.000 12.000 - -99.83% -
435.gromacs -53.61% 263.000 122.000 - -66.76% -
435.gromacs (avg) -53.61% 263.000 122.000 - -66.76% -
453.povray (unexplained diff vs previous) (percentage) -53.14% 2.710 1.270 - -99.88% -
401.bzip2 (max) -53.06% 49.000 23.000 - -99.01% -
401.bzip2 (unexplained diff vs previous) -51.02% 49.000 24.000 - -99.78% -
445.gobmk (max) (percentage) -50.55% 0.910 0.450 - -99.14% -
471.omnetpp (max) (percentage) -50.54% 5.540 2.740 - -96.56% -
435.gromacs (max) (percentage) -50.36% 2.740 1.360 - -97.23% -
433.milc (avg) (percentage) -47.44% 2.340 1.230 - -79.67% -
436.cactusADM (avg) (percentage) -44.22% 1.990 1.110 - -81.44% -
445.gobmk -43.42% 76.000 43.000 - -78.06% -
445.gobmk (avg) -43.42% 76.000 43.000 - -78.06% -
482.sphinx3 (max) (percentage) -42.57% 2.490 1.430 - -98.52% -
434.zeusmp (avg) (percentage) -40.85% 1.640 0.970 - -83.42% -
400.perlbench (unexplained diff vs previous) (percentage) -36.09% 2.300 1.470 - -99.72% -
437.leslie3d (max) -30.15% 534.000 373.000 - -80.66% -
482.sphinx3 (unexplained diff vs previous) (percentage) -29.61% 2.060 1.450 - -99.95% -
482.sphinx3 (avg) (percentage) -28.51% 2.490 1.780 - -77.55% -
456.hmmer (avg) (percentage) -27.40% 0.730 0.530 - -87.98% -
471.omnetpp (unexplained diff vs previous) -26.39% 72.000 53.000 - -99.50% -
453.povray (max) (percentage) -25.90% 2.780 2.060 - -97.74% -
481.wrf (avg) (percentage) -24.69% 2.390 1.800 - -71.15% -
447.dealII (max) (percentage) -20.13% 1.590 1.270 - -98.42% -
471.omnetpp (avg) (percentage) -18.35% 2.670 2.180 - -73.41% -
464.h264ref -17.31% 52.000 43.000 - -85.32% -
464.h264ref (avg) -17.31% 52.000 43.000 - -85.32% -
458.sjeng (unexplained diff vs previous) (percentage) -15.79% 0.190 0.160 - -99.82% -
401.bzip2 -12.24% 49.000 43.000 - -73.29% -
401.bzip2 (avg) -12.24% 49.000 43.000 - -73.29% -
437.leslie3d (max) (percentage) -10.85% 3.780 3.370 - -79.67% -
453.povray (avg) (percentage) -8.82% 1.700 1.550 - -80.15% -
459.GemsFDTD (avg) (percentage) -3.65% 1.370 1.320 - -77.40% -
410.bwaves (avg) (percentage) -2.17% 0.920 0.900 - -79.59% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.77% 1946163.000 1980515.000 - 1.81% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 45.51% 1424.000 2072.000 - -88.01% -
410.bwaves 5.02% 5652.000 5936.000 - -57.59% -
444.namd 4.28% 747.000 779.000 - -91.36% -
436.cactusADM 1.44% 2083.000 2113.000 - -88.05% -
465.tonto 1.24% 10941.000 11077.000 - 31.68% -
453.povray 1.10% 547.000 553.000 - -91.55% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 45.90% 3.050 4.450 - 73.83% -
437.leslie3d 38.87% 355.000 493.000 - 36.57% -
437.leslie3d (avg) 38.87% 355.000 493.000 - 36.57% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.94% 244728.000 232648.000 - -7.71% -
434.zeusmp -3.53% 152037.000 146667.000 - -4.70% -
464.h264ref -2.13% 387748.000 379508.000 - -1.98% -
435.gromacs -1.91% 499261.000 489749.000 - -2.88% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649825.000 - -1.83% -
458.sjeng -1.70% 104048.000 102284.000 - -1.67% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
447.dealII -1.46% 311591.000 307028.000 - -1.89% -
433.milc -1.42% 61382.000 60509.000 - -1.18% -
444.namd -1.39% 188385.000 185768.000 - -1.35% -
456.hmmer -1.38% 108691.000 107191.000 - -1.33% -
436.cactusADM -1.29% 352891.000 348331.000 - -1.23% -
450.soplex -1.22% 205081.000 202574.000 - -2.13% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.14% -
482.sphinx3 -1.06% 112859.000 111659.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.91% 6173.000 5376.000 - -77.26% -
482.sphinx3 -12.59% 945.000 826.000 - -97.26% -
400.perlbench -5.83% 1663.000 1566.000 - -85.71% -
437.leslie3d -4.73% 11640.000 11089.000 - -21.57% -
447.dealII -3.71% 1724.000 1660.000 - -81.22% -
462.libquantum -2.86% 140.000 136.000 - -98.82% -
458.sjeng -2.71% 7567.000 7362.000 - -47.55% -
435.gromacs -2.09% 7269.000 7117.000 - -53.55% -
471.omnetpp -1.73% 2724.000 2677.000 - -75.14% -
445.gobmk -1.45% 5023.000 4950.000 - -57.15% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -97.50% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.740 - 111.43% -
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.190 - 280.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.98% 787.130 0.140 - -95.24% -
436.cactusADM (unexplained diff vs previous) -99.98% 16396.000 3.000 - -99.42% -
429.mcf (unexplained diff vs previous) -99.98% 18593.000 4.000 - -55.56% -
470.lbm (unexplained diff vs previous) -99.97% 9990.000 3.000 - -99.41% -
470.lbm (unexplained diff vs previous) (percentage) -99.97% 263.730 0.080 - -97.99% -
459.GemsFDTD (unexplained diff vs previous) -99.97% 15458.000 5.000 - -98.38% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.96% 250.410 0.090 - -93.08% -
482.sphinx3 (unexplained diff vs previous) -99.95% 26073.000 12.000 - -98.07% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.450 - -29.61% -
456.hmmer (unexplained diff vs previous) -99.93% 8030.000 6.000 - -94.17% -
456.hmmer (unexplained diff vs previous) (percentage) -99.92% 278.630 0.210 - -77.42% -
433.milc (unexplained diff vs previous) -99.92% 11289.000 9.000 - -98.02% -
433.milc (unexplained diff vs previous) (percentage) -99.92% 980.800 0.790 - -77.49% -
453.povray (unexplained diff vs previous) (percentage) -99.88% 1043.330 1.270 - -53.14% -
453.povray (unexplained diff vs previous) -99.88% 5707.000 7.000 - -96.05% -
450.soplex (unexplained diff vs previous) (percentage) -99.88% 2557.320 3.150 - 67.55% -
450.soplex (unexplained diff vs previous) -99.88% 14500.000 18.000 - -93.92% -
410.bwaves (unexplained diff vs previous) (percentage) -99.86% 137.900 0.190 - -70.31% -
410.bwaves (unexplained diff vs previous) -99.86% 7794.000 11.000 - -87.78% -
445.gobmk (unexplained diff vs previous) -99.86% 5581.000 8.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.86% 111.110 0.160 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.83% 448.690 0.750 - -62.31% -
434.zeusmp (unexplained diff vs previous) -99.83% 11280.000 19.000 - -92.91% -
458.sjeng (unexplained diff vs previous) -99.83% 6876.000 12.000 - -53.85% -
458.sjeng (unexplained diff vs previous) (percentage) -99.82% 90.870 0.160 - -15.79% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.78% 368.340 0.810 - 145.45% -
401.bzip2 (unexplained diff vs previous) -99.78% 10833.000 24.000 - -51.02% -
464.h264ref (max) -99.74% 3127.000 8.000 - -86.89% -
464.h264ref (max) (percentage) -99.74% 54.290 0.140 - -68.89% -
400.perlbench (unexplained diff vs previous) -99.74% 8772.000 23.000 - -90.87% -
400.perlbench (unexplained diff vs previous) (percentage) -99.72% 527.480 1.470 - -36.09% -
473.astar (unexplained diff vs previous) (percentage) -99.71% 197.850 0.580 - 262.50% -
473.astar (unexplained diff vs previous) -99.70% 10146.000 30.000 - 36.36% -
458.sjeng (max) -99.69% 3602.000 11.000 - -83.08% -
456.hmmer (max) -99.67% 2120.000 7.000 - -94.49% -
458.sjeng (max) (percentage) -99.66% 47.610 0.160 - -65.96% -
456.hmmer (max) (percentage) -99.65% 73.590 0.260 - -77.39% -
471.omnetpp (unexplained diff vs previous) -99.50% 10659.000 53.000 - -26.39% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.49% 391.300 1.980 - 195.52% -
435.gromacs (unexplained diff vs previous) -99.46% 7028.000 38.000 - -91.20% -
470.lbm (max) -99.45% 2746.000 15.000 - -97.18% -
435.gromacs (unexplained diff vs previous) (percentage) -99.45% 96.680 0.530 - -81.21% -
470.lbm (max) (percentage) -99.43% 72.510 0.410 - -90.12% -
444.namd (max) -99.42% 685.000 4.000 - -99.40% -
444.namd (max) (percentage) -99.35% 91.790 0.600 - -91.86% -
459.GemsFDTD (max) -99.25% 4411.000 33.000 - -90.81% -
410.bwaves (max) (percentage) -99.21% 57.970 0.460 - -65.67% -
410.bwaves (max) -99.18% 3276.000 27.000 - -85.56% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - 25.76% -
445.gobmk (max) -99.17% 2643.000 22.000 - -79.05% -
445.gobmk (max) (percentage) -99.14% 52.630 0.450 - -50.55% -
436.cactusADM (max) -99.13% 1848.000 16.000 - -96.83% -
459.GemsFDTD (max) (percentage) -99.13% 71.460 0.620 - -59.21% -
436.cactusADM (max) (percentage) -99.13% 88.730 0.770 - -73.08% -
434.zeusmp (max) -99.08% 2055.000 19.000 - -92.75% -
434.zeusmp (max) (percentage) -99.07% 81.770 0.760 - -61.03% -
433.milc (max) -99.04% 1044.000 10.000 - -97.72% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -87.41% -
401.bzip2 (max) -99.01% 2313.000 23.000 - -53.06% -
433.milc (max) (percentage) -98.99% 90.750 0.920 - -72.86% -
401.bzip2 (max) (percentage) -98.97% 78.650 0.810 - 145.45% -
482.sphinx3 (max) -98.79% 911.000 11.000 - -98.54% -
481.wrf (max) (percentage) -98.79% 68.700 0.830 - -67.70% -
462.libquantum (max) -98.55% 138.000 2.000 - -98.59% -
482.sphinx3 (max) (percentage) -98.52% 96.500 1.430 - -42.57% -
447.dealII (max) -98.48% 1384.000 21.000 - -85.00% -
447.dealII (max) (percentage) -98.42% 80.280 1.270 - -20.13% -
473.astar (max) -98.30% 3406.000 58.000 - 123.08% -
473.astar (max) (percentage) -98.27% 66.430 1.150 - 505.26% -
462.libquantum (max) (percentage) -98.20% 98.970 1.780 - 44.72% -
453.povray (max) -97.80% 499.000 11.000 - -93.92% -
453.povray (max) (percentage) -97.74% 91.250 2.060 - -25.90% -
429.mcf (max) (percentage) -97.66% 92.890 2.170 - 2612.50% -
465.tonto (max) -97.63% 2112.000 50.000 - -76.96% -
465.tonto (max) (percentage) -97.62% 19.310 0.460 - -82.24% -
400.perlbench (max) -97.49% 1397.000 35.000 - -85.77% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 293.33% -
400.perlbench (max) (percentage) -97.32% 84.060 2.250 - 0.00% -
435.gromacs (max) -97.31% 3573.000 96.000 - -77.09% -
435.gromacs (max) (percentage) -97.23% 49.160 1.360 - -50.36% -
450.soplex (max) -96.88% 545.000 17.000 - -94.12% -
450.soplex (max) (percentage) -96.82% 96.240 3.060 - 66.30% -
429.mcf (max) -96.67% 1322.000 44.000 - 238.46% -
471.omnetpp (max) -96.63% 2169.000 73.000 - -87.75% -
471.omnetpp (max) (percentage) -96.56% 79.650 2.740 - -50.54% -
403.gcc (max) (percentage) -96.17% 99.360 3.810 - 786.05% -
437.leslie3d (unexplained diff vs previous) -94.17% 2314.000 135.000 - -75.68% -
437.leslie3d (unexplained diff vs previous) (percentage) -93.86% 19.880 1.220 - -68.96% -
456.hmmer -88.19% 127.000 15.000 - -81.25% -
456.hmmer (avg) -88.19% 127.000 15.000 - -81.25% -
456.hmmer (avg) (percentage) -87.98% 4.410 0.530 - -27.40% -
444.namd (avg) (percentage) -86.88% 9.220 1.210 - -76.64% -
444.namd -86.76% 68.000 9.000 - -98.07% -
444.namd (avg) -86.76% 68.000 9.000 - -98.07% -
470.lbm -86.61% 239.000 32.000 - -90.99% -
470.lbm (avg) -86.61% 239.000 32.000 - -90.99% -
470.lbm (avg) (percentage) -86.26% 6.330 0.870 - -68.71% -
464.h264ref -85.32% 293.000 43.000 - -17.31% -
464.h264ref (avg) -85.32% 293.000 43.000 - -17.31% -
464.h264ref (avg) (percentage) -85.27% 5.090 0.750 - 97.37% -
434.zeusmp -83.67% 147.000 24.000 - -89.14% -
434.zeusmp (avg) -83.67% 147.000 24.000 - -89.14% -
434.zeusmp (avg) (percentage) -83.42% 5.850 0.970 - -40.85% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -58.47% -
436.cactusADM -81.45% 124.000 23.000 - -93.45% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -93.45% -
436.cactusADM (avg) (percentage) -81.44% 5.980 1.110 - -44.22% -
458.sjeng -81.33% 241.000 45.000 - 25.00% -
458.sjeng (avg) -81.33% 241.000 45.000 - 25.00% -
482.sphinx3 -81.08% 74.000 14.000 - -98.14% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -98.14% -
453.povray -80.95% 42.000 8.000 - -92.79% -
453.povray (avg) -80.95% 42.000 8.000 - -92.79% -
437.leslie3d (max) -80.66% 1929.000 373.000 - -30.15% -
458.sjeng (avg) (percentage) -80.56% 3.190 0.620 - 138.46% -
459.GemsFDTD -80.56% 360.000 70.000 - -78.33% -
459.GemsFDTD (avg) -80.56% 360.000 70.000 - -78.33% -
453.povray (avg) (percentage) -80.15% 7.810 1.550 - -8.82% -
462.libquantum -80.00% 10.000 2.000 - -97.83% -
462.libquantum (avg) -80.00% 10.000 2.000 - -97.83% -
447.dealII -79.80% 99.000 20.000 - -73.68% -
447.dealII (avg) -79.80% 99.000 20.000 - -73.68% -
433.milc -79.71% 69.000 14.000 - -95.38% -
433.milc (avg) -79.71% 69.000 14.000 - -95.38% -
437.leslie3d (max) (percentage) -79.67% 16.580 3.370 - -10.85% -
433.milc (avg) (percentage) -79.67% 6.050 1.230 - -47.44% -
410.bwaves (avg) (percentage) -79.59% 4.410 0.900 - -2.17% -
447.dealII (avg) (percentage) -78.86% 5.770 1.220 - 41.86% -
410.bwaves -78.71% 249.000 53.000 - -58.59% -
410.bwaves (avg) -78.71% 249.000 53.000 - -58.59% -
445.gobmk -78.06% 196.000 43.000 - -43.42% -
445.gobmk (avg) -78.06% 196.000 43.000 - -43.42% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - -28.51% -
445.gobmk (avg) (percentage) -77.49% 3.910 0.880 - 33.33% -
459.GemsFDTD (avg) (percentage) -77.40% 5.840 1.320 - -3.65% -
462.libquantum (avg) (percentage) -76.37% 7.660 1.810 - 126.25% -
471.omnetpp -73.99% 223.000 58.000 - -79.79% -
471.omnetpp (avg) -73.99% 223.000 58.000 - -79.79% -
471.omnetpp (avg) (percentage) -73.41% 8.200 2.180 - -18.35% -
401.bzip2 -73.29% 161.000 43.000 - -12.24% -
401.bzip2 (avg) -73.29% 161.000 43.000 - -12.24% -
401.bzip2 (avg) (percentage) -72.99% 5.480 1.480 - 348.48% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -24.69% -
400.perlbench -70.48% 105.000 31.000 - -79.74% -
400.perlbench (avg) -70.48% 105.000 31.000 - -79.74% -
400.perlbench (avg) (percentage) -68.66% 6.350 1.990 - 42.14% -
435.gromacs -66.76% 367.000 122.000 - -53.61% -
435.gromacs (avg) -66.76% 367.000 122.000 - -53.61% -
435.gromacs (avg) (percentage) -66.01% 5.060 1.720 - 0.00% -
465.tonto (avg) (percentage) -63.77% 3.340 1.210 - 5.22% -
465.tonto -63.29% 365.000 134.000 - 39.58% -
465.tonto (avg) -63.29% 365.000 134.000 - 39.58% -
473.astar (avg) (percentage) -61.54% 4.160 1.600 - 492.59% -
473.astar -61.50% 213.000 82.000 - 115.79% -
473.astar (avg) -61.50% 213.000 82.000 - 115.79% -
450.soplex -61.11% 36.000 14.000 - -91.95% -
450.soplex (avg) -61.11% 36.000 14.000 - -91.95% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 127.93% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 665.96% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 886.67% -
429.mcf (avg) (percentage) -36.90% 7.670 4.840 - 1412.50% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1655.17% -
429.mcf -8.26% 109.000 100.000 - 81.82% -
429.mcf (avg) -8.26% 109.000 100.000 - 81.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1566.000 -85.71%
401.bzip2 2955.000 -80.30%
410.bwaves 5936.000 -57.59%
429.mcf 2072.000 -88.01%
433.milc 1146.000 -91.15%
434.zeusmp 2528.000 -81.26%
435.gromacs 7117.000 -53.55%
436.cactusADM 2113.000 -88.05%
437.leslie3d 11089.000 -21.57%
444.namd 779.000 -91.36%
445.gobmk 4950.000 -57.15%
447.dealII 1660.000 -81.22%
450.soplex 571.000 -96.38%
453.povray 553.000 -91.55%
456.hmmer 2869.000 -74.13%
458.sjeng 7362.000 -47.55%
459.GemsFDTD 5376.000 -77.26%
462.libquantum 136.000 -98.82%
464.h264ref 5810.000 -57.71%
465.tonto 11077.000 31.68%
470.lbm 3786.000 -70.43%
471.omnetpp 2677.000 -75.14%
473.astar 5130.000 -63.79%
482.sphinx3 826.000 -97.26%
Geometric Mean 2458.278 -81.32%
Code Size (bytes)
Name Current %
400.perlbench 895883.000 -
401.bzip2 43719.000 -1.14%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60509.000 -1.18%
434.zeusmp 146667.000 -4.70%
435.gromacs 489749.000 -2.88%
436.cactusADM 348331.000 -1.23%
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.35%
445.gobmk 1375078.000 -
447.dealII 307028.000 -1.89%
450.soplex 202574.000 -2.13%
453.povray 649825.000 -1.83%
456.hmmer 107191.000 -1.33%
458.sjeng 102284.000 -1.67%
459.GemsFDTD 232648.000 -7.71%
462.libquantum 15893.000 -
464.h264ref 379508.000 -1.98%
465.tonto 1980515.000 1.81%
470.lbm 9547.000 -1.69%
471.omnetpp 475388.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111659.000 -1.04%
Geometric Mean 136561.773 -1.89%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 31.000 -79.74%
400.perlbench (avg) 31.000 -79.74%
400.perlbench (avg) (percentage) 1.990 42.14%
400.perlbench (max) 35.000 -85.77%
400.perlbench (max) (percentage) 2.250 -
400.perlbench (unexplained diff vs previous) 23.000 -90.87%
400.perlbench (unexplained diff vs previous) (percentage) 1.470 -36.09%
401.bzip2 43.000 -12.24%
401.bzip2 (avg) 43.000 -12.24%
401.bzip2 (avg) (percentage) 1.480 348.48%
401.bzip2 (max) 23.000 -53.06%
401.bzip2 (max) (percentage) 0.810 145.45%
401.bzip2 (unexplained diff vs previous) 24.000 -51.02%
401.bzip2 (unexplained diff vs previous) (percentage) 0.810 145.45%
403.gcc (avg) (percentage) 5.090 1655.17%
403.gcc (max) (percentage) 3.810 786.05%
410.bwaves 53.000 -58.59%
410.bwaves (avg) 53.000 -58.59%
410.bwaves (avg) (percentage) 0.900 -2.17%
410.bwaves (max) 27.000 -85.56%
410.bwaves (max) (percentage) 0.460 -65.67%
410.bwaves (unexplained diff vs previous) 11.000 -87.78%
410.bwaves (unexplained diff vs previous) (percentage) 0.190 -70.31%
416.gamess (avg) (percentage) 0.760 -58.47%
416.gamess (max) (percentage) 0.370 -87.41%
429.mcf 100.000 81.82%
429.mcf (avg) 100.000 81.82%
429.mcf (avg) (percentage) 4.840 1412.50%
429.mcf (max) 44.000 238.46%
429.mcf (max) (percentage) 2.170 2612.50%
429.mcf (unexplained diff vs previous) 4.000 -55.56%
429.mcf (unexplained diff vs previous) (percentage) 0.190 280.00%
433.milc 14.000 -95.38%
433.milc (avg) 14.000 -95.38%
433.milc (avg) (percentage) 1.230 -47.44%
433.milc (max) 10.000 -97.72%
433.milc (max) (percentage) 0.920 -72.86%
433.milc (unexplained diff vs previous) 9.000 -98.02%
433.milc (unexplained diff vs previous) (percentage) 0.790 -77.49%
434.zeusmp 24.000 -89.14%
434.zeusmp (avg) 24.000 -89.14%
434.zeusmp (avg) (percentage) 0.970 -40.85%
434.zeusmp (max) 19.000 -92.75%
434.zeusmp (max) (percentage) 0.760 -61.03%
434.zeusmp (unexplained diff vs previous) 19.000 -92.91%
434.zeusmp (unexplained diff vs previous) (percentage) 0.750 -62.31%
435.gromacs 122.000 -53.61%
435.gromacs (avg) 122.000 -53.61%
435.gromacs (avg) (percentage) 1.720 -
435.gromacs (max) 96.000 -77.09%
435.gromacs (max) (percentage) 1.360 -50.36%
435.gromacs (unexplained diff vs previous) 38.000 -91.20%
435.gromacs (unexplained diff vs previous) (percentage) 0.530 -81.21%
436.cactusADM 23.000 -93.45%
436.cactusADM (avg) 23.000 -93.45%
436.cactusADM (avg) (percentage) 1.110 -44.22%
436.cactusADM (max) 16.000 -96.83%
436.cactusADM (max) (percentage) 0.770 -73.08%
436.cactusADM (unexplained diff vs previous) 3.000 -99.42%
436.cactusADM (unexplained diff vs previous) (percentage) 0.140 -95.24%
437.leslie3d 493.000 36.57%
437.leslie3d (avg) 493.000 36.57%
437.leslie3d (avg) (percentage) 4.450 73.83%
437.leslie3d (max) 373.000 -30.15%
437.leslie3d (max) (percentage) 3.370 -10.85%
437.leslie3d (unexplained diff vs previous) 135.000 -75.68%
437.leslie3d (unexplained diff vs previous) (percentage) 1.220 -68.96%
444.namd 9.000 -98.07%
444.namd (avg) 9.000 -98.07%
444.namd (avg) (percentage) 1.210 -76.64%
444.namd (max) 4.000 -99.40%
444.namd (max) (percentage) 0.600 -91.86%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 43.000 -43.42%
445.gobmk (avg) 43.000 -43.42%
445.gobmk (avg) (percentage) 0.880 33.33%
445.gobmk (max) 22.000 -79.05%
445.gobmk (max) (percentage) 0.450 -50.55%
445.gobmk (unexplained diff vs previous) 8.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.160 -
447.dealII 20.000 -73.68%
447.dealII (avg) 20.000 -73.68%
447.dealII (avg) (percentage) 1.220 41.86%
447.dealII (max) 21.000 -85.00%
447.dealII (max) (percentage) 1.270 -20.13%
450.soplex 14.000 -91.95%
450.soplex (avg) 14.000 -91.95%
450.soplex (avg) (percentage) 2.530 127.93%
450.soplex (max) 17.000 -94.12%
450.soplex (max) (percentage) 3.060 66.30%
450.soplex (unexplained diff vs previous) 18.000 -93.92%
450.soplex (unexplained diff vs previous) (percentage) 3.150 67.55%
453.povray 8.000 -92.79%
453.povray (avg) 8.000 -92.79%
453.povray (avg) (percentage) 1.550 -8.82%
453.povray (max) 11.000 -93.92%
453.povray (max) (percentage) 2.060 -25.90%
453.povray (unexplained diff vs previous) 7.000 -96.05%
453.povray (unexplained diff vs previous) (percentage) 1.270 -53.14%
454.calculix (avg) (percentage) 3.600 665.96%
454.calculix (max) (percentage) 0.830 25.76%
456.hmmer 15.000 -81.25%
456.hmmer (avg) 15.000 -81.25%
456.hmmer (avg) (percentage) 0.530 -27.40%
456.hmmer (max) 7.000 -94.49%
456.hmmer (max) (percentage) 0.260 -77.39%
456.hmmer (unexplained diff vs previous) 6.000 -94.17%
456.hmmer (unexplained diff vs previous) (percentage) 0.210 -77.42%
458.sjeng 45.000 25.00%
458.sjeng (avg) 45.000 25.00%
458.sjeng (avg) (percentage) 0.620 138.46%
458.sjeng (max) 11.000 -83.08%
458.sjeng (max) (percentage) 0.160 -65.96%
458.sjeng (unexplained diff vs previous) 12.000 -53.85%
458.sjeng (unexplained diff vs previous) (percentage) 0.160 -15.79%
459.GemsFDTD 70.000 -78.33%
459.GemsFDTD (avg) 70.000 -78.33%
459.GemsFDTD (avg) (percentage) 1.320 -3.65%
459.GemsFDTD (max) 33.000 -90.81%
459.GemsFDTD (max) (percentage) 0.620 -59.21%
459.GemsFDTD (unexplained diff vs previous) 5.000 -98.38%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.090 -93.08%
462.libquantum 2.000 -97.83%
462.libquantum (avg) 2.000 -97.83%
462.libquantum (avg) (percentage) 1.810 126.25%
462.libquantum (max) 2.000 -98.59%
462.libquantum (max) (percentage) 1.780 44.72%
462.libquantum (unexplained diff vs previous) 1.000 -97.50%
462.libquantum (unexplained diff vs previous) (percentage) 0.740 111.43%
464.h264ref 43.000 -17.31%
464.h264ref (avg) 43.000 -17.31%
464.h264ref (avg) (percentage) 0.750 97.37%
464.h264ref (max) 8.000 -86.89%
464.h264ref (max) (percentage) 0.140 -68.89%
465.tonto 134.000 39.58%
465.tonto (avg) 134.000 39.58%
465.tonto (avg) (percentage) 1.210 5.22%
465.tonto (max) 50.000 -76.96%
465.tonto (max) (percentage) 0.460 -82.24%
470.lbm 32.000 -90.99%
470.lbm (avg) 32.000 -90.99%
470.lbm (avg) (percentage) 0.870 -68.71%
470.lbm (max) 15.000 -97.18%
470.lbm (max) (percentage) 0.410 -90.12%
470.lbm (unexplained diff vs previous) 3.000 -99.41%
470.lbm (unexplained diff vs previous) (percentage) 0.080 -97.99%
471.omnetpp 58.000 -79.79%
471.omnetpp (avg) 58.000 -79.79%
471.omnetpp (avg) (percentage) 2.180 -18.35%
471.omnetpp (max) 73.000 -87.75%
471.omnetpp (max) (percentage) 2.740 -50.54%
471.omnetpp (unexplained diff vs previous) 53.000 -26.39%
471.omnetpp (unexplained diff vs previous) (percentage) 1.980 195.52%
473.astar 82.000 115.79%
473.astar (avg) 82.000 115.79%
473.astar (avg) (percentage) 1.600 492.59%
473.astar (max) 58.000 123.08%
473.astar (max) (percentage) 1.150 505.26%
473.astar (unexplained diff vs previous) 30.000 36.36%
473.astar (unexplained diff vs previous) (percentage) 0.580 262.50%
481.wrf (avg) (percentage) 1.800 -24.69%
481.wrf (max) (percentage) 0.830 -67.70%
482.sphinx3 14.000 -98.14%
482.sphinx3 (avg) 14.000 -98.14%
482.sphinx3 (avg) (percentage) 1.780 -28.51%
482.sphinx3 (max) 11.000 -98.54%
482.sphinx3 (max) (percentage) 1.430 -42.57%
482.sphinx3 (unexplained diff vs previous) 12.000 -98.07%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.450 -29.61%
483.xalancbmk (avg) (percentage) 2.960 886.67%
483.xalancbmk (max) (percentage) 1.770 293.33%
Geometric Mean 4.710 -71.38%