Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b6532accdd8e24329cc69bb58bc2883796008776 (+ 10 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/08aba2dd8c9390b6131cca0aac069f97eeddc9d2 (+ 45 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e64a1e81aadf6c401174ac9471ced0f0125c2912 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/25cd1b6c4571a4d82346fe97e81e280f64129355 (+ 120 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/296/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0296 (3-changed-components) 2024-09-16T01:41:16 0:00:00
Previous 0295 (4-changed-components) 2022-09-07T15:14:29 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 35 14
Performance Improvements 186 200
Added Tests 2 2
Unchanged Tests 1013 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 2.26% 104028.000 106376.000 - 2.24% -
465.tonto 1.39% 1945443.000 1972394.000 - 1.35% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 26.05% 8810.000 11105.000 - 1.50% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (avg) (percentage) 1397.06% 0.340 5.090 - -30.46% -
403.gcc (max) (percentage) 1029.41% 0.340 3.840 - -96.14% -
483.xalancbmk (avg) (percentage) 604.76% 0.420 2.960 - -54.46% -
429.mcf (unexplained diff vs previous) (percentage) 516.13% 0.310 1.910 0.000 -99.85% 0.000
454.calculix (avg) (percentage) 429.41% 0.680 3.600 - -55.11% -
401.bzip2 (max) (percentage) 400.00% 0.280 1.400 - -98.22% -
483.xalancbmk (max) (percentage) 293.33% 0.450 1.770 - -97.42% -
437.leslie3d (unexplained diff vs previous) (percentage) 289.29% 3.360 13.080 0.000 -34.21% 0.000
437.leslie3d (unexplained diff vs previous) 250.95% 475.000 1667.000 0.000 -27.96% 0.000
437.leslie3d (max) (percentage) 229.32% 4.570 15.050 - -9.23% -
429.mcf (avg) (percentage) 198.19% 1.660 4.950 - -35.46% -
437.leslie3d (max) 196.75% 646.000 1917.000 - -0.62% -
471.omnetpp (unexplained diff vs previous) (percentage) 184.78% 0.460 1.310 0.000 -99.67% 0.000
458.sjeng (avg) (percentage) 117.24% 0.290 0.630 - -80.25% -
473.astar (avg) (percentage) 112.99% 0.770 1.640 - -60.58% -
447.dealII (unexplained diff vs previous) (percentage) 102.11% 0.950 1.920 0.000 -99.53% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 73.81% 0.840 1.460 0.000 -99.98% 0.000
401.bzip2 (avg) (percentage) 68.13% 0.910 1.530 - -72.08% -
464.h264ref (avg) (percentage) 52.00% 0.500 0.760 - -85.07% -
400.perlbench (max) (percentage) 24.62% 1.990 2.480 - -97.05% -
464.h264ref (max) (percentage) 24.32% 0.740 0.920 - -98.31% -
473.astar (max) (percentage) 22.45% 3.830 4.690 - -92.94% -
437.leslie3d (avg) (percentage) 19.79% 3.790 4.540 - 48.85% -
450.soplex (avg) (percentage) 19.34% 2.120 2.530 - -60.65% -
458.sjeng 15.00% 40.000 46.000 - -80.91% -
458.sjeng (avg) 15.00% 40.000 46.000 - -80.91% -
437.leslie3d 7.84% 536.000 578.000 - 62.82% -
437.leslie3d (avg) 7.84% 536.000 578.000 - 62.82% -
401.bzip2 (unexplained diff vs previous) (percentage) 6.25% 0.160 0.170 0.000 -99.95% 0.000
401.bzip2 (max) 2.44% 41.000 42.000 - -98.18% -
465.tonto 1.49% 134.000 136.000 - -62.74% -
465.tonto (avg) 1.49% 134.000 136.000 - -62.74% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.79% 59403.000 54778.000 - -7.90% -
459.GemsFDTD -6.13% 247940.000 232736.000 - -4.90% -
434.zeusmp -4.71% 153897.000 146647.000 - -3.55% -
450.soplex -4.03% 211092.000 202586.000 - -1.22% -
435.gromacs -2.09% 500203.000 489757.000 - -1.90% -
464.h264ref -2.01% 387228.000 379436.000 - -2.14% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
447.dealII -1.61% 312944.000 307908.000 - -1.18% -
471.omnetpp -1.47% 482480.000 475404.000 - -0.55% -
444.namd -1.39% 188301.000 185676.000 - -1.44% -
456.hmmer -1.27% 108631.000 107255.000 - -1.32% -
436.cactusADM -1.26% 352831.000 348399.000 - -1.27% -
453.povray -1.21% 661959.000 653961.000 - -1.12% -
433.milc -1.18% 61230.000 60509.000 - -1.42% -
401.bzip2 -1.14% 44221.000 43715.000 - -1.17% -
482.sphinx3 -1.02% 112831.000 111683.000 - -1.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.81% 11533.000 137.000 - -2.14% -
482.sphinx3 -97.26% 30321.000 830.000 - -12.17% -
450.soplex -96.36% 15873.000 577.000 - 1.76% -
453.povray -91.77% 6552.000 539.000 - -1.46% -
444.namd -91.35% 8982.000 777.000 - 4.02% -
433.milc -91.07% 12878.000 1150.000 - -0.09% -
429.mcf -88.81% 17276.000 1934.000 - 35.81% -
436.cactusADM -88.13% 17697.000 2101.000 - 0.86% -
400.perlbench -86.09% 10991.000 1529.000 - -8.06% -
434.zeusmp -81.20% 13401.000 2520.000 - 0.24% -
447.dealII -81.19% 8876.000 1670.000 - -3.13% -
401.bzip2 -79.78% 14903.000 3014.000 - 2.48% -
459.GemsFDTD -77.33% 23624.000 5355.000 - -13.25% -
471.omnetpp -74.36% 10747.000 2756.000 - 1.17% -
456.hmmer -73.60% 11082.000 2926.000 - 1.53% -
470.lbm -70.56% 12804.000 3769.000 - -0.50% -
473.astar -63.76% 14182.000 5140.000 - 0.23% -
410.bwaves -58.69% 14310.000 5911.000 - 4.58% -
464.h264ref -58.10% 13834.000 5796.000 - 0.61% -
445.gobmk -56.74% 11553.000 4998.000 - -0.50% -
435.gromacs -53.07% 15234.000 7149.000 - -1.65% -
458.sjeng -47.22% 14004.000 7391.000 - -2.33% -
437.leslie3d -9.99% 14157.000 12743.000 - 9.48% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) -99.66% 1770.000 6.000 - -99.34% -
462.libquantum (max) -99.63% 1091.000 4.000 - -97.10% -
444.namd (unexplained diff vs previous) -99.60% 756.000 3.000 0.000 -99.96% 0.000
400.perlbench (unexplained diff vs previous) -99.51% 205.000 1.000 0.000 -99.99% 0.000
444.namd (max) -99.43% 697.000 4.000 - -99.42% -
462.libquantum -99.17% 242.000 2.000 - -80.00% -
462.libquantum (avg) -99.17% 242.000 2.000 - -80.00% -
450.soplex (max) -99.15% 709.000 6.000 - -98.90% -
482.sphinx3 (unexplained diff vs previous) -99.08% 760.000 7.000 0.000 -99.97% 0.000
434.zeusmp (unexplained diff vs previous) -98.95% 382.000 4.000 0.000 -99.96% 0.000
444.namd -98.67% 675.000 9.000 - -86.76% -
444.namd (avg) -98.67% 675.000 9.000 - -86.76% -
482.sphinx3 -98.61% 1079.000 15.000 - -79.73% -
482.sphinx3 (avg) -98.61% 1079.000 15.000 - -79.73% -
434.zeusmp (max) -98.16% 380.000 7.000 - -99.66% -
462.libquantum (unexplained diff vs previous) -97.94% 97.000 2.000 0.000 -99.99% 0.000
429.mcf (max) -97.76% 1608.000 36.000 - -97.28% -
450.soplex (unexplained diff vs previous) -97.75% 178.000 4.000 0.000 -99.97% 0.000
459.GemsFDTD (max) -97.75% 1289.000 29.000 - -99.34% -
471.omnetpp (max) -97.54% 1461.000 36.000 - -98.34% -
453.povray (max) -97.24% 326.000 9.000 - -98.20% -
456.hmmer (max) -97.22% 72.000 2.000 - -99.91% -
470.lbm (max) -96.45% 816.000 29.000 - -98.94% -
400.perlbench (unexplained diff vs previous) (percentage) -96.26% 1.870 0.070 0.000 -99.99% 0.000
433.milc -96.09% 358.000 14.000 - -79.71% -
433.milc (avg) -96.09% 358.000 14.000 - -79.71% -
433.milc (max) -95.93% 369.000 15.000 - -98.56% -
456.hmmer (unexplained diff vs previous) -95.89% 73.000 3.000 0.000 -99.96% 0.000
450.soplex -95.83% 336.000 14.000 - -61.11% -
450.soplex (avg) -95.83% 336.000 14.000 - -61.11% -
433.milc (unexplained diff vs previous) -95.79% 380.000 16.000 0.000 -99.86% 0.000
453.povray -95.70% 186.000 8.000 - -80.95% -
453.povray (avg) -95.70% 186.000 8.000 - -80.95% -
436.cactusADM (max) -95.68% 486.000 21.000 - -98.86% -
436.cactusADM -95.64% 527.000 23.000 - -81.45% -
436.cactusADM (avg) -95.64% 527.000 23.000 - -81.45% -
436.cactusADM (unexplained diff vs previous) -95.61% 501.000 22.000 0.000 -99.87% 0.000
444.namd (unexplained diff vs previous) (percentage) -95.37% 8.420 0.390 0.000 -99.97% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -94.39% 2.850 0.160 0.000 -99.96% 0.000
470.lbm -94.23% 572.000 33.000 - -86.19% -
470.lbm (avg) -94.23% 572.000 33.000 - -86.19% -
470.lbm (unexplained diff vs previous) -93.75% 480.000 30.000 0.000 -99.70% 0.000
473.astar (unexplained diff vs previous) -93.33% 15.000 1.000 0.000 -99.99% 0.000
434.zeusmp -93.26% 356.000 24.000 - -83.67% -
434.zeusmp (avg) -93.26% 356.000 24.000 - -83.67% -
444.namd (max) (percentage) -93.17% 7.760 0.530 - -99.42% -
459.GemsFDTD (unexplained diff vs previous) -91.88% 308.000 25.000 0.000 -99.84% 0.000
435.gromacs (unexplained diff vs previous) -90.91% 440.000 40.000 0.000 -99.43% 0.000
471.omnetpp (max) (percentage) -90.29% 13.600 1.320 - -98.34% -
434.zeusmp (max) (percentage) -90.14% 2.840 0.280 - -99.66% -
464.h264ref (unexplained diff vs previous) -90.10% 101.000 10.000 0.000 -99.85% 0.000
459.GemsFDTD (max) (percentage) -89.74% 5.460 0.560 - -99.22% -
410.bwaves (max) -89.14% 479.000 52.000 - -98.41% -
410.bwaves (unexplained diff vs previous) -88.58% 464.000 53.000 0.000 -99.32% 0.000
447.dealII (max) -88.28% 273.000 32.000 - -97.69% -
470.lbm (max) (percentage) -87.62% 6.380 0.790 - -98.91% -
416.gamess (max) (percentage) -87.38% 3.010 0.380 - -99.01% -
447.dealII -87.34% 158.000 20.000 - -79.80% -
447.dealII (avg) -87.34% 158.000 20.000 - -79.80% -
400.perlbench -86.16% 224.000 31.000 - -70.48% -
400.perlbench (avg) -86.16% 224.000 31.000 - -70.48% -
482.sphinx3 (max) (percentage) -85.62% 5.840 0.840 - -99.13% -
459.GemsFDTD -85.40% 493.000 72.000 - -80.00% -
459.GemsFDTD (avg) -85.40% 493.000 72.000 - -80.00% -
456.hmmer (unexplained diff vs previous) (percentage) -84.85% 0.660 0.100 0.000 -99.96% 0.000
456.hmmer (max) (percentage) -84.62% 0.650 0.100 - -99.86% -
444.namd (avg) (percentage) -83.51% 7.520 1.240 - -86.55% -
400.perlbench (max) -83.03% 218.000 37.000 - -97.35% -
473.astar (unexplained diff vs previous) (percentage) -81.82% 0.110 0.020 0.000 -99.99% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -80.62% 2.890 0.560 0.000 -99.42% 0.000
456.hmmer -80.26% 76.000 15.000 - -88.19% -
456.hmmer (avg) -80.26% 76.000 15.000 - -88.19% -
410.bwaves -79.93% 269.000 54.000 - -78.31% -
410.bwaves (avg) -79.93% 269.000 54.000 - -78.31% -
470.lbm (avg) (percentage) -79.87% 4.470 0.900 - -85.78% -
481.wrf (max) (percentage) -79.85% 4.120 0.830 - -98.79% -
429.mcf (max) (percentage) -79.81% 9.310 1.880 - -97.98% -
401.bzip2 (unexplained diff vs previous) -79.17% 24.000 5.000 0.000 -99.95% 0.000
470.lbm (unexplained diff vs previous) (percentage) -78.67% 3.750 0.800 0.000 -99.70% 0.000
435.gromacs (max) -78.50% 428.000 92.000 - -97.43% -
471.omnetpp -77.94% 272.000 60.000 - -73.09% -
471.omnetpp (avg) -77.94% 272.000 60.000 - -73.09% -
464.h264ref (unexplained diff vs previous) (percentage) -76.71% 0.730 0.170 0.000 -99.86% 0.000
450.soplex (max) (percentage) -75.39% 4.470 1.100 - -98.86% -
445.gobmk (unexplained diff vs previous) -75.18% 141.000 35.000 0.000 -99.37% 0.000
445.gobmk (max) -74.82% 139.000 35.000 - -98.68% -
416.gamess (avg) (percentage) -74.75% 3.010 0.760 - -82.81% -
410.bwaves (max) (percentage) -73.43% 3.350 0.890 - -98.46% -
410.bwaves (unexplained diff vs previous) (percentage) -72.22% 3.240 0.900 0.000 -99.35% 0.000
458.sjeng (unexplained diff vs previous) -71.05% 38.000 11.000 0.000 -99.84% 0.000
458.sjeng (max) -70.27% 37.000 11.000 - -99.69% -
435.gromacs -70.24% 420.000 125.000 - -65.94% -
435.gromacs (avg) -70.24% 420.000 125.000 - -65.94% -
465.tonto (max) (percentage) -67.86% 2.240 0.720 - -96.27% -
465.tonto (unexplained diff vs previous) (percentage) -67.58% 2.190 0.710 0.000 -95.61% 0.000
429.mcf -66.78% 286.000 95.000 - -12.84% -
429.mcf (avg) -66.78% 286.000 95.000 - -12.84% -
482.sphinx3 (unexplained diff vs previous) (percentage) -66.53% 2.510 0.840 0.000 -99.97% 0.000
401.bzip2 -65.93% 135.000 46.000 - -71.43% -
401.bzip2 (avg) -65.93% 135.000 46.000 - -71.43% -
445.gobmk -64.23% 123.000 44.000 - -77.55% -
445.gobmk (avg) -64.23% 123.000 44.000 - -77.55% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -63.85% 1.300 0.470 0.000 -99.81% 0.000
453.povray (max) (percentage) -63.05% 4.980 1.840 - -97.98% -
436.cactusADM (unexplained diff vs previous) (percentage) -62.90% 2.830 1.050 0.000 -99.87% 0.000
462.libquantum (max) (percentage) -62.79% 9.460 3.520 - -96.44% -
434.zeusmp (avg) (percentage) -62.78% 2.660 0.990 - -83.08% -
436.cactusADM (max) (percentage) -62.18% 2.750 1.040 - -98.83% -
447.dealII (unexplained diff vs previous) -61.90% 84.000 32.000 0.000 -99.54% 0.000
436.cactusADM (avg) (percentage) -61.74% 2.980 1.140 - -80.94% -
465.tonto (max) -59.90% 197.000 79.000 - -96.26% -
465.tonto (unexplained diff vs previous) -59.07% 193.000 79.000 0.000 -95.54% 0.000
481.wrf (avg) (percentage) -56.31% 4.120 1.800 - -71.15% -
473.astar (max) -55.62% 543.000 241.000 - -92.92% -
433.milc (avg) (percentage) -55.04% 2.780 1.250 - -79.34% -
435.gromacs (max) (percentage) -53.74% 2.810 1.300 - -97.36% -
433.milc (unexplained diff vs previous) (percentage) -52.88% 2.950 1.390 0.000 -99.86% 0.000
433.milc (max) (percentage) -52.26% 2.870 1.370 - -98.49% -
410.bwaves (avg) (percentage) -50.53% 1.880 0.930 - -78.91% -
482.sphinx3 (avg) (percentage) -49.16% 3.560 1.810 - -77.18% -
464.h264ref (max) -48.04% 102.000 53.000 - -98.31% -
453.povray (avg) (percentage) -45.77% 2.840 1.540 - -80.28% -
458.sjeng (max) (percentage) -44.44% 0.270 0.150 - -99.68% -
458.sjeng (unexplained diff vs previous) (percentage) -44.44% 0.270 0.150 0.000 -99.83% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -42.62% 1.220 0.700 0.000 -99.37% 0.000
445.gobmk (max) (percentage) -41.32% 1.210 0.710 - -98.65% -
450.soplex (unexplained diff vs previous) (percentage) -38.39% 1.120 0.690 0.000 -99.97% 0.000
447.dealII (max) (percentage) -36.69% 3.080 1.950 - -97.57% -
464.h264ref -36.23% 69.000 44.000 - -84.98% -
464.h264ref (avg) -36.23% 69.000 44.000 - -84.98% -
435.gromacs (avg) (percentage) -36.23% 2.760 1.760 - -65.22% -
459.GemsFDTD (avg) (percentage) -35.41% 2.090 1.350 - -76.88% -
447.dealII (avg) (percentage) -31.84% 1.790 1.220 - -78.86% -
429.mcf (unexplained diff vs previous) -30.19% 53.000 37.000 0.000 -99.80% 0.000
471.omnetpp (unexplained diff vs previous) -26.53% 49.000 36.000 0.000 -99.66% 0.000
454.calculix (max) (percentage) -23.15% 1.080 0.830 - -99.17% -
473.astar -22.94% 109.000 84.000 - -60.56% -
473.astar (avg) -22.94% 109.000 84.000 - -60.56% -
456.hmmer (avg) (percentage) -21.74% 0.690 0.540 - -87.76% -
465.tonto (avg) (percentage) -19.61% 1.530 1.230 - -63.17% -
445.gobmk (avg) (percentage) -16.82% 1.070 0.890 - -77.24% -
471.omnetpp (avg) (percentage) -14.17% 2.540 2.180 - -73.41% -
462.libquantum (avg) (percentage) -12.38% 2.100 1.840 - -75.98% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 2.26% -
465.tonto 1.35% 1946163.000 1972394.000 - 1.39% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.81% 1424.000 1934.000 - -88.81% -
437.leslie3d 9.48% 11640.000 12743.000 - -9.99% -
410.bwaves 4.58% 5652.000 5911.000 - -58.69% -
444.namd 4.02% 747.000 777.000 - -91.35% -
401.bzip2 2.48% 2941.000 3014.000 - -79.78% -
450.soplex 1.76% 567.000 577.000 - -96.36% -
456.hmmer 1.53% 2882.000 2926.000 - -73.60% -
465.tonto 1.50% 10941.000 11105.000 - 26.05% -
471.omnetpp 1.17% 2724.000 2756.000 - -74.36% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 62.82% 355.000 578.000 - 7.84% -
437.leslie3d (avg) 62.82% 355.000 578.000 - 7.84% -
437.leslie3d (avg) (percentage) 48.85% 3.050 4.540 - 19.79% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.90% 59479.000 54778.000 - -7.79% -
459.GemsFDTD -4.90% 244728.000 232736.000 - -6.13% -
434.zeusmp -3.55% 152037.000 146647.000 - -4.71% -
464.h264ref -2.14% 387748.000 379436.000 - -2.01% -
435.gromacs -1.90% 499261.000 489757.000 - -2.09% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
444.namd -1.44% 188385.000 185676.000 - -1.39% -
433.milc -1.42% 61382.000 60509.000 - -1.18% -
456.hmmer -1.32% 108691.000 107255.000 - -1.27% -
436.cactusADM -1.27% 352891.000 348399.000 - -1.26% -
450.soplex -1.22% 205081.000 202586.000 - -4.03% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
447.dealII -1.18% 311591.000 307908.000 - -1.61% -
401.bzip2 -1.17% 44233.000 43715.000 - -1.14% -
453.povray -1.12% 661389.000 653961.000 - -1.21% -
482.sphinx3 -1.04% 112859.000 111683.000 - -1.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.25% 6173.000 5355.000 - -77.33% -
482.sphinx3 -12.17% 945.000 830.000 - -97.26% -
400.perlbench -8.06% 1663.000 1529.000 - -86.09% -
447.dealII -3.13% 1724.000 1670.000 - -81.19% -
458.sjeng -2.33% 7567.000 7391.000 - -47.22% -
462.libquantum -2.14% 140.000 137.000 - -98.81% -
435.gromacs -1.65% 7269.000 7149.000 - -53.07% -
453.povray -1.46% 547.000 539.000 - -91.77% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) -99.99% 10146.000 1.000 0.000 -93.33% 0.000
473.astar (unexplained diff vs previous) (percentage) -99.99% 197.850 0.020 0.000 -81.82% 0.000
400.perlbench (unexplained diff vs previous) -99.99% 8772.000 1.000 0.000 -99.51% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -99.99% 527.480 0.070 0.000 -96.26% 0.000
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 0.000 -97.94% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.460 0.000 73.81% 0.000
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 7.000 0.000 -99.08% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.690 0.000 -38.39% 0.000
450.soplex (unexplained diff vs previous) -99.97% 14500.000 4.000 0.000 -97.75% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.840 0.000 -66.53% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.97% 1118.610 0.390 0.000 -95.37% 0.000
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 0.000 -98.95% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.160 0.000 -94.39% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -99.96% 278.630 0.100 0.000 -84.85% 0.000
444.namd (unexplained diff vs previous) -99.96% 8356.000 3.000 0.000 -99.60% 0.000
456.hmmer (unexplained diff vs previous) -99.96% 8030.000 3.000 0.000 -95.89% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -99.95% 368.340 0.170 0.000 6.25% 0.000
401.bzip2 (unexplained diff vs previous) -99.95% 10833.000 5.000 0.000 -79.17% 0.000
456.hmmer (max) -99.91% 2120.000 2.000 - -97.22% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.87% 787.130 1.050 0.000 -62.90% 0.000
436.cactusADM (unexplained diff vs previous) -99.87% 16396.000 22.000 0.000 -95.61% 0.000
456.hmmer (max) (percentage) -99.86% 73.590 0.100 - -84.62% -
433.milc (unexplained diff vs previous) (percentage) -99.86% 980.800 1.390 0.000 -52.88% 0.000
433.milc (unexplained diff vs previous) -99.86% 11289.000 16.000 0.000 -95.79% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -99.86% 118.780 0.170 0.000 -76.71% 0.000
464.h264ref (unexplained diff vs previous) -99.85% 6843.000 10.000 0.000 -90.10% 0.000
429.mcf (unexplained diff vs previous) (percentage) -99.85% 1305.690 1.910 0.000 516.13% 0.000
458.sjeng (unexplained diff vs previous) -99.84% 6876.000 11.000 0.000 -71.05% 0.000
459.GemsFDTD (unexplained diff vs previous) -99.84% 15458.000 25.000 0.000 -91.88% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -99.83% 90.870 0.150 0.000 -44.44% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.81% 250.410 0.470 0.000 -63.85% 0.000
429.mcf (unexplained diff vs previous) -99.80% 18593.000 37.000 0.000 -30.19% 0.000
470.lbm (unexplained diff vs previous) -99.70% 9990.000 30.000 0.000 -93.75% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.70% 263.730 0.800 0.000 -78.67% 0.000
458.sjeng (max) -99.69% 3602.000 11.000 - -70.27% -
458.sjeng (max) (percentage) -99.68% 47.610 0.150 - -44.44% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.67% 391.300 1.310 0.000 184.78% 0.000
471.omnetpp (unexplained diff vs previous) -99.66% 10659.000 36.000 0.000 -26.53% 0.000
434.zeusmp (max) -99.66% 2055.000 7.000 - -98.16% -
434.zeusmp (max) (percentage) -99.66% 81.770 0.280 - -90.14% -
447.dealII (unexplained diff vs previous) -99.54% 7017.000 32.000 0.000 -61.90% 0.000
447.dealII (unexplained diff vs previous) (percentage) -99.53% 407.020 1.920 0.000 102.11% 0.000
435.gromacs (unexplained diff vs previous) -99.43% 7028.000 40.000 0.000 -90.91% 0.000
444.namd (max) (percentage) -99.42% 91.790 0.530 - -93.17% -
435.gromacs (unexplained diff vs previous) (percentage) -99.42% 96.680 0.560 0.000 -80.62% 0.000
444.namd (max) -99.42% 685.000 4.000 - -99.43% -
445.gobmk (unexplained diff vs previous) -99.37% 5581.000 35.000 0.000 -75.18% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -99.37% 111.110 0.700 0.000 -42.62% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -99.35% 137.900 0.900 0.000 -72.22% 0.000
459.GemsFDTD (max) -99.34% 4411.000 29.000 - -97.75% -
482.sphinx3 (max) -99.34% 911.000 6.000 - -99.66% -
410.bwaves (unexplained diff vs previous) -99.32% 7794.000 53.000 0.000 -88.58% 0.000
459.GemsFDTD (max) (percentage) -99.22% 71.460 0.560 - -89.74% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - -23.15% -
482.sphinx3 (max) (percentage) -99.13% 96.500 0.840 - -85.62% -
416.gamess (max) (percentage) -99.01% 38.550 0.380 - -87.38% -
470.lbm (max) -98.94% 2746.000 29.000 - -96.45% -
470.lbm (max) (percentage) -98.91% 72.510 0.790 - -87.62% -
450.soplex (max) -98.90% 545.000 6.000 - -99.15% -
436.cactusADM (max) -98.86% 1848.000 21.000 - -95.68% -
450.soplex (max) (percentage) -98.86% 96.240 1.100 - -75.39% -
436.cactusADM (max) (percentage) -98.83% 88.730 1.040 - -62.18% -
481.wrf (max) (percentage) -98.79% 68.700 0.830 - -79.85% -
445.gobmk (max) -98.68% 2643.000 35.000 - -74.82% -
445.gobmk (max) (percentage) -98.65% 52.630 0.710 - -41.32% -
433.milc (max) -98.56% 1044.000 15.000 - -95.93% -
433.milc (max) (percentage) -98.49% 90.750 1.370 - -52.26% -
410.bwaves (max) (percentage) -98.46% 57.970 0.890 - -73.43% -
410.bwaves (max) -98.41% 3276.000 52.000 - -89.14% -
471.omnetpp (max) (percentage) -98.34% 79.650 1.320 - -90.29% -
471.omnetpp (max) -98.34% 2169.000 36.000 - -97.54% -
464.h264ref (max) (percentage) -98.31% 54.290 0.920 - 24.32% -
464.h264ref (max) -98.31% 3127.000 53.000 - -48.04% -
401.bzip2 (max) (percentage) -98.22% 78.650 1.400 - 400.00% -
453.povray (max) -98.20% 499.000 9.000 - -97.24% -
401.bzip2 (max) -98.18% 2313.000 42.000 - 2.44% -
453.povray (max) (percentage) -97.98% 91.250 1.840 - -63.05% -
429.mcf (max) (percentage) -97.98% 92.890 1.880 - -79.81% -
447.dealII (max) -97.69% 1384.000 32.000 - -88.28% -
447.dealII (max) (percentage) -97.57% 80.280 1.950 - -36.69% -
435.gromacs (max) -97.43% 3573.000 92.000 - -78.50% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 293.33% -
435.gromacs (max) (percentage) -97.36% 49.160 1.300 - -53.74% -
400.perlbench (max) -97.35% 1397.000 37.000 - -83.03% -
429.mcf (max) -97.28% 1322.000 36.000 - -97.76% -
462.libquantum (max) -97.10% 138.000 4.000 - -99.63% -
400.perlbench (max) (percentage) -97.05% 84.060 2.480 - 24.62% -
462.libquantum (max) (percentage) -96.44% 98.970 3.520 - -62.79% -
465.tonto (max) (percentage) -96.27% 19.310 0.720 - -67.86% -
465.tonto (max) -96.26% 2112.000 79.000 - -59.90% -
403.gcc (max) (percentage) -96.14% 99.360 3.840 - 1029.41% -
465.tonto (unexplained diff vs previous) (percentage) -95.61% 16.190 0.710 0.000 -67.58% 0.000
465.tonto (unexplained diff vs previous) -95.54% 1771.000 79.000 0.000 -59.07% 0.000
473.astar (max) (percentage) -92.94% 66.430 4.690 - 22.45% -
473.astar (max) -92.92% 3406.000 241.000 - -55.62% -
456.hmmer -88.19% 127.000 15.000 - -80.26% -
456.hmmer (avg) -88.19% 127.000 15.000 - -80.26% -
456.hmmer (avg) (percentage) -87.76% 4.410 0.540 - -21.74% -
444.namd -86.76% 68.000 9.000 - -98.67% -
444.namd (avg) -86.76% 68.000 9.000 - -98.67% -
444.namd (avg) (percentage) -86.55% 9.220 1.240 - -83.51% -
470.lbm -86.19% 239.000 33.000 - -94.23% -
470.lbm (avg) -86.19% 239.000 33.000 - -94.23% -
470.lbm (avg) (percentage) -85.78% 6.330 0.900 - -79.87% -
464.h264ref (avg) (percentage) -85.07% 5.090 0.760 - 52.00% -
464.h264ref -84.98% 293.000 44.000 - -36.23% -
464.h264ref (avg) -84.98% 293.000 44.000 - -36.23% -
434.zeusmp -83.67% 147.000 24.000 - -93.26% -
434.zeusmp (avg) -83.67% 147.000 24.000 - -93.26% -
434.zeusmp (avg) (percentage) -83.08% 5.850 0.990 - -62.78% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -74.75% -
436.cactusADM -81.45% 124.000 23.000 - -95.64% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -95.64% -
453.povray -80.95% 42.000 8.000 - -95.70% -
453.povray (avg) -80.95% 42.000 8.000 - -95.70% -
436.cactusADM (avg) (percentage) -80.94% 5.980 1.140 - -61.74% -
458.sjeng -80.91% 241.000 46.000 - 15.00% -
458.sjeng (avg) -80.91% 241.000 46.000 - 15.00% -
453.povray (avg) (percentage) -80.28% 7.810 1.540 - -45.77% -
458.sjeng (avg) (percentage) -80.25% 3.190 0.630 - 117.24% -
459.GemsFDTD -80.00% 360.000 72.000 - -85.40% -
459.GemsFDTD (avg) -80.00% 360.000 72.000 - -85.40% -
462.libquantum -80.00% 10.000 2.000 - -99.17% -
462.libquantum (avg) -80.00% 10.000 2.000 - -99.17% -
447.dealII -79.80% 99.000 20.000 - -87.34% -
447.dealII (avg) -79.80% 99.000 20.000 - -87.34% -
482.sphinx3 -79.73% 74.000 15.000 - -98.61% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - -98.61% -
433.milc -79.71% 69.000 14.000 - -96.09% -
433.milc (avg) -79.71% 69.000 14.000 - -96.09% -
433.milc (avg) (percentage) -79.34% 6.050 1.250 - -55.04% -
410.bwaves (avg) (percentage) -78.91% 4.410 0.930 - -50.53% -
447.dealII (avg) (percentage) -78.86% 5.770 1.220 - -31.84% -
410.bwaves -78.31% 249.000 54.000 - -79.93% -
410.bwaves (avg) -78.31% 249.000 54.000 - -79.93% -
445.gobmk -77.55% 196.000 44.000 - -64.23% -
445.gobmk (avg) -77.55% 196.000 44.000 - -64.23% -
445.gobmk (avg) (percentage) -77.24% 3.910 0.890 - -16.82% -
482.sphinx3 (avg) (percentage) -77.18% 7.930 1.810 - -49.16% -
459.GemsFDTD (avg) (percentage) -76.88% 5.840 1.350 - -35.41% -
462.libquantum (avg) (percentage) -75.98% 7.660 1.840 - -12.38% -
471.omnetpp (avg) (percentage) -73.41% 8.200 2.180 - -14.17% -
471.omnetpp -73.09% 223.000 60.000 - -77.94% -
471.omnetpp (avg) -73.09% 223.000 60.000 - -77.94% -
401.bzip2 (avg) (percentage) -72.08% 5.480 1.530 - 68.13% -
401.bzip2 -71.43% 161.000 46.000 - -65.93% -
401.bzip2 (avg) -71.43% 161.000 46.000 - -65.93% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -56.31% -
400.perlbench -70.48% 105.000 31.000 - -86.16% -
400.perlbench (avg) -70.48% 105.000 31.000 - -86.16% -
400.perlbench (avg) (percentage) -67.87% 6.350 2.040 - 0.00% -
435.gromacs -65.94% 367.000 125.000 - -70.24% -
435.gromacs (avg) -65.94% 367.000 125.000 - -70.24% -
435.gromacs (avg) (percentage) -65.22% 5.060 1.760 - -36.23% -
465.tonto (avg) (percentage) -63.17% 3.340 1.230 - -19.61% -
465.tonto -62.74% 365.000 136.000 - 1.49% -
465.tonto (avg) -62.74% 365.000 136.000 - 1.49% -
450.soplex -61.11% 36.000 14.000 - -95.83% -
450.soplex (avg) -61.11% 36.000 14.000 - -95.83% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 19.34% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - 112.99% -
473.astar -60.56% 213.000 84.000 - -22.94% -
473.astar (avg) -60.56% 213.000 84.000 - -22.94% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 429.41% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 604.76% -
429.mcf (avg) (percentage) -35.46% 7.670 4.950 - 198.19% -
437.leslie3d (unexplained diff vs previous) (percentage) -34.21% 19.880 13.080 0.000 289.29% 0.000
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1397.06% -
437.leslie3d (unexplained diff vs previous) -27.96% 2314.000 1667.000 0.000 250.95% 0.000
429.mcf -12.84% 109.000 95.000 - -66.78% -
429.mcf (avg) -12.84% 109.000 95.000 - -66.78% -
437.leslie3d (max) (percentage) -9.23% 16.580 15.050 - 229.32% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1529.000 -86.09%
401.bzip2 3014.000 -79.78%
410.bwaves 5911.000 -58.69%
429.mcf 1934.000 -88.81%
433.milc 1150.000 -91.07%
434.zeusmp 2520.000 -81.20%
435.gromacs 7149.000 -53.07%
436.cactusADM 2101.000 -88.13%
437.leslie3d 12743.000 -9.99%
444.namd 777.000 -91.35%
445.gobmk 4998.000 -56.74%
447.dealII 1670.000 -81.19%
450.soplex 577.000 -96.36%
453.povray 539.000 -91.77%
456.hmmer 2926.000 -73.60%
458.sjeng 7391.000 -47.22%
459.GemsFDTD 5355.000 -77.33%
462.libquantum 137.000 -98.81%
464.h264ref 5796.000 -58.10%
465.tonto 11105.000 26.05%
470.lbm 3769.000 -70.56%
471.omnetpp 2756.000 -74.36%
473.astar 5140.000 -63.76%
482.sphinx3 830.000 -97.26%
Geometric Mean 2470.316 -81.28%
Code Size (bytes)
Name Current %
400.perlbench 895899.000 -
401.bzip2 43715.000 -1.14%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60509.000 -1.18%
434.zeusmp 146647.000 -4.71%
435.gromacs 489757.000 -2.09%
436.cactusADM 348399.000 -1.26%
437.leslie3d 54778.000 -7.79%
444.namd 185676.000 -1.39%
445.gobmk 1374946.000 -
447.dealII 307908.000 -1.61%
450.soplex 202586.000 -4.03%
453.povray 653961.000 -1.21%
456.hmmer 107255.000 -1.27%
458.sjeng 106376.000 2.26%
459.GemsFDTD 232736.000 -6.13%
462.libquantum 15893.000 -
464.h264ref 379436.000 -2.01%
465.tonto 1972394.000 1.39%
470.lbm 9547.000 -1.69%
471.omnetpp 475404.000 -1.47%
473.astar 22756.000 -
482.sphinx3 111683.000 -1.02%
Geometric Mean 136815.251 -1.70%
Score
Name Current %
nb_compile_successful 48.000 65.52%
nb_execution_successful 48.000 65.52%
nb_total_tests 68.000 134.48%
Geometric Mean 53.909 85.89%
sample variability
Name Current %
400.perlbench 31.000 -86.16%
400.perlbench (avg) 31.000 -86.16%
400.perlbench (avg) (percentage) 2.040 -
400.perlbench (max) 37.000 -83.03%
400.perlbench (max) (percentage) 2.480 24.62%
400.perlbench (unexplained diff vs previous) 1.000 -99.51%
400.perlbench (unexplained diff vs previous) (percentage) 0.070 -96.26%
401.bzip2 46.000 -65.93%
401.bzip2 (avg) 46.000 -65.93%
401.bzip2 (avg) (percentage) 1.530 68.13%
401.bzip2 (max) 42.000 2.44%
401.bzip2 (max) (percentage) 1.400 400.00%
401.bzip2 (unexplained diff vs previous) 5.000 -79.17%
401.bzip2 (unexplained diff vs previous) (percentage) 0.170 6.25%
403.gcc (avg) (percentage) 5.090 1397.06%
403.gcc (max) (percentage) 3.840 1029.41%
410.bwaves 54.000 -79.93%
410.bwaves (avg) 54.000 -79.93%
410.bwaves (avg) (percentage) 0.930 -50.53%
410.bwaves (max) 52.000 -89.14%
410.bwaves (max) (percentage) 0.890 -73.43%
410.bwaves (unexplained diff vs previous) 53.000 -88.58%
410.bwaves (unexplained diff vs previous) (percentage) 0.900 -72.22%
416.gamess (avg) (percentage) 0.760 -74.75%
416.gamess (max) (percentage) 0.380 -87.38%
429.mcf 95.000 -66.78%
429.mcf (avg) 95.000 -66.78%
429.mcf (avg) (percentage) 4.950 198.19%
429.mcf (max) 36.000 -97.76%
429.mcf (max) (percentage) 1.880 -79.81%
429.mcf (unexplained diff vs previous) 37.000 -30.19%
429.mcf (unexplained diff vs previous) (percentage) 1.910 516.13%
433.milc 14.000 -96.09%
433.milc (avg) 14.000 -96.09%
433.milc (avg) (percentage) 1.250 -55.04%
433.milc (max) 15.000 -95.93%
433.milc (max) (percentage) 1.370 -52.26%
433.milc (unexplained diff vs previous) 16.000 -95.79%
433.milc (unexplained diff vs previous) (percentage) 1.390 -52.88%
434.zeusmp 24.000 -93.26%
434.zeusmp (avg) 24.000 -93.26%
434.zeusmp (avg) (percentage) 0.990 -62.78%
434.zeusmp (max) 7.000 -98.16%
434.zeusmp (max) (percentage) 0.280 -90.14%
434.zeusmp (unexplained diff vs previous) 4.000 -98.95%
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -94.39%
435.gromacs 125.000 -70.24%
435.gromacs (avg) 125.000 -70.24%
435.gromacs (avg) (percentage) 1.760 -36.23%
435.gromacs (max) 92.000 -78.50%
435.gromacs (max) (percentage) 1.300 -53.74%
435.gromacs (unexplained diff vs previous) 40.000 -90.91%
435.gromacs (unexplained diff vs previous) (percentage) 0.560 -80.62%
436.cactusADM 23.000 -95.64%
436.cactusADM (avg) 23.000 -95.64%
436.cactusADM (avg) (percentage) 1.140 -61.74%
436.cactusADM (max) 21.000 -95.68%
436.cactusADM (max) (percentage) 1.040 -62.18%
436.cactusADM (unexplained diff vs previous) 22.000 -95.61%
436.cactusADM (unexplained diff vs previous) (percentage) 1.050 -62.90%
437.leslie3d 578.000 7.84%
437.leslie3d (avg) 578.000 7.84%
437.leslie3d (avg) (percentage) 4.540 19.79%
437.leslie3d (max) 1917.000 196.75%
437.leslie3d (max) (percentage) 15.050 229.32%
437.leslie3d (unexplained diff vs previous) 1667.000 250.95%
437.leslie3d (unexplained diff vs previous) (percentage) 13.080 289.29%
444.namd 9.000 -98.67%
444.namd (avg) 9.000 -98.67%
444.namd (avg) (percentage) 1.240 -83.51%
444.namd (max) 4.000 -99.43%
444.namd (max) (percentage) 0.530 -93.17%
444.namd (unexplained diff vs previous) 3.000 -99.60%
444.namd (unexplained diff vs previous) (percentage) 0.390 -95.37%
445.gobmk 44.000 -64.23%
445.gobmk (avg) 44.000 -64.23%
445.gobmk (avg) (percentage) 0.890 -16.82%
445.gobmk (max) 35.000 -74.82%
445.gobmk (max) (percentage) 0.710 -41.32%
445.gobmk (unexplained diff vs previous) 35.000 -75.18%
445.gobmk (unexplained diff vs previous) (percentage) 0.700 -42.62%
447.dealII 20.000 -87.34%
447.dealII (avg) 20.000 -87.34%
447.dealII (avg) (percentage) 1.220 -31.84%
447.dealII (max) 32.000 -88.28%
447.dealII (max) (percentage) 1.950 -36.69%
447.dealII (unexplained diff vs previous) 32.000 -61.90%
447.dealII (unexplained diff vs previous) (percentage) 1.920 102.11%
450.soplex 14.000 -95.83%
450.soplex (avg) 14.000 -95.83%
450.soplex (avg) (percentage) 2.530 19.34%
450.soplex (max) 6.000 -99.15%
450.soplex (max) (percentage) 1.100 -75.39%
450.soplex (unexplained diff vs previous) 4.000 -97.75%
450.soplex (unexplained diff vs previous) (percentage) 0.690 -38.39%
453.povray 8.000 -95.70%
453.povray (avg) 8.000 -95.70%
453.povray (avg) (percentage) 1.540 -45.77%
453.povray (max) 9.000 -97.24%
453.povray (max) (percentage) 1.840 -63.05%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix (avg) (percentage) 3.600 429.41%
454.calculix (max) (percentage) 0.830 -23.15%
456.hmmer 15.000 -80.26%
456.hmmer (avg) 15.000 -80.26%
456.hmmer (avg) (percentage) 0.540 -21.74%
456.hmmer (max) 2.000 -97.22%
456.hmmer (max) (percentage) 0.100 -84.62%
456.hmmer (unexplained diff vs previous) 3.000 -95.89%
456.hmmer (unexplained diff vs previous) (percentage) 0.100 -84.85%
458.sjeng 46.000 15.00%
458.sjeng (avg) 46.000 15.00%
458.sjeng (avg) (percentage) 0.630 117.24%
458.sjeng (max) 11.000 -70.27%
458.sjeng (max) (percentage) 0.150 -44.44%
458.sjeng (unexplained diff vs previous) 11.000 -71.05%
458.sjeng (unexplained diff vs previous) (percentage) 0.150 -44.44%
459.GemsFDTD 72.000 -85.40%
459.GemsFDTD (avg) 72.000 -85.40%
459.GemsFDTD (avg) (percentage) 1.350 -35.41%
459.GemsFDTD (max) 29.000 -97.75%
459.GemsFDTD (max) (percentage) 0.560 -89.74%
459.GemsFDTD (unexplained diff vs previous) 25.000 -91.88%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.470 -63.85%
462.libquantum 2.000 -99.17%
462.libquantum (avg) 2.000 -99.17%
462.libquantum (avg) (percentage) 1.840 -12.38%
462.libquantum (max) 4.000 -99.63%
462.libquantum (max) (percentage) 3.520 -62.79%
462.libquantum (unexplained diff vs previous) 2.000 -97.94%
462.libquantum (unexplained diff vs previous) (percentage) 1.460 73.81%
464.h264ref 44.000 -36.23%
464.h264ref (avg) 44.000 -36.23%
464.h264ref (avg) (percentage) 0.760 52.00%
464.h264ref (max) 53.000 -48.04%
464.h264ref (max) (percentage) 0.920 24.32%
464.h264ref (unexplained diff vs previous) 10.000 -90.10%
464.h264ref (unexplained diff vs previous) (percentage) 0.170 -76.71%
465.tonto 136.000 1.49%
465.tonto (avg) 136.000 1.49%
465.tonto (avg) (percentage) 1.230 -19.61%
465.tonto (max) 79.000 -59.90%
465.tonto (max) (percentage) 0.720 -67.86%
465.tonto (unexplained diff vs previous) 79.000 -59.07%
465.tonto (unexplained diff vs previous) (percentage) 0.710 -67.58%
470.lbm 33.000 -94.23%
470.lbm (avg) 33.000 -94.23%
470.lbm (avg) (percentage) 0.900 -79.87%
470.lbm (max) 29.000 -96.45%
470.lbm (max) (percentage) 0.790 -87.62%
470.lbm (unexplained diff vs previous) 30.000 -93.75%
470.lbm (unexplained diff vs previous) (percentage) 0.800 -78.67%
471.omnetpp 60.000 -77.94%
471.omnetpp (avg) 60.000 -77.94%
471.omnetpp (avg) (percentage) 2.180 -14.17%
471.omnetpp (max) 36.000 -97.54%
471.omnetpp (max) (percentage) 1.320 -90.29%
471.omnetpp (unexplained diff vs previous) 36.000 -26.53%
471.omnetpp (unexplained diff vs previous) (percentage) 1.310 184.78%
473.astar 84.000 -22.94%
473.astar (avg) 84.000 -22.94%
473.astar (avg) (percentage) 1.640 112.99%
473.astar (max) 241.000 -55.62%
473.astar (max) (percentage) 4.690 22.45%
473.astar (unexplained diff vs previous) 1.000 -93.33%
473.astar (unexplained diff vs previous) (percentage) 0.020 -81.82%
481.wrf (avg) (percentage) 1.800 -56.31%
481.wrf (max) (percentage) 0.830 -79.85%
482.sphinx3 15.000 -98.61%
482.sphinx3 (avg) 15.000 -98.61%
482.sphinx3 (avg) (percentage) 1.810 -49.16%
482.sphinx3 (max) 6.000 -99.66%
482.sphinx3 (max) (percentage) 0.840 -85.62%
482.sphinx3 (unexplained diff vs previous) 7.000 -99.08%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.840 -66.53%
483.xalancbmk (avg) (percentage) 2.960 604.76%
483.xalancbmk (max) (percentage) 1.770 293.33%
Geometric Mean 5.044 -80.14%