Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e1e4078ac59740a79cd709d61872abe15aba0087 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (c5a36c4e591e41efe3e4d892ff62831d801752d3) (+ 10 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e442e8376dcb14c904523c78994157cb5b502ff1 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bb1d93eedc25f5d3a1db5e2183a6cbc5f3b5888a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/314/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0314 (basepoints/gcc-15-04846-gc5a36c4e591) 2024-11-03T03:12:03 0:00:00
Previous 0313 (4-changed-components) 2022-10-10T11:41:34 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 77 12
Performance Improvements 142 202
Added Tests 4 0
Unchanged Tests 1013 1022
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.41% 1948787.000 1976311.000 - 1.55% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 35.53% 8309.000 11261.000 - 2.92% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) (percentage) 4975.00% 0.240 12.180 - -86.89% -
429.mcf (unexplained diff vs previous) (percentage) 3433.33% 0.030 1.060 - -99.92% -
429.mcf (avg) (percentage) 1840.00% 0.250 4.850 - -36.77% -
437.leslie3d (unexplained diff vs previous) (percentage) 1581.25% 0.320 5.380 - -72.94% -
403.gcc (avg) (percentage) 1442.42% 0.330 5.090 - -30.46% -
473.astar (max) (percentage) 1389.66% 0.290 4.320 - -93.50% -
437.leslie3d (unexplained diff vs previous) 1269.57% 46.000 630.000 - -72.77% -
454.calculix (avg) (percentage) 958.82% 0.340 3.600 - -55.11% -
444.namd (unexplained diff vs previous) (percentage) 750.00% 0.060 0.510 - -99.95% -
473.astar (avg) (percentage) 680.95% 0.210 1.640 - -60.58% -
458.sjeng (unexplained diff vs previous) (percentage) 625.00% 0.040 0.290 - -99.68% -
447.dealII (unexplained diff vs previous) (percentage) 595.00% 0.200 1.390 - -99.66% -
429.mcf (max) 517.07% 41.000 253.000 - -80.86% -
403.gcc (max) (percentage) 511.29% 0.620 3.790 - -96.19% -
473.astar (max) 439.02% 41.000 221.000 - -93.51% -
482.sphinx3 (unexplained diff vs previous) (percentage) 405.26% 0.190 0.960 - -99.97% -
450.soplex (max) (percentage) 312.50% 1.120 4.620 - -95.20% -
462.libquantum (max) (percentage) 305.94% 1.010 4.100 - -95.86% -
462.libquantum (avg) (percentage) 297.87% 0.470 1.870 - -75.59% -
436.cactusADM (unexplained diff vs previous) (percentage) 266.67% 0.090 0.330 - -99.96% -
429.mcf (unexplained diff vs previous) 266.67% 6.000 22.000 - -99.88% -
465.tonto (unexplained diff vs previous) 254.90% 51.000 181.000 - -89.78% -
458.sjeng (unexplained diff vs previous) 250.00% 6.000 21.000 - -99.69% -
458.sjeng (avg) (percentage) 195.24% 0.210 0.620 - -80.56% -
473.astar 189.66% 29.000 84.000 - -60.56% -
473.astar (avg) 189.66% 29.000 84.000 - -60.56% -
401.bzip2 (avg) (percentage) 186.27% 0.510 1.460 - -73.36% -
458.sjeng (max) (percentage) 180.00% 0.450 1.260 - -97.35% -
464.h264ref (max) (percentage) 169.23% 0.390 1.050 - -98.07% -
450.soplex (avg) (percentage) 166.32% 0.950 2.530 - -60.65% -
465.tonto (unexplained diff vs previous) (percentage) 163.93% 0.610 1.610 - -90.06% -
483.xalancbmk (avg) (percentage) 148.74% 1.190 2.960 - -54.46% -
429.mcf 134.88% 43.000 101.000 - -7.34% -
429.mcf (avg) 134.88% 43.000 101.000 - -7.34% -
447.dealII (avg) (percentage) 110.53% 0.570 1.200 - -79.20% -
445.gobmk (avg) (percentage) 104.55% 0.440 0.900 - -76.98% -
464.h264ref (avg) (percentage) 102.70% 0.370 0.750 - -85.27% -
437.leslie3d (avg) (percentage) 101.86% 2.150 4.340 - 42.30% -
454.calculix (max) (percentage) 93.02% 0.430 0.830 - -99.17% -
473.astar (unexplained diff vs previous) (percentage) 82.76% 0.290 0.530 - -99.73% -
437.leslie3d (max) (percentage) 82.37% 3.120 5.690 - -65.68% -
470.lbm (unexplained diff vs previous) (percentage) 81.25% 0.160 0.290 - -99.89% -
445.gobmk (max) (percentage) 78.02% 0.910 1.620 - -96.92% -
401.bzip2 (max) (percentage) 69.92% 1.330 2.260 - -97.13% -
437.leslie3d 66.56% 305.000 508.000 - 43.10% -
437.leslie3d (avg) 66.56% 305.000 508.000 - 43.10% -
447.dealII (max) (percentage) 63.95% 0.860 1.410 - -98.24% -
458.sjeng 55.17% 29.000 45.000 - -81.33% -
458.sjeng (avg) 55.17% 29.000 45.000 - -81.33% -
401.bzip2 (unexplained diff vs previous) (percentage) 51.61% 0.310 0.470 - -99.87% -
437.leslie3d (max) 50.34% 443.000 666.000 - -65.47% -
445.gobmk (unexplained diff vs previous) (percentage) 50.00% 0.200 0.300 - -99.73% -
433.milc (max) (percentage) 47.52% 2.020 2.980 - -96.72% -
465.tonto 47.37% 95.000 140.000 - -61.64% -
465.tonto (avg) 47.37% 95.000 140.000 - -61.64% -
462.libquantum (unexplained diff vs previous) (percentage) 47.00% 1.000 1.470 - -99.98% -
458.sjeng (max) 46.03% 63.000 92.000 - -97.45% -
435.gromacs (max) (percentage) 44.35% 2.300 3.320 - -93.25% -
453.povray (max) (percentage) 43.48% 2.300 3.300 - -96.38% -
450.soplex (unexplained diff vs previous) (percentage) 38.00% 0.500 0.690 - -99.97% -
453.povray (avg) (percentage) 37.07% 1.160 1.590 - -79.64% -
471.omnetpp (avg) (percentage) 31.71% 1.640 2.160 - -73.66% -
447.dealII (unexplained diff vs previous) 27.78% 18.000 23.000 - -99.67% -
465.tonto (max) 25.29% 174.000 218.000 - -89.68% -
400.perlbench (avg) (percentage) 23.12% 1.600 1.970 - -68.98% -
435.gromacs (avg) (percentage) 18.92% 1.480 1.760 - -65.22% -
482.sphinx3 (max) (percentage) 18.58% 2.260 2.680 - -97.22% -
434.zeusmp (max) (percentage) 13.89% 1.440 1.640 - -97.99% -
464.h264ref (max) 13.21% 53.000 60.000 - -98.08% -
464.h264ref (unexplained diff vs previous) (percentage) 11.76% 0.340 0.380 - -99.68% -
459.GemsFDTD (avg) (percentage) 9.09% 1.210 1.320 - -77.40% -
465.tonto (avg) (percentage) 8.70% 1.150 1.250 - -62.57% -
434.zeusmp (unexplained diff vs previous) (percentage) 4.00% 0.250 0.260 - -99.94% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -6.17% 247936.000 232648.000 - -4.94% -
434.zeusmp -4.56% 153897.000 146883.000 - -3.39% -
450.soplex -2.13% 206988.000 202574.000 - -1.22% -
435.gromacs -2.09% 500143.000 489677.000 - -1.92% -
464.h264ref -1.99% 387148.000 379440.000 - -2.14% -
447.dealII -1.90% 312932.000 306976.000 - -1.48% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
458.sjeng -1.68% 104028.000 102284.000 - -1.70% -
471.omnetpp -1.47% 482480.000 475388.000 - -0.55% -
444.namd -1.34% 188293.000 185768.000 - -1.39% -
456.hmmer -1.31% 108623.000 107195.000 - -1.38% -
453.povray -1.22% 657843.000 649821.000 - -1.75% -
433.milc -1.19% 61230.000 60501.000 - -1.44% -
401.bzip2 -1.12% 44213.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111663.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.83% 11637.000 136.000 - -2.86% -
482.sphinx3 -97.28% 30531.000 830.000 - -12.17% -
450.soplex -96.33% 15879.000 582.000 - 2.65% -
453.povray -91.56% 6468.000 546.000 - -0.18% -
444.namd -91.33% 9012.000 781.000 - 4.55% -
433.milc -91.08% 12978.000 1157.000 - 0.52% -
436.cactusADM -88.05% 17692.000 2114.000 - 1.49% -
429.mcf -87.90% 17219.000 2083.000 - 46.28% -
400.perlbench -85.87% 10848.000 1533.000 - -7.82% -
434.zeusmp -82.77% 13485.000 2323.000 - -7.60% -
447.dealII -81.31% 8852.000 1654.000 - -4.06% -
401.bzip2 -80.16% 14928.000 2961.000 - 0.68% -
459.GemsFDTD -77.36% 23624.000 5349.000 - -13.35% -
471.omnetpp -75.06% 10725.000 2675.000 - -1.80% -
456.hmmer -73.92% 11083.000 2891.000 - 0.31% -
470.lbm -70.59% 12813.000 3768.000 - -0.53% -
473.astar -63.86% 14203.000 5133.000 - 0.10% -
410.bwaves -58.32% 14180.000 5910.000 - 4.56% -
464.h264ref -57.87% 13739.000 5788.000 - 0.47% -
445.gobmk -56.81% 11538.000 4983.000 - -0.80% -
435.gromacs -53.71% 15398.000 7127.000 - -1.95% -
458.sjeng -47.73% 14066.000 7352.000 - -2.84% -
437.leslie3d -17.58% 14209.000 11711.000 - 0.61% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (unexplained diff vs previous) -98.90% 455.000 5.000 - -99.94% -
433.milc (unexplained diff vs previous) -98.81% 84.000 1.000 - -99.99% -
462.libquantum (unexplained diff vs previous) -98.28% 116.000 2.000 - -99.99% -
444.namd (max) -97.97% 492.000 10.000 - -98.54% -
482.sphinx3 -97.60% 583.000 14.000 - -81.08% -
482.sphinx3 (avg) -97.60% 583.000 14.000 - -81.08% -
410.bwaves (unexplained diff vs previous) (percentage) -97.51% 3.210 0.080 - -99.94% -
444.namd -97.37% 342.000 9.000 - -86.76% -
444.namd (avg) -97.37% 342.000 9.000 - -86.76% -
482.sphinx3 (max) -96.81% 690.000 22.000 - -97.59% -
462.libquantum -96.30% 54.000 2.000 - -80.00% -
462.libquantum (avg) -96.30% 54.000 2.000 - -80.00% -
462.libquantum (max) -95.73% 117.000 5.000 - -96.38% -
456.hmmer (unexplained diff vs previous) -95.45% 110.000 5.000 - -99.94% -
450.soplex (unexplained diff vs previous) -94.94% 79.000 4.000 - -99.97% -
453.povray (unexplained diff vs previous) -94.44% 18.000 1.000 - -99.98% -
433.milc -93.64% 220.000 14.000 - -79.71% -
433.milc (avg) -93.64% 220.000 14.000 - -79.71% -
436.cactusADM (max) -93.28% 357.000 24.000 - -98.70% -
470.lbm (max) -90.93% 386.000 35.000 - -98.73% -
436.cactusADM -90.69% 247.000 23.000 - -81.45% -
436.cactusADM (avg) -90.69% 247.000 23.000 - -81.45% -
450.soplex -90.67% 150.000 14.000 - -61.11% -
450.soplex (avg) -90.67% 150.000 14.000 - -61.11% -
400.perlbench (max) -90.54% 444.000 42.000 - -96.99% -
453.povray -89.33% 75.000 8.000 - -80.95% -
453.povray (avg) -89.33% 75.000 8.000 - -80.95% -
453.povray (max) -87.84% 148.000 18.000 - -96.39% -
416.gamess (max) (percentage) -87.54% 2.970 0.370 - -99.04% -
434.zeusmp -87.43% 175.000 22.000 - -85.03% -
434.zeusmp (avg) -87.43% 175.000 22.000 - -85.03% -
433.milc (max) -87.02% 262.000 34.000 - -96.74% -
470.lbm -86.67% 240.000 32.000 - -86.61% -
470.lbm (avg) -86.67% 240.000 32.000 - -86.61% -
433.milc (unexplained diff vs previous) (percentage) -86.15% 0.650 0.090 - -99.99% -
482.sphinx3 (unexplained diff vs previous) -85.96% 57.000 8.000 - -99.97% -
410.bwaves (max) -85.74% 470.000 67.000 - -97.95% -
450.soplex (max) -85.31% 177.000 26.000 - -95.23% -
456.hmmer (max) -84.55% 110.000 17.000 - -99.20% -
456.hmmer (unexplained diff vs previous) (percentage) -82.83% 0.990 0.170 - -99.94% -
400.perlbench -82.66% 173.000 30.000 - -71.43% -
400.perlbench (avg) -82.66% 173.000 30.000 - -71.43% -
434.zeusmp (unexplained diff vs previous) -82.35% 34.000 6.000 - -99.95% -
459.GemsFDTD (max) -80.78% 562.000 108.000 - -97.55% -
459.GemsFDTD (unexplained diff vs previous) -80.77% 52.000 10.000 - -99.94% -
434.zeusmp (max) -80.41% 194.000 38.000 - -98.15% -
471.omnetpp (max) -78.69% 183.000 39.000 - -98.20% -
471.omnetpp (unexplained diff vs previous) -77.78% 180.000 40.000 - -99.62% -
410.bwaves -77.68% 233.000 52.000 - -79.12% -
410.bwaves (avg) -77.68% 233.000 52.000 - -79.12% -
456.hmmer -77.61% 67.000 15.000 - -88.19% -
456.hmmer (avg) -77.61% 67.000 15.000 - -88.19% -
481.wrf (max) (percentage) -77.16% 3.590 0.820 - -98.81% -
444.namd (max) (percentage) -76.01% 5.460 1.310 - -98.57% -
459.GemsFDTD -75.44% 285.000 70.000 - -80.56% -
459.GemsFDTD (avg) -75.44% 285.000 70.000 - -80.56% -
483.xalancbmk (max) (percentage) -74.38% 6.910 1.770 - -97.42% -
447.dealII (max) -69.74% 76.000 23.000 - -98.34% -
401.bzip2 (unexplained diff vs previous) -69.57% 46.000 14.000 - -99.87% -
470.lbm (max) (percentage) -68.54% 3.020 0.950 - -98.69% -
444.namd (avg) (percentage) -68.42% 3.800 1.200 - -86.98% -
471.omnetpp -67.43% 175.000 57.000 - -74.44% -
471.omnetpp (avg) -67.43% 175.000 57.000 - -74.44% -
401.bzip2 (max) -66.67% 198.000 66.000 - -97.15% -
410.bwaves (max) (percentage) -65.36% 3.320 1.150 - -98.02% -
416.gamess (avg) (percentage) -64.49% 2.140 0.760 - -82.81% -
447.dealII -62.00% 50.000 19.000 - -80.81% -
447.dealII (avg) -62.00% 50.000 19.000 - -80.81% -
436.cactusADM (unexplained diff vs previous) -56.25% 16.000 7.000 - -99.96% -
470.lbm (avg) (percentage) -54.26% 1.880 0.860 - -86.41% -
464.h264ref (unexplained diff vs previous) -53.19% 47.000 22.000 - -99.68% -
470.lbm (unexplained diff vs previous) -47.62% 21.000 11.000 - -99.89% -
410.bwaves (avg) (percentage) -46.06% 1.650 0.890 - -79.82% -
435.gromacs -44.93% 227.000 125.000 - -65.94% -
435.gromacs (avg) -44.93% 227.000 125.000 - -65.94% -
401.bzip2 -43.42% 76.000 43.000 - -73.29% -
401.bzip2 (avg) -43.42% 76.000 43.000 - -73.29% -
436.cactusADM (max) (percentage) -41.58% 2.020 1.180 - -98.67% -
456.hmmer (max) (percentage) -39.00% 1.000 0.610 - -99.17% -
453.povray (unexplained diff vs previous) (percentage) -35.71% 0.280 0.180 - -99.98% -
445.gobmk (unexplained diff vs previous) -34.78% 23.000 15.000 - -99.73% -
473.astar (unexplained diff vs previous) -34.15% 41.000 27.000 - -99.73% -
435.gromacs (max) -33.33% 354.000 236.000 - -93.39% -
400.perlbench (max) (percentage) -31.71% 4.100 2.800 - -96.67% -
433.milc (avg) (percentage) -26.47% 1.700 1.250 - -79.34% -
434.zeusmp (avg) (percentage) -25.38% 1.300 0.970 - -83.42% -
445.gobmk (max) -23.08% 104.000 80.000 - -96.97% -
436.cactusADM (avg) (percentage) -22.14% 1.400 1.090 - -81.77% -
444.namd (unexplained diff vs previous) -20.00% 5.000 4.000 - -99.95% -
459.GemsFDTD (max) (percentage) -15.13% 2.380 2.020 - -97.17% -
471.omnetpp (max) (percentage) -14.04% 1.710 1.470 - -98.15% -
464.h264ref -14.00% 50.000 43.000 - -85.32% -
464.h264ref (avg) -14.00% 50.000 43.000 - -85.32% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -13.64% 0.220 0.190 - -99.92% -
456.hmmer (avg) (percentage) -13.11% 0.610 0.530 - -87.98% -
445.gobmk -12.00% 50.000 44.000 - -77.55% -
445.gobmk (avg) -12.00% 50.000 44.000 - -77.55% -
471.omnetpp (unexplained diff vs previous) (percentage) -10.71% 1.680 1.500 - -99.62% -
465.tonto (max) (percentage) -7.62% 2.100 1.940 - -89.95% -
482.sphinx3 (avg) (percentage) -7.33% 1.910 1.770 - -77.68% -
481.wrf (avg) (percentage) -7.22% 1.940 1.800 - -71.15% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.55% 1946163.000 1976311.000 - 1.41% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 46.28% 1424.000 2083.000 - -87.90% -
410.bwaves 4.56% 5652.000 5910.000 - -58.32% -
444.namd 4.55% 747.000 781.000 - -91.33% -
465.tonto 2.92% 10941.000 11261.000 - 35.53% -
450.soplex 2.65% 567.000 582.000 - -96.33% -
436.cactusADM 1.49% 2083.000 2114.000 - -88.05% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 43.10% 355.000 508.000 - 66.56% -
437.leslie3d (avg) 43.10% 355.000 508.000 - 66.56% -
437.leslie3d (avg) (percentage) 42.30% 3.050 4.340 - 101.86% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.94% 244728.000 232648.000 - -6.17% -
434.zeusmp -3.39% 152037.000 146883.000 - -4.56% -
464.h264ref -2.14% 387748.000 379440.000 - -1.99% -
435.gromacs -1.92% 499261.000 489677.000 - -2.09% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649821.000 - -1.22% -
458.sjeng -1.70% 104048.000 102284.000 - -1.68% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
447.dealII -1.48% 311591.000 306976.000 - -1.90% -
433.milc -1.44% 61382.000 60501.000 - -1.19% -
444.namd -1.39% 188385.000 185768.000 - -1.34% -
456.hmmer -1.38% 108691.000 107195.000 - -1.31% -
450.soplex -1.22% 205081.000 202574.000 - -2.13% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.12% -
482.sphinx3 -1.06% 112859.000 111663.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.35% 6173.000 5349.000 - -77.36% -
482.sphinx3 -12.17% 945.000 830.000 - -97.28% -
400.perlbench -7.82% 1663.000 1533.000 - -85.87% -
434.zeusmp -7.60% 2514.000 2323.000 - -82.77% -
447.dealII -4.06% 1724.000 1654.000 - -81.31% -
462.libquantum -2.86% 140.000 136.000 - -98.83% -
458.sjeng -2.84% 7567.000 7352.000 - -47.73% -
435.gromacs -1.95% 7269.000 7127.000 - -53.71% -
471.omnetpp -1.80% 2724.000 2675.000 - -75.06% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - -98.81% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - -86.15% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - -98.28% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.470 - 47.00% -
453.povray (unexplained diff vs previous) (percentage) -99.98% 1043.330 0.180 - -35.71% -
453.povray (unexplained diff vs previous) -99.98% 5707.000 1.000 - -94.44% -
400.perlbench (unexplained diff vs previous) -99.98% 8772.000 2.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.98% 527.480 0.130 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.690 - 38.00% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 4.000 - -94.94% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 8.000 - -85.96% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.960 - 405.26% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.96% 787.130 0.330 - 266.67% -
436.cactusADM (unexplained diff vs previous) -99.96% 16396.000 7.000 - -56.25% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.510 - 750.00% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - -20.00% -
434.zeusmp (unexplained diff vs previous) -99.95% 11280.000 6.000 - -82.35% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.94% 448.690 0.260 - 4.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.94% 137.900 0.080 - -97.51% -
456.hmmer (unexplained diff vs previous) (percentage) -99.94% 278.630 0.170 - -82.83% -
456.hmmer (unexplained diff vs previous) -99.94% 8030.000 5.000 - -95.45% -
410.bwaves (unexplained diff vs previous) -99.94% 7794.000 5.000 - -98.90% -
459.GemsFDTD (unexplained diff vs previous) -99.94% 15458.000 10.000 - -80.77% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.92% 250.410 0.190 - -13.64% -
429.mcf (unexplained diff vs previous) (percentage) -99.92% 1305.690 1.060 - 3433.33% -
470.lbm (unexplained diff vs previous) (percentage) -99.89% 263.730 0.290 - 81.25% -
470.lbm (unexplained diff vs previous) -99.89% 9990.000 11.000 - -47.62% -
429.mcf (unexplained diff vs previous) -99.88% 18593.000 22.000 - 266.67% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.87% 368.340 0.470 - 51.61% -
401.bzip2 (unexplained diff vs previous) -99.87% 10833.000 14.000 - -69.57% -
473.astar (unexplained diff vs previous) -99.73% 10146.000 27.000 - -34.15% -
473.astar (unexplained diff vs previous) (percentage) -99.73% 197.850 0.530 - 82.76% -
445.gobmk (unexplained diff vs previous) -99.73% 5581.000 15.000 - -34.78% -
445.gobmk (unexplained diff vs previous) (percentage) -99.73% 111.110 0.300 - 50.00% -
458.sjeng (unexplained diff vs previous) -99.69% 6876.000 21.000 - 250.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.68% 90.870 0.290 - 625.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.68% 118.780 0.380 - 11.76% -
464.h264ref (unexplained diff vs previous) -99.68% 6843.000 22.000 - -53.19% -
447.dealII (unexplained diff vs previous) -99.67% 7017.000 23.000 - 27.78% -
447.dealII (unexplained diff vs previous) (percentage) -99.66% 407.020 1.390 - 595.00% -
471.omnetpp (unexplained diff vs previous) -99.62% 10659.000 40.000 - -77.78% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.62% 391.300 1.500 - -10.71% -
456.hmmer (max) -99.20% 2120.000 17.000 - -84.55% -
435.gromacs (unexplained diff vs previous) -99.17% 7028.000 58.000 - 0.00% -
456.hmmer (max) (percentage) -99.17% 73.590 0.610 - -39.00% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - 93.02% -
435.gromacs (unexplained diff vs previous) (percentage) -99.16% 96.680 0.810 - 0.00% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -87.54% -
481.wrf (max) (percentage) -98.81% 68.700 0.820 - -77.16% -
470.lbm (max) -98.73% 2746.000 35.000 - -90.93% -
436.cactusADM (max) -98.70% 1848.000 24.000 - -93.28% -
470.lbm (max) (percentage) -98.69% 72.510 0.950 - -68.54% -
436.cactusADM (max) (percentage) -98.67% 88.730 1.180 - -41.58% -
444.namd (max) (percentage) -98.57% 91.790 1.310 - -76.01% -
444.namd (max) -98.54% 685.000 10.000 - -97.97% -
447.dealII (max) -98.34% 1384.000 23.000 - -69.74% -
447.dealII (max) (percentage) -98.24% 80.280 1.410 - 63.95% -
471.omnetpp (max) -98.20% 2169.000 39.000 - -78.69% -
471.omnetpp (max) (percentage) -98.15% 79.650 1.470 - -14.04% -
434.zeusmp (max) -98.15% 2055.000 38.000 - -80.41% -
464.h264ref (max) -98.08% 3127.000 60.000 - 13.21% -
464.h264ref (max) (percentage) -98.07% 54.290 1.050 - 169.23% -
410.bwaves (max) (percentage) -98.02% 57.970 1.150 - -65.36% -
434.zeusmp (max) (percentage) -97.99% 81.770 1.640 - 13.89% -
410.bwaves (max) -97.95% 3276.000 67.000 - -85.74% -
482.sphinx3 (max) -97.59% 911.000 22.000 - -96.81% -
459.GemsFDTD (max) -97.55% 4411.000 108.000 - -80.78% -
458.sjeng (max) -97.45% 3602.000 92.000 - 46.03% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - -74.38% -
458.sjeng (max) (percentage) -97.35% 47.610 1.260 - 180.00% -
482.sphinx3 (max) (percentage) -97.22% 96.500 2.680 - 18.58% -
459.GemsFDTD (max) (percentage) -97.17% 71.460 2.020 - -15.13% -
401.bzip2 (max) -97.15% 2313.000 66.000 - -66.67% -
401.bzip2 (max) (percentage) -97.13% 78.650 2.260 - 69.92% -
400.perlbench (max) -96.99% 1397.000 42.000 - -90.54% -
445.gobmk (max) -96.97% 2643.000 80.000 - -23.08% -
445.gobmk (max) (percentage) -96.92% 52.630 1.620 - 78.02% -
433.milc (max) -96.74% 1044.000 34.000 - -87.02% -
433.milc (max) (percentage) -96.72% 90.750 2.980 - 47.52% -
400.perlbench (max) (percentage) -96.67% 84.060 2.800 - -31.71% -
453.povray (max) -96.39% 499.000 18.000 - -87.84% -
453.povray (max) (percentage) -96.38% 91.250 3.300 - 43.48% -
462.libquantum (max) -96.38% 138.000 5.000 - -95.73% -
403.gcc (max) (percentage) -96.19% 99.360 3.790 - 511.29% -
462.libquantum (max) (percentage) -95.86% 98.970 4.100 - 305.94% -
450.soplex (max) -95.23% 545.000 26.000 - -85.31% -
450.soplex (max) (percentage) -95.20% 96.240 4.620 - 312.50% -
473.astar (max) -93.51% 3406.000 221.000 - 439.02% -
473.astar (max) (percentage) -93.50% 66.430 4.320 - 1389.66% -
435.gromacs (max) -93.39% 3573.000 236.000 - -33.33% -
435.gromacs (max) (percentage) -93.25% 49.160 3.320 - 44.35% -
465.tonto (unexplained diff vs previous) (percentage) -90.06% 16.190 1.610 - 163.93% -
465.tonto (max) (percentage) -89.95% 19.310 1.940 - -7.62% -
465.tonto (unexplained diff vs previous) -89.78% 1771.000 181.000 - 254.90% -
465.tonto (max) -89.68% 2112.000 218.000 - 25.29% -
456.hmmer -88.19% 127.000 15.000 - -77.61% -
456.hmmer (avg) -88.19% 127.000 15.000 - -77.61% -
456.hmmer (avg) (percentage) -87.98% 4.410 0.530 - -13.11% -
444.namd (avg) (percentage) -86.98% 9.220 1.200 - -68.42% -
429.mcf (max) (percentage) -86.89% 92.890 12.180 - 4975.00% -
444.namd -86.76% 68.000 9.000 - -97.37% -
444.namd (avg) -86.76% 68.000 9.000 - -97.37% -
470.lbm -86.61% 239.000 32.000 - -86.67% -
470.lbm (avg) -86.61% 239.000 32.000 - -86.67% -
470.lbm (avg) (percentage) -86.41% 6.330 0.860 - -54.26% -
464.h264ref -85.32% 293.000 43.000 - -14.00% -
464.h264ref (avg) -85.32% 293.000 43.000 - -14.00% -
464.h264ref (avg) (percentage) -85.27% 5.090 0.750 - 102.70% -
434.zeusmp -85.03% 147.000 22.000 - -87.43% -
434.zeusmp (avg) -85.03% 147.000 22.000 - -87.43% -
434.zeusmp (avg) (percentage) -83.42% 5.850 0.970 - -25.38% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -64.49% -
436.cactusADM (avg) (percentage) -81.77% 5.980 1.090 - -22.14% -
436.cactusADM -81.45% 124.000 23.000 - -90.69% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -90.69% -
458.sjeng -81.33% 241.000 45.000 - 55.17% -
458.sjeng (avg) -81.33% 241.000 45.000 - 55.17% -
482.sphinx3 -81.08% 74.000 14.000 - -97.60% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -97.60% -
453.povray -80.95% 42.000 8.000 - -89.33% -
453.povray (avg) -80.95% 42.000 8.000 - -89.33% -
429.mcf (max) -80.86% 1322.000 253.000 - 517.07% -
447.dealII -80.81% 99.000 19.000 - -62.00% -
447.dealII (avg) -80.81% 99.000 19.000 - -62.00% -
458.sjeng (avg) (percentage) -80.56% 3.190 0.620 - 195.24% -
459.GemsFDTD -80.56% 360.000 70.000 - -75.44% -
459.GemsFDTD (avg) -80.56% 360.000 70.000 - -75.44% -
462.libquantum -80.00% 10.000 2.000 - -96.30% -
462.libquantum (avg) -80.00% 10.000 2.000 - -96.30% -
410.bwaves (avg) (percentage) -79.82% 4.410 0.890 - -46.06% -
433.milc -79.71% 69.000 14.000 - -93.64% -
433.milc (avg) -79.71% 69.000 14.000 - -93.64% -
453.povray (avg) (percentage) -79.64% 7.810 1.590 - 37.07% -
433.milc (avg) (percentage) -79.34% 6.050 1.250 - -26.47% -
447.dealII (avg) (percentage) -79.20% 5.770 1.200 - 110.53% -
410.bwaves -79.12% 249.000 52.000 - -77.68% -
410.bwaves (avg) -79.12% 249.000 52.000 - -77.68% -
482.sphinx3 (avg) (percentage) -77.68% 7.930 1.770 - -7.33% -
445.gobmk -77.55% 196.000 44.000 - -12.00% -
445.gobmk (avg) -77.55% 196.000 44.000 - -12.00% -
459.GemsFDTD (avg) (percentage) -77.40% 5.840 1.320 - 9.09% -
445.gobmk (avg) (percentage) -76.98% 3.910 0.900 - 104.55% -
462.libquantum (avg) (percentage) -75.59% 7.660 1.870 - 297.87% -
471.omnetpp -74.44% 223.000 57.000 - -67.43% -
471.omnetpp (avg) -74.44% 223.000 57.000 - -67.43% -
471.omnetpp (avg) (percentage) -73.66% 8.200 2.160 - 31.71% -
401.bzip2 (avg) (percentage) -73.36% 5.480 1.460 - 186.27% -
401.bzip2 -73.29% 161.000 43.000 - -43.42% -
401.bzip2 (avg) -73.29% 161.000 43.000 - -43.42% -
437.leslie3d (unexplained diff vs previous) (percentage) -72.94% 19.880 5.380 - 1581.25% -
437.leslie3d (unexplained diff vs previous) -72.77% 2314.000 630.000 - 1269.57% -
400.perlbench -71.43% 105.000 30.000 - -82.66% -
400.perlbench (avg) -71.43% 105.000 30.000 - -82.66% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -7.22% -
400.perlbench (avg) (percentage) -68.98% 6.350 1.970 - 23.12% -
435.gromacs -65.94% 367.000 125.000 - -44.93% -
435.gromacs (avg) -65.94% 367.000 125.000 - -44.93% -
437.leslie3d (max) (percentage) -65.68% 16.580 5.690 - 82.37% -
437.leslie3d (max) -65.47% 1929.000 666.000 - 50.34% -
435.gromacs (avg) (percentage) -65.22% 5.060 1.760 - 18.92% -
465.tonto (avg) (percentage) -62.57% 3.340 1.250 - 8.70% -
465.tonto -61.64% 365.000 140.000 - 47.37% -
465.tonto (avg) -61.64% 365.000 140.000 - 47.37% -
450.soplex -61.11% 36.000 14.000 - -90.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -90.67% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 166.32% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - 680.95% -
473.astar -60.56% 213.000 84.000 - 189.66% -
473.astar (avg) -60.56% 213.000 84.000 - 189.66% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 958.82% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 148.74% -
429.mcf (avg) (percentage) -36.77% 7.670 4.850 - 1840.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1442.42% -
429.mcf -7.34% 109.000 101.000 - 134.88% -
429.mcf (avg) -7.34% 109.000 101.000 - 134.88% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Report Time: 0.41s
Execution (seconds)
Name Current %
400.perlbench 1533.000 -85.87%
401.bzip2 2961.000 -80.16%
410.bwaves 5910.000 -58.32%
429.mcf 2083.000 -87.90%
433.milc 1157.000 -91.08%
434.zeusmp 2323.000 -82.77%
435.gromacs 7127.000 -53.71%
436.cactusADM 2114.000 -88.05%
437.leslie3d 11711.000 -17.58%
444.namd 781.000 -91.33%
445.gobmk 4983.000 -56.81%
447.dealII 1654.000 -81.31%
450.soplex 582.000 -96.33%
453.povray 546.000 -91.56%
456.hmmer 2891.000 -73.92%
458.sjeng 7352.000 -47.73%
459.GemsFDTD 5349.000 -77.36%
462.libquantum 136.000 -98.83%
464.h264ref 5788.000 -57.87%
465.tonto 11261.000 35.53%
470.lbm 3768.000 -70.59%
471.omnetpp 2675.000 -75.06%
473.astar 5133.000 -63.86%
482.sphinx3 830.000 -97.28%
Geometric Mean 2457.134 -81.34%
Code Size (bytes)
Name Current %
400.perlbench 892379.000 -
401.bzip2 43719.000 -1.12%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60501.000 -1.19%
434.zeusmp 146883.000 -4.56%
435.gromacs 489677.000 -2.09%
436.cactusADM 352411.000 -
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.34%
445.gobmk 1379170.000 -
447.dealII 306976.000 -1.90%
450.soplex 202574.000 -2.13%
453.povray 649821.000 -1.22%
456.hmmer 107195.000 -1.31%
458.sjeng 102284.000 -1.68%
459.GemsFDTD 232648.000 -6.17%
462.libquantum 15893.000 -
464.h264ref 379440.000 -1.99%
465.tonto 1976311.000 1.41%
470.lbm 9547.000 -1.69%
471.omnetpp 475388.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111663.000 -1.04%
Geometric Mean 136615.745 -1.73%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 30.000 -82.66%
400.perlbench (avg) 30.000 -82.66%
400.perlbench (avg) (percentage) 1.970 23.12%
400.perlbench (max) 42.000 -90.54%
400.perlbench (max) (percentage) 2.800 -31.71%
400.perlbench (unexplained diff vs previous) 2.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.130 -
401.bzip2 43.000 -43.42%
401.bzip2 (avg) 43.000 -43.42%
401.bzip2 (avg) (percentage) 1.460 186.27%
401.bzip2 (max) 66.000 -66.67%
401.bzip2 (max) (percentage) 2.260 69.92%
401.bzip2 (unexplained diff vs previous) 14.000 -69.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.470 51.61%
403.gcc (avg) (percentage) 5.090 1442.42%
403.gcc (max) (percentage) 3.790 511.29%
410.bwaves 52.000 -77.68%
410.bwaves (avg) 52.000 -77.68%
410.bwaves (avg) (percentage) 0.890 -46.06%
410.bwaves (max) 67.000 -85.74%
410.bwaves (max) (percentage) 1.150 -65.36%
410.bwaves (unexplained diff vs previous) 5.000 -98.90%
410.bwaves (unexplained diff vs previous) (percentage) 0.080 -97.51%
416.gamess (avg) (percentage) 0.760 -64.49%
416.gamess (max) (percentage) 0.370 -87.54%
429.mcf 101.000 134.88%
429.mcf (avg) 101.000 134.88%
429.mcf (avg) (percentage) 4.850 1840.00%
429.mcf (max) 253.000 517.07%
429.mcf (max) (percentage) 12.180 4975.00%
429.mcf (unexplained diff vs previous) 22.000 266.67%
429.mcf (unexplained diff vs previous) (percentage) 1.060 3433.33%
433.milc 14.000 -93.64%
433.milc (avg) 14.000 -93.64%
433.milc (avg) (percentage) 1.250 -26.47%
433.milc (max) 34.000 -87.02%
433.milc (max) (percentage) 2.980 47.52%
433.milc (unexplained diff vs previous) 1.000 -98.81%
433.milc (unexplained diff vs previous) (percentage) 0.090 -86.15%
434.zeusmp 22.000 -87.43%
434.zeusmp (avg) 22.000 -87.43%
434.zeusmp (avg) (percentage) 0.970 -25.38%
434.zeusmp (max) 38.000 -80.41%
434.zeusmp (max) (percentage) 1.640 13.89%
434.zeusmp (unexplained diff vs previous) 6.000 -82.35%
434.zeusmp (unexplained diff vs previous) (percentage) 0.260 4.00%
435.gromacs 125.000 -44.93%
435.gromacs (avg) 125.000 -44.93%
435.gromacs (avg) (percentage) 1.760 18.92%
435.gromacs (max) 236.000 -33.33%
435.gromacs (max) (percentage) 3.320 44.35%
435.gromacs (unexplained diff vs previous) 58.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.810 -
436.cactusADM 23.000 -90.69%
436.cactusADM (avg) 23.000 -90.69%
436.cactusADM (avg) (percentage) 1.090 -22.14%
436.cactusADM (max) 24.000 -93.28%
436.cactusADM (max) (percentage) 1.180 -41.58%
436.cactusADM (unexplained diff vs previous) 7.000 -56.25%
436.cactusADM (unexplained diff vs previous) (percentage) 0.330 266.67%
437.leslie3d 508.000 66.56%
437.leslie3d (avg) 508.000 66.56%
437.leslie3d (avg) (percentage) 4.340 101.86%
437.leslie3d (max) 666.000 50.34%
437.leslie3d (max) (percentage) 5.690 82.37%
437.leslie3d (unexplained diff vs previous) 630.000 1269.57%
437.leslie3d (unexplained diff vs previous) (percentage) 5.380 1581.25%
444.namd 9.000 -97.37%
444.namd (avg) 9.000 -97.37%
444.namd (avg) (percentage) 1.200 -68.42%
444.namd (max) 10.000 -97.97%
444.namd (max) (percentage) 1.310 -76.01%
444.namd (unexplained diff vs previous) 4.000 -20.00%
444.namd (unexplained diff vs previous) (percentage) 0.510 750.00%
445.gobmk 44.000 -12.00%
445.gobmk (avg) 44.000 -12.00%
445.gobmk (avg) (percentage) 0.900 104.55%
445.gobmk (max) 80.000 -23.08%
445.gobmk (max) (percentage) 1.620 78.02%
445.gobmk (unexplained diff vs previous) 15.000 -34.78%
445.gobmk (unexplained diff vs previous) (percentage) 0.300 50.00%
447.dealII 19.000 -62.00%
447.dealII (avg) 19.000 -62.00%
447.dealII (avg) (percentage) 1.200 110.53%
447.dealII (max) 23.000 -69.74%
447.dealII (max) (percentage) 1.410 63.95%
447.dealII (unexplained diff vs previous) 23.000 27.78%
447.dealII (unexplained diff vs previous) (percentage) 1.390 595.00%
450.soplex 14.000 -90.67%
450.soplex (avg) 14.000 -90.67%
450.soplex (avg) (percentage) 2.530 166.32%
450.soplex (max) 26.000 -85.31%
450.soplex (max) (percentage) 4.620 312.50%
450.soplex (unexplained diff vs previous) 4.000 -94.94%
450.soplex (unexplained diff vs previous) (percentage) 0.690 38.00%
453.povray 8.000 -89.33%
453.povray (avg) 8.000 -89.33%
453.povray (avg) (percentage) 1.590 37.07%
453.povray (max) 18.000 -87.84%
453.povray (max) (percentage) 3.300 43.48%
453.povray (unexplained diff vs previous) 1.000 -94.44%
453.povray (unexplained diff vs previous) (percentage) 0.180 -35.71%
454.calculix (avg) (percentage) 3.600 958.82%
454.calculix (max) (percentage) 0.830 93.02%
456.hmmer 15.000 -77.61%
456.hmmer (avg) 15.000 -77.61%
456.hmmer (avg) (percentage) 0.530 -13.11%
456.hmmer (max) 17.000 -84.55%
456.hmmer (max) (percentage) 0.610 -39.00%
456.hmmer (unexplained diff vs previous) 5.000 -95.45%
456.hmmer (unexplained diff vs previous) (percentage) 0.170 -82.83%
458.sjeng 45.000 55.17%
458.sjeng (avg) 45.000 55.17%
458.sjeng (avg) (percentage) 0.620 195.24%
458.sjeng (max) 92.000 46.03%
458.sjeng (max) (percentage) 1.260 180.00%
458.sjeng (unexplained diff vs previous) 21.000 250.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.290 625.00%
459.GemsFDTD 70.000 -75.44%
459.GemsFDTD (avg) 70.000 -75.44%
459.GemsFDTD (avg) (percentage) 1.320 9.09%
459.GemsFDTD (max) 108.000 -80.78%
459.GemsFDTD (max) (percentage) 2.020 -15.13%
459.GemsFDTD (unexplained diff vs previous) 10.000 -80.77%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.190 -13.64%
462.libquantum 2.000 -96.30%
462.libquantum (avg) 2.000 -96.30%
462.libquantum (avg) (percentage) 1.870 297.87%
462.libquantum (max) 5.000 -95.73%
462.libquantum (max) (percentage) 4.100 305.94%
462.libquantum (unexplained diff vs previous) 2.000 -98.28%
462.libquantum (unexplained diff vs previous) (percentage) 1.470 47.00%
464.h264ref 43.000 -14.00%
464.h264ref (avg) 43.000 -14.00%
464.h264ref (avg) (percentage) 0.750 102.70%
464.h264ref (max) 60.000 13.21%
464.h264ref (max) (percentage) 1.050 169.23%
464.h264ref (unexplained diff vs previous) 22.000 -53.19%
464.h264ref (unexplained diff vs previous) (percentage) 0.380 11.76%
465.tonto 140.000 47.37%
465.tonto (avg) 140.000 47.37%
465.tonto (avg) (percentage) 1.250 8.70%
465.tonto (max) 218.000 25.29%
465.tonto (max) (percentage) 1.940 -7.62%
465.tonto (unexplained diff vs previous) 181.000 254.90%
465.tonto (unexplained diff vs previous) (percentage) 1.610 163.93%
470.lbm 32.000 -86.67%
470.lbm (avg) 32.000 -86.67%
470.lbm (avg) (percentage) 0.860 -54.26%
470.lbm (max) 35.000 -90.93%
470.lbm (max) (percentage) 0.950 -68.54%
470.lbm (unexplained diff vs previous) 11.000 -47.62%
470.lbm (unexplained diff vs previous) (percentage) 0.290 81.25%
471.omnetpp 57.000 -67.43%
471.omnetpp (avg) 57.000 -67.43%
471.omnetpp (avg) (percentage) 2.160 31.71%
471.omnetpp (max) 39.000 -78.69%
471.omnetpp (max) (percentage) 1.470 -14.04%
471.omnetpp (unexplained diff vs previous) 40.000 -77.78%
471.omnetpp (unexplained diff vs previous) (percentage) 1.500 -10.71%
473.astar 84.000 189.66%
473.astar (avg) 84.000 189.66%
473.astar (avg) (percentage) 1.640 680.95%
473.astar (max) 221.000 439.02%
473.astar (max) (percentage) 4.320 1389.66%
473.astar (unexplained diff vs previous) 27.000 -34.15%
473.astar (unexplained diff vs previous) (percentage) 0.530 82.76%
481.wrf (avg) (percentage) 1.800 -7.22%
481.wrf (max) (percentage) 0.820 -77.16%
482.sphinx3 14.000 -97.60%
482.sphinx3 (avg) 14.000 -97.60%
482.sphinx3 (avg) (percentage) 1.770 -7.33%
482.sphinx3 (max) 22.000 -96.81%
482.sphinx3 (max) (percentage) 2.680 18.58%
482.sphinx3 (unexplained diff vs previous) 8.000 -85.96%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.960 405.26%
483.xalancbmk (avg) (percentage) 2.960 148.74%
483.xalancbmk (max) (percentage) 1.770 -74.38%
Geometric Mean 6.517 -40.86%