Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d396fcc9d17af551e8bc8543a7676694527893e4 (+ 16 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/b137e4bbcc488b44a037baad62a8da90659d7468 (+ 49 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e67f8e6dbd5ec98578a775b2e09b254f071e0f57 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/3b232d34011a152832ba40289e9d476dfcb846d2 (+ 637 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/302/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0302 (3-changed-components) 2024-10-02T19:21:16 0:00:00
Previous 0302 (-00000-) 2022-09-15T20:10:03 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 56 15
Performance Improvements 168 201
Unchanged Tests 1012 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 2.26% 104028.000 106376.000 - 2.24% -
465.tonto 1.39% 1945443.000 1972539.000 - 1.36% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 25.91% 8863.000 11159.000 - 1.99% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) (percentage) 2065.00% 0.200 4.330 - -93.48% -
464.h264ref (unexplained diff vs previous) (percentage) 1500.00% 0.010 0.160 - -99.87% -
403.gcc (avg) (percentage) 1442.42% 0.330 5.090 - -30.46% -
483.xalancbmk (avg) (percentage) 1309.52% 0.210 2.960 - -54.46% -
429.mcf (unexplained diff vs previous) (percentage) 1238.89% 0.180 2.410 - -99.82% -
403.gcc (max) (percentage) 1093.75% 0.320 3.820 - -96.16% -
429.mcf (max) (percentage) 1076.19% 0.210 2.470 - -97.34% -
464.h264ref (unexplained diff vs previous) 800.00% 1.000 9.000 - -99.87% -
429.mcf (avg) (percentage) 794.55% 0.550 4.920 - -35.85% -
454.calculix (avg) (percentage) 718.18% 0.440 3.600 - -55.11% -
473.astar (max) 689.29% 28.000 221.000 - -93.51% -
462.libquantum (max) (percentage) 470.91% 0.550 3.140 - -96.83% -
483.xalancbmk (max) (percentage) 420.59% 0.340 1.770 - -97.42% -
473.astar (avg) (percentage) 406.25% 0.320 1.620 - -61.06% -
401.bzip2 (unexplained diff vs previous) (percentage) 388.89% 0.090 0.440 - -99.88% -
401.bzip2 (max) (percentage) 288.89% 0.360 1.400 - -98.22% -
401.bzip2 (avg) (percentage) 257.14% 0.420 1.500 - -72.63% -
471.omnetpp (unexplained diff vs previous) (percentage) 245.83% 0.960 3.320 - -99.15% -
471.omnetpp (max) (percentage) 220.56% 1.070 3.430 - -95.69% -
458.sjeng (avg) (percentage) 210.00% 0.200 0.620 - -80.56% -
437.leslie3d (max) (percentage) 197.57% 4.110 12.230 - -26.24% -
462.libquantum (avg) (percentage) 160.00% 0.700 1.820 - -76.24% -
437.leslie3d (max) 139.76% 581.000 1393.000 - -27.79% -
450.soplex (avg) (percentage) 115.38% 1.170 2.520 - -60.81% -
410.bwaves (unexplained diff vs previous) (percentage) 113.79% 0.290 0.620 - -99.55% -
462.libquantum (unexplained diff vs previous) (percentage) 111.76% 0.340 0.720 - -99.99% -
464.h264ref (avg) (percentage) 82.93% 0.410 0.750 - -85.27% -
473.astar 82.22% 45.000 82.000 - -61.50% -
473.astar (avg) 82.22% 45.000 82.000 - -61.50% -
437.leslie3d (avg) (percentage) 74.42% 2.580 4.500 - 47.54% -
471.omnetpp (avg) (percentage) 72.44% 1.270 2.190 - -73.29% -
429.mcf (unexplained diff vs previous) 64.52% 31.000 51.000 - -99.73% -
458.sjeng 60.71% 28.000 45.000 - -81.33% -
458.sjeng (avg) 60.71% 28.000 45.000 - -81.33% -
465.tonto 58.82% 85.000 135.000 - -63.01% -
465.tonto (avg) 58.82% 85.000 135.000 - -63.01% -
454.calculix (max) (percentage) 48.21% 0.560 0.830 - -99.17% -
429.mcf (max) 44.44% 36.000 52.000 - -96.07% -
400.perlbench (avg) (percentage) 43.26% 1.410 2.020 - -68.19% -
437.leslie3d 40.27% 365.000 512.000 - 44.23% -
437.leslie3d (avg) 40.27% 365.000 512.000 - 44.23% -
447.dealII (avg) (percentage) 37.50% 0.880 1.210 - -79.03% -
465.tonto (avg) (percentage) 26.04% 0.960 1.210 - -63.77% -
410.bwaves (max) (percentage) 18.64% 0.590 0.700 - -98.79% -
400.perlbench (max) (percentage) 14.29% 2.030 2.320 - -97.24% -
429.mcf 10.64% 94.000 104.000 - -4.59% -
429.mcf (avg) 10.64% 94.000 104.000 - -4.59% -
453.povray (unexplained diff vs previous) (percentage) 9.05% 2.210 2.410 - -99.77% -
445.gobmk (avg) (percentage) 8.54% 0.820 0.890 - -77.24% -
453.povray (max) (percentage) 4.42% 2.260 2.360 - -97.41% -
459.GemsFDTD (avg) (percentage) 3.08% 1.300 1.340 - -77.05% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -6.13% 247940.000 232732.000 - -4.90% -
434.zeusmp -4.70% 153897.000 146667.000 - -3.53% -
450.soplex -4.03% 211092.000 202582.000 - -1.22% -
435.gromacs -2.09% 500203.000 489749.000 - -1.91% -
464.h264ref -1.98% 387228.000 379544.000 - -2.12% -
453.povray -1.83% 661959.000 649829.000 - -1.75% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
447.dealII -1.61% 312944.000 307892.000 - -1.19% -
471.omnetpp -1.47% 482480.000 475384.000 - -0.55% -
444.namd -1.35% 188301.000 185768.000 - -1.39% -
436.cactusADM -1.28% 352831.000 348331.000 - -1.29% -
456.hmmer -1.27% 108631.000 107255.000 - -1.32% -
433.milc -1.18% 61230.000 60509.000 - -1.42% -
401.bzip2 -1.14% 44221.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111659.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.80% 11570.000 139.000 - -0.71% -
482.sphinx3 -97.19% 29984.000 843.000 - -10.79% -
450.soplex -96.37% 15818.000 574.000 - 1.23% -
453.povray -91.77% 6551.000 539.000 - -1.46% -
444.namd -91.41% 9014.000 774.000 - 3.61% -
433.milc -91.06% 12902.000 1154.000 - 0.26% -
436.cactusADM -88.01% 17695.000 2122.000 - 1.87% -
429.mcf -87.73% 17272.000 2119.000 - 48.81% -
400.perlbench -85.91% 10904.000 1536.000 - -7.64% -
447.dealII -81.38% 8862.000 1650.000 - -4.29% -
434.zeusmp -81.31% 13498.000 2523.000 - 0.36% -
401.bzip2 -80.08% 14923.000 2973.000 - 1.09% -
459.GemsFDTD -77.22% 23620.000 5380.000 - -12.85% -
471.omnetpp -74.10% 10708.000 2773.000 - 1.80% -
456.hmmer -74.10% 11091.000 2873.000 - -0.31% -
470.lbm -70.32% 12805.000 3801.000 - 0.34% -
473.astar -63.96% 14191.000 5115.000 - -0.25% -
410.bwaves -58.30% 14286.000 5957.000 - 5.40% -
464.h264ref -58.08% 13766.000 5771.000 - 0.17% -
445.gobmk -56.73% 11555.000 5000.000 - -0.46% -
435.gromacs -53.27% 15227.000 7116.000 - -2.10% -
458.sjeng -47.63% 14043.000 7355.000 - -2.80% -
437.leslie3d -19.50% 14152.000 11393.000 - -2.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -99.56% 680.000 3.000 - -99.96% -
444.namd (max) -99.52% 631.000 3.000 - -99.56% -
482.sphinx3 (max) -99.36% 1097.000 7.000 - -99.23% -
450.soplex (max) -98.74% 637.000 8.000 - -98.53% -
434.zeusmp (unexplained diff vs previous) -98.63% 291.000 4.000 - -99.96% -
400.perlbench (unexplained diff vs previous) -98.23% 226.000 4.000 - -99.95% -
482.sphinx3 (unexplained diff vs previous) -98.19% 386.000 7.000 - -99.97% -
444.namd -98.10% 473.000 9.000 - -86.76% -
444.namd (avg) -98.10% 473.000 9.000 - -86.76% -
434.zeusmp (max) -97.89% 284.000 6.000 - -99.71% -
482.sphinx3 -97.84% 695.000 15.000 - -79.73% -
482.sphinx3 (avg) -97.84% 695.000 15.000 - -79.73% -
462.libquantum -97.50% 80.000 2.000 - -80.00% -
462.libquantum (avg) -97.50% 80.000 2.000 - -80.00% -
462.libquantum (unexplained diff vs previous) -97.44% 39.000 1.000 - -99.99% -
433.milc (unexplained diff vs previous) -97.05% 474.000 14.000 - -99.88% -
433.milc (max) -96.93% 456.000 14.000 - -98.66% -
470.lbm (unexplained diff vs previous) -96.68% 482.000 16.000 - -99.84% -
473.astar (unexplained diff vs previous) -96.55% 29.000 1.000 - -99.99% -
450.soplex (unexplained diff vs previous) -96.46% 254.000 9.000 - -99.94% -
436.cactusADM (unexplained diff vs previous) -96.36% 522.000 19.000 - -99.88% -
436.cactusADM (max) -96.25% 507.000 19.000 - -98.97% -
470.lbm (max) -96.00% 500.000 20.000 - -99.27% -
433.milc -95.21% 292.000 14.000 - -79.71% -
433.milc (avg) -95.21% 292.000 14.000 - -79.71% -
456.hmmer (max) -95.09% 163.000 8.000 - -99.62% -
444.namd (unexplained diff vs previous) (percentage) -94.83% 7.540 0.390 - -99.97% -
456.hmmer (unexplained diff vs previous) -94.55% 165.000 9.000 - -99.89% -
462.libquantum (max) -93.65% 63.000 4.000 - -97.10% -
436.cactusADM -93.65% 362.000 23.000 - -81.45% -
436.cactusADM (avg) -93.65% 362.000 23.000 - -81.45% -
444.namd (max) (percentage) -93.44% 7.010 0.460 - -99.50% -
453.povray -93.39% 121.000 8.000 - -80.95% -
453.povray (avg) -93.39% 121.000 8.000 - -80.95% -
434.zeusmp (unexplained diff vs previous) (percentage) -92.59% 2.160 0.160 - -99.96% -
450.soplex -92.43% 185.000 14.000 - -61.11% -
450.soplex (avg) -92.43% 185.000 14.000 - -61.11% -
453.povray (max) -91.89% 148.000 12.000 - -97.60% -
447.dealII (max) -91.84% 245.000 20.000 - -98.55% -
453.povray (unexplained diff vs previous) -91.03% 145.000 13.000 - -99.77% -
470.lbm -90.91% 363.000 33.000 - -86.19% -
470.lbm (avg) -90.91% 363.000 33.000 - -86.19% -
473.astar (unexplained diff vs previous) (percentage) -90.00% 0.200 0.020 - -99.99% -
434.zeusmp -89.66% 232.000 24.000 - -83.67% -
434.zeusmp (avg) -89.66% 232.000 24.000 - -83.67% -
470.lbm (unexplained diff vs previous) (percentage) -88.83% 3.760 0.420 - -99.84% -
459.GemsFDTD (max) -88.71% 363.000 41.000 - -99.07% -
459.GemsFDTD (unexplained diff vs previous) -88.55% 358.000 41.000 - -99.73% -
416.gamess (max) (percentage) -88.51% 3.220 0.370 - -99.04% -
434.zeusmp (max) (percentage) -88.15% 2.110 0.250 - -99.69% -
400.perlbench (unexplained diff vs previous) (percentage) -87.44% 2.070 0.260 - -99.95% -
470.lbm (max) (percentage) -85.93% 3.910 0.550 - -99.24% -
400.perlbench (max) -84.16% 221.000 35.000 - -97.49% -
447.dealII (unexplained diff vs previous) -83.95% 81.000 13.000 - -99.81% -
456.hmmer -82.95% 88.000 15.000 - -88.19% -
456.hmmer (avg) -82.95% 88.000 15.000 - -88.19% -
464.h264ref (max) -81.25% 48.000 9.000 - -99.71% -
445.gobmk (unexplained diff vs previous) -80.85% 141.000 27.000 - -99.52% -
445.gobmk (max) -80.58% 139.000 27.000 - -98.98% -
400.perlbench -79.74% 153.000 31.000 - -70.48% -
400.perlbench (avg) -79.74% 153.000 31.000 - -70.48% -
456.hmmer (unexplained diff vs previous) (percentage) -79.19% 1.490 0.310 - -99.89% -
456.hmmer (max) (percentage) -78.91% 1.470 0.310 - -99.58% -
458.sjeng (max) -78.12% 32.000 7.000 - -99.81% -
482.sphinx3 (max) (percentage) -77.05% 3.660 0.840 - -99.13% -
458.sjeng (unexplained diff vs previous) -76.92% 26.000 6.000 - -99.91% -
444.namd (avg) (percentage) -76.57% 5.250 1.230 - -86.66% -
459.GemsFDTD -76.55% 307.000 72.000 - -80.00% -
459.GemsFDTD (avg) -76.55% 307.000 72.000 - -80.00% -
481.wrf (max) (percentage) -75.80% 3.430 0.830 - -98.79% -
447.dealII -75.32% 77.000 19.000 - -80.81% -
447.dealII (avg) -75.32% 77.000 19.000 - -80.81% -
465.tonto (unexplained diff vs previous) (percentage) -73.78% 1.640 0.430 - -97.34% -
435.gromacs (unexplained diff vs previous) -71.90% 420.000 118.000 - -98.32% -
435.gromacs (max) -71.81% 408.000 115.000 - -96.78% -
465.tonto (max) (percentage) -70.24% 1.680 0.500 - -97.41% -
436.cactusADM (unexplained diff vs previous) (percentage) -69.49% 2.950 0.900 - -99.89% -
470.lbm (avg) (percentage) -68.66% 2.840 0.890 - -85.94% -
436.cactusADM (max) (percentage) -68.64% 2.870 0.900 - -98.99% -
433.milc (unexplained diff vs previous) (percentage) -67.03% 3.670 1.210 - -99.88% -
465.tonto (unexplained diff vs previous) -66.90% 145.000 48.000 - -97.29% -
433.milc (max) (percentage) -65.25% 3.540 1.230 - -98.64% -
437.leslie3d (unexplained diff vs previous) -63.55% 524.000 191.000 - -91.75% -
465.tonto (max) -62.84% 148.000 55.000 - -97.40% -
416.gamess (avg) (percentage) -61.81% 1.990 0.760 - -82.81% -
450.soplex (max) (percentage) -61.79% 4.030 1.540 - -98.40% -
410.bwaves -59.70% 134.000 54.000 - -78.31% -
410.bwaves (avg) -59.70% 134.000 54.000 - -78.31% -
458.sjeng (unexplained diff vs previous) (percentage) -57.89% 0.190 0.080 - -99.91% -
458.sjeng (max) (percentage) -56.52% 0.230 0.100 - -99.79% -
447.dealII (max) (percentage) -55.96% 2.770 1.220 - -98.48% -
445.gobmk (unexplained diff vs previous) (percentage) -55.74% 1.220 0.540 - -99.51% -
471.omnetpp -55.56% 135.000 60.000 - -73.09% -
471.omnetpp (avg) -55.56% 135.000 60.000 - -73.09% -
445.gobmk (max) (percentage) -55.37% 1.210 0.540 - -98.97% -
435.gromacs -55.36% 280.000 125.000 - -65.94% -
435.gromacs (avg) -55.36% 280.000 125.000 - -65.94% -
437.leslie3d (unexplained diff vs previous) (percentage) -54.59% 3.700 1.680 - -91.55% -
464.h264ref (max) (percentage) -54.29% 0.350 0.160 - -99.71% -
445.gobmk -53.19% 94.000 44.000 - -77.55% -
445.gobmk (avg) -53.19% 94.000 44.000 - -77.55% -
410.bwaves (max) -51.19% 84.000 41.000 - -98.75% -
459.GemsFDTD (max) (percentage) -50.00% 1.540 0.770 - -98.92% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -50.00% 1.520 0.760 - -99.70% -
433.milc (avg) (percentage) -45.37% 2.270 1.240 - -79.50% -
436.cactusADM (avg) (percentage) -44.88% 2.050 1.130 - -81.10% -
434.zeusmp (avg) (percentage) -43.60% 1.720 0.970 - -83.42% -
435.gromacs (unexplained diff vs previous) (percentage) -39.86% 2.760 1.660 - -98.28% -
435.gromacs (max) (percentage) -39.18% 2.680 1.630 - -96.68% -
482.sphinx3 (unexplained diff vs previous) (percentage) -35.66% 1.290 0.830 - -99.97% -
456.hmmer (avg) (percentage) -32.50% 0.800 0.540 - -87.76% -
401.bzip2 -29.03% 62.000 44.000 - -72.67% -
401.bzip2 (avg) -29.03% 62.000 44.000 - -72.67% -
481.wrf (avg) (percentage) -24.69% 2.390 1.800 - -71.15% -
464.h264ref -23.21% 56.000 43.000 - -85.32% -
464.h264ref (avg) -23.21% 56.000 43.000 - -85.32% -
401.bzip2 (max) -22.64% 53.000 41.000 - -98.23% -
482.sphinx3 (avg) (percentage) -22.41% 2.320 1.800 - -77.30% -
471.omnetpp (max) -16.67% 114.000 95.000 - -95.62% -
453.povray (avg) (percentage) -16.22% 1.850 1.550 - -80.15% -
447.dealII (unexplained diff vs previous) (percentage) -13.19% 0.910 0.790 - -99.81% -
471.omnetpp (unexplained diff vs previous) -10.68% 103.000 92.000 - -99.14% -
410.bwaves (unexplained diff vs previous) -9.76% 41.000 37.000 - -99.53% -
401.bzip2 (unexplained diff vs previous) -7.14% 14.000 13.000 - -99.88% -
435.gromacs (avg) (percentage) -4.35% 1.840 1.760 - -65.22% -
450.soplex (unexplained diff vs previous) (percentage) -2.48% 1.610 1.570 - -99.94% -
410.bwaves (avg) (percentage) -2.13% 0.940 0.920 - -79.14% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 2.26% -
465.tonto 1.36% 1946163.000 1972539.000 - 1.39% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 48.81% 1424.000 2119.000 - -87.73% -
410.bwaves 5.40% 5652.000 5957.000 - -58.30% -
444.namd 3.61% 747.000 774.000 - -91.41% -
465.tonto 1.99% 10941.000 11159.000 - 25.91% -
436.cactusADM 1.87% 2083.000 2122.000 - -88.01% -
471.omnetpp 1.80% 2724.000 2773.000 - -74.10% -
450.soplex 1.23% 567.000 574.000 - -96.37% -
401.bzip2 1.09% 2941.000 2973.000 - -80.08% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 47.54% 3.050 4.500 - 74.42% -
437.leslie3d 44.23% 355.000 512.000 - 40.27% -
437.leslie3d (avg) 44.23% 355.000 512.000 - 40.27% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.90% 244728.000 232732.000 - -6.13% -
434.zeusmp -3.53% 152037.000 146667.000 - -4.70% -
464.h264ref -2.12% 387748.000 379544.000 - -1.98% -
435.gromacs -1.91% 499261.000 489749.000 - -2.09% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649829.000 - -1.83% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
433.milc -1.42% 61382.000 60509.000 - -1.18% -
444.namd -1.39% 188385.000 185768.000 - -1.35% -
456.hmmer -1.32% 108691.000 107255.000 - -1.27% -
436.cactusADM -1.29% 352891.000 348331.000 - -1.28% -
450.soplex -1.22% 205081.000 202582.000 - -4.03% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
447.dealII -1.19% 311591.000 307892.000 - -1.61% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.14% -
482.sphinx3 -1.06% 112859.000 111659.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.85% 6173.000 5380.000 - -77.22% -
482.sphinx3 -10.79% 945.000 843.000 - -97.19% -
400.perlbench -7.64% 1663.000 1536.000 - -85.91% -
447.dealII -4.29% 1724.000 1650.000 - -81.38% -
458.sjeng -2.80% 7567.000 7355.000 - -47.63% -
437.leslie3d -2.12% 11640.000 11393.000 - -19.50% -
435.gromacs -2.10% 7269.000 7116.000 - -53.27% -
453.povray -1.46% 547.000 539.000 - -91.77% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -97.44% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - 111.76% -
473.astar (unexplained diff vs previous) -99.99% 10146.000 1.000 - -96.55% -
473.astar (unexplained diff vs previous) (percentage) -99.99% 197.850 0.020 - -90.00% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 7.000 - -98.19% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.830 - -35.66% -
444.namd (unexplained diff vs previous) (percentage) -99.97% 1118.610 0.390 - -94.83% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 - -98.63% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.160 - -92.59% -
444.namd (unexplained diff vs previous) -99.96% 8356.000 3.000 - -99.56% -
400.perlbench (unexplained diff vs previous) -99.95% 8772.000 4.000 - -98.23% -
400.perlbench (unexplained diff vs previous) (percentage) -99.95% 527.480 0.260 - -87.44% -
450.soplex (unexplained diff vs previous) (percentage) -99.94% 2557.320 1.570 - -2.48% -
450.soplex (unexplained diff vs previous) -99.94% 14500.000 9.000 - -96.46% -
458.sjeng (unexplained diff vs previous) -99.91% 6876.000 6.000 - -76.92% -
458.sjeng (unexplained diff vs previous) (percentage) -99.91% 90.870 0.080 - -57.89% -
456.hmmer (unexplained diff vs previous) (percentage) -99.89% 278.630 0.310 - -79.19% -
456.hmmer (unexplained diff vs previous) -99.89% 8030.000 9.000 - -94.55% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.89% 787.130 0.900 - -69.49% -
436.cactusADM (unexplained diff vs previous) -99.88% 16396.000 19.000 - -96.36% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.88% 368.340 0.440 - 388.89% -
401.bzip2 (unexplained diff vs previous) -99.88% 10833.000 13.000 - -7.14% -
433.milc (unexplained diff vs previous) (percentage) -99.88% 980.800 1.210 - -67.03% -
433.milc (unexplained diff vs previous) -99.88% 11289.000 14.000 - -97.05% -
464.h264ref (unexplained diff vs previous) -99.87% 6843.000 9.000 - 800.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.87% 118.780 0.160 - 1500.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.84% 263.730 0.420 - -88.83% -
470.lbm (unexplained diff vs previous) -99.84% 9990.000 16.000 - -96.68% -
429.mcf (unexplained diff vs previous) (percentage) -99.82% 1305.690 2.410 - 1238.89% -
447.dealII (unexplained diff vs previous) -99.81% 7017.000 13.000 - -83.95% -
447.dealII (unexplained diff vs previous) (percentage) -99.81% 407.020 0.790 - -13.19% -
458.sjeng (max) -99.81% 3602.000 7.000 - -78.12% -
458.sjeng (max) (percentage) -99.79% 47.610 0.100 - -56.52% -
453.povray (unexplained diff vs previous) -99.77% 5707.000 13.000 - -91.03% -
453.povray (unexplained diff vs previous) (percentage) -99.77% 1043.330 2.410 - 9.05% -
459.GemsFDTD (unexplained diff vs previous) -99.73% 15458.000 41.000 - -88.55% -
429.mcf (unexplained diff vs previous) -99.73% 18593.000 51.000 - 64.52% -
464.h264ref (max) -99.71% 3127.000 9.000 - -81.25% -
434.zeusmp (max) -99.71% 2055.000 6.000 - -97.89% -
464.h264ref (max) (percentage) -99.71% 54.290 0.160 - -54.29% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.70% 250.410 0.760 - -50.00% -
434.zeusmp (max) (percentage) -99.69% 81.770 0.250 - -88.15% -
456.hmmer (max) -99.62% 2120.000 8.000 - -95.09% -
456.hmmer (max) (percentage) -99.58% 73.590 0.310 - -78.91% -
444.namd (max) -99.56% 685.000 3.000 - -99.52% -
410.bwaves (unexplained diff vs previous) (percentage) -99.55% 137.900 0.620 - 113.79% -
410.bwaves (unexplained diff vs previous) -99.53% 7794.000 37.000 - -9.76% -
445.gobmk (unexplained diff vs previous) -99.52% 5581.000 27.000 - -80.85% -
445.gobmk (unexplained diff vs previous) (percentage) -99.51% 111.110 0.540 - -55.74% -
444.namd (max) (percentage) -99.50% 91.790 0.460 - -93.44% -
470.lbm (max) -99.27% 2746.000 20.000 - -96.00% -
470.lbm (max) (percentage) -99.24% 72.510 0.550 - -85.93% -
482.sphinx3 (max) -99.23% 911.000 7.000 - -99.36% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - 48.21% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.15% 391.300 3.320 - 245.83% -
471.omnetpp (unexplained diff vs previous) -99.14% 10659.000 92.000 - -10.68% -
482.sphinx3 (max) (percentage) -99.13% 96.500 0.840 - -77.05% -
459.GemsFDTD (max) -99.07% 4411.000 41.000 - -88.71% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -88.51% -
436.cactusADM (max) (percentage) -98.99% 88.730 0.900 - -68.64% -
445.gobmk (max) -98.98% 2643.000 27.000 - -80.58% -
445.gobmk (max) (percentage) -98.97% 52.630 0.540 - -55.37% -
436.cactusADM (max) -98.97% 1848.000 19.000 - -96.25% -
459.GemsFDTD (max) (percentage) -98.92% 71.460 0.770 - -50.00% -
410.bwaves (max) (percentage) -98.79% 57.970 0.700 - 18.64% -
481.wrf (max) (percentage) -98.79% 68.700 0.830 - -75.80% -
410.bwaves (max) -98.75% 3276.000 41.000 - -51.19% -
433.milc (max) -98.66% 1044.000 14.000 - -96.93% -
433.milc (max) (percentage) -98.64% 90.750 1.230 - -65.25% -
447.dealII (max) -98.55% 1384.000 20.000 - -91.84% -
450.soplex (max) -98.53% 545.000 8.000 - -98.74% -
447.dealII (max) (percentage) -98.48% 80.280 1.220 - -55.96% -
450.soplex (max) (percentage) -98.40% 96.240 1.540 - -61.79% -
435.gromacs (unexplained diff vs previous) -98.32% 7028.000 118.000 - -71.90% -
435.gromacs (unexplained diff vs previous) (percentage) -98.28% 96.680 1.660 - -39.86% -
401.bzip2 (max) -98.23% 2313.000 41.000 - -22.64% -
401.bzip2 (max) (percentage) -98.22% 78.650 1.400 - 288.89% -
453.povray (max) -97.60% 499.000 12.000 - -91.89% -
400.perlbench (max) -97.49% 1397.000 35.000 - -84.16% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 420.59% -
453.povray (max) (percentage) -97.41% 91.250 2.360 - 4.42% -
465.tonto (max) (percentage) -97.41% 19.310 0.500 - -70.24% -
465.tonto (max) -97.40% 2112.000 55.000 - -62.84% -
465.tonto (unexplained diff vs previous) (percentage) -97.34% 16.190 0.430 - -73.78% -
429.mcf (max) (percentage) -97.34% 92.890 2.470 - 1076.19% -
465.tonto (unexplained diff vs previous) -97.29% 1771.000 48.000 - -66.90% -
400.perlbench (max) (percentage) -97.24% 84.060 2.320 - 14.29% -
462.libquantum (max) -97.10% 138.000 4.000 - -93.65% -
462.libquantum (max) (percentage) -96.83% 98.970 3.140 - 470.91% -
435.gromacs (max) -96.78% 3573.000 115.000 - -71.81% -
435.gromacs (max) (percentage) -96.68% 49.160 1.630 - -39.18% -
403.gcc (max) (percentage) -96.16% 99.360 3.820 - 1093.75% -
429.mcf (max) -96.07% 1322.000 52.000 - 44.44% -
471.omnetpp (max) (percentage) -95.69% 79.650 3.430 - 220.56% -
471.omnetpp (max) -95.62% 2169.000 95.000 - -16.67% -
473.astar (max) -93.51% 3406.000 221.000 - 689.29% -
473.astar (max) (percentage) -93.48% 66.430 4.330 - 2065.00% -
437.leslie3d (unexplained diff vs previous) -91.75% 2314.000 191.000 - -63.55% -
437.leslie3d (unexplained diff vs previous) (percentage) -91.55% 19.880 1.680 - -54.59% -
456.hmmer -88.19% 127.000 15.000 - -82.95% -
456.hmmer (avg) -88.19% 127.000 15.000 - -82.95% -
456.hmmer (avg) (percentage) -87.76% 4.410 0.540 - -32.50% -
444.namd -86.76% 68.000 9.000 - -98.10% -
444.namd (avg) -86.76% 68.000 9.000 - -98.10% -
444.namd (avg) (percentage) -86.66% 9.220 1.230 - -76.57% -
470.lbm -86.19% 239.000 33.000 - -90.91% -
470.lbm (avg) -86.19% 239.000 33.000 - -90.91% -
470.lbm (avg) (percentage) -85.94% 6.330 0.890 - -68.66% -
464.h264ref -85.32% 293.000 43.000 - -23.21% -
464.h264ref (avg) -85.32% 293.000 43.000 - -23.21% -
464.h264ref (avg) (percentage) -85.27% 5.090 0.750 - 82.93% -
434.zeusmp -83.67% 147.000 24.000 - -89.66% -
434.zeusmp (avg) -83.67% 147.000 24.000 - -89.66% -
434.zeusmp (avg) (percentage) -83.42% 5.850 0.970 - -43.60% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -61.81% -
436.cactusADM -81.45% 124.000 23.000 - -93.65% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -93.65% -
458.sjeng -81.33% 241.000 45.000 - 60.71% -
458.sjeng (avg) -81.33% 241.000 45.000 - 60.71% -
436.cactusADM (avg) (percentage) -81.10% 5.980 1.130 - -44.88% -
453.povray -80.95% 42.000 8.000 - -93.39% -
453.povray (avg) -80.95% 42.000 8.000 - -93.39% -
447.dealII -80.81% 99.000 19.000 - -75.32% -
447.dealII (avg) -80.81% 99.000 19.000 - -75.32% -
458.sjeng (avg) (percentage) -80.56% 3.190 0.620 - 210.00% -
453.povray (avg) (percentage) -80.15% 7.810 1.550 - -16.22% -
459.GemsFDTD -80.00% 360.000 72.000 - -76.55% -
459.GemsFDTD (avg) -80.00% 360.000 72.000 - -76.55% -
462.libquantum -80.00% 10.000 2.000 - -97.50% -
462.libquantum (avg) -80.00% 10.000 2.000 - -97.50% -
482.sphinx3 -79.73% 74.000 15.000 - -97.84% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - -97.84% -
433.milc -79.71% 69.000 14.000 - -95.21% -
433.milc (avg) -79.71% 69.000 14.000 - -95.21% -
433.milc (avg) (percentage) -79.50% 6.050 1.240 - -45.37% -
410.bwaves (avg) (percentage) -79.14% 4.410 0.920 - -2.13% -
447.dealII (avg) (percentage) -79.03% 5.770 1.210 - 37.50% -
410.bwaves -78.31% 249.000 54.000 - -59.70% -
410.bwaves (avg) -78.31% 249.000 54.000 - -59.70% -
445.gobmk -77.55% 196.000 44.000 - -53.19% -
445.gobmk (avg) -77.55% 196.000 44.000 - -53.19% -
482.sphinx3 (avg) (percentage) -77.30% 7.930 1.800 - -22.41% -
445.gobmk (avg) (percentage) -77.24% 3.910 0.890 - 8.54% -
459.GemsFDTD (avg) (percentage) -77.05% 5.840 1.340 - 3.08% -
462.libquantum (avg) (percentage) -76.24% 7.660 1.820 - 160.00% -
471.omnetpp (avg) (percentage) -73.29% 8.200 2.190 - 72.44% -
471.omnetpp -73.09% 223.000 60.000 - -55.56% -
471.omnetpp (avg) -73.09% 223.000 60.000 - -55.56% -
401.bzip2 -72.67% 161.000 44.000 - -29.03% -
401.bzip2 (avg) -72.67% 161.000 44.000 - -29.03% -
401.bzip2 (avg) (percentage) -72.63% 5.480 1.500 - 257.14% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -24.69% -
400.perlbench -70.48% 105.000 31.000 - -79.74% -
400.perlbench (avg) -70.48% 105.000 31.000 - -79.74% -
400.perlbench (avg) (percentage) -68.19% 6.350 2.020 - 43.26% -
435.gromacs -65.94% 367.000 125.000 - -55.36% -
435.gromacs (avg) -65.94% 367.000 125.000 - -55.36% -
435.gromacs (avg) (percentage) -65.22% 5.060 1.760 - -4.35% -
465.tonto (avg) (percentage) -63.77% 3.340 1.210 - 26.04% -
465.tonto -63.01% 365.000 135.000 - 58.82% -
465.tonto (avg) -63.01% 365.000 135.000 - 58.82% -
473.astar -61.50% 213.000 82.000 - 82.22% -
473.astar (avg) -61.50% 213.000 82.000 - 82.22% -
450.soplex -61.11% 36.000 14.000 - -92.43% -
450.soplex (avg) -61.11% 36.000 14.000 - -92.43% -
473.astar (avg) (percentage) -61.06% 4.160 1.620 - 406.25% -
450.soplex (avg) (percentage) -60.81% 6.430 2.520 - 115.38% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 718.18% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 1309.52% -
429.mcf (avg) (percentage) -35.85% 7.670 4.920 - 794.55% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1442.42% -
437.leslie3d (max) -27.79% 1929.000 1393.000 - 139.76% -
437.leslie3d (max) (percentage) -26.24% 16.580 12.230 - 197.57% -
429.mcf -4.59% 109.000 104.000 - 10.64% -
429.mcf (avg) -4.59% 109.000 104.000 - 10.64% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1536.000 -85.91%
401.bzip2 2973.000 -80.08%
410.bwaves 5957.000 -58.30%
429.mcf 2119.000 -87.73%
433.milc 1154.000 -91.06%
434.zeusmp 2523.000 -81.31%
435.gromacs 7116.000 -53.27%
436.cactusADM 2122.000 -88.01%
437.leslie3d 11393.000 -19.50%
444.namd 774.000 -91.41%
445.gobmk 5000.000 -56.73%
447.dealII 1650.000 -81.38%
450.soplex 574.000 -96.37%
453.povray 539.000 -91.77%
456.hmmer 2873.000 -74.10%
458.sjeng 7355.000 -47.63%
459.GemsFDTD 5380.000 -77.22%
462.libquantum 139.000 -98.80%
464.h264ref 5771.000 -58.08%
465.tonto 11159.000 25.91%
470.lbm 3801.000 -70.32%
471.omnetpp 2773.000 -74.10%
473.astar 5115.000 -63.96%
482.sphinx3 843.000 -97.19%
Geometric Mean 2469.187 -81.28%
Code Size (bytes)
Name Current %
400.perlbench 895883.000 -
401.bzip2 43719.000 -1.14%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60509.000 -1.18%
434.zeusmp 146667.000 -4.70%
435.gromacs 489749.000 -2.09%
436.cactusADM 348331.000 -1.28%
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.35%
445.gobmk 1374834.000 -
447.dealII 307892.000 -1.61%
450.soplex 202582.000 -4.03%
453.povray 649829.000 -1.83%
456.hmmer 107255.000 -1.27%
458.sjeng 106376.000 2.26%
459.GemsFDTD 232732.000 -6.13%
462.libquantum 15893.000 -
464.h264ref 379544.000 -1.98%
465.tonto 1972539.000 1.39%
470.lbm 9547.000 -1.69%
471.omnetpp 475384.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111659.000 -1.04%
Geometric Mean 136783.376 -1.73%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 31.000 -79.74%
400.perlbench (avg) 31.000 -79.74%
400.perlbench (avg) (percentage) 2.020 43.26%
400.perlbench (max) 35.000 -84.16%
400.perlbench (max) (percentage) 2.320 14.29%
400.perlbench (unexplained diff vs previous) 4.000 -98.23%
400.perlbench (unexplained diff vs previous) (percentage) 0.260 -87.44%
401.bzip2 44.000 -29.03%
401.bzip2 (avg) 44.000 -29.03%
401.bzip2 (avg) (percentage) 1.500 257.14%
401.bzip2 (max) 41.000 -22.64%
401.bzip2 (max) (percentage) 1.400 288.89%
401.bzip2 (unexplained diff vs previous) 13.000 -7.14%
401.bzip2 (unexplained diff vs previous) (percentage) 0.440 388.89%
403.gcc (avg) (percentage) 5.090 1442.42%
403.gcc (max) (percentage) 3.820 1093.75%
410.bwaves 54.000 -59.70%
410.bwaves (avg) 54.000 -59.70%
410.bwaves (avg) (percentage) 0.920 -2.13%
410.bwaves (max) 41.000 -51.19%
410.bwaves (max) (percentage) 0.700 18.64%
410.bwaves (unexplained diff vs previous) 37.000 -9.76%
410.bwaves (unexplained diff vs previous) (percentage) 0.620 113.79%
416.gamess (avg) (percentage) 0.760 -61.81%
416.gamess (max) (percentage) 0.370 -88.51%
429.mcf 104.000 10.64%
429.mcf (avg) 104.000 10.64%
429.mcf (avg) (percentage) 4.920 794.55%
429.mcf (max) 52.000 44.44%
429.mcf (max) (percentage) 2.470 1076.19%
429.mcf (unexplained diff vs previous) 51.000 64.52%
429.mcf (unexplained diff vs previous) (percentage) 2.410 1238.89%
433.milc 14.000 -95.21%
433.milc (avg) 14.000 -95.21%
433.milc (avg) (percentage) 1.240 -45.37%
433.milc (max) 14.000 -96.93%
433.milc (max) (percentage) 1.230 -65.25%
433.milc (unexplained diff vs previous) 14.000 -97.05%
433.milc (unexplained diff vs previous) (percentage) 1.210 -67.03%
434.zeusmp 24.000 -89.66%
434.zeusmp (avg) 24.000 -89.66%
434.zeusmp (avg) (percentage) 0.970 -43.60%
434.zeusmp (max) 6.000 -97.89%
434.zeusmp (max) (percentage) 0.250 -88.15%
434.zeusmp (unexplained diff vs previous) 4.000 -98.63%
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -92.59%
435.gromacs 125.000 -55.36%
435.gromacs (avg) 125.000 -55.36%
435.gromacs (avg) (percentage) 1.760 -4.35%
435.gromacs (max) 115.000 -71.81%
435.gromacs (max) (percentage) 1.630 -39.18%
435.gromacs (unexplained diff vs previous) 118.000 -71.90%
435.gromacs (unexplained diff vs previous) (percentage) 1.660 -39.86%
436.cactusADM 23.000 -93.65%
436.cactusADM (avg) 23.000 -93.65%
436.cactusADM (avg) (percentage) 1.130 -44.88%
436.cactusADM (max) 19.000 -96.25%
436.cactusADM (max) (percentage) 0.900 -68.64%
436.cactusADM (unexplained diff vs previous) 19.000 -96.36%
436.cactusADM (unexplained diff vs previous) (percentage) 0.900 -69.49%
437.leslie3d 512.000 40.27%
437.leslie3d (avg) 512.000 40.27%
437.leslie3d (avg) (percentage) 4.500 74.42%
437.leslie3d (max) 1393.000 139.76%
437.leslie3d (max) (percentage) 12.230 197.57%
437.leslie3d (unexplained diff vs previous) 191.000 -63.55%
437.leslie3d (unexplained diff vs previous) (percentage) 1.680 -54.59%
444.namd 9.000 -98.10%
444.namd (avg) 9.000 -98.10%
444.namd (avg) (percentage) 1.230 -76.57%
444.namd (max) 3.000 -99.52%
444.namd (max) (percentage) 0.460 -93.44%
444.namd (unexplained diff vs previous) 3.000 -99.56%
444.namd (unexplained diff vs previous) (percentage) 0.390 -94.83%
445.gobmk 44.000 -53.19%
445.gobmk (avg) 44.000 -53.19%
445.gobmk (avg) (percentage) 0.890 8.54%
445.gobmk (max) 27.000 -80.58%
445.gobmk (max) (percentage) 0.540 -55.37%
445.gobmk (unexplained diff vs previous) 27.000 -80.85%
445.gobmk (unexplained diff vs previous) (percentage) 0.540 -55.74%
447.dealII 19.000 -75.32%
447.dealII (avg) 19.000 -75.32%
447.dealII (avg) (percentage) 1.210 37.50%
447.dealII (max) 20.000 -91.84%
447.dealII (max) (percentage) 1.220 -55.96%
447.dealII (unexplained diff vs previous) 13.000 -83.95%
447.dealII (unexplained diff vs previous) (percentage) 0.790 -13.19%
450.soplex 14.000 -92.43%
450.soplex (avg) 14.000 -92.43%
450.soplex (avg) (percentage) 2.520 115.38%
450.soplex (max) 8.000 -98.74%
450.soplex (max) (percentage) 1.540 -61.79%
450.soplex (unexplained diff vs previous) 9.000 -96.46%
450.soplex (unexplained diff vs previous) (percentage) 1.570 -2.48%
453.povray 8.000 -93.39%
453.povray (avg) 8.000 -93.39%
453.povray (avg) (percentage) 1.550 -16.22%
453.povray (max) 12.000 -91.89%
453.povray (max) (percentage) 2.360 4.42%
453.povray (unexplained diff vs previous) 13.000 -91.03%
453.povray (unexplained diff vs previous) (percentage) 2.410 9.05%
454.calculix (avg) (percentage) 3.600 718.18%
454.calculix (max) (percentage) 0.830 48.21%
456.hmmer 15.000 -82.95%
456.hmmer (avg) 15.000 -82.95%
456.hmmer (avg) (percentage) 0.540 -32.50%
456.hmmer (max) 8.000 -95.09%
456.hmmer (max) (percentage) 0.310 -78.91%
456.hmmer (unexplained diff vs previous) 9.000 -94.55%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 -79.19%
458.sjeng 45.000 60.71%
458.sjeng (avg) 45.000 60.71%
458.sjeng (avg) (percentage) 0.620 210.00%
458.sjeng (max) 7.000 -78.12%
458.sjeng (max) (percentage) 0.100 -56.52%
458.sjeng (unexplained diff vs previous) 6.000 -76.92%
458.sjeng (unexplained diff vs previous) (percentage) 0.080 -57.89%
459.GemsFDTD 72.000 -76.55%
459.GemsFDTD (avg) 72.000 -76.55%
459.GemsFDTD (avg) (percentage) 1.340 3.08%
459.GemsFDTD (max) 41.000 -88.71%
459.GemsFDTD (max) (percentage) 0.770 -50.00%
459.GemsFDTD (unexplained diff vs previous) 41.000 -88.55%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.760 -50.00%
462.libquantum 2.000 -97.50%
462.libquantum (avg) 2.000 -97.50%
462.libquantum (avg) (percentage) 1.820 160.00%
462.libquantum (max) 4.000 -93.65%
462.libquantum (max) (percentage) 3.140 470.91%
462.libquantum (unexplained diff vs previous) 1.000 -97.44%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 111.76%
464.h264ref 43.000 -23.21%
464.h264ref (avg) 43.000 -23.21%
464.h264ref (avg) (percentage) 0.750 82.93%
464.h264ref (max) 9.000 -81.25%
464.h264ref (max) (percentage) 0.160 -54.29%
464.h264ref (unexplained diff vs previous) 9.000 800.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.160 1500.00%
465.tonto 135.000 58.82%
465.tonto (avg) 135.000 58.82%
465.tonto (avg) (percentage) 1.210 26.04%
465.tonto (max) 55.000 -62.84%
465.tonto (max) (percentage) 0.500 -70.24%
465.tonto (unexplained diff vs previous) 48.000 -66.90%
465.tonto (unexplained diff vs previous) (percentage) 0.430 -73.78%
470.lbm 33.000 -90.91%
470.lbm (avg) 33.000 -90.91%
470.lbm (avg) (percentage) 0.890 -68.66%
470.lbm (max) 20.000 -96.00%
470.lbm (max) (percentage) 0.550 -85.93%
470.lbm (unexplained diff vs previous) 16.000 -96.68%
470.lbm (unexplained diff vs previous) (percentage) 0.420 -88.83%
471.omnetpp 60.000 -55.56%
471.omnetpp (avg) 60.000 -55.56%
471.omnetpp (avg) (percentage) 2.190 72.44%
471.omnetpp (max) 95.000 -16.67%
471.omnetpp (max) (percentage) 3.430 220.56%
471.omnetpp (unexplained diff vs previous) 92.000 -10.68%
471.omnetpp (unexplained diff vs previous) (percentage) 3.320 245.83%
473.astar 82.000 82.22%
473.astar (avg) 82.000 82.22%
473.astar (avg) (percentage) 1.620 406.25%
473.astar (max) 221.000 689.29%
473.astar (max) (percentage) 4.330 2065.00%
473.astar (unexplained diff vs previous) 1.000 -96.55%
473.astar (unexplained diff vs previous) (percentage) 0.020 -90.00%
481.wrf (avg) (percentage) 1.800 -24.69%
481.wrf (max) (percentage) 0.830 -75.80%
482.sphinx3 15.000 -97.84%
482.sphinx3 (avg) 15.000 -97.84%
482.sphinx3 (avg) (percentage) 1.800 -22.41%
482.sphinx3 (max) 7.000 -99.36%
482.sphinx3 (max) (percentage) 0.840 -77.05%
482.sphinx3 (unexplained diff vs previous) 7.000 -98.19%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.830 -35.66%
483.xalancbmk (avg) (percentage) 2.960 1309.52%
483.xalancbmk (max) (percentage) 1.770 420.59%
Geometric Mean 5.643 -63.13%