Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e1e4078ac59740a79cd709d61872abe15aba0087 (+ 20 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (7fdb66f0db6275118986ed8d77c94d6cfe5155c2) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e442e8376dcb14c904523c78994157cb5b502ff1 (+ 20 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bb1d93eedc25f5d3a1db5e2183a6cbc5f3b5888a (+ 262 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/312/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0312 (3-changed-components) 2024-11-01T06:23:35 0:00:00
Previous 0311 (4-changed-components) 2022-10-03T20:21:47 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 90 12
Performance Improvements 131 203
Added Tests 2 0
Unchanged Tests 1013 1021
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.41% 1948787.000 1976311.000 - 1.55% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 31.78% 8408.000 11080.000 - 1.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 117200.00% 0.010 11.730 - -99.10% -
429.mcf (unexplained diff vs previous) 12250.00% 2.000 247.000 - -98.67% -
473.astar (unexplained diff vs previous) (percentage) 5312.50% 0.080 4.330 - -97.81% -
473.astar (max) (percentage) 3538.46% 0.130 4.730 - -92.88% -
462.libquantum (unexplained diff vs previous) (percentage) 3525.00% 0.120 4.350 - -99.95% -
470.lbm (unexplained diff vs previous) (percentage) 3266.67% 0.030 1.010 - -99.62% -
435.gromacs (unexplained diff vs previous) (percentage) 3072.73% 0.110 3.490 - -96.39% -
429.mcf (max) (percentage) 2668.75% 0.480 13.290 - -85.69% -
445.gobmk (unexplained diff vs previous) (percentage) 2012.50% 0.080 1.690 - -98.48% -
473.astar (unexplained diff vs previous) 1909.09% 11.000 221.000 - -97.82% -
429.mcf (avg) (percentage) 1646.43% 0.280 4.890 - -36.25% -
483.xalancbmk (avg) (percentage) 1457.89% 0.190 2.960 - -54.46% -
447.dealII (unexplained diff vs previous) (percentage) 1333.33% 0.060 0.860 - -99.79% -
403.gcc (avg) (percentage) 1313.89% 0.360 5.090 - -30.46% -
435.gromacs (unexplained diff vs previous) 1294.44% 18.000 251.000 - -96.43% -
473.astar (max) 1238.89% 18.000 241.000 - -92.92% -
450.soplex (unexplained diff vs previous) (percentage) 1067.44% 0.430 5.020 - -99.80% -
454.calculix (avg) (percentage) 990.91% 0.330 3.600 - -55.11% -
444.namd (unexplained diff vs previous) (percentage) 862.50% 0.160 1.540 - -99.86% -
470.lbm (unexplained diff vs previous) 850.00% 4.000 38.000 - -99.62% -
458.sjeng (unexplained diff vs previous) (percentage) 846.67% 0.150 1.420 - -98.44% -
445.gobmk (unexplained diff vs previous) 833.33% 9.000 84.000 - -98.49% -
462.libquantum (max) (percentage) 775.00% 0.520 4.550 - -95.40% -
473.astar (avg) (percentage) 690.48% 0.210 1.660 - -60.10% -
454.calculix (max) (percentage) 492.86% 0.140 0.830 - -99.17% -
453.povray (unexplained diff vs previous) (percentage) 436.59% 0.410 2.200 - -99.79% -
403.gcc (max) (percentage) 406.67% 0.750 3.800 - -96.18% -
458.sjeng (unexplained diff vs previous) 400.00% 21.000 105.000 - -98.47% -
483.xalancbmk (max) (percentage) 391.67% 0.360 1.770 - -97.42% -
433.milc (unexplained diff vs previous) (percentage) 387.32% 0.710 3.460 - -99.65% -
436.cactusADM (unexplained diff vs previous) (percentage) 350.00% 0.200 0.900 - -99.89% -
462.libquantum (avg) (percentage) 306.52% 0.460 1.870 - -75.59% -
401.bzip2 (avg) (percentage) 260.98% 0.410 1.480 - -72.99% -
450.soplex (max) (percentage) 245.10% 1.530 5.280 - -94.51% -
429.mcf (max) 240.24% 82.000 279.000 - -78.90% -
482.sphinx3 (unexplained diff vs previous) (percentage) 225.00% 0.560 1.820 - -99.93% -
473.astar 189.66% 29.000 84.000 - -60.56% -
473.astar (avg) 189.66% 29.000 84.000 - -60.56% -
445.gobmk (max) (percentage) 186.67% 0.600 1.720 - -96.73% -
458.sjeng (max) (percentage) 182.35% 0.510 1.440 - -96.98% -
447.dealII (unexplained diff vs previous) 180.00% 5.000 14.000 - -99.80% -
450.soplex (avg) (percentage) 171.28% 0.940 2.550 - -60.34% -
458.sjeng (avg) (percentage) 152.00% 0.250 0.630 - -80.25% -
464.h264ref (max) (percentage) 146.67% 0.450 1.110 - -97.96% -
464.h264ref (unexplained diff vs previous) (percentage) 144.44% 0.450 1.100 - -99.07% -
471.omnetpp (unexplained diff vs previous) (percentage) 144.16% 0.770 1.880 - -99.52% -
445.gobmk (avg) (percentage) 143.24% 0.370 0.900 - -76.98% -
401.bzip2 (max) (percentage) 118.64% 1.180 2.580 - -96.72% -
400.perlbench (max) (percentage) 114.48% 1.450 3.110 - -96.30% -
447.dealII (avg) (percentage) 114.29% 0.560 1.200 - -79.20% -
429.mcf 112.50% 48.000 102.000 - -6.42% -
429.mcf (avg) 112.50% 48.000 102.000 - -6.42% -
401.bzip2 (unexplained diff vs previous) (percentage) 110.92% 1.190 2.510 - -99.32% -
434.zeusmp (unexplained diff vs previous) (percentage) 107.41% 0.810 1.680 - -99.63% -
464.h264ref (avg) (percentage) 102.70% 0.370 0.750 - -85.27% -
400.perlbench (avg) (percentage) 93.20% 1.030 1.990 - -68.66% -
437.leslie3d (avg) (percentage) 92.86% 2.240 4.320 - 41.64% -
482.sphinx3 (max) (percentage) 88.61% 1.580 2.980 - -96.91% -
453.povray (max) (percentage) 86.39% 1.910 3.560 - -96.10% -
437.leslie3d (unexplained diff vs previous) (percentage) 79.78% 0.890 1.600 - -91.95% -
447.dealII (max) (percentage) 65.52% 0.580 0.960 - -98.80% -
458.sjeng (max) 49.30% 71.000 106.000 - -97.06% -
453.povray (avg) (percentage) 49.07% 1.080 1.610 - -79.39% -
437.leslie3d 44.41% 331.000 478.000 - 34.65% -
437.leslie3d (avg) 44.41% 331.000 478.000 - 34.65% -
435.gromacs (max) (percentage) 42.52% 2.540 3.620 - -92.64% -
433.milc (max) (percentage) 37.69% 2.600 3.580 - -96.06% -
437.leslie3d (unexplained diff vs previous) 35.11% 131.000 177.000 - -92.35% -
435.gromacs (avg) (percentage) 34.09% 1.320 1.770 - -65.02% -
458.sjeng 31.43% 35.000 46.000 - -80.91% -
458.sjeng (avg) 31.43% 35.000 46.000 - -80.91% -
471.omnetpp (avg) (percentage) 24.14% 1.740 2.160 - -73.66% -
445.gobmk (max) 21.43% 70.000 85.000 - -96.78% -
459.GemsFDTD (max) (percentage) 17.96% 2.060 2.430 - -96.60% -
471.omnetpp (max) (percentage) 17.18% 1.630 1.910 - -97.60% -
465.tonto 15.13% 119.000 137.000 - -62.47% -
465.tonto (avg) 15.13% 119.000 137.000 - -62.47% -
459.GemsFDTD (avg) (percentage) 14.66% 1.160 1.330 - -77.23% -
465.tonto (max) 14.14% 198.000 226.000 - -89.30% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 12.32% 2.110 2.370 - -99.05% -
464.h264ref (max) 4.92% 61.000 64.000 - -97.95% -
481.wrf (avg) (percentage) 4.05% 1.730 1.800 - -71.15% -
464.h264ref (unexplained diff vs previous) 3.23% 62.000 64.000 - -99.06% -
445.gobmk 2.33% 43.000 44.000 - -77.55% -
445.gobmk (avg) 2.33% 43.000 44.000 - -77.55% -
456.hmmer (max) (percentage) 1.54% 0.650 0.660 - -99.10% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -6.17% 247936.000 232648.000 - -4.94% -
434.zeusmp -4.56% 153897.000 146883.000 - -3.39% -
450.soplex -2.13% 206988.000 202574.000 - -1.22% -
435.gromacs -2.09% 500135.000 489677.000 - -1.92% -
464.h264ref -1.99% 387148.000 379440.000 - -2.14% -
447.dealII -1.90% 312932.000 306976.000 - -1.48% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
458.sjeng -1.68% 104028.000 102284.000 - -1.70% -
471.omnetpp -1.47% 482480.000 475388.000 - -0.55% -
444.namd -1.34% 188293.000 185768.000 - -1.39% -
456.hmmer -1.31% 108623.000 107195.000 - -1.38% -
453.povray -1.22% 657843.000 649821.000 - -1.75% -
433.milc -1.19% 61230.000 60501.000 - -1.44% -
401.bzip2 -1.12% 44213.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111663.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.80% 11523.000 138.000 - -1.43% -
482.sphinx3 -97.23% 29695.000 822.000 - -13.02% -
450.soplex -96.40% 16039.000 578.000 - 1.94% -
444.namd -92.01% 9725.000 777.000 - 4.02% -
453.povray -91.39% 6327.000 545.000 - -0.37% -
433.milc -91.28% 13252.000 1156.000 - 0.43% -
436.cactusADM -88.32% 18167.000 2121.000 - 1.82% -
429.mcf -87.80% 17260.000 2105.000 - 47.82% -
400.perlbench -86.42% 11307.000 1535.000 - -7.70% -
434.zeusmp -83.10% 13714.000 2317.000 - -7.84% -
447.dealII -81.80% 8962.000 1631.000 - -5.39% -
401.bzip2 -80.03% 14756.000 2947.000 - 0.20% -
459.GemsFDTD -76.79% 23086.000 5359.000 - -13.19% -
471.omnetpp -74.45% 10626.000 2715.000 - -0.33% -
456.hmmer -73.87% 11043.000 2886.000 - 0.14% -
470.lbm -69.27% 12296.000 3779.000 - -0.24% -
473.astar -63.92% 14150.000 5106.000 - -0.43% -
445.gobmk -57.48% 11683.000 4968.000 - -1.09% -
464.h264ref -57.39% 13635.000 5810.000 - 0.85% -
410.bwaves -56.89% 13699.000 5905.000 - 4.48% -
435.gromacs -54.27% 15711.000 7185.000 - -1.16% -
458.sjeng -47.53% 14052.000 7373.000 - -2.56% -
437.leslie3d -25.04% 14782.000 11081.000 - -4.80% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) -98.21% 670.000 12.000 - -98.25% -
482.sphinx3 -97.64% 593.000 14.000 - -81.08% -
482.sphinx3 (avg) -97.64% 593.000 14.000 - -81.08% -
444.namd -97.61% 376.000 9.000 - -86.76% -
444.namd (avg) -97.61% 376.000 9.000 - -86.76% -
462.libquantum -96.23% 53.000 2.000 - -80.00% -
462.libquantum (avg) -96.23% 53.000 2.000 - -80.00% -
482.sphinx3 (max) -94.88% 469.000 24.000 - -97.37% -
433.milc -93.81% 226.000 14.000 - -79.71% -
433.milc (avg) -93.81% 226.000 14.000 - -79.71% -
436.cactusADM (max) -93.52% 401.000 26.000 - -98.59% -
436.cactusADM -91.02% 256.000 23.000 - -81.45% -
436.cactusADM (avg) -91.02% 256.000 23.000 - -81.45% -
482.sphinx3 (unexplained diff vs previous) -90.96% 166.000 15.000 - -99.94% -
450.soplex -90.67% 150.000 14.000 - -61.11% -
450.soplex (avg) -90.67% 150.000 14.000 - -61.11% -
462.libquantum (max) -89.83% 59.000 6.000 - -95.65% -
470.lbm (max) -89.01% 355.000 39.000 - -98.58% -
434.zeusmp (max) -88.83% 349.000 39.000 - -98.10% -
434.zeusmp -88.24% 187.000 22.000 - -85.03% -
434.zeusmp (avg) -88.24% 187.000 22.000 - -85.03% -
453.povray -88.24% 68.000 8.000 - -80.95% -
453.povray (avg) -88.24% 68.000 8.000 - -80.95% -
433.milc (max) -88.08% 344.000 41.000 - -96.07% -
450.soplex (max) -87.76% 245.000 30.000 - -94.50% -
470.lbm -85.84% 226.000 32.000 - -86.61% -
470.lbm (avg) -85.84% 226.000 32.000 - -86.61% -
453.povray (max) -84.17% 120.000 19.000 - -96.19% -
416.gamess (max) (percentage) -83.70% 2.270 0.370 - -99.04% -
410.bwaves (unexplained diff vs previous) -82.49% 417.000 73.000 - -99.06% -
410.bwaves (max) -81.93% 404.000 73.000 - -97.77% -
444.namd (max) (percentage) -77.21% 6.890 1.570 - -98.29% -
410.bwaves -75.91% 220.000 53.000 - -78.71% -
410.bwaves (avg) -75.91% 220.000 53.000 - -78.71% -
456.hmmer (unexplained diff vs previous) -75.00% 72.000 18.000 - -99.78% -
456.hmmer -74.58% 59.000 15.000 - -88.19% -
456.hmmer (avg) -74.58% 59.000 15.000 - -88.19% -
400.perlbench -74.14% 116.000 30.000 - -71.43% -
400.perlbench (avg) -74.14% 116.000 30.000 - -71.43% -
459.GemsFDTD (unexplained diff vs previous) -73.87% 486.000 127.000 - -99.18% -
459.GemsFDTD -73.41% 267.000 71.000 - -80.28% -
459.GemsFDTD (avg) -73.41% 267.000 71.000 - -80.28% -
456.hmmer (max) -73.24% 71.000 19.000 - -99.10% -
459.GemsFDTD (max) -72.63% 475.000 130.000 - -97.05% -
400.perlbench (max) -71.17% 163.000 47.000 - -96.64% -
447.dealII (max) -70.59% 51.000 15.000 - -98.92% -
471.omnetpp (max) -70.52% 173.000 51.000 - -97.65% -
444.namd (avg) (percentage) -68.99% 3.870 1.200 - -86.98% -
471.omnetpp -68.48% 184.000 58.000 - -73.99% -
471.omnetpp (avg) -68.48% 184.000 58.000 - -73.99% -
434.zeusmp (unexplained diff vs previous) -64.86% 111.000 39.000 - -99.65% -
470.lbm (max) (percentage) -64.01% 2.890 1.040 - -98.57% -
481.wrf (max) (percentage) -62.56% 2.190 0.820 - -98.81% -
447.dealII -62.00% 50.000 19.000 - -80.81% -
447.dealII (avg) -62.00% 50.000 19.000 - -80.81% -
410.bwaves (unexplained diff vs previous) (percentage) -59.21% 3.040 1.240 - -99.10% -
416.gamess (avg) (percentage) -58.47% 1.830 0.760 - -82.81% -
450.soplex (unexplained diff vs previous) -57.97% 69.000 29.000 - -99.80% -
401.bzip2 (unexplained diff vs previous) -57.95% 176.000 74.000 - -99.32% -
410.bwaves (max) (percentage) -57.63% 2.950 1.250 - -97.84% -
433.milc (unexplained diff vs previous) -57.45% 94.000 40.000 - -99.65% -
462.libquantum (unexplained diff vs previous) -57.14% 14.000 6.000 - -99.96% -
401.bzip2 (max) -56.32% 174.000 76.000 - -96.71% -
453.povray (unexplained diff vs previous) -53.85% 26.000 12.000 - -99.79% -
470.lbm (avg) (percentage) -53.26% 1.840 0.860 - -86.41% -
436.cactusADM (unexplained diff vs previous) -47.22% 36.000 19.000 - -99.88% -
410.bwaves (avg) (percentage) -44.10% 1.610 0.900 - -79.59% -
436.cactusADM (max) (percentage) -43.44% 2.210 1.250 - -98.59% -
435.gromacs -38.65% 207.000 127.000 - -65.40% -
435.gromacs (avg) -38.65% 207.000 127.000 - -65.40% -
437.leslie3d (max) -38.38% 396.000 244.000 - -87.35% -
471.omnetpp (unexplained diff vs previous) -37.80% 82.000 51.000 - -99.52% -
435.gromacs (max) -34.84% 399.000 260.000 - -92.72% -
434.zeusmp (max) (percentage) -32.94% 2.550 1.710 - -97.91% -
434.zeusmp (avg) (percentage) -28.47% 1.370 0.980 - -83.25% -
401.bzip2 -28.33% 60.000 43.000 - -73.29% -
401.bzip2 (avg) -28.33% 60.000 43.000 - -73.29% -
433.milc (avg) (percentage) -26.32% 1.710 1.260 - -79.17% -
465.tonto (unexplained diff vs previous) (percentage) -25.97% 2.310 1.710 - -89.44% -
444.namd (unexplained diff vs previous) -25.00% 16.000 12.000 - -99.86% -
436.cactusADM (avg) (percentage) -21.99% 1.410 1.100 - -81.61% -
437.leslie3d (max) (percentage) -17.54% 2.680 2.210 - -86.67% -
464.h264ref -14.00% 50.000 43.000 - -85.32% -
464.h264ref (avg) -14.00% 50.000 43.000 - -85.32% -
465.tonto (max) (percentage) -13.56% 2.360 2.040 - -89.44% -
465.tonto (avg) (percentage) -12.68% 1.420 1.240 - -62.87% -
482.sphinx3 (avg) (percentage) -11.00% 2.000 1.780 - -77.55% -
456.hmmer (unexplained diff vs previous) (percentage) -4.62% 0.650 0.620 - -99.78% -
465.tonto (unexplained diff vs previous) -2.58% 194.000 189.000 - -89.33% -
456.hmmer (avg) (percentage) -1.85% 0.540 0.530 - -87.98% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.55% 1946163.000 1976311.000 - 1.41% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 47.82% 1424.000 2105.000 - -87.80% -
410.bwaves 4.48% 5652.000 5905.000 - -56.89% -
444.namd 4.02% 747.000 777.000 - -92.01% -
450.soplex 1.94% 567.000 578.000 - -96.40% -
436.cactusADM 1.82% 2083.000 2121.000 - -88.32% -
465.tonto 1.27% 10941.000 11080.000 - 31.78% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 41.64% 3.050 4.320 - 92.86% -
437.leslie3d 34.65% 355.000 478.000 - 44.41% -
437.leslie3d (avg) 34.65% 355.000 478.000 - 44.41% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.94% 244728.000 232648.000 - -6.17% -
434.zeusmp -3.39% 152037.000 146883.000 - -4.56% -
464.h264ref -2.14% 387748.000 379440.000 - -1.99% -
435.gromacs -1.92% 499261.000 489677.000 - -2.09% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649821.000 - -1.22% -
458.sjeng -1.70% 104048.000 102284.000 - -1.68% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
447.dealII -1.48% 311591.000 306976.000 - -1.90% -
433.milc -1.44% 61382.000 60501.000 - -1.19% -
444.namd -1.39% 188385.000 185768.000 - -1.34% -
456.hmmer -1.38% 108691.000 107195.000 - -1.31% -
450.soplex -1.22% 205081.000 202574.000 - -2.13% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.12% -
482.sphinx3 -1.06% 112859.000 111663.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.19% 6173.000 5359.000 - -76.79% -
482.sphinx3 -13.02% 945.000 822.000 - -97.23% -
434.zeusmp -7.84% 2514.000 2317.000 - -83.10% -
400.perlbench -7.70% 1663.000 1535.000 - -86.42% -
447.dealII -5.39% 1724.000 1631.000 - -81.80% -
437.leslie3d -4.80% 11640.000 11081.000 - -25.04% -
458.sjeng -2.56% 7567.000 7373.000 - -47.53% -
462.libquantum -1.43% 140.000 138.000 - -98.80% -
435.gromacs -1.16% 7269.000 7185.000 - -54.27% -
445.gobmk -1.09% 5023.000 4968.000 - -57.48% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 6.000 - -57.14% -
462.libquantum (unexplained diff vs previous) (percentage) -99.95% 9655.710 4.350 - 3525.00% -
482.sphinx3 (unexplained diff vs previous) -99.94% 26073.000 15.000 - -90.96% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.93% 2759.050 1.820 - 225.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.89% 787.130 0.900 - 350.00% -
436.cactusADM (unexplained diff vs previous) -99.88% 16396.000 19.000 - -47.22% -
444.namd (unexplained diff vs previous) (percentage) -99.86% 1118.610 1.540 - 862.50% -
444.namd (unexplained diff vs previous) -99.86% 8356.000 12.000 - -25.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.80% 2557.320 5.020 - 1067.44% -
447.dealII (unexplained diff vs previous) -99.80% 7017.000 14.000 - 180.00% -
450.soplex (unexplained diff vs previous) -99.80% 14500.000 29.000 - -57.97% -
453.povray (unexplained diff vs previous) -99.79% 5707.000 12.000 - -53.85% -
453.povray (unexplained diff vs previous) (percentage) -99.79% 1043.330 2.200 - 436.59% -
447.dealII (unexplained diff vs previous) (percentage) -99.79% 407.020 0.860 - 1333.33% -
456.hmmer (unexplained diff vs previous) (percentage) -99.78% 278.630 0.620 - -4.62% -
456.hmmer (unexplained diff vs previous) -99.78% 8030.000 18.000 - -75.00% -
434.zeusmp (unexplained diff vs previous) -99.65% 11280.000 39.000 - -64.86% -
433.milc (unexplained diff vs previous) (percentage) -99.65% 980.800 3.460 - 387.32% -
433.milc (unexplained diff vs previous) -99.65% 11289.000 40.000 - -57.45% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.63% 448.690 1.680 - 107.41% -
470.lbm (unexplained diff vs previous) -99.62% 9990.000 38.000 - 850.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.62% 263.730 1.010 - 3266.67% -
400.perlbench (unexplained diff vs previous) -99.57% 8772.000 38.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.53% 527.480 2.480 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.52% 10659.000 51.000 - -37.80% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.52% 391.300 1.880 - 144.16% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.32% 368.340 2.510 - 110.92% -
401.bzip2 (unexplained diff vs previous) -99.32% 10833.000 74.000 - -57.95% -
459.GemsFDTD (unexplained diff vs previous) -99.18% 15458.000 127.000 - -73.87% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - 492.86% -
456.hmmer (max) -99.10% 2120.000 19.000 - -73.24% -
456.hmmer (max) (percentage) -99.10% 73.590 0.660 - 1.54% -
429.mcf (unexplained diff vs previous) (percentage) -99.10% 1305.690 11.730 - 117200.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.10% 137.900 1.240 - -59.21% -
464.h264ref (unexplained diff vs previous) (percentage) -99.07% 118.780 1.100 - 144.44% -
464.h264ref (unexplained diff vs previous) -99.06% 6843.000 64.000 - 3.23% -
410.bwaves (unexplained diff vs previous) -99.06% 7794.000 73.000 - -82.49% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.05% 250.410 2.370 - 12.32% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -83.70% -
447.dealII (max) -98.92% 1384.000 15.000 - -70.59% -
481.wrf (max) (percentage) -98.81% 68.700 0.820 - -62.56% -
447.dealII (max) (percentage) -98.80% 80.280 0.960 - 65.52% -
429.mcf (unexplained diff vs previous) -98.67% 18593.000 247.000 - 12250.00% -
436.cactusADM (max) -98.59% 1848.000 26.000 - -93.52% -
436.cactusADM (max) (percentage) -98.59% 88.730 1.250 - -43.44% -
470.lbm (max) -98.58% 2746.000 39.000 - -89.01% -
470.lbm (max) (percentage) -98.57% 72.510 1.040 - -64.01% -
445.gobmk (unexplained diff vs previous) -98.49% 5581.000 84.000 - 833.33% -
445.gobmk (unexplained diff vs previous) (percentage) -98.48% 111.110 1.690 - 2012.50% -
458.sjeng (unexplained diff vs previous) -98.47% 6876.000 105.000 - 400.00% -
458.sjeng (unexplained diff vs previous) (percentage) -98.44% 90.870 1.420 - 846.67% -
444.namd (max) (percentage) -98.29% 91.790 1.570 - -77.21% -
444.namd (max) -98.25% 685.000 12.000 - -98.21% -
434.zeusmp (max) -98.10% 2055.000 39.000 - -88.83% -
464.h264ref (max) (percentage) -97.96% 54.290 1.110 - 146.67% -
464.h264ref (max) -97.95% 3127.000 64.000 - 4.92% -
434.zeusmp (max) (percentage) -97.91% 81.770 1.710 - -32.94% -
410.bwaves (max) (percentage) -97.84% 57.970 1.250 - -57.63% -
473.astar (unexplained diff vs previous) -97.82% 10146.000 221.000 - 1909.09% -
473.astar (unexplained diff vs previous) (percentage) -97.81% 197.850 4.330 - 5312.50% -
410.bwaves (max) -97.77% 3276.000 73.000 - -81.93% -
471.omnetpp (max) -97.65% 2169.000 51.000 - -70.52% -
471.omnetpp (max) (percentage) -97.60% 79.650 1.910 - 17.18% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 391.67% -
482.sphinx3 (max) -97.37% 911.000 24.000 - -94.88% -
458.sjeng (max) -97.06% 3602.000 106.000 - 49.30% -
459.GemsFDTD (max) -97.05% 4411.000 130.000 - -72.63% -
458.sjeng (max) (percentage) -96.98% 47.610 1.440 - 182.35% -
482.sphinx3 (max) (percentage) -96.91% 96.500 2.980 - 88.61% -
445.gobmk (max) -96.78% 2643.000 85.000 - 21.43% -
445.gobmk (max) (percentage) -96.73% 52.630 1.720 - 186.67% -
401.bzip2 (max) (percentage) -96.72% 78.650 2.580 - 118.64% -
401.bzip2 (max) -96.71% 2313.000 76.000 - -56.32% -
400.perlbench (max) -96.64% 1397.000 47.000 - -71.17% -
459.GemsFDTD (max) (percentage) -96.60% 71.460 2.430 - 17.96% -
435.gromacs (unexplained diff vs previous) -96.43% 7028.000 251.000 - 1294.44% -
435.gromacs (unexplained diff vs previous) (percentage) -96.39% 96.680 3.490 - 3072.73% -
400.perlbench (max) (percentage) -96.30% 84.060 3.110 - 114.48% -
453.povray (max) -96.19% 499.000 19.000 - -84.17% -
403.gcc (max) (percentage) -96.18% 99.360 3.800 - 406.67% -
453.povray (max) (percentage) -96.10% 91.250 3.560 - 86.39% -
433.milc (max) -96.07% 1044.000 41.000 - -88.08% -
433.milc (max) (percentage) -96.06% 90.750 3.580 - 37.69% -
462.libquantum (max) -95.65% 138.000 6.000 - -89.83% -
462.libquantum (max) (percentage) -95.40% 98.970 4.550 - 775.00% -
450.soplex (max) (percentage) -94.51% 96.240 5.280 - 245.10% -
450.soplex (max) -94.50% 545.000 30.000 - -87.76% -
473.astar (max) -92.92% 3406.000 241.000 - 1238.89% -
473.astar (max) (percentage) -92.88% 66.430 4.730 - 3538.46% -
435.gromacs (max) -92.72% 3573.000 260.000 - -34.84% -
435.gromacs (max) (percentage) -92.64% 49.160 3.620 - 42.52% -
437.leslie3d (unexplained diff vs previous) -92.35% 2314.000 177.000 - 35.11% -
437.leslie3d (unexplained diff vs previous) (percentage) -91.95% 19.880 1.600 - 79.78% -
465.tonto (unexplained diff vs previous) (percentage) -89.44% 16.190 1.710 - -25.97% -
465.tonto (max) (percentage) -89.44% 19.310 2.040 - -13.56% -
465.tonto (unexplained diff vs previous) -89.33% 1771.000 189.000 - -2.58% -
465.tonto (max) -89.30% 2112.000 226.000 - 14.14% -
456.hmmer -88.19% 127.000 15.000 - -74.58% -
456.hmmer (avg) -88.19% 127.000 15.000 - -74.58% -
456.hmmer (avg) (percentage) -87.98% 4.410 0.530 - -1.85% -
437.leslie3d (max) -87.35% 1929.000 244.000 - -38.38% -
444.namd (avg) (percentage) -86.98% 9.220 1.200 - -68.99% -
444.namd -86.76% 68.000 9.000 - -97.61% -
444.namd (avg) -86.76% 68.000 9.000 - -97.61% -
437.leslie3d (max) (percentage) -86.67% 16.580 2.210 - -17.54% -
470.lbm -86.61% 239.000 32.000 - -85.84% -
470.lbm (avg) -86.61% 239.000 32.000 - -85.84% -
470.lbm (avg) (percentage) -86.41% 6.330 0.860 - -53.26% -
429.mcf (max) (percentage) -85.69% 92.890 13.290 - 2668.75% -
464.h264ref -85.32% 293.000 43.000 - -14.00% -
464.h264ref (avg) -85.32% 293.000 43.000 - -14.00% -
464.h264ref (avg) (percentage) -85.27% 5.090 0.750 - 102.70% -
434.zeusmp -85.03% 147.000 22.000 - -88.24% -
434.zeusmp (avg) -85.03% 147.000 22.000 - -88.24% -
434.zeusmp (avg) (percentage) -83.25% 5.850 0.980 - -28.47% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -58.47% -
436.cactusADM (avg) (percentage) -81.61% 5.980 1.100 - -21.99% -
436.cactusADM -81.45% 124.000 23.000 - -91.02% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -91.02% -
482.sphinx3 -81.08% 74.000 14.000 - -97.64% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -97.64% -
453.povray -80.95% 42.000 8.000 - -88.24% -
453.povray (avg) -80.95% 42.000 8.000 - -88.24% -
458.sjeng -80.91% 241.000 46.000 - 31.43% -
458.sjeng (avg) -80.91% 241.000 46.000 - 31.43% -
447.dealII -80.81% 99.000 19.000 - -62.00% -
447.dealII (avg) -80.81% 99.000 19.000 - -62.00% -
459.GemsFDTD -80.28% 360.000 71.000 - -73.41% -
459.GemsFDTD (avg) -80.28% 360.000 71.000 - -73.41% -
458.sjeng (avg) (percentage) -80.25% 3.190 0.630 - 152.00% -
462.libquantum -80.00% 10.000 2.000 - -96.23% -
462.libquantum (avg) -80.00% 10.000 2.000 - -96.23% -
433.milc -79.71% 69.000 14.000 - -93.81% -
433.milc (avg) -79.71% 69.000 14.000 - -93.81% -
410.bwaves (avg) (percentage) -79.59% 4.410 0.900 - -44.10% -
453.povray (avg) (percentage) -79.39% 7.810 1.610 - 49.07% -
447.dealII (avg) (percentage) -79.20% 5.770 1.200 - 114.29% -
433.milc (avg) (percentage) -79.17% 6.050 1.260 - -26.32% -
429.mcf (max) -78.90% 1322.000 279.000 - 240.24% -
410.bwaves -78.71% 249.000 53.000 - -75.91% -
410.bwaves (avg) -78.71% 249.000 53.000 - -75.91% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - -11.00% -
445.gobmk -77.55% 196.000 44.000 - 2.33% -
445.gobmk (avg) -77.55% 196.000 44.000 - 2.33% -
459.GemsFDTD (avg) (percentage) -77.23% 5.840 1.330 - 14.66% -
445.gobmk (avg) (percentage) -76.98% 3.910 0.900 - 143.24% -
462.libquantum (avg) (percentage) -75.59% 7.660 1.870 - 306.52% -
471.omnetpp -73.99% 223.000 58.000 - -68.48% -
471.omnetpp (avg) -73.99% 223.000 58.000 - -68.48% -
471.omnetpp (avg) (percentage) -73.66% 8.200 2.160 - 24.14% -
401.bzip2 -73.29% 161.000 43.000 - -28.33% -
401.bzip2 (avg) -73.29% 161.000 43.000 - -28.33% -
401.bzip2 (avg) (percentage) -72.99% 5.480 1.480 - 260.98% -
400.perlbench -71.43% 105.000 30.000 - -74.14% -
400.perlbench (avg) -71.43% 105.000 30.000 - -74.14% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 4.05% -
400.perlbench (avg) (percentage) -68.66% 6.350 1.990 - 93.20% -
435.gromacs -65.40% 367.000 127.000 - -38.65% -
435.gromacs (avg) -65.40% 367.000 127.000 - -38.65% -
435.gromacs (avg) (percentage) -65.02% 5.060 1.770 - 34.09% -
465.tonto (avg) (percentage) -62.87% 3.340 1.240 - -12.68% -
465.tonto -62.47% 365.000 137.000 - 15.13% -
465.tonto (avg) -62.47% 365.000 137.000 - 15.13% -
450.soplex -61.11% 36.000 14.000 - -90.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -90.67% -
473.astar -60.56% 213.000 84.000 - 189.66% -
473.astar (avg) -60.56% 213.000 84.000 - 189.66% -
450.soplex (avg) (percentage) -60.34% 6.430 2.550 - 171.28% -
473.astar (avg) (percentage) -60.10% 4.160 1.660 - 690.48% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 990.91% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 1457.89% -
429.mcf (avg) (percentage) -36.25% 7.670 4.890 - 1646.43% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1313.89% -
429.mcf -6.42% 109.000 102.000 - 112.50% -
429.mcf (avg) -6.42% 109.000 102.000 - 112.50% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1535.000 -86.42%
401.bzip2 2947.000 -80.03%
410.bwaves 5905.000 -56.89%
429.mcf 2105.000 -87.80%
433.milc 1156.000 -91.28%
434.zeusmp 2317.000 -83.10%
435.gromacs 7185.000 -54.27%
436.cactusADM 2121.000 -88.32%
437.leslie3d 11081.000 -25.04%
444.namd 777.000 -92.01%
445.gobmk 4968.000 -57.48%
447.dealII 1631.000 -81.80%
450.soplex 578.000 -96.40%
453.povray 545.000 -91.39%
456.hmmer 2886.000 -73.87%
458.sjeng 7373.000 -47.53%
459.GemsFDTD 5359.000 -76.79%
462.libquantum 138.000 -98.80%
464.h264ref 5810.000 -57.39%
465.tonto 11080.000 31.78%
470.lbm 3779.000 -69.27%
471.omnetpp 2715.000 -74.45%
473.astar 5106.000 -63.92%
482.sphinx3 822.000 -97.23%
Geometric Mean 2450.589 -81.46%
Code Size (bytes)
Name Current %
400.perlbench 892379.000 -
401.bzip2 43719.000 -1.12%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60501.000 -1.19%
434.zeusmp 146883.000 -4.56%
435.gromacs 489677.000 -2.09%
436.cactusADM 352411.000 -
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.34%
445.gobmk 1379170.000 -
447.dealII 306976.000 -1.90%
450.soplex 202574.000 -2.13%
453.povray 649821.000 -1.22%
456.hmmer 107195.000 -1.31%
458.sjeng 102284.000 -1.68%
459.GemsFDTD 232648.000 -6.17%
462.libquantum 15893.000 -
464.h264ref 379440.000 -1.99%
465.tonto 1976311.000 1.41%
470.lbm 9547.000 -1.69%
471.omnetpp 475388.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111663.000 -1.04%
Geometric Mean 136615.745 -1.71%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 30.000 -74.14%
400.perlbench (avg) 30.000 -74.14%
400.perlbench (avg) (percentage) 1.990 93.20%
400.perlbench (max) 47.000 -71.17%
400.perlbench (max) (percentage) 3.110 114.48%
400.perlbench (unexplained diff vs previous) 38.000 -
400.perlbench (unexplained diff vs previous) (percentage) 2.480 -
401.bzip2 43.000 -28.33%
401.bzip2 (avg) 43.000 -28.33%
401.bzip2 (avg) (percentage) 1.480 260.98%
401.bzip2 (max) 76.000 -56.32%
401.bzip2 (max) (percentage) 2.580 118.64%
401.bzip2 (unexplained diff vs previous) 74.000 -57.95%
401.bzip2 (unexplained diff vs previous) (percentage) 2.510 110.92%
403.gcc (avg) (percentage) 5.090 1313.89%
403.gcc (max) (percentage) 3.800 406.67%
410.bwaves 53.000 -75.91%
410.bwaves (avg) 53.000 -75.91%
410.bwaves (avg) (percentage) 0.900 -44.10%
410.bwaves (max) 73.000 -81.93%
410.bwaves (max) (percentage) 1.250 -57.63%
410.bwaves (unexplained diff vs previous) 73.000 -82.49%
410.bwaves (unexplained diff vs previous) (percentage) 1.240 -59.21%
416.gamess (avg) (percentage) 0.760 -58.47%
416.gamess (max) (percentage) 0.370 -83.70%
429.mcf 102.000 112.50%
429.mcf (avg) 102.000 112.50%
429.mcf (avg) (percentage) 4.890 1646.43%
429.mcf (max) 279.000 240.24%
429.mcf (max) (percentage) 13.290 2668.75%
429.mcf (unexplained diff vs previous) 247.000 12250.00%
429.mcf (unexplained diff vs previous) (percentage) 11.730 117200.00%
433.milc 14.000 -93.81%
433.milc (avg) 14.000 -93.81%
433.milc (avg) (percentage) 1.260 -26.32%
433.milc (max) 41.000 -88.08%
433.milc (max) (percentage) 3.580 37.69%
433.milc (unexplained diff vs previous) 40.000 -57.45%
433.milc (unexplained diff vs previous) (percentage) 3.460 387.32%
434.zeusmp 22.000 -88.24%
434.zeusmp (avg) 22.000 -88.24%
434.zeusmp (avg) (percentage) 0.980 -28.47%
434.zeusmp (max) 39.000 -88.83%
434.zeusmp (max) (percentage) 1.710 -32.94%
434.zeusmp (unexplained diff vs previous) 39.000 -64.86%
434.zeusmp (unexplained diff vs previous) (percentage) 1.680 107.41%
435.gromacs 127.000 -38.65%
435.gromacs (avg) 127.000 -38.65%
435.gromacs (avg) (percentage) 1.770 34.09%
435.gromacs (max) 260.000 -34.84%
435.gromacs (max) (percentage) 3.620 42.52%
435.gromacs (unexplained diff vs previous) 251.000 1294.44%
435.gromacs (unexplained diff vs previous) (percentage) 3.490 3072.73%
436.cactusADM 23.000 -91.02%
436.cactusADM (avg) 23.000 -91.02%
436.cactusADM (avg) (percentage) 1.100 -21.99%
436.cactusADM (max) 26.000 -93.52%
436.cactusADM (max) (percentage) 1.250 -43.44%
436.cactusADM (unexplained diff vs previous) 19.000 -47.22%
436.cactusADM (unexplained diff vs previous) (percentage) 0.900 350.00%
437.leslie3d 478.000 44.41%
437.leslie3d (avg) 478.000 44.41%
437.leslie3d (avg) (percentage) 4.320 92.86%
437.leslie3d (max) 244.000 -38.38%
437.leslie3d (max) (percentage) 2.210 -17.54%
437.leslie3d (unexplained diff vs previous) 177.000 35.11%
437.leslie3d (unexplained diff vs previous) (percentage) 1.600 79.78%
444.namd 9.000 -97.61%
444.namd (avg) 9.000 -97.61%
444.namd (avg) (percentage) 1.200 -68.99%
444.namd (max) 12.000 -98.21%
444.namd (max) (percentage) 1.570 -77.21%
444.namd (unexplained diff vs previous) 12.000 -25.00%
444.namd (unexplained diff vs previous) (percentage) 1.540 862.50%
445.gobmk 44.000 2.33%
445.gobmk (avg) 44.000 2.33%
445.gobmk (avg) (percentage) 0.900 143.24%
445.gobmk (max) 85.000 21.43%
445.gobmk (max) (percentage) 1.720 186.67%
445.gobmk (unexplained diff vs previous) 84.000 833.33%
445.gobmk (unexplained diff vs previous) (percentage) 1.690 2012.50%
447.dealII 19.000 -62.00%
447.dealII (avg) 19.000 -62.00%
447.dealII (avg) (percentage) 1.200 114.29%
447.dealII (max) 15.000 -70.59%
447.dealII (max) (percentage) 0.960 65.52%
447.dealII (unexplained diff vs previous) 14.000 180.00%
447.dealII (unexplained diff vs previous) (percentage) 0.860 1333.33%
450.soplex 14.000 -90.67%
450.soplex (avg) 14.000 -90.67%
450.soplex (avg) (percentage) 2.550 171.28%
450.soplex (max) 30.000 -87.76%
450.soplex (max) (percentage) 5.280 245.10%
450.soplex (unexplained diff vs previous) 29.000 -57.97%
450.soplex (unexplained diff vs previous) (percentage) 5.020 1067.44%
453.povray 8.000 -88.24%
453.povray (avg) 8.000 -88.24%
453.povray (avg) (percentage) 1.610 49.07%
453.povray (max) 19.000 -84.17%
453.povray (max) (percentage) 3.560 86.39%
453.povray (unexplained diff vs previous) 12.000 -53.85%
453.povray (unexplained diff vs previous) (percentage) 2.200 436.59%
454.calculix (avg) (percentage) 3.600 990.91%
454.calculix (max) (percentage) 0.830 492.86%
456.hmmer 15.000 -74.58%
456.hmmer (avg) 15.000 -74.58%
456.hmmer (avg) (percentage) 0.530 -1.85%
456.hmmer (max) 19.000 -73.24%
456.hmmer (max) (percentage) 0.660 1.54%
456.hmmer (unexplained diff vs previous) 18.000 -75.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.620 -4.62%
458.sjeng 46.000 31.43%
458.sjeng (avg) 46.000 31.43%
458.sjeng (avg) (percentage) 0.630 152.00%
458.sjeng (max) 106.000 49.30%
458.sjeng (max) (percentage) 1.440 182.35%
458.sjeng (unexplained diff vs previous) 105.000 400.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.420 846.67%
459.GemsFDTD 71.000 -73.41%
459.GemsFDTD (avg) 71.000 -73.41%
459.GemsFDTD (avg) (percentage) 1.330 14.66%
459.GemsFDTD (max) 130.000 -72.63%
459.GemsFDTD (max) (percentage) 2.430 17.96%
459.GemsFDTD (unexplained diff vs previous) 127.000 -73.87%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.370 12.32%
462.libquantum 2.000 -96.23%
462.libquantum (avg) 2.000 -96.23%
462.libquantum (avg) (percentage) 1.870 306.52%
462.libquantum (max) 6.000 -89.83%
462.libquantum (max) (percentage) 4.550 775.00%
462.libquantum (unexplained diff vs previous) 6.000 -57.14%
462.libquantum (unexplained diff vs previous) (percentage) 4.350 3525.00%
464.h264ref 43.000 -14.00%
464.h264ref (avg) 43.000 -14.00%
464.h264ref (avg) (percentage) 0.750 102.70%
464.h264ref (max) 64.000 4.92%
464.h264ref (max) (percentage) 1.110 146.67%
464.h264ref (unexplained diff vs previous) 64.000 3.23%
464.h264ref (unexplained diff vs previous) (percentage) 1.100 144.44%
465.tonto 137.000 15.13%
465.tonto (avg) 137.000 15.13%
465.tonto (avg) (percentage) 1.240 -12.68%
465.tonto (max) 226.000 14.14%
465.tonto (max) (percentage) 2.040 -13.56%
465.tonto (unexplained diff vs previous) 189.000 -2.58%
465.tonto (unexplained diff vs previous) (percentage) 1.710 -25.97%
470.lbm 32.000 -85.84%
470.lbm (avg) 32.000 -85.84%
470.lbm (avg) (percentage) 0.860 -53.26%
470.lbm (max) 39.000 -89.01%
470.lbm (max) (percentage) 1.040 -64.01%
470.lbm (unexplained diff vs previous) 38.000 850.00%
470.lbm (unexplained diff vs previous) (percentage) 1.010 3266.67%
471.omnetpp 58.000 -68.48%
471.omnetpp (avg) 58.000 -68.48%
471.omnetpp (avg) (percentage) 2.160 24.14%
471.omnetpp (max) 51.000 -70.52%
471.omnetpp (max) (percentage) 1.910 17.18%
471.omnetpp (unexplained diff vs previous) 51.000 -37.80%
471.omnetpp (unexplained diff vs previous) (percentage) 1.880 144.16%
473.astar 84.000 189.66%
473.astar (avg) 84.000 189.66%
473.astar (avg) (percentage) 1.660 690.48%
473.astar (max) 241.000 1238.89%
473.astar (max) (percentage) 4.730 3538.46%
473.astar (unexplained diff vs previous) 221.000 1909.09%
473.astar (unexplained diff vs previous) (percentage) 4.330 5312.50%
481.wrf (avg) (percentage) 1.800 4.05%
481.wrf (max) (percentage) 0.820 -62.56%
482.sphinx3 14.000 -97.64%
482.sphinx3 (avg) 14.000 -97.64%
482.sphinx3 (avg) (percentage) 1.780 -11.00%
482.sphinx3 (max) 24.000 -94.88%
482.sphinx3 (max) (percentage) 2.980 88.61%
482.sphinx3 (unexplained diff vs previous) 15.000 -90.96%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.820 225.00%
483.xalancbmk (avg) (percentage) 2.960 1457.89%
483.xalancbmk (max) (percentage) 1.770 391.67%
Geometric Mean 9.800 -4.80%