Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a5f3ca48236a79b0cf78a82dee1cc0241a975eb7 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/0f816116356fec32e3a3a2fb5af790a0438c5da4 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7b3d8558d92a123743699c577704aab4a2f3d949 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/22/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0022 (-00000-) 2023-04-03T23:32:24 0:00:00
Previous 0021 (basepoints/gcc-13-07022-g0f816116356) 2023-04-01T18:48:18 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 34 89
Performance Improvements 154 136
Unchanged Tests 1048 1011
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 5.87% 579.000 613.000 - -96.10% -
462.libquantum 1.27% 158.000 160.000 - -99.06% -
401.bzip2 1.22% 2948.000 2984.000 - -82.42% -
447.dealII 1.20% 1909.000 1932.000 - -78.77% -
481.wrf 1.10% 6279.000 6348.000 - -71.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 3900.00% 0.020 0.800 - 70.21% -
473.astar (unexplained diff vs previous) 3800.00% 1.000 39.000 - -36.07% -
481.wrf (unexplained diff vs previous) (percentage) 3533.33% 0.030 1.090 - -73.22% -
481.wrf (unexplained diff vs previous) 3350.00% 2.000 69.000 - -92.28% -
471.omnetpp (unexplained diff vs previous) 550.00% 2.000 13.000 - -79.03% -
471.omnetpp (unexplained diff vs previous) (percentage) 542.86% 0.070 0.450 - -32.84% -
434.zeusmp (unexplained diff vs previous) 466.67% 3.000 17.000 - -96.38% -
434.zeusmp (unexplained diff vs previous) (percentage) 463.64% 0.110 0.620 - -72.44% -
450.soplex (unexplained diff vs previous) 183.33% 12.000 34.000 - -50.72% -
450.soplex (unexplained diff vs previous) (percentage) 168.12% 2.070 5.550 - 1161.36% -
433.milc (unexplained diff vs previous) 150.00% 2.000 5.000 - -94.79% -
433.milc (unexplained diff vs previous) (percentage) 144.44% 0.180 0.440 - -37.14% -
429.mcf (unexplained diff vs previous) 100.00% 3.000 6.000 - -40.00% -
429.mcf (unexplained diff vs previous) (percentage) 100.00% 0.320 0.640 - 611.11% -
444.namd (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.76% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.110 0.220 - -95.79% -
462.libquantum (max) 100.00% 1.000 2.000 - -84.62% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - -85.71% -
462.libquantum (unexplained diff vs previous) (percentage) 98.41% 0.630 1.250 - 1462.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) 58.67% 0.750 1.190 - -61.11% -
482.sphinx3 (unexplained diff vs previous) 57.14% 7.000 11.000 - -99.02% -
410.bwaves (unexplained diff vs previous) (percentage) 21.05% 0.570 0.690 - -60.34% -
410.bwaves (unexplained diff vs previous) 20.59% 34.000 41.000 - -84.05% -
462.libquantum (max) (percentage) 11.40% 1.140 1.270 - 1487.50% -
450.soplex 6.25% 32.000 34.000 - -8.11% -
450.soplex (avg) 6.25% 32.000 34.000 - -8.11% -
437.leslie3d (avg) (percentage) 2.76% 3.620 3.720 - 122.75% -
450.soplex (max) 1.96% 51.000 52.000 - -24.64% -
400.perlbench (unexplained diff vs previous) (percentage) 1.78% 1.690 1.720 - 454.84% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -6.10% 12351.000 11597.000 - -35.82% -
403.gcc -3.33% 60.000 58.000 - -99.35% -
400.perlbench -1.69% 1601.000 1574.000 - -85.97% -
454.calculix -1.54% 65.000 64.000 - -99.80% -
482.sphinx3 -1.18% 933.000 922.000 - -97.48% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -96.00% 0.250 0.010 - -96.67% -
458.sjeng (unexplained diff vs previous) -94.74% 19.000 1.000 - -97.92% -
453.povray (unexplained diff vs previous) (percentage) -88.96% 1.630 0.180 - -92.14% -
453.povray (unexplained diff vs previous) -88.89% 9.000 1.000 - -99.41% -
456.hmmer (unexplained diff vs previous) (percentage) -81.97% 0.610 0.110 - -78.85% -
456.hmmer (unexplained diff vs previous) -81.48% 27.000 5.000 - -94.90% -
470.lbm (max) -81.33% 75.000 14.000 - -98.43% -
470.lbm (max) (percentage) -80.30% 2.030 0.400 - -92.70% -
454.calculix (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.59% -
459.GemsFDTD (max) -66.67% 216.000 72.000 - -87.54% -
459.GemsFDTD (max) (percentage) -66.56% 3.020 1.010 - -55.70% -
454.calculix (unexplained diff vs previous) (percentage) -66.23% 4.620 1.560 - 108.00% -
401.bzip2 (max) (percentage) -63.17% 6.380 2.350 - 487.50% -
401.bzip2 (max) -62.77% 188.000 70.000 - 4.48% -
465.tonto (unexplained diff vs previous) (percentage) -62.50% 0.160 0.060 - -94.69% -
465.tonto (unexplained diff vs previous) -61.90% 21.000 8.000 - -94.59% -
435.gromacs (unexplained diff vs previous) (percentage) -58.02% 0.810 0.340 - -80.35% -
435.gromacs (unexplained diff vs previous) -57.38% 61.000 26.000 - -91.10% -
436.cactusADM (max) (percentage) -55.36% 1.120 0.500 - -90.10% -
436.cactusADM (max) -55.17% 29.000 13.000 - -98.94% -
464.h264ref (unexplained diff vs previous) (percentage) -51.69% 0.890 0.430 - 13.16% -
464.h264ref (unexplained diff vs previous) -50.91% 55.000 27.000 - -53.45% -
458.sjeng (max) -50.00% 60.000 30.000 - -37.50% -
458.sjeng (max) (percentage) -48.72% 0.780 0.400 - 33.33% -
416.gamess (unexplained diff vs previous) -46.03% 63.000 34.000 - -96.21% -
416.gamess (unexplained diff vs previous) (percentage) -45.24% 0.420 0.230 - -92.46% -
416.gamess (max) -42.86% 105.000 60.000 - -93.50% -
416.gamess (max) (percentage) -42.25% 0.710 0.410 - -86.94% -
454.calculix (max) -33.33% 3.000 2.000 - -99.26% -
400.perlbench (max) -29.73% 37.000 26.000 - -70.79% -
445.gobmk (max) -27.78% 54.000 39.000 - 18.18% -
400.perlbench (max) (percentage) -27.78% 2.340 1.690 - 111.25% -
459.GemsFDTD (unexplained diff vs previous) -27.27% 11.000 8.000 - -98.63% -
445.gobmk (max) (percentage) -27.10% 1.070 0.780 - 188.89% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -26.67% 0.150 0.110 - -95.22% -
454.calculix (max) (percentage) -25.87% 5.720 4.240 - 404.76% -
437.leslie3d (max) -21.76% 910.000 712.000 - 27.14% -
437.leslie3d (max) (percentage) -16.69% 7.370 6.140 - 98.06% -
456.hmmer (max) (percentage) -13.33% 0.600 0.520 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -13.04% 0.460 0.400 - -92.06% -
464.h264ref (max) -12.96% 54.000 47.000 - -20.34% -
401.bzip2 (unexplained diff vs previous) (percentage) -12.95% 1.390 1.210 - 195.12% -
453.povray (max) -12.50% 8.000 7.000 - -96.34% -
464.h264ref (max) (percentage) -12.50% 0.880 0.770 - 97.44% -
401.bzip2 (unexplained diff vs previous) -12.20% 41.000 36.000 - -47.83% -
470.lbm (unexplained diff vs previous) -11.76% 17.000 15.000 - -98.18% -
456.hmmer (max) -11.54% 26.000 23.000 - -76.53% -
437.leslie3d (unexplained diff vs previous) -11.08% 848.000 754.000 - 303.21% -
453.povray (max) (percentage) -9.94% 1.610 1.450 - -44.02% -
436.cactusADM (unexplained diff vs previous) (percentage) -7.41% 0.540 0.500 - -89.60% -
436.cactusADM (unexplained diff vs previous) -7.14% 14.000 13.000 - -98.89% -
447.dealII (unexplained diff vs previous) (percentage) -5.56% 1.260 1.190 - 58.67% -
471.omnetpp (max) (percentage) -5.41% 1.110 1.050 - -43.55% -
437.leslie3d (unexplained diff vs previous) (percentage) -5.39% 6.870 6.500 - 531.07% -
465.tonto (max) (percentage) -5.33% 0.750 0.710 - -58.48% -
435.gromacs (max) -5.29% 189.000 179.000 - -39.53% -
465.tonto (max) -5.15% 97.000 92.000 - -58.74% -
435.gromacs (max) (percentage) -4.80% 2.500 2.380 - 35.23% -
445.gobmk (unexplained diff vs previous) -4.76% 42.000 40.000 - 122.22% -
465.tonto -4.73% 169.000 161.000 - 8.78% -
465.tonto (avg) -4.73% 169.000 161.000 - 8.78% -
465.tonto (avg) (percentage) -4.62% 1.300 1.240 - 8.77% -
453.povray -4.55% 22.000 21.000 - -81.42% -
453.povray (avg) -4.55% 22.000 21.000 - -81.42% -
482.sphinx3 -4.44% 45.000 43.000 - -94.99% -
482.sphinx3 (avg) -4.44% 45.000 43.000 - -94.99% -
447.dealII (unexplained diff vs previous) -4.17% 24.000 23.000 - -66.18% -
458.sjeng -4.05% 173.000 166.000 - 361.11% -
458.sjeng (avg) -4.05% 173.000 166.000 - 361.11% -
459.GemsFDTD (avg) (percentage) -4.04% 4.210 4.040 - 190.65% -
433.milc -4.00% 50.000 48.000 - -48.94% -
433.milc (avg) -4.00% 50.000 48.000 - -48.94% -
458.sjeng (avg) (percentage) -4.00% 2.250 2.160 - 839.13% -
459.GemsFDTD -3.97% 302.000 290.000 - -17.61% -
459.GemsFDTD (avg) -3.97% 302.000 290.000 - -17.61% -
473.astar -3.95% 152.000 146.000 - 186.27% -
473.astar (avg) -3.95% 152.000 146.000 - 186.27% -
435.gromacs -3.91% 281.000 270.000 - 68.75% -
435.gromacs (avg) -3.91% 281.000 270.000 - 68.75% -
429.mcf -3.90% 77.000 74.000 - 32.14% -
429.mcf (avg) -3.90% 77.000 74.000 - 32.14% -
453.povray (avg) (percentage) -3.88% 4.120 3.960 - 158.82% -
435.gromacs (avg) (percentage) -3.76% 3.720 3.580 - 276.84% -
444.namd (avg) (percentage) -3.74% 4.540 4.370 - 68.08% -
470.lbm -3.72% 188.000 181.000 - -70.23% -
470.lbm (avg) -3.72% 188.000 181.000 - -70.23% -
450.soplex (max) (percentage) -3.72% 8.870 8.540 - 1840.91% -
429.mcf (max) -3.70% 135.000 130.000 - 251.35% -
445.gobmk (unexplained diff vs previous) (percentage) -3.66% 0.820 0.790 - 426.67% -
437.leslie3d -3.58% 447.000 431.000 - 43.19% -
437.leslie3d (avg) -3.58% 447.000 431.000 - 43.19% -
400.perlbench -3.57% 56.000 54.000 - 25.58% -
400.perlbench (avg) -3.57% 56.000 54.000 - 25.58% -
456.hmmer -3.57% 112.000 108.000 - 92.86% -
456.hmmer (avg) -3.57% 112.000 108.000 - 92.86% -
456.hmmer (avg) (percentage) -3.57% 2.520 2.430 - 710.00% -
436.cactusADM -3.54% 113.000 109.000 - -81.37% -
436.cactusADM (avg) -3.54% 113.000 109.000 - -81.37% -
471.omnetpp -3.47% 144.000 139.000 - 27.52% -
471.omnetpp (avg) -3.47% 144.000 139.000 - 27.52% -
416.gamess -3.45% 377.000 364.000 - -24.95% -
416.gamess (avg) -3.45% 377.000 364.000 - -24.95% -
434.zeusmp (max) -3.45% 58.000 56.000 - -88.36% -
464.h264ref (avg) (percentage) -3.42% 2.920 2.820 - 623.08% -
429.mcf (avg) (percentage) -3.41% 8.200 7.920 - 1550.00% -
471.omnetpp (avg) (percentage) -3.38% 5.030 4.860 - 311.86% -
433.milc (avg) (percentage) -3.37% 4.450 4.300 - 523.19% -
447.dealII (max) (percentage) -3.23% 1.240 1.200 - -27.27% -
471.omnetpp (max) -3.23% 31.000 30.000 - -82.56% -
436.cactusADM (avg) (percentage) -3.23% 4.340 4.200 - 75.00% -
434.zeusmp (avg) (percentage) -3.22% 4.040 3.910 - 220.49% -
470.lbm (avg) (percentage) -3.17% 5.040 4.880 - 30.83% -
416.gamess (avg) (percentage) -3.15% 2.540 2.460 - 49.09% -
481.wrf (avg) (percentage) -3.11% 4.180 4.050 - 57.59% -
445.gobmk -3.10% 129.000 125.000 - 362.96% -
445.gobmk (avg) -3.10% 129.000 125.000 - 362.96% -
403.gcc (max) (percentage) -2.94% 7.140 6.930 - 1074.58% -
481.wrf (max) (percentage) -2.92% 1.370 1.330 - -68.03% -
454.calculix (avg) (percentage) -2.89% 5.540 5.380 - 165.02% -
482.sphinx3 (avg) (percentage) -2.86% 4.900 4.760 - 102.55% -
401.bzip2 (avg) (percentage) -2.82% 4.250 4.130 - 1429.63% -
434.zeusmp (max) (percentage) -2.82% 2.130 2.070 - -10.00% -
429.mcf (max) (percentage) -2.80% 14.300 13.900 - 4243.75% -
464.h264ref -2.78% 180.000 175.000 - 196.61% -
464.h264ref (avg) -2.78% 180.000 175.000 - 196.61% -
410.bwaves (avg) (percentage) -2.77% 3.610 3.510 - 79.08% -
445.gobmk (avg) (percentage) -2.76% 2.540 2.470 - 1022.73% -
410.bwaves (max) (percentage) -2.75% 3.630 3.530 - 99.44% -
434.zeusmp -2.73% 110.000 107.000 - -58.04% -
434.zeusmp (avg) -2.73% 110.000 107.000 - -58.04% -
447.dealII (avg) (percentage) -2.71% 3.690 3.590 - 312.64% -
473.astar (avg) (percentage) -2.57% 3.110 3.030 - 657.50% -
444.namd -2.50% 40.000 39.000 - -90.58% -
444.namd (avg) -2.50% 40.000 39.000 - -90.58% -
462.libquantum (avg) (percentage) -2.45% 3.680 3.590 - 1789.47% -
410.bwaves -2.34% 214.000 209.000 - -27.68% -
410.bwaves (avg) -2.34% 214.000 209.000 - -27.68% -
410.bwaves (max) -2.33% 215.000 210.000 - -19.23% -
481.wrf (max) -2.33% 86.000 84.000 - -90.81% -
400.perlbench (avg) (percentage) -1.98% 3.530 3.460 - 787.18% -
481.wrf -1.91% 262.000 257.000 - -54.51% -
481.wrf (avg) -1.91% 262.000 257.000 - -54.51% -
444.namd (max) (percentage) -1.89% 0.530 0.520 - -90.56% -
473.astar (max) -1.69% 59.000 58.000 - -4.92% -
401.bzip2 -1.60% 125.000 123.000 - 173.33% -
401.bzip2 (avg) -1.60% 125.000 123.000 - 173.33% -
447.dealII -1.43% 70.000 69.000 - -12.66% -
447.dealII (avg) -1.43% 70.000 69.000 - -12.66% -
483.xalancbmk (max) (percentage) -1.08% 1.850 1.830 - 98.91% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 4243.75% 0.320 13.900 - -2.80% -
450.soplex (avg) (percentage) 2212.50% 0.240 5.550 - 0.18% -
450.soplex (max) (percentage) 1840.91% 0.440 8.540 - -3.72% -
462.libquantum (avg) (percentage) 1789.47% 0.190 3.590 - -2.45% -
429.mcf (avg) (percentage) 1550.00% 0.480 7.920 - -3.41% -
462.libquantum (max) (percentage) 1487.50% 0.080 1.270 - 11.40% -
462.libquantum (unexplained diff vs previous) (percentage) 1462.50% 0.080 1.250 - 98.41% -
401.bzip2 (avg) (percentage) 1429.63% 0.270 4.130 - -2.82% -
450.soplex (unexplained diff vs previous) (percentage) 1161.36% 0.440 5.550 - 168.12% -
403.gcc (max) (percentage) 1074.58% 0.590 6.930 - -2.94% -
445.gobmk (avg) (percentage) 1022.73% 0.220 2.470 - -2.76% -
458.sjeng (avg) (percentage) 839.13% 0.230 2.160 - -4.00% -
400.perlbench (avg) (percentage) 787.18% 0.390 3.460 - -1.98% -
456.hmmer (avg) (percentage) 710.00% 0.300 2.430 - -3.57% -
473.astar (avg) (percentage) 657.50% 0.400 3.030 - -2.57% -
464.h264ref (avg) (percentage) 623.08% 0.390 2.820 - -3.42% -
429.mcf (unexplained diff vs previous) (percentage) 611.11% 0.090 0.640 - 100.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 531.07% 1.030 6.500 - -5.39% -
433.milc (avg) (percentage) 523.19% 0.690 4.300 - -3.37% -
401.bzip2 (max) (percentage) 487.50% 0.400 2.350 - -63.17% -
400.perlbench (unexplained diff vs previous) (percentage) 454.84% 0.310 1.720 - 1.78% -
445.gobmk (unexplained diff vs previous) (percentage) 426.67% 0.150 0.790 - -3.66% -
454.calculix (max) (percentage) 404.76% 0.840 4.240 - -25.87% -
445.gobmk 362.96% 27.000 125.000 - -3.10% -
445.gobmk (avg) 362.96% 27.000 125.000 - -3.10% -
458.sjeng 361.11% 36.000 166.000 - -4.05% -
458.sjeng (avg) 361.11% 36.000 166.000 - -4.05% -
403.gcc (avg) (percentage) 318.60% 0.430 1.800 - 0.00% -
447.dealII (avg) (percentage) 312.64% 0.870 3.590 - -2.71% -
471.omnetpp (avg) (percentage) 311.86% 1.180 4.860 - -3.38% -
437.leslie3d (unexplained diff vs previous) 303.21% 187.000 754.000 - -11.08% -
435.gromacs (avg) (percentage) 276.84% 0.950 3.580 - -3.76% -
429.mcf (max) 251.35% 37.000 130.000 - -3.70% -
434.zeusmp (avg) (percentage) 220.49% 1.220 3.910 - -3.22% -
464.h264ref 196.61% 59.000 175.000 - -2.78% -
464.h264ref (avg) 196.61% 59.000 175.000 - -2.78% -
401.bzip2 (unexplained diff vs previous) (percentage) 195.12% 0.410 1.210 - -12.95% -
459.GemsFDTD (avg) (percentage) 190.65% 1.390 4.040 - -4.04% -
445.gobmk (max) (percentage) 188.89% 0.270 0.780 - -27.10% -
473.astar 186.27% 51.000 146.000 - -3.95% -
473.astar (avg) 186.27% 51.000 146.000 - -3.95% -
401.bzip2 173.33% 45.000 123.000 - -1.60% -
401.bzip2 (avg) 173.33% 45.000 123.000 - -1.60% -
454.calculix (avg) (percentage) 165.02% 2.030 5.380 - -2.89% -
453.povray (avg) (percentage) 158.82% 1.530 3.960 - -3.88% -
473.astar (max) (percentage) 157.45% 0.470 1.210 - 0.00% -
437.leslie3d (avg) (percentage) 122.75% 1.670 3.720 - 2.76% -
445.gobmk (unexplained diff vs previous) 122.22% 18.000 40.000 - -4.76% -
400.perlbench (max) (percentage) 111.25% 0.800 1.690 - -27.78% -
454.calculix (unexplained diff vs previous) (percentage) 108.00% 0.750 1.560 - -66.23% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
482.sphinx3 (avg) (percentage) 102.55% 2.350 4.760 - -2.86% -
410.bwaves (max) (percentage) 99.44% 1.770 3.530 - -2.75% -
483.xalancbmk (max) (percentage) 98.91% 0.920 1.830 - -1.08% -
437.leslie3d (max) (percentage) 98.06% 3.100 6.140 - -16.69% -
464.h264ref (max) (percentage) 97.44% 0.390 0.770 - -12.50% -
456.hmmer 92.86% 56.000 108.000 - -3.57% -
456.hmmer (avg) 92.86% 56.000 108.000 - -3.57% -
433.milc (max) (percentage) 85.92% 0.710 1.320 - 0.00% -
410.bwaves (avg) (percentage) 79.08% 1.960 3.510 - -2.77% -
436.cactusADM (avg) (percentage) 75.00% 2.400 4.200 - -3.23% -
473.astar (unexplained diff vs previous) (percentage) 70.21% 0.470 0.800 - 3900.00% -
435.gromacs 68.75% 160.000 270.000 - -3.91% -
435.gromacs (avg) 68.75% 160.000 270.000 - -3.91% -
444.namd (avg) (percentage) 68.08% 2.600 4.370 - -3.74% -
447.dealII (unexplained diff vs previous) (percentage) 58.67% 0.750 1.190 - -5.56% -
481.wrf (avg) (percentage) 57.59% 2.570 4.050 - -3.11% -
416.gamess (avg) (percentage) 49.09% 1.650 2.460 - -3.15% -
437.leslie3d 43.19% 301.000 431.000 - -3.58% -
437.leslie3d (avg) 43.19% 301.000 431.000 - -3.58% -
435.gromacs (max) (percentage) 35.23% 1.760 2.380 - -4.80% -
458.sjeng (max) (percentage) 33.33% 0.300 0.400 - -48.72% -
429.mcf 32.14% 56.000 74.000 - -3.90% -
429.mcf (avg) 32.14% 56.000 74.000 - -3.90% -
470.lbm (avg) (percentage) 30.83% 3.730 4.880 - -3.17% -
471.omnetpp 27.52% 109.000 139.000 - -3.47% -
471.omnetpp (avg) 27.52% 109.000 139.000 - -3.47% -
437.leslie3d (max) 27.14% 560.000 712.000 - -21.76% -
400.perlbench 25.58% 43.000 54.000 - -3.57% -
400.perlbench (avg) 25.58% 43.000 54.000 - -3.57% -
445.gobmk (max) 18.18% 33.000 39.000 - -27.78% -
464.h264ref (unexplained diff vs previous) (percentage) 13.16% 0.380 0.430 - -51.69% -
465.tonto 8.78% 148.000 161.000 - -4.73% -
465.tonto (avg) 8.78% 148.000 161.000 - -4.73% -
465.tonto (avg) (percentage) 8.77% 1.140 1.240 - -4.62% -
401.bzip2 (max) 4.48% 67.000 70.000 - -62.77% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -
nb_total_tests -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.80% 32491.000 64.000 - -1.54% -
403.gcc -99.35% 8890.000 58.000 - -3.33% -
462.libquantum -99.06% 17005.000 160.000 - 1.27% -
482.sphinx3 -97.48% 36586.000 922.000 - -1.18% -
450.soplex -96.10% 15709.000 613.000 - 5.87% -
444.namd -94.37% 15957.000 899.000 - 0.22% -
453.povray -92.56% 7395.000 550.000 - -0.18% -
429.mcf -91.97% 11727.000 942.000 - -0.63% -
433.milc -91.77% 13668.000 1125.000 - -0.44% -
436.cactusADM -89.33% 24396.000 2603.000 - -0.50% -
434.zeusmp -86.89% 20932.000 2744.000 - 0.62% -
400.perlbench -85.97% 11215.000 1574.000 - -1.69% -
401.bzip2 -82.42% 16971.000 2984.000 - 1.22% -
447.dealII -78.77% 9101.000 1932.000 - 1.20% -
470.lbm -77.19% 16312.000 3721.000 - -0.40% -
456.hmmer -76.50% 18995.000 4464.000 - 0.11% -
459.GemsFDTD -71.67% 25364.000 7186.000 - 0.11% -
481.wrf -71.13% 21991.000 6348.000 - 1.10% -
471.omnetpp -69.08% 9265.000 2865.000 - -0.45% -
473.astar -62.64% 12983.000 4850.000 - -0.80% -
410.bwaves -59.46% 14745.000 5977.000 - 0.69% -
445.gobmk -59.14% 12396.000 5065.000 - -0.78% -
464.h264ref -59.10% 15208.000 6220.000 - 0.44% -
435.gromacs -55.25% 16853.000 7542.000 - -0.34% -
458.sjeng -51.89% 16018.000 7707.000 - -0.01% -
416.gamess -49.60% 29409.000 14823.000 - -0.23% -
437.leslie3d -35.82% 18070.000 11597.000 - -6.10% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.76% 834.000 2.000 - 100.00% -
454.calculix (unexplained diff vs previous) -99.59% 244.000 1.000 - -66.67% -
444.namd (max) -99.54% 879.000 4.000 - 0.00% -
454.calculix -99.54% 659.000 3.000 - 0.00% -
454.calculix (avg) -99.54% 659.000 3.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.41% 169.000 1.000 - -88.89% -
454.calculix (max) -99.26% 272.000 2.000 - -33.33% -
482.sphinx3 (unexplained diff vs previous) -99.02% 1118.000 11.000 - 57.14% -
436.cactusADM (max) -98.94% 1231.000 13.000 - -55.17% -
436.cactusADM (unexplained diff vs previous) -98.89% 1173.000 13.000 - -7.14% -
459.GemsFDTD (unexplained diff vs previous) -98.63% 584.000 8.000 - -27.27% -
482.sphinx3 (max) -98.44% 1152.000 18.000 - 0.00% -
470.lbm (max) -98.43% 893.000 14.000 - -81.33% -
470.lbm (unexplained diff vs previous) -98.18% 822.000 15.000 - -11.76% -
458.sjeng (unexplained diff vs previous) -97.92% 48.000 1.000 - -94.74% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -96.67% 0.300 0.010 - -96.00% -
434.zeusmp (unexplained diff vs previous) -96.38% 470.000 17.000 - 466.67% -
453.povray (max) -96.34% 191.000 7.000 - -12.50% -
416.gamess (unexplained diff vs previous) -96.21% 896.000 34.000 - -46.03% -
444.namd (unexplained diff vs previous) (percentage) -95.79% 5.230 0.220 - 100.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -95.22% 2.300 0.110 - -26.67% -
482.sphinx3 -94.99% 859.000 43.000 - -4.44% -
482.sphinx3 (avg) -94.99% 859.000 43.000 - -4.44% -
456.hmmer (unexplained diff vs previous) -94.90% 98.000 5.000 - -81.48% -
433.milc (unexplained diff vs previous) -94.79% 96.000 5.000 - 150.00% -
465.tonto (unexplained diff vs previous) (percentage) -94.69% 1.130 0.060 - -62.50% -
465.tonto (unexplained diff vs previous) -94.59% 148.000 8.000 - -61.90% -
416.gamess (max) -93.50% 923.000 60.000 - -42.86% -
470.lbm (max) (percentage) -92.70% 5.480 0.400 - -80.30% -
416.gamess (unexplained diff vs previous) (percentage) -92.46% 3.050 0.230 - -45.24% -
403.gcc (max) -92.31% 52.000 4.000 - 0.00% -
481.wrf (unexplained diff vs previous) -92.28% 894.000 69.000 - 3350.00% -
453.povray (unexplained diff vs previous) (percentage) -92.14% 2.290 0.180 - -88.96% -
470.lbm (unexplained diff vs previous) (percentage) -92.06% 5.040 0.400 - -13.04% -
435.gromacs (unexplained diff vs previous) -91.10% 292.000 26.000 - -57.38% -
481.wrf (max) -90.81% 914.000 84.000 - -2.33% -
444.namd -90.58% 414.000 39.000 - -2.50% -
444.namd (avg) -90.58% 414.000 39.000 - -2.50% -
444.namd (max) (percentage) -90.56% 5.510 0.520 - -1.89% -
436.cactusADM (max) (percentage) -90.10% 5.050 0.500 - -55.36% -
436.cactusADM (unexplained diff vs previous) (percentage) -89.60% 4.810 0.500 - -7.41% -
434.zeusmp (max) -88.36% 481.000 56.000 - -3.45% -
459.GemsFDTD (max) -87.54% 578.000 72.000 - -66.67% -
416.gamess (max) (percentage) -86.94% 3.140 0.410 - -42.25% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 - 100.00% -
433.milc (max) -85.57% 97.000 14.000 - 0.00% -
447.dealII (max) -84.67% 150.000 23.000 - 0.00% -
462.libquantum (max) -84.62% 13.000 2.000 - 100.00% -
462.libquantum -84.38% 32.000 5.000 - 0.00% -
462.libquantum (avg) -84.38% 32.000 5.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -84.05% 257.000 41.000 - 20.59% -
471.omnetpp (max) -82.56% 172.000 30.000 - -3.23% -
453.povray -81.42% 113.000 21.000 - -4.55% -
453.povray (avg) -81.42% 113.000 21.000 - -4.55% -
436.cactusADM -81.37% 585.000 109.000 - -3.54% -
436.cactusADM (avg) -81.37% 585.000 109.000 - -3.54% -
435.gromacs (unexplained diff vs previous) (percentage) -80.35% 1.730 0.340 - -58.02% -
471.omnetpp (unexplained diff vs previous) -79.03% 62.000 13.000 - 550.00% -
456.hmmer (unexplained diff vs previous) (percentage) -78.85% 0.520 0.110 - -81.97% -
456.hmmer (max) -76.53% 98.000 23.000 - -11.54% -
481.wrf (unexplained diff vs previous) (percentage) -73.22% 4.070 1.090 - 3533.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -72.44% 2.250 0.620 - 463.64% -
400.perlbench (max) -70.79% 89.000 26.000 - -29.73% -
470.lbm -70.23% 608.000 181.000 - -3.72% -
470.lbm (avg) -70.23% 608.000 181.000 - -3.72% -
481.wrf (max) (percentage) -68.03% 4.160 1.330 - -2.92% -
447.dealII (unexplained diff vs previous) -66.18% 68.000 23.000 - -4.17% -
482.sphinx3 (unexplained diff vs previous) (percentage) -61.11% 3.060 1.190 - 58.67% -
410.bwaves (unexplained diff vs previous) (percentage) -60.34% 1.740 0.690 - 21.05% -
465.tonto (max) -58.74% 223.000 92.000 - -5.15% -
465.tonto (max) (percentage) -58.48% 1.710 0.710 - -5.33% -
434.zeusmp -58.04% 255.000 107.000 - -2.73% -
434.zeusmp (avg) -58.04% 255.000 107.000 - -2.73% -
459.GemsFDTD (max) (percentage) -55.70% 2.280 1.010 - -66.56% -
481.wrf -54.51% 565.000 257.000 - -1.91% -
481.wrf (avg) -54.51% 565.000 257.000 - -1.91% -
464.h264ref (unexplained diff vs previous) -53.45% 58.000 27.000 - -50.91% -
450.soplex (unexplained diff vs previous) -50.72% 69.000 34.000 - 183.33% -
433.milc -48.94% 94.000 48.000 - -4.00% -
433.milc (avg) -48.94% 94.000 48.000 - -4.00% -
401.bzip2 (unexplained diff vs previous) -47.83% 69.000 36.000 - -12.20% -
453.povray (max) (percentage) -44.02% 2.590 1.450 - -9.94% -
471.omnetpp (max) (percentage) -43.55% 1.860 1.050 - -5.41% -
429.mcf (unexplained diff vs previous) -40.00% 10.000 6.000 - 100.00% -
435.gromacs (max) -39.53% 296.000 179.000 - -5.29% -
458.sjeng (max) -37.50% 48.000 30.000 - -50.00% -
433.milc (unexplained diff vs previous) (percentage) -37.14% 0.700 0.440 - 144.44% -
482.sphinx3 (max) (percentage) -36.51% 3.150 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -36.07% 61.000 39.000 - 3800.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -32.84% 0.670 0.450 - 542.86% -
410.bwaves -27.68% 289.000 209.000 - -2.34% -
410.bwaves (avg) -27.68% 289.000 209.000 - -2.34% -
447.dealII (max) (percentage) -27.27% 1.650 1.200 - -3.23% -
416.gamess -24.95% 485.000 364.000 - -3.45% -
416.gamess (avg) -24.95% 485.000 364.000 - -3.45% -
450.soplex (max) -24.64% 69.000 52.000 - 1.96% -
400.perlbench (unexplained diff vs previous) -22.86% 35.000 27.000 - 0.00% -
464.h264ref (max) -20.34% 59.000 47.000 - -12.96% -
410.bwaves (max) -19.23% 260.000 210.000 - -2.33% -
459.GemsFDTD -17.61% 352.000 290.000 - -3.97% -
459.GemsFDTD (avg) -17.61% 352.000 290.000 - -3.97% -
447.dealII -12.66% 79.000 69.000 - -1.43% -
447.dealII (avg) -12.66% 79.000 69.000 - -1.43% -
434.zeusmp (max) (percentage) -10.00% 2.300 2.070 - -2.82% -
450.soplex -8.11% 37.000 34.000 - 6.25% -
450.soplex (avg) -8.11% 37.000 34.000 - 6.25% -
473.astar (max) -4.92% 61.000 58.000 - -1.69% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1574.000 -1.69%
401.bzip2 2984.000 1.22%
403.gcc 58.000 -3.33%
410.bwaves 5977.000 -
416.gamess 14823.000 -
429.mcf 942.000 -
433.milc 1125.000 -
434.zeusmp 2744.000 -
435.gromacs 7542.000 -
436.cactusADM 2603.000 -
437.leslie3d 11597.000 -6.10%
444.namd 899.000 -
445.gobmk 5065.000 -
447.dealII 1932.000 1.20%
450.soplex 613.000 5.87%
453.povray 550.000 -
454.calculix 64.000 -1.54%
456.hmmer 4464.000 -
458.sjeng 7707.000 -
459.GemsFDTD 7186.000 -
462.libquantum 160.000 1.27%
464.h264ref 6220.000 -
465.tonto 13027.000 -
470.lbm 3721.000 -
471.omnetpp 2865.000 -
473.astar 4850.000 -
481.wrf 6348.000 1.10%
482.sphinx3 922.000 -1.18%
Geometric Mean 2178.541 -
Code Size (bytes)
Name Current %
400.perlbench 563463.000 -
401.bzip2 33660.000 -
403.gcc 1589886.000 -
410.bwaves 14722.000 -
416.gamess 4554136.000 -
429.mcf 7709.000 -
433.milc 47493.000 -
434.zeusmp 140952.000 -
435.gromacs 394002.000 -
436.cactusADM 257008.000 -
437.leslie3d 47993.000 -
444.namd 162770.000 -
445.gobmk 1088240.000 -
447.dealII 191588.000 -
450.soplex 135600.000 -
453.povray 488829.000 -
454.calculix 682256.000 -
456.hmmer 74969.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195934.000 -
462.libquantum 13074.000 -
464.h264ref 301398.000 -
465.tonto 1435789.000 -
470.lbm 10845.000 -
471.omnetpp 295657.000 -
473.astar 15549.000 -
481.wrf 1539861.000 -
482.sphinx3 80058.000 -
Geometric Mean 157305.199 -
sample variability
Name Current %
400.perlbench 54.000 -3.57%
400.perlbench (avg) 54.000 -3.57%
400.perlbench (avg) (percentage) 3.460 -1.98%
400.perlbench (max) 26.000 -29.73%
400.perlbench (max) (percentage) 1.690 -27.78%
400.perlbench (unexplained diff vs previous) 27.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.720 1.78%
401.bzip2 123.000 -1.60%
401.bzip2 (avg) 123.000 -1.60%
401.bzip2 (avg) (percentage) 4.130 -2.82%
401.bzip2 (max) 70.000 -62.77%
401.bzip2 (max) (percentage) 2.350 -63.17%
401.bzip2 (unexplained diff vs previous) 36.000 -12.20%
401.bzip2 (unexplained diff vs previous) (percentage) 1.210 -12.95%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.800 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 6.930 -2.94%
410.bwaves 209.000 -2.34%
410.bwaves (avg) 209.000 -2.34%
410.bwaves (avg) (percentage) 3.510 -2.77%
410.bwaves (max) 210.000 -2.33%
410.bwaves (max) (percentage) 3.530 -2.75%
410.bwaves (unexplained diff vs previous) 41.000 20.59%
410.bwaves (unexplained diff vs previous) (percentage) 0.690 21.05%
416.gamess 364.000 -3.45%
416.gamess (avg) 364.000 -3.45%
416.gamess (avg) (percentage) 2.460 -3.15%
416.gamess (max) 60.000 -42.86%
416.gamess (max) (percentage) 0.410 -42.25%
416.gamess (unexplained diff vs previous) 34.000 -46.03%
416.gamess (unexplained diff vs previous) (percentage) 0.230 -45.24%
429.mcf 74.000 -3.90%
429.mcf (avg) 74.000 -3.90%
429.mcf (avg) (percentage) 7.920 -3.41%
429.mcf (max) 130.000 -3.70%
429.mcf (max) (percentage) 13.900 -2.80%
429.mcf (unexplained diff vs previous) 6.000 100.00%
429.mcf (unexplained diff vs previous) (percentage) 0.640 100.00%
433.milc 48.000 -4.00%
433.milc (avg) 48.000 -4.00%
433.milc (avg) (percentage) 4.300 -3.37%
433.milc (max) 14.000 -
433.milc (max) (percentage) 1.320 -
433.milc (unexplained diff vs previous) 5.000 150.00%
433.milc (unexplained diff vs previous) (percentage) 0.440 144.44%
434.zeusmp 107.000 -2.73%
434.zeusmp (avg) 107.000 -2.73%
434.zeusmp (avg) (percentage) 3.910 -3.22%
434.zeusmp (max) 56.000 -3.45%
434.zeusmp (max) (percentage) 2.070 -2.82%
434.zeusmp (unexplained diff vs previous) 17.000 466.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.620 463.64%
435.gromacs 270.000 -3.91%
435.gromacs (avg) 270.000 -3.91%
435.gromacs (avg) (percentage) 3.580 -3.76%
435.gromacs (max) 179.000 -5.29%
435.gromacs (max) (percentage) 2.380 -4.80%
435.gromacs (unexplained diff vs previous) 26.000 -57.38%
435.gromacs (unexplained diff vs previous) (percentage) 0.340 -58.02%
436.cactusADM 109.000 -3.54%
436.cactusADM (avg) 109.000 -3.54%
436.cactusADM (avg) (percentage) 4.200 -3.23%
436.cactusADM (max) 13.000 -55.17%
436.cactusADM (max) (percentage) 0.500 -55.36%
436.cactusADM (unexplained diff vs previous) 13.000 -7.14%
436.cactusADM (unexplained diff vs previous) (percentage) 0.500 -7.41%
437.leslie3d 431.000 -3.58%
437.leslie3d (avg) 431.000 -3.58%
437.leslie3d (avg) (percentage) 3.720 2.76%
437.leslie3d (max) 712.000 -21.76%
437.leslie3d (max) (percentage) 6.140 -16.69%
437.leslie3d (unexplained diff vs previous) 754.000 -11.08%
437.leslie3d (unexplained diff vs previous) (percentage) 6.500 -5.39%
444.namd 39.000 -2.50%
444.namd (avg) 39.000 -2.50%
444.namd (avg) (percentage) 4.370 -3.74%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.520 -1.89%
444.namd (unexplained diff vs previous) 2.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.220 100.00%
445.gobmk 125.000 -3.10%
445.gobmk (avg) 125.000 -3.10%
445.gobmk (avg) (percentage) 2.470 -2.76%
445.gobmk (max) 39.000 -27.78%
445.gobmk (max) (percentage) 0.780 -27.10%
445.gobmk (unexplained diff vs previous) 40.000 -4.76%
445.gobmk (unexplained diff vs previous) (percentage) 0.790 -3.66%
447.dealII 69.000 -1.43%
447.dealII (avg) 69.000 -1.43%
447.dealII (avg) (percentage) 3.590 -2.71%
447.dealII (max) 23.000 -
447.dealII (max) (percentage) 1.200 -3.23%
447.dealII (unexplained diff vs previous) 23.000 -4.17%
447.dealII (unexplained diff vs previous) (percentage) 1.190 -5.56%
450.soplex 34.000 6.25%
450.soplex (avg) 34.000 6.25%
450.soplex (avg) (percentage) 5.550 -
450.soplex (max) 52.000 1.96%
450.soplex (max) (percentage) 8.540 -3.72%
450.soplex (unexplained diff vs previous) 34.000 183.33%
450.soplex (unexplained diff vs previous) (percentage) 5.550 168.12%
453.povray 21.000 -4.55%
453.povray (avg) 21.000 -4.55%
453.povray (avg) (percentage) 3.960 -3.88%
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.450 -9.94%
453.povray (unexplained diff vs previous) 1.000 -88.89%
453.povray (unexplained diff vs previous) (percentage) 0.180 -88.96%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.380 -2.89%
454.calculix (max) 2.000 -33.33%
454.calculix (max) (percentage) 4.240 -25.87%
454.calculix (unexplained diff vs previous) 1.000 -66.67%
454.calculix (unexplained diff vs previous) (percentage) 1.560 -66.23%
456.hmmer 108.000 -3.57%
456.hmmer (avg) 108.000 -3.57%
456.hmmer (avg) (percentage) 2.430 -3.57%
456.hmmer (max) 23.000 -11.54%
456.hmmer (max) (percentage) 0.520 -13.33%
456.hmmer (unexplained diff vs previous) 5.000 -81.48%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -81.97%
458.sjeng 166.000 -4.05%
458.sjeng (avg) 166.000 -4.05%
458.sjeng (avg) (percentage) 2.160 -4.00%
458.sjeng (max) 30.000 -50.00%
458.sjeng (max) (percentage) 0.400 -48.72%
458.sjeng (unexplained diff vs previous) 1.000 -94.74%
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -96.00%
459.GemsFDTD 290.000 -3.97%
459.GemsFDTD (avg) 290.000 -3.97%
459.GemsFDTD (avg) (percentage) 4.040 -4.04%
459.GemsFDTD (max) 72.000 -66.67%
459.GemsFDTD (max) (percentage) 1.010 -66.56%
459.GemsFDTD (unexplained diff vs previous) 8.000 -27.27%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.110 -26.67%
462.libquantum 5.000 -
462.libquantum (avg) 5.000 -
462.libquantum (avg) (percentage) 3.590 -2.45%
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 1.270 11.40%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.250 98.41%
464.h264ref 175.000 -2.78%
464.h264ref (avg) 175.000 -2.78%
464.h264ref (avg) (percentage) 2.820 -3.42%
464.h264ref (max) 47.000 -12.96%
464.h264ref (max) (percentage) 0.770 -12.50%
464.h264ref (unexplained diff vs previous) 27.000 -50.91%
464.h264ref (unexplained diff vs previous) (percentage) 0.430 -51.69%
465.tonto 161.000 -4.73%
465.tonto (avg) 161.000 -4.73%
465.tonto (avg) (percentage) 1.240 -4.62%
465.tonto (max) 92.000 -5.15%
465.tonto (max) (percentage) 0.710 -5.33%
465.tonto (unexplained diff vs previous) 8.000 -61.90%
465.tonto (unexplained diff vs previous) (percentage) 0.060 -62.50%
470.lbm 181.000 -3.72%
470.lbm (avg) 181.000 -3.72%
470.lbm (avg) (percentage) 4.880 -3.17%
470.lbm (max) 14.000 -81.33%
470.lbm (max) (percentage) 0.400 -80.30%
470.lbm (unexplained diff vs previous) 15.000 -11.76%
470.lbm (unexplained diff vs previous) (percentage) 0.400 -13.04%
471.omnetpp 139.000 -3.47%
471.omnetpp (avg) 139.000 -3.47%
471.omnetpp (avg) (percentage) 4.860 -3.38%
471.omnetpp (max) 30.000 -3.23%
471.omnetpp (max) (percentage) 1.050 -5.41%
471.omnetpp (unexplained diff vs previous) 13.000 550.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.450 542.86%
473.astar 146.000 -3.95%
473.astar (avg) 146.000 -3.95%
473.astar (avg) (percentage) 3.030 -2.57%
473.astar (max) 58.000 -1.69%
473.astar (max) (percentage) 1.210 -
473.astar (unexplained diff vs previous) 39.000 3800.00%
473.astar (unexplained diff vs previous) (percentage) 0.800 3900.00%
481.wrf 257.000 -1.91%
481.wrf (avg) 257.000 -1.91%
481.wrf (avg) (percentage) 4.050 -3.11%
481.wrf (max) 84.000 -2.33%
481.wrf (max) (percentage) 1.330 -2.92%
481.wrf (unexplained diff vs previous) 69.000 3350.00%
481.wrf (unexplained diff vs previous) (percentage) 1.090 3533.33%
482.sphinx3 43.000 -4.44%
482.sphinx3 (avg) 43.000 -4.44%
482.sphinx3 (avg) (percentage) 4.760 -2.86%
482.sphinx3 (max) 18.000 -
482.sphinx3 (max) (percentage) 2.000 -
482.sphinx3 (unexplained diff vs previous) 11.000 57.14%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.190 58.67%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.830 -1.08%
Geometric Mean 9.317 -5.04%