Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=945efa5c538d3967857ff9fa42e763577534c36d (+ 81 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/dc1be3eb33c7f37ac45ad0ccf5be063134a513be (+ 81 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=3a4781c16c680a2c5ab4585b4696f781898ab610 (+ 24 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=ec877605f9a9574a0b03854e44f5f64812043439 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/7/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0007 (3-changed-components) 2023-02-28T06:25:37 0:00:00
Previous 0006 (4-changed-components) 2023-02-25T09:19:02 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 76 116
Performance Improvements 116 100
Added Tests 4 4
Unchanged Tests 1040 1016
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 23.74% 952.000 1178.000 - -89.95% -
403.gcc 7.14% 56.000 60.000 - -99.33% -
470.lbm 3.05% 3739.000 3853.000 - -76.38% -
400.perlbench 2.22% 1574.000 1609.000 - -85.65% -
459.GemsFDTD 1.66% 7183.000 7302.000 - -71.21% -
482.sphinx3 1.51% 925.000 939.000 - -97.43% -
436.cactusADM 1.20% 2585.000 2616.000 - -89.28% -
447.dealII 1.06% 1882.000 1902.000 - -79.10% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) 10900.00% 1.000 110.000 - 511.11% -
445.gobmk (unexplained diff vs previous) (percentage) 10900.00% 0.020 2.200 - 1366.67% -
470.lbm (unexplained diff vs previous) (percentage) 5820.00% 0.050 2.960 - -41.27% -
470.lbm (unexplained diff vs previous) 5600.00% 2.000 114.000 - -86.13% -
429.mcf (max) 2225.00% 12.000 279.000 - 654.05% -
433.milc (unexplained diff vs previous) 2000.00% 1.000 21.000 - -78.12% -
433.milc (unexplained diff vs previous) (percentage) 2000.00% 0.090 1.890 - 170.00% -
429.mcf (unexplained diff vs previous) 1783.33% 12.000 226.000 - 2160.00% -
429.mcf (max) (percentage) 1754.69% 1.280 23.740 - 7318.75% -
459.GemsFDTD (max) 1628.57% 7.000 121.000 - -79.07% -
436.cactusADM (max) 1450.00% 2.000 31.000 - -97.48% -
436.cactusADM (unexplained diff vs previous) 1450.00% 2.000 31.000 - -97.36% -
429.mcf (unexplained diff vs previous) (percentage) 1423.02% 1.260 19.190 - 21222.22% -
459.GemsFDTD (max) (percentage) 1409.09% 0.110 1.660 - -27.19% -
459.GemsFDTD (unexplained diff vs previous) 1387.50% 8.000 119.000 - -79.62% -
436.cactusADM (unexplained diff vs previous) (percentage) 1387.50% 0.080 1.190 - -75.26% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1381.82% 0.110 1.630 - -29.13% -
473.astar (unexplained diff vs previous) (percentage) 1150.00% 0.120 1.500 - 219.15% -
473.astar (unexplained diff vs previous) 1100.00% 6.000 72.000 - 18.03% -
436.cactusADM (max) (percentage) 990.91% 0.110 1.200 - -76.24% -
471.omnetpp (unexplained diff vs previous) (percentage) 578.12% 0.320 2.170 - 223.88% -
471.omnetpp (unexplained diff vs previous) 566.67% 9.000 60.000 - -3.23% -
435.gromacs (unexplained diff vs previous) (percentage) 511.96% 0.920 5.630 - 225.43% -
435.gromacs (unexplained diff vs previous) 480.00% 70.000 406.000 - 39.04% -
445.gobmk (max) (percentage) 367.39% 0.460 2.150 - 696.30% -
445.gobmk (max) 365.22% 23.000 107.000 - 224.24% -
435.gromacs (max) (percentage) 363.48% 1.150 5.330 - 202.84% -
401.bzip2 (unexplained diff vs previous) (percentage) 357.45% 0.940 4.300 - 948.78% -
471.omnetpp (max) 346.15% 13.000 58.000 - -66.28% -
471.omnetpp (max) (percentage) 341.67% 0.480 2.120 - 13.98% -
435.gromacs (max) 341.38% 87.000 384.000 - 29.73% -
401.bzip2 (unexplained diff vs previous) 339.29% 28.000 123.000 - 78.26% -
433.milc (max) 300.00% 5.000 20.000 - -79.38% -
400.perlbench (unexplained diff vs previous) 288.89% 9.000 35.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 282.46% 0.570 2.180 - 603.23% -
433.milc (max) (percentage) 250.94% 0.530 1.860 - 161.97% -
450.soplex (unexplained diff vs previous) (percentage) 237.93% 2.030 6.860 - 1459.09% -
400.perlbench (max) 218.18% 11.000 35.000 - -60.67% -
450.soplex (unexplained diff vs previous) 216.67% 12.000 38.000 - -44.93% -
400.perlbench (max) (percentage) 212.68% 0.710 2.220 - 177.50% -
454.calculix (max) 200.00% 1.000 3.000 - -98.90% -
410.bwaves (unexplained diff vs previous) (percentage) 180.00% 0.150 0.420 - -75.86% -
410.bwaves (unexplained diff vs previous) 177.78% 9.000 25.000 - -90.27% -
454.calculix (max) (percentage) 158.40% 2.380 6.150 - 632.14% -
482.sphinx3 (max) 133.33% 6.000 14.000 - -98.78% -
481.wrf (unexplained diff vs previous) (percentage) 120.97% 0.620 1.370 - -66.34% -
481.wrf (unexplained diff vs previous) 117.95% 39.000 85.000 - -90.49% -
464.h264ref (unexplained diff vs previous) 110.53% 19.000 40.000 - -31.03% -
464.h264ref (unexplained diff vs previous) (percentage) 109.68% 0.310 0.650 - 71.05% -
458.sjeng (unexplained diff vs previous) 108.33% 12.000 25.000 - -47.92% -
481.wrf (max) (percentage) 107.69% 0.650 1.350 - -67.55% -
481.wrf (max) 107.50% 40.000 83.000 - -90.92% -
458.sjeng (unexplained diff vs previous) (percentage) 106.25% 0.160 0.330 - 10.00% -
462.libquantum (unexplained diff vs previous) (percentage) 104.84% 0.620 1.270 - 1487.50% -
482.sphinx3 (max) (percentage) 101.33% 0.750 1.510 - -52.06% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - -85.71% -
482.sphinx3 (unexplained diff vs previous) 100.00% 7.000 14.000 - -98.75% -
482.sphinx3 (unexplained diff vs previous) (percentage) 96.05% 0.760 1.490 - -51.31% -
434.zeusmp (unexplained diff vs previous) (percentage) 52.90% 1.380 2.110 - -6.22% -
434.zeusmp (unexplained diff vs previous) 50.00% 38.000 57.000 - -87.87% -
429.mcf 35.21% 71.000 96.000 - 71.43% -
429.mcf (avg) 35.21% 71.000 96.000 - 71.43% -
416.gamess (unexplained diff vs previous) 24.14% 29.000 36.000 - -95.98% -
416.gamess (unexplained diff vs previous) (percentage) 20.00% 0.200 0.240 - -92.13% -
429.mcf (avg) (percentage) 9.59% 7.510 8.230 - 1614.58% -
450.soplex (avg) (percentage) 1.16% 5.160 5.220 - 2075.00% -
447.dealII 1.02% 98.000 99.000 - 25.32% -
447.dealII (avg) 1.02% 98.000 99.000 - 25.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -6.42% 592.000 554.000 - -96.47% -
454.calculix -6.15% 65.000 61.000 - -99.81% -
435.gromacs -5.33% 7619.000 7213.000 - -57.20% -
401.bzip2 -4.12% 2982.000 2859.000 - -83.15% -
445.gobmk -2.15% 5109.000 4999.000 - -59.67% -
471.omnetpp -2.12% 2826.000 2766.000 - -70.15% -
434.zeusmp -2.07% 2753.000 2696.000 - -87.12% -
433.milc -1.86% 1132.000 1111.000 - -91.87% -
473.astar -1.48% 4871.000 4799.000 - -63.04% -
481.wrf -1.35% 6307.000 6222.000 - -71.71% -
462.libquantum -1.25% 160.000 158.000 - -99.07% -
444.namd -1.22% 900.000 889.000 - -94.43% -
437.leslie3d -1.14% 11410.000 11280.000 - -37.58% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (max) -98.52% 2162.000 32.000 - -67.35% -
456.hmmer (max) (percentage) -98.48% 48.110 0.730 - 40.38% -
444.namd (max) -33.33% 6.000 4.000 - -99.54% -
454.calculix -25.00% 4.000 3.000 - -99.54% -
454.calculix (avg) -25.00% 4.000 3.000 - -99.54% -
465.tonto (unexplained diff vs previous) -20.73% 82.000 65.000 - -56.08% -
465.tonto (unexplained diff vs previous) (percentage) -20.31% 0.640 0.510 - -54.87% -
444.namd (max) (percentage) -16.42% 0.670 0.560 - -89.84% -
456.hmmer (unexplained diff vs previous) -15.38% 39.000 33.000 - -66.33% -
456.hmmer (unexplained diff vs previous) (percentage) -14.94% 0.870 0.740 - 42.31% -
462.libquantum -12.50% 8.000 7.000 - -78.12% -
462.libquantum (avg) -12.50% 8.000 7.000 - -78.12% -
437.leslie3d (max) -12.07% 812.000 714.000 - 27.50% -
465.tonto (max) -11.43% 105.000 93.000 - -58.30% -
453.povray (max) (percentage) -11.43% 1.750 1.550 - -40.15% -
462.libquantum (max) (percentage) -11.35% 2.290 2.030 - 2437.50% -
453.povray (max) -11.11% 9.000 8.000 - -95.81% -
437.leslie3d (max) (percentage) -11.10% 7.120 6.330 - 104.19% -
465.tonto (max) (percentage) -10.98% 0.820 0.730 - -57.31% -
450.soplex (max) -10.39% 356.000 319.000 - 362.32% -
401.bzip2 (max) -7.95% 1522.000 1401.000 - 1991.04% -
450.soplex -6.67% 30.000 28.000 - -24.32% -
450.soplex (avg) -6.67% 30.000 28.000 - -24.32% -
434.zeusmp (max) -5.95% 1495.000 1406.000 - 192.31% -
403.gcc (max) (percentage) -5.51% 3.450 3.260 - 452.54% -
473.astar (max) -5.42% 1863.000 1762.000 - 2788.52% -
453.povray (avg) (percentage) -5.37% 6.330 5.990 - 291.50% -
401.bzip2 -5.37% 149.000 141.000 - 213.33% -
401.bzip2 (avg) -5.37% 149.000 141.000 - 213.33% -
433.milc -5.36% 56.000 53.000 - -43.62% -
433.milc (avg) -5.36% 56.000 53.000 - -43.62% -
481.wrf -5.32% 357.000 338.000 - -40.18% -
481.wrf (avg) -5.32% 357.000 338.000 - -40.18% -
471.omnetpp -5.26% 190.000 180.000 - 65.14% -
471.omnetpp (avg) -5.26% 190.000 180.000 - 65.14% -
458.sjeng (max) -5.05% 2970.000 2820.000 - 5775.00% -
416.gamess (max) -5.00% 5100.000 4845.000 - 424.92% -
458.sjeng -4.78% 251.000 239.000 - 563.89% -
458.sjeng (avg) -4.78% 251.000 239.000 - 563.89% -
416.gamess (max) (percentage) -4.77% 34.350 32.710 - 941.72% -
458.sjeng (max) (percentage) -4.75% 38.750 36.910 - 12203.33% -
456.hmmer -4.73% 169.000 161.000 - 187.50% -
456.hmmer (avg) -4.73% 169.000 161.000 - 187.50% -
464.h264ref -4.67% 257.000 245.000 - 315.25% -
464.h264ref (avg) -4.67% 257.000 245.000 - 315.25% -
464.h264ref (max) -4.60% 2260.000 2156.000 - 3554.24% -
410.bwaves -4.58% 262.000 250.000 - -13.49% -
410.bwaves (avg) -4.58% 262.000 250.000 - -13.49% -
435.gromacs -4.52% 354.000 338.000 - 111.25% -
435.gromacs (avg) -4.52% 354.000 338.000 - 111.25% -
410.bwaves (max) -4.42% 2238.000 2139.000 - 722.69% -
437.leslie3d (unexplained diff vs previous) -4.41% 136.000 130.000 - -30.48% -
416.gamess -4.41% 567.000 542.000 - 11.75% -
416.gamess (avg) -4.41% 567.000 542.000 - 11.75% -
458.sjeng (avg) (percentage) -4.27% 3.280 3.140 - 1265.22% -
447.dealII (max) (percentage) -4.27% 65.170 62.390 - 3681.21% -
434.zeusmp -4.26% 141.000 135.000 - -47.06% -
434.zeusmp (avg) -4.26% 141.000 135.000 - -47.06% -
465.tonto -4.23% 189.000 181.000 - 22.30% -
465.tonto (avg) -4.23% 189.000 181.000 - 22.30% -
416.gamess (avg) (percentage) -4.19% 3.820 3.660 - 121.82% -
437.leslie3d -4.18% 383.000 367.000 - 21.93% -
437.leslie3d (avg) -4.18% 383.000 367.000 - 21.93% -
464.h264ref (avg) (percentage) -4.10% 4.150 3.980 - 920.51% -
410.bwaves (avg) (percentage) -4.09% 4.400 4.220 - 115.31% -
465.tonto (avg) (percentage) -4.08% 1.470 1.410 - 23.68% -
481.wrf (avg) (percentage) -4.06% 5.670 5.440 - 111.67% -
464.h264ref (max) (percentage) -4.01% 36.390 34.930 - 8856.41% -
434.zeusmp (max) (percentage) -4.01% 54.340 52.160 - 2167.83% -
450.soplex (max) (percentage) -4.01% 60.140 57.730 - 13020.45% -
470.lbm (max) (percentage) -4.00% 48.210 46.280 - 744.53% -
473.astar (max) (percentage) -4.00% 38.250 36.720 - 7712.77% -
410.bwaves (max) (percentage) -4.00% 37.540 36.040 - 1936.16% -
401.bzip2 (max) (percentage) -3.99% 51.070 49.030 - 12157.50% -
445.gobmk -3.98% 176.000 169.000 - 525.93% -
445.gobmk (avg) -3.98% 176.000 169.000 - 525.93% -
473.astar -3.98% 176.000 169.000 - 231.37% -
473.astar (avg) -3.98% 176.000 169.000 - 231.37% -
456.hmmer (avg) (percentage) -3.71% 3.770 3.630 - 1110.00% -
482.sphinx3 (avg) (percentage) -3.49% 6.300 6.080 - 158.72% -
436.cactusADM (avg) (percentage) -3.45% 6.080 5.870 - 144.58% -
462.libquantum (avg) (percentage) -3.44% 5.230 5.050 - 2557.89% -
437.leslie3d (unexplained diff vs previous) (percentage) -3.36% 1.190 1.150 - 11.65% -
447.dealII (max) -3.26% 1226.000 1186.000 - 690.67% -
459.GemsFDTD (avg) (percentage) -3.21% 4.990 4.830 - 247.48% -
471.omnetpp (avg) (percentage) -3.12% 6.730 6.520 - 452.54% -
437.leslie3d (avg) (percentage) -2.98% 3.360 3.260 - 95.21% -
453.povray -2.94% 34.000 33.000 - -70.80% -
453.povray (avg) -2.94% 34.000 33.000 - -70.80% -
433.milc (avg) (percentage) -2.82% 4.970 4.830 - 600.00% -
483.xalancbmk (max) (percentage) -2.73% 2.200 2.140 - 132.61% -
434.zeusmp (avg) (percentage) -2.72% 5.150 5.010 - 310.66% -
400.perlbench (avg) (percentage) -2.55% 4.700 4.580 - 1074.36% -
436.cactusADM -2.55% 157.000 153.000 - -73.85% -
436.cactusADM (avg) -2.55% 157.000 153.000 - -73.85% -
473.astar (avg) (percentage) -2.48% 3.630 3.540 - 785.00% -
470.lbm (avg) (percentage) -2.23% 6.270 6.130 - 64.34% -
445.gobmk (avg) (percentage) -1.74% 3.450 3.390 - 1440.91% -
482.sphinx3 -1.72% 58.000 57.000 - -93.36% -
482.sphinx3 (avg) -1.72% 58.000 57.000 - -93.36% -
459.GemsFDTD -1.68% 358.000 352.000 - 0.00% -
459.GemsFDTD (avg) -1.68% 358.000 352.000 - 0.00% -
470.lbm (max) -1.05% 1802.000 1783.000 - 99.66% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 21222.22% 0.090 19.190 - 1423.02% -
450.soplex (max) (percentage) 13020.45% 0.440 57.730 - -4.01% -
458.sjeng (max) (percentage) 12203.33% 0.300 36.910 - -4.75% -
401.bzip2 (max) (percentage) 12157.50% 0.400 49.030 - -3.99% -
464.h264ref (max) (percentage) 8856.41% 0.390 34.930 - -4.01% -
473.astar (max) (percentage) 7712.77% 0.470 36.720 - -4.00% -
429.mcf (max) (percentage) 7318.75% 0.320 23.740 - 1754.69% -
458.sjeng (max) 5775.00% 48.000 2820.000 - -5.05% -
447.dealII (max) (percentage) 3681.21% 1.650 62.390 - -4.27% -
464.h264ref (max) 3554.24% 59.000 2156.000 - -4.60% -
473.astar (max) 2788.52% 61.000 1762.000 - -5.42% -
462.libquantum (avg) (percentage) 2557.89% 0.190 5.050 - -3.44% -
462.libquantum (max) (percentage) 2437.50% 0.080 2.030 - -11.35% -
434.zeusmp (max) (percentage) 2167.83% 2.300 52.160 - -4.01% -
429.mcf (unexplained diff vs previous) 2160.00% 10.000 226.000 - 1783.33% -
450.soplex (avg) (percentage) 2075.00% 0.240 5.220 - 1.16% -
401.bzip2 (max) 1991.04% 67.000 1401.000 - -7.95% -
410.bwaves (max) (percentage) 1936.16% 1.770 36.040 - -4.00% -
401.bzip2 (avg) (percentage) 1737.04% 0.270 4.960 - -0.80% -
429.mcf (avg) (percentage) 1614.58% 0.480 8.230 - 9.59% -
462.libquantum (unexplained diff vs previous) (percentage) 1487.50% 0.080 1.270 - 104.84% -
450.soplex (unexplained diff vs previous) (percentage) 1459.09% 0.440 6.860 - 237.93% -
445.gobmk (avg) (percentage) 1440.91% 0.220 3.390 - -1.74% -
445.gobmk (unexplained diff vs previous) (percentage) 1366.67% 0.150 2.200 - 10900.00% -
458.sjeng (avg) (percentage) 1265.22% 0.230 3.140 - -4.27% -
456.hmmer (avg) (percentage) 1110.00% 0.300 3.630 - -3.71% -
400.perlbench (avg) (percentage) 1074.36% 0.390 4.580 - -2.55% -
401.bzip2 (unexplained diff vs previous) (percentage) 948.78% 0.410 4.300 - 357.45% -
416.gamess (max) (percentage) 941.72% 3.140 32.710 - -4.77% -
464.h264ref (avg) (percentage) 920.51% 0.390 3.980 - -4.10% -
473.astar (avg) (percentage) 785.00% 0.400 3.540 - -2.48% -
454.calculix (unexplained diff vs previous) (percentage) 774.67% 0.750 6.560 - 0.00% -
470.lbm (max) (percentage) 744.53% 5.480 46.280 - -4.00% -
410.bwaves (max) 722.69% 260.000 2139.000 - -4.42% -
445.gobmk (max) (percentage) 696.30% 0.270 2.150 - 367.39% -
447.dealII (max) 690.67% 150.000 1186.000 - -3.26% -
429.mcf (max) 654.05% 37.000 279.000 - 2225.00% -
454.calculix (max) (percentage) 632.14% 0.840 6.150 - 158.40% -
400.perlbench (unexplained diff vs previous) (percentage) 603.23% 0.310 2.180 - 282.46% -
433.milc (avg) (percentage) 600.00% 0.690 4.830 - -2.82% -
458.sjeng 563.89% 36.000 239.000 - -4.78% -
458.sjeng (avg) 563.89% 36.000 239.000 - -4.78% -
445.gobmk 525.93% 27.000 169.000 - -3.98% -
445.gobmk (avg) 525.93% 27.000 169.000 - -3.98% -
445.gobmk (unexplained diff vs previous) 511.11% 18.000 110.000 - 10900.00% -
447.dealII (avg) (percentage) 502.30% 0.870 5.240 - 0.00% -
403.gcc (max) (percentage) 452.54% 0.590 3.260 - -5.51% -
471.omnetpp (avg) (percentage) 452.54% 1.180 6.520 - -3.12% -
416.gamess (max) 424.92% 923.000 4845.000 - -5.00% -
435.gromacs (avg) (percentage) 393.68% 0.950 4.690 - 0.86% -
450.soplex (max) 362.32% 69.000 319.000 - -10.39% -
464.h264ref 315.25% 59.000 245.000 - -4.67% -
464.h264ref (avg) 315.25% 59.000 245.000 - -4.67% -
434.zeusmp (avg) (percentage) 310.66% 1.220 5.010 - -2.72% -
453.povray (avg) (percentage) 291.50% 1.530 5.990 - -5.37% -
459.GemsFDTD (avg) (percentage) 247.48% 1.390 4.830 - -3.21% -
473.astar 231.37% 51.000 169.000 - -3.98% -
473.astar (avg) 231.37% 51.000 169.000 - -3.98% -
435.gromacs (unexplained diff vs previous) (percentage) 225.43% 1.730 5.630 - 511.96% -
445.gobmk (max) 224.24% 33.000 107.000 - 365.22% -
471.omnetpp (unexplained diff vs previous) (percentage) 223.88% 0.670 2.170 - 578.12% -
473.astar (unexplained diff vs previous) (percentage) 219.15% 0.470 1.500 - 1150.00% -
401.bzip2 213.33% 45.000 141.000 - -5.37% -
401.bzip2 (avg) 213.33% 45.000 141.000 - -5.37% -
454.calculix (avg) (percentage) 209.85% 2.030 6.290 - -0.16% -
435.gromacs (max) (percentage) 202.84% 1.760 5.330 - 363.48% -
434.zeusmp (max) 192.31% 481.000 1406.000 - -5.95% -
456.hmmer 187.50% 56.000 161.000 - -4.73% -
456.hmmer (avg) 187.50% 56.000 161.000 - -4.73% -
400.perlbench (max) (percentage) 177.50% 0.800 2.220 - 212.68% -
433.milc (unexplained diff vs previous) (percentage) 170.00% 0.700 1.890 - 2000.00% -
433.milc (max) (percentage) 161.97% 0.710 1.860 - 250.94% -
444.namd (avg) (percentage) 159.62% 2.600 6.750 - 0.00% -
482.sphinx3 (avg) (percentage) 158.72% 2.350 6.080 - -3.49% -
403.gcc (avg) (percentage) 151.16% 0.430 1.080 - 0.00% -
436.cactusADM (avg) (percentage) 144.58% 2.400 5.870 - -3.45% -
483.xalancbmk (max) (percentage) 132.61% 0.920 2.140 - -2.73% -
416.gamess (avg) (percentage) 121.82% 1.650 3.660 - -4.19% -
410.bwaves (avg) (percentage) 115.31% 1.960 4.220 - -4.09% -
481.wrf (avg) (percentage) 111.67% 2.570 5.440 - -4.06% -
435.gromacs 111.25% 160.000 338.000 - -4.52% -
435.gromacs (avg) 111.25% 160.000 338.000 - -4.52% -
437.leslie3d (max) (percentage) 104.19% 3.100 6.330 - -11.10% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
470.lbm (max) 99.66% 893.000 1783.000 - -1.05% -
437.leslie3d (avg) (percentage) 95.21% 1.670 3.260 - -2.98% -
401.bzip2 (unexplained diff vs previous) 78.26% 69.000 123.000 - 339.29% -
429.mcf 71.43% 56.000 96.000 - 35.21% -
429.mcf (avg) 71.43% 56.000 96.000 - 35.21% -
464.h264ref (unexplained diff vs previous) (percentage) 71.05% 0.380 0.650 - 109.68% -
400.perlbench 69.77% 43.000 73.000 - 0.00% -
400.perlbench (avg) 69.77% 43.000 73.000 - 0.00% -
471.omnetpp 65.14% 109.000 180.000 - -5.26% -
471.omnetpp (avg) 65.14% 109.000 180.000 - -5.26% -
470.lbm (avg) (percentage) 64.34% 3.730 6.130 - -2.23% -
456.hmmer (unexplained diff vs previous) (percentage) 42.31% 0.520 0.740 - -14.94% -
456.hmmer (max) (percentage) 40.38% 0.520 0.730 - -98.48% -
435.gromacs (unexplained diff vs previous) 39.04% 292.000 406.000 - 480.00% -
435.gromacs (max) 29.73% 296.000 384.000 - 341.38% -
437.leslie3d (max) 27.50% 560.000 714.000 - -12.07% -
447.dealII 25.32% 79.000 99.000 - 1.02% -
447.dealII (avg) 25.32% 79.000 99.000 - 1.02% -
465.tonto (avg) (percentage) 23.68% 1.140 1.410 - -4.08% -
465.tonto 22.30% 148.000 181.000 - -4.23% -
465.tonto (avg) 22.30% 148.000 181.000 - -4.23% -
437.leslie3d 21.93% 301.000 367.000 - -4.18% -
437.leslie3d (avg) 21.93% 301.000 367.000 - -4.18% -
473.astar (unexplained diff vs previous) 18.03% 61.000 72.000 - 1100.00% -
471.omnetpp (max) (percentage) 13.98% 1.860 2.120 - 341.67% -
416.gamess 11.75% 485.000 542.000 - -4.41% -
416.gamess (avg) 11.75% 485.000 542.000 - -4.41% -
437.leslie3d (unexplained diff vs previous) (percentage) 11.65% 1.030 1.150 - -3.36% -
458.sjeng (unexplained diff vs previous) (percentage) 10.00% 0.300 0.330 - 106.25% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -
nb_total_tests -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 61.000 - -6.15% -
403.gcc -99.33% 8890.000 60.000 - 7.14% -
462.libquantum -99.07% 17005.000 158.000 - -1.25% -
482.sphinx3 -97.43% 36586.000 939.000 - 1.51% -
450.soplex -96.47% 15709.000 554.000 - -6.42% -
444.namd -94.43% 15957.000 889.000 - -1.22% -
453.povray -92.54% 7395.000 552.000 - 0.00% -
433.milc -91.87% 13668.000 1111.000 - -1.86% -
429.mcf -89.95% 11727.000 1178.000 - 23.74% -
436.cactusADM -89.28% 24396.000 2616.000 - 1.20% -
434.zeusmp -87.12% 20932.000 2696.000 - -2.07% -
400.perlbench -85.65% 11215.000 1609.000 - 2.22% -
401.bzip2 -83.15% 16971.000 2859.000 - -4.12% -
447.dealII -79.10% 9101.000 1902.000 - 1.06% -
456.hmmer -76.51% 18995.000 4461.000 - -0.73% -
470.lbm -76.38% 16312.000 3853.000 - 3.05% -
481.wrf -71.71% 21991.000 6222.000 - -1.35% -
459.GemsFDTD -71.21% 25364.000 7302.000 - 1.66% -
471.omnetpp -70.15% 9265.000 2766.000 - -2.12% -
473.astar -63.04% 12983.000 4799.000 - -1.48% -
410.bwaves -59.74% 14745.000 5937.000 - -0.42% -
445.gobmk -59.67% 12396.000 4999.000 - -2.15% -
464.h264ref -59.41% 15208.000 6173.000 - -0.64% -
435.gromacs -57.20% 16853.000 7213.000 - -5.33% -
458.sjeng -52.30% 16018.000 7641.000 - -0.33% -
416.gamess -49.63% 29409.000 14813.000 - -0.24% -
437.leslie3d -37.58% 18070.000 11280.000 - -1.14% -
465.tonto -1.59% 13044.000 12837.000 - -0.50% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.54% 879.000 4.000 - -33.33% -
454.calculix -99.54% 659.000 3.000 - -25.00% -
454.calculix (avg) -99.54% 659.000 3.000 - -25.00% -
454.calculix (max) -98.90% 272.000 3.000 - 200.00% -
482.sphinx3 (max) -98.78% 1152.000 14.000 - 133.33% -
482.sphinx3 (unexplained diff vs previous) -98.75% 1118.000 14.000 - 100.00% -
454.calculix (unexplained diff vs previous) -98.36% 244.000 4.000 - 0.00% -
403.gcc (max) -98.08% 52.000 1.000 - 0.00% -
436.cactusADM (max) -97.48% 1231.000 31.000 - 1450.00% -
436.cactusADM (unexplained diff vs previous) -97.36% 1173.000 31.000 - 1450.00% -
416.gamess (unexplained diff vs previous) -95.98% 896.000 36.000 - 24.14% -
453.povray (max) -95.81% 191.000 8.000 - -11.11% -
482.sphinx3 -93.36% 859.000 57.000 - -1.72% -
482.sphinx3 (avg) -93.36% 859.000 57.000 - -1.72% -
416.gamess (unexplained diff vs previous) (percentage) -92.13% 3.050 0.240 - 20.00% -
481.wrf (max) -90.92% 914.000 83.000 - 107.50% -
481.wrf (unexplained diff vs previous) -90.49% 894.000 85.000 - 117.95% -
410.bwaves (unexplained diff vs previous) -90.27% 257.000 25.000 - 177.78% -
444.namd (max) (percentage) -89.84% 5.510 0.560 - -16.42% -
434.zeusmp (unexplained diff vs previous) -87.87% 470.000 57.000 - 50.00% -
470.lbm (unexplained diff vs previous) -86.13% 822.000 114.000 - 5600.00% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 - 100.00% -
444.namd -85.51% 414.000 60.000 - 0.00% -
444.namd (avg) -85.51% 414.000 60.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -79.62% 584.000 119.000 - 1387.50% -
433.milc (max) -79.38% 97.000 20.000 - 300.00% -
459.GemsFDTD (max) -79.07% 578.000 121.000 - 1628.57% -
433.milc (unexplained diff vs previous) -78.12% 96.000 21.000 - 2000.00% -
462.libquantum -78.12% 32.000 7.000 - -12.50% -
462.libquantum (avg) -78.12% 32.000 7.000 - -12.50% -
462.libquantum (max) -76.92% 13.000 3.000 - 0.00% -
436.cactusADM (max) (percentage) -76.24% 5.050 1.200 - 990.91% -
410.bwaves (unexplained diff vs previous) (percentage) -75.86% 1.740 0.420 - 180.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -75.26% 4.810 1.190 - 1387.50% -
436.cactusADM -73.85% 585.000 153.000 - -2.55% -
436.cactusADM (avg) -73.85% 585.000 153.000 - -2.55% -
453.povray -70.80% 113.000 33.000 - -2.94% -
453.povray (avg) -70.80% 113.000 33.000 - -2.94% -
481.wrf (max) (percentage) -67.55% 4.160 1.350 - 107.69% -
456.hmmer (max) -67.35% 98.000 32.000 - -98.52% -
481.wrf (unexplained diff vs previous) (percentage) -66.34% 4.070 1.370 - 120.97% -
456.hmmer (unexplained diff vs previous) -66.33% 98.000 33.000 - -15.38% -
471.omnetpp (max) -66.28% 172.000 58.000 - 346.15% -
470.lbm -61.18% 608.000 236.000 - 0.85% -
470.lbm (avg) -61.18% 608.000 236.000 - 0.85% -
400.perlbench (max) -60.67% 89.000 35.000 - 218.18% -
465.tonto (max) -58.30% 223.000 93.000 - -11.43% -
465.tonto (max) (percentage) -57.31% 1.710 0.730 - -10.98% -
465.tonto (unexplained diff vs previous) -56.08% 148.000 65.000 - -20.73% -
465.tonto (unexplained diff vs previous) (percentage) -54.87% 1.130 0.510 - -20.31% -
482.sphinx3 (max) (percentage) -52.06% 3.150 1.510 - 101.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -51.31% 3.060 1.490 - 96.05% -
458.sjeng (unexplained diff vs previous) -47.92% 48.000 25.000 - 108.33% -
434.zeusmp -47.06% 255.000 135.000 - -4.26% -
434.zeusmp (avg) -47.06% 255.000 135.000 - -4.26% -
450.soplex (unexplained diff vs previous) -44.93% 69.000 38.000 - 216.67% -
433.milc -43.62% 94.000 53.000 - -5.36% -
433.milc (avg) -43.62% 94.000 53.000 - -5.36% -
470.lbm (unexplained diff vs previous) (percentage) -41.27% 5.040 2.960 - 5820.00% -
481.wrf -40.18% 565.000 338.000 - -5.32% -
481.wrf (avg) -40.18% 565.000 338.000 - -5.32% -
453.povray (max) (percentage) -40.15% 2.590 1.550 - -11.43% -
464.h264ref (unexplained diff vs previous) -31.03% 58.000 40.000 - 110.53% -
437.leslie3d (unexplained diff vs previous) -30.48% 187.000 130.000 - -4.41% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -29.13% 2.300 1.630 - 1381.82% -
459.GemsFDTD (max) (percentage) -27.19% 2.280 1.660 - 1409.09% -
450.soplex -24.32% 37.000 28.000 - -6.67% -
450.soplex (avg) -24.32% 37.000 28.000 - -6.67% -
410.bwaves -13.49% 289.000 250.000 - -4.58% -
410.bwaves (avg) -13.49% 289.000 250.000 - -4.58% -
434.zeusmp (unexplained diff vs previous) (percentage) -6.22% 2.250 2.110 - 52.90% -
471.omnetpp (unexplained diff vs previous) -3.23% 62.000 60.000 - 566.67% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1609.000 2.22%
401.bzip2 2859.000 -4.12%
403.gcc 60.000 7.14%
410.bwaves 5937.000 -
416.gamess 14813.000 -
429.mcf 1178.000 23.74%
433.milc 1111.000 -1.86%
434.zeusmp 2696.000 -2.07%
435.gromacs 7213.000 -5.33%
436.cactusADM 2616.000 1.20%
437.leslie3d 11280.000 -1.14%
444.namd 889.000 -1.22%
445.gobmk 4999.000 -2.15%
447.dealII 1902.000 1.06%
450.soplex 554.000 -6.42%
453.povray 552.000 -
454.calculix 61.000 -6.15%
456.hmmer 4461.000 -
458.sjeng 7641.000 -
459.GemsFDTD 7302.000 1.66%
462.libquantum 158.000 -1.25%
464.h264ref 6173.000 -
465.tonto 12837.000 -
470.lbm 3853.000 3.05%
471.omnetpp 2766.000 -2.12%
473.astar 4799.000 -1.48%
481.wrf 6222.000 -1.35%
482.sphinx3 939.000 1.51%
Geometric Mean 2171.199 -
Code Size (bytes)
Name Current %
400.perlbench 563487.000 -
401.bzip2 33660.000 -
403.gcc 1589890.000 -
410.bwaves 14722.000 -
416.gamess 4554464.000 -
429.mcf 7717.000 -
433.milc 47493.000 -
434.zeusmp 141060.000 -
435.gromacs 393982.000 -
436.cactusADM 256968.000 -
437.leslie3d 48001.000 -
444.namd 162770.000 -
445.gobmk 1088216.000 -
447.dealII 191612.000 -
450.soplex 135592.000 -
453.povray 489013.000 -
454.calculix 682304.000 -
456.hmmer 74969.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195766.000 -
462.libquantum 13066.000 -
464.h264ref 301358.000 -
465.tonto 1436053.000 -
470.lbm 10845.000 -
471.omnetpp 295649.000 -
473.astar 15549.000 -
481.wrf 1539733.000 -
482.sphinx3 80058.000 -
Geometric Mean 157309.933 -
sample variability
Name Current %
400.perlbench 73.000 -
400.perlbench (avg) 73.000 -
400.perlbench (avg) (percentage) 4.580 -2.55%
400.perlbench (max) 35.000 218.18%
400.perlbench (max) (percentage) 2.220 212.68%
400.perlbench (unexplained diff vs previous) 35.000 288.89%
400.perlbench (unexplained diff vs previous) (percentage) 2.180 282.46%
401.bzip2 141.000 -5.37%
401.bzip2 (avg) 141.000 -5.37%
401.bzip2 (avg) (percentage) 4.960 -
401.bzip2 (max) 1401.000 -7.95%
401.bzip2 (max) (percentage) 49.030 -3.99%
401.bzip2 (unexplained diff vs previous) 123.000 339.29%
401.bzip2 (unexplained diff vs previous) (percentage) 4.300 357.45%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.080 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.260 -5.51%
410.bwaves 250.000 -4.58%
410.bwaves (avg) 250.000 -4.58%
410.bwaves (avg) (percentage) 4.220 -4.09%
410.bwaves (max) 2139.000 -4.42%
410.bwaves (max) (percentage) 36.040 -4.00%
410.bwaves (unexplained diff vs previous) 25.000 177.78%
410.bwaves (unexplained diff vs previous) (percentage) 0.420 180.00%
416.gamess 542.000 -4.41%
416.gamess (avg) 542.000 -4.41%
416.gamess (avg) (percentage) 3.660 -4.19%
416.gamess (max) 4845.000 -5.00%
416.gamess (max) (percentage) 32.710 -4.77%
416.gamess (unexplained diff vs previous) 36.000 24.14%
416.gamess (unexplained diff vs previous) (percentage) 0.240 20.00%
429.mcf 96.000 35.21%
429.mcf (avg) 96.000 35.21%
429.mcf (avg) (percentage) 8.230 9.59%
429.mcf (max) 279.000 2225.00%
429.mcf (max) (percentage) 23.740 1754.69%
429.mcf (unexplained diff vs previous) 226.000 1783.33%
429.mcf (unexplained diff vs previous) (percentage) 19.190 1423.02%
433.milc 53.000 -5.36%
433.milc (avg) 53.000 -5.36%
433.milc (avg) (percentage) 4.830 -2.82%
433.milc (max) 20.000 300.00%
433.milc (max) (percentage) 1.860 250.94%
433.milc (unexplained diff vs previous) 21.000 2000.00%
433.milc (unexplained diff vs previous) (percentage) 1.890 2000.00%
434.zeusmp 135.000 -4.26%
434.zeusmp (avg) 135.000 -4.26%
434.zeusmp (avg) (percentage) 5.010 -2.72%
434.zeusmp (max) 1406.000 -5.95%
434.zeusmp (max) (percentage) 52.160 -4.01%
434.zeusmp (unexplained diff vs previous) 57.000 50.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.110 52.90%
435.gromacs 338.000 -4.52%
435.gromacs (avg) 338.000 -4.52%
435.gromacs (avg) (percentage) 4.690 -
435.gromacs (max) 384.000 341.38%
435.gromacs (max) (percentage) 5.330 363.48%
435.gromacs (unexplained diff vs previous) 406.000 480.00%
435.gromacs (unexplained diff vs previous) (percentage) 5.630 511.96%
436.cactusADM 153.000 -2.55%
436.cactusADM (avg) 153.000 -2.55%
436.cactusADM (avg) (percentage) 5.870 -3.45%
436.cactusADM (max) 31.000 1450.00%
436.cactusADM (max) (percentage) 1.200 990.91%
436.cactusADM (unexplained diff vs previous) 31.000 1450.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.190 1387.50%
437.leslie3d 367.000 -4.18%
437.leslie3d (avg) 367.000 -4.18%
437.leslie3d (avg) (percentage) 3.260 -2.98%
437.leslie3d (max) 714.000 -12.07%
437.leslie3d (max) (percentage) 6.330 -11.10%
437.leslie3d (unexplained diff vs previous) 130.000 -4.41%
437.leslie3d (unexplained diff vs previous) (percentage) 1.150 -3.36%
444.namd 60.000 -
444.namd (avg) 60.000 -
444.namd (avg) (percentage) 6.750 -
444.namd (max) 4.000 -33.33%
444.namd (max) (percentage) 0.560 -16.42%
445.gobmk 169.000 -3.98%
445.gobmk (avg) 169.000 -3.98%
445.gobmk (avg) (percentage) 3.390 -1.74%
445.gobmk (max) 107.000 365.22%
445.gobmk (max) (percentage) 2.150 367.39%
445.gobmk (unexplained diff vs previous) 110.000 10900.00%
445.gobmk (unexplained diff vs previous) (percentage) 2.200 10900.00%
447.dealII 99.000 1.02%
447.dealII (avg) 99.000 1.02%
447.dealII (avg) (percentage) 5.240 -
447.dealII (max) 1186.000 -3.26%
447.dealII (max) (percentage) 62.390 -4.27%
450.soplex 28.000 -6.67%
450.soplex (avg) 28.000 -6.67%
450.soplex (avg) (percentage) 5.220 1.16%
450.soplex (max) 319.000 -10.39%
450.soplex (max) (percentage) 57.730 -4.01%
450.soplex (unexplained diff vs previous) 38.000 216.67%
450.soplex (unexplained diff vs previous) (percentage) 6.860 237.93%
453.povray 33.000 -2.94%
453.povray (avg) 33.000 -2.94%
453.povray (avg) (percentage) 5.990 -5.37%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.550 -11.43%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix 3.000 -25.00%
454.calculix (avg) 3.000 -25.00%
454.calculix (avg) (percentage) 6.290 -
454.calculix (max) 3.000 200.00%
454.calculix (max) (percentage) 6.150 158.40%
454.calculix (unexplained diff vs previous) 4.000 -
454.calculix (unexplained diff vs previous) (percentage) 6.560 -
456.hmmer 161.000 -4.73%
456.hmmer (avg) 161.000 -4.73%
456.hmmer (avg) (percentage) 3.630 -3.71%
456.hmmer (max) 32.000 -98.52%
456.hmmer (max) (percentage) 0.730 -98.48%
456.hmmer (unexplained diff vs previous) 33.000 -15.38%
456.hmmer (unexplained diff vs previous) (percentage) 0.740 -14.94%
458.sjeng 239.000 -4.78%
458.sjeng (avg) 239.000 -4.78%
458.sjeng (avg) (percentage) 3.140 -4.27%
458.sjeng (max) 2820.000 -5.05%
458.sjeng (max) (percentage) 36.910 -4.75%
458.sjeng (unexplained diff vs previous) 25.000 108.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.330 106.25%
459.GemsFDTD 352.000 -1.68%
459.GemsFDTD (avg) 352.000 -1.68%
459.GemsFDTD (avg) (percentage) 4.830 -3.21%
459.GemsFDTD (max) 121.000 1628.57%
459.GemsFDTD (max) (percentage) 1.660 1409.09%
459.GemsFDTD (unexplained diff vs previous) 119.000 1387.50%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.630 1381.82%
462.libquantum 7.000 -12.50%
462.libquantum (avg) 7.000 -12.50%
462.libquantum (avg) (percentage) 5.050 -3.44%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.030 -11.35%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.270 104.84%
464.h264ref 245.000 -4.67%
464.h264ref (avg) 245.000 -4.67%
464.h264ref (avg) (percentage) 3.980 -4.10%
464.h264ref (max) 2156.000 -4.60%
464.h264ref (max) (percentage) 34.930 -4.01%
464.h264ref (unexplained diff vs previous) 40.000 110.53%
464.h264ref (unexplained diff vs previous) (percentage) 0.650 109.68%
465.tonto 181.000 -4.23%
465.tonto (avg) 181.000 -4.23%
465.tonto (avg) (percentage) 1.410 -4.08%
465.tonto (max) 93.000 -11.43%
465.tonto (max) (percentage) 0.730 -10.98%
465.tonto (unexplained diff vs previous) 65.000 -20.73%
465.tonto (unexplained diff vs previous) (percentage) 0.510 -20.31%
470.lbm 236.000 -
470.lbm (avg) 236.000 -
470.lbm (avg) (percentage) 6.130 -2.23%
470.lbm (max) 1783.000 -1.05%
470.lbm (max) (percentage) 46.280 -4.00%
470.lbm (unexplained diff vs previous) 114.000 5600.00%
470.lbm (unexplained diff vs previous) (percentage) 2.960 5820.00%
471.omnetpp 180.000 -5.26%
471.omnetpp (avg) 180.000 -5.26%
471.omnetpp (avg) (percentage) 6.520 -3.12%
471.omnetpp (max) 58.000 346.15%
471.omnetpp (max) (percentage) 2.120 341.67%
471.omnetpp (unexplained diff vs previous) 60.000 566.67%
471.omnetpp (unexplained diff vs previous) (percentage) 2.170 578.12%
473.astar 169.000 -3.98%
473.astar (avg) 169.000 -3.98%
473.astar (avg) (percentage) 3.540 -2.48%
473.astar (max) 1762.000 -5.42%
473.astar (max) (percentage) 36.720 -4.00%
473.astar (unexplained diff vs previous) 72.000 1100.00%
473.astar (unexplained diff vs previous) (percentage) 1.500 1150.00%
481.wrf 338.000 -5.32%
481.wrf (avg) 338.000 -5.32%
481.wrf (avg) (percentage) 5.440 -4.06%
481.wrf (max) 83.000 107.50%
481.wrf (max) (percentage) 1.350 107.69%
481.wrf (unexplained diff vs previous) 85.000 117.95%
481.wrf (unexplained diff vs previous) (percentage) 1.370 120.97%
482.sphinx3 57.000 -1.72%
482.sphinx3 (avg) 57.000 -1.72%
482.sphinx3 (avg) (percentage) 6.080 -3.49%
482.sphinx3 (max) 14.000 133.33%
482.sphinx3 (max) (percentage) 1.510 101.33%
482.sphinx3 (unexplained diff vs previous) 14.000 100.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.490 96.05%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 2.140 -2.73%
Geometric Mean 17.844 42.05%