Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=26c7a0ea380bedb86ff3b5a9ed252d8d2557a0c5 (+ 49 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/841008d3966c0fe7a80ec10703a50fbdab7620ac (+ 89 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=dae3cf4134d476a4b4ef86fd7012231d6436c15e (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/110/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0110 (3-changed-components) 2023-11-14T23:27:43 0:00:00
Previous 0109 (3-changed-components) 2023-11-11T22:00:01 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 39 75
Performance Improvements 132 157
Added Tests 2 2
Unchanged Tests 1063 1002
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 10.53% 57.000 63.000 - -99.29% -
473.astar 2.08% 4861.000 4962.000 - -61.78% -
400.perlbench 1.95% 1641.000 1673.000 - -85.08% -
429.mcf 1.29% 929.000 941.000 - -91.98% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) 850.00% 2.000 19.000 - 5.56% -
445.gobmk (unexplained diff vs previous) (percentage) 825.00% 0.040 0.370 - 146.67% -
473.astar (unexplained diff vs previous) 818.18% 11.000 101.000 - 65.57% -
473.astar (unexplained diff vs previous) (percentage) 786.96% 0.230 2.040 - 334.04% -
403.gcc (max) 500.00% 1.000 6.000 - -88.46% -
401.bzip2 (unexplained diff vs previous) (percentage) 307.69% 0.130 0.530 - 29.27% -
401.bzip2 (unexplained diff vs previous) 300.00% 4.000 16.000 - -76.81% -
481.wrf (unexplained diff vs previous) (percentage) 239.13% 0.230 0.780 - -80.84% -
416.gamess (unexplained diff vs previous) (percentage) 233.33% 0.030 0.100 - -96.72% -
481.wrf (unexplained diff vs previous) 233.33% 15.000 50.000 - -94.41% -
435.gromacs (unexplained diff vs previous) 220.00% 5.000 16.000 - -94.52% -
403.gcc (max) (percentage) 217.17% 3.320 10.530 - 1684.75% -
416.gamess (unexplained diff vs previous) 200.00% 5.000 15.000 - -98.33% -
435.gromacs (unexplained diff vs previous) (percentage) 200.00% 0.070 0.210 - -87.86% -
456.hmmer (unexplained diff vs previous) (percentage) 175.00% 0.040 0.110 - -78.85% -
456.hmmer (unexplained diff vs previous) 150.00% 2.000 5.000 - -94.90% -
434.zeusmp (unexplained diff vs previous) (percentage) 128.57% 0.140 0.320 - -85.78% -
434.zeusmp (unexplained diff vs previous) 125.00% 4.000 9.000 - -98.09% -
470.lbm (unexplained diff vs previous) (percentage) 84.62% 0.130 0.240 - -95.24% -
470.lbm (unexplained diff vs previous) 80.00% 5.000 9.000 - -98.91% -
473.astar (max) 58.46% 65.000 103.000 - 68.85% -
473.astar (max) (percentage) 55.22% 1.340 2.080 - 342.55% -
444.namd (unexplained diff vs previous) (percentage) 36.36% 0.330 0.450 - -91.40% -
436.cactusADM (unexplained diff vs previous) (percentage) 34.78% 0.230 0.310 - -93.56% -
436.cactusADM (max) 33.33% 6.000 8.000 - -99.35% -
436.cactusADM (unexplained diff vs previous) 33.33% 6.000 8.000 - -99.32% -
444.namd (unexplained diff vs previous) 33.33% 3.000 4.000 - -99.52% -
403.gcc (avg) (percentage) 29.65% 1.720 2.230 - 418.60% -
436.cactusADM (max) (percentage) 24.00% 0.250 0.310 - -93.86% -
464.h264ref (unexplained diff vs previous) 5.56% 18.000 19.000 - -67.24% -
464.h264ref (unexplained diff vs previous) (percentage) 3.45% 0.290 0.300 - -21.05% -
454.calculix (unexplained diff vs previous) (percentage) 2.92% 3.080 3.170 - 322.67% -
473.astar 2.17% 92.000 94.000 - 84.31% -
473.astar (avg) 2.17% 92.000 94.000 - 84.31% -
465.tonto (avg) (percentage) 1.02% 0.980 0.990 - -13.16% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -4.29% 12097.000 11578.000 - -35.93% -
454.calculix -3.08% 65.000 63.000 - -99.81% -
450.soplex -1.17% 596.000 589.000 - -96.25% -
465.tonto -1.08% 13164.000 13022.000 - -0.17% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -80.19% 1.060 0.210 - -68.66% -
471.omnetpp (unexplained diff vs previous) -80.00% 30.000 6.000 - -90.32% -
453.povray (unexplained diff vs previous) (percentage) -75.00% 1.440 0.360 - -84.28% -
453.povray (unexplained diff vs previous) -75.00% 8.000 2.000 - -98.82% -
458.sjeng (unexplained diff vs previous) (percentage) -64.13% 0.920 0.330 - 10.00% -
458.sjeng (unexplained diff vs previous) -63.89% 72.000 26.000 - -45.83% -
447.dealII (max) -55.17% 29.000 13.000 - -91.33% -
447.dealII (max) (percentage) -51.63% 1.530 0.740 - -55.15% -
410.bwaves (unexplained diff vs previous) (percentage) -50.82% 0.610 0.300 - -82.76% -
410.bwaves (unexplained diff vs previous) -50.00% 36.000 18.000 - -93.00% -
433.milc (unexplained diff vs previous) -50.00% 2.000 1.000 - -98.96% -
433.milc (unexplained diff vs previous) (percentage) -50.00% 0.180 0.090 - -87.14% -
450.soplex (unexplained diff vs previous) -36.36% 11.000 7.000 - -89.86% -
450.soplex (unexplained diff vs previous) (percentage) -35.68% 1.850 1.190 - 170.45% -
433.milc (max) -33.33% 3.000 2.000 - -97.94% -
450.soplex (max) (percentage) -31.31% 1.980 1.360 - 209.09% -
454.calculix (max) (percentage) -29.96% 4.540 3.180 - 278.57% -
450.soplex (max) -27.27% 11.000 8.000 - -88.41% -
429.mcf (unexplained diff vs previous) (percentage) -25.58% 1.720 1.280 - 1322.22% -
429.mcf (unexplained diff vs previous) -25.00% 16.000 12.000 - 20.00% -
453.povray (max) -25.00% 8.000 6.000 - -96.86% -
462.libquantum -25.00% 4.000 3.000 - -90.62% -
462.libquantum (avg) -25.00% 4.000 3.000 - -90.62% -
437.leslie3d (unexplained diff vs previous) -24.45% 687.000 519.000 - 177.54% -
459.GemsFDTD (unexplained diff vs previous) -23.68% 38.000 29.000 - -95.03% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -22.64% 0.530 0.410 - -82.17% -
437.leslie3d (unexplained diff vs previous) (percentage) -21.13% 5.680 4.480 - 334.95% -
447.dealII (unexplained diff vs previous) -20.00% 15.000 12.000 - -82.35% -
447.dealII (unexplained diff vs previous) (percentage) -18.99% 0.790 0.640 - -14.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -16.92% 0.650 0.540 - -82.35% -
458.sjeng (max) -16.90% 71.000 59.000 - 22.92% -
471.omnetpp (max) (percentage) -16.67% 1.080 0.900 - -51.61% -
444.namd (max) -16.67% 6.000 5.000 - -99.43% -
471.omnetpp (max) -16.67% 30.000 25.000 - -85.47% -
482.sphinx3 (max) -16.67% 6.000 5.000 - -99.57% -
482.sphinx3 (unexplained diff vs previous) -16.67% 6.000 5.000 - -99.55% -
458.sjeng (max) (percentage) -16.48% 0.910 0.760 - 153.33% -
453.povray (max) (percentage) -16.44% 1.460 1.220 - -52.90% -
465.tonto (unexplained diff vs previous) -13.41% 164.000 142.000 - -4.05% -
465.tonto (unexplained diff vs previous) (percentage) -12.80% 1.250 1.090 - -3.54% -
437.leslie3d (max) -10.50% 1581.000 1415.000 - 152.68% -
400.perlbench (unexplained diff vs previous) (percentage) -10.33% 2.130 1.910 - 516.13% -
434.zeusmp (max) -10.00% 10.000 9.000 - -98.13% -
453.povray -9.09% 11.000 10.000 - -91.15% -
453.povray (avg) -9.09% 11.000 10.000 - -91.15% -
459.GemsFDTD (max) -8.62% 58.000 53.000 - -90.83% -
400.perlbench (unexplained diff vs previous) -8.57% 35.000 32.000 - -8.57% -
459.GemsFDTD (max) (percentage) -8.54% 0.820 0.750 - -67.11% -
456.hmmer (max) -8.33% 12.000 11.000 - -88.78% -
410.bwaves (max) (percentage) -8.00% 0.750 0.690 - -61.02% -
464.h264ref (max) -8.00% 25.000 23.000 - -61.02% -
470.lbm (max) -8.00% 25.000 23.000 - -97.42% -
464.h264ref (max) (percentage) -7.32% 0.410 0.380 - -2.56% -
470.lbm (max) (percentage) -7.25% 0.690 0.640 - -88.32% -
433.milc (max) (percentage) -6.90% 0.290 0.270 - -61.97% -
410.bwaves (max) -6.82% 44.000 41.000 - -84.23% -
400.perlbench (max) (percentage) -6.70% 2.090 1.950 - 143.75% -
429.mcf (max) -6.67% 15.000 14.000 - -62.16% -
429.mcf (max) (percentage) -6.51% 1.690 1.580 - 393.75% -
437.leslie3d (max) (percentage) -6.43% 13.070 12.230 - 294.52% -
445.gobmk (max) (percentage) -6.25% 1.600 1.500 - 455.56% -
445.gobmk (max) -6.17% 81.000 76.000 - 130.30% -
482.sphinx3 (max) (percentage) -6.06% 0.660 0.620 - -80.32% -
400.perlbench (max) -5.88% 34.000 32.000 - -64.04% -
434.zeusmp (max) (percentage) -5.56% 0.360 0.340 - -85.22% -
462.libquantum (max) (percentage) -5.48% 0.730 0.690 - 762.50% -
465.tonto (max) -4.76% 168.000 160.000 - -28.25% -
444.namd (max) (percentage) -4.41% 0.680 0.650 - -88.20% -
437.leslie3d -4.26% 516.000 494.000 - 64.12% -
437.leslie3d (avg) -4.26% 516.000 494.000 - 64.12% -
401.bzip2 (max) -4.17% 24.000 23.000 - -65.67% -
465.tonto (max) (percentage) -3.91% 1.280 1.230 - -28.07% -
456.hmmer (max) (percentage) -3.70% 0.270 0.260 - -50.00% -
481.wrf -3.40% 147.000 142.000 - -74.87% -
481.wrf (avg) -3.40% 147.000 142.000 - -74.87% -
416.gamess -3.11% 161.000 156.000 - -67.84% -
416.gamess (avg) -3.11% 161.000 156.000 - -67.84% -
481.wrf (max) -2.97% 101.000 98.000 - -89.28% -
435.gromacs -2.89% 173.000 168.000 - 5.00% -
435.gromacs (avg) -2.89% 173.000 168.000 - 5.00% -
416.gamess (avg) (percentage) -2.75% 1.090 1.060 - -35.76% -
435.gromacs (avg) (percentage) -2.63% 2.280 2.220 - 133.68% -
401.bzip2 -2.60% 77.000 75.000 - 66.67% -
401.bzip2 (avg) -2.60% 77.000 75.000 - 66.67% -
481.wrf (max) (percentage) -2.55% 1.570 1.530 - -63.22% -
464.h264ref -2.50% 80.000 78.000 - 32.20% -
464.h264ref (avg) -2.50% 80.000 78.000 - 32.20% -
453.povray (avg) (percentage) -2.49% 2.010 1.960 - 28.10% -
447.dealII -2.44% 41.000 40.000 - -49.37% -
447.dealII (avg) -2.44% 41.000 40.000 - -49.37% -
458.sjeng -2.44% 82.000 80.000 - 122.22% -
458.sjeng (avg) -2.44% 82.000 80.000 - 122.22% -
401.bzip2 (max) (percentage) -2.44% 0.820 0.800 - 100.00% -
464.h264ref (avg) (percentage) -2.33% 1.290 1.260 - 223.08% -
436.cactusADM -2.33% 43.000 42.000 - -92.82% -
436.cactusADM (avg) -2.33% 43.000 42.000 - -92.82% -
456.hmmer -2.27% 44.000 43.000 - -23.21% -
456.hmmer (avg) -2.27% 44.000 43.000 - -23.21% -
445.gobmk (avg) (percentage) -2.24% 1.340 1.310 - 495.45% -
459.GemsFDTD -2.24% 134.000 131.000 - -62.78% -
459.GemsFDTD (avg) -2.24% 134.000 131.000 - -62.78% -
481.wrf (avg) (percentage) -2.19% 2.280 2.230 - -13.23% -
410.bwaves -2.17% 92.000 90.000 - -68.86% -
410.bwaves (avg) -2.17% 92.000 90.000 - -68.86% -
434.zeusmp -2.08% 48.000 47.000 - -81.57% -
434.zeusmp (avg) -2.08% 48.000 47.000 - -81.57% -
462.libquantum (avg) (percentage) -2.05% 1.950 1.910 - 905.26% -
433.milc (avg) (percentage) -2.04% 1.960 1.920 - 178.26% -
456.hmmer (avg) (percentage) -2.02% 0.990 0.970 - 223.33% -
470.lbm (avg) (percentage) -2.02% 1.980 1.940 - -47.99% -
401.bzip2 (avg) (percentage) -1.95% 2.560 2.510 - 829.63% -
410.bwaves (avg) (percentage) -1.92% 1.560 1.530 - -21.94% -
458.sjeng (avg) (percentage) -1.90% 1.050 1.030 - 347.83% -
447.dealII (avg) (percentage) -1.83% 2.190 2.150 - 147.13% -
471.omnetpp (avg) (percentage) -1.81% 2.210 2.170 - 83.90% -
436.cactusADM (avg) (percentage) -1.81% 1.660 1.630 - -32.08% -
429.mcf (avg) (percentage) -1.78% 6.180 6.070 - 1164.58% -
482.sphinx3 (avg) (percentage) -1.78% 2.250 2.210 - -5.96% -
434.zeusmp (avg) (percentage) -1.72% 1.740 1.710 - 40.16% -
444.namd (avg) (percentage) -1.63% 1.840 1.810 - -30.38% -
471.omnetpp -1.61% 62.000 61.000 - -44.04% -
471.omnetpp (avg) -1.61% 62.000 61.000 - -44.04% -
459.GemsFDTD (avg) (percentage) -1.60% 1.880 1.850 - 33.09% -
445.gobmk -1.47% 68.000 67.000 - 148.15% -
445.gobmk (avg) -1.47% 68.000 67.000 - 148.15% -
470.lbm -1.37% 73.000 72.000 - -88.16% -
470.lbm (avg) -1.37% 73.000 72.000 - -88.16% -
450.soplex (avg) (percentage) -1.26% 3.180 3.140 - 1208.33% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 3.16% 48001.000 49520.000 - 0.00% -
453.povray 1.79% 489013.000 497781.000 - 0.00% -
416.gamess 1.62% 4554728.000 4628484.000 - 0.00% -
459.GemsFDTD 1.38% 195766.000 198470.000 - 0.00% -
471.omnetpp 1.29% 295652.000 299471.000 - 0.00% -
462.libquantum 1.13% 13066.000 13214.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1684.75% 0.590 10.530 - 217.17% -
403.gcc (unexplained diff vs previous) (percentage) 1541.38% 0.580 9.520 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 1322.22% 0.090 1.280 - -25.58% -
450.soplex (avg) (percentage) 1208.33% 0.240 3.140 - -1.26% -
429.mcf (avg) (percentage) 1164.58% 0.480 6.070 - -1.78% -
462.libquantum (avg) (percentage) 905.26% 0.190 1.910 - -2.05% -
401.bzip2 (avg) (percentage) 829.63% 0.270 2.510 - -1.95% -
462.libquantum (max) (percentage) 762.50% 0.080 0.690 - -5.48% -
400.perlbench (unexplained diff vs previous) (percentage) 516.13% 0.310 1.910 - -10.33% -
445.gobmk (avg) (percentage) 495.45% 0.220 1.310 - -2.24% -
445.gobmk (max) (percentage) 455.56% 0.270 1.500 - -6.25% -
400.perlbench (avg) (percentage) 433.33% 0.390 2.080 - -0.48% -
403.gcc (avg) (percentage) 418.60% 0.430 2.230 - 29.65% -
429.mcf (max) (percentage) 393.75% 0.320 1.580 - -6.51% -
473.astar (avg) (percentage) 375.00% 0.400 1.900 - 0.00% -
458.sjeng (avg) (percentage) 347.83% 0.230 1.030 - -1.90% -
473.astar (max) (percentage) 342.55% 0.470 2.080 - 55.22% -
437.leslie3d (unexplained diff vs previous) (percentage) 334.95% 1.030 4.480 - -21.13% -
473.astar (unexplained diff vs previous) (percentage) 334.04% 0.470 2.040 - 786.96% -
454.calculix (unexplained diff vs previous) (percentage) 322.67% 0.750 3.170 - 2.92% -
437.leslie3d (max) (percentage) 294.52% 3.100 12.230 - -6.43% -
454.calculix (max) (percentage) 278.57% 0.840 3.180 - -29.96% -
456.hmmer (avg) (percentage) 223.33% 0.300 0.970 - -2.02% -
464.h264ref (avg) (percentage) 223.08% 0.390 1.260 - -2.33% -
450.soplex (max) (percentage) 209.09% 0.440 1.360 - -31.31% -
433.milc (avg) (percentage) 178.26% 0.690 1.920 - -2.04% -
437.leslie3d (unexplained diff vs previous) 177.54% 187.000 519.000 - -24.45% -
450.soplex (unexplained diff vs previous) (percentage) 170.45% 0.440 1.190 - -35.68% -
437.leslie3d (avg) (percentage) 155.69% 1.670 4.270 - 0.00% -
458.sjeng (max) (percentage) 153.33% 0.300 0.760 - -16.48% -
437.leslie3d (max) 152.68% 560.000 1415.000 - -10.50% -
445.gobmk 148.15% 27.000 67.000 - -1.47% -
445.gobmk (avg) 148.15% 27.000 67.000 - -1.47% -
447.dealII (avg) (percentage) 147.13% 0.870 2.150 - -1.83% -
445.gobmk (unexplained diff vs previous) (percentage) 146.67% 0.150 0.370 - 825.00% -
400.perlbench (max) (percentage) 143.75% 0.800 1.950 - -6.70% -
435.gromacs (avg) (percentage) 133.68% 0.950 2.220 - -2.63% -
445.gobmk (max) 130.30% 33.000 76.000 - -6.17% -
458.sjeng 122.22% 36.000 80.000 - -2.44% -
458.sjeng (avg) 122.22% 36.000 80.000 - -2.44% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
401.bzip2 (max) (percentage) 100.00% 0.400 0.800 - -2.44% -
454.calculix (avg) (percentage) 91.13% 2.030 3.880 - -0.51% -
473.astar 84.31% 51.000 94.000 - 2.17% -
473.astar (avg) 84.31% 51.000 94.000 - 2.17% -
471.omnetpp (avg) (percentage) 83.90% 1.180 2.170 - -1.81% -
483.xalancbmk (max) (percentage) 70.65% 0.920 1.570 - 0.00% -
473.astar (max) 68.85% 61.000 103.000 - 58.46% -
401.bzip2 66.67% 45.000 75.000 - -2.60% -
401.bzip2 (avg) 66.67% 45.000 75.000 - -2.60% -
473.astar (unexplained diff vs previous) 65.57% 61.000 101.000 - 818.18% -
437.leslie3d 64.12% 301.000 494.000 - -4.26% -
437.leslie3d (avg) 64.12% 301.000 494.000 - -4.26% -
434.zeusmp (avg) (percentage) 40.16% 1.220 1.710 - -1.72% -
459.GemsFDTD (avg) (percentage) 33.09% 1.390 1.850 - -1.60% -
464.h264ref 32.20% 59.000 78.000 - -2.50% -
464.h264ref (avg) 32.20% 59.000 78.000 - -2.50% -
401.bzip2 (unexplained diff vs previous) (percentage) 29.27% 0.410 0.530 - 307.69% -
453.povray (avg) (percentage) 28.10% 1.530 1.960 - -2.49% -
458.sjeng (max) 22.92% 48.000 59.000 - -16.90% -
429.mcf (unexplained diff vs previous) 20.00% 10.000 12.000 - -25.00% -
458.sjeng (unexplained diff vs previous) (percentage) 10.00% 0.300 0.330 - -64.13% -
445.gobmk (unexplained diff vs previous) 5.56% 18.000 19.000 - 850.00% -
435.gromacs 5.00% 160.000 168.000 - -2.89% -
435.gromacs (avg) 5.00% 160.000 168.000 - -2.89% -
429.mcf 1.79% 56.000 57.000 - 0.00% -
429.mcf (avg) 1.79% 56.000 57.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.32% 141060.000 139198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 63.000 - -3.08% -
403.gcc -99.29% 8890.000 63.000 - 10.53% -
462.libquantum -98.78% 17005.000 207.000 - 0.00% -
482.sphinx3 -97.49% 36586.000 918.000 - -0.54% -
450.soplex -96.25% 15709.000 589.000 - -1.17% -
444.namd -94.37% 15957.000 898.000 - -0.44% -
453.povray -92.52% 7395.000 553.000 - -0.36% -
429.mcf -91.98% 11727.000 941.000 - 1.29% -
433.milc -91.94% 13668.000 1101.000 - 0.09% -
436.cactusADM -89.40% 24396.000 2587.000 - -0.31% -
434.zeusmp -86.64% 20932.000 2796.000 - 0.32% -
400.perlbench -85.08% 11215.000 1673.000 - 1.95% -
401.bzip2 -82.33% 16971.000 2999.000 - -0.53% -
447.dealII -79.30% 9101.000 1884.000 - -0.63% -
470.lbm -77.15% 16312.000 3727.000 - -0.24% -
456.hmmer -76.45% 18995.000 4473.000 - 0.11% -
459.GemsFDTD -71.91% 25364.000 7125.000 - -0.41% -
481.wrf -70.86% 21991.000 6408.000 - -0.77% -
471.omnetpp -69.52% 9265.000 2824.000 - 0.21% -
473.astar -61.78% 12983.000 4962.000 - 2.08% -
410.bwaves -59.69% 14745.000 5944.000 - 0.30% -
464.h264ref -58.89% 15208.000 6252.000 - 0.30% -
445.gobmk -58.68% 12396.000 5122.000 - 0.37% -
435.gromacs -54.86% 16853.000 7607.000 - 0.21% -
458.sjeng -50.95% 16018.000 7857.000 - 0.33% -
416.gamess -49.71% 29409.000 14789.000 - 0.10% -
437.leslie3d -35.93% 18070.000 11578.000 - -4.29% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.70% 659.000 2.000 - 0.00% -
454.calculix (avg) -99.70% 659.000 2.000 - 0.00% -
482.sphinx3 (max) -99.57% 1152.000 5.000 - -16.67% -
482.sphinx3 (unexplained diff vs previous) -99.55% 1118.000 5.000 - -16.67% -
444.namd (unexplained diff vs previous) -99.52% 834.000 4.000 - 33.33% -
444.namd (max) -99.43% 879.000 5.000 - -16.67% -
436.cactusADM (max) -99.35% 1231.000 8.000 - 33.33% -
436.cactusADM (unexplained diff vs previous) -99.32% 1173.000 8.000 - 33.33% -
454.calculix (max) -99.26% 272.000 2.000 - 0.00% -
454.calculix (unexplained diff vs previous) -99.18% 244.000 2.000 - 0.00% -
433.milc (unexplained diff vs previous) -98.96% 96.000 1.000 - -50.00% -
470.lbm (unexplained diff vs previous) -98.91% 822.000 9.000 - 80.00% -
453.povray (unexplained diff vs previous) -98.82% 169.000 2.000 - -75.00% -
416.gamess (unexplained diff vs previous) -98.33% 896.000 15.000 - 200.00% -
434.zeusmp (max) -98.13% 481.000 9.000 - -10.00% -
434.zeusmp (unexplained diff vs previous) -98.09% 470.000 9.000 - 125.00% -
433.milc (max) -97.94% 97.000 2.000 - -33.33% -
482.sphinx3 -97.67% 859.000 20.000 - 0.00% -
482.sphinx3 (avg) -97.67% 859.000 20.000 - 0.00% -
470.lbm (max) -97.42% 893.000 23.000 - -8.00% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
453.povray (max) -96.86% 191.000 6.000 - -25.00% -
416.gamess (unexplained diff vs previous) (percentage) -96.72% 3.050 0.100 - 233.33% -
416.gamess (max) -96.64% 923.000 31.000 - 0.00% -
444.namd -96.14% 414.000 16.000 - 0.00% -
444.namd (avg) -96.14% 414.000 16.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -95.24% 5.040 0.240 - 84.62% -
459.GemsFDTD (unexplained diff vs previous) -95.03% 584.000 29.000 - -23.68% -
456.hmmer (unexplained diff vs previous) -94.90% 98.000 5.000 - 150.00% -
435.gromacs (unexplained diff vs previous) -94.52% 292.000 16.000 - 220.00% -
481.wrf (unexplained diff vs previous) -94.41% 894.000 50.000 - 233.33% -
436.cactusADM (max) (percentage) -93.86% 5.050 0.310 - 24.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -93.56% 4.810 0.310 - 34.78% -
416.gamess (max) (percentage) -93.31% 3.140 0.210 - 0.00% -
410.bwaves (unexplained diff vs previous) -93.00% 257.000 18.000 - -50.00% -
436.cactusADM -92.82% 585.000 42.000 - -2.33% -
436.cactusADM (avg) -92.82% 585.000 42.000 - -2.33% -
462.libquantum (max) -92.31% 13.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -91.40% 5.230 0.450 - 36.36% -
447.dealII (max) -91.33% 150.000 13.000 - -55.17% -
453.povray -91.15% 113.000 10.000 - -9.09% -
453.povray (avg) -91.15% 113.000 10.000 - -9.09% -
459.GemsFDTD (max) -90.83% 578.000 53.000 - -8.62% -
462.libquantum -90.62% 32.000 3.000 - -25.00% -
462.libquantum (avg) -90.62% 32.000 3.000 - -25.00% -
471.omnetpp (unexplained diff vs previous) -90.32% 62.000 6.000 - -80.00% -
450.soplex (unexplained diff vs previous) -89.86% 69.000 7.000 - -36.36% -
481.wrf (max) -89.28% 914.000 98.000 - -2.97% -
456.hmmer (max) -88.78% 98.000 11.000 - -8.33% -
403.gcc (max) -88.46% 52.000 6.000 - 500.00% -
403.gcc (unexplained diff vs previous) -88.46% 52.000 6.000 - 0.00% -
450.soplex (max) -88.41% 69.000 8.000 - -27.27% -
470.lbm (max) (percentage) -88.32% 5.480 0.640 - -7.25% -
444.namd (max) (percentage) -88.20% 5.510 0.650 - -4.41% -
470.lbm -88.16% 608.000 72.000 - -1.37% -
470.lbm (avg) -88.16% 608.000 72.000 - -1.37% -
435.gromacs (unexplained diff vs previous) (percentage) -87.86% 1.730 0.210 - 200.00% -
433.milc (unexplained diff vs previous) (percentage) -87.14% 0.700 0.090 - -50.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -85.78% 2.250 0.320 - 128.57% -
471.omnetpp (max) -85.47% 172.000 25.000 - -16.67% -
434.zeusmp (max) (percentage) -85.22% 2.300 0.340 - -5.56% -
453.povray (unexplained diff vs previous) (percentage) -84.28% 2.290 0.360 - -75.00% -
410.bwaves (max) -84.23% 260.000 41.000 - -6.82% -
410.bwaves (unexplained diff vs previous) (percentage) -82.76% 1.740 0.300 - -50.82% -
447.dealII (unexplained diff vs previous) -82.35% 68.000 12.000 - -20.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.35% 3.060 0.540 - -16.92% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -82.17% 2.300 0.410 - -22.64% -
434.zeusmp -81.57% 255.000 47.000 - -2.08% -
434.zeusmp (avg) -81.57% 255.000 47.000 - -2.08% -
481.wrf (unexplained diff vs previous) (percentage) -80.84% 4.070 0.780 - 239.13% -
482.sphinx3 (max) (percentage) -80.32% 3.150 0.620 - -6.06% -
456.hmmer (unexplained diff vs previous) (percentage) -78.85% 0.520 0.110 - 175.00% -
433.milc -77.66% 94.000 21.000 - 0.00% -
433.milc (avg) -77.66% 94.000 21.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -76.81% 69.000 16.000 - 300.00% -
481.wrf -74.87% 565.000 142.000 - -3.40% -
481.wrf (avg) -74.87% 565.000 142.000 - -3.40% -
435.gromacs (max) -74.32% 296.000 76.000 - 0.00% -
410.bwaves -68.86% 289.000 90.000 - -2.17% -
410.bwaves (avg) -68.86% 289.000 90.000 - -2.17% -
471.omnetpp (unexplained diff vs previous) (percentage) -68.66% 0.670 0.210 - -80.19% -
416.gamess -67.84% 485.000 156.000 - -3.11% -
416.gamess (avg) -67.84% 485.000 156.000 - -3.11% -
464.h264ref (unexplained diff vs previous) -67.24% 58.000 19.000 - 5.56% -
459.GemsFDTD (max) (percentage) -67.11% 2.280 0.750 - -8.54% -
401.bzip2 (max) -65.67% 67.000 23.000 - -4.17% -
400.perlbench (max) -64.04% 89.000 32.000 - -5.88% -
481.wrf (max) (percentage) -63.22% 4.160 1.530 - -2.55% -
459.GemsFDTD -62.78% 352.000 131.000 - -2.24% -
459.GemsFDTD (avg) -62.78% 352.000 131.000 - -2.24% -
429.mcf (max) -62.16% 37.000 14.000 - -6.67% -
433.milc (max) (percentage) -61.97% 0.710 0.270 - -6.90% -
410.bwaves (max) (percentage) -61.02% 1.770 0.690 - -8.00% -
464.h264ref (max) -61.02% 59.000 23.000 - -8.00% -
447.dealII (max) (percentage) -55.15% 1.650 0.740 - -51.63% -
453.povray (max) (percentage) -52.90% 2.590 1.220 - -16.44% -
471.omnetpp (max) (percentage) -51.61% 1.860 0.900 - -16.67% -
450.soplex -51.35% 37.000 18.000 - 0.00% -
450.soplex (avg) -51.35% 37.000 18.000 - 0.00% -
456.hmmer (max) (percentage) -50.00% 0.520 0.260 - -3.70% -
447.dealII -49.37% 79.000 40.000 - -2.44% -
447.dealII (avg) -49.37% 79.000 40.000 - -2.44% -
470.lbm (avg) (percentage) -47.99% 3.730 1.940 - -2.02% -
458.sjeng (unexplained diff vs previous) -45.83% 48.000 26.000 - -63.89% -
471.omnetpp -44.04% 109.000 61.000 - -1.61% -
471.omnetpp (avg) -44.04% 109.000 61.000 - -1.61% -
435.gromacs (max) (percentage) -42.61% 1.760 1.010 - 0.00% -
416.gamess (avg) (percentage) -35.76% 1.650 1.060 - -2.75% -
436.cactusADM (avg) (percentage) -32.08% 2.400 1.630 - -1.81% -
444.namd (avg) (percentage) -30.38% 2.600 1.810 - -1.63% -
465.tonto (max) -28.25% 223.000 160.000 - -4.76% -
465.tonto (max) (percentage) -28.07% 1.710 1.230 - -3.91% -
456.hmmer -23.21% 56.000 43.000 - -2.27% -
456.hmmer (avg) -23.21% 56.000 43.000 - -2.27% -
410.bwaves (avg) (percentage) -21.94% 1.960 1.530 - -1.92% -
464.h264ref (unexplained diff vs previous) (percentage) -21.05% 0.380 0.300 - 3.45% -
400.perlbench -20.93% 43.000 34.000 - 0.00% -
400.perlbench (avg) -20.93% 43.000 34.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -14.67% 0.750 0.640 - -18.99% -
465.tonto -13.51% 148.000 128.000 - -0.78% -
465.tonto (avg) -13.51% 148.000 128.000 - -0.78% -
481.wrf (avg) (percentage) -13.23% 2.570 2.230 - -2.19% -
465.tonto (avg) (percentage) -13.16% 1.140 0.990 - 1.02% -
400.perlbench (unexplained diff vs previous) -8.57% 35.000 32.000 - -8.57% -
482.sphinx3 (avg) (percentage) -5.96% 2.350 2.210 - -1.78% -
465.tonto (unexplained diff vs previous) -4.05% 148.000 142.000 - -13.41% -
465.tonto (unexplained diff vs previous) (percentage) -3.54% 1.130 1.090 - -12.80% -
464.h264ref (max) (percentage) -2.56% 0.390 0.380 - -7.32% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)


Report Time: 0.39s
Name Current %
400.perlbench 1673.000 1.95%
401.bzip2 2999.000 -
403.gcc 63.000 10.53%
410.bwaves 5944.000 -
416.gamess 14789.000 -
429.mcf 941.000 1.29%
433.milc 1101.000 -
434.zeusmp 2796.000 -
435.gromacs 7607.000 -
436.cactusADM 2587.000 -
437.leslie3d 11578.000 -4.29%
444.namd 898.000 -
445.gobmk 5122.000 -
447.dealII 1884.000 -
450.soplex 589.000 -1.17%
453.povray 553.000 -
454.calculix 63.000 -3.08%
456.hmmer 4473.000 -
458.sjeng 7857.000 -
459.GemsFDTD 7125.000 -
462.libquantum 207.000 -
464.h264ref 6252.000 -
465.tonto 13022.000 -1.08%
470.lbm 3727.000 -
471.omnetpp 2824.000 -
473.astar 4962.000 2.08%
481.wrf 6408.000 -
482.sphinx3 918.000 -
Geometric Mean 2206.938 -
Name Current %
400.perlbench 567014.000 -
401.bzip2 33646.000 -
403.gcc 1603038.000 -
410.bwaves 14762.000 -
416.gamess 4628484.000 -
429.mcf 7701.000 -
433.milc 47885.000 -
434.zeusmp 139198.000 -
435.gromacs 395094.000 -
436.cactusADM 258134.000 -
437.leslie3d 49520.000 -
444.namd 162891.000 -
445.gobmk 1089880.000 -
447.dealII 192682.000 -
450.soplex 136752.000 -
453.povray 497781.000 -
454.calculix 687531.000 -
456.hmmer 74925.000 -
458.sjeng 81781.000 -
459.GemsFDTD 198470.000 -
462.libquantum 13214.000 -
464.h264ref 301922.000 -
465.tonto 1446404.000 -
470.lbm 10853.000 -
471.omnetpp 299471.000 -
473.astar 15677.000 -
481.wrf 1537232.000 -
482.sphinx3 80162.000 -
Geometric Mean 158257.629 -
Name Current %
400.perlbench 34.000 -
400.perlbench (avg) 34.000 -
400.perlbench (avg) (percentage) 2.080 -
400.perlbench (max) 32.000 -5.88%
400.perlbench (max) (percentage) 1.950 -6.70%
400.perlbench (unexplained diff vs previous) 32.000 -8.57%
400.perlbench (unexplained diff vs previous) (percentage) 1.910 -10.33%
401.bzip2 75.000 -2.60%
401.bzip2 (avg) 75.000 -2.60%
401.bzip2 (avg) (percentage) 2.510 -1.95%
401.bzip2 (max) 23.000 -4.17%
401.bzip2 (max) (percentage) 0.800 -2.44%
401.bzip2 (unexplained diff vs previous) 16.000 300.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.530 307.69%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.230 29.65%
403.gcc (max) 6.000 500.00%
403.gcc (max) (percentage) 10.530 217.17%
403.gcc (unexplained diff vs previous) 6.000 -
403.gcc (unexplained diff vs previous) (percentage) 9.520 -
410.bwaves 90.000 -2.17%
410.bwaves (avg) 90.000 -2.17%
410.bwaves (avg) (percentage) 1.530 -1.92%
410.bwaves (max) 41.000 -6.82%
410.bwaves (max) (percentage) 0.690 -8.00%
410.bwaves (unexplained diff vs previous) 18.000 -50.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.300 -50.82%
416.gamess 156.000 -3.11%
416.gamess (avg) 156.000 -3.11%
416.gamess (avg) (percentage) 1.060 -2.75%
416.gamess (max) 31.000 -
416.gamess (max) (percentage) 0.210 -
416.gamess (unexplained diff vs previous) 15.000 200.00%
416.gamess (unexplained diff vs previous) (percentage) 0.100 233.33%
429.mcf 57.000 -
429.mcf (avg) 57.000 -
429.mcf (avg) (percentage) 6.070 -1.78%
429.mcf (max) 14.000 -6.67%
429.mcf (max) (percentage) 1.580 -6.51%
429.mcf (unexplained diff vs previous) 12.000 -25.00%
429.mcf (unexplained diff vs previous) (percentage) 1.280 -25.58%
433.milc 21.000 -
433.milc (avg) 21.000 -
433.milc (avg) (percentage) 1.920 -2.04%
433.milc (max) 2.000 -33.33%
433.milc (max) (percentage) 0.270 -6.90%
433.milc (unexplained diff vs previous) 1.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -50.00%
434.zeusmp 47.000 -2.08%
434.zeusmp (avg) 47.000 -2.08%
434.zeusmp (avg) (percentage) 1.710 -1.72%
434.zeusmp (max) 9.000 -10.00%
434.zeusmp (max) (percentage) 0.340 -5.56%
434.zeusmp (unexplained diff vs previous) 9.000 125.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.320 128.57%
435.gromacs 168.000 -2.89%
435.gromacs (avg) 168.000 -2.89%
435.gromacs (avg) (percentage) 2.220 -2.63%
435.gromacs (max) 76.000 -
435.gromacs (max) (percentage) 1.010 -
435.gromacs (unexplained diff vs previous) 16.000 220.00%
435.gromacs (unexplained diff vs previous) (percentage) 0.210 200.00%
436.cactusADM 42.000 -2.33%
436.cactusADM (avg) 42.000 -2.33%
436.cactusADM (avg) (percentage) 1.630 -1.81%
436.cactusADM (max) 8.000 33.33%
436.cactusADM (max) (percentage) 0.310 24.00%
436.cactusADM (unexplained diff vs previous) 8.000 33.33%
436.cactusADM (unexplained diff vs previous) (percentage) 0.310 34.78%
437.leslie3d 494.000 -4.26%
437.leslie3d (avg) 494.000 -4.26%
437.leslie3d (avg) (percentage) 4.270 -
437.leslie3d (max) 1415.000 -10.50%
437.leslie3d (max) (percentage) 12.230 -6.43%
437.leslie3d (unexplained diff vs previous) 519.000 -24.45%
437.leslie3d (unexplained diff vs previous) (percentage) 4.480 -21.13%
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 1.810 -1.63%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.650 -4.41%
444.namd (unexplained diff vs previous) 4.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 0.450 36.36%
445.gobmk 67.000 -1.47%
445.gobmk (avg) 67.000 -1.47%
445.gobmk (avg) (percentage) 1.310 -2.24%
445.gobmk (max) 76.000 -6.17%
445.gobmk (max) (percentage) 1.500 -6.25%
445.gobmk (unexplained diff vs previous) 19.000 850.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.370 825.00%
447.dealII 40.000 -2.44%
447.dealII (avg) 40.000 -2.44%
447.dealII (avg) (percentage) 2.150 -1.83%
447.dealII (max) 13.000 -55.17%
447.dealII (max) (percentage) 0.740 -51.63%
447.dealII (unexplained diff vs previous) 12.000 -20.00%
447.dealII (unexplained diff vs previous) (percentage) 0.640 -18.99%
450.soplex 18.000 -
450.soplex (avg) 18.000 -
450.soplex (avg) (percentage) 3.140 -1.26%
450.soplex (max) 8.000 -27.27%
450.soplex (max) (percentage) 1.360 -31.31%
450.soplex (unexplained diff vs previous) 7.000 -36.36%
450.soplex (unexplained diff vs previous) (percentage) 1.190 -35.68%
453.povray 10.000 -9.09%
453.povray (avg) 10.000 -9.09%
453.povray (avg) (percentage) 1.960 -2.49%
453.povray (max) 6.000 -25.00%
453.povray (max) (percentage) 1.220 -16.44%
453.povray (unexplained diff vs previous) 2.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.360 -75.00%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.880 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.180 -29.96%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.170 2.92%
456.hmmer 43.000 -2.27%
456.hmmer (avg) 43.000 -2.27%
456.hmmer (avg) (percentage) 0.970 -2.02%
456.hmmer (max) 11.000 -8.33%
456.hmmer (max) (percentage) 0.260 -3.70%
456.hmmer (unexplained diff vs previous) 5.000 150.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 175.00%
458.sjeng 80.000 -2.44%
458.sjeng (avg) 80.000 -2.44%
458.sjeng (avg) (percentage) 1.030 -1.90%
458.sjeng (max) 59.000 -16.90%
458.sjeng (max) (percentage) 0.760 -16.48%
458.sjeng (unexplained diff vs previous) 26.000 -63.89%
458.sjeng (unexplained diff vs previous) (percentage) 0.330 -64.13%
459.GemsFDTD 131.000 -2.24%
459.GemsFDTD (avg) 131.000 -2.24%
459.GemsFDTD (avg) (percentage) 1.850 -1.60%
459.GemsFDTD (max) 53.000 -8.62%
459.GemsFDTD (max) (percentage) 0.750 -8.54%
459.GemsFDTD (unexplained diff vs previous) 29.000 -23.68%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.410 -22.64%
462.libquantum 3.000 -25.00%
462.libquantum (avg) 3.000 -25.00%
462.libquantum (avg) (percentage) 1.910 -2.05%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.690 -5.48%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 78.000 -2.50%
464.h264ref (avg) 78.000 -2.50%
464.h264ref (avg) (percentage) 1.260 -2.33%
464.h264ref (max) 23.000 -8.00%
464.h264ref (max) (percentage) 0.380 -7.32%
464.h264ref (unexplained diff vs previous) 19.000 5.56%
464.h264ref (unexplained diff vs previous) (percentage) 0.300 3.45%
465.tonto 128.000 -
465.tonto (avg) 128.000 -
465.tonto (avg) (percentage) 0.990 1.02%
465.tonto (max) 160.000 -4.76%
465.tonto (max) (percentage) 1.230 -3.91%
465.tonto (unexplained diff vs previous) 142.000 -13.41%
465.tonto (unexplained diff vs previous) (percentage) 1.090 -12.80%
470.lbm 72.000 -1.37%
470.lbm (avg) 72.000 -1.37%
470.lbm (avg) (percentage) 1.940 -2.02%
470.lbm (max) 23.000 -8.00%
470.lbm (max) (percentage) 0.640 -7.25%
470.lbm (unexplained diff vs previous) 9.000 80.00%
470.lbm (unexplained diff vs previous) (percentage) 0.240 84.62%
471.omnetpp 61.000 -1.61%
471.omnetpp (avg) 61.000 -1.61%
471.omnetpp (avg) (percentage) 2.170 -1.81%
471.omnetpp (max) 25.000 -16.67%
471.omnetpp (max) (percentage) 0.900 -16.67%
471.omnetpp (unexplained diff vs previous) 6.000 -80.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.210 -80.19%
473.astar 94.000 2.17%
473.astar (avg) 94.000 2.17%
473.astar (avg) (percentage) 1.900 -
473.astar (max) 103.000 58.46%
473.astar (max) (percentage) 2.080 55.22%
473.astar (unexplained diff vs previous) 101.000 818.18%
473.astar (unexplained diff vs previous) (percentage) 2.040 786.96%
481.wrf 142.000 -3.40%
481.wrf (avg) 142.000 -3.40%
481.wrf (avg) (percentage) 2.230 -2.19%
481.wrf (max) 98.000 -2.97%
481.wrf (max) (percentage) 1.530 -2.55%
481.wrf (unexplained diff vs previous) 50.000 233.33%
481.wrf (unexplained diff vs previous) (percentage) 0.780 239.13%
482.sphinx3 20.000 -
482.sphinx3 (avg) 20.000 -
482.sphinx3 (avg) (percentage) 2.210 -1.78%
482.sphinx3 (max) 5.000 -16.67%
482.sphinx3 (max) (percentage) 0.620 -6.06%
482.sphinx3 (unexplained diff vs previous) 5.000 -16.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.540 -16.92%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.570 -
Geometric Mean 5.714 13.72%