Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=757b1c20d49438a19cb3bfd5ce5db20f40ce4e21 (+ 14 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ab98b4c0725eb7c0f03d319ef3e22ae761b2698a (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4a07fbb689eeec30e7d71a0d144c26e0d1e424ac (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=0d0d729e9e989d9b3c803c9b524f926a9d39ca9e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-arm-spec2k6-Os_LTO/156/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0156 (-00000-) 2022-09-23T12:13:15 0:00:00
Previous 0154 (4-changed-components) 2022-09-20T12:42:48 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 67 146
Performance Improvements 133 70
Added Tests 4 0
Unchanged Tests 1032 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm 7.75% 15990.000 17230.000 - 5.63% -
454.calculix 5.90% 28427.000 30104.000 - -7.35% -
481.wrf 4.50% 21965.000 22953.000 - 4.37% -
437.leslie3d 3.22% 18155.000 18739.000 - 3.70% -
459.GemsFDTD 2.76% 25332.000 26032.000 - 2.63% -
482.sphinx3 2.67% 36385.000 37358.000 - 2.11% -
453.povray 2.01% 7366.000 7514.000 - 1.61% -
465.tonto 1.09% 10240.000 10352.000 - -20.64% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) 10800.00% 1.000 109.000 - 211.43% -
400.perlbench (unexplained diff vs previous) (percentage) 9600.00% 0.010 0.970 - 212.90% -
401.bzip2 (unexplained diff vs previous) (percentage) 2000.00% 0.010 0.210 - -48.78% -
401.bzip2 (unexplained diff vs previous) 1650.00% 2.000 35.000 - -49.28% -
462.libquantum (unexplained diff vs previous) (percentage) 350.00% 0.040 0.180 - 125.00% -
462.libquantum (unexplained diff vs previous) 342.86% 7.000 31.000 - 121.43% -
400.perlbench (max) (percentage) 269.23% 0.260 0.960 - 20.00% -
400.perlbench (max) 268.97% 29.000 107.000 - 20.22% -
403.gcc (unexplained diff vs previous) (percentage) 229.17% 0.240 0.790 - 36.21% -
403.gcc (unexplained diff vs previous) 222.73% 22.000 71.000 - 36.54% -
433.milc (unexplained diff vs previous) (percentage) 154.55% 0.110 0.280 - -60.00% -
433.milc (unexplained diff vs previous) 153.33% 15.000 38.000 - -60.42% -
447.dealII (unexplained diff vs previous) (percentage) 114.29% 0.140 0.300 - -60.00% -
447.dealII (unexplained diff vs previous) 107.69% 13.000 27.000 - -60.29% -
471.omnetpp (unexplained diff vs previous) (percentage) 66.67% 0.300 0.500 - -25.37% -
471.omnetpp (unexplained diff vs previous) 66.67% 27.000 45.000 - -27.42% -
464.h264ref (unexplained diff vs previous) (percentage) 55.00% 0.200 0.310 - -18.42% -
464.h264ref (unexplained diff vs previous) 53.33% 30.000 46.000 - -20.69% -
400.perlbench (avg) (percentage) 48.15% 0.270 0.400 - 2.56% -
459.GemsFDTD (max) 47.13% 488.000 718.000 - 24.22% -
400.perlbench 46.67% 30.000 44.000 - 2.33% -
400.perlbench (avg) 46.67% 30.000 44.000 - 2.33% -
437.leslie3d (max) 46.00% 413.000 603.000 - 7.68% -
437.leslie3d (unexplained diff vs previous) 44.20% 405.000 584.000 - 212.30% -
459.GemsFDTD (max) (percentage) 43.01% 1.930 2.760 - 21.05% -
437.leslie3d (max) (percentage) 41.23% 2.280 3.220 - 3.87% -
437.leslie3d (unexplained diff vs previous) (percentage) 39.91% 2.230 3.120 - 202.91% -
456.hmmer (unexplained diff vs previous) 25.49% 51.000 64.000 - -34.69% -
470.lbm (max) 24.53% 1072.000 1335.000 - 49.50% -
403.gcc (max) (percentage) 23.44% 0.640 0.790 - 33.90% -
456.hmmer (unexplained diff vs previous) (percentage) 23.08% 0.260 0.320 - -38.46% -
403.gcc (max) 22.81% 57.000 70.000 - 34.62% -
471.omnetpp (max) 21.62% 37.000 45.000 - -73.84% -
470.lbm 21.54% 701.000 852.000 - 40.13% -
470.lbm (avg) 21.54% 701.000 852.000 - 40.13% -
471.omnetpp (max) (percentage) 19.05% 0.420 0.500 - -73.12% -
470.lbm (max) (percentage) 15.50% 6.710 7.750 - 41.42% -
437.leslie3d 14.86% 350.000 402.000 - 33.55% -
437.leslie3d (avg) 14.86% 350.000 402.000 - 33.55% -
454.calculix (max) 13.85% 1560.000 1776.000 - 552.94% -
470.lbm (avg) (percentage) 12.76% 4.390 4.950 - 32.71% -
437.leslie3d (avg) (percentage) 11.40% 1.930 2.150 - 28.74% -
454.calculix 9.42% 1444.000 1580.000 - 139.76% -
454.calculix (avg) 9.42% 1444.000 1580.000 - 139.76% -
481.wrf 8.86% 858.000 934.000 - 65.31% -
481.wrf (avg) 8.86% 858.000 934.000 - 65.31% -
470.lbm (unexplained diff vs previous) 7.73% 1151.000 1240.000 - 50.85% -
454.calculix (max) (percentage) 7.47% 5.490 5.900 - 602.38% -
481.wrf (max) 7.28% 962.000 1032.000 - 12.91% -
459.GemsFDTD 6.04% 613.000 650.000 - 84.66% -
459.GemsFDTD (avg) 6.04% 613.000 650.000 - 84.66% -
481.wrf (avg) (percentage) 4.09% 3.910 4.070 - 58.37% -
454.calculix (avg) (percentage) 3.35% 5.080 5.250 - 158.62% -
459.GemsFDTD (avg) (percentage) 3.31% 2.420 2.500 - 79.86% -
481.wrf (max) (percentage) 2.74% 4.380 4.500 - 8.17% -
453.povray 1.63% 184.000 187.000 - 65.49% -
453.povray (avg) 1.63% 184.000 187.000 - 65.49% -
454.calculix (unexplained diff vs previous) 1.57% 1651.000 1677.000 - 587.30% -
403.gcc (avg) (percentage) 1.30% 0.770 0.780 - 81.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) -96.85% 381.000 12.000 - -97.45% -
434.zeusmp (unexplained diff vs previous) (percentage) -96.70% 1.820 0.060 - -97.33% -
436.cactusADM (unexplained diff vs previous) -96.40% 1194.000 43.000 - -96.33% -
436.cactusADM (unexplained diff vs previous) (percentage) -96.31% 4.880 0.180 - -96.26% -
450.soplex (unexplained diff vs previous) (percentage) -96.30% 0.270 0.010 - -97.73% -
435.gromacs (unexplained diff vs previous) (percentage) -95.86% 1.690 0.070 - -95.95% -
435.gromacs (unexplained diff vs previous) -95.79% 285.000 12.000 - -95.89% -
450.soplex (unexplained diff vs previous) -95.24% 42.000 2.000 - -97.10% -
416.gamess (unexplained diff vs previous) -94.14% 853.000 50.000 - -94.42% -
416.gamess (unexplained diff vs previous) (percentage) -94.14% 2.900 0.170 - -94.43% -
444.namd (unexplained diff vs previous) (percentage) -92.23% 4.760 0.370 - -92.93% -
444.namd (unexplained diff vs previous) -92.22% 758.000 59.000 - -92.93% -
429.mcf (unexplained diff vs previous) -91.11% 90.000 8.000 - -20.00% -
429.mcf (unexplained diff vs previous) (percentage) -90.91% 0.770 0.070 - -22.22% -
473.astar (max) -79.12% 297.000 62.000 - 1.64% -
473.astar (max) (percentage) -79.04% 2.290 0.480 - 2.13% -
410.bwaves (unexplained diff vs previous) -52.79% 233.000 110.000 - -57.20% -
483.xalancbmk (unexplained diff vs previous) -52.78% 72.000 34.000 - -30.61% -
410.bwaves (unexplained diff vs previous) (percentage) -52.56% 1.560 0.740 - -57.47% -
483.xalancbmk (unexplained diff vs previous) (percentage) -52.27% 0.880 0.420 - -31.15% -
458.sjeng (unexplained diff vs previous) -51.52% 66.000 32.000 - -33.33% -
458.sjeng (unexplained diff vs previous) (percentage) -51.22% 0.410 0.200 - -33.33% -
445.gobmk (unexplained diff vs previous) -37.14% 35.000 22.000 - 22.22% -
445.gobmk (unexplained diff vs previous) (percentage) -35.71% 0.280 0.180 - 20.00% -
429.mcf (max) -25.84% 89.000 66.000 - 78.38% -
436.cactusADM (max) -25.12% 1254.000 939.000 - -23.72% -
482.sphinx3 (unexplained diff vs previous) (percentage) -25.07% 3.470 2.600 - -15.03% -
429.mcf (max) (percentage) -25.00% 0.760 0.570 - 78.12% -
444.namd (max) (percentage) -25.00% 5.000 3.750 - -31.94% -
436.cactusADM (max) (percentage) -24.95% 5.130 3.850 - -23.76% -
444.namd (max) -24.75% 796.000 599.000 - -31.85% -
482.sphinx3 (unexplained diff vs previous) -22.90% 1262.000 973.000 - -12.97% -
435.gromacs -20.00% 380.000 304.000 - 90.00% -
435.gromacs (avg) -20.00% 380.000 304.000 - 90.00% -
435.gromacs (avg) (percentage) -19.91% 2.260 1.810 - 90.53% -
483.xalancbmk (max) -18.06% 72.000 59.000 - -19.18% -
450.soplex -17.98% 89.000 73.000 - 97.30% -
450.soplex (avg) -17.98% 89.000 73.000 - 97.30% -
445.gobmk (max) (percentage) -17.86% 0.280 0.230 - -14.81% -
445.gobmk (max) -17.65% 34.000 28.000 - -15.15% -
450.soplex (avg) (percentage) -17.54% 0.570 0.470 - 95.83% -
483.xalancbmk (max) (percentage) -17.05% 0.880 0.730 - -20.65% -
444.namd (avg) (percentage) -16.34% 4.650 3.890 - 49.62% -
444.namd -16.08% 740.000 621.000 - 50.00% -
444.namd (avg) -16.08% 740.000 621.000 - 50.00% -
434.zeusmp -16.01% 356.000 299.000 - 17.25% -
434.zeusmp (avg) -16.01% 356.000 299.000 - 17.25% -
429.mcf -15.94% 251.000 211.000 - 276.79% -
429.mcf (avg) -15.94% 251.000 211.000 - 276.79% -
429.mcf (avg) (percentage) -15.89% 2.140 1.800 - 275.00% -
434.zeusmp (avg) (percentage) -15.88% 1.700 1.430 - 17.21% -
436.cactusADM -15.74% 921.000 776.000 - 32.65% -
436.cactusADM (avg) -15.74% 921.000 776.000 - 32.65% -
416.gamess -15.74% 756.000 637.000 - 31.34% -
416.gamess (avg) -15.74% 756.000 637.000 - 31.34% -
436.cactusADM (avg) (percentage) -15.65% 3.770 3.180 - 32.50% -
416.gamess (avg) (percentage) -15.56% 2.570 2.170 - 31.52% -
464.h264ref -15.18% 191.000 162.000 - 174.58% -
464.h264ref (avg) -15.18% 191.000 162.000 - 174.58% -
464.h264ref (avg) (percentage) -14.96% 1.270 1.080 - 176.92% -
483.xalancbmk (avg) (percentage) -14.38% 1.460 1.250 - 123.21% -
483.xalancbmk -14.29% 119.000 102.000 - 131.82% -
483.xalancbmk (avg) -14.29% 119.000 102.000 - 131.82% -
458.sjeng -13.74% 131.000 113.000 - 213.89% -
458.sjeng (avg) -13.74% 131.000 113.000 - 213.89% -
458.sjeng (avg) (percentage) -13.58% 0.810 0.700 - 204.35% -
401.bzip2 (max) -13.46% 52.000 45.000 - -32.84% -
401.bzip2 (avg) (percentage) -13.16% 0.760 0.660 - 144.44% -
471.omnetpp (avg) (percentage) -13.16% 2.280 1.980 - 67.80% -
401.bzip2 (max) (percentage) -12.90% 0.310 0.270 - -32.50% -
433.milc -12.79% 172.000 150.000 - 59.57% -
433.milc (avg) -12.79% 172.000 150.000 - 59.57% -
433.milc (avg) (percentage) -12.70% 1.260 1.100 - 59.42% -
471.omnetpp -12.68% 205.000 179.000 - 64.22% -
471.omnetpp (avg) -12.68% 205.000 179.000 - 64.22% -
416.gamess (max) -12.54% 877.000 767.000 - -16.90% -
401.bzip2 -12.50% 128.000 112.000 - 148.89% -
401.bzip2 (avg) -12.50% 128.000 112.000 - 148.89% -
416.gamess (max) (percentage) -12.42% 2.980 2.610 - -16.88% -
447.dealII -12.26% 106.000 93.000 - 17.72% -
447.dealII (avg) -12.26% 106.000 93.000 - 17.72% -
447.dealII (avg) (percentage) -11.97% 1.170 1.030 - 18.39% -
410.bwaves -10.38% 260.000 233.000 - -19.38% -
410.bwaves (avg) -10.38% 260.000 233.000 - -19.38% -
435.gromacs (max) -10.03% 289.000 260.000 - -12.16% -
453.povray (max) (percentage) -10.00% 1.800 1.620 - -37.45% -
435.gromacs (max) (percentage) -9.88% 1.720 1.550 - -11.93% -
450.soplex (max) (percentage) -9.80% 0.510 0.460 - 4.55% -
410.bwaves (avg) (percentage) -9.71% 1.750 1.580 - -19.39% -
410.bwaves (max) -9.49% 295.000 267.000 - 2.69% -
462.libquantum -8.97% 78.000 71.000 - 121.88% -
462.libquantum (avg) -8.97% 78.000 71.000 - 121.88% -
434.zeusmp (max) -8.91% 404.000 368.000 - -23.49% -
450.soplex (max) -8.86% 79.000 72.000 - 4.35% -
434.zeusmp (max) (percentage) -8.81% 1.930 1.760 - -23.48% -
462.libquantum (avg) (percentage) -8.70% 0.460 0.420 - 121.05% -
410.bwaves (max) (percentage) -8.59% 1.980 1.810 - 2.26% -
482.sphinx3 (max) (percentage) -8.58% 3.380 3.090 - -1.90% -
453.povray (max) -8.33% 132.000 121.000 - -36.65% -
464.h264ref (max) -8.33% 72.000 66.000 - 11.86% -
464.h264ref (max) (percentage) -8.33% 0.480 0.440 - 12.82% -
456.hmmer -8.26% 109.000 100.000 - 78.57% -
456.hmmer (avg) -8.26% 109.000 100.000 - 78.57% -
445.gobmk (avg) (percentage) -8.00% 0.250 0.230 - 4.55% -
456.hmmer (max) -7.32% 123.000 114.000 - 16.33% -
456.hmmer (avg) (percentage) -7.27% 0.550 0.510 - 70.00% -
433.milc (max) -7.14% 182.000 169.000 - 74.23% -
433.milc (max) (percentage) -6.77% 1.330 1.240 - 74.65% -
445.gobmk -6.67% 30.000 28.000 - 3.70% -
445.gobmk (avg) -6.67% 30.000 28.000 - 3.70% -
456.hmmer (max) (percentage) -6.45% 0.620 0.580 - 11.54% -
447.dealII (max) (percentage) -6.29% 1.430 1.340 - -18.79% -
447.dealII (max) -6.15% 130.000 122.000 - -18.67% -
481.wrf (unexplained diff vs previous) (percentage) -6.11% 4.580 4.300 - 5.65% -
482.sphinx3 (max) -6.10% 1229.000 1154.000 - 0.17% -
473.astar (avg) (percentage) -5.71% 0.700 0.660 - 65.00% -
482.sphinx3 (avg) (percentage) -5.68% 4.050 3.820 - 62.55% -
473.astar -5.56% 90.000 85.000 - 66.67% -
473.astar (avg) -5.56% 90.000 85.000 - 66.67% -
454.calculix (unexplained diff vs previous) (percentage) -4.13% 5.810 5.570 - 642.67% -
465.tonto (max) (percentage) -3.91% 1.280 1.230 - -28.07% -
465.tonto (avg) (percentage) -3.20% 1.250 1.210 - 6.14% -
482.sphinx3 -3.12% 1473.000 1427.000 - 66.12% -
482.sphinx3 (avg) -3.12% 1473.000 1427.000 - 66.12% -
465.tonto (max) -3.05% 131.000 127.000 - -43.05% -
462.libquantum (max) -2.99% 469.000 455.000 - 3400.00% -
458.sjeng (max) -2.96% 406.000 394.000 - 720.83% -
462.libquantum (max) (percentage) -2.89% 2.770 2.690 - 3262.50% -
458.sjeng (max) (percentage) -2.79% 2.510 2.440 - 713.33% -
465.tonto -2.34% 128.000 125.000 - -15.54% -
465.tonto (avg) -2.34% 128.000 125.000 - -15.54% -
481.wrf (unexplained diff vs previous) -1.69% 1005.000 988.000 - 10.51% -
473.astar (unexplained diff vs previous) -1.56% 64.000 63.000 - 3.28% -

Added Tests - sample variability
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 2.31% 141060.000 144324.000 - 0.00% -
450.soplex 1.10% 135596.000 137094.000 - 0.00% -
459.GemsFDTD 1.10% 195766.000 197910.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm 5.63% 16312.000 17230.000 - 7.75% -
481.wrf 4.37% 21991.000 22953.000 - 4.50% -
456.hmmer 4.18% 18995.000 19789.000 - -0.32% -
437.leslie3d 3.70% 18070.000 18739.000 - 3.22% -
459.GemsFDTD 2.63% 25364.000 26032.000 - 2.76% -
482.sphinx3 2.11% 36586.000 37358.000 - 2.67% -
483.xalancbmk 1.93% 8027.000 8182.000 - -0.41% -
453.povray 1.61% 7395.000 7514.000 - 2.01% -
458.sjeng 1.01% 16018.000 16180.000 - -0.20% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) 3400.00% 13.000 455.000 - -2.99% -
462.libquantum (max) (percentage) 3262.50% 0.080 2.690 - -2.89% -
458.sjeng (max) 720.83% 48.000 394.000 - -2.96% -
458.sjeng (max) (percentage) 713.33% 0.300 2.440 - -2.79% -
454.calculix (unexplained diff vs previous) (percentage) 642.67% 0.750 5.570 - -4.13% -
454.calculix (max) (percentage) 602.38% 0.840 5.900 - 7.47% -
454.calculix (unexplained diff vs previous) 587.30% 244.000 1677.000 - 1.57% -
454.calculix (max) 552.94% 272.000 1776.000 - 13.85% -
429.mcf 276.79% 56.000 211.000 - -15.94% -
429.mcf (avg) 276.79% 56.000 211.000 - -15.94% -
429.mcf (avg) (percentage) 275.00% 0.480 1.800 - -15.89% -
458.sjeng 213.89% 36.000 113.000 - -13.74% -
458.sjeng (avg) 213.89% 36.000 113.000 - -13.74% -
400.perlbench (unexplained diff vs previous) (percentage) 212.90% 0.310 0.970 - 9600.00% -
437.leslie3d (unexplained diff vs previous) 212.30% 187.000 584.000 - 44.20% -
400.perlbench (unexplained diff vs previous) 211.43% 35.000 109.000 - 10800.00% -
458.sjeng (avg) (percentage) 204.35% 0.230 0.700 - -13.58% -
437.leslie3d (unexplained diff vs previous) (percentage) 202.91% 1.030 3.120 - 39.91% -
464.h264ref (avg) (percentage) 176.92% 0.390 1.080 - -14.96% -
464.h264ref 174.58% 59.000 162.000 - -15.18% -
464.h264ref (avg) 174.58% 59.000 162.000 - -15.18% -
454.calculix (avg) (percentage) 158.62% 2.030 5.250 - 3.35% -
401.bzip2 148.89% 45.000 112.000 - -12.50% -
401.bzip2 (avg) 148.89% 45.000 112.000 - -12.50% -
401.bzip2 (avg) (percentage) 144.44% 0.270 0.660 - -13.16% -
454.calculix 139.76% 659.000 1580.000 - 9.42% -
454.calculix (avg) 139.76% 659.000 1580.000 - 9.42% -
483.xalancbmk 131.82% 44.000 102.000 - -14.29% -
483.xalancbmk (avg) 131.82% 44.000 102.000 - -14.29% -
462.libquantum (unexplained diff vs previous) (percentage) 125.00% 0.080 0.180 - 350.00% -
483.xalancbmk (avg) (percentage) 123.21% 0.560 1.250 - -14.38% -
462.libquantum 121.88% 32.000 71.000 - -8.97% -
462.libquantum (avg) 121.88% 32.000 71.000 - -8.97% -
462.libquantum (unexplained diff vs previous) 121.43% 14.000 31.000 - 342.86% -
462.libquantum (avg) (percentage) 121.05% 0.190 0.420 - -8.70% -
450.soplex 97.30% 37.000 73.000 - -17.98% -
450.soplex (avg) 97.30% 37.000 73.000 - -17.98% -
450.soplex (avg) (percentage) 95.83% 0.240 0.470 - -17.54% -
435.gromacs (avg) (percentage) 90.53% 0.950 1.810 - -19.91% -
435.gromacs 90.00% 160.000 304.000 - -20.00% -
435.gromacs (avg) 90.00% 160.000 304.000 - -20.00% -
459.GemsFDTD 84.66% 352.000 650.000 - 6.04% -
459.GemsFDTD (avg) 84.66% 352.000 650.000 - 6.04% -
403.gcc 81.58% 38.000 69.000 - 0.00% -
403.gcc (avg) 81.58% 38.000 69.000 - 0.00% -
403.gcc (avg) (percentage) 81.40% 0.430 0.780 - 1.30% -
459.GemsFDTD (avg) (percentage) 79.86% 1.390 2.500 - 3.31% -
456.hmmer 78.57% 56.000 100.000 - -8.26% -
456.hmmer (avg) 78.57% 56.000 100.000 - -8.26% -
429.mcf (max) 78.38% 37.000 66.000 - -25.84% -
429.mcf (max) (percentage) 78.12% 0.320 0.570 - -25.00% -
433.milc (max) (percentage) 74.65% 0.710 1.240 - -6.77% -
433.milc (max) 74.23% 97.000 169.000 - -7.14% -
456.hmmer (avg) (percentage) 70.00% 0.300 0.510 - -7.27% -
471.omnetpp (avg) (percentage) 67.80% 1.180 1.980 - -13.16% -
473.astar 66.67% 51.000 85.000 - -5.56% -
473.astar (avg) 66.67% 51.000 85.000 - -5.56% -
482.sphinx3 66.12% 859.000 1427.000 - -3.12% -
482.sphinx3 (avg) 66.12% 859.000 1427.000 - -3.12% -
453.povray 65.49% 113.000 187.000 - 1.63% -
453.povray (avg) 65.49% 113.000 187.000 - 1.63% -
481.wrf 65.31% 565.000 934.000 - 8.86% -
481.wrf (avg) 65.31% 565.000 934.000 - 8.86% -
473.astar (avg) (percentage) 65.00% 0.400 0.660 - -5.71% -
471.omnetpp 64.22% 109.000 179.000 - -12.68% -
471.omnetpp (avg) 64.22% 109.000 179.000 - -12.68% -
453.povray (avg) (percentage) 63.40% 1.530 2.500 - 0.00% -
482.sphinx3 (avg) (percentage) 62.55% 2.350 3.820 - -5.68% -
433.milc 59.57% 94.000 150.000 - -12.79% -
433.milc (avg) 59.57% 94.000 150.000 - -12.79% -
433.milc (avg) (percentage) 59.42% 0.690 1.100 - -12.70% -
481.wrf (avg) (percentage) 58.37% 2.570 4.070 - 4.09% -
470.lbm (unexplained diff vs previous) 50.85% 822.000 1240.000 - 7.73% -
444.namd 50.00% 414.000 621.000 - -16.08% -
444.namd (avg) 50.00% 414.000 621.000 - -16.08% -
444.namd (avg) (percentage) 49.62% 2.600 3.890 - -16.34% -
470.lbm (max) 49.50% 893.000 1335.000 - 24.53% -
470.lbm (unexplained diff vs previous) (percentage) 42.86% 5.040 7.200 - 0.00% -
470.lbm (max) (percentage) 41.42% 5.480 7.750 - 15.50% -
470.lbm 40.13% 608.000 852.000 - 21.54% -
470.lbm (avg) 40.13% 608.000 852.000 - 21.54% -
403.gcc (unexplained diff vs previous) 36.54% 52.000 71.000 - 222.73% -
403.gcc (unexplained diff vs previous) (percentage) 36.21% 0.580 0.790 - 229.17% -
403.gcc (max) 34.62% 52.000 70.000 - 22.81% -
403.gcc (max) (percentage) 33.90% 0.590 0.790 - 23.44% -
437.leslie3d 33.55% 301.000 402.000 - 14.86% -
437.leslie3d (avg) 33.55% 301.000 402.000 - 14.86% -
470.lbm (avg) (percentage) 32.71% 3.730 4.950 - 12.76% -
436.cactusADM 32.65% 585.000 776.000 - -15.74% -
436.cactusADM (avg) 32.65% 585.000 776.000 - -15.74% -
436.cactusADM (avg) (percentage) 32.50% 2.400 3.180 - -15.65% -
416.gamess (avg) (percentage) 31.52% 1.650 2.170 - -15.56% -
416.gamess 31.34% 485.000 637.000 - -15.74% -
416.gamess (avg) 31.34% 485.000 637.000 - -15.74% -
437.leslie3d (avg) (percentage) 28.74% 1.670 2.150 - 11.40% -
459.GemsFDTD (max) 24.22% 578.000 718.000 - 47.13% -
445.gobmk (unexplained diff vs previous) 22.22% 18.000 22.000 - -37.14% -
459.GemsFDTD (max) (percentage) 21.05% 2.280 2.760 - 43.01% -
400.perlbench (max) 20.22% 89.000 107.000 - 268.97% -
445.gobmk (unexplained diff vs previous) (percentage) 20.00% 0.150 0.180 - -35.71% -
400.perlbench (max) (percentage) 20.00% 0.800 0.960 - 269.23% -
459.GemsFDTD (unexplained diff vs previous) 19.86% 584.000 700.000 - 0.00% -
447.dealII (avg) (percentage) 18.39% 0.870 1.030 - -11.97% -
447.dealII 17.72% 79.000 93.000 - -12.26% -
447.dealII (avg) 17.72% 79.000 93.000 - -12.26% -
434.zeusmp 17.25% 255.000 299.000 - -16.01% -
434.zeusmp (avg) 17.25% 255.000 299.000 - -16.01% -
434.zeusmp (avg) (percentage) 17.21% 1.220 1.430 - -15.88% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 16.96% 2.300 2.690 - 0.00% -
456.hmmer (max) 16.33% 98.000 114.000 - -7.32% -
481.wrf (max) 12.91% 914.000 1032.000 - 7.28% -
464.h264ref (max) (percentage) 12.82% 0.390 0.440 - -8.33% -
464.h264ref (max) 11.86% 59.000 66.000 - -8.33% -
456.hmmer (max) (percentage) 11.54% 0.520 0.580 - -6.45% -
481.wrf (unexplained diff vs previous) 10.51% 894.000 988.000 - -1.69% -
481.wrf (max) (percentage) 8.17% 4.160 4.500 - 2.74% -
437.leslie3d (max) 7.68% 560.000 603.000 - 46.00% -
465.tonto (avg) (percentage) 6.14% 1.140 1.210 - -3.20% -
481.wrf (unexplained diff vs previous) (percentage) 5.65% 4.070 4.300 - -6.11% -
445.gobmk (avg) (percentage) 4.55% 0.220 0.230 - -8.00% -
450.soplex (max) (percentage) 4.55% 0.440 0.460 - -9.80% -
450.soplex (max) 4.35% 69.000 72.000 - -8.86% -
473.astar (unexplained diff vs previous) (percentage) 4.26% 0.470 0.490 - 0.00% -
437.leslie3d (max) (percentage) 3.87% 3.100 3.220 - 41.23% -
445.gobmk 3.70% 27.000 28.000 - -6.67% -
445.gobmk (avg) 3.70% 27.000 28.000 - -6.67% -
473.astar (unexplained diff vs previous) 3.28% 61.000 63.000 - -1.56% -
410.bwaves (max) 2.69% 260.000 267.000 - -9.49% -
400.perlbench (avg) (percentage) 2.56% 0.390 0.400 - 48.15% -
400.perlbench 2.33% 43.000 44.000 - 46.67% -
400.perlbench (avg) 2.33% 43.000 44.000 - 46.67% -
410.bwaves (max) (percentage) 2.26% 1.770 1.810 - -8.59% -
473.astar (max) (percentage) 2.13% 0.470 0.480 - -79.04% -
473.astar (max) 1.64% 61.000 62.000 - -79.12% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -20.64% 13044.000 10352.000 - 1.09% -
454.calculix -7.35% 32491.000 30104.000 - 5.90% -
471.omnetpp -2.15% 9265.000 9066.000 - 0.50% -
464.h264ref -1.25% 15208.000 15018.000 - -0.31% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex (unexplained diff vs previous) (percentage) -97.73% 0.440 0.010 - -96.30% -
434.zeusmp (unexplained diff vs previous) -97.45% 470.000 12.000 - -96.85% -
434.zeusmp (unexplained diff vs previous) (percentage) -97.33% 2.250 0.060 - -96.70% -
450.soplex (unexplained diff vs previous) -97.10% 69.000 2.000 - -95.24% -
436.cactusADM (unexplained diff vs previous) -96.33% 1173.000 43.000 - -96.40% -
436.cactusADM (unexplained diff vs previous) (percentage) -96.26% 4.810 0.180 - -96.31% -
435.gromacs (unexplained diff vs previous) (percentage) -95.95% 1.730 0.070 - -95.86% -
435.gromacs (unexplained diff vs previous) -95.89% 292.000 12.000 - -95.79% -
416.gamess (unexplained diff vs previous) (percentage) -94.43% 3.050 0.170 - -94.14% -
416.gamess (unexplained diff vs previous) -94.42% 896.000 50.000 - -94.14% -
444.namd (unexplained diff vs previous) -92.93% 834.000 59.000 - -92.22% -
444.namd (unexplained diff vs previous) (percentage) -92.93% 5.230 0.370 - -92.23% -
471.omnetpp (max) -73.84% 172.000 45.000 - 21.62% -
471.omnetpp (max) (percentage) -73.12% 1.860 0.500 - 19.05% -
433.milc (unexplained diff vs previous) -60.42% 96.000 38.000 - 153.33% -
447.dealII (unexplained diff vs previous) -60.29% 68.000 27.000 - 107.69% -
433.milc (unexplained diff vs previous) (percentage) -60.00% 0.700 0.280 - 154.55% -
447.dealII (unexplained diff vs previous) (percentage) -60.00% 0.750 0.300 - 114.29% -
410.bwaves (unexplained diff vs previous) (percentage) -57.47% 1.740 0.740 - -52.56% -
410.bwaves (unexplained diff vs previous) -57.20% 257.000 110.000 - -52.79% -
401.bzip2 (unexplained diff vs previous) -49.28% 69.000 35.000 - 1650.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -48.78% 0.410 0.210 - 2000.00% -
465.tonto (max) -43.05% 223.000 127.000 - -3.05% -
456.hmmer (unexplained diff vs previous) (percentage) -38.46% 0.520 0.320 - 23.08% -
453.povray (max) (percentage) -37.45% 2.590 1.620 - -10.00% -
453.povray (max) -36.65% 191.000 121.000 - -8.33% -
456.hmmer (unexplained diff vs previous) -34.69% 98.000 64.000 - 25.49% -
458.sjeng (unexplained diff vs previous) -33.33% 48.000 32.000 - -51.52% -
458.sjeng (unexplained diff vs previous) (percentage) -33.33% 0.300 0.200 - -51.22% -
401.bzip2 (max) -32.84% 67.000 45.000 - -13.46% -
401.bzip2 (max) (percentage) -32.50% 0.400 0.270 - -12.90% -
444.namd (max) (percentage) -31.94% 5.510 3.750 - -25.00% -
444.namd (max) -31.85% 879.000 599.000 - -24.75% -
483.xalancbmk (unexplained diff vs previous) (percentage) -31.15% 0.610 0.420 - -52.27% -
483.xalancbmk (unexplained diff vs previous) -30.61% 49.000 34.000 - -52.78% -
465.tonto (max) (percentage) -28.07% 1.710 1.230 - -3.91% -
471.omnetpp (unexplained diff vs previous) -27.42% 62.000 45.000 - 66.67% -
471.omnetpp (unexplained diff vs previous) (percentage) -25.37% 0.670 0.500 - 66.67% -
465.tonto (unexplained diff vs previous) -24.32% 148.000 112.000 - 0.00% -
436.cactusADM (max) (percentage) -23.76% 5.050 3.850 - -24.95% -
436.cactusADM (max) -23.72% 1231.000 939.000 - -25.12% -
434.zeusmp (max) -23.49% 481.000 368.000 - -8.91% -
434.zeusmp (max) (percentage) -23.48% 2.300 1.760 - -8.81% -
429.mcf (unexplained diff vs previous) (percentage) -22.22% 0.090 0.070 - -90.91% -
464.h264ref (unexplained diff vs previous) -20.69% 58.000 46.000 - 53.33% -
483.xalancbmk (max) (percentage) -20.65% 0.920 0.730 - -17.05% -
429.mcf (unexplained diff vs previous) -20.00% 10.000 8.000 - -91.11% -
410.bwaves (avg) (percentage) -19.39% 1.960 1.580 - -9.71% -
410.bwaves -19.38% 289.000 233.000 - -10.38% -
410.bwaves (avg) -19.38% 289.000 233.000 - -10.38% -
483.xalancbmk (max) -19.18% 73.000 59.000 - -18.06% -
447.dealII (max) (percentage) -18.79% 1.650 1.340 - -6.29% -
447.dealII (max) -18.67% 150.000 122.000 - -6.15% -
464.h264ref (unexplained diff vs previous) (percentage) -18.42% 0.380 0.310 - 55.00% -
416.gamess (max) -16.90% 923.000 767.000 - -12.54% -
416.gamess (max) (percentage) -16.88% 3.140 2.610 - -12.42% -
465.tonto -15.54% 148.000 125.000 - -2.34% -
465.tonto (avg) -15.54% 148.000 125.000 - -2.34% -
445.gobmk (max) -15.15% 33.000 28.000 - -17.65% -
482.sphinx3 (unexplained diff vs previous) (percentage) -15.03% 3.060 2.600 - -25.07% -
445.gobmk (max) (percentage) -14.81% 0.270 0.230 - -17.86% -
482.sphinx3 (unexplained diff vs previous) -12.97% 1118.000 973.000 - -22.90% -
435.gromacs (max) -12.16% 296.000 260.000 - -10.03% -
435.gromacs (max) (percentage) -11.93% 1.760 1.550 - -9.88% -
465.tonto (unexplained diff vs previous) (percentage) -4.42% 1.130 1.080 - 0.00% -
482.sphinx3 (max) (percentage) -1.90% 3.150 3.090 - -8.58% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 11219.000 -
401.bzip2 17000.000 -
403.gcc 8950.000 -
410.bwaves 14801.000 -
416.gamess 29389.000 -
429.mcf 11738.000 -
433.milc 13669.000 -
434.zeusmp 20933.000 -
435.gromacs 16813.000 -
436.cactusADM 24406.000 -
437.leslie3d 18739.000 3.22%
444.namd 15980.000 -
445.gobmk 12355.000 -
447.dealII 9122.000 -
450.soplex 15675.000 -
453.povray 7514.000 2.01%
454.calculix 30104.000 5.90%
456.hmmer 19789.000 -
458.sjeng 16180.000 -
459.GemsFDTD 26032.000 2.76%
462.libquantum 16935.000 -
464.h264ref 15018.000 -
465.tonto 10352.000 1.09%
470.lbm 17230.000 7.75%
471.omnetpp 9066.000 -
473.astar 12928.000 -
481.wrf 22953.000 4.50%
482.sphinx3 37358.000 2.67%
483.xalancbmk 8182.000 -
Geometric Mean 15575.245 -
Code Size (bytes)
Name Current %
400.perlbench 563663.000 -
401.bzip2 33660.000 -
403.gcc 1585625.000 -
410.bwaves 14714.000 -
416.gamess 4554456.000 -
429.mcf 7709.000 -
433.milc 47497.000 -
434.zeusmp 144324.000 -
435.gromacs 395282.000 -
436.cactusADM 257008.000 -
437.leslie3d 48073.000 -
444.namd 162762.000 -
445.gobmk 1088320.000 -
447.dealII 191138.000 -
450.soplex 137094.000 -
453.povray 489119.000 -
454.calculix 682043.000 -
456.hmmer 74993.000 -
458.sjeng 81161.000 -
459.GemsFDTD 197910.000 -
462.libquantum 13106.000 -
464.h264ref 301290.000 -
465.tonto 1438029.000 -
470.lbm 10845.000 -
471.omnetpp 297268.000 -
473.astar 15549.000 -
481.wrf 1540595.000 -
482.sphinx3 80002.000 -
483.xalancbmk 1460034.000 -
Geometric Mean 170181.409 -
sample variability
Name Current %
400.perlbench 44.000 46.67%
400.perlbench (avg) 44.000 46.67%
400.perlbench (avg) (percentage) 0.400 48.15%
400.perlbench (max) 107.000 268.97%
400.perlbench (max) (percentage) 0.960 269.23%
400.perlbench (unexplained diff vs previous) 109.000 10800.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.970 9600.00%
401.bzip2 112.000 -12.50%
401.bzip2 (avg) 112.000 -12.50%
401.bzip2 (avg) (percentage) 0.660 -13.16%
401.bzip2 (max) 45.000 -13.46%
401.bzip2 (max) (percentage) 0.270 -12.90%
401.bzip2 (unexplained diff vs previous) 35.000 1650.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.210 2000.00%
403.gcc 69.000 -
403.gcc (avg) 69.000 -
403.gcc (avg) (percentage) 0.780 1.30%
403.gcc (max) 70.000 22.81%
403.gcc (max) (percentage) 0.790 23.44%
403.gcc (unexplained diff vs previous) 71.000 222.73%
403.gcc (unexplained diff vs previous) (percentage) 0.790 229.17%
410.bwaves 233.000 -10.38%
410.bwaves (avg) 233.000 -10.38%
410.bwaves (avg) (percentage) 1.580 -9.71%
410.bwaves (max) 267.000 -9.49%
410.bwaves (max) (percentage) 1.810 -8.59%
410.bwaves (unexplained diff vs previous) 110.000 -52.79%
410.bwaves (unexplained diff vs previous) (percentage) 0.740 -52.56%
416.gamess 637.000 -15.74%
416.gamess (avg) 637.000 -15.74%
416.gamess (avg) (percentage) 2.170 -15.56%
416.gamess (max) 767.000 -12.54%
416.gamess (max) (percentage) 2.610 -12.42%
416.gamess (unexplained diff vs previous) 50.000 -94.14%
416.gamess (unexplained diff vs previous) (percentage) 0.170 -94.14%
429.mcf 211.000 -15.94%
429.mcf (avg) 211.000 -15.94%
429.mcf (avg) (percentage) 1.800 -15.89%
429.mcf (max) 66.000 -25.84%
429.mcf (max) (percentage) 0.570 -25.00%
429.mcf (unexplained diff vs previous) 8.000 -91.11%
429.mcf (unexplained diff vs previous) (percentage) 0.070 -90.91%
433.milc 150.000 -12.79%
433.milc (avg) 150.000 -12.79%
433.milc (avg) (percentage) 1.100 -12.70%
433.milc (max) 169.000 -7.14%
433.milc (max) (percentage) 1.240 -6.77%
433.milc (unexplained diff vs previous) 38.000 153.33%
433.milc (unexplained diff vs previous) (percentage) 0.280 154.55%
434.zeusmp 299.000 -16.01%
434.zeusmp (avg) 299.000 -16.01%
434.zeusmp (avg) (percentage) 1.430 -15.88%
434.zeusmp (max) 368.000 -8.91%
434.zeusmp (max) (percentage) 1.760 -8.81%
434.zeusmp (unexplained diff vs previous) 12.000 -96.85%
434.zeusmp (unexplained diff vs previous) (percentage) 0.060 -96.70%
435.gromacs 304.000 -20.00%
435.gromacs (avg) 304.000 -20.00%
435.gromacs (avg) (percentage) 1.810 -19.91%
435.gromacs (max) 260.000 -10.03%
435.gromacs (max) (percentage) 1.550 -9.88%
435.gromacs (unexplained diff vs previous) 12.000 -95.79%
435.gromacs (unexplained diff vs previous) (percentage) 0.070 -95.86%
436.cactusADM 776.000 -15.74%
436.cactusADM (avg) 776.000 -15.74%
436.cactusADM (avg) (percentage) 3.180 -15.65%
436.cactusADM (max) 939.000 -25.12%
436.cactusADM (max) (percentage) 3.850 -24.95%
436.cactusADM (unexplained diff vs previous) 43.000 -96.40%
436.cactusADM (unexplained diff vs previous) (percentage) 0.180 -96.31%
437.leslie3d 402.000 14.86%
437.leslie3d (avg) 402.000 14.86%
437.leslie3d (avg) (percentage) 2.150 11.40%
437.leslie3d (max) 603.000 46.00%
437.leslie3d (max) (percentage) 3.220 41.23%
437.leslie3d (unexplained diff vs previous) 584.000 44.20%
437.leslie3d (unexplained diff vs previous) (percentage) 3.120 39.91%
444.namd 621.000 -16.08%
444.namd (avg) 621.000 -16.08%
444.namd (avg) (percentage) 3.890 -16.34%
444.namd (max) 599.000 -24.75%
444.namd (max) (percentage) 3.750 -25.00%
444.namd (unexplained diff vs previous) 59.000 -92.22%
444.namd (unexplained diff vs previous) (percentage) 0.370 -92.23%
445.gobmk 28.000 -6.67%
445.gobmk (avg) 28.000 -6.67%
445.gobmk (avg) (percentage) 0.230 -8.00%
445.gobmk (max) 28.000 -17.65%
445.gobmk (max) (percentage) 0.230 -17.86%
445.gobmk (unexplained diff vs previous) 22.000 -37.14%
445.gobmk (unexplained diff vs previous) (percentage) 0.180 -35.71%
447.dealII 93.000 -12.26%
447.dealII (avg) 93.000 -12.26%
447.dealII (avg) (percentage) 1.030 -11.97%
447.dealII (max) 122.000 -6.15%
447.dealII (max) (percentage) 1.340 -6.29%
447.dealII (unexplained diff vs previous) 27.000 107.69%
447.dealII (unexplained diff vs previous) (percentage) 0.300 114.29%
450.soplex 73.000 -17.98%
450.soplex (avg) 73.000 -17.98%
450.soplex (avg) (percentage) 0.470 -17.54%
450.soplex (max) 72.000 -8.86%
450.soplex (max) (percentage) 0.460 -9.80%
450.soplex (unexplained diff vs previous) 2.000 -95.24%
450.soplex (unexplained diff vs previous) (percentage) 0.010 -96.30%
453.povray 187.000 1.63%
453.povray (avg) 187.000 1.63%
453.povray (avg) (percentage) 2.500 -
453.povray (max) 121.000 -8.33%
453.povray (max) (percentage) 1.620 -10.00%
454.calculix 1580.000 9.42%
454.calculix (avg) 1580.000 9.42%
454.calculix (avg) (percentage) 5.250 3.35%
454.calculix (max) 1776.000 13.85%
454.calculix (max) (percentage) 5.900 7.47%
454.calculix (unexplained diff vs previous) 1677.000 1.57%
454.calculix (unexplained diff vs previous) (percentage) 5.570 -4.13%
456.hmmer 100.000 -8.26%
456.hmmer (avg) 100.000 -8.26%
456.hmmer (avg) (percentage) 0.510 -7.27%
456.hmmer (max) 114.000 -7.32%
456.hmmer (max) (percentage) 0.580 -6.45%
456.hmmer (unexplained diff vs previous) 64.000 25.49%
456.hmmer (unexplained diff vs previous) (percentage) 0.320 23.08%
458.sjeng 113.000 -13.74%
458.sjeng (avg) 113.000 -13.74%
458.sjeng (avg) (percentage) 0.700 -13.58%
458.sjeng (max) 394.000 -2.96%
458.sjeng (max) (percentage) 2.440 -2.79%
458.sjeng (unexplained diff vs previous) 32.000 -51.52%
458.sjeng (unexplained diff vs previous) (percentage) 0.200 -51.22%
459.GemsFDTD 650.000 6.04%
459.GemsFDTD (avg) 650.000 6.04%
459.GemsFDTD (avg) (percentage) 2.500 3.31%
459.GemsFDTD (max) 718.000 47.13%
459.GemsFDTD (max) (percentage) 2.760 43.01%
459.GemsFDTD (unexplained diff vs previous) 700.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.690 -
462.libquantum 71.000 -8.97%
462.libquantum (avg) 71.000 -8.97%
462.libquantum (avg) (percentage) 0.420 -8.70%
462.libquantum (max) 455.000 -2.99%
462.libquantum (max) (percentage) 2.690 -2.89%
462.libquantum (unexplained diff vs previous) 31.000 342.86%
462.libquantum (unexplained diff vs previous) (percentage) 0.180 350.00%
464.h264ref 162.000 -15.18%
464.h264ref (avg) 162.000 -15.18%
464.h264ref (avg) (percentage) 1.080 -14.96%
464.h264ref (max) 66.000 -8.33%
464.h264ref (max) (percentage) 0.440 -8.33%
464.h264ref (unexplained diff vs previous) 46.000 53.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.310 55.00%
465.tonto 125.000 -2.34%
465.tonto (avg) 125.000 -2.34%
465.tonto (avg) (percentage) 1.210 -3.20%
465.tonto (max) 127.000 -3.05%
465.tonto (max) (percentage) 1.230 -3.91%
465.tonto (unexplained diff vs previous) 112.000 -
465.tonto (unexplained diff vs previous) (percentage) 1.080 -
470.lbm 852.000 21.54%
470.lbm (avg) 852.000 21.54%
470.lbm (avg) (percentage) 4.950 12.76%
470.lbm (max) 1335.000 24.53%
470.lbm (max) (percentage) 7.750 15.50%
470.lbm (unexplained diff vs previous) 1240.000 7.73%
470.lbm (unexplained diff vs previous) (percentage) 7.200 -
471.omnetpp 179.000 -12.68%
471.omnetpp (avg) 179.000 -12.68%
471.omnetpp (avg) (percentage) 1.980 -13.16%
471.omnetpp (max) 45.000 21.62%
471.omnetpp (max) (percentage) 0.500 19.05%
471.omnetpp (unexplained diff vs previous) 45.000 66.67%
471.omnetpp (unexplained diff vs previous) (percentage) 0.500 66.67%
473.astar 85.000 -5.56%
473.astar (avg) 85.000 -5.56%
473.astar (avg) (percentage) 0.660 -5.71%
473.astar (max) 62.000 -79.12%
473.astar (max) (percentage) 0.480 -79.04%
473.astar (unexplained diff vs previous) 63.000 -1.56%
473.astar (unexplained diff vs previous) (percentage) 0.490 -
481.wrf 934.000 8.86%
481.wrf (avg) 934.000 8.86%
481.wrf (avg) (percentage) 4.070 4.09%
481.wrf (max) 1032.000 7.28%
481.wrf (max) (percentage) 4.500 2.74%
481.wrf (unexplained diff vs previous) 988.000 -1.69%
481.wrf (unexplained diff vs previous) (percentage) 4.300 -6.11%
482.sphinx3 1427.000 -3.12%
482.sphinx3 (avg) 1427.000 -3.12%
482.sphinx3 (avg) (percentage) 3.820 -5.68%
482.sphinx3 (max) 1154.000 -6.10%
482.sphinx3 (max) (percentage) 3.090 -8.58%
482.sphinx3 (unexplained diff vs previous) 973.000 -22.90%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.600 -25.07%
483.xalancbmk 102.000 -14.29%
483.xalancbmk (avg) 102.000 -14.29%
483.xalancbmk (avg) (percentage) 1.250 -14.38%
483.xalancbmk (max) 59.000 -18.06%
483.xalancbmk (max) (percentage) 0.730 -17.05%
483.xalancbmk (unexplained diff vs previous) 34.000 -52.78%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.420 -52.27%
Geometric Mean 17.992 -13.36%