Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5e39600a691e3ba76acf6ab94edb24844c2e82b7 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/4341106354c6a463ce3628a4ef9c1a1d37193b59 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=91689649656314b04f3dbee0415a9254eb1424dd (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=71897434024c86029bf47273558c0b8f82387f4a (+ 119 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/5/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0005 (v6.1.13-45595-g71897434024c) 2023-02-24T03:31:55 0:00:00
Previous 0004 (glibc-2.37.9000-00130-g91689649656) 2023-02-23T06:46:02 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 31 125
Performance Improvements 160 101
Added Tests 2 2
Unchanged Tests 1043 1008
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 4.92% 61.000 64.000 - -99.72% -
400.perlbench 3.38% 1626.000 1681.000 - -84.22% -
403.gcc 1.72% 58.000 59.000 - -99.35% -
450.soplex 1.57% 572.000 581.000 - -96.24% -
471.omnetpp 1.23% 2926.000 2962.000 - -72.42% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 811.76% 0.170 1.550 - -22.89% -
450.soplex (unexplained diff vs previous) 800.00% 1.000 9.000 - -97.11% -
436.cactusADM (unexplained diff vs previous) (percentage) 478.57% 0.140 0.810 - -75.08% -
436.cactusADM (unexplained diff vs previous) 466.67% 3.000 17.000 - -97.02% -
401.bzip2 (unexplained diff vs previous) (percentage) 285.11% 0.470 1.810 - 108.05% -
401.bzip2 (unexplained diff vs previous) 278.57% 14.000 53.000 - -59.85% -
416.gamess (unexplained diff vs previous) (percentage) 266.67% 0.030 0.110 - -96.31% -
416.gamess (unexplained diff vs previous) 250.00% 4.000 14.000 - -97.93% -
400.perlbench (unexplained diff vs previous) 205.56% 18.000 55.000 - -84.59% -
400.perlbench (unexplained diff vs previous) (percentage) 194.59% 1.110 3.270 - -2.39% -
471.omnetpp (unexplained diff vs previous) (percentage) 177.27% 0.440 1.220 - 408.33% -
471.omnetpp (unexplained diff vs previous) 176.92% 13.000 36.000 - 38.46% -
470.lbm (unexplained diff vs previous) (percentage) 114.29% 0.210 0.450 - 309.09% -
470.lbm (unexplained diff vs previous) 112.50% 8.000 17.000 - 21.43% -
410.bwaves (unexplained diff vs previous) 104.17% 24.000 49.000 - 226.67% -
410.bwaves (unexplained diff vs previous) (percentage) 102.50% 0.400 0.810 - 710.00% -
454.calculix (unexplained diff vs previous) 50.00% 2.000 3.000 - -40.00% -
481.wrf (unexplained diff vs previous) (percentage) 47.44% 0.780 1.150 - 71.64% -
481.wrf (unexplained diff vs previous) 46.51% 43.000 63.000 - -43.75% -
454.calculix (unexplained diff vs previous) (percentage) 42.99% 3.280 4.690 - 23350.00% -
445.gobmk (unexplained diff vs previous) (percentage) 12.90% 0.310 0.350 - -77.42% -
445.gobmk (unexplained diff vs previous) 12.50% 16.000 18.000 - -90.32% -
462.libquantum (unexplained diff vs previous) (percentage) 2.34% 2.140 2.190 - 21800.00% -
437.leslie3d (avg) (percentage) 1.36% 2.950 2.990 - 25.63% -
400.perlbench 1.01% 99.000 100.000 - -35.90% -
400.perlbench (avg) 1.01% 99.000 100.000 - -35.90% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.95% 11014.000 10579.000 - -29.50% -
462.libquantum -2.14% 140.000 137.000 - -98.82% -
401.bzip2 -1.78% 2980.000 2927.000 - -80.72% -
481.wrf -1.14% 5533.000 5470.000 - -67.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -94.12% 17.000 1.000 - -93.33% -
464.h264ref (unexplained diff vs previous) (percentage) -93.10% 0.290 0.020 - -80.00% -
435.gromacs (unexplained diff vs previous) -81.33% 166.000 31.000 - -90.25% -
435.gromacs (unexplained diff vs previous) (percentage) -81.25% 2.240 0.420 - -79.61% -
482.sphinx3 (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.46% -
482.sphinx3 (unexplained diff vs previous) (percentage) -74.42% 0.430 0.110 - -82.26% -
437.leslie3d (unexplained diff vs previous) -66.51% 1299.000 435.000 - 26.82% -
437.leslie3d (unexplained diff vs previous) (percentage) -65.14% 11.790 4.110 - 79.48% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -63.64% 0.440 0.160 - -23.81% -
465.tonto (unexplained diff vs previous) -63.11% 103.000 38.000 - -39.68% -
459.GemsFDTD (unexplained diff vs previous) -62.96% 27.000 10.000 - -79.17% -
465.tonto (unexplained diff vs previous) (percentage) -62.37% 0.930 0.350 - -54.55% -
434.zeusmp (unexplained diff vs previous) -52.94% 17.000 8.000 - -97.40% -
434.zeusmp (unexplained diff vs previous) (percentage) -52.94% 0.680 0.320 - -86.27% -
456.hmmer (unexplained diff vs previous) -47.37% 19.000 10.000 - -87.95% -
456.hmmer (unexplained diff vs previous) (percentage) -46.15% 0.650 0.350 - -53.33% -
444.namd (unexplained diff vs previous) (percentage) -34.15% 0.410 0.270 - -96.51% -
444.namd (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.71% -
458.sjeng (unexplained diff vs previous) -24.24% 33.000 25.000 - 177.78% -
458.sjeng (unexplained diff vs previous) (percentage) -23.81% 0.420 0.320 - 433.33% -
437.leslie3d (max) -15.93% 1161.000 976.000 - 178.06% -
462.libquantum -14.29% 7.000 6.000 - -92.00% -
462.libquantum (avg) -14.29% 7.000 6.000 - -92.00% -
401.bzip2 (max) -12.68% 1766.000 1542.000 - 1059.40% -
437.leslie3d (max) (percentage) -12.51% 10.550 9.230 - 294.44% -
462.libquantum (max) -12.17% 115.000 101.000 - 36.49% -
447.dealII (unexplained diff vs previous) (percentage) -12.09% 0.910 0.800 - 2.56% -
401.bzip2 (max) (percentage) -11.11% 59.290 52.700 - 5888.64% -
447.dealII (unexplained diff vs previous) -11.11% 18.000 16.000 - -78.95% -
471.omnetpp (max) (percentage) -11.11% 58.700 52.180 - 745.71% -
434.zeusmp (max) (percentage) -11.10% 61.600 54.760 - 2301.75% -
400.perlbench (max) (percentage) -11.10% 62.970 55.980 - 1627.78% -
481.wrf (max) -11.03% 3164.000 2815.000 - 431.13% -
434.zeusmp (max) -10.81% 1545.000 1378.000 - 357.81% -
433.milc (max) -10.73% 885.000 790.000 - 92.21% -
436.cactusADM (max) -10.68% 1564.000 1397.000 - 153.08% -
435.gromacs (max) -10.40% 3096.000 2774.000 - 791.96% -
444.namd (max) -10.34% 561.000 503.000 - -22.50% -
429.mcf (max) -10.09% 1179.000 1060.000 - 1052.17% -
416.gamess (max) -10.07% 4598.000 4135.000 - 530.34% -
471.omnetpp (max) -10.02% 1717.000 1545.000 - 133.38% -
470.lbm (max) (percentage) -10.01% 60.760 54.680 - 972.16% -
435.gromacs (max) (percentage) -10.00% 41.780 37.600 - 1761.39% -
481.wrf (max) (percentage) -10.00% 57.190 51.470 - 1533.97% -
462.libquantum (max) (percentage) -10.00% 82.500 74.250 - 11501.56% -
436.cactusADM (max) (percentage) -10.00% 74.100 66.690 - 2017.14% -
450.soplex (max) (percentage) -10.00% 80.130 72.120 - 3560.91% -
429.mcf (max) (percentage) -9.99% 77.250 69.530 - 12775.93% -
444.namd (max) (percentage) -9.99% 76.850 69.170 - 863.37% -
433.milc (max) (percentage) -9.99% 75.750 68.180 - 2050.79% -
410.bwaves (max) (percentage) -9.99% 50.740 45.670 - 21647.62% -
464.h264ref (max) (percentage) -9.99% 46.060 41.460 - 9541.86% -
459.GemsFDTD (max) (percentage) -9.99% 59.480 53.540 - 8823.33% -
464.h264ref (max) -9.98% 2705.000 2435.000 - 3827.42% -
416.gamess (max) (percentage) -9.98% 36.970 33.280 - 1051.56% -
459.GemsFDTD (max) -9.85% 3656.000 3296.000 - 2254.29% -
470.lbm (max) -9.59% 2262.000 2045.000 - 213.17% -
410.bwaves (max) -9.28% 3059.000 2775.000 - 9150.00% -
450.soplex (max) -8.52% 458.000 419.000 - 37.83% -
400.perlbench (max) -8.02% 1023.000 941.000 - 172.75% -
445.gobmk (max) -7.76% 2566.000 2367.000 - 1193.44% -
465.tonto (max) -7.73% 2174.000 2006.000 - 584.64% -
456.hmmer (max) -7.72% 1944.000 1794.000 - 1181.43% -
465.tonto (max) (percentage) -7.42% 19.680 18.220 - 408.94% -
445.gobmk (max) (percentage) -7.42% 49.480 45.810 - 2894.12% -
458.sjeng (max) (percentage) -7.42% 41.260 38.200 - 17263.64% -
473.astar (max) (percentage) -7.42% 57.450 53.190 - 37892.86% -
453.povray (max) (percentage) -7.41% 82.030 75.950 - 2901.98% -
454.calculix (max) (percentage) -7.41% 89.730 83.080 - 1667.66% -
482.sphinx3 (max) (percentage) -7.41% 86.900 80.460 - 5373.47% -
456.hmmer (max) (percentage) -7.40% 67.020 62.060 - 4786.61% -
453.povray (max) -7.40% 446.000 413.000 - 150.30% -
482.sphinx3 (max) -7.38% 813.000 753.000 - 71.53% -
458.sjeng (max) -7.11% 3208.000 2980.000 - 9512.90% -
473.astar (max) -6.72% 3376.000 3149.000 - 15645.00% -
416.gamess -6.29% 556.000 521.000 - 5.89% -
416.gamess (avg) -6.29% 556.000 521.000 - 5.89% -
416.gamess (avg) (percentage) -6.04% 4.470 4.200 - 93.55% -
447.dealII (max) (percentage) -5.78% 73.070 68.850 - 6159.09% -
465.tonto -5.57% 377.000 356.000 - 159.85% -
465.tonto (avg) -5.57% 377.000 356.000 - 159.85% -
453.povray -5.56% 36.000 34.000 - -58.02% -
453.povray (avg) -5.56% 36.000 34.000 - -58.02% -
453.povray (avg) (percentage) -5.45% 6.790 6.420 - 413.60% -
464.h264ref (avg) (percentage) -5.34% 3.930 3.720 - 588.89% -
465.tonto (avg) (percentage) -5.26% 3.420 3.240 - 94.01% -
464.h264ref -5.22% 230.000 218.000 - 179.49% -
464.h264ref (avg) -5.22% 230.000 218.000 - 179.49% -
482.sphinx3 -5.17% 58.000 55.000 - -87.39% -
482.sphinx3 (avg) -5.17% 58.000 55.000 - -87.39% -
481.wrf -5.10% 294.000 279.000 - -12.26% -
481.wrf (avg) -5.10% 294.000 279.000 - -12.26% -
435.gromacs -5.09% 334.000 317.000 - 19.17% -
435.gromacs (avg) -5.09% 334.000 317.000 - 19.17% -
447.dealII (max) -5.05% 1446.000 1373.000 - 1183.18% -
445.gobmk -4.81% 187.000 178.000 - 93.48% -
445.gobmk (avg) -4.81% 187.000 178.000 - 93.48% -
447.dealII -4.76% 105.000 100.000 - -3.85% -
447.dealII (avg) -4.76% 105.000 100.000 - -3.85% -
456.hmmer -4.76% 126.000 120.000 - 60.00% -
456.hmmer (avg) -4.76% 126.000 120.000 - 60.00% -
447.dealII (avg) (percentage) -4.71% 5.310 5.060 - 372.90% -
482.sphinx3 (avg) (percentage) -4.66% 6.220 5.930 - 306.16% -
435.gromacs (avg) (percentage) -4.66% 4.510 4.300 - 148.55% -
459.GemsFDTD (avg) (percentage) -4.58% 4.370 4.170 - 363.33% -
459.GemsFDTD -4.48% 268.000 256.000 - 21.90% -
459.GemsFDTD (avg) -4.48% 268.000 256.000 - 21.90% -
445.gobmk (avg) (percentage) -4.43% 3.610 3.450 - 348.05% -
444.namd (avg) (percentage) -4.30% 7.670 7.340 - 86.77% -
429.mcf -4.23% 71.000 68.000 - -24.44% -
429.mcf (avg) -4.23% 71.000 68.000 - -24.44% -
458.sjeng (avg) (percentage) -4.18% 2.630 2.520 - 663.64% -
456.hmmer (avg) (percentage) -4.14% 4.350 4.170 - 513.24% -
481.wrf (avg) (percentage) -4.13% 5.330 5.110 - 170.37% -
401.bzip2 -4.03% 124.000 119.000 - 80.30% -
401.bzip2 (avg) -4.03% 124.000 119.000 - 80.30% -
434.zeusmp (avg) (percentage) -4.02% 5.220 5.010 - 238.51% -
458.sjeng -3.92% 204.000 196.000 - 317.02% -
458.sjeng (avg) -3.92% 204.000 196.000 - 317.02% -
436.cactusADM -3.74% 107.000 103.000 - -64.60% -
436.cactusADM (avg) -3.74% 107.000 103.000 - -64.60% -
470.lbm (avg) (percentage) -3.70% 5.140 4.950 - 108.86% -
403.gcc (max) (percentage) -3.68% 95.180 91.680 - 12633.33% -
444.namd -3.64% 55.000 53.000 - -85.07% -
444.namd (avg) -3.64% 55.000 53.000 - -85.07% -
429.mcf (avg) (percentage) -3.62% 4.690 4.520 - 752.83% -
450.soplex (avg) (percentage) -3.59% 5.850 5.640 - 354.84% -
433.milc -3.39% 59.000 57.000 - -74.09% -
433.milc (avg) -3.39% 59.000 57.000 - -74.09% -
436.cactusADM (avg) (percentage) -3.15% 5.080 4.920 - 196.39% -
470.lbm -3.14% 191.000 185.000 - -38.94% -
470.lbm (avg) -3.14% 191.000 185.000 - -38.94% -
433.milc (avg) (percentage) -3.13% 5.120 4.960 - 191.76% -
434.zeusmp -3.08% 130.000 126.000 - -35.38% -
434.zeusmp (avg) -3.08% 130.000 126.000 - -35.38% -
450.soplex -3.03% 33.000 32.000 - -83.25% -
450.soplex (avg) -3.03% 33.000 32.000 - -83.25% -
410.bwaves (avg) (percentage) -2.86% 3.500 3.400 - 211.93% -
473.astar (avg) (percentage) -2.72% 2.940 2.860 - 1405.26% -
471.omnetpp (avg) (percentage) -2.72% 5.150 5.010 - 215.09% -
483.xalancbmk (max) -2.66% 338.000 329.000 - 631.11% -
437.leslie3d -2.47% 324.000 316.000 - -11.48% -
437.leslie3d (avg) -2.47% 324.000 316.000 - -11.48% -
400.perlbench (avg) (percentage) -2.44% 6.150 6.000 - 308.16% -
401.bzip2 (avg) (percentage) -2.40% 4.170 4.070 - 825.00% -
483.xalancbmk (max) (percentage) -2.39% 8.360 8.160 - 1890.24% -
410.bwaves -2.37% 211.000 206.000 - 28.75% -
410.bwaves (avg) -2.37% 211.000 206.000 - 28.75% -
462.libquantum (avg) (percentage) -2.34% 5.130 5.010 - 670.77% -
454.calculix (avg) (percentage) -1.87% 7.480 7.340 - 265.17% -
454.calculix (max) -1.85% 54.000 53.000 - -95.07% -
403.gcc (max) -1.82% 55.000 54.000 - -15.62% -
473.astar -1.74% 172.000 169.000 - 503.57% -
473.astar (avg) -1.74% 172.000 169.000 - 503.57% -
471.omnetpp -1.33% 150.000 148.000 - -12.94% -
471.omnetpp (avg) -1.33% 150.000 148.000 - -12.94% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 34.19% 8205.000 11010.000 - -0.34% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (max) (percentage) 37892.86% 0.140 53.190 - -7.42% -
454.calculix (unexplained diff vs previous) (percentage) 23350.00% 0.020 4.690 - 42.99% -
462.libquantum (unexplained diff vs previous) (percentage) 21800.00% 0.010 2.190 - 2.34% -
410.bwaves (max) (percentage) 21647.62% 0.210 45.670 - -9.99% -
458.sjeng (max) (percentage) 17263.64% 0.220 38.200 - -7.42% -
473.astar (max) 15645.00% 20.000 3149.000 - -6.72% -
429.mcf (max) (percentage) 12775.93% 0.540 69.530 - -9.99% -
403.gcc (max) (percentage) 12633.33% 0.720 91.680 - -3.68% -
462.libquantum (max) (percentage) 11501.56% 0.640 74.250 - -10.00% -
464.h264ref (max) (percentage) 9541.86% 0.430 41.460 - -9.99% -
458.sjeng (max) 9512.90% 31.000 2980.000 - -7.11% -
410.bwaves (max) 9150.00% 30.000 2775.000 - -9.28% -
459.GemsFDTD (max) (percentage) 8823.33% 0.600 53.540 - -9.99% -
447.dealII (max) (percentage) 6159.09% 1.100 68.850 - -5.78% -
401.bzip2 (max) (percentage) 5888.64% 0.880 52.700 - -11.11% -
482.sphinx3 (max) (percentage) 5373.47% 1.470 80.460 - -7.41% -
456.hmmer (max) (percentage) 4786.61% 1.270 62.060 - -7.40% -
464.h264ref (max) 3827.42% 62.000 2435.000 - -9.98% -
473.astar (unexplained diff vs previous) (percentage) 3600.00% 0.020 0.740 - 0.00% -
450.soplex (max) (percentage) 3560.91% 1.970 72.120 - -10.00% -
453.povray (max) (percentage) 2901.98% 2.530 75.950 - -7.41% -
445.gobmk (max) (percentage) 2894.12% 1.530 45.810 - -7.42% -
434.zeusmp (max) (percentage) 2301.75% 2.280 54.760 - -11.10% -
459.GemsFDTD (max) 2254.29% 140.000 3296.000 - -9.85% -
433.milc (max) (percentage) 2050.79% 3.170 68.180 - -9.99% -
436.cactusADM (max) (percentage) 2017.14% 3.150 66.690 - -10.00% -
483.xalancbmk (max) (percentage) 1890.24% 0.410 8.160 - -2.39% -
435.gromacs (max) (percentage) 1761.39% 2.020 37.600 - -10.00% -
454.calculix (max) (percentage) 1667.66% 4.700 83.080 - -7.41% -
400.perlbench (max) (percentage) 1627.78% 3.240 55.980 - -11.10% -
481.wrf (max) (percentage) 1533.97% 3.150 51.470 - -10.00% -
473.astar (avg) (percentage) 1405.26% 0.190 2.860 - -2.72% -
473.astar (unexplained diff vs previous) 1366.67% 3.000 44.000 - 0.00% -
445.gobmk (max) 1193.44% 183.000 2367.000 - -7.76% -
447.dealII (max) 1183.18% 107.000 1373.000 - -5.05% -
456.hmmer (max) 1181.43% 140.000 1794.000 - -7.72% -
403.gcc (avg) (percentage) 1116.39% 0.610 7.420 - 0.00% -
401.bzip2 (max) 1059.40% 133.000 1542.000 - -12.68% -
429.mcf (max) 1052.17% 92.000 1060.000 - -10.09% -
416.gamess (max) (percentage) 1051.56% 2.890 33.280 - -9.98% -
470.lbm (max) (percentage) 972.16% 5.100 54.680 - -10.01% -
444.namd (max) (percentage) 863.37% 7.180 69.170 - -9.99% -
401.bzip2 (avg) (percentage) 825.00% 0.440 4.070 - -2.40% -
435.gromacs (max) 791.96% 311.000 2774.000 - -10.40% -
429.mcf (avg) (percentage) 752.83% 0.530 4.520 - -3.62% -
471.omnetpp (max) (percentage) 745.71% 6.170 52.180 - -11.11% -
410.bwaves (unexplained diff vs previous) (percentage) 710.00% 0.100 0.810 - 102.50% -
462.libquantum (avg) (percentage) 670.77% 0.650 5.010 - -2.34% -
458.sjeng (avg) (percentage) 663.64% 0.330 2.520 - -4.18% -
483.xalancbmk (max) 631.11% 45.000 329.000 - -2.66% -
464.h264ref (avg) (percentage) 588.89% 0.540 3.720 - -5.34% -
465.tonto (max) 584.64% 293.000 2006.000 - -7.73% -
416.gamess (max) 530.34% 656.000 4135.000 - -10.07% -
456.hmmer (avg) (percentage) 513.24% 0.680 4.170 - -4.14% -
473.astar 503.57% 28.000 169.000 - -1.74% -
473.astar (avg) 503.57% 28.000 169.000 - -1.74% -
458.sjeng (unexplained diff vs previous) (percentage) 433.33% 0.060 0.320 - -23.81% -
481.wrf (max) 431.13% 530.000 2815.000 - -11.03% -
453.povray (avg) (percentage) 413.60% 1.250 6.420 - -5.45% -
465.tonto (max) (percentage) 408.94% 3.580 18.220 - -7.42% -
471.omnetpp (unexplained diff vs previous) (percentage) 408.33% 0.240 1.220 - 177.27% -
447.dealII (avg) (percentage) 372.90% 1.070 5.060 - -4.71% -
459.GemsFDTD (avg) (percentage) 363.33% 0.900 4.170 - -4.58% -
434.zeusmp (max) 357.81% 301.000 1378.000 - -10.81% -
450.soplex (avg) (percentage) 354.84% 1.240 5.640 - -3.59% -
445.gobmk (avg) (percentage) 348.05% 0.770 3.450 - -4.43% -
458.sjeng 317.02% 47.000 196.000 - -3.92% -
458.sjeng (avg) 317.02% 47.000 196.000 - -3.92% -
470.lbm (unexplained diff vs previous) (percentage) 309.09% 0.110 0.450 - 114.29% -
400.perlbench (avg) (percentage) 308.16% 1.470 6.000 - -2.44% -
482.sphinx3 (avg) (percentage) 306.16% 1.460 5.930 - -4.66% -
437.leslie3d (max) (percentage) 294.44% 2.340 9.230 - -12.51% -
454.calculix (avg) (percentage) 265.17% 2.010 7.340 - -1.87% -
434.zeusmp (avg) (percentage) 238.51% 1.480 5.010 - -4.02% -
410.bwaves (unexplained diff vs previous) 226.67% 15.000 49.000 - 104.17% -
471.omnetpp (avg) (percentage) 215.09% 1.590 5.010 - -2.72% -
470.lbm (max) 213.17% 653.000 2045.000 - -9.59% -
410.bwaves (avg) (percentage) 211.93% 1.090 3.400 - -2.86% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 0.00% -
436.cactusADM (avg) (percentage) 196.39% 1.660 4.920 - -3.15% -
433.milc (avg) (percentage) 191.76% 1.700 4.960 - -3.13% -
464.h264ref 179.49% 78.000 218.000 - -5.22% -
464.h264ref (avg) 179.49% 78.000 218.000 - -5.22% -
437.leslie3d (max) 178.06% 351.000 976.000 - -15.93% -
458.sjeng (unexplained diff vs previous) 177.78% 9.000 25.000 - -24.24% -
400.perlbench (max) 172.75% 345.000 941.000 - -8.02% -
481.wrf (avg) (percentage) 170.37% 1.890 5.110 - -4.13% -
465.tonto 159.85% 137.000 356.000 - -5.57% -
465.tonto (avg) 159.85% 137.000 356.000 - -5.57% -
436.cactusADM (max) 153.08% 552.000 1397.000 - -10.68% -
453.povray (max) 150.30% 165.000 413.000 - -7.40% -
435.gromacs (avg) (percentage) 148.55% 1.730 4.300 - -4.66% -
471.omnetpp (max) 133.38% 662.000 1545.000 - -10.02% -
470.lbm (avg) (percentage) 108.86% 2.370 4.950 - -3.70% -
401.bzip2 (unexplained diff vs previous) (percentage) 108.05% 0.870 1.810 - 285.11% -
465.tonto (avg) (percentage) 94.01% 1.670 3.240 - -5.26% -
416.gamess (avg) (percentage) 93.55% 2.170 4.200 - -6.04% -
445.gobmk 93.48% 92.000 178.000 - -4.81% -
445.gobmk (avg) 93.48% 92.000 178.000 - -4.81% -
433.milc (max) 92.21% 411.000 790.000 - -10.73% -
444.namd (avg) (percentage) 86.77% 3.930 7.340 - -4.30% -
401.bzip2 80.30% 66.000 119.000 - -4.03% -
401.bzip2 (avg) 80.30% 66.000 119.000 - -4.03% -
437.leslie3d (unexplained diff vs previous) (percentage) 79.48% 2.290 4.110 - -65.14% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 71.64% 0.670 1.150 - 47.44% -
482.sphinx3 (max) 71.53% 439.000 753.000 - -7.38% -
456.hmmer 60.00% 75.000 120.000 - -4.76% -
456.hmmer (avg) 60.00% 75.000 120.000 - -4.76% -
471.omnetpp (unexplained diff vs previous) 38.46% 26.000 36.000 - 176.92% -
450.soplex (max) 37.83% 304.000 419.000 - -8.52% -
462.libquantum (max) 36.49% 74.000 101.000 - -12.17% -
410.bwaves 28.75% 160.000 206.000 - -2.37% -
410.bwaves (avg) 28.75% 160.000 206.000 - -2.37% -
437.leslie3d (unexplained diff vs previous) 26.82% 343.000 435.000 - -66.51% -
437.leslie3d (avg) (percentage) 25.63% 2.380 2.990 - 1.36% -
459.GemsFDTD 21.90% 210.000 256.000 - -4.48% -
459.GemsFDTD (avg) 21.90% 210.000 256.000 - -4.48% -
470.lbm (unexplained diff vs previous) 21.43% 14.000 17.000 - 112.50% -
435.gromacs 19.17% 266.000 317.000 - -5.09% -
435.gromacs (avg) 19.17% 266.000 317.000 - -5.09% -
416.gamess 5.89% 492.000 521.000 - -6.29% -
416.gamess (avg) 5.89% 492.000 521.000 - -6.29% -
447.dealII (unexplained diff vs previous) (percentage) 2.56% 0.780 0.800 - -12.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 64.000 - 4.92% -
403.gcc -99.35% 9010.000 59.000 - 1.72% -
462.libquantum -98.82% 11614.000 137.000 - -2.14% -
482.sphinx3 -96.87% 29928.000 937.000 - 0.11% -
450.soplex -96.24% 15466.000 581.000 - 1.57% -
444.namd -91.96% 9050.000 728.000 - -0.27% -
453.povray -91.69% 6544.000 544.000 - 0.00% -
429.mcf -91.11% 17158.000 1525.000 - -0.13% -
433.milc -91.07% 12976.000 1159.000 - -0.86% -
436.cactusADM -88.06% 17544.000 2095.000 - -0.80% -
400.perlbench -84.22% 10650.000 1681.000 - 3.38% -
434.zeusmp -80.95% 13211.000 2517.000 - 0.32% -
401.bzip2 -80.72% 15185.000 2927.000 - -1.78% -
447.dealII -79.54% 9751.000 1995.000 - 0.81% -
456.hmmer -73.82% 11046.000 2892.000 - -0.34% -
459.GemsFDTD -73.63% 23356.000 6158.000 - 0.16% -
471.omnetpp -72.42% 10739.000 2962.000 - 1.23% -
470.lbm -70.82% 12819.000 3741.000 - 0.46% -
481.wrf -67.51% 16834.000 5470.000 - -1.14% -
483.xalancbmk -63.91% 11172.000 4032.000 - -0.44% -
473.astar -60.34% 14932.000 5922.000 - 0.75% -
464.h264ref -59.65% 14556.000 5874.000 - 0.02% -
410.bwaves -58.81% 14755.000 6078.000 - 0.81% -
445.gobmk -56.92% 11995.000 5168.000 - -0.35% -
435.gromacs -52.14% 15419.000 7380.000 - -0.42% -
458.sjeng -45.35% 14275.000 7802.000 - 0.32% -
416.gamess -45.27% 22704.000 12425.000 - -0.11% -
437.leslie3d -29.50% 15005.000 10579.000 - -3.95% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.71% 700.000 2.000 - -33.33% -
482.sphinx3 (unexplained diff vs previous) -99.46% 186.000 1.000 - -75.00% -
454.calculix -99.13% 459.000 4.000 - 0.00% -
454.calculix (avg) -99.13% 459.000 4.000 - 0.00% -
416.gamess (unexplained diff vs previous) -97.93% 676.000 14.000 - 250.00% -
429.mcf (unexplained diff vs previous) -97.85% 93.000 2.000 - 0.00% -
433.milc (unexplained diff vs previous) -97.65% 425.000 10.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -97.40% 308.000 8.000 - -52.94% -
450.soplex (unexplained diff vs previous) -97.11% 311.000 9.000 - 800.00% -
436.cactusADM (unexplained diff vs previous) -97.02% 570.000 17.000 - 466.67% -
444.namd (unexplained diff vs previous) (percentage) -96.51% 7.730 0.270 - -34.15% -
416.gamess (unexplained diff vs previous) (percentage) -96.31% 2.980 0.110 - 266.67% -
454.calculix (max) -95.07% 1074.000 53.000 - -1.85% -
464.h264ref (unexplained diff vs previous) -93.33% 15.000 1.000 - -94.12% -
403.gcc -92.59% 54.000 4.000 - 0.00% -
403.gcc (avg) -92.59% 54.000 4.000 - 0.00% -
462.libquantum -92.00% 75.000 6.000 - -14.29% -
462.libquantum (avg) -92.00% 75.000 6.000 - -14.29% -
445.gobmk (unexplained diff vs previous) -90.32% 186.000 18.000 - 12.50% -
435.gromacs (unexplained diff vs previous) -90.25% 318.000 31.000 - -81.33% -
456.hmmer (unexplained diff vs previous) -87.95% 83.000 10.000 - -47.37% -
482.sphinx3 -87.39% 436.000 55.000 - -5.17% -
482.sphinx3 (avg) -87.39% 436.000 55.000 - -5.17% -
434.zeusmp (unexplained diff vs previous) (percentage) -86.27% 2.330 0.320 - -52.94% -
444.namd -85.07% 355.000 53.000 - -3.64% -
444.namd (avg) -85.07% 355.000 53.000 - -3.64% -
400.perlbench (unexplained diff vs previous) -84.59% 357.000 55.000 - 205.56% -
450.soplex -83.25% 191.000 32.000 - -3.03% -
450.soplex (avg) -83.25% 191.000 32.000 - -3.03% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.26% 0.620 0.110 - -74.42% -
464.h264ref (unexplained diff vs previous) (percentage) -80.00% 0.100 0.020 - -93.10% -
435.gromacs (unexplained diff vs previous) (percentage) -79.61% 2.060 0.420 - -81.25% -
459.GemsFDTD (unexplained diff vs previous) -79.17% 48.000 10.000 - -62.96% -
447.dealII (unexplained diff vs previous) -78.95% 76.000 16.000 - -11.11% -
445.gobmk (unexplained diff vs previous) (percentage) -77.42% 1.550 0.350 - 12.90% -
429.mcf (unexplained diff vs previous) (percentage) -75.93% 0.540 0.130 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -75.08% 3.250 0.810 - 478.57% -
433.milc -74.09% 220.000 57.000 - -3.39% -
433.milc (avg) -74.09% 220.000 57.000 - -3.39% -
433.milc (unexplained diff vs previous) (percentage) -73.78% 3.280 0.860 - 0.00% -
436.cactusADM -64.60% 291.000 103.000 - -3.74% -
436.cactusADM (avg) -64.60% 291.000 103.000 - -3.74% -
401.bzip2 (unexplained diff vs previous) -59.85% 132.000 53.000 - 278.57% -
453.povray -58.02% 81.000 34.000 - -5.56% -
453.povray (avg) -58.02% 81.000 34.000 - -5.56% -
465.tonto (unexplained diff vs previous) (percentage) -54.55% 0.770 0.350 - -62.37% -
456.hmmer (unexplained diff vs previous) (percentage) -53.33% 0.750 0.350 - -46.15% -
481.wrf (unexplained diff vs previous) -43.75% 112.000 63.000 - 46.51% -
454.calculix (unexplained diff vs previous) -40.00% 5.000 3.000 - 50.00% -
465.tonto (unexplained diff vs previous) -39.68% 63.000 38.000 - -63.11% -
470.lbm -38.94% 303.000 185.000 - -3.14% -
470.lbm (avg) -38.94% 303.000 185.000 - -3.14% -
483.xalancbmk -36.49% 74.000 47.000 - 0.00% -
483.xalancbmk (avg) -36.49% 74.000 47.000 - 0.00% -
400.perlbench -35.90% 156.000 100.000 - 1.01% -
400.perlbench (avg) -35.90% 156.000 100.000 - 1.01% -
434.zeusmp -35.38% 195.000 126.000 - -3.08% -
434.zeusmp (avg) -35.38% 195.000 126.000 - -3.08% -
429.mcf -24.44% 90.000 68.000 - -4.23% -
429.mcf (avg) -24.44% 90.000 68.000 - -4.23% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -23.81% 0.210 0.160 - -63.64% -
450.soplex (unexplained diff vs previous) (percentage) -22.89% 2.010 1.550 - 811.76% -
444.namd (max) -22.50% 649.000 503.000 - -10.34% -
403.gcc (max) -15.62% 64.000 54.000 - -1.82% -
471.omnetpp -12.94% 170.000 148.000 - -1.33% -
471.omnetpp (avg) -12.94% 170.000 148.000 - -1.33% -
481.wrf -12.26% 318.000 279.000 - -5.10% -
481.wrf (avg) -12.26% 318.000 279.000 - -5.10% -
437.leslie3d -11.48% 357.000 316.000 - -2.47% -
437.leslie3d (avg) -11.48% 357.000 316.000 - -2.47% -
447.dealII -3.85% 104.000 100.000 - -4.76% -
447.dealII (avg) -3.85% 104.000 100.000 - -4.76% -
400.perlbench (unexplained diff vs previous) (percentage) -2.39% 3.350 3.270 - 194.59% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1681.000 3.38%
401.bzip2 2927.000 -1.78%
403.gcc 59.000 1.72%
410.bwaves 6078.000 -
416.gamess 12425.000 -
429.mcf 1525.000 -
433.milc 1159.000 -
434.zeusmp 2517.000 -
435.gromacs 7380.000 -
436.cactusADM 2095.000 -
437.leslie3d 10579.000 -3.95%
444.namd 728.000 -
445.gobmk 5168.000 -
447.dealII 1995.000 -
450.soplex 581.000 1.57%
453.povray 544.000 -
454.calculix 64.000 4.92%
456.hmmer 2892.000 -
458.sjeng 7802.000 -
459.GemsFDTD 6158.000 -
462.libquantum 137.000 -2.14%
464.h264ref 5874.000 -
465.tonto 11010.000 -
470.lbm 3741.000 -
471.omnetpp 2962.000 1.23%
473.astar 5922.000 -
481.wrf 5470.000 -1.14%
482.sphinx3 937.000 -
483.xalancbmk 4032.000 -
Geometric Mean 2144.209 -
Code Size (bytes)
Name Current %
400.perlbench 922495.000 -
401.bzip2 49892.000 -
403.gcc 2674905.000 -
410.bwaves 17876.000 -
416.gamess 6249439.000 -
429.mcf 10951.000 -
433.milc 95866.000 -
434.zeusmp 165667.000 -
435.gromacs 678889.000 -
436.cactusADM 553942.000 -
437.leslie3d 65177.000 -
444.namd 191015.000 -
445.gobmk 1403691.000 -
447.dealII 2118788.000 -
450.soplex 260508.000 -
453.povray 712861.000 -
454.calculix 1273160.000 -
456.hmmer 231152.000 -
458.sjeng 120213.000 -
459.GemsFDTD 253809.000 -
462.libquantum 31297.000 -
464.h264ref 424212.000 -
465.tonto 2871458.000 -
470.lbm 10908.000 -
471.omnetpp 566566.000 -
473.astar 32068.000 -
481.wrf 2651133.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3274223.000 -
Geometric Mean 297834.772 -
sample variability
Name Current %
400.perlbench 100.000 1.01%
400.perlbench (avg) 100.000 1.01%
400.perlbench (avg) (percentage) 6.000 -2.44%
400.perlbench (max) 941.000 -8.02%
400.perlbench (max) (percentage) 55.980 -11.10%
400.perlbench (unexplained diff vs previous) 55.000 205.56%
400.perlbench (unexplained diff vs previous) (percentage) 3.270 194.59%
401.bzip2 119.000 -4.03%
401.bzip2 (avg) 119.000 -4.03%
401.bzip2 (avg) (percentage) 4.070 -2.40%
401.bzip2 (max) 1542.000 -12.68%
401.bzip2 (max) (percentage) 52.700 -11.11%
401.bzip2 (unexplained diff vs previous) 53.000 278.57%
401.bzip2 (unexplained diff vs previous) (percentage) 1.810 285.11%
403.gcc 4.000 -
403.gcc (avg) 4.000 -
403.gcc (avg) (percentage) 7.420 -
403.gcc (max) 54.000 -1.82%
403.gcc (max) (percentage) 91.680 -3.68%
410.bwaves 206.000 -2.37%
410.bwaves (avg) 206.000 -2.37%
410.bwaves (avg) (percentage) 3.400 -2.86%
410.bwaves (max) 2775.000 -9.28%
410.bwaves (max) (percentage) 45.670 -9.99%
410.bwaves (unexplained diff vs previous) 49.000 104.17%
410.bwaves (unexplained diff vs previous) (percentage) 0.810 102.50%
416.gamess 521.000 -6.29%
416.gamess (avg) 521.000 -6.29%
416.gamess (avg) (percentage) 4.200 -6.04%
416.gamess (max) 4135.000 -10.07%
416.gamess (max) (percentage) 33.280 -9.98%
416.gamess (unexplained diff vs previous) 14.000 250.00%
416.gamess (unexplained diff vs previous) (percentage) 0.110 266.67%
429.mcf 68.000 -4.23%
429.mcf (avg) 68.000 -4.23%
429.mcf (avg) (percentage) 4.520 -3.62%
429.mcf (max) 1060.000 -10.09%
429.mcf (max) (percentage) 69.530 -9.99%
429.mcf (unexplained diff vs previous) 2.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.130 -
433.milc 57.000 -3.39%
433.milc (avg) 57.000 -3.39%
433.milc (avg) (percentage) 4.960 -3.13%
433.milc (max) 790.000 -10.73%
433.milc (max) (percentage) 68.180 -9.99%
433.milc (unexplained diff vs previous) 10.000 -
433.milc (unexplained diff vs previous) (percentage) 0.860 -
434.zeusmp 126.000 -3.08%
434.zeusmp (avg) 126.000 -3.08%
434.zeusmp (avg) (percentage) 5.010 -4.02%
434.zeusmp (max) 1378.000 -10.81%
434.zeusmp (max) (percentage) 54.760 -11.10%
434.zeusmp (unexplained diff vs previous) 8.000 -52.94%
434.zeusmp (unexplained diff vs previous) (percentage) 0.320 -52.94%
435.gromacs 317.000 -5.09%
435.gromacs (avg) 317.000 -5.09%
435.gromacs (avg) (percentage) 4.300 -4.66%
435.gromacs (max) 2774.000 -10.40%
435.gromacs (max) (percentage) 37.600 -10.00%
435.gromacs (unexplained diff vs previous) 31.000 -81.33%
435.gromacs (unexplained diff vs previous) (percentage) 0.420 -81.25%
436.cactusADM 103.000 -3.74%
436.cactusADM (avg) 103.000 -3.74%
436.cactusADM (avg) (percentage) 4.920 -3.15%
436.cactusADM (max) 1397.000 -10.68%
436.cactusADM (max) (percentage) 66.690 -10.00%
436.cactusADM (unexplained diff vs previous) 17.000 466.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.810 478.57%
437.leslie3d 316.000 -2.47%
437.leslie3d (avg) 316.000 -2.47%
437.leslie3d (avg) (percentage) 2.990 1.36%
437.leslie3d (max) 976.000 -15.93%
437.leslie3d (max) (percentage) 9.230 -12.51%
437.leslie3d (unexplained diff vs previous) 435.000 -66.51%
437.leslie3d (unexplained diff vs previous) (percentage) 4.110 -65.14%
444.namd 53.000 -3.64%
444.namd (avg) 53.000 -3.64%
444.namd (avg) (percentage) 7.340 -4.30%
444.namd (max) 503.000 -10.34%
444.namd (max) (percentage) 69.170 -9.99%
444.namd (unexplained diff vs previous) 2.000 -33.33%
444.namd (unexplained diff vs previous) (percentage) 0.270 -34.15%
445.gobmk 178.000 -4.81%
445.gobmk (avg) 178.000 -4.81%
445.gobmk (avg) (percentage) 3.450 -4.43%
445.gobmk (max) 2367.000 -7.76%
445.gobmk (max) (percentage) 45.810 -7.42%
445.gobmk (unexplained diff vs previous) 18.000 12.50%
445.gobmk (unexplained diff vs previous) (percentage) 0.350 12.90%
447.dealII 100.000 -4.76%
447.dealII (avg) 100.000 -4.76%
447.dealII (avg) (percentage) 5.060 -4.71%
447.dealII (max) 1373.000 -5.05%
447.dealII (max) (percentage) 68.850 -5.78%
447.dealII (unexplained diff vs previous) 16.000 -11.11%
447.dealII (unexplained diff vs previous) (percentage) 0.800 -12.09%
450.soplex 32.000 -3.03%
450.soplex (avg) 32.000 -3.03%
450.soplex (avg) (percentage) 5.640 -3.59%
450.soplex (max) 419.000 -8.52%
450.soplex (max) (percentage) 72.120 -10.00%
450.soplex (unexplained diff vs previous) 9.000 800.00%
450.soplex (unexplained diff vs previous) (percentage) 1.550 811.76%
453.povray 34.000 -5.56%
453.povray (avg) 34.000 -5.56%
453.povray (avg) (percentage) 6.420 -5.45%
453.povray (max) 413.000 -7.40%
453.povray (max) (percentage) 75.950 -7.41%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix 4.000 -
454.calculix (avg) 4.000 -
454.calculix (avg) (percentage) 7.340 -1.87%
454.calculix (max) 53.000 -1.85%
454.calculix (max) (percentage) 83.080 -7.41%
454.calculix (unexplained diff vs previous) 3.000 50.00%
454.calculix (unexplained diff vs previous) (percentage) 4.690 42.99%
456.hmmer 120.000 -4.76%
456.hmmer (avg) 120.000 -4.76%
456.hmmer (avg) (percentage) 4.170 -4.14%
456.hmmer (max) 1794.000 -7.72%
456.hmmer (max) (percentage) 62.060 -7.40%
456.hmmer (unexplained diff vs previous) 10.000 -47.37%
456.hmmer (unexplained diff vs previous) (percentage) 0.350 -46.15%
458.sjeng 196.000 -3.92%
458.sjeng (avg) 196.000 -3.92%
458.sjeng (avg) (percentage) 2.520 -4.18%
458.sjeng (max) 2980.000 -7.11%
458.sjeng (max) (percentage) 38.200 -7.42%
458.sjeng (unexplained diff vs previous) 25.000 -24.24%
458.sjeng (unexplained diff vs previous) (percentage) 0.320 -23.81%
459.GemsFDTD 256.000 -4.48%
459.GemsFDTD (avg) 256.000 -4.48%
459.GemsFDTD (avg) (percentage) 4.170 -4.58%
459.GemsFDTD (max) 3296.000 -9.85%
459.GemsFDTD (max) (percentage) 53.540 -9.99%
459.GemsFDTD (unexplained diff vs previous) 10.000 -62.96%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.160 -63.64%
462.libquantum 6.000 -14.29%
462.libquantum (avg) 6.000 -14.29%
462.libquantum (avg) (percentage) 5.010 -2.34%
462.libquantum (max) 101.000 -12.17%
462.libquantum (max) (percentage) 74.250 -10.00%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.190 2.34%
464.h264ref 218.000 -5.22%
464.h264ref (avg) 218.000 -5.22%
464.h264ref (avg) (percentage) 3.720 -5.34%
464.h264ref (max) 2435.000 -9.98%
464.h264ref (max) (percentage) 41.460 -9.99%
464.h264ref (unexplained diff vs previous) 1.000 -94.12%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -93.10%
465.tonto 356.000 -5.57%
465.tonto (avg) 356.000 -5.57%
465.tonto (avg) (percentage) 3.240 -5.26%
465.tonto (max) 2006.000 -7.73%
465.tonto (max) (percentage) 18.220 -7.42%
465.tonto (unexplained diff vs previous) 38.000 -63.11%
465.tonto (unexplained diff vs previous) (percentage) 0.350 -62.37%
470.lbm 185.000 -3.14%
470.lbm (avg) 185.000 -3.14%
470.lbm (avg) (percentage) 4.950 -3.70%
470.lbm (max) 2045.000 -9.59%
470.lbm (max) (percentage) 54.680 -10.01%
470.lbm (unexplained diff vs previous) 17.000 112.50%
470.lbm (unexplained diff vs previous) (percentage) 0.450 114.29%
471.omnetpp 148.000 -1.33%
471.omnetpp (avg) 148.000 -1.33%
471.omnetpp (avg) (percentage) 5.010 -2.72%
471.omnetpp (max) 1545.000 -10.02%
471.omnetpp (max) (percentage) 52.180 -11.11%
471.omnetpp (unexplained diff vs previous) 36.000 176.92%
471.omnetpp (unexplained diff vs previous) (percentage) 1.220 177.27%
473.astar 169.000 -1.74%
473.astar (avg) 169.000 -1.74%
473.astar (avg) (percentage) 2.860 -2.72%
473.astar (max) 3149.000 -6.72%
473.astar (max) (percentage) 53.190 -7.42%
473.astar (unexplained diff vs previous) 44.000 -
473.astar (unexplained diff vs previous) (percentage) 0.740 -
481.wrf 279.000 -5.10%
481.wrf (avg) 279.000 -5.10%
481.wrf (avg) (percentage) 5.110 -4.13%
481.wrf (max) 2815.000 -11.03%
481.wrf (max) (percentage) 51.470 -10.00%
481.wrf (unexplained diff vs previous) 63.000 46.51%
481.wrf (unexplained diff vs previous) (percentage) 1.150 47.44%
482.sphinx3 55.000 -5.17%
482.sphinx3 (avg) 55.000 -5.17%
482.sphinx3 (avg) (percentage) 5.930 -4.66%
482.sphinx3 (max) 753.000 -7.38%
482.sphinx3 (max) (percentage) 80.460 -7.41%
482.sphinx3 (unexplained diff vs previous) 1.000 -75.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -74.42%
483.xalancbmk 47.000 -
483.xalancbmk (avg) 47.000 -
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 329.000 -2.66%
483.xalancbmk (max) (percentage) 8.160 -2.39%
Geometric Mean 26.792 4.56%