Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4e38ed582cb9a2e09141126c2e0a527816e702e6 (+ 14 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/7a3dfc23a910a47b6c1113b3a28a22858d0b9e7a (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9e5c991106cb04b489272de0ef6a7a6bcef50477 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=ca898c727516c7e7261162b45f9d3a4d64f5283a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/289/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0289 (-00000-) 2022-09-14T14:42:37 0:00:00
Previous 0287 (3-changed-components) 2022-09-11T05:25:04 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 25 104
Performance Improvements 167 112
Added Tests 8 0
Unchanged Tests 1036 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
410.bwaves 1.72% 15475.000 15741.000 - 6.68% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) 833.33% 3.000 28.000 - -91.19% -
435.gromacs (unexplained diff vs previous) (percentage) 800.00% 0.020 0.180 - -91.26% -
444.namd (unexplained diff vs previous) (percentage) 390.00% 0.100 0.490 - -93.66% -
444.namd (unexplained diff vs previous) 388.89% 9.000 44.000 - -93.71% -
429.mcf (unexplained diff vs previous) 228.57% 7.000 23.000 - -75.27% -
429.mcf (unexplained diff vs previous) (percentage) 225.00% 0.040 0.130 - -75.93% -
462.libquantum (unexplained diff vs previous) 200.00% 2.000 6.000 - 500.00% -
464.h264ref (unexplained diff vs previous) 196.30% 27.000 80.000 - 433.33% -
464.h264ref (unexplained diff vs previous) (percentage) 194.44% 0.180 0.530 - 430.00% -
433.milc (unexplained diff vs previous) (percentage) 175.00% 0.320 0.880 - -73.17% -
433.milc (unexplained diff vs previous) 171.43% 42.000 114.000 - -73.18% -
410.bwaves (unexplained diff vs previous) 158.25% 103.000 266.000 - 1673.33% -
410.bwaves (unexplained diff vs previous) (percentage) 152.24% 0.670 1.690 - 1590.00% -
462.libquantum (unexplained diff vs previous) (percentage) 150.00% 0.020 0.050 - 400.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 75.00% 0.160 0.280 - -87.77% -
437.leslie3d (unexplained diff vs previous) 69.57% 23.000 39.000 - -88.63% -
436.cactusADM (unexplained diff vs previous) (percentage) 40.00% 0.100 0.140 - -95.69% -
436.cactusADM (unexplained diff vs previous) 38.89% 18.000 25.000 - -95.61% -
401.bzip2 (unexplained diff vs previous) 25.00% 16.000 20.000 - -84.85% -
401.bzip2 (unexplained diff vs previous) (percentage) 18.18% 0.110 0.130 - -85.06% -
410.bwaves 6.82% 176.000 188.000 - 17.50% -
410.bwaves (avg) 6.82% 176.000 188.000 - 17.50% -
453.povray (unexplained diff vs previous) 6.67% 15.000 16.000 - 1500.00% -
410.bwaves (avg) (percentage) 5.26% 1.140 1.200 - 10.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) -95.45% 66.000 3.000 - -99.04% -
450.soplex (unexplained diff vs previous) (percentage) -95.24% 0.420 0.020 - -99.00% -
471.omnetpp (max) -93.13% 1484.000 102.000 - -84.59% -
471.omnetpp (max) (percentage) -93.07% 13.710 0.950 - -84.60% -
456.hmmer (unexplained diff vs previous) (percentage) -84.13% 0.630 0.100 - -86.67% -
456.hmmer (unexplained diff vs previous) -83.82% 68.000 11.000 - -86.75% -
454.calculix (unexplained diff vs previous) (percentage) -82.35% 0.170 0.030 - 50.00% -
454.calculix (unexplained diff vs previous) -81.08% 37.000 7.000 - 40.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -80.00% 0.100 0.020 - -90.48% -
459.GemsFDTD (unexplained diff vs previous) -79.17% 24.000 5.000 - -89.58% -
481.wrf (unexplained diff vs previous) (percentage) -68.75% 0.320 0.100 - -85.07% -
481.wrf (unexplained diff vs previous) -68.52% 54.000 17.000 - -84.82% -
470.lbm (unexplained diff vs previous) (percentage) -53.85% 0.130 0.060 - -45.45% -
445.gobmk (unexplained diff vs previous) (percentage) -52.63% 0.190 0.090 - -94.19% -
445.gobmk (unexplained diff vs previous) -52.17% 23.000 11.000 - -94.09% -
470.lbm (unexplained diff vs previous) -50.00% 16.000 8.000 - -42.86% -
473.astar (unexplained diff vs previous) -50.00% 2.000 1.000 - -66.67% -
471.omnetpp (unexplained diff vs previous) (percentage) -40.48% 1.260 0.750 - 212.50% -
471.omnetpp (unexplained diff vs previous) -40.44% 136.000 81.000 - 211.54% -
434.zeusmp (unexplained diff vs previous) (percentage) -33.33% 0.120 0.080 - -96.57% -
434.zeusmp (unexplained diff vs previous) -31.25% 16.000 11.000 - -96.43% -
400.perlbench (max) (percentage) -29.83% 2.950 2.070 - -36.11% -
400.perlbench (max) -29.43% 316.000 223.000 - -35.36% -
416.gamess (unexplained diff vs previous) -27.78% 18.000 13.000 - -98.08% -
416.gamess (unexplained diff vs previous) (percentage) -25.00% 0.080 0.060 - -97.99% -
482.sphinx3 (unexplained diff vs previous) -20.24% 168.000 134.000 - -27.96% -
482.sphinx3 (unexplained diff vs previous) (percentage) -20.00% 0.550 0.440 - -29.03% -
456.hmmer (max) -16.22% 74.000 62.000 - -55.71% -
456.hmmer (max) (percentage) -15.94% 0.690 0.580 - -54.33% -
403.gcc -15.58% 77.000 65.000 - 20.37% -
403.gcc (avg) -15.58% 77.000 65.000 - 20.37% -
403.gcc (avg) (percentage) -15.29% 0.850 0.720 - 18.03% -
416.gamess -14.58% 295.000 252.000 - -48.78% -
416.gamess (avg) -14.58% 295.000 252.000 - -48.78% -
416.gamess (avg) (percentage) -14.50% 1.310 1.120 - -48.39% -
481.wrf -13.60% 272.000 235.000 - -26.10% -
481.wrf (avg) -13.60% 272.000 235.000 - -26.10% -
481.wrf (avg) (percentage) -13.58% 1.620 1.400 - -25.93% -
483.xalancbmk (max) -12.86% 70.000 61.000 - 35.56% -
454.calculix (avg) (percentage) -12.21% 1.720 1.510 - -24.88% -
454.calculix -12.21% 385.000 338.000 - -26.36% -
454.calculix (avg) -12.21% 385.000 338.000 - -26.36% -
458.sjeng -11.96% 92.000 81.000 - 72.34% -
458.sjeng (avg) -11.96% 92.000 81.000 - 72.34% -
483.xalancbmk (max) (percentage) -11.86% 0.590 0.520 - 26.83% -
473.astar -11.22% 98.000 87.000 - 210.71% -
473.astar (avg) -11.22% 98.000 87.000 - 210.71% -
447.dealII -11.21% 107.000 95.000 - -8.65% -
447.dealII (avg) -11.21% 107.000 95.000 - -8.65% -
458.sjeng (avg) (percentage) -11.11% 0.630 0.560 - 69.70% -
444.namd (max) (percentage) -11.07% 5.780 5.140 - -28.41% -
470.lbm -11.05% 362.000 322.000 - 6.27% -
470.lbm (avg) -11.05% 362.000 322.000 - 6.27% -
447.dealII (avg) (percentage) -11.01% 1.090 0.970 - -9.35% -
450.soplex (avg) (percentage) -11.01% 1.090 0.970 - -21.77% -
470.lbm (avg) (percentage) -10.92% 2.840 2.530 - 6.75% -
435.gromacs (avg) (percentage) -10.77% 1.300 1.160 - -32.95% -
459.GemsFDTD -10.72% 401.000 358.000 - 70.48% -
459.GemsFDTD (avg) -10.72% 401.000 358.000 - 70.48% -
447.dealII (unexplained diff vs previous) (percentage) -10.71% 0.280 0.250 - -67.95% -
447.dealII (unexplained diff vs previous) -10.71% 28.000 25.000 - -67.11% -
435.gromacs -10.66% 197.000 176.000 - -33.83% -
435.gromacs (avg) -10.66% 197.000 176.000 - -33.83% -
462.libquantum -10.66% 197.000 176.000 - 134.67% -
462.libquantum (avg) -10.66% 197.000 176.000 - 134.67% -
450.soplex -10.65% 169.000 151.000 - -20.94% -
450.soplex (avg) -10.65% 169.000 151.000 - -20.94% -
473.astar (avg) (percentage) -10.61% 0.660 0.590 - 210.53% -
462.libquantum (avg) (percentage) -10.59% 1.700 1.520 - 133.85% -
444.namd (max) -10.58% 520.000 465.000 - -28.35% -
429.mcf (avg) (percentage) -10.55% 2.370 2.120 - 300.00% -
445.gobmk -10.53% 38.000 34.000 - -63.04% -
445.gobmk (avg) -10.53% 38.000 34.000 - -63.04% -
459.GemsFDTD (avg) (percentage) -10.53% 1.710 1.530 - 70.00% -
434.zeusmp (avg) (percentage) -10.47% 1.910 1.710 - 15.54% -
429.mcf -10.32% 407.000 365.000 - 305.56% -
429.mcf (avg) -10.32% 407.000 365.000 - 305.56% -
401.bzip2 -10.29% 136.000 122.000 - 84.85% -
401.bzip2 (avg) -10.29% 136.000 122.000 - 84.85% -
434.zeusmp -10.24% 254.000 228.000 - 16.92% -
434.zeusmp (avg) -10.24% 254.000 228.000 - 16.92% -
436.cactusADM (avg) (percentage) -10.15% 1.970 1.770 - 6.63% -
436.cactusADM -10.09% 347.000 312.000 - 7.22% -
436.cactusADM (avg) -10.09% 347.000 312.000 - 7.22% -
437.leslie3d -10.00% 290.000 261.000 - -26.89% -
437.leslie3d (avg) -10.00% 290.000 261.000 - -26.89% -
465.tonto (avg) (percentage) -10.00% 1.000 0.900 - -46.11% -
401.bzip2 (avg) (percentage) -10.00% 0.900 0.810 - 84.09% -
456.hmmer (avg) (percentage) -10.00% 0.600 0.540 - -20.59% -
437.leslie3d (avg) (percentage) -9.71% 2.060 1.860 - -21.85% -
465.tonto -9.64% 83.000 75.000 - -45.26% -
465.tonto (avg) -9.64% 83.000 75.000 - -45.26% -
445.gobmk (avg) (percentage) -9.38% 0.320 0.290 - -62.34% -
456.hmmer -9.38% 64.000 58.000 - -22.67% -
456.hmmer (avg) -9.38% 64.000 58.000 - -22.67% -
453.povray (avg) (percentage) -9.35% 1.070 0.970 - -22.40% -
464.h264ref -9.21% 228.000 207.000 - 165.38% -
464.h264ref (avg) -9.21% 228.000 207.000 - 165.38% -
444.namd (avg) (percentage) -9.12% 2.960 2.690 - -31.55% -
445.gobmk (max) -8.93% 112.000 102.000 - -44.26% -
453.povray -8.70% 69.000 63.000 - -22.22% -
453.povray (avg) -8.70% 69.000 63.000 - -22.22% -
464.h264ref (avg) (percentage) -8.67% 1.500 1.370 - 153.70% -
444.namd -8.65% 266.000 243.000 - -31.55% -
444.namd (avg) -8.65% 266.000 243.000 - -31.55% -
445.gobmk (max) (percentage) -8.60% 0.930 0.850 - -44.44% -
454.calculix (max) -8.58% 793.000 725.000 - -32.50% -
482.sphinx3 (avg) (percentage) -8.56% 1.870 1.710 - 17.12% -
453.povray (max) (percentage) -8.54% 2.460 2.250 - -11.07% -
471.omnetpp -8.49% 271.000 248.000 - 45.88% -
471.omnetpp (avg) -8.49% 271.000 248.000 - 45.88% -
454.calculix (max) (percentage) -8.47% 3.540 3.240 - -31.06% -
435.gromacs (max) (percentage) -8.30% 2.410 2.210 - 9.41% -
435.gromacs (max) -8.20% 366.000 336.000 - 8.04% -
453.povray (max) -8.12% 160.000 147.000 - -10.91% -
482.sphinx3 -8.11% 567.000 521.000 - 19.50% -
482.sphinx3 (avg) -8.11% 567.000 521.000 - 19.50% -
400.perlbench (avg) (percentage) -8.11% 1.480 1.360 - -7.48% -
471.omnetpp (avg) (percentage) -7.97% 2.510 2.310 - 45.28% -
400.perlbench -7.59% 158.000 146.000 - -6.41% -
400.perlbench (avg) -7.59% 158.000 146.000 - -6.41% -
433.milc (max) -7.56% 357.000 330.000 - -19.71% -
481.wrf (max) -7.48% 682.000 631.000 - 19.06% -
481.wrf (max) (percentage) -7.39% 4.060 3.760 - 19.37% -
437.leslie3d (max) -6.95% 705.000 656.000 - 86.89% -
483.xalancbmk (avg) (percentage) -6.90% 0.290 0.270 - -59.70% -
436.cactusADM (max) (percentage) -6.74% 3.410 3.180 - 0.95% -
482.sphinx3 (max) (percentage) -6.72% 5.360 5.000 - 240.14% -
429.mcf (max) (percentage) -6.70% 12.980 12.110 - 2142.59% -
470.lbm (max) -6.70% 1298.000 1211.000 - 85.45% -
450.soplex (max) (percentage) -6.67% 4.950 4.620 - 134.52% -
434.zeusmp (max) -6.67% 525.000 490.000 - 62.79% -
436.cactusADM (max) -6.66% 601.000 561.000 - 1.63% -
433.milc -6.64% 241.000 225.000 - 2.27% -
433.milc (avg) -6.64% 241.000 225.000 - 2.27% -
433.milc (max) (percentage) -6.62% 2.720 2.540 - -19.87% -
459.GemsFDTD (max) (percentage) -6.62% 6.500 6.070 - 911.67% -
450.soplex (max) -6.61% 771.000 720.000 - 136.84% -
437.leslie3d (max) (percentage) -6.60% 5.000 4.670 - 99.57% -
410.bwaves (max) (percentage) -6.60% 1.970 1.840 - 776.19% -
434.zeusmp (max) (percentage) -6.60% 3.940 3.680 - 61.40% -
429.mcf (max) -6.58% 2233.000 2086.000 - 2167.39% -
470.lbm (max) (percentage) -6.58% 10.180 9.510 - 86.47% -
459.GemsFDTD (max) -6.56% 1524.000 1424.000 - 917.14% -
401.bzip2 (max) (percentage) -6.50% 4.310 4.030 - 357.95% -
458.sjeng (max) -6.44% 435.000 407.000 - 1212.90% -
401.bzip2 (max) -6.43% 653.000 611.000 - 359.40% -
458.sjeng (max) (percentage) -6.38% 2.980 2.790 - 1168.18% -
482.sphinx3 (max) -6.33% 1627.000 1524.000 - 247.15% -
464.h264ref (max) -6.29% 1384.000 1297.000 - 1991.94% -
403.gcc (max) (percentage) -6.19% 3.070 2.880 - 300.00% -
462.libquantum (max) (percentage) -6.18% 10.190 9.560 - 1393.75% -
403.gcc (max) -6.12% 278.000 261.000 - 307.81% -
462.libquantum (max) -6.09% 1183.000 1111.000 - 1401.35% -
433.milc (avg) (percentage) -5.98% 1.840 1.730 - 1.76% -
483.xalancbmk -5.88% 34.000 32.000 - -56.76% -
483.xalancbmk (avg) -5.88% 34.000 32.000 - -56.76% -
416.gamess (max) (percentage) -5.82% 2.750 2.590 - -10.38% -
464.h264ref (max) (percentage) -5.73% 9.080 8.560 - 1890.70% -
473.astar (max) -5.67% 688.000 649.000 - 3145.00% -
416.gamess (max) -5.65% 619.000 584.000 - -10.98% -
473.astar (max) (percentage) -5.63% 4.620 4.360 - 3014.29% -
410.bwaves (max) -4.93% 304.000 289.000 - 863.33% -
465.tonto (max) -4.62% 173.000 165.000 - -43.69% -
465.tonto (max) (percentage) -4.35% 2.070 1.980 - -44.69% -
447.dealII (max) -3.52% 199.000 192.000 - 79.44% -
447.dealII (max) (percentage) -2.97% 2.020 1.960 - 78.18% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.60% 260647.000 267429.000 - 0.00% -
400.perlbench 2.12% 930652.000 950396.000 - 0.00% -
459.GemsFDTD 1.29% 253716.000 256984.000 - 0.00% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.68% 14755.000 15741.000 - 1.72% -
483.xalancbmk 6.52% 11172.000 11900.000 - 0.19% -
464.h264ref 4.17% 14556.000 15163.000 - -0.52% -
458.sjeng 2.43% 14275.000 14622.000 - 0.05% -
482.sphinx3 1.88% 29928.000 30490.000 - 0.44% -
465.tonto 1.86% 8205.000 8358.000 - -0.44% -
400.perlbench 1.46% 10650.000 10805.000 - 0.71% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (max) 3145.00% 20.000 649.000 - -5.67% -
473.astar (max) (percentage) 3014.29% 0.140 4.360 - -5.63% -
429.mcf (max) 2167.39% 92.000 2086.000 - -6.58% -
429.mcf (max) (percentage) 2142.59% 0.540 12.110 - -6.70% -
464.h264ref (max) 1991.94% 62.000 1297.000 - -6.29% -
464.h264ref (max) (percentage) 1890.70% 0.430 8.560 - -5.73% -
410.bwaves (unexplained diff vs previous) 1673.33% 15.000 266.000 - 158.25% -
410.bwaves (unexplained diff vs previous) (percentage) 1590.00% 0.100 1.690 - 152.24% -
453.povray (unexplained diff vs previous) 1500.00% 1.000 16.000 - 6.67% -
462.libquantum (max) 1401.35% 74.000 1111.000 - -6.09% -
462.libquantum (max) (percentage) 1393.75% 0.640 9.560 - -6.18% -
458.sjeng (max) 1212.90% 31.000 407.000 - -6.44% -
458.sjeng (max) (percentage) 1168.18% 0.220 2.790 - -6.38% -
453.povray (unexplained diff vs previous) (percentage) 1100.00% 0.020 0.240 - 4.35% -
459.GemsFDTD (max) 917.14% 140.000 1424.000 - -6.56% -
459.GemsFDTD (max) (percentage) 911.67% 0.600 6.070 - -6.62% -
410.bwaves (max) 863.33% 30.000 289.000 - -4.93% -
410.bwaves (max) (percentage) 776.19% 0.210 1.840 - -6.60% -
462.libquantum (unexplained diff vs previous) 500.00% 1.000 6.000 - 200.00% -
464.h264ref (unexplained diff vs previous) 433.33% 15.000 80.000 - 196.30% -
464.h264ref (unexplained diff vs previous) (percentage) 430.00% 0.100 0.530 - 194.44% -
462.libquantum (unexplained diff vs previous) (percentage) 400.00% 0.010 0.050 - 150.00% -
401.bzip2 (max) 359.40% 133.000 611.000 - -6.43% -
401.bzip2 (max) (percentage) 357.95% 0.880 4.030 - -6.50% -
403.gcc (max) 307.81% 64.000 261.000 - -6.12% -
429.mcf 305.56% 90.000 365.000 - -10.32% -
429.mcf (avg) 305.56% 90.000 365.000 - -10.32% -
403.gcc (max) (percentage) 300.00% 0.720 2.880 - -6.19% -
429.mcf (avg) (percentage) 300.00% 0.530 2.120 - -10.55% -
482.sphinx3 (max) 247.15% 439.000 1524.000 - -6.33% -
482.sphinx3 (max) (percentage) 240.14% 1.470 5.000 - -6.72% -
471.omnetpp (unexplained diff vs previous) (percentage) 212.50% 0.240 0.750 - -40.48% -
471.omnetpp (unexplained diff vs previous) 211.54% 26.000 81.000 - -40.44% -
473.astar 210.71% 28.000 87.000 - -11.22% -
473.astar (avg) 210.71% 28.000 87.000 - -11.22% -
473.astar (avg) (percentage) 210.53% 0.190 0.590 - -10.61% -
464.h264ref 165.38% 78.000 207.000 - -9.21% -
464.h264ref (avg) 165.38% 78.000 207.000 - -9.21% -
464.h264ref (avg) (percentage) 153.70% 0.540 1.370 - -8.67% -
450.soplex (max) 136.84% 304.000 720.000 - -6.61% -
462.libquantum 134.67% 75.000 176.000 - -10.66% -
462.libquantum (avg) 134.67% 75.000 176.000 - -10.66% -
450.soplex (max) (percentage) 134.52% 1.970 4.620 - -6.67% -
462.libquantum (avg) (percentage) 133.85% 0.650 1.520 - -10.59% -
437.leslie3d (max) (percentage) 99.57% 2.340 4.670 - -6.60% -
437.leslie3d (max) 86.89% 351.000 656.000 - -6.95% -
470.lbm (max) (percentage) 86.47% 5.100 9.510 - -6.58% -
470.lbm (max) 85.45% 653.000 1211.000 - -6.70% -
401.bzip2 84.85% 66.000 122.000 - -10.29% -
401.bzip2 (avg) 84.85% 66.000 122.000 - -10.29% -
401.bzip2 (avg) (percentage) 84.09% 0.440 0.810 - -10.00% -
447.dealII (max) 79.44% 107.000 192.000 - -3.52% -
447.dealII (max) (percentage) 78.18% 1.100 1.960 - -2.97% -
458.sjeng 72.34% 47.000 81.000 - -11.96% -
458.sjeng (avg) 72.34% 47.000 81.000 - -11.96% -
459.GemsFDTD 70.48% 210.000 358.000 - -10.72% -
459.GemsFDTD (avg) 70.48% 210.000 358.000 - -10.72% -
459.GemsFDTD (avg) (percentage) 70.00% 0.900 1.530 - -10.53% -
458.sjeng (avg) (percentage) 69.70% 0.330 0.560 - -11.11% -
434.zeusmp (max) 62.79% 301.000 490.000 - -6.67% -
434.zeusmp (max) (percentage) 61.40% 2.280 3.680 - -6.60% -
471.omnetpp 45.88% 170.000 248.000 - -8.49% -
471.omnetpp (avg) 45.88% 170.000 248.000 - -8.49% -
471.omnetpp (avg) (percentage) 45.28% 1.590 2.310 - -7.97% -
454.calculix (unexplained diff vs previous) 40.00% 5.000 7.000 - -81.08% -
483.xalancbmk (max) 35.56% 45.000 61.000 - -12.86% -
483.xalancbmk (max) (percentage) 26.83% 0.410 0.520 - -11.86% -
403.gcc 20.37% 54.000 65.000 - -15.58% -
403.gcc (avg) 20.37% 54.000 65.000 - -15.58% -
482.sphinx3 19.50% 436.000 521.000 - -8.11% -
482.sphinx3 (avg) 19.50% 436.000 521.000 - -8.11% -
481.wrf (max) (percentage) 19.37% 3.150 3.760 - -7.39% -
481.wrf (max) 19.06% 530.000 631.000 - -7.48% -
403.gcc (avg) (percentage) 18.03% 0.610 0.720 - -15.29% -
410.bwaves 17.50% 160.000 188.000 - 6.82% -
410.bwaves (avg) 17.50% 160.000 188.000 - 6.82% -
482.sphinx3 (avg) (percentage) 17.12% 1.460 1.710 - -8.56% -
434.zeusmp 16.92% 195.000 228.000 - -10.24% -
434.zeusmp (avg) 16.92% 195.000 228.000 - -10.24% -
434.zeusmp (avg) (percentage) 15.54% 1.480 1.710 - -10.47% -
410.bwaves (avg) (percentage) 10.09% 1.090 1.200 - 5.26% -
435.gromacs (max) (percentage) 9.41% 2.020 2.210 - -8.30% -
435.gromacs (max) 8.04% 311.000 336.000 - -8.20% -
436.cactusADM 7.22% 291.000 312.000 - -10.09% -
436.cactusADM (avg) 7.22% 291.000 312.000 - -10.09% -
470.lbm (avg) (percentage) 6.75% 2.370 2.530 - -10.92% -
436.cactusADM (avg) (percentage) 6.63% 1.660 1.770 - -10.15% -
470.lbm 6.27% 303.000 322.000 - -11.05% -
470.lbm (avg) 6.27% 303.000 322.000 - -11.05% -
433.milc 2.27% 220.000 225.000 - -6.64% -
433.milc (avg) 2.27% 220.000 225.000 - -6.64% -
433.milc (avg) (percentage) 1.76% 1.700 1.730 - -5.98% -
436.cactusADM (max) 1.63% 552.000 561.000 - -6.66% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.33% 120221.000 116217.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.28% 15005.000 14062.000 - -0.28% -
456.hmmer -2.54% 11046.000 10765.000 - -0.10% -
454.calculix -2.01% 22860.000 22401.000 - -0.03% -
435.gromacs -1.24% 15419.000 15228.000 - 0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex (unexplained diff vs previous) -99.04% 311.000 3.000 - -95.45% -
450.soplex (unexplained diff vs previous) (percentage) -99.00% 2.010 0.020 - -95.24% -
416.gamess (unexplained diff vs previous) -98.08% 676.000 13.000 - -27.78% -
416.gamess (unexplained diff vs previous) (percentage) -97.99% 2.980 0.060 - -25.00% -
403.gcc (unexplained diff vs previous) (percentage) -97.22% 0.720 0.020 - 0.00% -
403.gcc (unexplained diff vs previous) -96.92% 65.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -96.57% 2.330 0.080 - -33.33% -
434.zeusmp (unexplained diff vs previous) -96.43% 308.000 11.000 - -31.25% -
436.cactusADM (unexplained diff vs previous) (percentage) -95.69% 3.250 0.140 - 40.00% -
436.cactusADM (unexplained diff vs previous) -95.61% 570.000 25.000 - 38.89% -
445.gobmk (unexplained diff vs previous) (percentage) -94.19% 1.550 0.090 - -52.63% -
445.gobmk (unexplained diff vs previous) -94.09% 186.000 11.000 - -52.17% -
444.namd (unexplained diff vs previous) -93.71% 700.000 44.000 - 388.89% -
444.namd (unexplained diff vs previous) (percentage) -93.66% 7.730 0.490 - 390.00% -
435.gromacs (unexplained diff vs previous) (percentage) -91.26% 2.060 0.180 - 800.00% -
435.gromacs (unexplained diff vs previous) -91.19% 318.000 28.000 - 833.33% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -90.48% 0.210 0.020 - -80.00% -
459.GemsFDTD (unexplained diff vs previous) -89.58% 48.000 5.000 - -79.17% -
437.leslie3d (unexplained diff vs previous) -88.63% 343.000 39.000 - 69.57% -
437.leslie3d (unexplained diff vs previous) (percentage) -87.77% 2.290 0.280 - 75.00% -
456.hmmer (unexplained diff vs previous) -86.75% 83.000 11.000 - -83.82% -
456.hmmer (unexplained diff vs previous) (percentage) -86.67% 0.750 0.100 - -84.13% -
481.wrf (unexplained diff vs previous) (percentage) -85.07% 0.670 0.100 - -68.75% -
401.bzip2 (unexplained diff vs previous) (percentage) -85.06% 0.870 0.130 - 18.18% -
401.bzip2 (unexplained diff vs previous) -84.85% 132.000 20.000 - 25.00% -
481.wrf (unexplained diff vs previous) -84.82% 112.000 17.000 - -68.52% -
471.omnetpp (max) (percentage) -84.60% 6.170 0.950 - -93.07% -
471.omnetpp (max) -84.59% 662.000 102.000 - -93.13% -
400.perlbench (unexplained diff vs previous) (percentage) -79.10% 3.350 0.700 - 0.00% -
400.perlbench (unexplained diff vs previous) -78.71% 357.000 76.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -75.93% 0.540 0.130 - 225.00% -
429.mcf (unexplained diff vs previous) -75.27% 93.000 23.000 - 228.57% -
433.milc (unexplained diff vs previous) -73.18% 425.000 114.000 - 171.43% -
433.milc (unexplained diff vs previous) (percentage) -73.17% 3.280 0.880 - 175.00% -
447.dealII (unexplained diff vs previous) (percentage) -67.95% 0.780 0.250 - -10.71% -
447.dealII (unexplained diff vs previous) -67.11% 76.000 25.000 - -10.71% -
473.astar (unexplained diff vs previous) -66.67% 3.000 1.000 - -50.00% -
445.gobmk -63.04% 92.000 34.000 - -10.53% -
445.gobmk (avg) -63.04% 92.000 34.000 - -10.53% -
445.gobmk (avg) (percentage) -62.34% 0.770 0.290 - -9.38% -
483.xalancbmk (avg) (percentage) -59.70% 0.670 0.270 - -6.90% -
483.xalancbmk -56.76% 74.000 32.000 - -5.88% -
483.xalancbmk (avg) -56.76% 74.000 32.000 - -5.88% -
483.xalancbmk (unexplained diff vs previous) (percentage) -56.10% 0.410 0.180 - 0.00% -
456.hmmer (max) -55.71% 140.000 62.000 - -16.22% -
456.hmmer (max) (percentage) -54.33% 1.270 0.580 - -15.94% -
483.xalancbmk (unexplained diff vs previous) -52.17% 46.000 22.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.020 0.010 - 0.00% -
416.gamess -48.78% 492.000 252.000 - -14.58% -
416.gamess (avg) -48.78% 492.000 252.000 - -14.58% -
416.gamess (avg) (percentage) -48.39% 2.170 1.120 - -14.50% -
465.tonto (avg) (percentage) -46.11% 1.670 0.900 - -10.00% -
470.lbm (unexplained diff vs previous) (percentage) -45.45% 0.110 0.060 - -53.85% -
465.tonto -45.26% 137.000 75.000 - -9.64% -
465.tonto (avg) -45.26% 137.000 75.000 - -9.64% -
465.tonto (max) (percentage) -44.69% 3.580 1.980 - -4.35% -
445.gobmk (max) (percentage) -44.44% 1.530 0.850 - -8.60% -
445.gobmk (max) -44.26% 183.000 102.000 - -8.93% -
465.tonto (max) -43.69% 293.000 165.000 - -4.62% -
465.tonto (unexplained diff vs previous) (percentage) -42.86% 0.770 0.440 - 0.00% -
470.lbm (unexplained diff vs previous) -42.86% 14.000 8.000 - -50.00% -
465.tonto (unexplained diff vs previous) -41.27% 63.000 37.000 - 0.00% -
400.perlbench (max) (percentage) -36.11% 3.240 2.070 - -29.83% -
400.perlbench (max) -35.36% 345.000 223.000 - -29.43% -
435.gromacs -33.83% 266.000 176.000 - -10.66% -
435.gromacs (avg) -33.83% 266.000 176.000 - -10.66% -
435.gromacs (avg) (percentage) -32.95% 1.730 1.160 - -10.77% -
454.calculix (max) -32.50% 1074.000 725.000 - -8.58% -
444.namd (avg) (percentage) -31.55% 3.930 2.690 - -9.12% -
444.namd -31.55% 355.000 243.000 - -8.65% -
444.namd (avg) -31.55% 355.000 243.000 - -8.65% -
454.calculix (max) (percentage) -31.06% 4.700 3.240 - -8.47% -
482.sphinx3 (unexplained diff vs previous) (percentage) -29.03% 0.620 0.440 - -20.00% -
444.namd (max) (percentage) -28.41% 7.180 5.140 - -11.07% -
444.namd (max) -28.35% 649.000 465.000 - -10.58% -
482.sphinx3 (unexplained diff vs previous) -27.96% 186.000 134.000 - -20.24% -
437.leslie3d -26.89% 357.000 261.000 - -10.00% -
437.leslie3d (avg) -26.89% 357.000 261.000 - -10.00% -
454.calculix -26.36% 459.000 338.000 - -12.21% -
454.calculix (avg) -26.36% 459.000 338.000 - -12.21% -
481.wrf -26.10% 318.000 235.000 - -13.60% -
481.wrf (avg) -26.10% 318.000 235.000 - -13.60% -
481.wrf (avg) (percentage) -25.93% 1.890 1.400 - -13.58% -
454.calculix (avg) (percentage) -24.88% 2.010 1.510 - -12.21% -
456.hmmer -22.67% 75.000 58.000 - -9.38% -
456.hmmer (avg) -22.67% 75.000 58.000 - -9.38% -
453.povray (avg) (percentage) -22.40% 1.250 0.970 - -9.35% -
453.povray -22.22% 81.000 63.000 - -8.70% -
453.povray (avg) -22.22% 81.000 63.000 - -8.70% -
458.sjeng (unexplained diff vs previous) -22.22% 9.000 7.000 - 0.00% -
437.leslie3d (avg) (percentage) -21.85% 2.380 1.860 - -9.71% -
450.soplex (avg) (percentage) -21.77% 1.240 0.970 - -11.01% -
450.soplex -20.94% 191.000 151.000 - -10.65% -
450.soplex (avg) -20.94% 191.000 151.000 - -10.65% -
456.hmmer (avg) (percentage) -20.59% 0.680 0.540 - -10.00% -
433.milc (max) (percentage) -19.87% 3.170 2.540 - -6.62% -
433.milc (max) -19.71% 411.000 330.000 - -7.56% -
453.povray (max) (percentage) -11.07% 2.530 2.250 - -8.54% -
416.gamess (max) -10.98% 656.000 584.000 - -5.65% -
453.povray (max) -10.91% 165.000 147.000 - -8.12% -
416.gamess (max) (percentage) -10.38% 2.890 2.590 - -5.82% -
447.dealII (avg) (percentage) -9.35% 1.070 0.970 - -11.01% -
447.dealII -8.65% 104.000 95.000 - -11.21% -
447.dealII (avg) -8.65% 104.000 95.000 - -11.21% -
400.perlbench (avg) (percentage) -7.48% 1.470 1.360 - -8.11% -
400.perlbench -6.41% 156.000 146.000 - -7.59% -
400.perlbench (avg) -6.41% 156.000 146.000 - -7.59% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 10805.000 -
401.bzip2 15185.000 -
403.gcc 9082.000 -
410.bwaves 15741.000 1.72%
416.gamess 22557.000 -
429.mcf 17232.000 -
433.milc 13011.000 -
434.zeusmp 13334.000 -
435.gromacs 15228.000 -
436.cactusADM 17664.000 -
437.leslie3d 14062.000 -
444.namd 9051.000 -
445.gobmk 12060.000 -
447.dealII 9838.000 -
450.soplex 15595.000 -
453.povray 6534.000 -
454.calculix 22401.000 -
456.hmmer 10765.000 -
458.sjeng 14622.000 -
459.GemsFDTD 23461.000 -
462.libquantum 11625.000 -
464.h264ref 15163.000 -
465.tonto 8358.000 -
470.lbm 12743.000 -
471.omnetpp 10746.000 -
473.astar 14908.000 -
481.wrf 16787.000 -
482.sphinx3 30490.000 -
483.xalancbmk 11900.000 -
Geometric Mean 13734.493 -
Code Size (bytes)
Name Current %
400.perlbench 950396.000 -
401.bzip2 49876.000 -
403.gcc 2689219.000 -
410.bwaves 17880.000 -
416.gamess 6265939.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678605.000 -
436.cactusADM 553558.000 -
437.leslie3d 64933.000 -
444.namd 190967.000 -
445.gobmk 1399447.000 -
447.dealII 2113483.000 -
450.soplex 267429.000 -
453.povray 713188.000 -
454.calculix 1272226.000 -
456.hmmer 231177.000 -
458.sjeng 116217.000 -
459.GemsFDTD 256984.000 -
462.libquantum 31291.000 -
464.h264ref 427908.000 -
465.tonto 2870976.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2635561.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3290554.000 -
Geometric Mean 298390.889 -
sample variability
Name Current %
400.perlbench 146.000 -7.59%
400.perlbench (avg) 146.000 -7.59%
400.perlbench (avg) (percentage) 1.360 -8.11%
400.perlbench (max) 223.000 -29.43%
400.perlbench (max) (percentage) 2.070 -29.83%
400.perlbench (unexplained diff vs previous) 76.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.700 -
401.bzip2 122.000 -10.29%
401.bzip2 (avg) 122.000 -10.29%
401.bzip2 (avg) (percentage) 0.810 -10.00%
401.bzip2 (max) 611.000 -6.43%
401.bzip2 (max) (percentage) 4.030 -6.50%
401.bzip2 (unexplained diff vs previous) 20.000 25.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.130 18.18%
403.gcc 65.000 -15.58%
403.gcc (avg) 65.000 -15.58%
403.gcc (avg) (percentage) 0.720 -15.29%
403.gcc (max) 261.000 -6.12%
403.gcc (max) (percentage) 2.880 -6.19%
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.020 -
410.bwaves 188.000 6.82%
410.bwaves (avg) 188.000 6.82%
410.bwaves (avg) (percentage) 1.200 5.26%
410.bwaves (max) 289.000 -4.93%
410.bwaves (max) (percentage) 1.840 -6.60%
410.bwaves (unexplained diff vs previous) 266.000 158.25%
410.bwaves (unexplained diff vs previous) (percentage) 1.690 152.24%
416.gamess 252.000 -14.58%
416.gamess (avg) 252.000 -14.58%
416.gamess (avg) (percentage) 1.120 -14.50%
416.gamess (max) 584.000 -5.65%
416.gamess (max) (percentage) 2.590 -5.82%
416.gamess (unexplained diff vs previous) 13.000 -27.78%
416.gamess (unexplained diff vs previous) (percentage) 0.060 -25.00%
429.mcf 365.000 -10.32%
429.mcf (avg) 365.000 -10.32%
429.mcf (avg) (percentage) 2.120 -10.55%
429.mcf (max) 2086.000 -6.58%
429.mcf (max) (percentage) 12.110 -6.70%
429.mcf (unexplained diff vs previous) 23.000 228.57%
429.mcf (unexplained diff vs previous) (percentage) 0.130 225.00%
433.milc 225.000 -6.64%
433.milc (avg) 225.000 -6.64%
433.milc (avg) (percentage) 1.730 -5.98%
433.milc (max) 330.000 -7.56%
433.milc (max) (percentage) 2.540 -6.62%
433.milc (unexplained diff vs previous) 114.000 171.43%
433.milc (unexplained diff vs previous) (percentage) 0.880 175.00%
434.zeusmp 228.000 -10.24%
434.zeusmp (avg) 228.000 -10.24%
434.zeusmp (avg) (percentage) 1.710 -10.47%
434.zeusmp (max) 490.000 -6.67%
434.zeusmp (max) (percentage) 3.680 -6.60%
434.zeusmp (unexplained diff vs previous) 11.000 -31.25%
434.zeusmp (unexplained diff vs previous) (percentage) 0.080 -33.33%
435.gromacs 176.000 -10.66%
435.gromacs (avg) 176.000 -10.66%
435.gromacs (avg) (percentage) 1.160 -10.77%
435.gromacs (max) 336.000 -8.20%
435.gromacs (max) (percentage) 2.210 -8.30%
435.gromacs (unexplained diff vs previous) 28.000 833.33%
435.gromacs (unexplained diff vs previous) (percentage) 0.180 800.00%
436.cactusADM 312.000 -10.09%
436.cactusADM (avg) 312.000 -10.09%
436.cactusADM (avg) (percentage) 1.770 -10.15%
436.cactusADM (max) 561.000 -6.66%
436.cactusADM (max) (percentage) 3.180 -6.74%
436.cactusADM (unexplained diff vs previous) 25.000 38.89%
436.cactusADM (unexplained diff vs previous) (percentage) 0.140 40.00%
437.leslie3d 261.000 -10.00%
437.leslie3d (avg) 261.000 -10.00%
437.leslie3d (avg) (percentage) 1.860 -9.71%
437.leslie3d (max) 656.000 -6.95%
437.leslie3d (max) (percentage) 4.670 -6.60%
437.leslie3d (unexplained diff vs previous) 39.000 69.57%
437.leslie3d (unexplained diff vs previous) (percentage) 0.280 75.00%
444.namd 243.000 -8.65%
444.namd (avg) 243.000 -8.65%
444.namd (avg) (percentage) 2.690 -9.12%
444.namd (max) 465.000 -10.58%
444.namd (max) (percentage) 5.140 -11.07%
444.namd (unexplained diff vs previous) 44.000 388.89%
444.namd (unexplained diff vs previous) (percentage) 0.490 390.00%
445.gobmk 34.000 -10.53%
445.gobmk (avg) 34.000 -10.53%
445.gobmk (avg) (percentage) 0.290 -9.38%
445.gobmk (max) 102.000 -8.93%
445.gobmk (max) (percentage) 0.850 -8.60%
445.gobmk (unexplained diff vs previous) 11.000 -52.17%
445.gobmk (unexplained diff vs previous) (percentage) 0.090 -52.63%
447.dealII 95.000 -11.21%
447.dealII (avg) 95.000 -11.21%
447.dealII (avg) (percentage) 0.970 -11.01%
447.dealII (max) 192.000 -3.52%
447.dealII (max) (percentage) 1.960 -2.97%
447.dealII (unexplained diff vs previous) 25.000 -10.71%
447.dealII (unexplained diff vs previous) (percentage) 0.250 -10.71%
450.soplex 151.000 -10.65%
450.soplex (avg) 151.000 -10.65%
450.soplex (avg) (percentage) 0.970 -11.01%
450.soplex (max) 720.000 -6.61%
450.soplex (max) (percentage) 4.620 -6.67%
450.soplex (unexplained diff vs previous) 3.000 -95.45%
450.soplex (unexplained diff vs previous) (percentage) 0.020 -95.24%
453.povray 63.000 -8.70%
453.povray (avg) 63.000 -8.70%
453.povray (avg) (percentage) 0.970 -9.35%
453.povray (max) 147.000 -8.12%
453.povray (max) (percentage) 2.250 -8.54%
453.povray (unexplained diff vs previous) 16.000 6.67%
453.povray (unexplained diff vs previous) (percentage) 0.240 -
454.calculix 338.000 -12.21%
454.calculix (avg) 338.000 -12.21%
454.calculix (avg) (percentage) 1.510 -12.21%
454.calculix (max) 725.000 -8.58%
454.calculix (max) (percentage) 3.240 -8.47%
454.calculix (unexplained diff vs previous) 7.000 -81.08%
454.calculix (unexplained diff vs previous) (percentage) 0.030 -82.35%
456.hmmer 58.000 -9.38%
456.hmmer (avg) 58.000 -9.38%
456.hmmer (avg) (percentage) 0.540 -10.00%
456.hmmer (max) 62.000 -16.22%
456.hmmer (max) (percentage) 0.580 -15.94%
456.hmmer (unexplained diff vs previous) 11.000 -83.82%
456.hmmer (unexplained diff vs previous) (percentage) 0.100 -84.13%
458.sjeng 81.000 -11.96%
458.sjeng (avg) 81.000 -11.96%
458.sjeng (avg) (percentage) 0.560 -11.11%
458.sjeng (max) 407.000 -6.44%
458.sjeng (max) (percentage) 2.790 -6.38%
458.sjeng (unexplained diff vs previous) 7.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.050 -
459.GemsFDTD 358.000 -10.72%
459.GemsFDTD (avg) 358.000 -10.72%
459.GemsFDTD (avg) (percentage) 1.530 -10.53%
459.GemsFDTD (max) 1424.000 -6.56%
459.GemsFDTD (max) (percentage) 6.070 -6.62%
459.GemsFDTD (unexplained diff vs previous) 5.000 -79.17%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.020 -80.00%
462.libquantum 176.000 -10.66%
462.libquantum (avg) 176.000 -10.66%
462.libquantum (avg) (percentage) 1.520 -10.59%
462.libquantum (max) 1111.000 -6.09%
462.libquantum (max) (percentage) 9.560 -6.18%
462.libquantum (unexplained diff vs previous) 6.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.050 150.00%
464.h264ref 207.000 -9.21%
464.h264ref (avg) 207.000 -9.21%
464.h264ref (avg) (percentage) 1.370 -8.67%
464.h264ref (max) 1297.000 -6.29%
464.h264ref (max) (percentage) 8.560 -5.73%
464.h264ref (unexplained diff vs previous) 80.000 196.30%
464.h264ref (unexplained diff vs previous) (percentage) 0.530 194.44%
465.tonto 75.000 -9.64%
465.tonto (avg) 75.000 -9.64%
465.tonto (avg) (percentage) 0.900 -10.00%
465.tonto (max) 165.000 -4.62%
465.tonto (max) (percentage) 1.980 -4.35%
465.tonto (unexplained diff vs previous) 37.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.440 -
470.lbm 322.000 -11.05%
470.lbm (avg) 322.000 -11.05%
470.lbm (avg) (percentage) 2.530 -10.92%
470.lbm (max) 1211.000 -6.70%
470.lbm (max) (percentage) 9.510 -6.58%
470.lbm (unexplained diff vs previous) 8.000 -50.00%
470.lbm (unexplained diff vs previous) (percentage) 0.060 -53.85%
471.omnetpp 248.000 -8.49%
471.omnetpp (avg) 248.000 -8.49%
471.omnetpp (avg) (percentage) 2.310 -7.97%
471.omnetpp (max) 102.000 -93.13%
471.omnetpp (max) (percentage) 0.950 -93.07%
471.omnetpp (unexplained diff vs previous) 81.000 -40.44%
471.omnetpp (unexplained diff vs previous) (percentage) 0.750 -40.48%
473.astar 87.000 -11.22%
473.astar (avg) 87.000 -11.22%
473.astar (avg) (percentage) 0.590 -10.61%
473.astar (max) 649.000 -5.67%
473.astar (max) (percentage) 4.360 -5.63%
473.astar (unexplained diff vs previous) 1.000 -50.00%
473.astar (unexplained diff vs previous) (percentage) 0.010 -
481.wrf 235.000 -13.60%
481.wrf (avg) 235.000 -13.60%
481.wrf (avg) (percentage) 1.400 -13.58%
481.wrf (max) 631.000 -7.48%
481.wrf (max) (percentage) 3.760 -7.39%
481.wrf (unexplained diff vs previous) 17.000 -68.52%
481.wrf (unexplained diff vs previous) (percentage) 0.100 -68.75%
482.sphinx3 521.000 -8.11%
482.sphinx3 (avg) 521.000 -8.11%
482.sphinx3 (avg) (percentage) 1.710 -8.56%
482.sphinx3 (max) 1524.000 -6.33%
482.sphinx3 (max) (percentage) 5.000 -6.72%
482.sphinx3 (unexplained diff vs previous) 134.000 -20.24%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.440 -20.00%
483.xalancbmk 32.000 -5.88%
483.xalancbmk (avg) 32.000 -5.88%
483.xalancbmk (avg) (percentage) 0.270 -6.90%
483.xalancbmk (max) 61.000 -12.86%
483.xalancbmk (max) (percentage) 0.520 -11.86%
483.xalancbmk (unexplained diff vs previous) 22.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.180 -
Geometric Mean 13.672 -11.07%