Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=904d9b02a185c9048cf17bf7295b89d7380cea3d (+ 48 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/573dbd5175dbf16a3b4551ec55800febf0d1b617 (+ 44 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=db9b47e9f996bbdb831580ff7343542a017c80ee (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=06a6642c97bbf927195d2748ba2755a9a0c208de (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/14/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0014 (3-changed-components) 2023-03-19T02:20:45 0:00:00
Previous 0013 (4-changed-components) 2023-01-18T04:27:35 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 94 108
Performance Improvements 95 120
Added Tests 38 0
Unchanged Tests 1009 1008
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.71% 922495.000 938305.000 - 0.82% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 34.20% 8008.000 10747.000 - 30.98% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 11166.67% 0.030 3.380 - 16800.00% -
473.astar (unexplained diff vs previous) 4725.00% 4.000 193.000 - 6333.33% -
429.mcf (max) (percentage) 4331.91% 0.470 20.830 - 3757.41% -
456.hmmer (unexplained diff vs previous) (percentage) 3700.00% 0.010 0.380 - -49.33% -
429.mcf (unexplained diff vs previous) (percentage) 3568.09% 0.470 17.240 - 3092.59% -
473.astar (max) (percentage) 2235.71% 0.140 3.270 - 2235.71% -
483.xalancbmk (max) (percentage) 1717.95% 0.390 7.090 - 1629.27% -
473.astar (avg) (percentage) 1422.22% 0.180 2.740 - 1342.11% -
429.mcf (avg) (percentage) 1035.85% 0.530 6.020 - 1035.85% -
403.gcc (avg) (percentage) 1011.48% 0.610 6.780 - 1011.48% -
456.hmmer (unexplained diff vs previous) 1000.00% 1.000 11.000 - -86.75% -
436.cactusADM (unexplained diff vs previous) (percentage) 964.71% 0.170 1.810 - -44.31% -
403.gcc (max) (percentage) 850.00% 0.680 6.460 - 797.22% -
473.astar (max) 830.00% 20.000 186.000 - 830.00% -
401.bzip2 (avg) (percentage) 690.91% 0.440 3.480 - 690.91% -
458.sjeng (max) (percentage) 585.00% 0.200 1.370 - 522.73% -
483.xalancbmk (max) 565.12% 43.000 286.000 - 535.56% -
462.libquantum (avg) (percentage) 547.62% 0.630 4.080 - 527.69% -
458.sjeng (avg) (percentage) 521.21% 0.330 2.050 - 521.21% -
473.astar 500.00% 26.000 156.000 - 457.14% -
473.astar (avg) 500.00% 26.000 156.000 - 457.14% -
459.GemsFDTD (max) (percentage) 491.38% 0.580 3.430 - 471.67% -
464.h264ref (avg) (percentage) 433.33% 0.540 2.880 - 433.33% -
410.bwaves (max) (percentage) 384.51% 0.710 3.440 - 1538.10% -
429.mcf (max) 380.00% 80.000 384.000 - 317.39% -
456.hmmer (avg) (percentage) 358.46% 0.650 2.980 - 338.24% -
450.soplex (avg) (percentage) 346.77% 1.240 5.540 - 346.77% -
459.GemsFDTD (avg) (percentage) 306.67% 0.900 3.660 - 306.67% -
429.mcf (unexplained diff vs previous) 292.59% 81.000 318.000 - 241.94% -
458.sjeng (max) 271.43% 28.000 104.000 - 235.48% -
453.povray (avg) (percentage) 271.20% 1.250 4.640 - 271.20% -
445.gobmk (avg) (percentage) 263.64% 0.770 2.800 - 263.64% -
401.bzip2 (max) (percentage) 262.96% 0.810 2.940 - 234.09% -
410.bwaves (unexplained diff vs previous) (percentage) 260.56% 0.710 2.560 - 2460.00% -
464.h264ref (max) (percentage) 254.76% 0.420 1.490 - 246.51% -
447.dealII (avg) (percentage) 254.21% 1.070 3.790 - 254.21% -
450.soplex (max) (percentage) 248.09% 1.830 6.370 - 223.35% -
400.perlbench (avg) (percentage) 238.10% 1.470 4.970 - 238.10% -
462.libquantum (unexplained diff vs previous) (percentage) 236.36% 0.220 0.740 - 7300.00% -
458.sjeng 229.79% 47.000 155.000 - 229.79% -
458.sjeng (avg) 229.79% 47.000 155.000 - 229.79% -
482.sphinx3 (avg) (percentage) 223.97% 1.460 4.730 - 223.97% -
433.milc (avg) (percentage) 204.82% 1.660 5.060 - 197.65% -
410.bwaves (avg) (percentage) 197.20% 1.070 3.180 - 191.74% -
454.calculix (avg) (percentage) 195.52% 2.010 5.940 - 195.52% -
434.zeusmp (avg) (percentage) 182.43% 1.480 4.180 - 182.43% -
471.omnetpp (avg) (percentage) 172.33% 1.590 4.330 - 172.33% -
433.milc (unexplained diff vs previous) (percentage) 166.10% 0.590 1.570 - -52.13% -
436.cactusADM (avg) (percentage) 152.83% 1.590 4.020 - 142.17% -
482.sphinx3 (max) (percentage) 152.24% 1.340 3.380 - 129.93% -
462.libquantum (max) (percentage) 150.00% 0.640 1.600 - 150.00% -
465.tonto 136.84% 133.000 315.000 - 129.93% -
465.tonto (avg) 136.84% 133.000 315.000 - 129.93% -
433.milc (max) (percentage) 129.55% 2.640 6.060 - 91.17% -
435.gromacs (avg) (percentage) 117.34% 1.730 3.760 - 117.34% -
471.omnetpp (unexplained diff vs previous) (percentage) 116.57% 1.690 3.660 - 1425.00% -
464.h264ref 114.10% 78.000 167.000 - 114.10% -
464.h264ref (avg) 114.10% 78.000 167.000 - 114.10% -
481.wrf (avg) (percentage) 111.64% 1.890 4.000 - 111.64% -
410.bwaves (max) 94.29% 105.000 204.000 - 580.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 76.12% -
465.tonto (avg) (percentage) 76.05% 1.670 2.940 - 76.05% -
470.lbm (avg) (percentage) 73.00% 2.370 4.100 - 73.00% -
435.gromacs (max) (percentage) 67.55% 1.880 3.150 - 55.94% -
445.gobmk 57.61% 92.000 145.000 - 57.61% -
445.gobmk (avg) 57.61% 92.000 145.000 - 57.61% -
459.GemsFDTD (max) 54.89% 133.000 206.000 - 47.14% -
401.bzip2 50.00% 66.000 99.000 - 50.00% -
401.bzip2 (avg) 50.00% 66.000 99.000 - 50.00% -
444.namd (avg) (percentage) 47.33% 3.930 5.790 - 47.33% -
410.bwaves (unexplained diff vs previous) 44.76% 105.000 152.000 - 913.33% -
464.h264ref (max) 40.98% 61.000 86.000 - 38.71% -
437.leslie3d (unexplained diff vs previous) (percentage) 35.22% 6.700 9.060 - 295.63% -
434.zeusmp (max) (percentage) 33.96% 2.120 2.840 - 24.56% -
416.gamess (avg) (percentage) 33.64% 2.170 2.900 - 33.64% -
437.leslie3d (avg) (percentage) 33.08% 2.600 3.460 - 45.38% -
437.leslie3d (max) (percentage) 32.32% 6.280 8.310 - 255.13% -
445.gobmk (max) (percentage) 30.28% 1.420 1.850 - 20.92% -
436.cactusADM (unexplained diff vs previous) 30.00% 30.000 39.000 - -93.16% -
429.mcf 23.33% 90.000 111.000 - 23.33% -
429.mcf (avg) 23.33% 90.000 111.000 - 23.33% -
456.hmmer 19.72% 71.000 85.000 - 13.33% -
456.hmmer (avg) 19.72% 71.000 85.000 - 13.33% -
410.bwaves 18.24% 159.000 188.000 - 17.50% -
410.bwaves (avg) 18.24% 159.000 188.000 - 17.50% -
400.perlbench (max) (percentage) 11.76% 3.060 3.420 - 5.56% -
453.povray (max) (percentage) 7.59% 2.370 2.550 - 0.79% -
454.calculix (max) (percentage) 7.44% 4.300 4.620 - -1.70% -
470.lbm (max) (percentage) 6.97% 4.590 4.910 - -3.73% -
459.GemsFDTD 6.80% 206.000 220.000 - 4.76% -
459.GemsFDTD (avg) 6.80% 206.000 220.000 - 4.76% -
437.leslie3d (unexplained diff vs previous) 1.49% 942.000 956.000 - 178.72% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -6.87% 120213.000 111949.000 - -6.88% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -99.71% 21737.000 62.000 - -99.73% -
403.gcc -99.35% 8989.000 58.000 - -99.36% -
462.libquantum -98.83% 11589.000 136.000 - -98.83% -
482.sphinx3 -96.88% 29063.000 907.000 - -96.97% -
450.soplex -96.46% 15449.000 547.000 - -96.46% -
444.namd -92.06% 9007.000 715.000 - -92.10% -
453.povray -91.60% 6366.000 535.000 - -91.82% -
433.milc -91.24% 13053.000 1144.000 - -91.18% -
429.mcf -89.20% 17077.000 1845.000 - -89.25% -
436.cactusADM -87.77% 17574.000 2150.000 - -87.75% -
400.perlbench -84.92% 10665.000 1608.000 - -84.90% -
434.zeusmp -81.27% 13206.000 2473.000 - -81.28% -
401.bzip2 -81.03% 15129.000 2870.000 - -81.10% -
447.dealII -79.21% 9552.000 1986.000 - -79.63% -
471.omnetpp -74.23% 10924.000 2815.000 - -73.79% -
456.hmmer -73.97% 11047.000 2876.000 - -73.96% -
459.GemsFDTD -73.73% 22968.000 6034.000 - -74.17% -
470.lbm -69.84% 12328.000 3718.000 - -71.00% -
481.wrf -66.60% 16156.000 5396.000 - -67.95% -
483.xalancbmk -64.10% 11255.000 4040.000 - -63.84% -
473.astar -61.72% 14936.000 5717.000 - -61.71% -
464.h264ref -60.19% 14617.000 5819.000 - -60.02% -
410.bwaves -60.06% 14860.000 5935.000 - -59.78% -
445.gobmk -57.04% 12072.000 5186.000 - -56.77% -
435.gromacs -53.63% 15331.000 7109.000 - -53.89% -
458.sjeng -46.68% 14270.000 7609.000 - -46.70% -
416.gamess -45.44% 22648.000 12357.000 - -45.57% -
437.leslie3d -24.96% 14063.000 10553.000 - -29.67% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (max) -99.79% 934.000 2.000 - -99.81% -
454.calculix -99.31% 436.000 3.000 - -99.35% -
454.calculix (avg) -99.31% 436.000 3.000 - -99.35% -
462.libquantum (max) -97.30% 74.000 2.000 - -97.30% -
444.namd (max) -97.00% 600.000 18.000 - -97.23% -
462.libquantum (unexplained diff vs previous) -96.00% 25.000 1.000 - 0.00% -
403.gcc (max) -95.08% 61.000 3.000 - -95.31% -
403.gcc -94.44% 54.000 3.000 - -94.44% -
403.gcc (avg) -94.44% 54.000 3.000 - -94.44% -
462.libquantum -93.15% 73.000 5.000 - -93.33% -
462.libquantum (avg) -93.15% 73.000 5.000 - -93.33% -
482.sphinx3 (max) -92.29% 389.000 30.000 - -93.17% -
416.gamess (max) -92.28% 622.000 48.000 - -92.68% -
456.hmmer (max) -92.25% 129.000 10.000 - -92.86% -
436.cactusADM (max) -91.52% 460.000 39.000 - -92.93% -
453.povray (max) -91.33% 150.000 13.000 - -92.12% -
482.sphinx3 -90.09% 424.000 42.000 - -90.37% -
482.sphinx3 (avg) -90.09% 424.000 42.000 - -90.37% -
444.namd -88.39% 353.000 41.000 - -88.45% -
444.namd (avg) -88.39% 353.000 41.000 - -88.45% -
450.soplex (max) -87.94% 282.000 34.000 - -88.82% -
416.gamess (max) (percentage) -85.82% 2.750 0.390 - -86.51% -
471.omnetpp (max) -84.75% 649.000 99.000 - -85.05% -
450.soplex -84.29% 191.000 30.000 - -84.29% -
450.soplex (avg) -84.29% 191.000 30.000 - -84.29% -
400.perlbench (max) -83.44% 326.000 54.000 - -84.35% -
447.dealII (max) -81.73% 104.000 19.000 - -82.24% -
433.milc (max) -79.94% 344.000 69.000 - -83.21% -
481.wrf (max) -78.71% 465.000 99.000 - -81.32% -
433.milc (unexplained diff vs previous) -76.62% 77.000 18.000 - -95.76% -
434.zeusmp (max) -74.91% 279.000 70.000 - -76.74% -
433.milc -73.61% 216.000 57.000 - -74.09% -
433.milc (avg) -73.61% 216.000 57.000 - -74.09% -
453.povray -69.62% 79.000 24.000 - -70.37% -
453.povray (avg) -69.62% 79.000 24.000 - -70.37% -
436.cactusADM -69.18% 279.000 86.000 - -70.45% -
436.cactusADM (avg) -69.18% 279.000 86.000 - -70.45% -
470.lbm (max) -67.79% 565.000 182.000 - -72.13% -
456.hmmer (max) (percentage) -67.52% 1.170 0.380 - -70.08% -
444.namd (max) (percentage) -61.17% 6.670 2.590 - -63.93% -
400.perlbench -49.36% 156.000 79.000 - -49.36% -
400.perlbench (avg) -49.36% 156.000 79.000 - -49.36% -
470.lbm -47.95% 292.000 152.000 - -49.83% -
470.lbm (avg) -47.95% 292.000 152.000 - -49.83% -
434.zeusmp -47.18% 195.000 103.000 - -47.18% -
434.zeusmp (avg) -47.18% 195.000 103.000 - -47.18% -
445.gobmk (max) -44.44% 171.000 95.000 - -48.09% -
471.omnetpp (unexplained diff vs previous) -44.32% 185.000 103.000 - 296.15% -
471.omnetpp (max) (percentage) -40.67% 5.950 3.530 - -42.79% -
483.xalancbmk -37.33% 75.000 47.000 - -36.49% -
483.xalancbmk (avg) -37.33% 75.000 47.000 - -36.49% -
481.wrf (max) (percentage) -35.76% 2.880 1.850 - -41.27% -
401.bzip2 (max) -31.15% 122.000 84.000 - -36.84% -
471.omnetpp -30.06% 173.000 121.000 - -28.82% -
471.omnetpp (avg) -30.06% 173.000 121.000 - -28.82% -
481.wrf -29.51% 305.000 215.000 - -32.39% -
481.wrf (avg) -29.51% 305.000 215.000 - -32.39% -
436.cactusADM (max) (percentage) -29.39% 2.620 1.850 - -41.27% -
465.tonto (max) (percentage) -27.84% 3.340 2.410 - -32.68% -
416.gamess -27.09% 491.000 358.000 - -27.24% -
416.gamess (avg) -27.09% 491.000 358.000 - -27.24% -
447.dealII -26.47% 102.000 75.000 - -27.88% -
447.dealII (avg) -26.47% 102.000 75.000 - -27.88% -
435.gromacs (max) -22.57% 288.000 223.000 - -28.30% -
447.dealII (max) (percentage) -9.17% 1.090 0.990 - -10.00% -
465.tonto (max) -3.00% 267.000 259.000 - -11.60% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 30.98% 8205.000 10747.000 - 34.20% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) 24100.00% 0.020 4.840 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 16800.00% 0.020 3.380 - 11166.67% -
453.povray (unexplained diff vs previous) (percentage) 13000.00% 0.020 2.620 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 7300.00% 0.010 0.740 - 236.36% -
473.astar (unexplained diff vs previous) 6333.33% 3.000 193.000 - 4725.00% -
429.mcf (max) (percentage) 3757.41% 0.540 20.830 - 4331.91% -
429.mcf (unexplained diff vs previous) (percentage) 3092.59% 0.540 17.240 - 3568.09% -
410.bwaves (unexplained diff vs previous) (percentage) 2460.00% 0.100 2.560 - 260.56% -
473.astar (max) (percentage) 2235.71% 0.140 3.270 - 2235.71% -
458.sjeng (unexplained diff vs previous) (percentage) 2216.67% 0.060 1.390 - 0.00% -
483.xalancbmk (max) (percentage) 1629.27% 0.410 7.090 - 1717.95% -
410.bwaves (max) (percentage) 1538.10% 0.210 3.440 - 384.51% -
471.omnetpp (unexplained diff vs previous) (percentage) 1425.00% 0.240 3.660 - 116.57% -
464.h264ref (unexplained diff vs previous) (percentage) 1410.00% 0.100 1.510 - 0.00% -
473.astar (avg) (percentage) 1342.11% 0.190 2.740 - 1422.22% -
453.povray (unexplained diff vs previous) 1300.00% 1.000 14.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 1077.78% 9.000 106.000 - 0.00% -
429.mcf (avg) (percentage) 1035.85% 0.530 6.020 - 1035.85% -
403.gcc (avg) (percentage) 1011.48% 0.610 6.780 - 1011.48% -
410.bwaves (unexplained diff vs previous) 913.33% 15.000 152.000 - 44.76% -
473.astar (max) 830.00% 20.000 186.000 - 830.00% -
403.gcc (max) (percentage) 797.22% 0.720 6.460 - 850.00% -
401.bzip2 (avg) (percentage) 690.91% 0.440 3.480 - 690.91% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 666.67% 0.210 1.610 - 0.00% -
410.bwaves (max) 580.00% 30.000 204.000 - 94.29% -
483.xalancbmk (max) 535.56% 45.000 286.000 - 565.12% -
462.libquantum (avg) (percentage) 527.69% 0.650 4.080 - 547.62% -
458.sjeng (max) (percentage) 522.73% 0.220 1.370 - 585.00% -
458.sjeng (avg) (percentage) 521.21% 0.330 2.050 - 521.21% -
464.h264ref (unexplained diff vs previous) 486.67% 15.000 88.000 - 0.00% -
459.GemsFDTD (max) (percentage) 471.67% 0.600 3.430 - 491.38% -
473.astar 457.14% 28.000 156.000 - 500.00% -
473.astar (avg) 457.14% 28.000 156.000 - 500.00% -
464.h264ref (avg) (percentage) 433.33% 0.540 2.880 - 433.33% -
450.soplex (avg) (percentage) 346.77% 1.240 5.540 - 346.77% -
456.hmmer (avg) (percentage) 338.24% 0.680 2.980 - 358.46% -
465.tonto (unexplained diff vs previous) 320.63% 63.000 265.000 - 0.00% -
429.mcf (max) 317.39% 92.000 384.000 - 380.00% -
459.GemsFDTD (avg) (percentage) 306.67% 0.900 3.660 - 306.67% -
471.omnetpp (unexplained diff vs previous) 296.15% 26.000 103.000 - -44.32% -
437.leslie3d (unexplained diff vs previous) (percentage) 295.63% 2.290 9.060 - 35.22% -
482.sphinx3 (unexplained diff vs previous) (percentage) 291.94% 0.620 2.430 - 0.00% -
453.povray (avg) (percentage) 271.20% 1.250 4.640 - 271.20% -
445.gobmk (avg) (percentage) 263.64% 0.770 2.800 - 263.64% -
437.leslie3d (max) (percentage) 255.13% 2.340 8.310 - 32.32% -
447.dealII (avg) (percentage) 254.21% 1.070 3.790 - 254.21% -
401.bzip2 (unexplained diff vs previous) (percentage) 248.28% 0.870 3.030 - 0.00% -
464.h264ref (max) (percentage) 246.51% 0.430 1.490 - 254.76% -
429.mcf (unexplained diff vs previous) 241.94% 93.000 318.000 - 292.59% -
400.perlbench (avg) (percentage) 238.10% 1.470 4.970 - 238.10% -
458.sjeng (max) 235.48% 31.000 104.000 - 271.43% -
401.bzip2 (max) (percentage) 234.09% 0.880 2.940 - 262.96% -
458.sjeng 229.79% 47.000 155.000 - 229.79% -
458.sjeng (avg) 229.79% 47.000 155.000 - 229.79% -
482.sphinx3 (avg) (percentage) 223.97% 1.460 4.730 - 223.97% -
450.soplex (max) (percentage) 223.35% 1.970 6.370 - 248.09% -
465.tonto (unexplained diff vs previous) (percentage) 220.78% 0.770 2.470 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 218.18% 0.110 0.350 - 0.00% -
433.milc (avg) (percentage) 197.65% 1.700 5.060 - 204.82% -
454.calculix (avg) (percentage) 195.52% 2.010 5.940 - 195.52% -
410.bwaves (avg) (percentage) 191.74% 1.090 3.180 - 197.20% -
434.zeusmp (avg) (percentage) 182.43% 1.480 4.180 - 182.43% -
437.leslie3d (unexplained diff vs previous) 178.72% 343.000 956.000 - 1.49% -
471.omnetpp (avg) (percentage) 172.33% 1.590 4.330 - 172.33% -
462.libquantum (max) (percentage) 150.00% 0.640 1.600 - 150.00% -
437.leslie3d (max) 149.57% 351.000 876.000 - -0.79% -
436.cactusADM (avg) (percentage) 142.17% 1.660 4.020 - 152.83% -
403.gcc (unexplained diff vs previous) (percentage) 138.89% 0.720 1.720 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 137.31% 0.670 1.590 - 0.00% -
482.sphinx3 (max) (percentage) 129.93% 1.470 3.380 - 152.24% -
465.tonto 129.93% 137.000 315.000 - 136.84% -
465.tonto (avg) 129.93% 137.000 315.000 - 136.84% -
435.gromacs (avg) (percentage) 117.34% 1.730 3.760 - 117.34% -
464.h264ref 114.10% 78.000 167.000 - 114.10% -
464.h264ref (avg) 114.10% 78.000 167.000 - 114.10% -
481.wrf (avg) (percentage) 111.64% 1.890 4.000 - 111.64% -
459.GemsFDTD (unexplained diff vs previous) 102.08% 48.000 97.000 - 0.00% -
433.milc (max) (percentage) 91.17% 3.170 6.060 - 129.55% -
450.soplex (unexplained diff vs previous) (percentage) 82.09% 2.010 3.660 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 76.12% -
465.tonto (avg) (percentage) 76.05% 1.670 2.940 - 76.05% -
470.lbm (avg) (percentage) 73.00% 2.370 4.100 - 73.00% -
435.gromacs (unexplained diff vs previous) (percentage) 57.77% 2.060 3.250 - 0.00% -
445.gobmk 57.61% 92.000 145.000 - 57.61% -
445.gobmk (avg) 57.61% 92.000 145.000 - 57.61% -
435.gromacs (max) (percentage) 55.94% 2.020 3.150 - 67.55% -
401.bzip2 50.00% 66.000 99.000 - 50.00% -
401.bzip2 (avg) 50.00% 66.000 99.000 - 50.00% -
444.namd (avg) (percentage) 47.33% 3.930 5.790 - 47.33% -
459.GemsFDTD (max) 47.14% 140.000 206.000 - 54.89% -
437.leslie3d (avg) (percentage) 45.38% 2.380 3.460 - 33.08% -
464.h264ref (max) 38.71% 62.000 86.000 - 40.98% -
416.gamess (avg) (percentage) 33.64% 2.170 2.900 - 33.64% -
434.zeusmp (max) (percentage) 24.56% 2.280 2.840 - 33.96% -
429.mcf 23.33% 90.000 111.000 - 23.33% -
429.mcf (avg) 23.33% 90.000 111.000 - 23.33% -
445.gobmk (max) (percentage) 20.92% 1.530 1.850 - 30.28% -
410.bwaves 17.50% 160.000 188.000 - 18.24% -
410.bwaves (avg) 17.50% 160.000 188.000 - 18.24% -
456.hmmer 13.33% 75.000 85.000 - 19.72% -
456.hmmer (avg) 13.33% 75.000 85.000 - 19.72% -
400.perlbench (unexplained diff vs previous) (percentage) 5.67% 3.350 3.540 - 0.00% -
400.perlbench (max) (percentage) 5.56% 3.240 3.420 - 11.76% -
459.GemsFDTD 4.76% 210.000 220.000 - 6.80% -
459.GemsFDTD (avg) 4.76% 210.000 220.000 - 6.80% -
437.leslie3d 2.24% 357.000 365.000 - 0.00% -
437.leslie3d (avg) 2.24% 357.000 365.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.88% 120221.000 111949.000 - -6.87% -
464.h264ref -1.01% 428364.000 424048.000 - 0.93% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - -99.71% -
403.gcc -99.36% 9010.000 58.000 - -99.35% -
462.libquantum -98.83% 11614.000 136.000 - -98.83% -
482.sphinx3 -96.97% 29928.000 907.000 - -96.88% -
450.soplex -96.46% 15466.000 547.000 - -96.46% -
444.namd -92.10% 9050.000 715.000 - -92.06% -
453.povray -91.82% 6544.000 535.000 - -91.60% -
433.milc -91.18% 12976.000 1144.000 - -91.24% -
429.mcf -89.25% 17158.000 1845.000 - -89.20% -
436.cactusADM -87.75% 17544.000 2150.000 - -87.77% -
400.perlbench -84.90% 10650.000 1608.000 - -84.92% -
434.zeusmp -81.28% 13211.000 2473.000 - -81.27% -
401.bzip2 -81.10% 15185.000 2870.000 - -81.03% -
447.dealII -79.63% 9751.000 1986.000 - -79.21% -
459.GemsFDTD -74.17% 23356.000 6034.000 - -73.73% -
456.hmmer -73.96% 11046.000 2876.000 - -73.97% -
471.omnetpp -73.79% 10739.000 2815.000 - -74.23% -
470.lbm -71.00% 12819.000 3718.000 - -69.84% -
481.wrf -67.95% 16834.000 5396.000 - -66.60% -
483.xalancbmk -63.84% 11172.000 4040.000 - -64.10% -
473.astar -61.71% 14932.000 5717.000 - -61.72% -
464.h264ref -60.02% 14556.000 5819.000 - -60.19% -
410.bwaves -59.78% 14755.000 5935.000 - -60.06% -
445.gobmk -56.77% 11995.000 5186.000 - -57.04% -
435.gromacs -53.89% 15419.000 7109.000 - -53.63% -
458.sjeng -46.70% 14275.000 7609.000 - -46.68% -
416.gamess -45.57% 22704.000 12357.000 - -45.44% -
437.leslie3d -29.67% 15005.000 10553.000 - -24.96% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.81% 1074.000 2.000 - -99.79% -
454.calculix -99.35% 459.000 3.000 - -99.31% -
454.calculix (avg) -99.35% 459.000 3.000 - -99.31% -
447.dealII (unexplained diff vs previous) -98.68% 76.000 1.000 - 0.00% -
403.gcc (unexplained diff vs previous) -98.46% 65.000 1.000 - 0.00% -
462.libquantum (max) -97.30% 74.000 2.000 - -97.30% -
444.namd (unexplained diff vs previous) -97.29% 700.000 19.000 - 0.00% -
444.namd (max) -97.23% 649.000 18.000 - -97.00% -
433.milc (unexplained diff vs previous) -95.76% 425.000 18.000 - -76.62% -
403.gcc (max) -95.31% 64.000 3.000 - -95.08% -
403.gcc -94.44% 54.000 3.000 - -94.44% -
403.gcc (avg) -94.44% 54.000 3.000 - -94.44% -
447.dealII (unexplained diff vs previous) (percentage) -93.59% 0.780 0.050 - 0.00% -
450.soplex (unexplained diff vs previous) -93.57% 311.000 20.000 - 0.00% -
462.libquantum -93.33% 75.000 5.000 - -93.15% -
462.libquantum (avg) -93.33% 75.000 5.000 - -93.15% -
482.sphinx3 (max) -93.17% 439.000 30.000 - -92.29% -
436.cactusADM (unexplained diff vs previous) -93.16% 570.000 39.000 - 30.00% -
436.cactusADM (max) -92.93% 552.000 39.000 - -91.52% -
416.gamess (unexplained diff vs previous) -92.90% 676.000 48.000 - 0.00% -
456.hmmer (max) -92.86% 140.000 10.000 - -92.25% -
416.gamess (max) -92.68% 656.000 48.000 - -92.28% -
453.povray (max) -92.12% 165.000 13.000 - -91.33% -
482.sphinx3 -90.37% 436.000 42.000 - -90.09% -
482.sphinx3 (avg) -90.37% 436.000 42.000 - -90.09% -
450.soplex (max) -88.82% 304.000 34.000 - -87.94% -
434.zeusmp (unexplained diff vs previous) -88.64% 308.000 35.000 - 0.00% -
444.namd -88.45% 355.000 41.000 - -88.39% -
444.namd (avg) -88.45% 355.000 41.000 - -88.39% -
482.sphinx3 (unexplained diff vs previous) -88.17% 186.000 22.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -86.91% 2.980 0.390 - 0.00% -
456.hmmer (unexplained diff vs previous) -86.75% 83.000 11.000 - 1000.00% -
416.gamess (max) (percentage) -86.51% 2.890 0.390 - -85.82% -
471.omnetpp (max) -85.05% 662.000 99.000 - -84.75% -
400.perlbench (max) -84.35% 345.000 54.000 - -83.44% -
450.soplex -84.29% 191.000 30.000 - -84.29% -
450.soplex (avg) -84.29% 191.000 30.000 - -84.29% -
400.perlbench (unexplained diff vs previous) -84.03% 357.000 57.000 - 0.00% -
433.milc (max) -83.21% 411.000 69.000 - -79.94% -
447.dealII (max) -82.24% 107.000 19.000 - -81.73% -
481.wrf (max) -81.32% 530.000 99.000 - -78.71% -
434.zeusmp (max) -76.74% 301.000 70.000 - -74.91% -
433.milc -74.09% 220.000 57.000 - -73.61% -
433.milc (avg) -74.09% 220.000 57.000 - -73.61% -
470.lbm (max) -72.13% 653.000 182.000 - -67.79% -
436.cactusADM -70.45% 291.000 86.000 - -69.18% -
436.cactusADM (avg) -70.45% 291.000 86.000 - -69.18% -
453.povray -70.37% 81.000 24.000 - -69.62% -
453.povray (avg) -70.37% 81.000 24.000 - -69.62% -
456.hmmer (max) (percentage) -70.08% 1.270 0.380 - -67.52% -
445.gobmk (unexplained diff vs previous) -66.67% 186.000 62.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -65.59% 7.730 2.660 - 0.00% -
444.namd (max) (percentage) -63.93% 7.180 2.590 - -61.17% -
433.milc (unexplained diff vs previous) (percentage) -52.13% 3.280 1.570 - 166.10% -
470.lbm -49.83% 303.000 152.000 - -47.95% -
470.lbm (avg) -49.83% 303.000 152.000 - -47.95% -
400.perlbench -49.36% 156.000 79.000 - -49.36% -
400.perlbench (avg) -49.36% 156.000 79.000 - -49.36% -
456.hmmer (unexplained diff vs previous) (percentage) -49.33% 0.750 0.380 - 3700.00% -
445.gobmk (max) -48.09% 183.000 95.000 - -44.44% -
434.zeusmp -47.18% 195.000 103.000 - -47.18% -
434.zeusmp (avg) -47.18% 195.000 103.000 - -47.18% -
436.cactusADM (unexplained diff vs previous) (percentage) -44.31% 3.250 1.810 - 964.71% -
471.omnetpp (max) (percentage) -42.79% 6.170 3.530 - -40.67% -
436.cactusADM (max) (percentage) -41.27% 3.150 1.850 - -29.39% -
481.wrf (max) (percentage) -41.27% 3.150 1.850 - -35.76% -
454.calculix (unexplained diff vs previous) -40.00% 5.000 3.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -39.06% 2.330 1.420 - 0.00% -
401.bzip2 (max) -36.84% 133.000 84.000 - -31.15% -
483.xalancbmk -36.49% 74.000 47.000 - -37.33% -
483.xalancbmk (avg) -36.49% 74.000 47.000 - -37.33% -
401.bzip2 (unexplained diff vs previous) -34.09% 132.000 87.000 - 0.00% -
465.tonto (max) (percentage) -32.68% 3.580 2.410 - -27.84% -
481.wrf -32.39% 318.000 215.000 - -29.51% -
481.wrf (avg) -32.39% 318.000 215.000 - -29.51% -
471.omnetpp -28.82% 170.000 121.000 - -30.06% -
471.omnetpp (avg) -28.82% 170.000 121.000 - -30.06% -
435.gromacs (max) -28.30% 311.000 223.000 - -22.57% -
447.dealII -27.88% 104.000 75.000 - -26.47% -
447.dealII (avg) -27.88% 104.000 75.000 - -26.47% -
435.gromacs (unexplained diff vs previous) -27.36% 318.000 231.000 - 0.00% -
416.gamess -27.24% 492.000 358.000 - -27.09% -
416.gamess (avg) -27.24% 492.000 358.000 - -27.09% -
481.wrf (unexplained diff vs previous) -23.21% 112.000 86.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -22.58% 1.550 1.200 - 0.00% -
465.tonto (max) -11.60% 293.000 259.000 - -3.00% -
447.dealII (max) (percentage) -10.00% 1.100 0.990 - -9.17% -
470.lbm (unexplained diff vs previous) -7.14% 14.000 13.000 - 0.00% -
470.lbm (max) (percentage) -3.73% 5.100 4.910 - 6.97% -
454.calculix (max) (percentage) -1.70% 4.700 4.620 - 7.44% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1608.000 -84.92%
401.bzip2 2870.000 -81.03%
403.gcc 58.000 -99.35%
410.bwaves 5935.000 -60.06%
416.gamess 12357.000 -45.44%
429.mcf 1845.000 -89.20%
433.milc 1144.000 -91.24%
434.zeusmp 2473.000 -81.27%
435.gromacs 7109.000 -53.63%
436.cactusADM 2150.000 -87.77%
437.leslie3d 10553.000 -24.96%
444.namd 715.000 -92.06%
445.gobmk 5186.000 -57.04%
447.dealII 1986.000 -79.21%
450.soplex 547.000 -96.46%
453.povray 535.000 -91.60%
454.calculix 62.000 -99.71%
456.hmmer 2876.000 -73.97%
458.sjeng 7609.000 -46.68%
459.GemsFDTD 6034.000 -73.73%
462.libquantum 136.000 -98.83%
464.h264ref 5819.000 -60.19%
465.tonto 10747.000 34.20%
470.lbm 3718.000 -69.84%
471.omnetpp 2815.000 -74.23%
473.astar 5717.000 -61.72%
481.wrf 5396.000 -66.60%
482.sphinx3 907.000 -96.88%
483.xalancbmk 4040.000 -64.10%
Geometric Mean 2120.627 -84.32%
Code Size (bytes)
Name Current %
400.perlbench 938305.000 1.71%
401.bzip2 49892.000 -
403.gcc 2678237.000 -
410.bwaves 17876.000 -
416.gamess 6261095.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165667.000 -
435.gromacs 678645.000 -
436.cactusADM 553658.000 -
437.leslie3d 65173.000 -
444.namd 190962.000 -
445.gobmk 1399483.000 -
447.dealII 2121732.000 -
450.soplex 260508.000 -
453.povray 704477.000 -
454.calculix 1272852.000 -
456.hmmer 231140.000 -
458.sjeng 111949.000 -6.87%
459.GemsFDTD 253981.000 -
462.libquantum 31297.000 -
464.h264ref 424048.000 -
465.tonto 2875386.000 -
470.lbm 10908.000 -
471.omnetpp 566593.000 -
473.astar 32056.000 -
481.wrf 2638533.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3281683.000 -
Geometric Mean 297144.711 -
sample variability
Name Current %
400.perlbench 79.000 -49.36%
400.perlbench (avg) 79.000 -49.36%
400.perlbench (avg) (percentage) 4.970 238.10%
400.perlbench (max) 54.000 -83.44%
400.perlbench (max) (percentage) 3.420 11.76%
400.perlbench (unexplained diff vs previous) 57.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.540 -
401.bzip2 99.000 50.00%
401.bzip2 (avg) 99.000 50.00%
401.bzip2 (avg) (percentage) 3.480 690.91%
401.bzip2 (max) 84.000 -31.15%
401.bzip2 (max) (percentage) 2.940 262.96%
401.bzip2 (unexplained diff vs previous) 87.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 3.030 -
403.gcc 3.000 -94.44%
403.gcc (avg) 3.000 -94.44%
403.gcc (avg) (percentage) 6.780 1011.48%
403.gcc (max) 3.000 -95.08%
403.gcc (max) (percentage) 6.460 850.00%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.720 -
410.bwaves 188.000 18.24%
410.bwaves (avg) 188.000 18.24%
410.bwaves (avg) (percentage) 3.180 197.20%
410.bwaves (max) 204.000 94.29%
410.bwaves (max) (percentage) 3.440 384.51%
410.bwaves (unexplained diff vs previous) 152.000 44.76%
410.bwaves (unexplained diff vs previous) (percentage) 2.560 260.56%
416.gamess 358.000 -27.09%
416.gamess (avg) 358.000 -27.09%
416.gamess (avg) (percentage) 2.900 33.64%
416.gamess (max) 48.000 -92.28%
416.gamess (max) (percentage) 0.390 -85.82%
416.gamess (unexplained diff vs previous) 48.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.390 -
429.mcf 111.000 23.33%
429.mcf (avg) 111.000 23.33%
429.mcf (avg) (percentage) 6.020 1035.85%
429.mcf (max) 384.000 380.00%
429.mcf (max) (percentage) 20.830 4331.91%
429.mcf (unexplained diff vs previous) 318.000 292.59%
429.mcf (unexplained diff vs previous) (percentage) 17.240 3568.09%
433.milc 57.000 -73.61%
433.milc (avg) 57.000 -73.61%
433.milc (avg) (percentage) 5.060 204.82%
433.milc (max) 69.000 -79.94%
433.milc (max) (percentage) 6.060 129.55%
433.milc (unexplained diff vs previous) 18.000 -76.62%
433.milc (unexplained diff vs previous) (percentage) 1.570 166.10%
434.zeusmp 103.000 -47.18%
434.zeusmp (avg) 103.000 -47.18%
434.zeusmp (avg) (percentage) 4.180 182.43%
434.zeusmp (max) 70.000 -74.91%
434.zeusmp (max) (percentage) 2.840 33.96%
434.zeusmp (unexplained diff vs previous) 35.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.420 -
435.gromacs 267.000 -
435.gromacs (avg) 267.000 -
435.gromacs (avg) (percentage) 3.760 117.34%
435.gromacs (max) 223.000 -22.57%
435.gromacs (max) (percentage) 3.150 67.55%
435.gromacs (unexplained diff vs previous) 231.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.250 -
436.cactusADM 86.000 -69.18%
436.cactusADM (avg) 86.000 -69.18%
436.cactusADM (avg) (percentage) 4.020 152.83%
436.cactusADM (max) 39.000 -91.52%
436.cactusADM (max) (percentage) 1.850 -29.39%
436.cactusADM (unexplained diff vs previous) 39.000 30.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.810 964.71%
437.leslie3d 365.000 -
437.leslie3d (avg) 365.000 -
437.leslie3d (avg) (percentage) 3.460 33.08%
437.leslie3d (max) 876.000 -
437.leslie3d (max) (percentage) 8.310 32.32%
437.leslie3d (unexplained diff vs previous) 956.000 1.49%
437.leslie3d (unexplained diff vs previous) (percentage) 9.060 35.22%
444.namd 41.000 -88.39%
444.namd (avg) 41.000 -88.39%
444.namd (avg) (percentage) 5.790 47.33%
444.namd (max) 18.000 -97.00%
444.namd (max) (percentage) 2.590 -61.17%
444.namd (unexplained diff vs previous) 19.000 -
444.namd (unexplained diff vs previous) (percentage) 2.660 -
445.gobmk 145.000 57.61%
445.gobmk (avg) 145.000 57.61%
445.gobmk (avg) (percentage) 2.800 263.64%
445.gobmk (max) 95.000 -44.44%
445.gobmk (max) (percentage) 1.850 30.28%
445.gobmk (unexplained diff vs previous) 62.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.200 -
447.dealII 75.000 -26.47%
447.dealII (avg) 75.000 -26.47%
447.dealII (avg) (percentage) 3.790 254.21%
447.dealII (max) 19.000 -81.73%
447.dealII (max) (percentage) 0.990 -9.17%
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.050 -
450.soplex 30.000 -84.29%
450.soplex (avg) 30.000 -84.29%
450.soplex (avg) (percentage) 5.540 346.77%
450.soplex (max) 34.000 -87.94%
450.soplex (max) (percentage) 6.370 248.09%
450.soplex (unexplained diff vs previous) 20.000 -
450.soplex (unexplained diff vs previous) (percentage) 3.660 -
453.povray 24.000 -69.62%
453.povray (avg) 24.000 -69.62%
453.povray (avg) (percentage) 4.640 271.20%
453.povray (max) 13.000 -91.33%
453.povray (max) (percentage) 2.550 7.59%
453.povray (unexplained diff vs previous) 14.000 -
453.povray (unexplained diff vs previous) (percentage) 2.620 -
454.calculix 3.000 -99.31%
454.calculix (avg) 3.000 -99.31%
454.calculix (avg) (percentage) 5.940 195.52%
454.calculix (max) 2.000 -99.79%
454.calculix (max) (percentage) 4.620 7.44%
454.calculix (unexplained diff vs previous) 3.000 -
454.calculix (unexplained diff vs previous) (percentage) 4.840 -
456.hmmer 85.000 19.72%
456.hmmer (avg) 85.000 19.72%
456.hmmer (avg) (percentage) 2.980 358.46%
456.hmmer (max) 10.000 -92.25%
456.hmmer (max) (percentage) 0.380 -67.52%
456.hmmer (unexplained diff vs previous) 11.000 1000.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.380 3700.00%
458.sjeng 155.000 229.79%
458.sjeng (avg) 155.000 229.79%
458.sjeng (avg) (percentage) 2.050 521.21%
458.sjeng (max) 104.000 271.43%
458.sjeng (max) (percentage) 1.370 585.00%
458.sjeng (unexplained diff vs previous) 106.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.390 -
459.GemsFDTD 220.000 6.80%
459.GemsFDTD (avg) 220.000 6.80%
459.GemsFDTD (avg) (percentage) 3.660 306.67%
459.GemsFDTD (max) 206.000 54.89%
459.GemsFDTD (max) (percentage) 3.430 491.38%
459.GemsFDTD (unexplained diff vs previous) 97.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.610 -
462.libquantum 5.000 -93.15%
462.libquantum (avg) 5.000 -93.15%
462.libquantum (avg) (percentage) 4.080 547.62%
462.libquantum (max) 2.000 -97.30%
462.libquantum (max) (percentage) 1.600 150.00%
462.libquantum (unexplained diff vs previous) 1.000 -96.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.740 236.36%
464.h264ref 167.000 114.10%
464.h264ref (avg) 167.000 114.10%
464.h264ref (avg) (percentage) 2.880 433.33%
464.h264ref (max) 86.000 40.98%
464.h264ref (max) (percentage) 1.490 254.76%
464.h264ref (unexplained diff vs previous) 88.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.510 -
465.tonto 315.000 136.84%
465.tonto (avg) 315.000 136.84%
465.tonto (avg) (percentage) 2.940 76.05%
465.tonto (max) 259.000 -3.00%
465.tonto (max) (percentage) 2.410 -27.84%
465.tonto (unexplained diff vs previous) 265.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.470 -
470.lbm 152.000 -47.95%
470.lbm (avg) 152.000 -47.95%
470.lbm (avg) (percentage) 4.100 73.00%
470.lbm (max) 182.000 -67.79%
470.lbm (max) (percentage) 4.910 6.97%
470.lbm (unexplained diff vs previous) 13.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.350 -
471.omnetpp 121.000 -30.06%
471.omnetpp (avg) 121.000 -30.06%
471.omnetpp (avg) (percentage) 4.330 172.33%
471.omnetpp (max) 99.000 -84.75%
471.omnetpp (max) (percentage) 3.530 -40.67%
471.omnetpp (unexplained diff vs previous) 103.000 -44.32%
471.omnetpp (unexplained diff vs previous) (percentage) 3.660 116.57%
473.astar 156.000 500.00%
473.astar (avg) 156.000 500.00%
473.astar (avg) (percentage) 2.740 1422.22%
473.astar (max) 186.000 830.00%
473.astar (max) (percentage) 3.270 2235.71%
473.astar (unexplained diff vs previous) 193.000 4725.00%
473.astar (unexplained diff vs previous) (percentage) 3.380 11166.67%
481.wrf 215.000 -29.51%
481.wrf (avg) 215.000 -29.51%
481.wrf (avg) (percentage) 4.000 111.64%
481.wrf (max) 99.000 -78.71%
481.wrf (max) (percentage) 1.850 -35.76%
481.wrf (unexplained diff vs previous) 86.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.590 -
482.sphinx3 42.000 -90.09%
482.sphinx3 (avg) 42.000 -90.09%
482.sphinx3 (avg) (percentage) 4.730 223.97%
482.sphinx3 (max) 30.000 -92.29%
482.sphinx3 (max) (percentage) 3.380 152.24%
482.sphinx3 (unexplained diff vs previous) 22.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.430 -
483.xalancbmk 47.000 -37.33%
483.xalancbmk (avg) 47.000 -37.33%
483.xalancbmk (avg) (percentage) 1.180 76.12%
483.xalancbmk (max) 286.000 565.12%
483.xalancbmk (max) (percentage) 7.090 1717.95%
Geometric Mean 15.955 -14.89%