Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=929a05081ec2ca6448927b96f673b0cd9633a342 (+ 26 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f189c4ab489ce72e949c1ecde6b97e9dcbddf72e (+ 122 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0d5cb2ae27c0a163c15e5222fb132bf9d026b14b (+ 32 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/30/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0030 (3-changed-components) 2023-04-04T20:59:16 0:00:00
Previous 0029 (3-changed-components) 2023-04-02T11:43:40 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 28 10
Performance Improvements 149 195
Added Tests 13 7
Unchanged Tests 1046 1024
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 2.37% 549.000 562.000 - 2.74% -
481.wrf 1.71% 5428.000 5521.000 - -0.23% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) 433.33% 3.000 16.000 - -99.84% -
473.astar (unexplained diff vs previous) (percentage) 416.67% 0.060 0.310 - -99.84% -
453.povray (max) 333.33% 3.000 13.000 - -97.39% -
450.soplex (unexplained diff vs previous) (percentage) 305.88% 0.170 0.690 - -99.97% -
450.soplex (unexplained diff vs previous) 300.00% 1.000 4.000 - -99.97% -
453.povray (max) (percentage) 229.17% 0.720 2.370 - -97.40% -
453.povray (unexplained diff vs previous) 225.00% 4.000 13.000 - -99.77% -
453.povray (unexplained diff vs previous) (percentage) 216.44% 0.730 2.310 - -99.78% -
470.lbm (unexplained diff vs previous) (percentage) 160.00% 0.050 0.130 - -99.95% -
470.lbm (unexplained diff vs previous) 150.00% 2.000 5.000 - -99.95% -
450.soplex (max) 100.00% 2.000 4.000 - -99.27% -
436.cactusADM (unexplained diff vs previous) (percentage) 72.73% 0.330 0.570 - -99.93% -
436.cactusADM (unexplained diff vs previous) 71.43% 7.000 12.000 - -99.93% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 48.39% 0.310 0.460 - -99.82% -
459.GemsFDTD (unexplained diff vs previous) 47.37% 19.000 28.000 - -99.82% -
447.dealII (unexplained diff vs previous) (percentage) 44.29% 0.700 1.010 - -99.75% -
447.dealII (unexplained diff vs previous) 41.67% 12.000 17.000 - -99.76% -
450.soplex (max) (percentage) 40.00% 0.500 0.700 - -99.27% -
416.gamess (unexplained diff vs previous) (percentage) 33.33% 0.030 0.040 - -99.94% -
416.gamess (unexplained diff vs previous) 25.00% 4.000 5.000 - -99.94% -
434.zeusmp (max) 17.65% 17.000 20.000 - -99.03% -
434.zeusmp (max) (percentage) 12.68% 0.710 0.800 - -99.02% -
434.zeusmp (unexplained diff vs previous) 11.11% 18.000 20.000 - -99.82% -
434.zeusmp (unexplained diff vs previous) (percentage) 9.72% 0.720 0.790 - -99.82% -
459.GemsFDTD (max) 8.00% 25.000 27.000 - -99.39% -
459.GemsFDTD (max) (percentage) 7.14% 0.420 0.450 - -99.37% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.28% 61.000 59.000 - 5.36% -
435.gromacs -1.12% 7383.000 7300.000 - 0.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -99.46% 7.360 0.040 - -99.80% -
437.leslie3d (unexplained diff vs previous) -99.39% 825.000 5.000 - -99.78% -
410.bwaves (unexplained diff vs previous) -94.29% 35.000 2.000 - -99.97% -
410.bwaves (unexplained diff vs previous) (percentage) -93.55% 0.620 0.040 - -99.97% -
458.sjeng (unexplained diff vs previous) -82.76% 29.000 5.000 - -99.93% -
458.sjeng (unexplained diff vs previous) (percentage) -81.58% 0.380 0.070 - -99.92% -
433.milc (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.99% -
433.milc (unexplained diff vs previous) (percentage) -74.29% 0.350 0.090 - -99.99% -
482.sphinx3 (unexplained diff vs previous) -71.43% 14.000 4.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) (percentage) -71.43% 1.470 0.420 - -99.98% -
454.calculix (max) (percentage) -65.36% 3.840 1.330 - -98.67% -
483.xalancbmk (unexplained diff vs previous) -60.98% 41.000 16.000 - -99.81% -
483.xalancbmk (unexplained diff vs previous) (percentage) -60.75% 1.070 0.420 - -99.81% -
401.bzip2 (unexplained diff vs previous) -53.85% 39.000 18.000 - -99.83% -
401.bzip2 (unexplained diff vs previous) (percentage) -53.79% 1.320 0.610 - -99.83% -
462.libquantum (unexplained diff vs previous) (percentage) -50.34% 1.450 0.720 - -99.99% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.99% -
464.h264ref (unexplained diff vs previous) (percentage) -49.37% 0.790 0.400 - -99.66% -
464.h264ref (unexplained diff vs previous) -48.89% 45.000 23.000 - -99.66% -
435.gromacs (unexplained diff vs previous) -43.54% 147.000 83.000 - -98.82% -
435.gromacs (unexplained diff vs previous) (percentage) -42.71% 1.990 1.140 - -98.82% -
433.milc (max) -40.00% 5.000 3.000 - -99.71% -
433.milc (max) (percentage) -36.96% 0.460 0.290 - -99.68% -
454.calculix -33.33% 3.000 2.000 - -50.00% -
454.calculix (avg) -33.33% 3.000 2.000 - -50.00% -
456.hmmer (unexplained diff vs previous) (percentage) -28.57% 0.140 0.100 - -99.96% -
471.omnetpp (max) -28.57% 35.000 25.000 - -98.85% -
471.omnetpp (unexplained diff vs previous) -27.59% 29.000 21.000 - -99.80% -
429.mcf (max) -27.27% 22.000 16.000 - -98.79% -
471.omnetpp (max) (percentage) -27.13% 1.290 0.940 - -98.82% -
471.omnetpp (unexplained diff vs previous) (percentage) -26.42% 1.060 0.780 - -99.80% -
429.mcf (max) (percentage) -25.15% 1.630 1.220 - -98.69% -
456.hmmer (unexplained diff vs previous) -25.00% 4.000 3.000 - -99.96% -
482.sphinx3 (max) -21.43% 14.000 11.000 - -98.79% -
445.gobmk (unexplained diff vs previous) -20.31% 64.000 51.000 - -99.09% -
444.namd (max) -20.00% 5.000 4.000 - -99.42% -
465.tonto (max) -19.49% 118.000 95.000 - -95.50% -
445.gobmk (unexplained diff vs previous) (percentage) -19.20% 1.250 1.010 - -99.09% -
465.tonto (max) (percentage) -18.69% 1.070 0.870 - -95.49% -
401.bzip2 (max) (percentage) -16.92% 1.300 1.080 - -98.63% -
482.sphinx3 (max) (percentage) -16.78% 1.490 1.240 - -98.72% -
462.libquantum -16.67% 6.000 5.000 - -50.00% -
462.libquantum (avg) -16.67% 6.000 5.000 - -50.00% -
401.bzip2 (max) -15.79% 38.000 32.000 - -98.62% -
435.gromacs (max) -13.42% 149.000 129.000 - -96.39% -
410.bwaves (max) (percentage) -12.90% 0.620 0.540 - -99.07% -
435.gromacs (max) (percentage) -12.32% 2.030 1.780 - -96.38% -
410.bwaves (max) -11.76% 34.000 30.000 - -99.08% -
456.hmmer (max) -11.11% 9.000 8.000 - -99.62% -
464.h264ref (max) (percentage) -10.13% 0.790 0.710 - -98.69% -
473.astar (max) (percentage) -9.09% 0.660 0.600 - -99.10% -
464.h264ref (max) -9.09% 44.000 40.000 - -98.72% -
473.astar (max) -9.09% 33.000 30.000 - -99.12% -
470.lbm (max) (percentage) -8.57% 0.350 0.320 - -99.56% -
462.libquantum (max) (percentage) -8.39% 1.430 1.310 - -98.68% -
470.lbm (max) -7.69% 13.000 12.000 - -99.56% -
483.xalancbmk (max) (percentage) -6.92% 1.300 1.210 - -98.24% -
437.leslie3d (max) -6.56% 1617.000 1511.000 - -21.67% -
437.leslie3d (max) (percentage) -6.51% 14.430 13.490 - -18.64% -
456.hmmer (max) (percentage) -6.25% 0.320 0.300 - -99.59% -
483.xalancbmk (max) -6.12% 49.000 46.000 - -98.24% -
444.namd (max) (percentage) -5.71% 0.700 0.660 - -99.28% -
447.dealII (max) -5.56% 18.000 17.000 - -98.77% -
416.gamess -4.94% 263.000 250.000 - -54.55% -
416.gamess (avg) -4.94% 263.000 250.000 - -54.55% -
445.gobmk (max) (percentage) -4.72% 1.270 1.210 - -97.70% -
416.gamess (avg) (percentage) -4.72% 2.120 2.020 - -54.30% -
400.perlbench -4.69% 64.000 61.000 - -41.90% -
400.perlbench (avg) -4.69% 64.000 61.000 - -41.90% -
445.gobmk (max) -4.69% 64.000 61.000 - -97.69% -
447.dealII (max) (percentage) -4.55% 1.100 1.050 - -98.69% -
450.soplex -4.35% 23.000 22.000 - -38.89% -
450.soplex (avg) -4.35% 23.000 22.000 - -38.89% -
465.tonto -4.10% 293.000 281.000 - -23.01% -
465.tonto (avg) -4.10% 293.000 281.000 - -23.01% -
454.calculix (avg) (percentage) -4.03% 4.960 4.760 - -40.65% -
458.sjeng -3.95% 152.000 146.000 - -39.42% -
458.sjeng (avg) -3.95% 152.000 146.000 - -39.42% -
437.leslie3d -3.79% 501.000 482.000 - 35.77% -
437.leslie3d (avg) -3.79% 501.000 482.000 - 35.77% -
483.xalancbmk -3.77% 159.000 153.000 - -38.31% -
483.xalancbmk (avg) -3.77% 159.000 153.000 - -38.31% -
400.perlbench (max) -3.70% 27.000 26.000 - -98.14% -
471.omnetpp -3.65% 137.000 132.000 - -40.81% -
471.omnetpp (avg) -3.65% 137.000 132.000 - -40.81% -
447.dealII -3.64% 55.000 53.000 - -46.46% -
447.dealII (avg) -3.64% 55.000 53.000 - -46.46% -
483.xalancbmk (avg) (percentage) -3.59% 4.180 4.030 - -38.00% -
459.GemsFDTD -3.59% 223.000 215.000 - -40.28% -
459.GemsFDTD (avg) -3.59% 223.000 215.000 - -40.28% -
437.leslie3d (avg) (percentage) -3.58% 4.470 4.310 - 41.31% -
429.mcf -3.57% 140.000 135.000 - 23.85% -
429.mcf (avg) -3.57% 140.000 135.000 - 23.85% -
435.gromacs -3.54% 254.000 245.000 - -33.24% -
435.gromacs (avg) -3.54% 254.000 245.000 - -33.24% -
436.cactusADM -3.49% 86.000 83.000 - -33.06% -
436.cactusADM (avg) -3.49% 86.000 83.000 - -33.06% -
458.sjeng (avg) (percentage) -3.47% 2.020 1.950 - -38.87% -
465.tonto (avg) (percentage) -3.40% 2.650 2.560 - -23.35% -
456.hmmer (avg) (percentage) -3.39% 2.360 2.280 - -48.30% -
445.gobmk -3.36% 119.000 115.000 - -41.33% -
445.gobmk (avg) -3.36% 119.000 115.000 - -41.33% -
444.namd (avg) (percentage) -3.36% 5.060 4.890 - -46.96% -
400.perlbench (avg) (percentage) -3.32% 3.920 3.790 - -40.31% -
429.mcf (avg) (percentage) -3.27% 10.090 9.760 - 27.25% -
410.bwaves (avg) (percentage) -3.23% 2.790 2.700 - -38.78% -
410.bwaves -3.18% 157.000 152.000 - -38.96% -
410.bwaves (avg) -3.18% 157.000 152.000 - -38.96% -
473.astar -3.07% 163.000 158.000 - -25.82% -
473.astar (avg) -3.07% 163.000 158.000 - -25.82% -
459.GemsFDTD (avg) (percentage) -3.05% 3.610 3.500 - -40.07% -
464.h264ref (avg) (percentage) -3.04% 2.960 2.870 - -43.61% -
470.lbm (avg) (percentage) -3.01% 3.660 3.550 - -43.92% -
482.sphinx3 (avg) (percentage) -2.98% 4.700 4.560 - -42.50% -
456.hmmer -2.94% 68.000 66.000 - -48.03% -
456.hmmer (avg) -2.94% 68.000 66.000 - -48.03% -
470.lbm -2.90% 138.000 134.000 - -43.93% -
470.lbm (avg) -2.90% 138.000 134.000 - -43.93% -
473.astar (avg) (percentage) -2.83% 3.180 3.090 - -25.72% -
433.milc (avg) (percentage) -2.80% 3.930 3.820 - -36.86% -
471.omnetpp (avg) (percentage) -2.78% 5.030 4.890 - -40.37% -
447.dealII (avg) (percentage) -2.78% 3.240 3.150 - -45.41% -
444.namd -2.70% 37.000 36.000 - -47.06% -
444.namd (avg) -2.70% 37.000 36.000 - -47.06% -
450.soplex (avg) (percentage) -2.70% 4.080 3.970 - -38.26% -
435.gromacs (avg) (percentage) -2.61% 3.450 3.360 - -33.60% -
403.gcc (max) (percentage) -2.53% 7.500 7.310 - -92.64% -
434.zeusmp (avg) (percentage) -2.52% 3.570 3.480 - -40.51% -
401.bzip2 (avg) (percentage) -2.50% 3.200 3.120 - -43.07% -
462.libquantum (avg) (percentage) -2.49% 4.410 4.300 - -43.86% -
481.wrf (avg) (percentage) -2.45% 3.680 3.590 - -42.47% -
436.cactusADM (avg) (percentage) -2.44% 4.090 3.990 - -33.28% -
464.h264ref -2.40% 167.000 163.000 - -44.37% -
464.h264ref (avg) -2.40% 167.000 163.000 - -44.37% -
433.milc -2.27% 44.000 43.000 - -37.68% -
433.milc (avg) -2.27% 44.000 43.000 - -37.68% -
482.sphinx3 -2.27% 44.000 43.000 - -41.89% -
482.sphinx3 (avg) -2.27% 44.000 43.000 - -41.89% -
434.zeusmp -2.25% 89.000 87.000 - -40.82% -
434.zeusmp (avg) -2.25% 89.000 87.000 - -40.82% -
445.gobmk (avg) (percentage) -2.14% 2.340 2.290 - -41.43% -
401.bzip2 -2.13% 94.000 92.000 - -42.86% -
401.bzip2 (avg) -2.13% 94.000 92.000 - -42.86% -
400.perlbench (max) (percentage) -1.78% 1.690 1.660 - -98.03% -
453.povray (avg) (percentage) -1.71% 4.090 4.020 - -48.53% -
481.wrf (max) (percentage) -1.32% 2.270 2.240 - -96.74% -
436.cactusADM (max) (percentage) -1.01% 1.990 1.970 - -97.78% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
454.calculix (max)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.92% 104048.000 108124.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - -3.28% -
453.povray 2.74% 547.000 562.000 - 2.37% -
450.soplex 2.12% 567.000 579.000 - 0.70% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 41.31% 3.050 4.310 - -3.58% -
437.leslie3d 35.77% 355.000 482.000 - -3.79% -
437.leslie3d (avg) 35.77% 355.000 482.000 - -3.79% -
429.mcf (avg) (percentage) 27.25% 7.670 9.760 - -3.27% -
429.mcf 23.85% 109.000 135.000 - -3.57% -
429.mcf (avg) 23.85% 109.000 135.000 - -3.57% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.13% 387748.000 383368.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -3.75% 11640.000 11204.000 - -0.04% -
429.mcf -2.53% 1424.000 1388.000 - 0.00% -
400.perlbench -2.35% 1663.000 1624.000 - -0.67% -
447.dealII -2.09% 1724.000 1688.000 - -1.00% -
454.calculix -1.61% 62.000 61.000 - 0.00% -
464.h264ref -1.22% 5761.000 5691.000 - 0.41% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -50.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - -50.34% -
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - -75.00% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - -74.29% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.420 - -71.43% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 4.000 - -71.43% -
410.bwaves (unexplained diff vs previous) -99.97% 7794.000 2.000 - -94.29% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.690 - 305.88% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 4.000 - 300.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.97% 137.900 0.040 - -93.55% -
456.hmmer (unexplained diff vs previous) (percentage) -99.96% 278.630 0.100 - -28.57% -
456.hmmer (unexplained diff vs previous) -99.96% 8030.000 3.000 - -25.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.95% 263.730 0.130 - 160.00% -
470.lbm (unexplained diff vs previous) -99.95% 9990.000 5.000 - 150.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.94% 62.730 0.040 - 33.33% -
416.gamess (unexplained diff vs previous) -99.94% 7819.000 5.000 - 25.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.93% 787.130 0.570 - 72.73% -
458.sjeng (unexplained diff vs previous) -99.93% 6876.000 5.000 - -82.76% -
436.cactusADM (unexplained diff vs previous) -99.93% 16396.000 12.000 - 71.43% -
458.sjeng (unexplained diff vs previous) (percentage) -99.92% 90.870 0.070 - -81.58% -
400.perlbench (unexplained diff vs previous) -99.87% 8772.000 11.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.87% 527.480 0.680 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.84% 197.850 0.310 - 416.67% -
473.astar (unexplained diff vs previous) -99.84% 10146.000 16.000 - 433.33% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.83% 368.340 0.610 - -53.79% -
401.bzip2 (unexplained diff vs previous) -99.83% 10833.000 18.000 - -53.85% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.82% 448.690 0.790 - 9.72% -
434.zeusmp (unexplained diff vs previous) -99.82% 11280.000 20.000 - 11.11% -
459.GemsFDTD (unexplained diff vs previous) -99.82% 15458.000 28.000 - 47.37% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.82% 250.410 0.460 - 48.39% -
483.xalancbmk (unexplained diff vs previous) -99.81% 8368.000 16.000 - -60.98% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.81% 219.170 0.420 - -60.75% -
471.omnetpp (unexplained diff vs previous) -99.80% 10659.000 21.000 - -27.59% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.80% 391.300 0.780 - -26.42% -
437.leslie3d (unexplained diff vs previous) (percentage) -99.80% 19.880 0.040 - -99.46% -
437.leslie3d (unexplained diff vs previous) -99.78% 2314.000 5.000 - -99.39% -
453.povray (unexplained diff vs previous) (percentage) -99.78% 1043.330 2.310 - 216.44% -
453.povray (unexplained diff vs previous) -99.77% 5707.000 13.000 - 225.00% -
447.dealII (unexplained diff vs previous) -99.76% 7017.000 17.000 - 41.67% -
447.dealII (unexplained diff vs previous) (percentage) -99.75% 407.020 1.010 - 44.29% -
416.gamess (max) -99.73% 4805.000 13.000 - 0.00% -
416.gamess (max) (percentage) -99.71% 38.550 0.110 - 0.00% -
433.milc (max) -99.71% 1044.000 3.000 - -40.00% -
433.milc (max) (percentage) -99.68% 90.750 0.290 - -36.96% -
464.h264ref (unexplained diff vs previous) -99.66% 6843.000 23.000 - -48.89% -
464.h264ref (unexplained diff vs previous) (percentage) -99.66% 118.780 0.400 - -49.37% -
456.hmmer (max) -99.62% 2120.000 8.000 - -11.11% -
456.hmmer (max) (percentage) -99.59% 73.590 0.300 - -6.25% -
470.lbm (max) -99.56% 2746.000 12.000 - -7.69% -
470.lbm (max) (percentage) -99.56% 72.510 0.320 - -8.57% -
444.namd (max) -99.42% 685.000 4.000 - -20.00% -
459.GemsFDTD (max) -99.39% 4411.000 27.000 - 8.00% -
459.GemsFDTD (max) (percentage) -99.37% 71.460 0.450 - 7.14% -
444.namd (max) (percentage) -99.28% 91.790 0.660 - -5.71% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
450.soplex (max) (percentage) -99.27% 96.240 0.700 - 40.00% -
450.soplex (max) -99.27% 545.000 4.000 - 100.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.23% 219.530 1.680 - 0.00% -
481.wrf (unexplained diff vs previous) -99.23% 12149.000 93.000 - 0.00% -
473.astar (max) -99.12% 3406.000 30.000 - -9.09% -
473.astar (max) (percentage) -99.10% 66.430 0.600 - -9.09% -
445.gobmk (unexplained diff vs previous) (percentage) -99.09% 111.110 1.010 - -19.20% -
445.gobmk (unexplained diff vs previous) -99.09% 5581.000 51.000 - -20.31% -
410.bwaves (max) -99.08% 3276.000 30.000 - -11.76% -
410.bwaves (max) (percentage) -99.07% 57.970 0.540 - -12.90% -
434.zeusmp (max) -99.03% 2055.000 20.000 - 17.65% -
434.zeusmp (max) (percentage) -99.02% 81.770 0.800 - 12.68% -
471.omnetpp (max) -98.85% 2169.000 25.000 - -28.57% -
435.gromacs (unexplained diff vs previous) (percentage) -98.82% 96.680 1.140 - -42.71% -
471.omnetpp (max) (percentage) -98.82% 79.650 0.940 - -27.13% -
435.gromacs (unexplained diff vs previous) -98.82% 7028.000 83.000 - -43.54% -
482.sphinx3 (max) -98.79% 911.000 11.000 - -21.43% -
429.mcf (max) -98.79% 1322.000 16.000 - -27.27% -
458.sjeng (max) -98.78% 3602.000 44.000 - 0.00% -
447.dealII (max) -98.77% 1384.000 17.000 - -5.56% -
458.sjeng (max) (percentage) -98.76% 47.610 0.590 - 0.00% -
464.h264ref (max) -98.72% 3127.000 40.000 - -9.09% -
482.sphinx3 (max) (percentage) -98.72% 96.500 1.240 - -16.78% -
464.h264ref (max) (percentage) -98.69% 54.290 0.710 - -10.13% -
447.dealII (max) (percentage) -98.69% 80.280 1.050 - -4.55% -
429.mcf (max) (percentage) -98.69% 92.890 1.220 - -25.15% -
462.libquantum (max) (percentage) -98.68% 98.970 1.310 - -8.39% -
454.calculix (max) (percentage) -98.67% 99.730 1.330 - -65.36% -
401.bzip2 (max) (percentage) -98.63% 78.650 1.080 - -16.92% -
401.bzip2 (max) -98.62% 2313.000 32.000 - -15.79% -
483.xalancbmk (max) -98.24% 2621.000 46.000 - -6.12% -
483.xalancbmk (max) (percentage) -98.24% 68.670 1.210 - -6.92% -
400.perlbench (max) -98.14% 1397.000 26.000 - -3.70% -
400.perlbench (max) (percentage) -98.03% 84.060 1.660 - -1.78% -
436.cactusADM (max) -97.78% 1848.000 41.000 - 0.00% -
436.cactusADM (max) (percentage) -97.78% 88.730 1.970 - -1.01% -
445.gobmk (max) (percentage) -97.70% 52.630 1.210 - -4.72% -
445.gobmk (max) -97.69% 2643.000 61.000 - -4.69% -
453.povray (max) (percentage) -97.40% 91.250 2.370 - 229.17% -
453.povray (max) -97.39% 499.000 13.000 - 333.33% -
465.tonto (unexplained diff vs previous) (percentage) -96.79% 16.190 0.520 - 0.00% -
465.tonto (unexplained diff vs previous) -96.78% 1771.000 57.000 - 0.00% -
481.wrf (max) -96.76% 3801.000 123.000 - 0.00% -
481.wrf (max) (percentage) -96.74% 68.700 2.240 - -1.32% -
435.gromacs (max) -96.39% 3573.000 129.000 - -13.42% -
435.gromacs (max) (percentage) -96.38% 49.160 1.780 - -12.32% -
465.tonto (max) -95.50% 2112.000 95.000 - -19.49% -
465.tonto (max) (percentage) -95.49% 19.310 0.870 - -18.69% -
403.gcc (max) -92.73% 55.000 4.000 - 0.00% -
403.gcc (max) (percentage) -92.64% 99.360 7.310 - -2.53% -
416.gamess -54.55% 550.000 250.000 - -4.94% -
416.gamess (avg) -54.55% 550.000 250.000 - -4.94% -
416.gamess (avg) (percentage) -54.30% 4.420 2.020 - -4.72% -
454.calculix -50.00% 4.000 2.000 - -33.33% -
454.calculix (avg) -50.00% 4.000 2.000 - -33.33% -
462.libquantum -50.00% 10.000 5.000 - -16.67% -
462.libquantum (avg) -50.00% 10.000 5.000 - -16.67% -
453.povray (avg) (percentage) -48.53% 7.810 4.020 - -1.71% -
456.hmmer (avg) (percentage) -48.30% 4.410 2.280 - -3.39% -
456.hmmer -48.03% 127.000 66.000 - -2.94% -
456.hmmer (avg) -48.03% 127.000 66.000 - -2.94% -
453.povray -47.62% 42.000 22.000 - 0.00% -
453.povray (avg) -47.62% 42.000 22.000 - 0.00% -
444.namd -47.06% 68.000 36.000 - -2.70% -
444.namd (avg) -47.06% 68.000 36.000 - -2.70% -
444.namd (avg) (percentage) -46.96% 9.220 4.890 - -3.36% -
447.dealII -46.46% 99.000 53.000 - -3.64% -
447.dealII (avg) -46.46% 99.000 53.000 - -3.64% -
447.dealII (avg) (percentage) -45.41% 5.770 3.150 - -2.78% -
464.h264ref -44.37% 293.000 163.000 - -2.40% -
464.h264ref (avg) -44.37% 293.000 163.000 - -2.40% -
470.lbm -43.93% 239.000 134.000 - -2.90% -
470.lbm (avg) -43.93% 239.000 134.000 - -2.90% -
470.lbm (avg) (percentage) -43.92% 6.330 3.550 - -3.01% -
462.libquantum (avg) (percentage) -43.86% 7.660 4.300 - -2.49% -
464.h264ref (avg) (percentage) -43.61% 5.090 2.870 - -3.04% -
401.bzip2 (avg) (percentage) -43.07% 5.480 3.120 - -2.50% -
401.bzip2 -42.86% 161.000 92.000 - -2.13% -
401.bzip2 (avg) -42.86% 161.000 92.000 - -2.13% -
481.wrf -42.61% 345.000 198.000 - -0.50% -
481.wrf (avg) -42.61% 345.000 198.000 - -0.50% -
482.sphinx3 (avg) (percentage) -42.50% 7.930 4.560 - -2.98% -
481.wrf (avg) (percentage) -42.47% 6.240 3.590 - -2.45% -
400.perlbench -41.90% 105.000 61.000 - -4.69% -
400.perlbench (avg) -41.90% 105.000 61.000 - -4.69% -
482.sphinx3 -41.89% 74.000 43.000 - -2.27% -
482.sphinx3 (avg) -41.89% 74.000 43.000 - -2.27% -
445.gobmk (avg) (percentage) -41.43% 3.910 2.290 - -2.14% -
445.gobmk -41.33% 196.000 115.000 - -3.36% -
445.gobmk (avg) -41.33% 196.000 115.000 - -3.36% -
434.zeusmp -40.82% 147.000 87.000 - -2.25% -
434.zeusmp (avg) -40.82% 147.000 87.000 - -2.25% -
471.omnetpp -40.81% 223.000 132.000 - -3.65% -
471.omnetpp (avg) -40.81% 223.000 132.000 - -3.65% -
454.calculix (avg) (percentage) -40.65% 8.020 4.760 - -4.03% -
434.zeusmp (avg) (percentage) -40.51% 5.850 3.480 - -2.52% -
471.omnetpp (avg) (percentage) -40.37% 8.200 4.890 - -2.78% -
400.perlbench (avg) (percentage) -40.31% 6.350 3.790 - -3.32% -
459.GemsFDTD -40.28% 360.000 215.000 - -3.59% -
459.GemsFDTD (avg) -40.28% 360.000 215.000 - -3.59% -
459.GemsFDTD (avg) (percentage) -40.07% 5.840 3.500 - -3.05% -
458.sjeng -39.42% 241.000 146.000 - -3.95% -
458.sjeng (avg) -39.42% 241.000 146.000 - -3.95% -
410.bwaves -38.96% 249.000 152.000 - -3.18% -
410.bwaves (avg) -38.96% 249.000 152.000 - -3.18% -
450.soplex -38.89% 36.000 22.000 - -4.35% -
450.soplex (avg) -38.89% 36.000 22.000 - -4.35% -
458.sjeng (avg) (percentage) -38.87% 3.190 1.950 - -3.47% -
410.bwaves (avg) (percentage) -38.78% 4.410 2.700 - -3.23% -
483.xalancbmk -38.31% 248.000 153.000 - -3.77% -
483.xalancbmk (avg) -38.31% 248.000 153.000 - -3.77% -
450.soplex (avg) (percentage) -38.26% 6.430 3.970 - -2.70% -
483.xalancbmk (avg) (percentage) -38.00% 6.500 4.030 - -3.59% -
433.milc -37.68% 69.000 43.000 - -2.27% -
433.milc (avg) -37.68% 69.000 43.000 - -2.27% -
433.milc (avg) (percentage) -36.86% 6.050 3.820 - -2.80% -
435.gromacs (avg) (percentage) -33.60% 5.060 3.360 - -2.61% -
436.cactusADM (avg) (percentage) -33.28% 5.980 3.990 - -2.44% -
435.gromacs -33.24% 367.000 245.000 - -3.54% -
435.gromacs (avg) -33.24% 367.000 245.000 - -3.54% -
436.cactusADM -33.06% 124.000 83.000 - -3.49% -
436.cactusADM (avg) -33.06% 124.000 83.000 - -3.49% -
473.astar -25.82% 213.000 158.000 - -3.07% -
473.astar (avg) -25.82% 213.000 158.000 - -3.07% -
473.astar (avg) (percentage) -25.72% 4.160 3.090 - -2.83% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
465.tonto (avg) (percentage) -23.35% 3.340 2.560 - -3.40% -
465.tonto -23.01% 365.000 281.000 - -4.10% -
465.tonto (avg) -23.01% 365.000 281.000 - -4.10% -
437.leslie3d (max) -21.67% 1929.000 1511.000 - -6.56% -
437.leslie3d (max) (percentage) -18.64% 16.580 13.490 - -6.51% -
403.gcc (avg) (percentage) -12.02% 7.320 6.440 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
454.calculix (max)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Report Time: 0.44s
Execution (seconds)
Name Current %
400.perlbench 1624.000 -
401.bzip2 2970.000 -
403.gcc 59.000 -3.28%
410.bwaves 5644.000 -
416.gamess 12423.000 -
429.mcf 1388.000 -
433.milc 1146.000 -
434.zeusmp 2527.000 -
435.gromacs 7300.000 -1.12%
436.cactusADM 2094.000 -
437.leslie3d 11204.000 -
444.namd 746.000 -
445.gobmk 5050.000 -
447.dealII 1688.000 -
450.soplex 579.000 -
453.povray 562.000 2.37%
454.calculix 61.000 -
456.hmmer 2897.000 -
458.sjeng 7530.000 -
459.GemsFDTD 6150.000 -
462.libquantum 139.000 -
464.h264ref 5691.000 -
465.tonto 11014.000 -
470.lbm 3797.000 -
471.omnetpp 2708.000 -
473.astar 5126.000 -
481.wrf 5521.000 1.71%
482.sphinx3 948.000 -
483.xalancbmk 3805.000 -
Geometric Mean 2097.245 -
Code Size (bytes)
Name Current %
400.perlbench 889147.000 -
401.bzip2 44233.000 -
403.gcc 2443867.000 -
410.bwaves 16760.000 -
416.gamess 5751013.000 -
429.mcf 9123.000 -
433.milc 61378.000 -
434.zeusmp 152125.000 -
435.gromacs 498901.000 -
436.cactusADM 352895.000 -
437.leslie3d 59475.000 -
444.namd 188340.000 -
445.gobmk 1377562.000 -
447.dealII 312935.000 -
450.soplex 205105.000 -
453.povray 661073.000 -
454.calculix 845170.000 -
456.hmmer 108667.000 -
458.sjeng 108124.000 -
459.GemsFDTD 245032.000 -
462.libquantum 16085.000 -
464.h264ref 383368.000 -
465.tonto 1950214.000 -
470.lbm 9691.000 -
471.omnetpp 478063.000 -
473.astar 22956.000 -
481.wrf 1960014.000 -
482.sphinx3 112795.000 -
483.xalancbmk 2343606.000 -
Geometric Mean 224163.538 -
sample variability
Name Current %
400.perlbench 61.000 -4.69%
400.perlbench (avg) 61.000 -4.69%
400.perlbench (avg) (percentage) 3.790 -3.32%
400.perlbench (max) 26.000 -3.70%
400.perlbench (max) (percentage) 1.660 -1.78%
400.perlbench (unexplained diff vs previous) 11.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.680 -
401.bzip2 92.000 -2.13%
401.bzip2 (avg) 92.000 -2.13%
401.bzip2 (avg) (percentage) 3.120 -2.50%
401.bzip2 (max) 32.000 -15.79%
401.bzip2 (max) (percentage) 1.080 -16.92%
401.bzip2 (unexplained diff vs previous) 18.000 -53.85%
401.bzip2 (unexplained diff vs previous) (percentage) 0.610 -53.79%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.440 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.310 -2.53%
410.bwaves 152.000 -3.18%
410.bwaves (avg) 152.000 -3.18%
410.bwaves (avg) (percentage) 2.700 -3.23%
410.bwaves (max) 30.000 -11.76%
410.bwaves (max) (percentage) 0.540 -12.90%
410.bwaves (unexplained diff vs previous) 2.000 -94.29%
410.bwaves (unexplained diff vs previous) (percentage) 0.040 -93.55%
416.gamess 250.000 -4.94%
416.gamess (avg) 250.000 -4.94%
416.gamess (avg) (percentage) 2.020 -4.72%
416.gamess (max) 13.000 -
416.gamess (max) (percentage) 0.110 -
416.gamess (unexplained diff vs previous) 5.000 25.00%
416.gamess (unexplained diff vs previous) (percentage) 0.040 33.33%
429.mcf 135.000 -3.57%
429.mcf (avg) 135.000 -3.57%
429.mcf (avg) (percentage) 9.760 -3.27%
429.mcf (max) 16.000 -27.27%
429.mcf (max) (percentage) 1.220 -25.15%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 43.000 -2.27%
433.milc (avg) 43.000 -2.27%
433.milc (avg) (percentage) 3.820 -2.80%
433.milc (max) 3.000 -40.00%
433.milc (max) (percentage) 0.290 -36.96%
433.milc (unexplained diff vs previous) 1.000 -75.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -74.29%
434.zeusmp 87.000 -2.25%
434.zeusmp (avg) 87.000 -2.25%
434.zeusmp (avg) (percentage) 3.480 -2.52%
434.zeusmp (max) 20.000 17.65%
434.zeusmp (max) (percentage) 0.800 12.68%
434.zeusmp (unexplained diff vs previous) 20.000 11.11%
434.zeusmp (unexplained diff vs previous) (percentage) 0.790 9.72%
435.gromacs 245.000 -3.54%
435.gromacs (avg) 245.000 -3.54%
435.gromacs (avg) (percentage) 3.360 -2.61%
435.gromacs (max) 129.000 -13.42%
435.gromacs (max) (percentage) 1.780 -12.32%
435.gromacs (unexplained diff vs previous) 83.000 -43.54%
435.gromacs (unexplained diff vs previous) (percentage) 1.140 -42.71%
436.cactusADM 83.000 -3.49%
436.cactusADM (avg) 83.000 -3.49%
436.cactusADM (avg) (percentage) 3.990 -2.44%
436.cactusADM (max) 41.000 -
436.cactusADM (max) (percentage) 1.970 -1.01%
436.cactusADM (unexplained diff vs previous) 12.000 71.43%
436.cactusADM (unexplained diff vs previous) (percentage) 0.570 72.73%
437.leslie3d 482.000 -3.79%
437.leslie3d (avg) 482.000 -3.79%
437.leslie3d (avg) (percentage) 4.310 -3.58%
437.leslie3d (max) 1511.000 -6.56%
437.leslie3d (max) (percentage) 13.490 -6.51%
437.leslie3d (unexplained diff vs previous) 5.000 -99.39%
437.leslie3d (unexplained diff vs previous) (percentage) 0.040 -99.46%
444.namd 36.000 -2.70%
444.namd (avg) 36.000 -2.70%
444.namd (avg) (percentage) 4.890 -3.36%
444.namd (max) 4.000 -20.00%
444.namd (max) (percentage) 0.660 -5.71%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 115.000 -3.36%
445.gobmk (avg) 115.000 -3.36%
445.gobmk (avg) (percentage) 2.290 -2.14%
445.gobmk (max) 61.000 -4.69%
445.gobmk (max) (percentage) 1.210 -4.72%
445.gobmk (unexplained diff vs previous) 51.000 -20.31%
445.gobmk (unexplained diff vs previous) (percentage) 1.010 -19.20%
447.dealII 53.000 -3.64%
447.dealII (avg) 53.000 -3.64%
447.dealII (avg) (percentage) 3.150 -2.78%
447.dealII (max) 17.000 -5.56%
447.dealII (max) (percentage) 1.050 -4.55%
447.dealII (unexplained diff vs previous) 17.000 41.67%
447.dealII (unexplained diff vs previous) (percentage) 1.010 44.29%
450.soplex 22.000 -4.35%
450.soplex (avg) 22.000 -4.35%
450.soplex (avg) (percentage) 3.970 -2.70%
450.soplex (max) 4.000 100.00%
450.soplex (max) (percentage) 0.700 40.00%
450.soplex (unexplained diff vs previous) 4.000 300.00%
450.soplex (unexplained diff vs previous) (percentage) 0.690 305.88%
453.povray 22.000 -
453.povray (avg) 22.000 -
453.povray (avg) (percentage) 4.020 -1.71%
453.povray (max) 13.000 333.33%
453.povray (max) (percentage) 2.370 229.17%
453.povray (unexplained diff vs previous) 13.000 225.00%
453.povray (unexplained diff vs previous) (percentage) 2.310 216.44%
454.calculix 2.000 -33.33%
454.calculix (avg) 2.000 -33.33%
454.calculix (avg) (percentage) 4.760 -4.03%
454.calculix (max) 0.000 -
454.calculix (max) (percentage) 1.330 -65.36%
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 66.000 -2.94%
456.hmmer (avg) 66.000 -2.94%
456.hmmer (avg) (percentage) 2.280 -3.39%
456.hmmer (max) 8.000 -11.11%
456.hmmer (max) (percentage) 0.300 -6.25%
456.hmmer (unexplained diff vs previous) 3.000 -25.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.100 -28.57%
458.sjeng 146.000 -3.95%
458.sjeng (avg) 146.000 -3.95%
458.sjeng (avg) (percentage) 1.950 -3.47%
458.sjeng (max) 44.000 -
458.sjeng (max) (percentage) 0.590 -
458.sjeng (unexplained diff vs previous) 5.000 -82.76%
458.sjeng (unexplained diff vs previous) (percentage) 0.070 -81.58%
459.GemsFDTD 215.000 -3.59%
459.GemsFDTD (avg) 215.000 -3.59%
459.GemsFDTD (avg) (percentage) 3.500 -3.05%
459.GemsFDTD (max) 27.000 8.00%
459.GemsFDTD (max) (percentage) 0.450 7.14%
459.GemsFDTD (unexplained diff vs previous) 28.000 47.37%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.460 48.39%
462.libquantum 5.000 -16.67%
462.libquantum (avg) 5.000 -16.67%
462.libquantum (avg) (percentage) 4.300 -2.49%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.310 -8.39%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -50.34%
464.h264ref 163.000 -2.40%
464.h264ref (avg) 163.000 -2.40%
464.h264ref (avg) (percentage) 2.870 -3.04%
464.h264ref (max) 40.000 -9.09%
464.h264ref (max) (percentage) 0.710 -10.13%
464.h264ref (unexplained diff vs previous) 23.000 -48.89%
464.h264ref (unexplained diff vs previous) (percentage) 0.400 -49.37%
465.tonto 281.000 -4.10%
465.tonto (avg) 281.000 -4.10%
465.tonto (avg) (percentage) 2.560 -3.40%
465.tonto (max) 95.000 -19.49%
465.tonto (max) (percentage) 0.870 -18.69%
465.tonto (unexplained diff vs previous) 57.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.520 -
470.lbm 134.000 -2.90%
470.lbm (avg) 134.000 -2.90%
470.lbm (avg) (percentage) 3.550 -3.01%
470.lbm (max) 12.000 -7.69%
470.lbm (max) (percentage) 0.320 -8.57%
470.lbm (unexplained diff vs previous) 5.000 150.00%
470.lbm (unexplained diff vs previous) (percentage) 0.130 160.00%
471.omnetpp 132.000 -3.65%
471.omnetpp (avg) 132.000 -3.65%
471.omnetpp (avg) (percentage) 4.890 -2.78%
471.omnetpp (max) 25.000 -28.57%
471.omnetpp (max) (percentage) 0.940 -27.13%
471.omnetpp (unexplained diff vs previous) 21.000 -27.59%
471.omnetpp (unexplained diff vs previous) (percentage) 0.780 -26.42%
473.astar 158.000 -3.07%
473.astar (avg) 158.000 -3.07%
473.astar (avg) (percentage) 3.090 -2.83%
473.astar (max) 30.000 -9.09%
473.astar (max) (percentage) 0.600 -9.09%
473.astar (unexplained diff vs previous) 16.000 433.33%
473.astar (unexplained diff vs previous) (percentage) 0.310 416.67%
481.wrf 198.000 -
481.wrf (avg) 198.000 -
481.wrf (avg) (percentage) 3.590 -2.45%
481.wrf (max) 123.000 -
481.wrf (max) (percentage) 2.240 -1.32%
481.wrf (unexplained diff vs previous) 93.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.680 -
482.sphinx3 43.000 -2.27%
482.sphinx3 (avg) 43.000 -2.27%
482.sphinx3 (avg) (percentage) 4.560 -2.98%
482.sphinx3 (max) 11.000 -21.43%
482.sphinx3 (max) (percentage) 1.240 -16.78%
482.sphinx3 (unexplained diff vs previous) 4.000 -71.43%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.420 -71.43%
483.xalancbmk 153.000 -3.77%
483.xalancbmk (avg) 153.000 -3.77%
483.xalancbmk (avg) (percentage) 4.030 -3.59%
483.xalancbmk (max) 46.000 -6.12%
483.xalancbmk (max) (percentage) 1.210 -6.92%
483.xalancbmk (unexplained diff vs previous) 16.000 -60.98%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.420 -60.75%
Geometric Mean 5.478 -42.01%