Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/09d51a841dcfbc41c3d7f3274b109b5f9fb09bb0 (+ 901 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/131/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0131 (llvmorg-19-init-08057-g09d51a841dcf) 2024-04-05T21:53:08 0:00:00
Previous 0129 (no-change) 2024-03-30T19:28:15 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 16
Performance Improvements 73 124
Added Tests 4 8
Unchanged Tests 692 632
Total Tests 780

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 975.00% 0.080 0.860 - 760.00% -
433.milc (unexplained diff vs previous) 900.00% 1.000 10.000 - -23.08% -
456.hmmer (unexplained diff vs previous) 283.33% 6.000 23.000 - -50.00% -
456.hmmer (unexplained diff vs previous) (percentage) 275.00% 0.160 0.600 - 53.85% -
450.soplex (unexplained diff vs previous) (percentage) 78.08% 0.730 1.300 - 182.61% -
450.soplex (unexplained diff vs previous) 75.00% 4.000 7.000 - -89.86% -
433.milc (max) (percentage) 39.34% 0.610 0.850 - 6.25% -
433.milc (max) 28.57% 7.000 9.000 - -91.67% -
456.hmmer (max) (percentage) 13.21% 0.530 0.600 - -94.27% -
456.hmmer (max) 10.00% 20.000 22.000 - -98.23% -
433.milc (avg) (percentage) 1.61% 0.620 0.630 - -26.74% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -1.28% 546.000 539.000 - -96.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) -92.59% 0.270 0.020 - -94.44% -
445.gobmk (unexplained diff vs previous) -92.31% 13.000 1.000 - -97.50% -
470.lbm (unexplained diff vs previous) (percentage) -92.00% 0.250 0.020 - -99.67% -
483.xalancbmk (unexplained diff vs previous) (percentage) -90.91% 0.330 0.030 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -90.91% 11.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -90.00% 10.000 1.000 - -99.88% -
453.povray (unexplained diff vs previous) (percentage) -75.16% 1.610 0.400 - 0.00% -
401.bzip2 (unexplained diff vs previous) -75.00% 4.000 1.000 - -96.97% -
453.povray (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -75.00% 0.240 0.060 - -70.00% -
473.astar (unexplained diff vs previous) -72.73% 11.000 3.000 - -88.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -71.43% 0.140 0.040 - -80.00% -
464.h264ref (unexplained diff vs previous) (percentage) -67.74% 0.310 0.100 - 0.00% -
429.mcf (unexplained diff vs previous) -66.67% 15.000 5.000 - -77.27% -
464.h264ref (unexplained diff vs previous) -66.67% 18.000 6.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -66.15% 1.300 0.440 - 175.00% -
447.dealII (unexplained diff vs previous) -50.00% 4.000 2.000 - -96.30% -
447.dealII (unexplained diff vs previous) (percentage) -50.00% 0.200 0.100 - -82.76% -
471.omnetpp (unexplained diff vs previous) (percentage) -30.49% 0.820 0.570 - -41.84% -
471.omnetpp (unexplained diff vs previous) -30.43% 23.000 16.000 - -84.47% -
482.sphinx3 (unexplained diff vs previous) (percentage) -25.00% 0.400 0.300 - -91.25% -
482.sphinx3 (unexplained diff vs previous) -25.00% 4.000 3.000 - -99.67% -
445.gobmk (max) -15.38% 13.000 11.000 - -97.34% -
429.mcf (max) -14.29% 14.000 12.000 - -99.47% -
429.mcf (max) (percentage) -12.50% 1.280 1.120 - -93.13% -
445.gobmk (max) (percentage) -11.11% 0.270 0.240 - -93.57% -
470.lbm (max) -10.00% 10.000 9.000 - -98.81% -
401.bzip2 (max) -8.33% 12.000 11.000 - -98.19% -
470.lbm (max) (percentage) -8.00% 0.250 0.230 - -95.98% -
458.sjeng (max) (percentage) -7.69% 0.390 0.360 - -93.00% -
447.dealII (max) -7.14% 14.000 13.000 - -94.17% -
471.omnetpp (max) -7.14% 42.000 39.000 - -95.99% -
447.dealII (max) (percentage) -6.76% 0.740 0.690 - -71.01% -
471.omnetpp (max) (percentage) -6.62% 1.510 1.410 - -84.81% -
483.xalancbmk (max) (percentage) -6.57% 1.980 1.850 - -85.66% -
464.h264ref (max) (percentage) -6.45% 0.310 0.290 - -30.95% -
458.sjeng (max) -6.45% 31.000 29.000 - -96.69% -
483.xalancbmk (max) -6.06% 66.000 62.000 - -94.87% -
482.sphinx3 (max) (percentage) -5.88% 1.190 1.120 - -66.16% -
445.gobmk -5.56% 18.000 17.000 - -77.03% -
445.gobmk (avg) -5.56% 18.000 17.000 - -77.03% -
464.h264ref (max) -5.56% 18.000 17.000 - -71.67% -
429.mcf -5.26% 19.000 18.000 - -93.92% -
429.mcf (avg) -5.26% 19.000 18.000 - -93.92% -
462.libquantum (max) (percentage) -4.83% 2.070 1.970 - -69.12% -
401.bzip2 (max) (percentage) -4.55% 0.440 0.420 - -88.89% -
444.namd (max) (percentage) -4.48% 0.670 0.640 - -92.09% -
473.astar (max) (percentage) -4.05% 0.740 0.710 - -89.40% -
453.povray (max) (percentage) -3.80% 1.580 1.520 - 322.22% -
447.dealII (avg) (percentage) -3.17% 0.630 0.610 - -41.90% -
470.lbm -3.12% 32.000 31.000 - -92.97% -
470.lbm (avg) -3.12% 32.000 31.000 - -92.97% -
473.astar -3.12% 32.000 31.000 - -72.32% -
473.astar (avg) -3.12% 32.000 31.000 - -72.32% -
473.astar (max) -2.94% 34.000 33.000 - -95.99% -
473.astar (avg) (percentage) -2.86% 0.700 0.680 - -26.09% -
445.gobmk (avg) (percentage) -2.70% 0.370 0.360 - -46.27% -
462.libquantum (avg) (percentage) -2.58% 1.550 1.510 - 96.10% -
470.lbm (avg) (percentage) -2.50% 0.800 0.780 - -76.58% -
483.xalancbmk (avg) (percentage) -2.45% 1.630 1.590 - -25.00% -
482.sphinx3 (avg) (percentage) -2.30% 0.870 0.850 - -51.15% -
456.hmmer -2.13% 47.000 46.000 - -71.95% -
456.hmmer (avg) -2.13% 47.000 46.000 - -71.95% -
453.povray (avg) (percentage) -2.11% 0.950 0.930 - 16.25% -
401.bzip2 (avg) (percentage) -2.04% 0.490 0.480 - -26.15% -
444.namd (avg) (percentage) -1.87% 1.070 1.050 - -59.14% -
483.xalancbmk -1.85% 54.000 53.000 - -73.23% -
483.xalancbmk (avg) -1.85% 54.000 53.000 - -73.23% -
429.mcf (avg) (percentage) -1.79% 1.680 1.650 - -22.17% -
456.hmmer (avg) (percentage) -1.63% 1.230 1.210 - -12.95% -
403.gcc (max) (percentage) -1.35% 6.670 6.580 - 182.40% -
471.omnetpp (avg) (percentage) -1.10% 1.810 1.790 - 11.87% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.96% 146765.000 149644.000 - 0.00% -
471.omnetpp 1.38% 316676.000 321049.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) 760.00% 0.100 0.860 - 975.00% -
453.povray (max) (percentage) 322.22% 0.360 1.520 - -3.80% -
403.gcc (avg) (percentage) 212.73% 0.550 1.720 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 182.61% 0.460 1.300 - 78.08% -
403.gcc (max) (percentage) 182.40% 2.330 6.580 - -1.35% -
429.mcf (unexplained diff vs previous) (percentage) 175.00% 0.160 0.440 - -66.15% -
450.soplex (avg) (percentage) 168.00% 0.500 1.340 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.060 0.120 - 0.00% -
462.libquantum (avg) (percentage) 96.10% 0.770 1.510 - -2.58% -
456.hmmer (unexplained diff vs previous) (percentage) 53.85% 0.390 0.600 - 275.00% -
453.povray (avg) (percentage) 16.25% 0.800 0.930 - -2.11% -
471.omnetpp (avg) (percentage) 11.87% 1.600 1.790 - -1.10% -
433.milc (max) (percentage) 6.25% 0.800 0.850 - 39.34% -
464.h264ref (avg) (percentage) 3.45% 0.290 0.300 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.14% 7239.000 6939.000 - 0.00% -
462.libquantum -2.98% 12504.000 12131.000 - 0.00% -
453.povray -2.21% 524493.000 512911.000 - 0.00% -
464.h264ref -1.97% 303767.000 297775.000 - 0.00% -
433.milc -1.79% 47001.000 46161.000 - 0.00% -
444.namd -1.61% 124963.000 122950.000 - 0.00% -
458.sjeng -1.27% 80297.000 79274.000 - -0.03% -
470.lbm -1.26% 9338.000 9220.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.41% 9509.000 56.000 - 0.00% -
462.libquantum -98.70% 14409.000 187.000 - 0.00% -
450.soplex -96.43% 15112.000 539.000 - -1.28% -
482.sphinx3 -96.28% 26682.000 992.000 - 0.30% -
444.namd -93.52% 12400.000 804.000 - 0.12% -
453.povray -92.84% 6987.000 500.000 - 0.40% -
429.mcf -91.79% 13988.000 1148.000 - -0.43% -
433.milc -91.41% 13601.000 1169.000 - -0.85% -
401.bzip2 -82.33% 16137.000 2851.000 - 0.04% -
447.dealII -78.99% 9380.000 1971.000 - 0.10% -
471.omnetpp -73.04% 10477.000 2825.000 - 0.57% -
470.lbm -69.80% 13259.000 4004.000 - 0.02% -
456.hmmer -67.84% 11854.000 3812.000 - -0.60% -
483.xalancbmk -64.01% 9376.000 3374.000 - 0.03% -
473.astar -61.88% 12272.000 4678.000 - 0.06% -
464.h264ref -59.40% 14498.000 5886.000 - 0.10% -
445.gobmk -56.04% 11093.000 4877.000 - 0.02% -
458.sjeng -51.74% 17055.000 8231.000 - 0.44% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.88% 804.000 1.000 - -90.00% -
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.67% 914.000 3.000 - -25.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.67% 6.060 0.020 - -92.00% -
444.namd (max) -99.50% 1003.000 5.000 - 0.00% -
429.mcf (max) -99.47% 2281.000 12.000 - -14.29% -
470.lbm (max) -98.81% 758.000 9.000 - -10.00% -
482.sphinx3 (max) -98.75% 883.000 11.000 - 0.00% -
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
456.hmmer (max) -98.23% 1242.000 22.000 - 10.00% -
401.bzip2 (max) -98.19% 609.000 11.000 - -8.33% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -97.50% 40.000 1.000 - -92.31% -
444.namd -97.48% 318.000 8.000 - 0.00% -
444.namd (avg) -97.48% 318.000 8.000 - 0.00% -
445.gobmk (max) -97.34% 413.000 11.000 - -15.38% -
401.bzip2 (unexplained diff vs previous) -96.97% 33.000 1.000 - -75.00% -
450.soplex (max) -96.79% 249.000 8.000 - 0.00% -
458.sjeng (max) -96.69% 876.000 29.000 - -6.45% -
447.dealII (unexplained diff vs previous) -96.30% 54.000 2.000 - -50.00% -
471.omnetpp (max) -95.99% 972.000 39.000 - -7.14% -
473.astar (max) -95.99% 822.000 33.000 - -2.94% -
470.lbm (max) (percentage) -95.98% 5.720 0.230 - -8.00% -
483.xalancbmk (max) -94.87% 1209.000 62.000 - -6.06% -
445.gobmk (unexplained diff vs previous) (percentage) -94.44% 0.360 0.020 - -92.59% -
456.hmmer (max) (percentage) -94.27% 10.480 0.600 - 13.21% -
447.dealII (max) -94.17% 223.000 13.000 - -7.14% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf -93.92% 296.000 18.000 - -5.26% -
429.mcf (avg) -93.92% 296.000 18.000 - -5.26% -
445.gobmk (max) (percentage) -93.57% 3.730 0.240 - -11.11% -
429.mcf (max) (percentage) -93.13% 16.310 1.120 - -12.50% -
458.sjeng (max) (percentage) -93.00% 5.140 0.360 - -7.69% -
470.lbm -92.97% 441.000 31.000 - -3.12% -
470.lbm (avg) -92.97% 441.000 31.000 - -3.12% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
444.namd (max) (percentage) -92.09% 8.090 0.640 - -4.48% -
433.milc (max) -91.67% 108.000 9.000 - 28.57% -
482.sphinx3 (unexplained diff vs previous) (percentage) -91.25% 3.430 0.300 - -25.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
450.soplex (unexplained diff vs previous) -89.86% 69.000 7.000 - 75.00% -
473.astar (max) (percentage) -89.40% 6.700 0.710 - -4.05% -
401.bzip2 (max) (percentage) -88.89% 3.780 0.420 - -4.55% -
473.astar (unexplained diff vs previous) -88.00% 25.000 3.000 - -72.73% -
447.dealII -87.76% 98.000 12.000 - 0.00% -
447.dealII (avg) -87.76% 98.000 12.000 - 0.00% -
401.bzip2 -87.50% 104.000 13.000 - 0.00% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 0.00% -
444.namd (unexplained diff vs previous) -87.50% 8.000 1.000 - 0.00% -
483.xalancbmk (max) (percentage) -85.66% 12.900 1.850 - -6.57% -
471.omnetpp (max) (percentage) -84.81% 9.280 1.410 - -6.62% -
471.omnetpp (unexplained diff vs previous) -84.47% 103.000 16.000 - -30.43% -
447.dealII (unexplained diff vs previous) (percentage) -82.76% 0.580 0.100 - -50.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -80.00% 0.200 0.040 - -71.43% -
429.mcf (unexplained diff vs previous) -77.27% 22.000 5.000 - -66.67% -
445.gobmk -77.03% 74.000 17.000 - -5.56% -
445.gobmk (avg) -77.03% 74.000 17.000 - -5.56% -
470.lbm (avg) (percentage) -76.58% 3.330 0.780 - -2.50% -
458.sjeng -75.00% 136.000 34.000 - 0.00% -
458.sjeng (avg) -75.00% 136.000 34.000 - 0.00% -
483.xalancbmk -73.23% 198.000 53.000 - -1.85% -
483.xalancbmk (avg) -73.23% 198.000 53.000 - -1.85% -
473.astar -72.32% 112.000 31.000 - -3.12% -
473.astar (avg) -72.32% 112.000 31.000 - -3.12% -
453.povray (max) -72.00% 25.000 7.000 - 0.00% -
456.hmmer -71.95% 164.000 46.000 - -2.13% -
456.hmmer (avg) -71.95% 164.000 46.000 - -2.13% -
464.h264ref (max) -71.67% 60.000 17.000 - -5.56% -
447.dealII (max) (percentage) -71.01% 2.380 0.690 - -6.76% -
471.omnetpp -70.06% 167.000 50.000 - 0.00% -
471.omnetpp (avg) -70.06% 167.000 50.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -70.00% 0.200 0.060 - -75.00% -
462.libquantum (max) (percentage) -69.12% 6.380 1.970 - -4.83% -
482.sphinx3 (max) (percentage) -66.16% 3.310 1.120 - -5.88% -
464.h264ref -59.52% 42.000 17.000 - 0.00% -
464.h264ref (avg) -59.52% 42.000 17.000 - 0.00% -
444.namd (avg) (percentage) -59.14% 2.570 1.050 - -1.87% -
482.sphinx3 (avg) (percentage) -51.15% 1.740 0.850 - -2.30% -
456.hmmer (unexplained diff vs previous) -50.00% 46.000 23.000 - 283.33% -
458.sjeng (avg) (percentage) -47.50% 0.800 0.420 - 0.00% -
445.gobmk (avg) (percentage) -46.27% 0.670 0.360 - -2.70% -
447.dealII (avg) (percentage) -41.90% 1.050 0.610 - -3.17% -
471.omnetpp (unexplained diff vs previous) (percentage) -41.84% 0.980 0.570 - -30.49% -
464.h264ref (max) (percentage) -30.95% 0.420 0.290 - -6.45% -
433.milc (avg) (percentage) -26.74% 0.860 0.630 - 1.61% -
401.bzip2 (avg) (percentage) -26.15% 0.650 0.480 - -2.04% -
473.astar (avg) (percentage) -26.09% 0.920 0.680 - -2.86% -
483.xalancbmk (avg) (percentage) -25.00% 2.120 1.590 - -2.45% -
433.milc (unexplained diff vs previous) -23.08% 13.000 10.000 - 900.00% -
429.mcf (avg) (percentage) -22.17% 2.120 1.650 - -1.79% -
456.hmmer (avg) (percentage) -12.95% 1.390 1.210 - -1.63% -
450.soplex (max) (percentage) -3.03% 1.650 1.600 - 0.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2851.000 -
403.gcc 56.000 -
429.mcf 1148.000 -
433.milc 1169.000 -
444.namd 804.000 -
445.gobmk 4877.000 -
447.dealII 1971.000 -
450.soplex 539.000 -1.28%
453.povray 500.000 -
456.hmmer 3812.000 -
458.sjeng 8231.000 -
462.libquantum 187.000 -
464.h264ref 5886.000 -
470.lbm 4004.000 -
471.omnetpp 2825.000 -
473.astar 4678.000 -
482.sphinx3 992.000 -
483.xalancbmk 3374.000 -
Geometric Mean 1552.008 -
Name Current %
401.bzip2 33549.000 -
403.gcc 1656431.000 -
429.mcf 6939.000 -
433.milc 46161.000 -
444.namd 122950.000 -
445.gobmk 1255989.000 -
447.dealII 196446.000 -
450.soplex 149644.000 -
453.povray 512911.000 -
456.hmmer 80417.000 -
458.sjeng 79274.000 -
462.libquantum 12131.000 -
464.h264ref 297775.000 -
470.lbm 9220.000 -
471.omnetpp 321049.000 -
473.astar 15559.000 -
482.sphinx3 87392.000 -
483.xalancbmk 1611988.000 -
Geometric Mean 110660.465 -
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.480 -2.04%
401.bzip2 (max) 11.000 -8.33%
401.bzip2 (max) (percentage) 0.420 -4.55%
401.bzip2 (unexplained diff vs previous) 1.000 -75.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -71.43%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.720 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.580 -1.35%
429.mcf 18.000 -5.26%
429.mcf (avg) 18.000 -5.26%
429.mcf (avg) (percentage) 1.650 -1.79%
429.mcf (max) 12.000 -14.29%
429.mcf (max) (percentage) 1.120 -12.50%
429.mcf (unexplained diff vs previous) 5.000 -66.67%
429.mcf (unexplained diff vs previous) (percentage) 0.440 -66.15%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 1.61%
433.milc (max) 9.000 28.57%
433.milc (max) (percentage) 0.850 39.34%
433.milc (unexplained diff vs previous) 10.000 900.00%
433.milc (unexplained diff vs previous) (percentage) 0.860 975.00%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.050 -1.87%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.640 -4.48%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.120 -
445.gobmk 17.000 -5.56%
445.gobmk (avg) 17.000 -5.56%
445.gobmk (avg) (percentage) 0.360 -2.70%
445.gobmk (max) 11.000 -15.38%
445.gobmk (max) (percentage) 0.240 -11.11%
445.gobmk (unexplained diff vs previous) 1.000 -92.31%
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -92.59%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.610 -3.17%
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 0.690 -6.76%
447.dealII (unexplained diff vs previous) 2.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.100 -50.00%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.340 -
450.soplex (max) 8.000 -
450.soplex (max) (percentage) 1.600 -
450.soplex (unexplained diff vs previous) 7.000 75.00%
450.soplex (unexplained diff vs previous) (percentage) 1.300 78.08%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.930 -2.11%
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.520 -3.80%
453.povray (unexplained diff vs previous) 2.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.400 -75.16%
456.hmmer 46.000 -2.13%
456.hmmer (avg) 46.000 -2.13%
456.hmmer (avg) (percentage) 1.210 -1.63%
456.hmmer (max) 22.000 10.00%
456.hmmer (max) (percentage) 0.600 13.21%
456.hmmer (unexplained diff vs previous) 23.000 283.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.600 275.00%
458.sjeng 34.000 -
458.sjeng (avg) 34.000 -
458.sjeng (avg) (percentage) 0.420 -
458.sjeng (max) 29.000 -6.45%
458.sjeng (max) (percentage) 0.360 -7.69%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.510 -2.58%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.970 -4.83%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 17.000 -
464.h264ref (avg) 17.000 -
464.h264ref (avg) (percentage) 0.300 -
464.h264ref (max) 17.000 -5.56%
464.h264ref (max) (percentage) 0.290 -6.45%
464.h264ref (unexplained diff vs previous) 6.000 -66.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.100 -67.74%
470.lbm 31.000 -3.12%
470.lbm (avg) 31.000 -3.12%
470.lbm (avg) (percentage) 0.780 -2.50%
470.lbm (max) 9.000 -10.00%
470.lbm (max) (percentage) 0.230 -8.00%
470.lbm (unexplained diff vs previous) 1.000 -90.00%
470.lbm (unexplained diff vs previous) (percentage) 0.020 -92.00%
471.omnetpp 50.000 -
471.omnetpp (avg) 50.000 -
471.omnetpp (avg) (percentage) 1.790 -1.10%
471.omnetpp (max) 39.000 -7.14%
471.omnetpp (max) (percentage) 1.410 -6.62%
471.omnetpp (unexplained diff vs previous) 16.000 -30.43%
471.omnetpp (unexplained diff vs previous) (percentage) 0.570 -30.49%
473.astar 31.000 -3.12%
473.astar (avg) 31.000 -3.12%
473.astar (avg) (percentage) 0.680 -2.86%
473.astar (max) 33.000 -2.94%
473.astar (max) (percentage) 0.710 -4.05%
473.astar (unexplained diff vs previous) 3.000 -72.73%
473.astar (unexplained diff vs previous) (percentage) 0.060 -75.00%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.850 -2.30%
482.sphinx3 (max) 11.000 -
482.sphinx3 (max) (percentage) 1.120 -5.88%
482.sphinx3 (unexplained diff vs previous) 3.000 -25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.300 -25.00%
483.xalancbmk 53.000 -1.85%
483.xalancbmk (avg) 53.000 -1.85%
483.xalancbmk (avg) (percentage) 1.590 -2.45%
483.xalancbmk (max) 62.000 -6.06%
483.xalancbmk (max) (percentage) 1.850 -6.57%
483.xalancbmk (unexplained diff vs previous) 1.000 -90.91%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.030 -90.91%
Geometric Mean 1.978 -41.29%