Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/470aea5ed403d43b68e2ffdbec451d79913eb15d (+ 243 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_tk1-llvm-master-arm-spec2k6-O2/404/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0404 (llvmorg-16-init-11387-g470aea5ed403) 2022-11-18T18:43:37 0:00:00
Previous 0403 (llvmorg-16-init-11144-gaae08b1d372a) 2022-11-15T00:20:09 0:00:00
Baseline 0001 (llvmorg-16-init-16024-ga455c91601a8) 2022-12-31T07:27:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 46 69
Performance Improvements 52 41
Added Tests 4 12
Unchanged Tests 678 658
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 1.90% 18192.000 18538.000 - 1.68% -
447.dealII 1.08% 5187.000 5243.000 - 1.39% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) 948.48% 33.000 346.000 - 606.12% -
482.sphinx3 (unexplained diff vs previous) (percentage) 938.89% 0.180 1.870 - 592.59% -
471.omnetpp (unexplained diff vs previous) (percentage) 660.00% 0.050 0.380 - 442.86% -
471.omnetpp (unexplained diff vs previous) 600.00% 4.000 28.000 - 460.00% -
447.dealII (max) 366.67% 12.000 56.000 - 64.71% -
429.mcf (unexplained diff vs previous) (percentage) 350.00% 0.040 0.180 - 260.00% -
447.dealII (max) (percentage) 332.00% 0.250 1.080 - 63.64% -
429.mcf (unexplained diff vs previous) 325.00% 4.000 17.000 - 240.00% -
403.gcc (unexplained diff vs previous) 266.67% 3.000 11.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 240.00% 0.050 0.170 - 0.00% -
429.mcf (max) 142.86% 7.000 17.000 - 70.00% -
445.gobmk (unexplained diff vs previous) (percentage) 125.00% 0.200 0.450 - 0.00% -
429.mcf (max) (percentage) 125.00% 0.080 0.180 - 63.64% -
445.gobmk (unexplained diff vs previous) 122.73% 22.000 49.000 - 0.00% -
482.sphinx3 (max) 108.28% 169.000 352.000 - 618.37% -
482.sphinx3 (max) (percentage) 104.30% 0.930 1.900 - 603.70% -
433.milc (unexplained diff vs previous) 100.00% 2.000 4.000 - -63.64% -
445.gobmk (max) (percentage) 55.17% 0.290 0.450 - 66.67% -
464.h264ref (unexplained diff vs previous) 55.00% 40.000 62.000 - -30.34% -
445.gobmk (max) 54.84% 31.000 48.000 - 60.00% -
464.h264ref (unexplained diff vs previous) (percentage) 53.66% 0.410 0.630 - -30.77% -
453.povray (unexplained diff vs previous) (percentage) 40.74% 0.540 0.760 - 20.63% -
453.povray (unexplained diff vs previous) 40.00% 25.000 35.000 - 20.69% -
482.sphinx3 24.00% 100.000 124.000 - 34.78% -
482.sphinx3 (avg) 24.00% 100.000 124.000 - 34.78% -
447.dealII 23.81% 21.000 26.000 - -7.14% -
447.dealII (avg) 23.81% 21.000 26.000 - -7.14% -
482.sphinx3 (avg) (percentage) 21.82% 0.550 0.670 - 31.37% -
458.sjeng (avg) (percentage) 19.48% 0.770 0.920 - 46.03% -
447.dealII (avg) (percentage) 19.05% 0.420 0.500 - -9.09% -
458.sjeng 15.65% 115.000 133.000 - 44.57% -
458.sjeng (avg) 15.65% 115.000 133.000 - 44.57% -
445.gobmk (avg) (percentage) 11.76% 0.170 0.190 - -13.64% -
401.bzip2 11.11% 9.000 10.000 - 11.11% -
401.bzip2 (avg) 11.11% 9.000 10.000 - 11.11% -
445.gobmk 11.11% 18.000 20.000 - -16.67% -
445.gobmk (avg) 11.11% 18.000 20.000 - -16.67% -
453.povray (max) (percentage) 10.14% 0.690 0.760 - 20.63% -
453.povray (max) 9.68% 31.000 34.000 - 17.24% -
401.bzip2 (max) 6.67% 15.000 16.000 - 77.78% -
450.soplex 6.25% 16.000 17.000 - 13.33% -
450.soplex (avg) 6.25% 16.000 17.000 - 13.33% -
464.h264ref (avg) (percentage) 1.85% 0.540 0.550 - -14.06% -
453.povray (avg) (percentage) 1.59% 0.630 0.640 - 30.61% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.52% 14938.000 14561.000 - -0.69% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -90.00% 0.100 0.010 - 0.00% -
462.libquantum (unexplained diff vs previous) -86.67% 15.000 2.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -76.37% 182.000 43.000 - -85.52% -
456.hmmer (unexplained diff vs previous) (percentage) -76.35% 2.410 0.570 - -85.64% -
470.lbm (unexplained diff vs previous) (percentage) -46.27% 0.670 0.360 - 300.00% -
470.lbm (unexplained diff vs previous) -46.23% 106.000 57.000 - 280.00% -
483.xalancbmk (unexplained diff vs previous) -29.17% 24.000 17.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -28.57% 0.420 0.300 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -27.27% 0.330 0.240 - 300.00% -
444.namd (unexplained diff vs previous) -27.27% 33.000 24.000 - 300.00% -
450.soplex (unexplained diff vs previous) (percentage) -27.27% 0.440 0.320 - 220.00% -
450.soplex (max) -27.03% 37.000 27.000 - 35.00% -
450.soplex (unexplained diff vs previous) -27.03% 37.000 27.000 - 237.50% -
456.hmmer (max) -25.42% 177.000 132.000 - -53.68% -
456.hmmer (max) (percentage) -25.11% 2.350 1.760 - -53.93% -
450.soplex (max) (percentage) -25.00% 0.440 0.330 - 37.50% -
473.astar (avg) (percentage) -13.33% 0.150 0.130 - 8.33% -
462.libquantum (max) -12.50% 48.000 42.000 - 425.00% -
462.libquantum (max) (percentage) -12.12% 0.330 0.290 - 383.33% -
458.sjeng (max) -12.02% 416.000 366.000 - 617.65% -
464.h264ref (max) -11.27% 71.000 63.000 - -27.59% -
464.h264ref (max) (percentage) -10.96% 0.730 0.650 - -27.78% -
458.sjeng (max) (percentage) -9.68% 2.790 2.520 - 620.00% -
403.gcc (max) (percentage) -9.52% 0.420 0.380 - -51.28% -
462.libquantum -9.09% 33.000 30.000 - 57.89% -
462.libquantum (avg) -9.09% 33.000 30.000 - 57.89% -
470.lbm (max) -9.01% 111.000 101.000 - 260.71% -
462.libquantum (avg) (percentage) -8.70% 0.230 0.210 - 61.54% -
470.lbm (max) (percentage) -8.57% 0.700 0.640 - 255.56% -
473.astar -7.69% 13.000 12.000 - 9.09% -
473.astar (avg) -7.69% 13.000 12.000 - 9.09% -
483.xalancbmk -7.50% 40.000 37.000 - -31.48% -
483.xalancbmk (avg) -7.50% 40.000 37.000 - -31.48% -
403.gcc (max) -7.41% 27.000 25.000 - -50.98% -
458.sjeng (unexplained diff vs previous) -7.14% 406.000 377.000 - 0.00% -
473.astar (max) -7.14% 14.000 13.000 - -13.33% -
483.xalancbmk (avg) (percentage) -7.14% 0.700 0.650 - -29.35% -
473.astar (max) (percentage) -6.25% 0.160 0.150 - -11.76% -
471.omnetpp (max) (percentage) -6.19% 1.130 1.060 - 130.43% -
471.omnetpp (max) -6.10% 82.000 77.000 - 133.33% -
444.namd (max) -6.06% 33.000 31.000 - 24.00% -
444.namd (max) (percentage) -5.88% 0.340 0.320 - 23.08% -
483.xalancbmk (max) (percentage) -5.80% 0.690 0.650 - -39.81% -
456.hmmer -5.49% 91.000 86.000 - -9.47% -
456.hmmer (avg) -5.49% 91.000 86.000 - -9.47% -
483.xalancbmk (max) -5.13% 39.000 37.000 - -41.27% -
456.hmmer (avg) (percentage) -4.96% 1.210 1.150 - -9.45% -
458.sjeng (unexplained diff vs previous) (percentage) -4.78% 2.720 2.590 - 0.00% -
471.omnetpp -2.63% 38.000 37.000 - 15.62% -
471.omnetpp (avg) -2.63% 38.000 37.000 - 15.62% -
471.omnetpp (avg) (percentage) -1.89% 0.530 0.520 - 18.18% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.45% 73592.000 74660.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 1.68% 18232.000 18538.000 - 1.90% -
447.dealII 1.39% 5171.000 5243.000 - 1.08% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (unexplained diff vs previous) 750.00% 2.000 17.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 650.00% 0.020 0.150 - 0.00% -
458.sjeng (max) (percentage) 620.00% 0.350 2.520 - -9.68% -
482.sphinx3 (max) 618.37% 49.000 352.000 - 108.28% -
458.sjeng (max) 617.65% 51.000 366.000 - -12.02% -
482.sphinx3 (unexplained diff vs previous) 606.12% 49.000 346.000 - 948.48% -
482.sphinx3 (max) (percentage) 603.70% 0.270 1.900 - 104.30% -
482.sphinx3 (unexplained diff vs previous) (percentage) 592.59% 0.270 1.870 - 938.89% -
471.omnetpp (unexplained diff vs previous) 460.00% 5.000 28.000 - 600.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 442.86% 0.070 0.380 - 660.00% -
462.libquantum (max) 425.00% 8.000 42.000 - -12.50% -
462.libquantum (max) (percentage) 383.33% 0.060 0.290 - -12.12% -
470.lbm (unexplained diff vs previous) (percentage) 300.00% 0.090 0.360 - -46.27% -
444.namd (unexplained diff vs previous) 300.00% 6.000 24.000 - -27.27% -
444.namd (unexplained diff vs previous) (percentage) 300.00% 0.060 0.240 - -27.27% -
470.lbm (unexplained diff vs previous) 280.00% 15.000 57.000 - -46.23% -
470.lbm (max) 260.71% 28.000 101.000 - -9.01% -
429.mcf (unexplained diff vs previous) (percentage) 260.00% 0.050 0.180 - 350.00% -
470.lbm (max) (percentage) 255.56% 0.180 0.640 - -8.57% -
429.mcf (unexplained diff vs previous) 240.00% 5.000 17.000 - 325.00% -
450.soplex (unexplained diff vs previous) 237.50% 8.000 27.000 - -27.03% -
450.soplex (unexplained diff vs previous) (percentage) 220.00% 0.100 0.320 - -27.27% -
471.omnetpp (max) 133.33% 33.000 77.000 - -6.10% -
471.omnetpp (max) (percentage) 130.43% 0.460 1.060 - -6.19% -
401.bzip2 (max) (percentage) 87.50% 0.080 0.150 - 7.14% -
401.bzip2 (max) 77.78% 9.000 16.000 - 6.67% -
429.mcf (max) 70.00% 10.000 17.000 - 142.86% -
445.gobmk (max) (percentage) 66.67% 0.270 0.450 - 55.17% -
447.dealII (max) 64.71% 34.000 56.000 - 366.67% -
447.dealII (max) (percentage) 63.64% 0.660 1.080 - 332.00% -
429.mcf (max) (percentage) 63.64% 0.110 0.180 - 125.00% -
462.libquantum (avg) (percentage) 61.54% 0.130 0.210 - -8.70% -
445.gobmk (max) 60.00% 30.000 48.000 - 54.84% -
462.libquantum 57.89% 19.000 30.000 - -9.09% -
462.libquantum (avg) 57.89% 19.000 30.000 - -9.09% -
458.sjeng (avg) (percentage) 46.03% 0.630 0.920 - 19.48% -
458.sjeng 44.57% 92.000 133.000 - 15.65% -
458.sjeng (avg) 44.57% 92.000 133.000 - 15.65% -
470.lbm 38.30% 47.000 65.000 - 0.00% -
470.lbm (avg) 38.30% 47.000 65.000 - 0.00% -
450.soplex (max) (percentage) 37.50% 0.240 0.330 - -25.00% -
470.lbm (avg) (percentage) 36.67% 0.300 0.410 - 0.00% -
450.soplex (max) 35.00% 20.000 27.000 - -27.03% -
482.sphinx3 34.78% 92.000 124.000 - 24.00% -
482.sphinx3 (avg) 34.78% 92.000 124.000 - 24.00% -
453.povray 31.82% 22.000 29.000 - 0.00% -
453.povray (avg) 31.82% 22.000 29.000 - 0.00% -
482.sphinx3 (avg) (percentage) 31.37% 0.510 0.670 - 21.82% -
453.povray (avg) (percentage) 30.61% 0.490 0.640 - 1.59% -
444.namd (max) 24.00% 25.000 31.000 - -6.06% -
444.namd (max) (percentage) 23.08% 0.260 0.320 - -5.88% -
453.povray (unexplained diff vs previous) 20.69% 29.000 35.000 - 40.00% -
453.povray (max) (percentage) 20.63% 0.630 0.760 - 10.14% -
453.povray (unexplained diff vs previous) (percentage) 20.63% 0.630 0.760 - 40.74% -
471.omnetpp (avg) (percentage) 18.18% 0.440 0.520 - -1.89% -
453.povray (max) 17.24% 29.000 34.000 - 9.68% -
471.omnetpp 15.62% 32.000 37.000 - -2.63% -
471.omnetpp (avg) 15.62% 32.000 37.000 - -2.63% -
450.soplex 13.33% 15.000 17.000 - 6.25% -
450.soplex (avg) 13.33% 15.000 17.000 - 6.25% -
401.bzip2 11.11% 9.000 10.000 - 11.11% -
401.bzip2 (avg) 11.11% 9.000 10.000 - 11.11% -
450.soplex (avg) (percentage) 10.53% 0.190 0.210 - 5.00% -
473.astar 9.09% 11.000 12.000 - -7.69% -
473.astar (avg) 9.09% 11.000 12.000 - -7.69% -
473.astar (avg) (percentage) 8.33% 0.120 0.130 - -13.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -3.13% 11199.000 10849.000 - -0.45% -
483.xalancbmk -2.94% 5921.000 5747.000 - 0.30% -
471.omnetpp -1.36% 7376.000 7276.000 - -0.38% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) -94.12% 0.170 0.010 - 0.00% -
473.astar (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -85.64% 3.970 0.570 - -76.35% -
456.hmmer (unexplained diff vs previous) -85.52% 297.000 43.000 - -76.37% -
433.milc (unexplained diff vs previous) (percentage) -66.67% 0.090 0.030 - 50.00% -
433.milc (unexplained diff vs previous) -63.64% 11.000 4.000 - 100.00% -
433.milc (max) -60.00% 10.000 4.000 - 0.00% -
433.milc (max) (percentage) -55.56% 0.090 0.040 - 0.00% -
456.hmmer (max) (percentage) -53.93% 3.820 1.760 - -25.11% -
456.hmmer (max) -53.68% 285.000 132.000 - -25.42% -
403.gcc (max) (percentage) -51.28% 0.780 0.380 - -9.52% -
403.gcc (max) -50.98% 51.000 25.000 - -7.41% -
483.xalancbmk (max) -41.27% 63.000 37.000 - -5.13% -
483.xalancbmk (max) (percentage) -39.81% 1.080 0.650 - -5.80% -
403.gcc (avg) (percentage) -36.11% 0.360 0.230 - -4.17% -
403.gcc -34.78% 23.000 15.000 - 0.00% -
403.gcc (avg) -34.78% 23.000 15.000 - 0.00% -
483.xalancbmk -31.48% 54.000 37.000 - -7.50% -
483.xalancbmk (avg) -31.48% 54.000 37.000 - -7.50% -
464.h264ref (unexplained diff vs previous) (percentage) -30.77% 0.910 0.630 - 53.66% -
464.h264ref (unexplained diff vs previous) -30.34% 89.000 62.000 - 55.00% -
483.xalancbmk (avg) (percentage) -29.35% 0.920 0.650 - -7.14% -
464.h264ref (max) (percentage) -27.78% 0.900 0.650 - -10.96% -
464.h264ref (max) -27.59% 87.000 63.000 - -11.27% -
445.gobmk -16.67% 24.000 20.000 - 11.11% -
445.gobmk (avg) -16.67% 24.000 20.000 - 11.11% -
464.h264ref -14.52% 62.000 53.000 - 0.00% -
464.h264ref (avg) -14.52% 62.000 53.000 - 0.00% -
464.h264ref (avg) (percentage) -14.06% 0.640 0.550 - 1.85% -
445.gobmk (avg) (percentage) -13.64% 0.220 0.190 - 11.76% -
473.astar (max) -13.33% 15.000 13.000 - -7.14% -
473.astar (max) (percentage) -11.76% 0.170 0.150 - -6.25% -
456.hmmer -9.47% 95.000 86.000 - -5.49% -
456.hmmer (avg) -9.47% 95.000 86.000 - -5.49% -
456.hmmer (avg) (percentage) -9.45% 1.270 1.150 - -4.96% -
447.dealII (avg) (percentage) -9.09% 0.550 0.500 - 19.05% -
447.dealII -7.14% 28.000 26.000 - 23.81% -
447.dealII (avg) -7.14% 28.000 26.000 - 23.81% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)


Report Time: 0.34s
Name Current %
401.bzip2 11333.000 -
403.gcc 6613.000 -
429.mcf 9621.000 -
433.milc 11916.000 -
444.namd 9970.000 -
445.gobmk 10849.000 -
447.dealII 5243.000 1.08%
450.soplex 8470.000 -
453.povray 4596.000 -
456.hmmer 7507.000 -
458.sjeng 14561.000 -2.52%
462.libquantum 14687.000 -
464.h264ref 9789.000 -
470.lbm 15866.000 -
471.omnetpp 7276.000 -
473.astar 9327.000 -
482.sphinx3 18538.000 1.90%
483.xalancbmk 5747.000 -
Geometric Mean 9421.255 -
Name Current %
401.bzip2 74660.000 -
403.gcc 3223057.000 -
429.mcf 11067.000 -
433.milc 113891.000 -
444.namd 226810.000 -
445.gobmk 1593191.000 -
447.dealII 2632110.000 -
450.soplex 310653.000 -
453.povray 913734.000 -
456.hmmer 259274.000 -
458.sjeng 149677.000 -
462.libquantum 35309.000 -
464.h264ref 623094.000 -
470.lbm 11281.000 -
471.omnetpp 527879.000 -
473.astar 35956.000 -
482.sphinx3 166092.000 -
483.xalancbmk 3355164.000 -
Geometric Mean 242390.279 -
Name Current %
401.bzip2 10.000 11.11%
401.bzip2 (avg) 10.000 11.11%
401.bzip2 (avg) (percentage) 0.090 -
401.bzip2 (max) 16.000 6.67%
401.bzip2 (max) (percentage) 0.150 -
401.bzip2 (unexplained diff vs previous) 17.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.150 -
403.gcc 15.000 -
403.gcc (avg) 15.000 -
403.gcc (avg) (percentage) 0.230 -
403.gcc (max) 25.000 -7.41%
403.gcc (max) (percentage) 0.380 -9.52%
403.gcc (unexplained diff vs previous) 11.000 266.67%
403.gcc (unexplained diff vs previous) (percentage) 0.170 240.00%
429.mcf 7.000 -
429.mcf (avg) 7.000 -
429.mcf (avg) (percentage) 0.080 -
429.mcf (max) 17.000 142.86%
429.mcf (max) (percentage) 0.180 125.00%
429.mcf (unexplained diff vs previous) 17.000 325.00%
429.mcf (unexplained diff vs previous) (percentage) 0.180 350.00%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.070 -
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.040 -
433.milc (unexplained diff vs previous) 4.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.030 -
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 0.170 -
444.namd (max) 31.000 -6.06%
444.namd (max) (percentage) 0.320 -5.88%
444.namd (unexplained diff vs previous) 24.000 -27.27%
444.namd (unexplained diff vs previous) (percentage) 0.240 -27.27%
445.gobmk 20.000 11.11%
445.gobmk (avg) 20.000 11.11%
445.gobmk (avg) (percentage) 0.190 11.76%
445.gobmk (max) 48.000 54.84%
445.gobmk (max) (percentage) 0.450 55.17%
445.gobmk (unexplained diff vs previous) 49.000 122.73%
445.gobmk (unexplained diff vs previous) (percentage) 0.450 125.00%
447.dealII 26.000 23.81%
447.dealII (avg) 26.000 23.81%
447.dealII (avg) (percentage) 0.500 19.05%
447.dealII (max) 56.000 366.67%
447.dealII (max) (percentage) 1.080 332.00%
447.dealII (unexplained diff vs previous) 56.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.070 -
450.soplex 17.000 6.25%
450.soplex (avg) 17.000 6.25%
450.soplex (avg) (percentage) 0.210 -
450.soplex (max) 27.000 -27.03%
450.soplex (max) (percentage) 0.330 -25.00%
450.soplex (unexplained diff vs previous) 27.000 -27.03%
450.soplex (unexplained diff vs previous) (percentage) 0.320 -27.27%
453.povray 29.000 -
453.povray (avg) 29.000 -
453.povray (avg) (percentage) 0.640 1.59%
453.povray (max) 34.000 9.68%
453.povray (max) (percentage) 0.760 10.14%
453.povray (unexplained diff vs previous) 35.000 40.00%
453.povray (unexplained diff vs previous) (percentage) 0.760 40.74%
456.hmmer 86.000 -5.49%
456.hmmer (avg) 86.000 -5.49%
456.hmmer (avg) (percentage) 1.150 -4.96%
456.hmmer (max) 132.000 -25.42%
456.hmmer (max) (percentage) 1.760 -25.11%
456.hmmer (unexplained diff vs previous) 43.000 -76.37%
456.hmmer (unexplained diff vs previous) (percentage) 0.570 -76.35%
458.sjeng 133.000 15.65%
458.sjeng (avg) 133.000 15.65%
458.sjeng (avg) (percentage) 0.920 19.48%
458.sjeng (max) 366.000 -12.02%
458.sjeng (max) (percentage) 2.520 -9.68%
458.sjeng (unexplained diff vs previous) 377.000 -7.14%
458.sjeng (unexplained diff vs previous) (percentage) 2.590 -4.78%
462.libquantum 30.000 -9.09%
462.libquantum (avg) 30.000 -9.09%
462.libquantum (avg) (percentage) 0.210 -8.70%
462.libquantum (max) 42.000 -12.50%
462.libquantum (max) (percentage) 0.290 -12.12%
462.libquantum (unexplained diff vs previous) 2.000 -86.67%
462.libquantum (unexplained diff vs previous) (percentage) 0.010 -90.00%
464.h264ref 53.000 -
464.h264ref (avg) 53.000 -
464.h264ref (avg) (percentage) 0.550 1.85%
464.h264ref (max) 63.000 -11.27%
464.h264ref (max) (percentage) 0.650 -10.96%
464.h264ref (unexplained diff vs previous) 62.000 55.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.630 53.66%
470.lbm 65.000 -
470.lbm (avg) 65.000 -
470.lbm (avg) (percentage) 0.410 -
470.lbm (max) 101.000 -9.01%
470.lbm (max) (percentage) 0.640 -8.57%
470.lbm (unexplained diff vs previous) 57.000 -46.23%
470.lbm (unexplained diff vs previous) (percentage) 0.360 -46.27%
471.omnetpp 37.000 -2.63%
471.omnetpp (avg) 37.000 -2.63%
471.omnetpp (avg) (percentage) 0.520 -1.89%
471.omnetpp (max) 77.000 -6.10%
471.omnetpp (max) (percentage) 1.060 -6.19%
471.omnetpp (unexplained diff vs previous) 28.000 600.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.380 660.00%
473.astar 12.000 -7.69%
473.astar (avg) 12.000 -7.69%
473.astar (avg) (percentage) 0.130 -13.33%
473.astar (max) 13.000 -7.14%
473.astar (max) (percentage) 0.150 -6.25%
473.astar (unexplained diff vs previous) 1.000 -
473.astar (unexplained diff vs previous) (percentage) 0.010 -
482.sphinx3 124.000 24.00%
482.sphinx3 (avg) 124.000 24.00%
482.sphinx3 (avg) (percentage) 0.670 21.82%
482.sphinx3 (max) 352.000 108.28%
482.sphinx3 (max) (percentage) 1.900 104.30%
482.sphinx3 (unexplained diff vs previous) 346.000 948.48%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.870 938.89%
483.xalancbmk 37.000 -7.50%
483.xalancbmk (avg) 37.000 -7.50%
483.xalancbmk (avg) (percentage) 0.650 -7.14%
483.xalancbmk (max) 37.000 -5.13%
483.xalancbmk (max) (percentage) 0.650 -5.80%
483.xalancbmk (unexplained diff vs previous) 17.000 -29.17%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.300 -28.57%
Geometric Mean 4.379 24.63%