Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4036a6946e5420bb77a93037c83732be600b9b0b (+ 535 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/144/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0144 (llvmorg-19-init-08048-g4036a6946e54) 2024-04-06T10:50:15 0:00:00
Previous 0142 (llvmorg-19-init-07513-g5748ad84e5e8) 2024-03-31T23:14:05 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 26 29
Performance Improvements 40 113
Unchanged Tests 714 638
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 1.02% 98.000 99.000 - -99.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (unexplained diff vs previous) 466.67% 6.000 34.000 - -44.26% -
483.xalancbmk (unexplained diff vs previous) (percentage) 452.94% 0.170 0.940 - 44.62% -
473.astar (unexplained diff vs previous) (percentage) 325.00% 0.120 0.510 - -32.89% -
473.astar (unexplained diff vs previous) 316.67% 6.000 25.000 - -76.85% -
450.soplex (unexplained diff vs previous) (percentage) 300.00% 0.190 0.760 - 33.33% -
445.gobmk (unexplained diff vs previous) 300.00% 1.000 4.000 - -86.67% -
445.gobmk (unexplained diff vs previous) (percentage) 300.00% 0.020 0.080 - -66.67% -
450.soplex (unexplained diff vs previous) 300.00% 1.000 4.000 - -95.12% -
453.povray (unexplained diff vs previous) 200.00% 1.000 3.000 - -97.69% -
453.povray (unexplained diff vs previous) (percentage) 190.91% 0.220 0.640 - -66.32% -
470.lbm (unexplained diff vs previous) (percentage) 159.09% 0.220 0.570 - -84.08% -
470.lbm (unexplained diff vs previous) 157.14% 7.000 18.000 - -96.38% -
473.astar (max) 84.62% 13.000 24.000 - -78.95% -
473.astar (max) (percentage) 82.14% 0.280 0.510 - -36.25% -
470.lbm (max) (percentage) 23.91% 0.460 0.570 - -89.71% -
470.lbm (max) 21.43% 14.000 17.000 - -97.79% -
433.milc (max) 20.00% 5.000 6.000 - -96.74% -
433.milc (unexplained diff vs previous) 20.00% 5.000 6.000 - -96.70% -
433.milc (max) (percentage) 18.18% 0.440 0.520 - -62.04% -
433.milc (unexplained diff vs previous) (percentage) 18.18% 0.440 0.520 - -61.48% -
456.hmmer (unexplained diff vs previous) (percentage) 16.00% 1.000 1.160 - 1557.14% -
456.hmmer (unexplained diff vs previous) 13.89% 36.000 41.000 - 355.56% -
456.hmmer (max) (percentage) 12.87% 1.010 1.140 - 280.00% -
456.hmmer (max) 11.11% 36.000 40.000 - 0.00% -
456.hmmer (avg) (percentage) 1.49% 0.670 0.680 - 88.89% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.67% 60.000 59.000 - -99.35% -
456.hmmer -1.14% 3589.000 3548.000 - -73.45% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -97.96% 49.000 1.000 - -98.91% -
471.omnetpp (unexplained diff vs previous) (percentage) -97.73% 1.760 0.040 - -95.35% -
444.namd (max) -50.00% 10.000 5.000 - -99.43% -
401.bzip2 (unexplained diff vs previous) -43.33% 30.000 17.000 - -65.31% -
444.namd (max) (percentage) -43.15% 1.460 0.830 - -87.31% -
401.bzip2 (unexplained diff vs previous) (percentage) -42.73% 1.100 0.630 - 103.23% -
444.namd (unexplained diff vs previous) -28.57% 7.000 5.000 - -99.40% -
444.namd (unexplained diff vs previous) (percentage) -28.13% 0.960 0.690 - -88.76% -
403.gcc (max) -16.67% 6.000 5.000 - -85.29% -
482.sphinx3 (max) -14.29% 7.000 6.000 - -99.31% -
471.omnetpp (max) (percentage) -10.14% 2.170 1.950 - 10.80% -
401.bzip2 (max) -10.00% 30.000 27.000 - -43.75% -
471.omnetpp (max) -10.00% 60.000 54.000 - -71.43% -
401.bzip2 (max) (percentage) -8.04% 1.120 1.030 - 232.26% -
450.soplex (max) (percentage) -6.85% 1.460 1.360 - 138.60% -
401.bzip2 -6.25% 16.000 15.000 - -55.88% -
401.bzip2 (avg) -6.25% 16.000 15.000 - -55.88% -
462.libquantum (max) (percentage) -6.13% 1.630 1.530 - 665.00% -
482.sphinx3 (max) (percentage) -5.95% 0.840 0.790 - -76.20% -
483.xalancbmk (max) (percentage) -5.84% 1.540 1.450 - 123.08% -
483.xalancbmk (max) -5.45% 55.000 52.000 - -14.75% -
447.dealII (max) -5.26% 19.000 18.000 - -86.05% -
464.h264ref (max) (percentage) -5.00% 0.400 0.380 - -2.56% -
447.dealII (max) (percentage) -4.67% 1.070 1.020 - -35.44% -
445.gobmk -4.55% 22.000 21.000 - -4.55% -
445.gobmk (avg) -4.55% 22.000 21.000 - -4.55% -
464.h264ref (max) -4.55% 22.000 21.000 - -65.00% -
429.mcf (max) (percentage) -4.46% 1.120 1.070 - 91.07% -
470.lbm -3.12% 32.000 31.000 - -90.37% -
470.lbm (avg) -3.12% 32.000 31.000 - -90.37% -
445.gobmk (avg) (percentage) -2.38% 0.420 0.410 - 127.78% -
471.omnetpp -2.04% 49.000 48.000 - -42.17% -
471.omnetpp (avg) -2.04% 49.000 48.000 - -42.17% -
473.astar (avg) (percentage) -1.71% 1.170 1.150 - 130.00% -
471.omnetpp (avg) (percentage) -1.69% 1.770 1.740 - 123.08% -
444.namd (avg) (percentage) -1.47% 1.360 1.340 - -64.83% -
453.povray (max) (percentage) -1.09% 0.920 0.910 - -52.85% -
403.gcc (max) (percentage) -1.08% 10.220 10.110 - 2560.53% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.22% 39458.000 40333.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 2560.53% 0.380 10.110 - -1.08% -
456.hmmer (unexplained diff vs previous) (percentage) 1557.14% 0.070 1.160 - 16.00% -
462.libquantum (avg) (percentage) 773.33% 0.150 1.310 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - -0.98% -
403.gcc (avg) (percentage) 689.58% 0.480 3.790 - 0.00% -
462.libquantum (max) (percentage) 665.00% 0.200 1.530 - -6.13% -
456.hmmer (unexplained diff vs previous) 355.56% 9.000 41.000 - 13.89% -
429.mcf (avg) (percentage) 351.11% 0.450 2.030 - -0.98% -
456.hmmer (max) (percentage) 280.00% 0.300 1.140 - 12.87% -
450.soplex (avg) (percentage) 238.89% 0.360 1.220 - -0.81% -
401.bzip2 (max) (percentage) 232.26% 0.310 1.030 - -8.04% -
483.xalancbmk (avg) (percentage) 186.00% 0.500 1.430 - -0.69% -
401.bzip2 (avg) (percentage) 168.18% 0.220 0.590 - 0.00% -
450.soplex (max) (percentage) 138.60% 0.570 1.360 - -6.85% -
473.astar (avg) (percentage) 130.00% 0.500 1.150 - -1.71% -
445.gobmk (avg) (percentage) 127.78% 0.180 0.410 - -2.38% -
471.omnetpp (avg) (percentage) 123.08% 0.780 1.740 - -1.69% -
483.xalancbmk (max) (percentage) 123.08% 0.650 1.450 - -5.84% -
401.bzip2 (unexplained diff vs previous) (percentage) 103.23% 0.310 0.630 - -42.73% -
429.mcf (max) (percentage) 91.07% 0.560 1.070 - -4.46% -
456.hmmer (avg) (percentage) 88.89% 0.360 0.680 - 1.49% -
464.h264ref (avg) (percentage) 63.64% 0.330 0.540 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 44.62% 0.650 0.940 - 452.94% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.570 0.760 - 300.00% -
429.mcf (unexplained diff vs previous) (percentage) 23.21% 0.560 0.690 - 0.00% -
471.omnetpp (max) (percentage) 10.80% 1.760 1.950 - -10.14% -
483.xalancbmk 8.51% 47.000 51.000 - 0.00% -
483.xalancbmk (avg) 8.51% 47.000 51.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.47% 26756.000 23955.000 - 0.00% -
444.namd -3.21% 175160.000 169537.000 - 0.00% -
447.dealII -2.86% 1777992.000 1727183.000 - 0.00% -
453.povray -2.80% 593097.000 576486.000 - 0.00% -
433.milc -2.77% 74971.000 72894.000 - -0.01% -
464.h264ref -1.44% 354618.000 349510.000 - -0.00% -
482.sphinx3 -1.36% 115736.000 114159.000 - 0.02% -
429.mcf -1.02% 7915.000 7834.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9099.000 59.000 - -1.67% -
462.libquantum -99.25% 13126.000 99.000 - 1.02% -
482.sphinx3 -96.66% 26310.000 880.000 - -0.56% -
450.soplex -96.35% 14429.000 526.000 - 0.77% -
444.namd -94.65% 13495.000 722.000 - -0.69% -
453.povray -93.19% 6857.000 467.000 - 0.65% -
433.milc -91.44% 13482.000 1154.000 - 0.52% -
429.mcf -90.27% 11999.000 1167.000 - 0.69% -
401.bzip2 -82.76% 15683.000 2703.000 - -0.62% -
447.dealII -78.25% 8196.000 1783.000 - -0.83% -
470.lbm -77.26% 13882.000 3157.000 - -0.57% -
471.omnetpp -74.10% 10746.000 2783.000 - 0.04% -
456.hmmer -73.45% 13365.000 3548.000 - -1.14% -
473.astar -65.76% 14262.000 4884.000 - 0.51% -
464.h264ref -64.04% 15493.000 5571.000 - 0.22% -
483.xalancbmk -61.45% 9427.000 3634.000 - 0.94% -
445.gobmk -57.71% 12400.000 5244.000 - -0.08% -
458.sjeng -49.87% 16406.000 8225.000 - -0.02% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.43% 882.000 5.000 - -50.00% -
444.namd (unexplained diff vs previous) -99.40% 828.000 5.000 - -28.57% -
482.sphinx3 (max) -99.31% 873.000 6.000 - -14.29% -
471.omnetpp (unexplained diff vs previous) -98.91% 92.000 1.000 - -97.96% -
444.namd -98.25% 514.000 9.000 - 0.00% -
444.namd (avg) -98.25% 514.000 9.000 - 0.00% -
482.sphinx3 -98.16% 489.000 9.000 - 0.00% -
482.sphinx3 (avg) -98.16% 489.000 9.000 - 0.00% -
470.lbm (max) -97.79% 769.000 17.000 - 21.43% -
453.povray (unexplained diff vs previous) -97.69% 130.000 3.000 - 200.00% -
453.povray (max) -96.97% 132.000 4.000 - 0.00% -
433.milc (max) -96.74% 184.000 6.000 - 20.00% -
433.milc (unexplained diff vs previous) -96.70% 182.000 6.000 - 20.00% -
470.lbm (unexplained diff vs previous) -96.38% 497.000 18.000 - 157.14% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -95.35% 0.860 0.040 - -97.73% -
450.soplex (unexplained diff vs previous) -95.12% 82.000 4.000 - 300.00% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
450.soplex (max) -91.46% 82.000 7.000 - 0.00% -
447.dealII -90.83% 120.000 11.000 - 0.00% -
447.dealII (avg) -90.83% 120.000 11.000 - 0.00% -
470.lbm -90.37% 322.000 31.000 - -3.12% -
470.lbm (avg) -90.37% 322.000 31.000 - -3.12% -
470.lbm (max) (percentage) -89.71% 5.540 0.570 - 23.91% -
444.namd (unexplained diff vs previous) (percentage) -88.76% 6.140 0.690 - -28.13% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
429.mcf (unexplained diff vs previous) -88.06% 67.000 8.000 - 0.00% -
444.namd (max) (percentage) -87.31% 6.540 0.830 - -43.15% -
445.gobmk (unexplained diff vs previous) -86.67% 30.000 4.000 - 300.00% -
447.dealII (max) -86.05% 129.000 18.000 - -5.26% -
403.gcc (max) -85.29% 34.000 5.000 - -16.67% -
470.lbm (unexplained diff vs previous) (percentage) -84.08% 3.580 0.570 - 159.09% -
458.sjeng (max) -83.08% 65.000 11.000 - 0.00% -
429.mcf (max) -82.09% 67.000 12.000 - 0.00% -
473.astar (max) -78.95% 114.000 24.000 - 84.62% -
473.astar (unexplained diff vs previous) -76.85% 108.000 25.000 - 316.67% -
482.sphinx3 (max) (percentage) -76.20% 3.320 0.790 - -5.95% -
471.omnetpp (max) -71.43% 189.000 54.000 - -10.00% -
445.gobmk (max) -68.97% 29.000 9.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.240 0.080 - 300.00% -
453.povray (unexplained diff vs previous) (percentage) -66.32% 1.900 0.640 - 190.91% -
401.bzip2 (unexplained diff vs previous) -65.31% 49.000 17.000 - -43.33% -
458.sjeng (max) (percentage) -65.00% 0.400 0.140 - 0.00% -
464.h264ref (max) -65.00% 60.000 21.000 - -4.55% -
444.namd (avg) (percentage) -64.83% 3.810 1.340 - -1.47% -
458.sjeng -62.11% 95.000 36.000 - 0.00% -
458.sjeng (avg) -62.11% 95.000 36.000 - 0.00% -
433.milc (max) (percentage) -62.04% 1.370 0.520 - 18.18% -
433.milc (unexplained diff vs previous) (percentage) -61.48% 1.350 0.520 - 18.18% -
429.mcf -56.60% 53.000 23.000 - 0.00% -
429.mcf (avg) -56.60% 53.000 23.000 - 0.00% -
470.lbm (avg) (percentage) -56.47% 2.320 1.010 - -0.98% -
447.dealII (avg) (percentage) -56.46% 1.470 0.640 - 0.00% -
401.bzip2 -55.88% 34.000 15.000 - -6.25% -
401.bzip2 (avg) -55.88% 34.000 15.000 - -6.25% -
453.povray (max) (percentage) -52.85% 1.930 0.910 - -1.09% -
456.hmmer -50.00% 48.000 24.000 - 0.00% -
456.hmmer (avg) -50.00% 48.000 24.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -44.26% 61.000 34.000 - 466.67% -
482.sphinx3 (avg) (percentage) -44.09% 1.860 1.040 - 0.00% -
401.bzip2 (max) -43.75% 48.000 27.000 - -10.00% -
471.omnetpp -42.17% 83.000 48.000 - -2.04% -
471.omnetpp (avg) -42.17% 83.000 48.000 - -2.04% -
464.h264ref -41.18% 51.000 30.000 - 0.00% -
464.h264ref (avg) -41.18% 51.000 30.000 - 0.00% -
433.milc (avg) (percentage) -36.63% 1.010 0.640 - 0.00% -
473.astar (max) (percentage) -36.25% 0.800 0.510 - 82.14% -
447.dealII (max) (percentage) -35.44% 1.580 1.020 - -4.67% -
473.astar (unexplained diff vs previous) (percentage) -32.89% 0.760 0.510 - 325.00% -
458.sjeng (avg) (percentage) -24.14% 0.580 0.440 - 0.00% -
473.astar -21.13% 71.000 56.000 - 0.00% -
473.astar (avg) -21.13% 71.000 56.000 - 0.00% -
445.gobmk (max) (percentage) -20.83% 0.240 0.190 - 0.00% -
453.povray (avg) (percentage) -19.71% 1.370 1.100 - -0.90% -
483.xalancbmk (max) -14.75% 61.000 52.000 - -5.45% -
445.gobmk -4.55% 22.000 21.000 - -4.55% -
445.gobmk (avg) -4.55% 22.000 21.000 - -4.55% -
464.h264ref (max) (percentage) -2.56% 0.390 0.380 - -5.00% -

Report Time: 0.37s
Execution (seconds)
Name Current %
401.bzip2 2703.000 -
403.gcc 59.000 -1.67%
429.mcf 1167.000 -
433.milc 1154.000 -
444.namd 722.000 -
445.gobmk 5244.000 -
447.dealII 1783.000 -
450.soplex 526.000 -
453.povray 467.000 -
456.hmmer 3548.000 -1.14%
458.sjeng 8225.000 -
462.libquantum 99.000 1.02%
464.h264ref 5571.000 -
470.lbm 3157.000 -
471.omnetpp 2783.000 -
473.astar 4884.000 -
482.sphinx3 880.000 -
483.xalancbmk 3634.000 -
Geometric Mean 1448.355 -
Code Size (bytes)
Name Current %
401.bzip2 40333.000 -
403.gcc 1954713.000 -
429.mcf 7834.000 -
433.milc 72894.000 -
444.namd 169537.000 -
445.gobmk 1308216.000 -
447.dealII 1727183.000 -
450.soplex 198335.000 -
453.povray 576486.000 -
456.hmmer 166422.000 -
458.sjeng 96893.000 -
462.libquantum 23955.000 -
464.h264ref 349510.000 -
470.lbm 9702.000 -
471.omnetpp 376219.000 -
473.astar 23315.000 -
482.sphinx3 114159.000 -
483.xalancbmk 2284952.000 -
Geometric Mean 162006.272 -
sample variability
Name Current %
401.bzip2 15.000 -6.25%
401.bzip2 (avg) 15.000 -6.25%
401.bzip2 (avg) (percentage) 0.590 -
401.bzip2 (max) 27.000 -10.00%
401.bzip2 (max) (percentage) 1.030 -8.04%
401.bzip2 (unexplained diff vs previous) 17.000 -43.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.630 -42.73%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.790 -
403.gcc (max) 5.000 -16.67%
403.gcc (max) (percentage) 10.110 -1.08%
429.mcf 23.000 -
429.mcf (avg) 23.000 -
429.mcf (avg) (percentage) 2.030 -
429.mcf (max) 12.000 -
429.mcf (max) (percentage) 1.070 -4.46%
429.mcf (unexplained diff vs previous) 8.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.690 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 -
433.milc (max) 6.000 20.00%
433.milc (max) (percentage) 0.520 18.18%
433.milc (unexplained diff vs previous) 6.000 20.00%
433.milc (unexplained diff vs previous) (percentage) 0.520 18.18%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.340 -1.47%
444.namd (max) 5.000 -50.00%
444.namd (max) (percentage) 0.830 -43.15%
444.namd (unexplained diff vs previous) 5.000 -28.57%
444.namd (unexplained diff vs previous) (percentage) 0.690 -28.13%
445.gobmk 21.000 -4.55%
445.gobmk (avg) 21.000 -4.55%
445.gobmk (avg) (percentage) 0.410 -2.38%
445.gobmk (max) 9.000 -
445.gobmk (max) (percentage) 0.190 -
445.gobmk (unexplained diff vs previous) 4.000 300.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.080 300.00%
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 0.640 -
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.020 -4.67%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.220 -
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.360 -6.85%
450.soplex (unexplained diff vs previous) 4.000 300.00%
450.soplex (unexplained diff vs previous) (percentage) 0.760 300.00%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.100 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.910 -1.09%
453.povray (unexplained diff vs previous) 3.000 200.00%
453.povray (unexplained diff vs previous) (percentage) 0.640 190.91%
456.hmmer 24.000 -
456.hmmer (avg) 24.000 -
456.hmmer (avg) (percentage) 0.680 1.49%
456.hmmer (max) 40.000 11.11%
456.hmmer (max) (percentage) 1.140 12.87%
456.hmmer (unexplained diff vs previous) 41.000 13.89%
456.hmmer (unexplained diff vs previous) (percentage) 1.160 16.00%
458.sjeng 36.000 -
458.sjeng (avg) 36.000 -
458.sjeng (avg) (percentage) 0.440 -
458.sjeng (max) 11.000 -
458.sjeng (max) (percentage) 0.140 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.310 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.530 -6.13%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -
464.h264ref 30.000 -
464.h264ref (avg) 30.000 -
464.h264ref (avg) (percentage) 0.540 -
464.h264ref (max) 21.000 -4.55%
464.h264ref (max) (percentage) 0.380 -5.00%
470.lbm 31.000 -3.12%
470.lbm (avg) 31.000 -3.12%
470.lbm (avg) (percentage) 1.010 -
470.lbm (max) 17.000 21.43%
470.lbm (max) (percentage) 0.570 23.91%
470.lbm (unexplained diff vs previous) 18.000 157.14%
470.lbm (unexplained diff vs previous) (percentage) 0.570 159.09%
471.omnetpp 48.000 -2.04%
471.omnetpp (avg) 48.000 -2.04%
471.omnetpp (avg) (percentage) 1.740 -1.69%
471.omnetpp (max) 54.000 -10.00%
471.omnetpp (max) (percentage) 1.950 -10.14%
471.omnetpp (unexplained diff vs previous) 1.000 -97.96%
471.omnetpp (unexplained diff vs previous) (percentage) 0.040 -97.73%
473.astar 56.000 -
473.astar (avg) 56.000 -
473.astar (avg) (percentage) 1.150 -1.71%
473.astar (max) 24.000 84.62%
473.astar (max) (percentage) 0.510 82.14%
473.astar (unexplained diff vs previous) 25.000 316.67%
473.astar (unexplained diff vs previous) (percentage) 0.510 325.00%
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.040 -
482.sphinx3 (max) 6.000 -14.29%
482.sphinx3 (max) (percentage) 0.790 -5.95%
483.xalancbmk 51.000 -
483.xalancbmk (avg) 51.000 -
483.xalancbmk (avg) (percentage) 1.430 -
483.xalancbmk (max) 52.000 -5.45%
483.xalancbmk (max) (percentage) 1.450 -5.84%
483.xalancbmk (unexplained diff vs previous) 34.000 466.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.940 452.94%
Geometric Mean 3.696 25.55%