Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/703423c26965cd2e5b331e587d87f8ee291d956a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/15/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0015 (no-change) 2023-02-19T07:55:01 0:00:00
Previous 0013 (llvmorg-17-init-02761-g703423c26965) 2023-02-17T19:41:31 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 68
Performance Improvements 85 52
Added Tests 4 2
Unchanged Tests 673 658
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.63% 198668.000 201902.000 - 1.61% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 135305.97% 0.670 907.220 - 161903.57% -
471.omnetpp (unexplained diff vs previous) (percentage) 35098.80% 0.830 292.150 - 33870.93% -
429.mcf (unexplained diff vs previous) 13267.09% 79.000 10560.000 - 15661.19% -
471.omnetpp (unexplained diff vs previous) 8914.44% 90.000 8113.000 - 8718.48% -
473.astar (unexplained diff vs previous) (percentage) 8103.14% 2.550 209.180 - 27423.68% -
473.astar (unexplained diff vs previous) 2555.20% 375.000 9957.000 - 9119.44% -
473.astar (max) (percentage) 660.22% 8.900 67.660 - 8357.50% -
429.mcf (max) (percentage) 605.88% 12.760 90.070 - 15983.93% -
471.omnetpp (max) (percentage) 587.90% 10.830 74.500 - 4132.95% -
483.xalancbmk (max) (percentage) 328.52% 14.200 60.850 - 9261.54% -
473.astar (max) 145.99% 1309.000 3220.000 - 2724.56% -
473.astar (avg) (percentage) 138.01% 2.710 6.450 - 1190.00% -
429.mcf (avg) (percentage) 117.40% 3.620 7.870 - 1648.89% -
471.omnetpp (avg) (percentage) 110.26% 3.020 6.350 - 714.10% -
471.omnetpp (max) 75.40% 1179.000 2068.000 - 994.18% -
483.xalancbmk (avg) (percentage) 72.90% 5.830 10.080 - 1916.00% -
483.xalancbmk (max) 67.89% 1305.000 2191.000 - 3491.80% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum -5.65% 26756.000 25243.000 - -5.65% -
433.milc -2.20% 74971.000 73322.000 - -2.20% -
401.bzip2 -2.04% 39474.000 38669.000 - -2.00% -
447.dealII -1.83% 1779348.000 1746719.000 - -1.76% -
482.sphinx3 -1.20% 115768.000 114379.000 - -1.17% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -99.36% 9206.000 59.000 - -99.35% -
462.libquantum -99.25% 13128.000 98.000 - -99.25% -
482.sphinx3 -96.64% 26338.000 885.000 - -96.64% -
450.soplex -96.36% 14371.000 523.000 - -96.38% -
444.namd -94.20% 12164.000 706.000 - -94.77% -
453.povray -92.19% 6043.000 472.000 - -93.12% -
433.milc -91.32% 13371.000 1161.000 - -91.39% -
429.mcf -90.07% 11724.000 1164.000 - -90.30% -
401.bzip2 -82.59% 15808.000 2752.000 - -82.45% -
447.dealII -78.79% 8260.000 1752.000 - -78.62% -
470.lbm -77.00% 13720.000 3156.000 - -77.27% -
471.omnetpp -74.50% 10890.000 2777.000 - -74.16% -
456.hmmer -72.63% 13030.000 3566.000 - -73.32% -
473.astar -67.66% 14717.000 4760.000 - -66.62% -
464.h264ref -63.26% 15018.000 5517.000 - -64.39% -
483.xalancbmk -60.85% 9197.000 3601.000 - -61.80% -
445.gobmk -56.80% 12113.000 5233.000 - -57.80% -
458.sjeng -50.14% 16213.000 8083.000 - -50.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) -99.49% 196.000 1.000 - -97.06% -
462.libquantum (max) -99.35% 1226.000 8.000 - -69.23% -
462.libquantum -99.30% 286.000 2.000 - -89.47% -
462.libquantum (avg) -99.30% 286.000 2.000 - -89.47% -
450.soplex (max) -96.92% 130.000 4.000 - -95.12% -
482.sphinx3 (max) -96.87% 2233.000 70.000 - -91.98% -
482.sphinx3 -96.68% 753.000 25.000 - -94.89% -
482.sphinx3 (avg) -96.68% 753.000 25.000 - -94.89% -
450.soplex -96.43% 56.000 2.000 - -96.08% -
450.soplex (avg) -96.43% 56.000 2.000 - -96.08% -
444.namd (max) -94.69% 471.000 25.000 - -97.17% -
444.namd -94.25% 504.000 29.000 - -94.36% -
444.namd (avg) -94.25% 504.000 29.000 - -94.36% -
453.povray (max) -92.73% 564.000 41.000 - -68.94% -
453.povray -92.38% 105.000 8.000 - -91.40% -
453.povray (avg) -92.38% 105.000 8.000 - -91.40% -
433.milc (max) -91.93% 322.000 26.000 - -85.87% -
433.milc -91.89% 148.000 12.000 - -91.18% -
433.milc (avg) -91.89% 148.000 12.000 - -91.18% -
401.bzip2 (max) -83.83% 600.000 97.000 - 102.08% -
401.bzip2 -83.06% 183.000 31.000 - -8.82% -
401.bzip2 (avg) -83.06% 183.000 31.000 - -8.82% -
447.dealII (max) -79.39% 165.000 34.000 - -73.64% -
447.dealII -78.90% 109.000 23.000 - -80.83% -
447.dealII (avg) -78.90% 109.000 23.000 - -80.83% -
470.lbm (max) -78.56% 1735.000 372.000 - -51.63% -
429.mcf -78.54% 424.000 91.000 - 71.70% -
429.mcf (avg) -78.54% 424.000 91.000 - 71.70% -
470.lbm -77.00% 574.000 132.000 - -59.01% -
470.lbm (avg) -77.00% 574.000 132.000 - -59.01% -
456.hmmer (max) -74.46% 1151.000 294.000 - 635.00% -
456.hmmer -72.64% 413.000 113.000 - 135.42% -
456.hmmer (avg) -72.64% 413.000 113.000 - 135.42% -
464.h264ref (max) -65.72% 1199.000 411.000 - 585.00% -
464.h264ref -63.43% 309.000 113.000 - 121.57% -
464.h264ref (avg) -63.43% 309.000 113.000 - 121.57% -
445.gobmk (max) -59.78% 649.000 261.000 - 800.00% -
445.gobmk -56.82% 176.000 76.000 - 245.45% -
445.gobmk (avg) -56.82% 176.000 76.000 - 245.45% -
458.sjeng (max) -51.62% 833.000 403.000 - 520.00% -
458.sjeng -50.38% 262.000 130.000 - 36.84% -
458.sjeng (avg) -50.38% 262.000 130.000 - 36.84% -
471.omnetpp -46.34% 328.000 176.000 - 112.05% -
471.omnetpp (avg) -46.34% 328.000 176.000 - 112.05% -
483.xalancbmk -32.46% 536.000 362.000 - 670.21% -
483.xalancbmk (avg) -32.46% 536.000 362.000 - 670.21% -
429.mcf (max) -29.90% 1495.000 1048.000 - 1464.18% -
473.astar -22.86% 398.000 307.000 - 332.39% -
473.astar (avg) -22.86% 398.000 307.000 - 332.39% -
482.sphinx3 (max) (percentage) -6.72% 8.480 7.910 - 138.25% -
445.gobmk (max) (percentage) -6.72% 5.360 5.000 - 1983.33% -
456.hmmer (max) (percentage) -6.67% 8.840 8.250 - 2650.00% -
470.lbm (max) (percentage) -6.64% 12.650 11.810 - 113.18% -
433.milc (max) (percentage) -6.64% 2.410 2.250 - 64.23% -
462.libquantum (max) (percentage) -6.64% 9.340 8.720 - 4260.00% -
464.h264ref (max) (percentage) -6.63% 7.990 7.460 - 1812.82% -
401.bzip2 (max) (percentage) -6.58% 3.800 3.550 - 1045.16% -
444.namd (max) (percentage) -6.44% 3.880 3.630 - -44.50% -
450.soplex (max) (percentage) -5.49% 0.910 0.860 - 50.88% -
453.povray (max) (percentage) -5.14% 9.340 8.860 - 359.07% -
403.gcc (max) (percentage) -3.76% 2.130 2.050 - 439.47% -
458.sjeng (max) (percentage) -2.92% 5.140 4.990 - 1147.50% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.61% 198708.000 201902.000 - 1.63% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 161903.57% 0.560 907.220 - 135305.97% -
471.omnetpp (unexplained diff vs previous) (percentage) 33870.93% 0.860 292.150 - 35098.80% -
473.astar (unexplained diff vs previous) (percentage) 27423.68% 0.760 209.180 - 8103.14% -
483.xalancbmk (unexplained diff vs previous) (percentage) 23807.69% 0.650 155.400 - 0.00% -
429.mcf (max) (percentage) 15983.93% 0.560 90.070 - 605.88% -
429.mcf (unexplained diff vs previous) 15661.19% 67.000 10560.000 - 13267.09% -
483.xalancbmk (max) (percentage) 9261.54% 0.650 60.850 - 328.52% -
473.astar (unexplained diff vs previous) 9119.44% 108.000 9957.000 - 2555.20% -
483.xalancbmk (unexplained diff vs previous) 9073.77% 61.000 5596.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 8718.48% 92.000 8113.000 - 8914.44% -
473.astar (max) (percentage) 8357.50% 0.800 67.660 - 660.22% -
462.libquantum (max) (percentage) 4260.00% 0.200 8.720 - -6.64% -
471.omnetpp (max) (percentage) 4132.95% 1.760 74.500 - 587.90% -
483.xalancbmk (max) 3491.80% 61.000 2191.000 - 67.89% -
473.astar (max) 2724.56% 114.000 3220.000 - 145.99% -
456.hmmer (max) (percentage) 2650.00% 0.300 8.250 - -6.67% -
445.gobmk (max) (percentage) 1983.33% 0.240 5.000 - -6.72% -
483.xalancbmk (avg) (percentage) 1916.00% 0.500 10.080 - 72.90% -
464.h264ref (max) (percentage) 1812.82% 0.390 7.460 - -6.63% -
429.mcf (avg) (percentage) 1648.89% 0.450 7.870 - 117.40% -
429.mcf (max) 1464.18% 67.000 1048.000 - -29.90% -
462.libquantum (avg) (percentage) 1353.33% 0.150 2.180 - 0.00% -
473.astar (avg) (percentage) 1190.00% 0.500 6.450 - 138.01% -
458.sjeng (max) (percentage) 1147.50% 0.400 4.990 - -2.92% -
401.bzip2 (max) (percentage) 1045.16% 0.310 3.550 - -6.58% -
471.omnetpp (max) 994.18% 189.000 2068.000 - 75.40% -
445.gobmk (max) 800.00% 29.000 261.000 - -59.78% -
456.hmmer (avg) (percentage) 780.56% 0.360 3.170 - 0.00% -
471.omnetpp (avg) (percentage) 714.10% 0.780 6.350 - 110.26% -
445.gobmk (avg) (percentage) 711.11% 0.180 1.460 - 0.00% -
483.xalancbmk 670.21% 47.000 362.000 - -32.46% -
483.xalancbmk (avg) 670.21% 47.000 362.000 - -32.46% -
456.hmmer (max) 635.00% 40.000 294.000 - -74.46% -
464.h264ref (max) 585.00% 60.000 411.000 - -65.72% -
464.h264ref (avg) (percentage) 524.24% 0.330 2.060 - 0.00% -
458.sjeng (max) 520.00% 65.000 403.000 - -51.62% -
403.gcc (max) (percentage) 439.47% 0.380 2.050 - -3.76% -
401.bzip2 (avg) (percentage) 427.27% 0.220 1.160 - 0.00% -
453.povray (max) (percentage) 359.07% 1.930 8.860 - -5.14% -
473.astar 332.39% 71.000 307.000 - -22.86% -
473.astar (avg) 332.39% 71.000 307.000 - -22.86% -
445.gobmk 245.45% 22.000 76.000 - -56.82% -
445.gobmk (avg) 245.45% 22.000 76.000 - -56.82% -
458.sjeng (avg) (percentage) 179.31% 0.580 1.620 - 0.00% -
482.sphinx3 (max) (percentage) 138.25% 3.320 7.910 - -6.72% -
456.hmmer 135.42% 48.000 113.000 - -72.64% -
456.hmmer (avg) 135.42% 48.000 113.000 - -72.64% -
464.h264ref 121.57% 51.000 113.000 - -63.43% -
464.h264ref (avg) 121.57% 51.000 113.000 - -63.43% -
470.lbm (max) (percentage) 113.18% 5.540 11.810 - -6.64% -
471.omnetpp 112.05% 83.000 176.000 - -46.34% -
471.omnetpp (avg) 112.05% 83.000 176.000 - -46.34% -
401.bzip2 (max) 102.08% 48.000 97.000 - -83.83% -
403.gcc (avg) (percentage) 97.92% 0.480 0.950 - 0.00% -
470.lbm (avg) (percentage) 80.60% 2.320 4.190 - 0.00% -
429.mcf 71.70% 53.000 91.000 - -78.54% -
429.mcf (avg) 71.70% 53.000 91.000 - -78.54% -
433.milc (max) (percentage) 64.23% 1.370 2.250 - -6.64% -
482.sphinx3 (avg) (percentage) 53.76% 1.860 2.860 - 0.00% -
450.soplex (max) (percentage) 50.88% 0.570 0.860 - -5.49% -
458.sjeng 36.84% 95.000 130.000 - -50.38% -
458.sjeng (avg) 36.84% 95.000 130.000 - -50.38% -
453.povray (avg) (percentage) 27.01% 1.370 1.740 - 0.00% -
447.dealII (max) (percentage) 25.95% 1.580 1.990 - -0.50% -
433.milc (avg) (percentage) 9.90% 1.010 1.110 - 0.00% -
444.namd (avg) (percentage) 8.92% 3.810 4.150 - 0.00% -
450.soplex (avg) (percentage) 8.33% 0.360 0.390 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.65% 26756.000 25243.000 - -5.65% -
433.milc -2.20% 74971.000 73322.000 - -2.20% -
401.bzip2 -2.00% 39458.000 38669.000 - -2.04% -
447.dealII -1.76% 1777992.000 1746719.000 - -1.83% -
482.sphinx3 -1.17% 115736.000 114379.000 - -1.20% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9099.000 59.000 - -99.36% -
462.libquantum -99.25% 13126.000 98.000 - -99.25% -
482.sphinx3 -96.64% 26310.000 885.000 - -96.64% -
450.soplex -96.38% 14429.000 523.000 - -96.36% -
444.namd -94.77% 13495.000 706.000 - -94.20% -
453.povray -93.12% 6857.000 472.000 - -92.19% -
433.milc -91.39% 13482.000 1161.000 - -91.32% -
429.mcf -90.30% 11999.000 1164.000 - -90.07% -
401.bzip2 -82.45% 15683.000 2752.000 - -82.59% -
447.dealII -78.62% 8196.000 1752.000 - -78.79% -
470.lbm -77.27% 13882.000 3156.000 - -77.00% -
471.omnetpp -74.16% 10746.000 2777.000 - -74.50% -
456.hmmer -73.32% 13365.000 3566.000 - -72.63% -
473.astar -66.62% 14262.000 4760.000 - -67.66% -
464.h264ref -64.39% 15493.000 5517.000 - -63.26% -
483.xalancbmk -61.80% 9427.000 3601.000 - -60.85% -
445.gobmk -57.80% 12400.000 5233.000 - -56.80% -
458.sjeng -50.73% 16406.000 8083.000 - -50.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -97.17% 882.000 25.000 - -94.69% -
403.gcc (max) -97.06% 34.000 1.000 - -99.49% -
450.soplex -96.08% 51.000 2.000 - -96.43% -
450.soplex (avg) -96.08% 51.000 2.000 - -96.43% -
450.soplex (max) -95.12% 82.000 4.000 - -96.92% -
482.sphinx3 -94.89% 489.000 25.000 - -96.68% -
482.sphinx3 (avg) -94.89% 489.000 25.000 - -96.68% -
444.namd -94.36% 514.000 29.000 - -94.25% -
444.namd (avg) -94.36% 514.000 29.000 - -94.25% -
482.sphinx3 (max) -91.98% 873.000 70.000 - -96.87% -
453.povray -91.40% 93.000 8.000 - -92.38% -
453.povray (avg) -91.40% 93.000 8.000 - -92.38% -
433.milc -91.18% 136.000 12.000 - -91.89% -
433.milc (avg) -91.18% 136.000 12.000 - -91.89% -
462.libquantum -89.47% 19.000 2.000 - -99.30% -
462.libquantum (avg) -89.47% 19.000 2.000 - -99.30% -
433.milc (max) -85.87% 184.000 26.000 - -91.93% -
447.dealII -80.83% 120.000 23.000 - -78.90% -
447.dealII (avg) -80.83% 120.000 23.000 - -78.90% -
447.dealII (max) -73.64% 129.000 34.000 - -79.39% -
462.libquantum (max) -69.23% 26.000 8.000 - -99.35% -
453.povray (max) -68.94% 132.000 41.000 - -92.73% -
470.lbm -59.01% 322.000 132.000 - -77.00% -
470.lbm (avg) -59.01% 322.000 132.000 - -77.00% -
470.lbm (max) -51.63% 769.000 372.000 - -78.56% -
444.namd (max) (percentage) -44.50% 6.540 3.630 - -6.44% -
447.dealII (avg) (percentage) -9.52% 1.470 1.330 - 0.00% -
401.bzip2 -8.82% 34.000 31.000 - -83.06% -
401.bzip2 (avg) -8.82% 34.000 31.000 - -83.06% -

Added Tests - sample variability
403.gcc
403.gcc (avg)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2752.000 -82.59%
403.gcc 59.000 -99.36%
429.mcf 1164.000 -90.07%
433.milc 1161.000 -91.32%
444.namd 706.000 -94.20%
445.gobmk 5233.000 -56.80%
447.dealII 1752.000 -78.79%
450.soplex 523.000 -96.36%
453.povray 472.000 -92.19%
456.hmmer 3566.000 -72.63%
458.sjeng 8083.000 -50.14%
462.libquantum 98.000 -99.25%
464.h264ref 5517.000 -63.26%
470.lbm 3156.000 -77.00%
471.omnetpp 2777.000 -74.50%
473.astar 4760.000 -67.66%
482.sphinx3 885.000 -96.64%
483.xalancbmk 3601.000 -60.85%
Geometric Mean 1441.966 -88.44%
Code Size (bytes)
Name Current %
401.bzip2 38669.000 -2.04%
403.gcc 1958381.000 -
429.mcf 7902.000 -
433.milc 73322.000 -2.20%
444.namd 175337.000 -
445.gobmk 1310368.000 -
447.dealII 1746719.000 -1.83%
450.soplex 201902.000 1.63%
453.povray 589822.000 -
456.hmmer 166478.000 -
458.sjeng 97005.000 -
462.libquantum 25243.000 -5.65%
464.h264ref 352910.000 -
470.lbm 9726.000 -
471.omnetpp 376579.000 -
473.astar 23199.000 -
482.sphinx3 114379.000 -1.20%
483.xalancbmk 2286944.000 -
Geometric Mean 163146.513 -
sample variability
Name Current %
401.bzip2 31.000 -83.06%
401.bzip2 (avg) 31.000 -83.06%
401.bzip2 (avg) (percentage) 1.160 -
401.bzip2 (max) 97.000 -83.83%
401.bzip2 (max) (percentage) 3.550 -6.58%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.950 -
403.gcc (max) 1.000 -99.49%
403.gcc (max) (percentage) 2.050 -3.76%
429.mcf 91.000 -78.54%
429.mcf (avg) 91.000 -78.54%
429.mcf (avg) (percentage) 7.870 117.40%
429.mcf (max) 1048.000 -29.90%
429.mcf (max) (percentage) 90.070 605.88%
429.mcf (unexplained diff vs previous) 10560.000 13267.09%
429.mcf (unexplained diff vs previous) (percentage) 907.220 135305.97%
433.milc 12.000 -91.89%
433.milc (avg) 12.000 -91.89%
433.milc (avg) (percentage) 1.110 -
433.milc (max) 26.000 -91.93%
433.milc (max) (percentage) 2.250 -6.64%
444.namd 29.000 -94.25%
444.namd (avg) 29.000 -94.25%
444.namd (avg) (percentage) 4.150 -
444.namd (max) 25.000 -94.69%
444.namd (max) (percentage) 3.630 -6.44%
445.gobmk 76.000 -56.82%
445.gobmk (avg) 76.000 -56.82%
445.gobmk (avg) (percentage) 1.460 -
445.gobmk (max) 261.000 -59.78%
445.gobmk (max) (percentage) 5.000 -6.72%
447.dealII 23.000 -78.90%
447.dealII (avg) 23.000 -78.90%
447.dealII (avg) (percentage) 1.330 -
447.dealII (max) 34.000 -79.39%
447.dealII (max) (percentage) 1.990 -
450.soplex 2.000 -96.43%
450.soplex (avg) 2.000 -96.43%
450.soplex (avg) (percentage) 0.390 -
450.soplex (max) 4.000 -96.92%
450.soplex (max) (percentage) 0.860 -5.49%
453.povray 8.000 -92.38%
453.povray (avg) 8.000 -92.38%
453.povray (avg) (percentage) 1.740 -
453.povray (max) 41.000 -92.73%
453.povray (max) (percentage) 8.860 -5.14%
456.hmmer 113.000 -72.64%
456.hmmer (avg) 113.000 -72.64%
456.hmmer (avg) (percentage) 3.170 -
456.hmmer (max) 294.000 -74.46%
456.hmmer (max) (percentage) 8.250 -6.67%
458.sjeng 130.000 -50.38%
458.sjeng (avg) 130.000 -50.38%
458.sjeng (avg) (percentage) 1.620 -
458.sjeng (max) 403.000 -51.62%
458.sjeng (max) (percentage) 4.990 -2.92%
462.libquantum 2.000 -99.30%
462.libquantum (avg) 2.000 -99.30%
462.libquantum (avg) (percentage) 2.180 -
462.libquantum (max) 8.000 -99.35%
462.libquantum (max) (percentage) 8.720 -6.64%
464.h264ref 113.000 -63.43%
464.h264ref (avg) 113.000 -63.43%
464.h264ref (avg) (percentage) 2.060 -
464.h264ref (max) 411.000 -65.72%
464.h264ref (max) (percentage) 7.460 -6.63%
470.lbm 132.000 -77.00%
470.lbm (avg) 132.000 -77.00%
470.lbm (avg) (percentage) 4.190 -
470.lbm (max) 372.000 -78.56%
470.lbm (max) (percentage) 11.810 -6.64%
471.omnetpp 176.000 -46.34%
471.omnetpp (avg) 176.000 -46.34%
471.omnetpp (avg) (percentage) 6.350 110.26%
471.omnetpp (max) 2068.000 75.40%
471.omnetpp (max) (percentage) 74.500 587.90%
471.omnetpp (unexplained diff vs previous) 8113.000 8914.44%
471.omnetpp (unexplained diff vs previous) (percentage) 292.150 35098.80%
473.astar 307.000 -22.86%
473.astar (avg) 307.000 -22.86%
473.astar (avg) (percentage) 6.450 138.01%
473.astar (max) 3220.000 145.99%
473.astar (max) (percentage) 67.660 660.22%
473.astar (unexplained diff vs previous) 9957.000 2555.20%
473.astar (unexplained diff vs previous) (percentage) 209.180 8103.14%
482.sphinx3 25.000 -96.68%
482.sphinx3 (avg) 25.000 -96.68%
482.sphinx3 (avg) (percentage) 2.860 -
482.sphinx3 (max) 70.000 -96.87%
482.sphinx3 (max) (percentage) 7.910 -6.72%
483.xalancbmk 362.000 -32.46%
483.xalancbmk (avg) 362.000 -32.46%
483.xalancbmk (avg) (percentage) 10.080 72.90%
483.xalancbmk (max) 2191.000 67.89%
483.xalancbmk (max) (percentage) 60.850 328.52%
483.xalancbmk (unexplained diff vs previous) 5596.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 155.400 -
Geometric Mean 23.070 -53.79%