Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5ec73b7dcf7f23225ccd37a605f0b752058ea643 (+ 303 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/173/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0173 (llvmorg-20-init-03096-g5ec73b7dcf7f) 2024-08-15T15:47:52 0:00:00
Previous 0172 (llvmorg-20-init-02793-gc4c9f39ba46b) 2024-08-10T06:02:39 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 15 16
Performance Improvements 42 120
Added Tests 2 2
Unchanged Tests 709 630
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.69% 59.000 60.000 - -99.37% -
433.milc 1.37% 1164.000 1180.000 - -91.32% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 205.45% 0.550 1.680 0.000 16700.00% 0.000
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 200.00% 0.000
433.milc (max) 60.00% 10.000 16.000 - -85.19% -
447.dealII (unexplained diff vs previous) (percentage) 47.73% 0.880 1.300 0.000 124.14% 0.000
447.dealII (unexplained diff vs previous) 47.06% 17.000 25.000 0.000 -53.70% 0.000
433.milc (max) (percentage) 45.74% 0.940 1.370 - 71.25% -
433.milc (unexplained diff vs previous) 45.45% 11.000 16.000 0.000 23.08% 0.000
433.milc (unexplained diff vs previous) (percentage) 43.16% 0.950 1.360 0.000 1260.00% 0.000
456.hmmer (unexplained diff vs previous) 16.67% 6.000 7.000 0.000 -84.78% 0.000
456.hmmer (unexplained diff vs previous) (percentage) 12.50% 0.160 0.180 0.000 -53.85% 0.000
444.namd (unexplained diff vs previous) (percentage) 2.70% 0.370 0.380 0.000 533.33% 0.000
447.dealII (avg) (percentage) 2.70% 0.740 0.760 - -27.62% -
433.milc (avg) (percentage) 1.64% 0.610 0.620 - -27.91% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.65% 182.000 179.000 - -98.76% -
450.soplex -1.46% 547.000 539.000 - -96.43% -
447.dealII -1.29% 1941.000 1916.000 - -79.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -87.50% 0.240 0.030 0.000 -96.94% 0.000
470.lbm (unexplained diff vs previous) -86.36% 22.000 3.000 0.000 -99.63% 0.000
471.omnetpp (unexplained diff vs previous) -85.71% 7.000 1.000 0.000 -99.03% 0.000
470.lbm (unexplained diff vs previous) (percentage) -85.45% 0.550 0.080 0.000 -98.68% 0.000
429.mcf (unexplained diff vs previous) -83.33% 6.000 1.000 0.000 -95.45% 0.000
429.mcf (unexplained diff vs previous) (percentage) -83.02% 0.530 0.090 0.000 -43.75% 0.000
401.bzip2 (unexplained diff vs previous) -64.29% 14.000 5.000 0.000 -84.85% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -64.00% 0.500 0.180 0.000 -10.00% 0.000
444.namd (max) -33.33% 3.000 2.000 - -99.80% -
429.mcf (max) -20.00% 5.000 4.000 - -99.82% -
429.mcf (max) (percentage) -17.31% 0.520 0.430 - -97.36% -
470.lbm (max) (percentage) -16.36% 0.550 0.460 - -91.96% -
470.lbm (max) -14.29% 21.000 18.000 - -97.63% -
471.omnetpp (max) -14.29% 14.000 12.000 - -98.77% -
464.h264ref (max) (percentage) -12.50% 0.160 0.140 - -66.67% -
444.namd (max) (percentage) -11.90% 0.420 0.370 - -95.43% -
464.h264ref (max) -11.11% 9.000 8.000 - -86.67% -
456.hmmer (max) (percentage) -8.70% 0.230 0.210 - -98.00% -
471.omnetpp (max) (percentage) -8.33% 0.480 0.440 - -95.26% -
473.astar (max) -7.69% 26.000 24.000 - -97.08% -
450.soplex (max) (percentage) -7.26% 3.030 2.810 - 70.30% -
473.astar (max) (percentage) -7.14% 0.560 0.520 - -92.24% -
482.sphinx3 (max) -7.14% 14.000 13.000 - -98.53% -
462.libquantum (max) (percentage) -6.80% 2.060 1.920 - -69.91% -
450.soplex (max) -6.25% 16.000 15.000 - -93.98% -
482.sphinx3 (max) (percentage) -4.90% 1.430 1.360 - -58.91% -
445.gobmk (max) (percentage) -4.55% 0.220 0.210 - -94.37% -
464.h264ref (avg) (percentage) -4.35% 0.230 0.220 - -24.14% -
401.bzip2 (max) (percentage) -4.08% 0.490 0.470 - -87.57% -
447.dealII (max) -3.85% 26.000 25.000 - -88.79% -
456.hmmer -3.03% 33.000 32.000 - -80.49% -
456.hmmer (avg) -3.03% 33.000 32.000 - -80.49% -
453.povray (max) (percentage) -2.52% 1.190 1.160 - 222.22% -
401.bzip2 (avg) (percentage) -2.27% 0.440 0.430 - -33.85% -
429.mcf (avg) (percentage) -1.56% 1.280 1.260 - -40.57% -
447.dealII (max) (percentage) -1.46% 1.370 1.350 - -43.28% -
471.omnetpp (avg) (percentage) -1.37% 1.460 1.440 - -10.00% -
444.namd (avg) (percentage) -1.16% 0.860 0.850 - -66.93% -
456.hmmer (avg) (percentage) -1.15% 0.870 0.860 - -38.13% -

Added Tests - sample variability
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.89% 146765.000 149544.000 - 0.01% -
471.omnetpp 1.62% 316676.000 321798.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 16700.00% 0.010 1.680 0.000 205.45% 0.000
433.milc (unexplained diff vs previous) (percentage) 1260.00% 0.100 1.360 0.000 43.16% 0.000
444.namd (unexplained diff vs previous) (percentage) 533.33% 0.060 0.380 0.000 2.70% 0.000
403.gcc (avg) (percentage) 372.73% 0.550 2.600 - 0.00% -
453.povray (max) (percentage) 222.22% 0.360 1.160 - -2.52% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 200.00% 0.000
450.soplex (avg) (percentage) 154.00% 0.500 1.270 - 0.00% -
403.gcc (max) (percentage) 131.33% 2.330 5.390 - -0.92% -
447.dealII (unexplained diff vs previous) (percentage) 124.14% 0.580 1.300 0.000 47.73% 0.000
462.libquantum (avg) (percentage) 100.00% 0.770 1.540 - 0.00% -
433.milc (max) (percentage) 71.25% 0.800 1.370 - 45.74% -
450.soplex (max) (percentage) 70.30% 1.650 2.810 - -7.26% -
433.milc (unexplained diff vs previous) 23.08% 13.000 16.000 0.000 45.45% 0.000
453.povray (avg) (percentage) 18.75% 0.800 0.950 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.87% 7239.000 6959.000 - 0.00% -
462.libquantum -3.27% 12504.000 12095.000 - 0.00% -
453.povray -2.16% 524493.000 513184.000 - 0.00% -
433.milc -1.82% 47001.000 46145.000 - 0.00% -
401.bzip2 -1.76% 33698.000 33105.000 - 0.00% -
444.namd -1.57% 124963.000 122998.000 - 0.00% -
458.sjeng -1.52% 80297.000 79078.000 - -0.09% -
464.h264ref -1.47% 303767.000 299313.000 - -0.04% -
470.lbm -1.14% 9338.000 9232.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.37% 9509.000 60.000 - 1.69% -
462.libquantum -98.76% 14409.000 179.000 - -1.65% -
450.soplex -96.43% 15112.000 539.000 - -1.46% -
482.sphinx3 -96.29% 26682.000 989.000 - -0.60% -
444.namd -93.56% 12400.000 799.000 - -0.37% -
453.povray -92.89% 6987.000 497.000 - 0.00% -
429.mcf -91.86% 13988.000 1138.000 - -0.09% -
433.milc -91.32% 13601.000 1180.000 - 1.37% -
401.bzip2 -82.58% 16137.000 2811.000 - -0.18% -
447.dealII -79.57% 9380.000 1916.000 - -1.29% -
471.omnetpp -72.03% 10477.000 2930.000 - -0.03% -
470.lbm -69.95% 13259.000 3984.000 - 0.08% -
456.hmmer -67.83% 11854.000 3813.000 - 0.18% -
473.astar -62.14% 12272.000 4646.000 - -0.51% -
464.h264ref -59.02% 14498.000 5942.000 - 0.00% -
445.gobmk -56.22% 11093.000 4856.000 - 0.04% -
458.sjeng -52.24% 17055.000 8146.000 - 0.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.82% 2281.000 4.000 - -20.00% -
444.namd (max) -99.80% 1003.000 2.000 - -33.33% -
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
470.lbm (unexplained diff vs previous) -99.63% 804.000 3.000 0.000 -86.36% 0.000
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
456.hmmer (max) -99.36% 1242.000 8.000 - 0.00% -
458.sjeng (max) -99.09% 876.000 8.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.03% 103.000 1.000 0.000 -85.71% 0.000
471.omnetpp (max) -98.77% 972.000 12.000 - -14.29% -
470.lbm (unexplained diff vs previous) (percentage) -98.68% 6.060 0.080 0.000 -85.45% 0.000
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
482.sphinx3 (max) -98.53% 883.000 13.000 - -7.14% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
444.namd -98.11% 318.000 6.000 - 0.00% -
444.namd (avg) -98.11% 318.000 6.000 - 0.00% -
403.gcc -98.08% 52.000 1.000 - 0.00% -
403.gcc (avg) -98.08% 52.000 1.000 - 0.00% -
458.sjeng (max) (percentage) -98.05% 5.140 0.100 - 0.00% -
456.hmmer (max) (percentage) -98.00% 10.480 0.210 - -8.70% -
401.bzip2 (max) -97.87% 609.000 13.000 - 0.00% -
470.lbm (max) -97.63% 758.000 18.000 - -14.29% -
445.gobmk (max) -97.58% 413.000 10.000 - 0.00% -
429.mcf (max) (percentage) -97.36% 16.310 0.430 - -17.31% -
473.astar (max) -97.08% 822.000 24.000 - -7.69% -
471.omnetpp (unexplained diff vs previous) (percentage) -96.94% 0.980 0.030 0.000 -87.50% 0.000
429.mcf (unexplained diff vs previous) -95.45% 22.000 1.000 0.000 -83.33% 0.000
444.namd (max) (percentage) -95.43% 8.090 0.370 - -11.90% -
429.mcf -95.27% 296.000 14.000 - 0.00% -
429.mcf (avg) -95.27% 296.000 14.000 - 0.00% -
471.omnetpp (max) (percentage) -95.26% 9.280 0.440 - -8.33% -
470.lbm -95.01% 441.000 22.000 - 0.00% -
470.lbm (avg) -95.01% 441.000 22.000 - 0.00% -
445.gobmk (max) (percentage) -94.37% 3.730 0.210 - -4.55% -
450.soplex (max) -93.98% 249.000 15.000 - -6.25% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
473.astar (max) (percentage) -92.24% 6.700 0.520 - -7.14% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
470.lbm (max) (percentage) -91.96% 5.720 0.460 - -16.36% -
447.dealII (max) -88.79% 223.000 25.000 - -3.85% -
401.bzip2 -88.46% 104.000 12.000 - 0.00% -
401.bzip2 (avg) -88.46% 104.000 12.000 - 0.00% -
401.bzip2 (max) (percentage) -87.57% 3.780 0.470 - -4.08% -
464.h264ref (max) -86.67% 60.000 8.000 - -11.11% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
433.milc (max) -85.19% 108.000 16.000 - 60.00% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 0.000 -64.29% 0.000
456.hmmer (unexplained diff vs previous) -84.78% 46.000 7.000 0.000 16.67% 0.000
470.lbm (avg) (percentage) -83.18% 3.330 0.560 - -1.75% -
445.gobmk -81.08% 74.000 14.000 - 0.00% -
445.gobmk (avg) -81.08% 74.000 14.000 - 0.00% -
458.sjeng -80.88% 136.000 26.000 - 0.00% -
458.sjeng (avg) -80.88% 136.000 26.000 - 0.00% -
456.hmmer -80.49% 164.000 32.000 - -3.03% -
456.hmmer (avg) -80.49% 164.000 32.000 - -3.03% -
453.povray (max) -80.00% 25.000 5.000 - 0.00% -
473.astar -77.68% 112.000 25.000 - 0.00% -
473.astar (avg) -77.68% 112.000 25.000 - 0.00% -
471.omnetpp -74.85% 167.000 42.000 - 0.00% -
471.omnetpp (avg) -74.85% 167.000 42.000 - 0.00% -
462.libquantum (max) (percentage) -69.91% 6.380 1.920 - -6.80% -
464.h264ref -69.05% 42.000 13.000 - 0.00% -
464.h264ref (avg) -69.05% 42.000 13.000 - 0.00% -
444.namd (avg) (percentage) -66.93% 2.570 0.850 - -1.16% -
464.h264ref (max) (percentage) -66.67% 0.420 0.140 - -12.50% -
444.namd (unexplained diff vs previous) -62.50% 8.000 3.000 0.000 0.00% 0.000
482.sphinx3 (max) (percentage) -58.91% 3.310 1.360 - -4.90% -
458.sjeng (avg) (percentage) -58.75% 0.800 0.330 - 0.00% -
445.gobmk (avg) (percentage) -56.72% 0.670 0.290 - 0.00% -
482.sphinx3 (avg) (percentage) -55.17% 1.740 0.780 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -53.85% 0.390 0.180 0.000 12.50% 0.000
447.dealII (unexplained diff vs previous) -53.70% 54.000 25.000 0.000 47.06% 0.000
429.mcf (unexplained diff vs previous) (percentage) -43.75% 0.160 0.090 0.000 -83.02% 0.000
447.dealII (max) (percentage) -43.28% 2.380 1.350 - -1.46% -
473.astar (avg) (percentage) -41.30% 0.920 0.540 - 0.00% -
429.mcf (avg) (percentage) -40.57% 2.120 1.260 - -1.56% -
456.hmmer (avg) (percentage) -38.13% 1.390 0.860 - -1.15% -
401.bzip2 (avg) (percentage) -33.85% 0.650 0.430 - -2.27% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
433.milc (avg) (percentage) -27.91% 0.860 0.620 - 1.64% -
447.dealII (avg) (percentage) -27.62% 1.050 0.760 - 2.70% -
464.h264ref (avg) (percentage) -24.14% 0.290 0.220 - -4.35% -
401.bzip2 (unexplained diff vs previous) (percentage) -10.00% 0.200 0.180 0.000 -64.00% 0.000
471.omnetpp (avg) (percentage) -10.00% 1.600 1.440 - -1.37% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2811.000 -
403.gcc 60.000 1.69%
429.mcf 1138.000 -
433.milc 1180.000 1.37%
444.namd 799.000 -
445.gobmk 4856.000 -
447.dealII 1916.000 -1.29%
450.soplex 539.000 -1.46%
453.povray 497.000 -
456.hmmer 3813.000 -
458.sjeng 8146.000 -
462.libquantum 179.000 -1.65%
464.h264ref 5942.000 -
470.lbm 3984.000 -
471.omnetpp 2930.000 -
473.astar 4646.000 -
482.sphinx3 989.000 -
Geometric Mean 1481.647 -
Code Size (bytes)
Name Current %
401.bzip2 33105.000 -
403.gcc 1656015.000 -
429.mcf 6959.000 -
433.milc 46145.000 -
444.namd 122998.000 -
445.gobmk 1255901.000 -
447.dealII 195810.000 -
450.soplex 149544.000 -
453.povray 513184.000 -
456.hmmer 80329.000 -
458.sjeng 79078.000 -
462.libquantum 12095.000 -
464.h264ref 299313.000 -
470.lbm 9232.000 -
471.omnetpp 321798.000 -
473.astar 15603.000 -
482.sphinx3 87484.000 -
Geometric Mean 94483.290 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.430 -2.27%
401.bzip2 (max) 13.000 -
401.bzip2 (max) (percentage) 0.470 -4.08%
401.bzip2 (unexplained diff vs previous) 5.000 -64.29%
401.bzip2 (unexplained diff vs previous) (percentage) 0.180 -64.00%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.600 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.390 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.260 -1.56%
429.mcf (max) 4.000 -20.00%
429.mcf (max) (percentage) 0.430 -17.31%
429.mcf (unexplained diff vs previous) 1.000 -83.33%
429.mcf (unexplained diff vs previous) (percentage) 0.090 -83.02%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.620 1.64%
433.milc (max) 16.000 60.00%
433.milc (max) (percentage) 1.370 45.74%
433.milc (unexplained diff vs previous) 16.000 45.45%
433.milc (unexplained diff vs previous) (percentage) 1.360 43.16%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.850 -1.16%
444.namd (max) 2.000 -33.33%
444.namd (max) (percentage) 0.370 -11.90%
444.namd (unexplained diff vs previous) 3.000 -
444.namd (unexplained diff vs previous) (percentage) 0.380 2.70%
445.gobmk 14.000 -
445.gobmk (avg) 14.000 -
445.gobmk (avg) (percentage) 0.290 -
445.gobmk (max) 10.000 -
445.gobmk (max) (percentage) 0.210 -4.55%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.760 2.70%
447.dealII (max) 25.000 -3.85%
447.dealII (max) (percentage) 1.350 -1.46%
447.dealII (unexplained diff vs previous) 25.000 47.06%
447.dealII (unexplained diff vs previous) (percentage) 1.300 47.73%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.270 -
450.soplex (max) 15.000 -6.25%
450.soplex (max) (percentage) 2.810 -7.26%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.950 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.160 -2.52%
456.hmmer 32.000 -3.03%
456.hmmer (avg) 32.000 -3.03%
456.hmmer (avg) (percentage) 0.860 -1.15%
456.hmmer (max) 8.000 -
456.hmmer (max) (percentage) 0.210 -8.70%
456.hmmer (unexplained diff vs previous) 7.000 16.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.180 12.50%
458.sjeng 26.000 -
458.sjeng (avg) 26.000 -
458.sjeng (avg) (percentage) 0.330 -
458.sjeng (max) 8.000 -
458.sjeng (max) (percentage) 0.100 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.540 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.920 -6.80%
462.libquantum (unexplained diff vs previous) 3.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.680 205.45%
464.h264ref 13.000 -
464.h264ref (avg) 13.000 -
464.h264ref (avg) (percentage) 0.220 -4.35%
464.h264ref (max) 8.000 -11.11%
464.h264ref (max) (percentage) 0.140 -12.50%
464.h264ref (unexplained diff vs previous) 0.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.000 -
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.560 -
470.lbm (max) 18.000 -14.29%
470.lbm (max) (percentage) 0.460 -16.36%
470.lbm (unexplained diff vs previous) 3.000 -86.36%
470.lbm (unexplained diff vs previous) (percentage) 0.080 -85.45%
471.omnetpp 42.000 -
471.omnetpp (avg) 42.000 -
471.omnetpp (avg) (percentage) 1.440 -1.37%
471.omnetpp (max) 12.000 -14.29%
471.omnetpp (max) (percentage) 0.440 -8.33%
471.omnetpp (unexplained diff vs previous) 1.000 -85.71%
471.omnetpp (unexplained diff vs previous) (percentage) 0.030 -87.50%
473.astar 25.000 -
473.astar (avg) 25.000 -
473.astar (avg) (percentage) 0.540 -
473.astar (max) 24.000 -7.69%
473.astar (max) (percentage) 0.520 -7.14%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.780 -
482.sphinx3 (max) 13.000 -7.14%
482.sphinx3 (max) (percentage) 1.360 -4.90%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.164 -25.80%