Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/2b9210d1aa9ce9c204b3af0158636c71a5a72e17 (+ 579 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/156/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0156 (llvmorg-19-init-10523-g2b9210d1aa9c) 2024-05-03T15:02:57 0:00:00
Previous 0155 (llvmorg-19-init-09944-g8009bbec59d1) 2024-04-29T22:57:40 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 23
Performance Improvements 34 111
Added Tests 4 4
Unchanged Tests 720 642
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.51% 57.000 59.000 - -99.35% -
462.libquantum 2.13% 94.000 96.000 - -99.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 700.00% 0.020 0.160 0.000 -78.95% 0.000
473.astar (unexplained diff vs previous) 700.00% 1.000 8.000 0.000 -92.59% 0.000
450.soplex (unexplained diff vs previous) (percentage) 152.63% 0.380 0.960 0.000 68.42% 0.000
450.soplex (unexplained diff vs previous) 150.00% 2.000 5.000 0.000 -93.90% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 134.43% 0.610 1.430 0.000 66.28% 0.000
471.omnetpp (unexplained diff vs previous) 129.41% 17.000 39.000 0.000 -57.61% 0.000
433.milc (unexplained diff vs previous) 100.00% 5.000 10.000 0.000 -94.51% 0.000
433.milc (unexplained diff vs previous) (percentage) 100.00% 0.440 0.880 0.000 -34.81% 0.000
444.namd (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 -99.76% 0.000
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.140 0.280 0.000 -95.44% 0.000
471.omnetpp (max) (percentage) 46.87% 0.960 1.410 - -19.89% -
471.omnetpp (max) 46.15% 26.000 38.000 - -79.89% -
433.milc (max) (percentage) 33.85% 0.650 0.870 - -36.50% -
433.milc (max) 28.57% 7.000 9.000 - -95.11% -
470.lbm (unexplained diff vs previous) 27.27% 11.000 14.000 0.000 -97.18% 0.000
470.lbm (unexplained diff vs previous) (percentage) 25.71% 0.350 0.440 0.000 -87.71% 0.000
458.sjeng 3.23% 31.000 32.000 - -66.32% -
458.sjeng (avg) 3.23% 31.000 32.000 - -66.32% -
433.milc (avg) (percentage) 1.64% 0.610 0.620 - -38.61% -
462.libquantum (avg) (percentage) 1.55% 1.290 1.310 - 773.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.41% 2773.000 2734.000 - -74.56% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -51.17% 4.260 2.080 0.000 1633.33% 0.000
462.libquantum (unexplained diff vs previous) -50.00% 4.000 2.000 0.000 -87.50% 0.000
464.h264ref (max) -25.00% 20.000 15.000 - -75.00% -
464.h264ref (max) (percentage) -25.00% 0.360 0.270 - -30.77% -
450.soplex (max) -16.67% 6.000 5.000 - -93.90% -
445.gobmk (max) (percentage) -14.29% 0.070 0.060 - -75.00% -
462.libquantum (max) (percentage) -12.50% 4.080 3.570 - 1685.00% -
482.sphinx3 (max) -12.50% 8.000 7.000 - -99.20% -
444.namd (max) (percentage) -10.14% 0.690 0.620 - -90.52% -
429.mcf (max) -10.00% 10.000 9.000 - -86.57% -
447.dealII -9.09% 11.000 10.000 - -91.67% -
447.dealII (avg) -9.09% 11.000 10.000 - -91.67% -
482.sphinx3 (max) (percentage) -9.09% 0.990 0.900 - -72.89% -
450.soplex (max) (percentage) -8.40% 1.190 1.090 - 91.23% -
447.dealII (max) -7.14% 14.000 13.000 - -89.92% -
429.mcf (max) (percentage) -6.90% 0.870 0.810 - 44.64% -
483.xalancbmk (max) (percentage) -6.25% 0.960 0.900 - 38.46% -
447.dealII (max) (percentage) -6.10% 0.820 0.770 - -51.27% -
470.lbm (max) (percentage) -5.80% 0.690 0.650 - -88.27% -
473.astar (max) (percentage) -5.00% 0.200 0.190 - -76.25% -
429.mcf -4.76% 21.000 20.000 - -62.26% -
429.mcf (avg) -4.76% 21.000 20.000 - -62.26% -
470.lbm (max) -4.76% 21.000 20.000 - -97.40% -
464.h264ref -3.70% 27.000 26.000 - -49.02% -
464.h264ref (avg) -3.70% 27.000 26.000 - -49.02% -
447.dealII (avg) (percentage) -3.23% 0.620 0.600 - -59.18% -
453.povray (max) (percentage) -2.47% 1.620 1.580 - -18.13% -
403.gcc (max) (percentage) -2.38% 2.940 2.870 - 655.26% -
471.omnetpp -2.27% 44.000 43.000 - -48.19% -
471.omnetpp (avg) -2.27% 44.000 43.000 - -48.19% -
464.h264ref (avg) (percentage) -2.04% 0.490 0.480 - 45.45% -
444.namd (avg) (percentage) -1.65% 1.210 1.190 - -68.77% -
429.mcf (avg) (percentage) -1.65% 1.820 1.790 - 297.78% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.50% 39458.000 41629.000 - 0.00% -
450.soplex 1.14% 198708.000 200971.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 1685.00% 0.200 3.570 - -12.50% -
462.libquantum (unexplained diff vs previous) (percentage) 1633.33% 0.120 2.080 0.000 -51.17% 0.000
462.libquantum (avg) (percentage) 773.33% 0.150 1.310 - 1.55% -
403.gcc (max) (percentage) 655.26% 0.380 2.870 - -2.38% -
403.gcc (avg) (percentage) 654.17% 0.480 3.620 - 0.00% -
429.mcf (avg) (percentage) 297.78% 0.450 1.790 - -1.65% -
450.soplex (avg) (percentage) 236.11% 0.360 1.210 - 0.00% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
401.bzip2 (avg) (percentage) 159.09% 0.220 0.570 - 0.00% -
445.gobmk (avg) (percentage) 105.56% 0.180 0.370 - 0.00% -
471.omnetpp (avg) (percentage) 102.56% 0.780 1.580 - -0.63% -
473.astar (avg) (percentage) 102.00% 0.500 1.010 - -0.98% -
450.soplex (max) (percentage) 91.23% 0.570 1.090 - -8.40% -
401.bzip2 (max) (percentage) 90.32% 0.310 0.590 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 90.32% 0.310 0.590 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 68.42% 0.570 0.960 0.000 152.63% 0.000
456.hmmer (avg) (percentage) 66.67% 0.360 0.600 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 66.28% 0.860 1.430 0.000 134.43% 0.000
464.h264ref (avg) (percentage) 45.45% 0.330 0.480 - -2.04% -
429.mcf (max) (percentage) 44.64% 0.560 0.810 - -6.90% -
483.xalancbmk (max) (percentage) 38.46% 0.650 0.900 - -6.25% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.56% 26756.000 23931.000 - 0.00% -
433.milc -2.82% 74971.000 72858.000 - 0.00% -
447.dealII -2.72% 1777992.000 1729667.000 - 0.00% -
453.povray -2.57% 593097.000 577858.000 - -0.01% -
444.namd -1.41% 175160.000 172689.000 - 0.00% -
464.h264ref -1.28% 354618.000 350092.000 - -0.04% -
429.mcf -1.07% 7915.000 7830.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9099.000 59.000 - 3.51% -
462.libquantum -99.27% 13126.000 96.000 - 2.13% -
482.sphinx3 -96.66% 26310.000 879.000 - 0.46% -
450.soplex -96.40% 14429.000 519.000 - -0.95% -
444.namd -94.68% 13495.000 718.000 - -0.28% -
453.povray -93.22% 6857.000 465.000 - -0.21% -
433.milc -91.55% 13482.000 1139.000 - -0.87% -
429.mcf -90.36% 11999.000 1157.000 - -0.17% -
401.bzip2 -82.75% 15683.000 2706.000 - 0.59% -
447.dealII -77.94% 8196.000 1808.000 - 0.00% -
470.lbm -77.18% 13882.000 3168.000 - -0.44% -
471.omnetpp -74.56% 10746.000 2734.000 - -1.41% -
456.hmmer -73.37% 13365.000 3559.000 - -0.03% -
473.astar -65.80% 14262.000 4878.000 - 0.16% -
464.h264ref -64.07% 15493.000 5567.000 - 0.00% -
445.gobmk -58.36% 12400.000 5163.000 - -0.48% -
458.sjeng -49.96% 16406.000 8210.000 - 0.28% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.76% 828.000 2.000 0.000 100.00% 0.000
444.namd (max) -99.55% 882.000 4.000 - 0.00% -
482.sphinx3 (max) -99.20% 873.000 7.000 - -12.50% -
444.namd -98.44% 514.000 8.000 - 0.00% -
444.namd (avg) -98.44% 514.000 8.000 - 0.00% -
482.sphinx3 -98.36% 489.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.36% 489.000 8.000 - 0.00% -
470.lbm (max) -97.40% 769.000 20.000 - -4.76% -
470.lbm (unexplained diff vs previous) -97.18% 497.000 14.000 0.000 27.27% 0.000
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
429.mcf (unexplained diff vs previous) -97.01% 67.000 2.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -95.44% 6.140 0.280 0.000 100.00% 0.000
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc (max) -95.11% 184.000 9.000 - 28.57% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray (max) -94.70% 132.000 7.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
433.milc (unexplained diff vs previous) -94.51% 182.000 10.000 0.000 100.00% 0.000
450.soplex (max) -93.90% 82.000 5.000 - -16.67% -
450.soplex (unexplained diff vs previous) -93.90% 82.000 5.000 0.000 150.00% 0.000
473.astar (unexplained diff vs previous) -92.59% 108.000 8.000 0.000 700.00% 0.000
473.astar (max) -92.11% 114.000 9.000 - 0.00% -
447.dealII -91.67% 120.000 10.000 - -9.09% -
447.dealII (avg) -91.67% 120.000 10.000 - -9.09% -
470.lbm -90.99% 322.000 29.000 - 0.00% -
470.lbm (avg) -90.99% 322.000 29.000 - 0.00% -
444.namd (max) (percentage) -90.52% 6.540 0.620 - -10.14% -
447.dealII (max) -89.92% 129.000 13.000 - -7.14% -
445.gobmk (max) -89.66% 29.000 3.000 - 0.00% -
462.libquantum (max) -88.46% 26.000 3.000 - 0.00% -
470.lbm (max) (percentage) -88.27% 5.540 0.650 - -5.80% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -87.71% 3.580 0.440 0.000 25.71% 0.000
462.libquantum (unexplained diff vs previous) -87.50% 16.000 2.000 0.000 -50.00% 0.000
429.mcf (max) -86.57% 67.000 9.000 - -10.00% -
471.omnetpp (max) -79.89% 189.000 38.000 - 46.15% -
473.astar (unexplained diff vs previous) (percentage) -78.95% 0.760 0.160 0.000 700.00% 0.000
456.hmmer (max) -77.50% 40.000 9.000 - 0.00% -
458.sjeng (max) -76.92% 65.000 15.000 - 0.00% -
473.astar (max) (percentage) -76.25% 0.800 0.190 - -5.00% -
445.gobmk (max) (percentage) -75.00% 0.240 0.060 - -14.29% -
464.h264ref (max) -75.00% 60.000 15.000 - -25.00% -
482.sphinx3 (max) (percentage) -72.89% 3.320 0.900 - -9.09% -
429.mcf (unexplained diff vs previous) (percentage) -69.64% 0.560 0.170 0.000 0.00% 0.000
444.namd (avg) (percentage) -68.77% 3.810 1.190 - -1.65% -
401.bzip2 (max) -68.75% 48.000 15.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -67.35% 49.000 16.000 0.000 0.00% 0.000
458.sjeng -66.32% 95.000 32.000 - 3.23% -
458.sjeng (avg) -66.32% 95.000 32.000 - 3.23% -
429.mcf -62.26% 53.000 20.000 - -4.76% -
429.mcf (avg) -62.26% 53.000 20.000 - -4.76% -
470.lbm (avg) (percentage) -59.91% 2.320 0.930 - -1.06% -
447.dealII (avg) (percentage) -59.18% 1.470 0.600 - -3.23% -
471.omnetpp (unexplained diff vs previous) -57.61% 92.000 39.000 0.000 129.41% 0.000
456.hmmer -56.25% 48.000 21.000 - 0.00% -
456.hmmer (avg) -56.25% 48.000 21.000 - 0.00% -
401.bzip2 -55.88% 34.000 15.000 - 0.00% -
401.bzip2 (avg) -55.88% 34.000 15.000 - 0.00% -
458.sjeng (max) (percentage) -52.50% 0.400 0.190 - 0.00% -
447.dealII (max) (percentage) -51.27% 1.580 0.770 - -6.10% -
464.h264ref -49.02% 51.000 26.000 - -3.70% -
464.h264ref (avg) -49.02% 51.000 26.000 - -3.70% -
471.omnetpp -48.19% 83.000 43.000 - -2.27% -
471.omnetpp (avg) -48.19% 83.000 43.000 - -2.27% -
482.sphinx3 (avg) (percentage) -47.31% 1.860 0.980 - 0.00% -
433.milc (avg) (percentage) -38.61% 1.010 0.620 - 1.64% -
433.milc (max) (percentage) -36.50% 1.370 0.870 - 33.85% -
433.milc (unexplained diff vs previous) (percentage) -34.81% 1.350 0.880 0.000 100.00% 0.000
458.sjeng (avg) (percentage) -32.76% 0.580 0.390 - 0.00% -
473.astar -30.99% 71.000 49.000 - 0.00% -
473.astar (avg) -30.99% 71.000 49.000 - 0.00% -
464.h264ref (max) (percentage) -30.77% 0.390 0.270 - -25.00% -
471.omnetpp (max) (percentage) -19.89% 1.760 1.410 - 46.87% -
453.povray (avg) (percentage) -18.98% 1.370 1.110 - 0.00% -
453.povray (max) (percentage) -18.13% 1.930 1.580 - -2.47% -
445.gobmk -13.64% 22.000 19.000 - 0.00% -
445.gobmk (avg) -13.64% 22.000 19.000 - 0.00% -
456.hmmer (max) (percentage) -13.33% 0.300 0.260 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2706.000 -
403.gcc 59.000 3.51%
429.mcf 1157.000 -
433.milc 1139.000 -
444.namd 718.000 -
445.gobmk 5163.000 -
447.dealII 1808.000 -
450.soplex 519.000 -
453.povray 465.000 -
456.hmmer 3559.000 -
458.sjeng 8210.000 -
462.libquantum 96.000 2.13%
464.h264ref 5567.000 -
470.lbm 3168.000 -
471.omnetpp 2734.000 -1.41%
473.astar 4878.000 -
482.sphinx3 879.000 -
Geometric Mean 1364.631 -
Code Size (bytes)
Name Current %
401.bzip2 41629.000 -
403.gcc 1956137.000 -
429.mcf 7830.000 -
433.milc 72858.000 -
444.namd 172689.000 -
445.gobmk 1308600.000 -
447.dealII 1729667.000 -
450.soplex 200971.000 -
453.povray 577858.000 -
456.hmmer 167610.000 -
458.sjeng 96853.000 -
462.libquantum 23931.000 -
464.h264ref 350092.000 -
470.lbm 9702.000 -
471.omnetpp 376439.000 -
473.astar 23315.000 -
482.sphinx3 115247.000 -
Geometric Mean 139342.098 -
sample variability
Name Current %
401.bzip2 15.000 -
401.bzip2 (avg) 15.000 -
401.bzip2 (avg) (percentage) 0.570 -
401.bzip2 (max) 15.000 -
401.bzip2 (max) (percentage) 0.590 -
401.bzip2 (unexplained diff vs previous) 16.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.590 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.620 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.870 -2.38%
429.mcf 20.000 -4.76%
429.mcf (avg) 20.000 -4.76%
429.mcf (avg) (percentage) 1.790 -1.65%
429.mcf (max) 9.000 -10.00%
429.mcf (max) (percentage) 0.810 -6.90%
429.mcf (unexplained diff vs previous) 2.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.170 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.620 1.64%
433.milc (max) 9.000 28.57%
433.milc (max) (percentage) 0.870 33.85%
433.milc (unexplained diff vs previous) 10.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.880 100.00%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.190 -1.65%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.620 -10.14%
444.namd (unexplained diff vs previous) 2.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.280 100.00%
445.gobmk 19.000 -
445.gobmk (avg) 19.000 -
445.gobmk (avg) (percentage) 0.370 -
445.gobmk (max) 3.000 -
445.gobmk (max) (percentage) 0.060 -14.29%
447.dealII 10.000 -9.09%
447.dealII (avg) 10.000 -9.09%
447.dealII (avg) (percentage) 0.600 -3.23%
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 0.770 -6.10%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.210 -
450.soplex (max) 5.000 -16.67%
450.soplex (max) (percentage) 1.090 -8.40%
450.soplex (unexplained diff vs previous) 5.000 150.00%
450.soplex (unexplained diff vs previous) (percentage) 0.960 152.63%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.110 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.580 -2.47%
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.600 -
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.260 -
458.sjeng 32.000 3.23%
458.sjeng (avg) 32.000 3.23%
458.sjeng (avg) (percentage) 0.390 -
458.sjeng (max) 15.000 -
458.sjeng (max) (percentage) 0.190 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.310 1.55%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.570 -12.50%
462.libquantum (unexplained diff vs previous) 2.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.080 -51.17%
464.h264ref 26.000 -3.70%
464.h264ref (avg) 26.000 -3.70%
464.h264ref (avg) (percentage) 0.480 -2.04%
464.h264ref (max) 15.000 -25.00%
464.h264ref (max) (percentage) 0.270 -25.00%
464.h264ref (unexplained diff vs previous) 0.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.000 -
470.lbm 29.000 -
470.lbm (avg) 29.000 -
470.lbm (avg) (percentage) 0.930 -
470.lbm (max) 20.000 -4.76%
470.lbm (max) (percentage) 0.650 -5.80%
470.lbm (unexplained diff vs previous) 14.000 27.27%
470.lbm (unexplained diff vs previous) (percentage) 0.440 25.71%
471.omnetpp 43.000 -2.27%
471.omnetpp (avg) 43.000 -2.27%
471.omnetpp (avg) (percentage) 1.580 -
471.omnetpp (max) 38.000 46.15%
471.omnetpp (max) (percentage) 1.410 46.87%
471.omnetpp (unexplained diff vs previous) 39.000 129.41%
471.omnetpp (unexplained diff vs previous) (percentage) 1.430 134.43%
473.astar 49.000 -
473.astar (avg) 49.000 -
473.astar (avg) (percentage) 1.010 -
473.astar (max) 9.000 -
473.astar (max) (percentage) 0.190 -5.00%
473.astar (unexplained diff vs previous) 8.000 700.00%
473.astar (unexplained diff vs previous) (percentage) 0.160 700.00%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.980 -
482.sphinx3 (max) 7.000 -12.50%
482.sphinx3 (max) (percentage) 0.900 -9.09%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.900 -6.25%
Geometric Mean 2.177 -26.00%