Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/cddb9ce04e68d876de895d39d60b6af34d569012 (+ 412 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/153/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0153 (llvmorg-19-init-14525-gcddb9ce04e68) 2024-06-10T04:14:52 0:00:00
Previous 0152 (llvmorg-19-init-14113-g7e5bc71514c7) 2024-06-05T04:40:31 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 19
Performance Improvements 43 117
Added Tests 8 4
Unchanged Tests 699 628
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.72% 58.000 59.000 - -99.38% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 850.00% 0.020 0.190 0.000 -5.00% 0.000
473.astar (unexplained diff vs previous) 800.00% 1.000 9.000 0.000 -64.00% 0.000
429.mcf (max) 260.00% 5.000 18.000 - -99.21% -
429.mcf (max) (percentage) 236.73% 0.490 1.650 - -89.88% -
456.hmmer (unexplained diff vs previous) (percentage) 123.08% 0.130 0.290 0.000 -25.64% 0.000
456.hmmer (unexplained diff vs previous) 120.00% 5.000 11.000 0.000 -76.09% 0.000
433.milc (max) (percentage) 85.94% 0.640 1.190 - 48.75% -
433.milc (max) 85.71% 7.000 13.000 - -87.96% -
471.omnetpp (unexplained diff vs previous) (percentage) 56.76% 0.740 1.160 0.000 18.37% 0.000
471.omnetpp (unexplained diff vs previous) 54.55% 22.000 34.000 0.000 -66.99% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 54.17% 0.240 0.370 0.000 0.00% 0.000
458.sjeng (max) 52.63% 19.000 29.000 - -96.69% -
458.sjeng (max) (percentage) 50.00% 0.240 0.360 - -93.00% -
458.sjeng (unexplained diff vs previous) 50.00% 20.000 30.000 0.000 0.00% 0.000
482.sphinx3 14.29% 7.000 8.000 - -98.28% -
482.sphinx3 (avg) 14.29% 7.000 8.000 - -98.28% -
433.milc (avg) (percentage) 3.23% 0.620 0.640 - -25.58% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -1.65% 1149.000 1130.000 - -91.92% -
462.libquantum -1.65% 182.000 179.000 - -98.76% -
433.milc -1.19% 1178.000 1164.000 - -91.44% -
471.omnetpp -1.14% 2971.000 2937.000 - -71.97% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -85.71% 0.350 0.050 0.000 -99.17% 0.000
470.lbm (unexplained diff vs previous) -85.71% 14.000 2.000 0.000 -99.75% 0.000
447.dealII (unexplained diff vs previous) -50.00% 30.000 15.000 0.000 -72.22% 0.000
447.dealII (unexplained diff vs previous) (percentage) -49.35% 1.540 0.780 0.000 34.48% 0.000
464.h264ref (unexplained diff vs previous) -46.15% 13.000 7.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -45.45% 0.220 0.120 0.000 0.00% 0.000
464.h264ref (max) (percentage) -24.00% 0.250 0.190 - -54.76% -
464.h264ref (max) -21.43% 14.000 11.000 - -81.67% -
462.libquantum (max) -20.00% 5.000 4.000 - -99.56% -
447.dealII (max) -16.67% 30.000 25.000 - -88.79% -
447.dealII (max) (percentage) -16.67% 1.560 1.300 - -45.38% -
470.lbm (max) -13.33% 15.000 13.000 - -98.28% -
470.lbm (max) (percentage) -13.16% 0.380 0.330 - -94.23% -
445.gobmk (max) -7.69% 13.000 12.000 - -97.09% -
482.sphinx3 (max) -7.14% 14.000 13.000 - -98.53% -
473.astar (max) -6.67% 15.000 14.000 - -98.30% -
471.omnetpp (max) (percentage) -6.60% 2.120 1.980 - -78.66% -
471.omnetpp (max) -6.45% 62.000 58.000 - -94.03% -
401.bzip2 (max) -6.25% 16.000 15.000 - -97.54% -
473.astar (max) (percentage) -5.88% 0.340 0.320 - -95.22% -
429.mcf -5.88% 17.000 16.000 - -94.59% -
429.mcf (avg) -5.88% 17.000 16.000 - -94.59% -
456.hmmer (max) -5.88% 17.000 16.000 - -98.71% -
401.bzip2 (max) (percentage) -5.26% 0.570 0.540 - -85.71% -
456.hmmer (max) (percentage) -4.35% 0.460 0.440 - -95.80% -
445.gobmk (max) (percentage) -3.70% 0.270 0.260 - -93.03% -
450.soplex (max) (percentage) -3.61% 2.490 2.400 - 45.45% -
470.lbm -3.57% 28.000 27.000 - -93.88% -
470.lbm (avg) -3.57% 28.000 27.000 - -93.88% -
462.libquantum (max) (percentage) -3.55% 2.820 2.720 - -57.37% -
482.sphinx3 (max) (percentage) -3.50% 1.430 1.380 - -58.31% -
453.povray (max) (percentage) -3.16% 0.950 0.920 - 155.56% -
470.lbm (avg) (percentage) -2.86% 0.700 0.680 - -79.58% -
444.namd (avg) (percentage) -2.13% 0.940 0.920 - -64.20% -
471.omnetpp -2.08% 48.000 47.000 - -71.86% -
471.omnetpp (avg) -2.08% 48.000 47.000 - -71.86% -
473.astar (avg) (percentage) -1.64% 0.610 0.600 - -34.78% -
403.gcc (max) (percentage) -1.29% 6.220 6.140 - 163.52% -
444.namd (max) (percentage) -1.28% 0.780 0.770 - -90.48% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.88% 146765.000 149520.000 - -0.01% -
471.omnetpp 1.66% 316676.000 321918.000 - -0.15% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 16700.00% 0.010 1.680 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 1100.00% 0.100 1.200 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 950.00% 0.160 1.680 0.000 0.00% 0.000
403.gcc (avg) (percentage) 387.27% 0.550 2.680 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 0.00% 0.000
450.soplex (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
403.gcc (max) (percentage) 163.52% 2.330 6.140 - -1.29% -
453.povray (max) (percentage) 155.56% 0.360 0.920 - -3.16% -
462.libquantum (avg) (percentage) 106.49% 0.770 1.590 - 0.00% -
433.milc (max) (percentage) 48.75% 0.800 1.190 - 85.94% -
450.soplex (max) (percentage) 45.45% 1.650 2.400 - -3.61% -
447.dealII (unexplained diff vs previous) (percentage) 34.48% 0.580 0.780 0.000 -49.35% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 18.37% 0.980 1.160 0.000 56.76% 0.000
453.povray (avg) (percentage) 13.75% 0.800 0.910 - 0.00% -
433.milc (unexplained diff vs previous) 7.69% 13.000 14.000 0.000 0.00% 0.000
471.omnetpp (avg) (percentage) 1.25% 1.600 1.620 - -0.61% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.87% 7239.000 6959.000 - 0.00% -
462.libquantum -2.95% 12504.000 12135.000 - 0.00% -
453.povray -2.14% 524493.000 513264.000 - -0.00% -
401.bzip2 -1.74% 33698.000 33113.000 - 0.02% -
433.milc -1.70% 47001.000 46201.000 - 0.00% -
464.h264ref -1.57% 303767.000 299009.000 - 0.01% -
444.namd -1.50% 124963.000 123090.000 - 0.00% -
458.sjeng -1.26% 80297.000 79286.000 - 0.00% -
470.lbm -1.14% 9338.000 9232.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9509.000 59.000 - 1.72% -
462.libquantum -98.76% 14409.000 179.000 - -1.65% -
450.soplex -96.41% 15112.000 542.000 - 0.93% -
482.sphinx3 -96.29% 26682.000 990.000 - 0.71% -
444.namd -93.52% 12400.000 804.000 - 0.25% -
453.povray -92.87% 6987.000 498.000 - 0.00% -
429.mcf -91.92% 13988.000 1130.000 - -1.65% -
433.milc -91.44% 13601.000 1164.000 - -1.19% -
401.bzip2 -82.36% 16137.000 2847.000 - 0.96% -
447.dealII -79.37% 9380.000 1935.000 - -0.77% -
471.omnetpp -71.97% 10477.000 2937.000 - -1.14% -
470.lbm -69.78% 13259.000 4007.000 - -0.05% -
456.hmmer -67.78% 11854.000 3819.000 - 0.29% -
473.astar -61.86% 12272.000 4681.000 - 0.19% -
464.h264ref -59.42% 14498.000 5883.000 - 0.12% -
445.gobmk -56.20% 11093.000 4859.000 - -0.69% -
458.sjeng -51.94% 17055.000 8197.000 - -0.36% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.75% 804.000 2.000 0.000 -85.71% 0.000
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
462.libquantum (max) -99.56% 919.000 4.000 - -20.00% -
444.namd (max) -99.40% 1003.000 6.000 - 0.00% -
429.mcf (max) -99.21% 2281.000 18.000 - 260.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.17% 6.060 0.050 0.000 -85.71% 0.000
456.hmmer (max) -98.71% 1242.000 16.000 - -5.88% -
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
482.sphinx3 (max) -98.53% 883.000 13.000 - -7.14% -
473.astar (max) -98.30% 822.000 14.000 - -6.67% -
470.lbm (max) -98.28% 758.000 13.000 - -13.33% -
482.sphinx3 -98.28% 464.000 8.000 - 14.29% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 14.29% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc -98.08% 52.000 1.000 - 0.00% -
403.gcc (avg) -98.08% 52.000 1.000 - 0.00% -
444.namd -97.80% 318.000 7.000 - 0.00% -
444.namd (avg) -97.80% 318.000 7.000 - 0.00% -
401.bzip2 (max) -97.54% 609.000 15.000 - -6.25% -
445.gobmk (max) -97.09% 413.000 12.000 - -7.69% -
458.sjeng (max) -96.69% 876.000 29.000 - 52.63% -
456.hmmer (max) (percentage) -95.80% 10.480 0.440 - -4.35% -
473.astar (max) (percentage) -95.22% 6.700 0.320 - -5.88% -
450.soplex (max) -94.78% 249.000 13.000 - 0.00% -
429.mcf -94.59% 296.000 16.000 - -5.88% -
429.mcf (avg) -94.59% 296.000 16.000 - -5.88% -
470.lbm (max) (percentage) -94.23% 5.720 0.330 - -13.16% -
471.omnetpp (max) -94.03% 972.000 58.000 - -6.45% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
470.lbm -93.88% 441.000 27.000 - -3.57% -
470.lbm (avg) -93.88% 441.000 27.000 - -3.57% -
445.gobmk (max) (percentage) -93.03% 3.730 0.260 - -3.70% -
458.sjeng (max) (percentage) -93.00% 5.140 0.360 - 50.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
444.namd (max) (percentage) -90.48% 8.090 0.770 - -1.28% -
429.mcf (max) (percentage) -89.88% 16.310 1.650 - 236.73% -
447.dealII (max) -88.79% 223.000 25.000 - -16.67% -
433.milc (max) -87.96% 108.000 13.000 - 85.71% -
447.dealII -87.76% 98.000 12.000 - 0.00% -
447.dealII (avg) -87.76% 98.000 12.000 - 0.00% -
401.bzip2 -87.50% 104.000 13.000 - 0.00% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 0.00% -
401.bzip2 (max) (percentage) -85.71% 3.780 0.540 - -5.26% -
453.povray (max) -84.00% 25.000 4.000 - 0.00% -
464.h264ref (max) -81.67% 60.000 11.000 - -21.43% -
445.gobmk -79.73% 74.000 15.000 - 0.00% -
445.gobmk (avg) -79.73% 74.000 15.000 - 0.00% -
470.lbm (avg) (percentage) -79.58% 3.330 0.680 - -2.86% -
471.omnetpp (max) (percentage) -78.66% 9.280 1.980 - -6.60% -
458.sjeng -77.94% 136.000 30.000 - 0.00% -
458.sjeng (avg) -77.94% 136.000 30.000 - 0.00% -
456.hmmer -76.22% 164.000 39.000 - 0.00% -
456.hmmer (avg) -76.22% 164.000 39.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -76.09% 46.000 11.000 0.000 120.00% 0.000
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 0.000 0.00% 0.000
473.astar -75.00% 112.000 28.000 - 0.00% -
473.astar (avg) -75.00% 112.000 28.000 - 0.00% -
447.dealII (unexplained diff vs previous) -72.22% 54.000 15.000 0.000 -50.00% 0.000
471.omnetpp -71.86% 167.000 47.000 - -2.08% -
471.omnetpp (avg) -71.86% 167.000 47.000 - -2.08% -
471.omnetpp (unexplained diff vs previous) -66.99% 103.000 34.000 0.000 54.55% 0.000
464.h264ref -64.29% 42.000 15.000 - 0.00% -
464.h264ref (avg) -64.29% 42.000 15.000 - 0.00% -
444.namd (avg) (percentage) -64.20% 2.570 0.920 - -2.13% -
473.astar (unexplained diff vs previous) -64.00% 25.000 9.000 0.000 800.00% 0.000
482.sphinx3 (max) (percentage) -58.31% 3.310 1.380 - -3.50% -
462.libquantum (max) (percentage) -57.37% 6.380 2.720 - -3.55% -
464.h264ref (max) (percentage) -54.76% 0.420 0.190 - -24.00% -
458.sjeng (avg) (percentage) -53.75% 0.800 0.370 - 0.00% -
445.gobmk (avg) (percentage) -53.73% 0.670 0.310 - 0.00% -
482.sphinx3 (avg) (percentage) -53.45% 1.740 0.810 - 0.00% -
447.dealII (max) (percentage) -45.38% 2.380 1.300 - -16.67% -
447.dealII (avg) (percentage) -37.14% 1.050 0.660 - 0.00% -
473.astar (avg) (percentage) -34.78% 0.920 0.600 - -1.64% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
429.mcf (avg) (percentage) -29.72% 2.120 1.490 - 0.00% -
401.bzip2 (avg) (percentage) -27.69% 0.650 0.470 - 0.00% -
456.hmmer (avg) (percentage) -25.90% 1.390 1.030 - -0.96% -
456.hmmer (unexplained diff vs previous) (percentage) -25.64% 0.390 0.290 0.000 123.08% 0.000
433.milc (avg) (percentage) -25.58% 0.860 0.640 - 3.23% -
429.mcf (unexplained diff vs previous) -13.64% 22.000 19.000 0.000 0.00% 0.000
464.h264ref (avg) (percentage) -6.90% 0.290 0.270 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -5.00% 0.200 0.190 0.000 850.00% 0.000

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2847.000 -
403.gcc 59.000 1.72%
429.mcf 1130.000 -1.65%
433.milc 1164.000 -1.19%
444.namd 804.000 -
445.gobmk 4859.000 -
447.dealII 1935.000 -
450.soplex 542.000 -
453.povray 498.000 -
456.hmmer 3819.000 -
458.sjeng 8197.000 -
462.libquantum 179.000 -1.65%
464.h264ref 5883.000 -
470.lbm 4007.000 -
471.omnetpp 2937.000 -1.14%
473.astar 4681.000 -
482.sphinx3 990.000 -
Geometric Mean 1482.867 -
Code Size (bytes)
Name Current %
401.bzip2 33113.000 -
403.gcc 1656535.000 -
429.mcf 6959.000 -
433.milc 46201.000 -
444.namd 123090.000 -
445.gobmk 1255885.000 -
447.dealII 195974.000 -
450.soplex 149520.000 -
453.povray 513264.000 -
456.hmmer 80353.000 -
458.sjeng 79286.000 -
462.libquantum 12135.000 -
464.h264ref 299009.000 -
470.lbm 9232.000 -
471.omnetpp 321918.000 -
473.astar 15563.000 -
482.sphinx3 87400.000 -
Geometric Mean 94513.265 -
sample variability
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.470 -
401.bzip2 (max) 15.000 -6.25%
401.bzip2 (max) (percentage) 0.540 -5.26%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.680 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.140 -1.29%
429.mcf 16.000 -5.88%
429.mcf (avg) 16.000 -5.88%
429.mcf (avg) (percentage) 1.490 -
429.mcf (max) 18.000 260.00%
429.mcf (max) (percentage) 1.650 236.73%
429.mcf (unexplained diff vs previous) 19.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.680 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 3.23%
433.milc (max) 13.000 85.71%
433.milc (max) (percentage) 1.190 85.94%
433.milc (unexplained diff vs previous) 14.000 -
433.milc (unexplained diff vs previous) (percentage) 1.200 -
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 0.920 -2.13%
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.770 -1.28%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.250 -
445.gobmk 15.000 -
445.gobmk (avg) 15.000 -
445.gobmk (avg) (percentage) 0.310 -
445.gobmk (max) 12.000 -7.69%
445.gobmk (max) (percentage) 0.260 -3.70%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.660 -
447.dealII (max) 25.000 -16.67%
447.dealII (max) (percentage) 1.300 -16.67%
447.dealII (unexplained diff vs previous) 15.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.780 -49.35%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.330 -
450.soplex (max) 13.000 -
450.soplex (max) (percentage) 2.400 -3.61%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.910 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.920 -3.16%
456.hmmer 39.000 -
456.hmmer (avg) 39.000 -
456.hmmer (avg) (percentage) 1.030 -
456.hmmer (max) 16.000 -5.88%
456.hmmer (max) (percentage) 0.440 -4.35%
456.hmmer (unexplained diff vs previous) 11.000 120.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.290 123.08%
458.sjeng 30.000 -
458.sjeng (avg) 30.000 -
458.sjeng (avg) (percentage) 0.370 -
458.sjeng (max) 29.000 52.63%
458.sjeng (max) (percentage) 0.360 50.00%
458.sjeng (unexplained diff vs previous) 30.000 50.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.370 54.17%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.590 -
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 2.720 -3.55%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.680 -
464.h264ref 15.000 -
464.h264ref (avg) 15.000 -
464.h264ref (avg) (percentage) 0.270 -
464.h264ref (max) 11.000 -21.43%
464.h264ref (max) (percentage) 0.190 -24.00%
464.h264ref (unexplained diff vs previous) 7.000 -46.15%
464.h264ref (unexplained diff vs previous) (percentage) 0.120 -45.45%
470.lbm 27.000 -3.57%
470.lbm (avg) 27.000 -3.57%
470.lbm (avg) (percentage) 0.680 -2.86%
470.lbm (max) 13.000 -13.33%
470.lbm (max) (percentage) 0.330 -13.16%
470.lbm (unexplained diff vs previous) 2.000 -85.71%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -85.71%
471.omnetpp 47.000 -2.08%
471.omnetpp (avg) 47.000 -2.08%
471.omnetpp (avg) (percentage) 1.620 -
471.omnetpp (max) 58.000 -6.45%
471.omnetpp (max) (percentage) 1.980 -6.60%
471.omnetpp (unexplained diff vs previous) 34.000 54.55%
471.omnetpp (unexplained diff vs previous) (percentage) 1.160 56.76%
473.astar 28.000 -
473.astar (avg) 28.000 -
473.astar (avg) (percentage) 0.600 -1.64%
473.astar (max) 14.000 -6.67%
473.astar (max) (percentage) 0.320 -5.88%
473.astar (unexplained diff vs previous) 9.000 800.00%
473.astar (unexplained diff vs previous) (percentage) 0.190 850.00%
482.sphinx3 8.000 14.29%
482.sphinx3 (avg) 8.000 14.29%
482.sphinx3 (avg) (percentage) 0.810 -
482.sphinx3 (max) 13.000 -7.14%
482.sphinx3 (max) (percentage) 1.380 -3.50%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 3.302 1.23%