Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3641efcf8cb256ddbd20f4add5ce55800cad5399 (+ 694 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/158/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0158 (llvmorg-19-init-16349-g3641efcf8cb2) 2024-06-28T13:17:27 0:00:00
Previous 0157 (llvmorg-19-init-15655-gc791d86eab13) 2024-06-24T00:10:02 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 17
Performance Improvements 42 122
Added Tests 6 4
Unchanged Tests 698 625
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.22% 180.000 184.000 - -98.72% -
447.dealII 1.65% 1944.000 1976.000 - -78.93% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) 510.00% 0.100 0.610 0.000 -82.22% 0.000
482.sphinx3 (unexplained diff vs previous) 500.00% 1.000 6.000 0.000 -99.34% 0.000
473.astar (unexplained diff vs previous) 160.00% 5.000 13.000 0.000 -48.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 154.55% 0.110 0.280 0.000 40.00% 0.000
444.namd (max) (percentage) 100.00% 0.740 1.480 - -81.71% -
444.namd (max) 83.33% 6.000 11.000 - -98.90% -
482.sphinx3 (max) 50.00% 4.000 6.000 - -99.32% -
482.sphinx3 (max) (percentage) 38.64% 0.440 0.610 - -81.57% -
456.hmmer (unexplained diff vs previous) (percentage) 33.33% 0.180 0.240 0.000 -38.46% 0.000
456.hmmer (unexplained diff vs previous) 28.57% 7.000 9.000 0.000 -80.43% 0.000
464.h264ref (unexplained diff vs previous) 25.00% 4.000 5.000 0.000 0.00% 0.000
456.hmmer (max) 12.50% 8.000 9.000 - -99.28% -
445.gobmk (unexplained diff vs previous) 10.00% 10.000 11.000 0.000 -72.50% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 9.52% 0.210 0.230 0.000 -36.11% 0.000
401.bzip2 8.33% 12.000 13.000 - -87.50% -
401.bzip2 (avg) 8.33% 12.000 13.000 - -87.50% -
447.dealII 7.69% 13.000 14.000 - -85.71% -
447.dealII (avg) 7.69% 13.000 14.000 - -85.71% -
447.dealII (avg) (percentage) 4.17% 0.720 0.750 - -28.57% -
444.namd (avg) (percentage) 2.22% 0.900 0.920 - -64.20% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.67% 60.000 59.000 - -99.38% -
444.namd -1.48% 812.000 800.000 - -93.55% -
453.povray -1.40% 501.000 494.000 - -92.93% -
471.omnetpp -1.32% 2955.000 2916.000 - -72.17% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -83.33% 18.000 3.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -81.82% 0.220 0.040 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -54.12% 85.000 39.000 0.000 -62.14% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -53.47% 2.880 1.340 0.000 36.73% 0.000
470.lbm (unexplained diff vs previous) -35.71% 14.000 9.000 0.000 -98.88% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -34.83% 3.330 2.170 0.000 21600.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -34.29% 0.350 0.230 0.000 -96.20% 0.000
462.libquantum (unexplained diff vs previous) -33.33% 6.000 4.000 0.000 300.00% 0.000
458.sjeng (max) -28.57% 21.000 15.000 - -98.29% -
458.sjeng (max) (percentage) -26.92% 0.260 0.190 - -96.30% -
453.povray (max) -14.29% 7.000 6.000 - -76.00% -
471.omnetpp (max) -13.79% 87.000 75.000 - -92.28% -
447.dealII (max) (percentage) -13.79% 2.030 1.750 - -26.47% -
447.dealII (max) -12.82% 39.000 34.000 - -84.75% -
471.omnetpp (max) (percentage) -12.50% 2.960 2.590 - -72.09% -
429.mcf (max) -12.50% 8.000 7.000 - -99.69% -
462.libquantum (max) (percentage) -12.38% 3.230 2.830 - -55.64% -
470.lbm (max) (percentage) -11.43% 0.350 0.310 - -94.58% -
401.bzip2 (max) -9.09% 11.000 10.000 - -98.36% -
470.lbm (max) -7.69% 13.000 12.000 - -98.42% -
473.astar (max) -6.67% 15.000 14.000 - -98.30% -
450.soplex (max) (percentage) -6.35% 1.260 1.180 - -28.48% -
473.astar (max) (percentage) -5.88% 0.340 0.320 - -95.22% -
445.gobmk (max) -5.26% 19.000 18.000 - -95.64% -
401.bzip2 (max) (percentage) -5.13% 0.390 0.370 - -90.21% -
445.gobmk (max) (percentage) -5.00% 0.400 0.380 - -89.81% -
429.mcf (max) (percentage) -4.11% 0.730 0.700 - -95.71% -
458.sjeng -3.45% 29.000 28.000 - -79.41% -
458.sjeng (avg) -3.45% 29.000 28.000 - -79.41% -
453.povray (max) (percentage) -2.82% 1.420 1.380 - 283.33% -
458.sjeng (avg) (percentage) -2.78% 0.360 0.350 - -56.25% -
433.milc (max) (percentage) -2.53% 0.790 0.770 - -3.75% -
471.omnetpp -2.13% 47.000 46.000 - -72.46% -
471.omnetpp (avg) -2.13% 47.000 46.000 - -72.46% -
470.lbm (avg) (percentage) -1.56% 0.640 0.630 - -81.08% -
429.mcf (avg) (percentage) -1.40% 1.430 1.410 - -33.49% -
456.hmmer (avg) (percentage) -1.03% 0.970 0.960 - -30.94% -
403.gcc (max) (percentage) -1.03% 5.850 5.790 - 148.50% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.88% 146765.000 149528.000 - -0.01% -
471.omnetpp 1.65% 316676.000 321910.000 - -0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21600.00% 0.010 2.170 0.000 -34.83% 0.000
444.namd (unexplained diff vs previous) (percentage) 2400.00% 0.060 1.500 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 580.00% 0.100 0.680 0.000 0.00% 0.000
403.gcc (avg) (percentage) 387.27% 0.550 2.680 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 337.50% 0.160 0.700 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 0.000 -33.33% 0.000
453.povray (max) (percentage) 283.33% 0.360 1.380 - -2.82% -
447.dealII (unexplained diff vs previous) (percentage) 179.31% 0.580 1.620 0.000 0.00% 0.000
450.soplex (avg) (percentage) 160.00% 0.500 1.300 - 0.00% -
403.gcc (max) (percentage) 148.50% 2.330 5.790 - -1.03% -
462.libquantum (avg) (percentage) 110.39% 0.770 1.620 - 0.62% -
444.namd (unexplained diff vs previous) 50.00% 8.000 12.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 40.00% 0.200 0.280 0.000 154.55% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 36.73% 0.980 1.340 0.000 -53.47% 0.000
453.povray (avg) (percentage) 16.25% 0.800 0.930 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.87% 7239.000 6959.000 - 0.00% -
462.libquantum -3.27% 12504.000 12095.000 - 0.00% -
453.povray -2.17% 524493.000 513136.000 - 0.00% -
444.namd -1.99% 124963.000 122474.000 - 0.00% -
433.milc -1.82% 47001.000 46145.000 - 0.00% -
401.bzip2 -1.74% 33698.000 33113.000 - 0.02% -
464.h264ref -1.35% 303767.000 299657.000 - 0.00% -
458.sjeng -1.34% 80297.000 79222.000 - 0.00% -
470.lbm -1.14% 9338.000 9232.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9509.000 59.000 - -1.67% -
462.libquantum -98.72% 14409.000 184.000 - 2.22% -
450.soplex -96.39% 15112.000 545.000 - 0.93% -
482.sphinx3 -96.31% 26682.000 985.000 - -0.61% -
444.namd -93.55% 12400.000 800.000 - -1.48% -
453.povray -92.93% 6987.000 494.000 - -1.40% -
429.mcf -91.89% 13988.000 1135.000 - -0.70% -
433.milc -91.40% 13601.000 1170.000 - -0.68% -
401.bzip2 -82.41% 16137.000 2839.000 - 0.53% -
447.dealII -78.93% 9380.000 1976.000 - 1.65% -
471.omnetpp -72.17% 10477.000 2916.000 - -1.32% -
470.lbm -69.83% 13259.000 4000.000 - 0.23% -
456.hmmer -67.86% 11854.000 3810.000 - 0.24% -
473.astar -61.95% 12272.000 4669.000 - -0.28% -
464.h264ref -58.95% 14498.000 5951.000 - -0.08% -
445.gobmk -56.15% 11093.000 4864.000 - -0.23% -
458.sjeng -51.67% 17055.000 8242.000 - 0.04% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.69% 2281.000 7.000 - -12.50% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.34% 914.000 6.000 0.000 500.00% 0.000
482.sphinx3 (max) -99.32% 883.000 6.000 - 50.00% -
456.hmmer (max) -99.28% 1242.000 9.000 - 12.50% -
444.namd (max) -98.90% 1003.000 11.000 - 83.33% -
470.lbm (unexplained diff vs previous) -98.88% 804.000 9.000 0.000 -35.71% 0.000
403.gcc (max) -98.64% 221.000 3.000 - 0.00% -
482.sphinx3 -98.49% 464.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - 0.00% -
470.lbm (max) -98.42% 758.000 12.000 - -7.69% -
401.bzip2 (max) -98.36% 609.000 10.000 - -9.09% -
473.astar (max) -98.30% 822.000 14.000 - -6.67% -
458.sjeng (max) -98.29% 876.000 15.000 - -28.57% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc -98.08% 52.000 1.000 - 0.00% -
403.gcc (avg) -98.08% 52.000 1.000 - 0.00% -
444.namd -97.80% 318.000 7.000 - 0.00% -
444.namd (avg) -97.80% 318.000 7.000 - 0.00% -
456.hmmer (max) (percentage) -97.71% 10.480 0.240 - 4.35% -
450.soplex (max) -97.59% 249.000 6.000 - 0.00% -
458.sjeng (max) (percentage) -96.30% 5.140 0.190 - -26.92% -
470.lbm (unexplained diff vs previous) (percentage) -96.20% 6.060 0.230 0.000 -34.29% 0.000
429.mcf (max) (percentage) -95.71% 16.310 0.700 - -4.11% -
445.gobmk (max) -95.64% 413.000 18.000 - -5.26% -
473.astar (max) (percentage) -95.22% 6.700 0.320 - -5.88% -
429.mcf -94.59% 296.000 16.000 - 0.00% -
429.mcf (avg) -94.59% 296.000 16.000 - 0.00% -
470.lbm (max) (percentage) -94.58% 5.720 0.310 - -11.43% -
470.lbm -94.33% 441.000 25.000 - 0.00% -
470.lbm (avg) -94.33% 441.000 25.000 - 0.00% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
471.omnetpp (max) -92.28% 972.000 75.000 - -13.79% -
433.milc (max) -91.67% 108.000 9.000 - 0.00% -
464.h264ref (max) -91.67% 60.000 5.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
401.bzip2 (max) (percentage) -90.21% 3.780 0.370 - -5.13% -
445.gobmk (max) (percentage) -89.81% 3.730 0.380 - -5.00% -
401.bzip2 -87.50% 104.000 13.000 - 8.33% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 8.33% -
447.dealII -85.71% 98.000 14.000 - 7.69% -
447.dealII (avg) -85.71% 98.000 14.000 - 7.69% -
447.dealII (max) -84.75% 223.000 34.000 - -12.82% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.22% 3.430 0.610 0.000 510.00% 0.000
444.namd (max) (percentage) -81.71% 8.090 1.480 - 100.00% -
482.sphinx3 (max) (percentage) -81.57% 3.310 0.610 - 38.64% -
470.lbm (avg) (percentage) -81.08% 3.330 0.630 - -1.56% -
456.hmmer (unexplained diff vs previous) -80.43% 46.000 9.000 0.000 28.57% 0.000
445.gobmk -79.73% 74.000 15.000 - 0.00% -
445.gobmk (avg) -79.73% 74.000 15.000 - 0.00% -
458.sjeng -79.41% 136.000 28.000 - -3.45% -
458.sjeng (avg) -79.41% 136.000 28.000 - -3.45% -
456.hmmer -78.05% 164.000 36.000 - 0.00% -
456.hmmer (avg) -78.05% 164.000 36.000 - 0.00% -
473.astar -76.79% 112.000 26.000 - 0.00% -
473.astar (avg) -76.79% 112.000 26.000 - 0.00% -
464.h264ref (max) (percentage) -76.19% 0.420 0.100 - 0.00% -
453.povray (max) -76.00% 25.000 6.000 - -14.29% -
445.gobmk (unexplained diff vs previous) -72.50% 40.000 11.000 0.000 10.00% 0.000
471.omnetpp -72.46% 167.000 46.000 - -2.13% -
471.omnetpp (avg) -72.46% 167.000 46.000 - -2.13% -
471.omnetpp (max) (percentage) -72.09% 9.280 2.590 - -12.50% -
464.h264ref -66.67% 42.000 14.000 - 0.00% -
464.h264ref (avg) -66.67% 42.000 14.000 - 0.00% -
444.namd (avg) (percentage) -64.20% 2.570 0.920 - 2.22% -
429.mcf (unexplained diff vs previous) -63.64% 22.000 8.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -62.14% 103.000 39.000 0.000 -54.12% 0.000
482.sphinx3 (avg) (percentage) -56.90% 1.740 0.750 - 0.00% -
458.sjeng (avg) (percentage) -56.25% 0.800 0.350 - -2.78% -
462.libquantum (max) (percentage) -55.64% 6.380 2.830 - -12.38% -
445.gobmk (avg) (percentage) -53.73% 0.670 0.310 - 0.00% -
473.astar (unexplained diff vs previous) -48.00% 25.000 13.000 0.000 160.00% 0.000
447.dealII (unexplained diff vs previous) -40.74% 54.000 32.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -38.46% 13.000 8.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -38.46% 0.390 0.240 0.000 33.33% 0.000
473.astar (avg) (percentage) -38.04% 0.920 0.570 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -36.11% 0.360 0.230 0.000 9.52% 0.000
429.mcf (avg) (percentage) -33.49% 2.120 1.410 - -1.40% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
456.hmmer (avg) (percentage) -30.94% 1.390 0.960 - -1.03% -
401.bzip2 (avg) (percentage) -29.23% 0.650 0.460 - 0.00% -
447.dealII (avg) (percentage) -28.57% 1.050 0.750 - 4.17% -
450.soplex (max) (percentage) -28.48% 1.650 1.180 - -6.35% -
433.milc (avg) (percentage) -26.74% 0.860 0.630 - 0.00% -
447.dealII (max) (percentage) -26.47% 2.380 1.750 - -13.79% -
464.h264ref (avg) (percentage) -13.79% 0.290 0.250 - 0.00% -
433.milc (max) (percentage) -3.75% 0.800 0.770 - -2.53% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
401.bzip2 2839.000 -
403.gcc 59.000 -1.67%
429.mcf 1135.000 -
433.milc 1170.000 -
444.namd 800.000 -1.48%
445.gobmk 4864.000 -
447.dealII 1976.000 1.65%
450.soplex 545.000 -
453.povray 494.000 -1.40%
456.hmmer 3810.000 -
458.sjeng 8242.000 -
462.libquantum 184.000 2.22%
464.h264ref 5951.000 -
470.lbm 4000.000 -
471.omnetpp 2916.000 -1.32%
473.astar 4669.000 -
482.sphinx3 985.000 -
Geometric Mean 1486.956 -
Code Size (bytes)
Name Current %
401.bzip2 33113.000 -
403.gcc 1655759.000 -
429.mcf 6959.000 -
433.milc 46145.000 -
444.namd 122474.000 -
445.gobmk 1256029.000 -
447.dealII 195862.000 -
450.soplex 149528.000 -
453.povray 513136.000 -
456.hmmer 80345.000 -
458.sjeng 79222.000 -
462.libquantum 12095.000 -
464.h264ref 299657.000 -
470.lbm 9232.000 -
471.omnetpp 321910.000 -
473.astar 15563.000 -
482.sphinx3 87400.000 -
Geometric Mean 94460.907 -
sample variability
Name Current %
401.bzip2 13.000 8.33%
401.bzip2 (avg) 13.000 8.33%
401.bzip2 (avg) (percentage) 0.460 -
401.bzip2 (max) 10.000 -9.09%
401.bzip2 (max) (percentage) 0.370 -5.13%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.680 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.790 -1.03%
429.mcf 16.000 -
429.mcf (avg) 16.000 -
429.mcf (avg) (percentage) 1.410 -1.40%
429.mcf (max) 7.000 -12.50%
429.mcf (max) (percentage) 0.700 -4.11%
429.mcf (unexplained diff vs previous) 8.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.700 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 -
433.milc (max) 9.000 -
433.milc (max) (percentage) 0.770 -2.53%
433.milc (unexplained diff vs previous) 8.000 -
433.milc (unexplained diff vs previous) (percentage) 0.680 -
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 0.920 2.22%
444.namd (max) 11.000 83.33%
444.namd (max) (percentage) 1.480 100.00%
444.namd (unexplained diff vs previous) 12.000 -
444.namd (unexplained diff vs previous) (percentage) 1.500 -
445.gobmk 15.000 -
445.gobmk (avg) 15.000 -
445.gobmk (avg) (percentage) 0.310 -
445.gobmk (max) 18.000 -5.26%
445.gobmk (max) (percentage) 0.380 -5.00%
445.gobmk (unexplained diff vs previous) 11.000 10.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.230 9.52%
447.dealII 14.000 7.69%
447.dealII (avg) 14.000 7.69%
447.dealII (avg) (percentage) 0.750 4.17%
447.dealII (max) 34.000 -12.82%
447.dealII (max) (percentage) 1.750 -13.79%
447.dealII (unexplained diff vs previous) 32.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.620 -
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.300 -
450.soplex (max) 6.000 -
450.soplex (max) (percentage) 1.180 -6.35%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.930 -
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.380 -2.82%
456.hmmer 36.000 -
456.hmmer (avg) 36.000 -
456.hmmer (avg) (percentage) 0.960 -1.03%
456.hmmer (max) 9.000 12.50%
456.hmmer (max) (percentage) 0.240 -
456.hmmer (unexplained diff vs previous) 9.000 28.57%
456.hmmer (unexplained diff vs previous) (percentage) 0.240 33.33%
458.sjeng 28.000 -3.45%
458.sjeng (avg) 28.000 -3.45%
458.sjeng (avg) (percentage) 0.350 -2.78%
458.sjeng (max) 15.000 -28.57%
458.sjeng (max) (percentage) 0.190 -26.92%
458.sjeng (unexplained diff vs previous) 3.000 -83.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -81.82%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.620 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.830 -12.38%
462.libquantum (unexplained diff vs previous) 4.000 -33.33%
462.libquantum (unexplained diff vs previous) (percentage) 2.170 -34.83%
464.h264ref 14.000 -
464.h264ref (avg) 14.000 -
464.h264ref (avg) (percentage) 0.250 -
464.h264ref (max) 5.000 -
464.h264ref (max) (percentage) 0.100 -
464.h264ref (unexplained diff vs previous) 5.000 25.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.080 -
470.lbm 25.000 -
470.lbm (avg) 25.000 -
470.lbm (avg) (percentage) 0.630 -1.56%
470.lbm (max) 12.000 -7.69%
470.lbm (max) (percentage) 0.310 -11.43%
470.lbm (unexplained diff vs previous) 9.000 -35.71%
470.lbm (unexplained diff vs previous) (percentage) 0.230 -34.29%
471.omnetpp 46.000 -2.13%
471.omnetpp (avg) 46.000 -2.13%
471.omnetpp (avg) (percentage) 1.590 -
471.omnetpp (max) 75.000 -13.79%
471.omnetpp (max) (percentage) 2.590 -12.50%
471.omnetpp (unexplained diff vs previous) 39.000 -54.12%
471.omnetpp (unexplained diff vs previous) (percentage) 1.340 -53.47%
473.astar 26.000 -
473.astar (avg) 26.000 -
473.astar (avg) (percentage) 0.570 -
473.astar (max) 14.000 -6.67%
473.astar (max) (percentage) 0.320 -5.88%
473.astar (unexplained diff vs previous) 13.000 160.00%
473.astar (unexplained diff vs previous) (percentage) 0.280 154.55%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.750 -
482.sphinx3 (max) 6.000 50.00%
482.sphinx3 (max) (percentage) 0.610 38.64%
482.sphinx3 (unexplained diff vs previous) 6.000 500.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.610 510.00%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 3.054 1.56%