Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f4230b4332262dffb0bd3b7a2f8d6deb2e96488e (+ 179 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/252/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0252 (llvmorg-20-init-16785-gf4230b433226) 2024-12-30T21:19:34 0:00:00
Previous 0251 (llvmorg-20-init-16606-gc703b4645c79) 2024-12-24T22:30:18 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 33
Performance Improvements 47 108
Added Tests 5 5
Unchanged Tests 709 634
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 2.83% 460.000 473.000 - -93.10% -
462.libquantum 1.00% 100.000 101.000 - -99.23% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) 900.00% 1.000 10.000 - -83.33% -
464.h264ref (unexplained diff vs previous) (percentage) 800.00% 0.020 0.180 - -53.85% -
473.astar (unexplained diff vs previous) (percentage) 725.00% 0.040 0.330 - -56.58% -
473.astar (unexplained diff vs previous) 700.00% 2.000 16.000 - -85.19% -
453.povray (unexplained diff vs previous) 160.00% 5.000 13.000 - -90.00% -
453.povray (unexplained diff vs previous) (percentage) 152.29% 1.090 2.750 - 44.74% -
450.soplex (max) 71.43% 7.000 12.000 - -85.37% -
450.soplex (unexplained diff vs previous) (percentage) 66.88% 1.540 2.570 - 350.88% -
450.soplex (max) (percentage) 64.47% 1.520 2.500 - 338.60% -
450.soplex (unexplained diff vs previous) 62.50% 8.000 13.000 - -84.15% -
453.povray (max) 44.44% 9.000 13.000 - -90.15% -
453.povray (max) (percentage) 34.76% 2.100 2.830 - 46.63% -
453.povray 25.00% 4.000 5.000 - -94.62% -
453.povray (avg) 25.00% 4.000 5.000 - -94.62% -
453.povray (avg) (percentage) 3.92% 1.020 1.060 - -22.63% -
473.astar (max) (percentage) 3.13% 0.320 0.330 - -58.75% -
450.soplex (avg) (percentage) 1.90% 1.050 1.070 - 197.22% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -2.50% 519.000 506.000 - -96.49% -
471.omnetpp -1.70% 2818.000 2770.000 - -74.22% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) -84.85% 33.000 5.000 - -95.87% -
447.dealII (unexplained diff vs previous) (percentage) -84.78% 1.840 0.280 - -81.08% -
470.lbm (unexplained diff vs previous) -69.70% 33.000 10.000 - -97.99% -
470.lbm (unexplained diff vs previous) (percentage) -69.52% 1.050 0.320 - -91.06% -
458.sjeng (max) -69.44% 36.000 11.000 - -83.08% -
458.sjeng (max) (percentage) -68.18% 0.440 0.140 - -65.00% -
458.sjeng (unexplained diff vs previous) (percentage) -64.71% 0.170 0.060 - -76.00% -
458.sjeng (unexplained diff vs previous) -64.29% 14.000 5.000 - -87.80% -
433.milc (unexplained diff vs previous) -50.00% 10.000 5.000 - -97.25% -
433.milc (unexplained diff vs previous) (percentage) -50.00% 0.880 0.440 - -67.41% -
456.hmmer (unexplained diff vs previous) -33.33% 12.000 8.000 - -11.11% -
471.omnetpp (unexplained diff vs previous) -33.33% 72.000 48.000 - -47.83% -
471.omnetpp (unexplained diff vs previous) (percentage) -32.42% 2.560 1.730 - 101.16% -
456.hmmer (unexplained diff vs previous) (percentage) -32.35% 0.340 0.230 - 228.57% -
433.milc (max) -30.00% 10.000 7.000 - -96.20% -
471.omnetpp (max) -26.03% 73.000 54.000 - -71.43% -
471.omnetpp (max) (percentage) -25.19% 2.620 1.960 - 11.36% -
482.sphinx3 (unexplained diff vs previous) -25.00% 4.000 3.000 - -99.67% -
433.milc (max) (percentage) -25.00% 0.880 0.660 - -51.82% -
482.sphinx3 (unexplained diff vs previous) (percentage) -24.44% 0.450 0.340 - -90.12% -
456.hmmer (max) (percentage) -18.42% 0.380 0.310 - 3.33% -
470.lbm (max) -18.18% 33.000 27.000 - -96.49% -
470.lbm (max) (percentage) -16.98% 1.060 0.880 - -84.12% -
456.hmmer (max) -15.38% 13.000 11.000 - -72.50% -
401.bzip2 (max) -13.33% 15.000 13.000 - -72.92% -
444.namd (max) (percentage) -12.24% 0.980 0.860 - -86.85% -
401.bzip2 (max) (percentage) -7.14% 0.560 0.520 - 67.74% -
401.bzip2 (unexplained diff vs previous) (percentage) -7.14% 0.560 0.520 - 67.74% -
401.bzip2 (unexplained diff vs previous) -6.67% 15.000 14.000 - -71.43% -
462.libquantum (max) (percentage) -3.94% 1.270 1.220 - 510.00% -
447.dealII (max) (percentage) -3.89% 1.800 1.730 - 9.49% -
473.astar -3.23% 31.000 30.000 - -57.75% -
473.astar (avg) -3.23% 31.000 30.000 - -57.75% -
447.dealII (max) -3.12% 32.000 31.000 - -75.97% -
482.sphinx3 (max) (percentage) -2.86% 1.400 1.360 - -59.04% -
471.omnetpp -2.70% 37.000 36.000 - -56.63% -
471.omnetpp (avg) -2.70% 37.000 36.000 - -56.63% -
444.namd (avg) (percentage) -2.17% 0.920 0.900 - -76.38% -
429.mcf (max) (percentage) -2.15% 0.930 0.910 - 62.50% -
445.gobmk (max) (percentage) -1.85% 0.540 0.530 - 120.83% -
473.astar (avg) (percentage) -1.56% 0.640 0.630 - 26.00% -
447.dealII (avg) (percentage) -1.47% 0.680 0.670 - -54.42% -
429.mcf (unexplained diff vs previous) (percentage) -1.43% 0.700 0.690 - 23.21% -
482.sphinx3 (avg) (percentage) -1.20% 0.830 0.820 - -55.91% -
462.libquantum (unexplained diff vs previous) (percentage) -1.00% 1.000 0.990 - 725.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.10% 39458.000 40285.000 - 0.00% -
450.soplex 1.89% 198708.000 202463.000 - 0.00% -
471.omnetpp 1.08% 373579.000 377596.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (avg) (percentage) 986.67% 0.150 1.630 - -0.61% -
462.libquantum (unexplained diff vs previous) (percentage) 725.00% 0.120 0.990 - -1.00% -
403.gcc (avg) (percentage) 650.00% 0.480 3.600 - 0.00% -
462.libquantum (max) (percentage) 510.00% 0.200 1.220 - -3.94% -
403.gcc (max) (percentage) 468.42% 0.380 2.160 - -0.92% -
450.soplex (unexplained diff vs previous) (percentage) 350.88% 0.570 2.570 - 66.88% -
450.soplex (max) (percentage) 338.60% 0.570 2.500 - 64.47% -
456.hmmer (unexplained diff vs previous) (percentage) 228.57% 0.070 0.230 - -32.35% -
450.soplex (avg) (percentage) 197.22% 0.360 1.070 - 1.90% -
429.mcf (avg) (percentage) 175.56% 0.450 1.240 - -0.80% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
445.gobmk (max) (percentage) 120.83% 0.240 0.530 - -1.85% -
401.bzip2 (avg) (percentage) 109.09% 0.220 0.460 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 101.16% 0.860 1.730 - -32.42% -
471.omnetpp (avg) (percentage) 70.51% 0.780 1.330 - 0.76% -
401.bzip2 (max) (percentage) 67.74% 0.310 0.520 - -7.14% -
401.bzip2 (unexplained diff vs previous) (percentage) 67.74% 0.310 0.520 - -7.14% -
445.gobmk (avg) (percentage) 66.67% 0.180 0.300 - 0.00% -
429.mcf (max) (percentage) 62.50% 0.560 0.910 - -2.15% -
453.povray (max) (percentage) 46.63% 1.930 2.830 - 34.76% -
453.povray (unexplained diff vs previous) (percentage) 44.74% 1.900 2.750 - 152.29% -
473.astar (avg) (percentage) 26.00% 0.500 0.630 - -1.56% -
429.mcf (unexplained diff vs previous) (percentage) 23.21% 0.560 0.690 - -1.43% -
456.hmmer (avg) (percentage) 22.22% 0.360 0.440 - 0.00% -
471.omnetpp (max) (percentage) 11.36% 1.760 1.960 - -25.19% -
447.dealII (max) (percentage) 9.49% 1.580 1.730 - -3.89% -
456.hmmer (max) (percentage) 3.33% 0.300 0.310 - -18.42% -
483.xalancbmk (max) (percentage) 1.54% 0.650 0.660 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -11.11% 18.000 16.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.12% 26756.000 24047.000 - 0.00% -
433.milc -2.85% 74971.000 72834.000 - 0.00% -
447.dealII -2.40% 1777992.000 1735367.000 - 0.00% -
453.povray -2.36% 593097.000 579087.000 - 0.00% -
444.namd -2.15% 175160.000 171389.000 - 0.00% -
464.h264ref -1.43% 354618.000 349548.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.98% 12400.000 2.000 - 0.00% -
403.gcc -99.36% 9099.000 58.000 - 0.00% -
462.libquantum -99.23% 13126.000 101.000 - 1.00% -
482.sphinx3 -96.64% 26310.000 885.000 - 0.34% -
450.soplex -96.49% 14429.000 506.000 - -2.50% -
444.namd -94.75% 13495.000 708.000 - 0.00% -
453.povray -93.10% 6857.000 473.000 - 2.83% -
433.milc -91.57% 13482.000 1137.000 - -0.44% -
429.mcf -90.40% 11999.000 1152.000 - 0.70% -
401.bzip2 -82.91% 15683.000 2680.000 - -0.52% -
447.dealII -78.14% 8196.000 1792.000 - -0.28% -
470.lbm -77.38% 13882.000 3140.000 - -0.32% -
471.omnetpp -74.22% 10746.000 2770.000 - -1.70% -
456.hmmer -73.44% 13365.000 3550.000 - -0.22% -
473.astar -66.11% 14262.000 4834.000 - -0.33% -
464.h264ref -64.28% 15493.000 5534.000 - -0.18% -
458.sjeng -49.37% 16406.000 8306.000 - -0.06% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.67% 904.000 3.000 - -25.00% -
444.namd (max) -99.32% 882.000 6.000 - 0.00% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 (max) -98.63% 873.000 12.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) -97.99% 497.000 10.000 - -69.70% -
433.milc (unexplained diff vs previous) -97.25% 182.000 5.000 - -50.00% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
470.lbm (max) -96.49% 769.000 27.000 - -18.18% -
433.milc -96.32% 136.000 5.000 - 0.00% -
433.milc (avg) -96.32% 136.000 5.000 - 0.00% -
433.milc (max) -96.20% 184.000 7.000 - -30.00% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
447.dealII (unexplained diff vs previous) -95.87% 121.000 5.000 - -84.85% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 25.00% -
453.povray (avg) -94.62% 93.000 5.000 - 25.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
470.lbm -93.48% 322.000 21.000 - 0.00% -
470.lbm (avg) -93.48% 322.000 21.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -91.06% 3.580 0.320 - -69.52% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
453.povray (max) -90.15% 132.000 13.000 - 44.44% -
482.sphinx3 (unexplained diff vs previous) (percentage) -90.12% 3.440 0.340 - -24.44% -
447.dealII -90.00% 120.000 12.000 - 0.00% -
447.dealII (avg) -90.00% 120.000 12.000 - 0.00% -
453.povray (unexplained diff vs previous) -90.00% 130.000 13.000 - 160.00% -
429.mcf (unexplained diff vs previous) -88.06% 67.000 8.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -87.80% 41.000 5.000 - -64.29% -
444.namd (max) (percentage) -86.85% 6.540 0.860 - -12.24% -
473.astar (max) -86.84% 114.000 15.000 - 0.00% -
450.soplex (max) -85.37% 82.000 12.000 - 71.43% -
473.astar (unexplained diff vs previous) -85.19% 108.000 16.000 - 700.00% -
429.mcf (max) -85.07% 67.000 10.000 - 0.00% -
450.soplex (unexplained diff vs previous) -84.15% 82.000 13.000 - 62.50% -
470.lbm (max) (percentage) -84.12% 5.540 0.880 - -16.98% -
464.h264ref (unexplained diff vs previous) -83.33% 60.000 10.000 - 900.00% -
458.sjeng (max) -83.08% 65.000 11.000 - -69.44% -
447.dealII (unexplained diff vs previous) (percentage) -81.08% 1.480 0.280 - -84.78% -
464.h264ref (max) -80.00% 60.000 12.000 - 0.00% -
444.namd (avg) (percentage) -76.38% 3.810 0.900 - -2.17% -
458.sjeng (unexplained diff vs previous) (percentage) -76.00% 0.250 0.060 - -64.71% -
447.dealII (max) -75.97% 129.000 31.000 - -3.12% -
429.mcf -73.58% 53.000 14.000 - 0.00% -
429.mcf (avg) -73.58% 53.000 14.000 - 0.00% -
401.bzip2 (max) -72.92% 48.000 13.000 - -13.33% -
456.hmmer (max) -72.50% 40.000 11.000 - -15.38% -
401.bzip2 (unexplained diff vs previous) -71.43% 49.000 14.000 - -6.67% -
471.omnetpp (max) -71.43% 189.000 54.000 - -26.03% -
470.lbm (avg) (percentage) -70.69% 2.320 0.680 - 0.00% -
458.sjeng -69.47% 95.000 29.000 - 0.00% -
458.sjeng (avg) -69.47% 95.000 29.000 - 0.00% -
456.hmmer -68.75% 48.000 15.000 - 0.00% -
456.hmmer (avg) -68.75% 48.000 15.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -67.41% 1.350 0.440 - -50.00% -
464.h264ref -66.67% 51.000 17.000 - 0.00% -
464.h264ref (avg) -66.67% 51.000 17.000 - 0.00% -
458.sjeng (max) (percentage) -65.00% 0.400 0.140 - -68.18% -
401.bzip2 -64.71% 34.000 12.000 - 0.00% -
401.bzip2 (avg) -64.71% 34.000 12.000 - 0.00% -
482.sphinx3 (max) (percentage) -59.04% 3.320 1.360 - -2.86% -
473.astar (max) (percentage) -58.75% 0.800 0.330 - 3.13% -
473.astar -57.75% 71.000 30.000 - -3.23% -
473.astar (avg) -57.75% 71.000 30.000 - -3.23% -
471.omnetpp -56.63% 83.000 36.000 - -2.70% -
471.omnetpp (avg) -56.63% 83.000 36.000 - -2.70% -
473.astar (unexplained diff vs previous) (percentage) -56.58% 0.760 0.330 - 725.00% -
482.sphinx3 (avg) (percentage) -55.91% 1.860 0.820 - -1.20% -
447.dealII (avg) (percentage) -54.42% 1.470 0.670 - -1.47% -
464.h264ref (unexplained diff vs previous) (percentage) -53.85% 0.390 0.180 - 800.00% -
433.milc (max) (percentage) -51.82% 1.370 0.660 - -25.00% -
433.milc (avg) (percentage) -49.50% 1.010 0.510 - 0.00% -
471.omnetpp (unexplained diff vs previous) -47.83% 92.000 48.000 - -33.33% -
464.h264ref (max) (percentage) -43.59% 0.390 0.220 - 0.00% -
458.sjeng (avg) (percentage) -37.93% 0.580 0.360 - 0.00% -
453.povray (avg) (percentage) -22.63% 1.370 1.060 - 3.92% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -33.33% -
464.h264ref (avg) (percentage) -6.06% 0.330 0.310 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (max)


Report Time: 0.35s
Name Current %
401.bzip2 2680.000 -
403.gcc 58.000 -
429.mcf 1152.000 -
433.milc 1137.000 -
444.namd 708.000 -
445.gobmk 2.000 -
447.dealII 1792.000 -
450.soplex 506.000 -2.50%
453.povray 473.000 2.83%
456.hmmer 3550.000 -
458.sjeng 8306.000 -
462.libquantum 101.000 1.00%
464.h264ref 5534.000 -
470.lbm 3140.000 -
471.omnetpp 2770.000 -1.70%
473.astar 4834.000 -
482.sphinx3 885.000 -
Geometric Mean 859.229 -
Name Current %
401.bzip2 40285.000 -
403.gcc 1953221.000 -
429.mcf 7942.000 -
433.milc 72834.000 -
444.namd 171389.000 -
447.dealII 1735367.000 -
450.soplex 202463.000 -
453.povray 579087.000 -
456.hmmer 166662.000 -
458.sjeng 96913.000 -
462.libquantum 24047.000 -
464.h264ref 349548.000 -
470.lbm 9778.000 -
471.omnetpp 377596.000 -
473.astar 23295.000 -
482.sphinx3 114715.000 -
Geometric Mean 121052.309 -
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.460 -
401.bzip2 (max) 13.000 -13.33%
401.bzip2 (max) (percentage) 0.520 -7.14%
401.bzip2 (unexplained diff vs previous) 14.000 -6.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.520 -7.14%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.600 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.160 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.240 -
429.mcf (max) 10.000 -
429.mcf (max) (percentage) 0.910 -2.15%
429.mcf (unexplained diff vs previous) 8.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.690 -1.43%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.510 -
433.milc (max) 7.000 -30.00%
433.milc (max) (percentage) 0.660 -25.00%
433.milc (unexplained diff vs previous) 5.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.440 -50.00%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.900 -2.17%
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.860 -12.24%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 0.300 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 0.530 -1.85%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.670 -1.47%
447.dealII (max) 31.000 -3.12%
447.dealII (max) (percentage) 1.730 -3.89%
447.dealII (unexplained diff vs previous) 5.000 -84.85%
447.dealII (unexplained diff vs previous) (percentage) 0.280 -84.78%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.070 1.90%
450.soplex (max) 12.000 71.43%
450.soplex (max) (percentage) 2.500 64.47%
450.soplex (unexplained diff vs previous) 13.000 62.50%
450.soplex (unexplained diff vs previous) (percentage) 2.570 66.88%
453.povray 5.000 25.00%
453.povray (avg) 5.000 25.00%
453.povray (avg) (percentage) 1.060 3.92%
453.povray (max) 13.000 44.44%
453.povray (max) (percentage) 2.830 34.76%
453.povray (unexplained diff vs previous) 13.000 160.00%
453.povray (unexplained diff vs previous) (percentage) 2.750 152.29%
456.hmmer 15.000 -
456.hmmer (avg) 15.000 -
456.hmmer (avg) (percentage) 0.440 -
456.hmmer (max) 11.000 -15.38%
456.hmmer (max) (percentage) 0.310 -18.42%
456.hmmer (unexplained diff vs previous) 8.000 -33.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.230 -32.35%
458.sjeng 29.000 -
458.sjeng (avg) 29.000 -
458.sjeng (avg) (percentage) 0.360 -
458.sjeng (max) 11.000 -69.44%
458.sjeng (max) (percentage) 0.140 -68.18%
458.sjeng (unexplained diff vs previous) 5.000 -64.29%
458.sjeng (unexplained diff vs previous) (percentage) 0.060 -64.71%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.630 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.220 -3.94%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.990 -1.00%
464.h264ref 17.000 -
464.h264ref (avg) 17.000 -
464.h264ref (avg) (percentage) 0.310 -
464.h264ref (max) 12.000 -
464.h264ref (max) (percentage) 0.220 -
464.h264ref (unexplained diff vs previous) 10.000 900.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.180 800.00%
470.lbm 21.000 -
470.lbm (avg) 21.000 -
470.lbm (avg) (percentage) 0.680 -
470.lbm (max) 27.000 -18.18%
470.lbm (max) (percentage) 0.880 -16.98%
470.lbm (unexplained diff vs previous) 10.000 -69.70%
470.lbm (unexplained diff vs previous) (percentage) 0.320 -69.52%
471.omnetpp 36.000 -2.70%
471.omnetpp (avg) 36.000 -2.70%
471.omnetpp (avg) (percentage) 1.330 -
471.omnetpp (max) 54.000 -26.03%
471.omnetpp (max) (percentage) 1.960 -25.19%
471.omnetpp (unexplained diff vs previous) 48.000 -33.33%
471.omnetpp (unexplained diff vs previous) (percentage) 1.730 -32.42%
473.astar 30.000 -3.23%
473.astar (avg) 30.000 -3.23%
473.astar (avg) (percentage) 0.630 -1.56%
473.astar (max) 15.000 -
473.astar (max) (percentage) 0.330 3.13%
473.astar (unexplained diff vs previous) 16.000 700.00%
473.astar (unexplained diff vs previous) (percentage) 0.330 725.00%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.820 -1.20%
482.sphinx3 (max) 12.000 -
482.sphinx3 (max) (percentage) 1.360 -2.86%
482.sphinx3 (unexplained diff vs previous) 3.000 -25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.340 -24.44%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.660 -
Geometric Mean 1.870 -37.35%