Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a16f6462d756804276d4b39267b3c19bcd6949fe (+ 483 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz-build/73/
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0073 (llvmorg-18-init-07932-ga16f6462d756) 2023-10-02T05:07:50 0:00:00
Previous 0067 (llvmorg-18-init-06129-ga292e7edf8b2) 2023-09-16T18:54:37 0:00:00
Baseline 0014 (no-change) 2023-02-19T08:08:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 45 9
Performance Improvements 55 87
Added Tests 14 30
Unchanged Tests 654 642
Total Tests 768

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.33% 60.000 62.000 - 3.33% -
450.soplex 3.31% 543.000 561.000 - 1.08% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 1100.00% 1.000 12.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 1088.89% 0.180 2.140 - 0.00% -
433.milc (max) 500.00% 2.000 12.000 - -92.16% -
471.omnetpp (unexplained diff vs previous) 444.44% 9.000 49.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 434.48% 0.290 1.550 - 0.00% -
433.milc (max) (percentage) 415.00% 0.200 1.030 - -92.22% -
470.lbm (unexplained diff vs previous) 280.00% 5.000 19.000 - 0.00% -
401.bzip2 (max) 271.43% 7.000 26.000 - -69.41% -
470.lbm (unexplained diff vs previous) (percentage) 269.23% 0.130 0.480 - 0.00% -
444.namd (max) (percentage) 244.00% 0.250 0.860 - -93.46% -
401.bzip2 (max) (percentage) 238.46% 0.260 0.880 - -69.01% -
429.mcf (unexplained diff vs previous) (percentage) 205.88% 0.170 0.520 - 0.00% -
429.mcf (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
444.namd (max) 200.00% 2.000 6.000 - -94.23% -
458.sjeng (max) 120.00% 15.000 33.000 - -96.29% -
458.sjeng (max) (percentage) 118.75% 0.160 0.350 - -96.21% -
445.gobmk (unexplained diff vs previous) (percentage) 115.38% 0.130 0.280 - 0.00% -
445.gobmk (unexplained diff vs previous) 114.29% 7.000 15.000 - 0.00% -
429.mcf (max) 83.33% 6.000 11.000 - -94.91% -
458.sjeng (unexplained diff vs previous) (percentage) 75.00% 0.080 0.140 - 0.00% -
464.h264ref (max) 75.00% 16.000 28.000 - -90.41% -
464.h264ref (max) (percentage) 71.43% 0.280 0.480 - -90.08% -
464.h264ref (unexplained diff vs previous) (percentage) 71.43% 0.280 0.480 - 0.00% -
464.h264ref (unexplained diff vs previous) 70.59% 17.000 29.000 - 0.00% -
429.mcf (max) (percentage) 68.33% 0.600 1.010 - -94.61% -
458.sjeng (unexplained diff vs previous) 62.50% 8.000 13.000 - 0.00% -
456.hmmer (max) 60.00% 10.000 16.000 - -95.03% -
456.hmmer (max) (percentage) 53.33% 0.300 0.460 - -94.84% -
445.gobmk (max) 50.00% 10.000 15.000 - -91.76% -
445.gobmk (max) (percentage) 40.00% 0.200 0.280 - -91.64% -
471.omnetpp (max) 28.95% 38.000 49.000 - -90.34% -
473.astar (unexplained diff vs previous) 28.57% 7.000 9.000 - -99.90% -
473.astar (unexplained diff vs previous) (percentage) 28.57% 0.140 0.180 - -99.90% -
471.omnetpp (max) (percentage) 28.46% 1.230 1.580 - -90.29% -
470.lbm (max) 26.67% 15.000 19.000 - -95.71% -
470.lbm (max) (percentage) 22.50% 0.400 0.490 - -95.66% -
450.soplex (max) 20.00% 10.000 12.000 - 71.43% -
401.bzip2 (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 15.00% 0.200 0.230 - 0.00% -
450.soplex 14.29% 7.000 8.000 - 166.67% -
450.soplex (avg) 14.29% 7.000 8.000 - 166.67% -
450.soplex (max) (percentage) 10.05% 1.990 2.190 - 64.66% -
450.soplex (avg) (percentage) 2.14% 1.400 1.430 - 116.67% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum -4.25% 22218.000 21274.000 - -3.59% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -1.14% 3948.000 3903.000 - -2.20% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) -65.52% 29.000 10.000 - -99.68% -
473.astar (max) (percentage) -65.00% 0.600 0.210 - -99.67% -
462.libquantum (max) (percentage) -25.00% 1.000 0.750 - -87.20% -
482.sphinx3 (max) (percentage) -23.85% 1.090 0.830 - -94.22% -
482.sphinx3 (max) -20.00% 10.000 8.000 - -94.37% -
453.povray (max) -18.18% 11.000 9.000 - -64.00% -
483.xalancbmk (max) -17.07% 41.000 34.000 - -98.19% -
453.povray (max) (percentage) -15.77% 2.220 1.870 - -61.28% -
483.xalancbmk (max) (percentage) -15.24% 1.050 0.890 - -98.11% -
482.sphinx3 -15.00% 20.000 17.000 - -50.00% -
482.sphinx3 (avg) -15.00% 20.000 17.000 - -50.00% -
453.povray -14.29% 7.000 6.000 - -14.29% -
453.povray (avg) -14.29% 7.000 6.000 - -14.29% -
482.sphinx3 (avg) (percentage) -12.98% 2.080 1.810 - -47.69% -
447.dealII (avg) (percentage) -12.15% 1.070 0.940 - -17.54% -
447.dealII -11.54% 26.000 23.000 - -14.81% -
447.dealII (avg) -11.54% 26.000 23.000 - -14.81% -
456.hmmer (avg) (percentage) -11.50% 2.000 1.770 - -51.37% -
456.hmmer -11.11% 72.000 64.000 - -51.15% -
456.hmmer (avg) -11.11% 72.000 64.000 - -51.15% -
473.astar -10.81% 111.000 99.000 - -60.08% -
473.astar (avg) -10.81% 111.000 99.000 - -60.08% -
473.astar (avg) (percentage) -10.62% 2.260 2.020 - -59.76% -
429.mcf -10.34% 29.000 26.000 - -52.73% -
429.mcf (avg) -10.34% 29.000 26.000 - -52.73% -
470.lbm -10.14% 69.000 62.000 - -60.26% -
470.lbm (avg) -10.14% 69.000 62.000 - -60.26% -
429.mcf (avg) (percentage) -9.69% 2.580 2.330 - -51.15% -
470.lbm (avg) (percentage) -9.66% 1.760 1.590 - -60.05% -
458.sjeng (avg) (percentage) -9.64% 0.830 0.750 - -54.55% -
464.h264ref (avg) (percentage) -9.37% 0.960 0.870 - -56.50% -
458.sjeng -8.97% 78.000 71.000 - -55.35% -
458.sjeng (avg) -8.97% 78.000 71.000 - -55.35% -
464.h264ref -8.77% 57.000 52.000 - -56.67% -
464.h264ref (avg) -8.77% 57.000 52.000 - -56.67% -
445.gobmk -8.57% 35.000 32.000 - -54.93% -
445.gobmk (avg) -8.57% 35.000 32.000 - -54.93% -
453.povray (avg) (percentage) -8.15% 1.350 1.240 - -17.33% -
445.gobmk (avg) (percentage) -7.69% 0.650 0.600 - -54.20% -
444.namd (avg) (percentage) -7.05% 2.270 2.110 - -50.47% -
462.libquantum (avg) (percentage) -6.80% 1.030 0.960 - -40.00% -
471.omnetpp (avg) (percentage) -6.52% 1.840 1.720 - -51.41% -
444.namd -5.56% 18.000 17.000 - -50.00% -
444.namd (avg) -5.56% 18.000 17.000 - -50.00% -
471.omnetpp -5.26% 57.000 54.000 - -50.91% -
471.omnetpp (avg) -5.26% 57.000 54.000 - -50.91% -
447.dealII (max) (percentage) -4.95% 1.010 0.960 - -79.83% -
483.xalancbmk -4.94% 162.000 154.000 - -43.17% -
483.xalancbmk (avg) -4.94% 162.000 154.000 - -43.17% -
433.milc (avg) (percentage) -4.44% 1.350 1.290 - -36.76% -
447.dealII (max) -4.17% 24.000 23.000 - -80.00% -
483.xalancbmk (avg) (percentage) -3.88% 4.120 3.960 - -41.85% -
403.gcc (max) (percentage) -1.47% 6.820 6.720 - -42.17% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 3.33% 60.000 62.000 - 3.33% -
471.omnetpp 1.38% 3116.000 3159.000 - 0.83% -
450.soplex 1.08% 555.000 561.000 - 3.31% -
447.dealII 1.03% 2432.000 2457.000 - 0.53% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex 166.67% 3.000 8.000 - 14.29% -
450.soplex (avg) 166.67% 3.000 8.000 - 14.29% -
450.soplex (avg) (percentage) 116.67% 0.660 1.430 - 2.14% -
450.soplex (max) 71.43% 7.000 12.000 - 20.00% -
450.soplex (max) (percentage) 64.66% 1.330 2.190 - 10.05% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -3.59% 22066.000 21274.000 - -4.25% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk -2.20% 3991.000 3903.000 - -1.14% -
458.sjeng -1.68% 9638.000 9476.000 - -0.41% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) -99.90% 173.660 0.180 - 28.57% -
473.astar (unexplained diff vs previous) -99.90% 8605.000 9.000 - 28.57% -
473.astar (max) -99.68% 3144.000 10.000 - -65.52% -
473.astar (max) (percentage) -99.67% 63.460 0.210 - -65.00% -
483.xalancbmk (max) -98.19% 1883.000 34.000 - -17.07% -
483.xalancbmk (max) (percentage) -98.11% 47.200 0.890 - -15.24% -
458.sjeng (max) -96.29% 889.000 33.000 - 120.00% -
458.sjeng (max) (percentage) -96.21% 9.230 0.350 - 118.75% -
470.lbm (max) -95.71% 443.000 19.000 - 26.67% -
470.lbm (max) (percentage) -95.66% 11.290 0.490 - 22.50% -
456.hmmer (max) -95.03% 322.000 16.000 - 60.00% -
429.mcf (max) -94.91% 216.000 11.000 - 83.33% -
456.hmmer (max) (percentage) -94.84% 8.910 0.460 - 53.33% -
429.mcf (max) (percentage) -94.61% 18.730 1.010 - 68.33% -
482.sphinx3 (max) -94.37% 142.000 8.000 - -20.00% -
444.namd (max) -94.23% 104.000 6.000 - 200.00% -
482.sphinx3 (max) (percentage) -94.22% 14.360 0.830 - -23.85% -
444.namd (max) (percentage) -93.46% 13.140 0.860 - 244.00% -
433.milc (max) (percentage) -92.22% 13.240 1.030 - 415.00% -
433.milc (max) -92.16% 153.000 12.000 - 500.00% -
445.gobmk (max) -91.76% 182.000 15.000 - 50.00% -
445.gobmk (max) (percentage) -91.64% 3.350 0.280 - 40.00% -
464.h264ref (max) -90.41% 292.000 28.000 - 75.00% -
471.omnetpp (max) -90.34% 507.000 49.000 - 28.95% -
471.omnetpp (max) (percentage) -90.29% 16.280 1.580 - 28.46% -
464.h264ref (max) (percentage) -90.08% 4.840 0.480 - 71.43% -
462.libquantum (max) -90.00% 10.000 1.000 - 0.00% -
462.libquantum (max) (percentage) -87.20% 5.860 0.750 - -25.00% -
447.dealII (max) -80.00% 115.000 23.000 - -4.17% -
447.dealII (max) (percentage) -79.83% 4.760 0.960 - -4.95% -
401.bzip2 (max) -69.41% 85.000 26.000 - 271.43% -
401.bzip2 (max) (percentage) -69.01% 2.840 0.880 - 238.46% -
453.povray (max) -64.00% 25.000 9.000 - -18.18% -
453.povray (max) (percentage) -61.28% 4.830 1.870 - -15.77% -
470.lbm -60.26% 156.000 62.000 - -10.14% -
470.lbm (avg) -60.26% 156.000 62.000 - -10.14% -
473.astar -60.08% 248.000 99.000 - -10.81% -
473.astar (avg) -60.08% 248.000 99.000 - -10.81% -
470.lbm (avg) (percentage) -60.05% 3.980 1.590 - -9.66% -
473.astar (avg) (percentage) -59.76% 5.020 2.020 - -10.62% -
464.h264ref -56.67% 120.000 52.000 - -8.77% -
464.h264ref (avg) -56.67% 120.000 52.000 - -8.77% -
464.h264ref (avg) (percentage) -56.50% 2.000 0.870 - -9.37% -
458.sjeng -55.35% 159.000 71.000 - -8.97% -
458.sjeng (avg) -55.35% 159.000 71.000 - -8.97% -
445.gobmk -54.93% 71.000 32.000 - -8.57% -
445.gobmk (avg) -54.93% 71.000 32.000 - -8.57% -
458.sjeng (avg) (percentage) -54.55% 1.650 0.750 - -9.64% -
445.gobmk (avg) (percentage) -54.20% 1.310 0.600 - -7.69% -
429.mcf -52.73% 55.000 26.000 - -10.34% -
429.mcf (avg) -52.73% 55.000 26.000 - -10.34% -
471.omnetpp (avg) (percentage) -51.41% 3.540 1.720 - -6.52% -
456.hmmer (avg) (percentage) -51.37% 3.640 1.770 - -11.50% -
429.mcf (avg) (percentage) -51.15% 4.770 2.330 - -9.69% -
456.hmmer -51.15% 131.000 64.000 - -11.11% -
456.hmmer (avg) -51.15% 131.000 64.000 - -11.11% -
471.omnetpp -50.91% 110.000 54.000 - -5.26% -
471.omnetpp (avg) -50.91% 110.000 54.000 - -5.26% -
444.namd (avg) (percentage) -50.47% 4.260 2.110 - -7.05% -
444.namd -50.00% 34.000 17.000 - -5.56% -
444.namd (avg) -50.00% 34.000 17.000 - -5.56% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
482.sphinx3 -50.00% 34.000 17.000 - -15.00% -
482.sphinx3 (avg) -50.00% 34.000 17.000 - -15.00% -
482.sphinx3 (avg) (percentage) -47.69% 3.460 1.810 - -12.98% -
483.xalancbmk -43.17% 271.000 154.000 - -4.94% -
483.xalancbmk (avg) -43.17% 271.000 154.000 - -4.94% -
403.gcc (max) (percentage) -42.17% 11.620 6.720 - -1.47% -
483.xalancbmk (avg) (percentage) -41.85% 6.810 3.960 - -3.88% -
462.libquantum (avg) (percentage) -40.00% 1.600 0.960 - -6.80% -
401.bzip2 (avg) (percentage) -38.79% 1.160 0.710 - 0.00% -
401.bzip2 -38.24% 34.000 21.000 - 0.00% -
401.bzip2 (avg) -38.24% 34.000 21.000 - 0.00% -
433.milc (avg) (percentage) -36.76% 2.040 1.290 - -4.44% -
433.milc -34.78% 23.000 15.000 - 0.00% -
433.milc (avg) -34.78% 23.000 15.000 - 0.00% -
403.gcc (max) -33.33% 6.000 4.000 - 0.00% -
447.dealII (avg) (percentage) -17.54% 1.140 0.940 - -12.15% -
453.povray (avg) (percentage) -17.33% 1.500 1.240 - -8.15% -
447.dealII -14.81% 27.000 23.000 - -11.54% -
447.dealII (avg) -14.81% 27.000 23.000 - -11.54% -
453.povray -14.29% 7.000 6.000 - -14.29% -
453.povray (avg) -14.29% 7.000 6.000 - -14.29% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 3006.000 -
403.gcc 62.000 3.33%
429.mcf 1154.000 -
433.milc 1168.000 -
444.namd 806.000 -
445.gobmk 5418.000 -
447.dealII 2457.000 -
450.soplex 561.000 3.31%
453.povray 526.000 -
456.hmmer 3625.000 -
458.sjeng 9476.000 -
462.libquantum 183.000 -
464.h264ref 5989.000 -
470.lbm 3936.000 -
471.omnetpp 3159.000 -
473.astar 4948.000 -
482.sphinx3 987.000 -
483.xalancbmk 3903.000 -1.14%
Geometric Mean 1636.617 -
Name Current %
401.bzip2 35901.000 -
403.gcc 1844057.000 -
429.mcf 7498.000 -
433.milc 69329.000 -
444.namd 154727.000 -
445.gobmk 1290406.000 -
447.dealII 1475735.000 -
450.soplex 180218.000 -
453.povray 544546.000 -
456.hmmer 156498.000 -
458.sjeng 90393.000 -
462.libquantum 21274.000 -4.25%
464.h264ref 334584.000 -
470.lbm 9734.000 -
471.omnetpp 362270.000 -
473.astar 21203.000 -
482.sphinx3 108063.000 -
483.xalancbmk 2168882.000 -
Geometric Mean 151443.408 -
Name Current %
401.bzip2 21.000 -
401.bzip2 (avg) 21.000 -
401.bzip2 (avg) (percentage) 0.710 -
401.bzip2 (max) 26.000 271.43%
401.bzip2 (max) (percentage) 0.880 238.46%
401.bzip2 (unexplained diff vs previous) 7.000 16.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.230 15.00%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.730 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 6.720 -1.47%
429.mcf 26.000 -10.34%
429.mcf (avg) 26.000 -10.34%
429.mcf (avg) (percentage) 2.330 -9.69%
429.mcf (max) 11.000 83.33%
429.mcf (max) (percentage) 1.010 68.33%
429.mcf (unexplained diff vs previous) 6.000 200.00%
429.mcf (unexplained diff vs previous) (percentage) 0.520 205.88%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.290 -4.44%
433.milc (max) 12.000 500.00%
433.milc (max) (percentage) 1.030 415.00%
433.milc (unexplained diff vs previous) 12.000 -
433.milc (unexplained diff vs previous) (percentage) 1.030 -
444.namd 17.000 -5.56%
444.namd (avg) 17.000 -5.56%
444.namd (avg) (percentage) 2.110 -7.05%
444.namd (max) 6.000 200.00%
444.namd (max) (percentage) 0.860 244.00%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.250 -
445.gobmk 32.000 -8.57%
445.gobmk (avg) 32.000 -8.57%
445.gobmk (avg) (percentage) 0.600 -7.69%
445.gobmk (max) 15.000 50.00%
445.gobmk (max) (percentage) 0.280 40.00%
445.gobmk (unexplained diff vs previous) 15.000 114.29%
445.gobmk (unexplained diff vs previous) (percentage) 0.280 115.38%
447.dealII 23.000 -11.54%
447.dealII (avg) 23.000 -11.54%
447.dealII (avg) (percentage) 0.940 -12.15%
447.dealII (max) 23.000 -4.17%
447.dealII (max) (percentage) 0.960 -4.95%
447.dealII (unexplained diff vs previous) 2.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.080 -
450.soplex 8.000 14.29%
450.soplex (avg) 8.000 14.29%
450.soplex (avg) (percentage) 1.430 2.14%
450.soplex (max) 12.000 20.00%
450.soplex (max) (percentage) 2.190 10.05%
450.soplex (unexplained diff vs previous) 12.000 1100.00%
450.soplex (unexplained diff vs previous) (percentage) 2.140 1088.89%
453.povray 6.000 -14.29%
453.povray (avg) 6.000 -14.29%
453.povray (avg) (percentage) 1.240 -8.15%
453.povray (max) 9.000 -18.18%
453.povray (max) (percentage) 1.870 -15.77%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.190 -
456.hmmer 64.000 -11.11%
456.hmmer (avg) 64.000 -11.11%
456.hmmer (avg) (percentage) 1.770 -11.50%
456.hmmer (max) 16.000 60.00%
456.hmmer (max) (percentage) 0.460 53.33%
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -
458.sjeng 71.000 -8.97%
458.sjeng (avg) 71.000 -8.97%
458.sjeng (avg) (percentage) 0.750 -9.64%
458.sjeng (max) 33.000 120.00%
458.sjeng (max) (percentage) 0.350 118.75%
458.sjeng (unexplained diff vs previous) 13.000 62.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.140 75.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 0.960 -6.80%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.750 -25.00%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 52.000 -8.77%
464.h264ref (avg) 52.000 -8.77%
464.h264ref (avg) (percentage) 0.870 -9.37%
464.h264ref (max) 28.000 75.00%
464.h264ref (max) (percentage) 0.480 71.43%
464.h264ref (unexplained diff vs previous) 29.000 70.59%
464.h264ref (unexplained diff vs previous) (percentage) 0.480 71.43%
470.lbm 62.000 -10.14%
470.lbm (avg) 62.000 -10.14%
470.lbm (avg) (percentage) 1.590 -9.66%
470.lbm (max) 19.000 26.67%
470.lbm (max) (percentage) 0.490 22.50%
470.lbm (unexplained diff vs previous) 19.000 280.00%
470.lbm (unexplained diff vs previous) (percentage) 0.480 269.23%
471.omnetpp 54.000 -5.26%
471.omnetpp (avg) 54.000 -5.26%
471.omnetpp (avg) (percentage) 1.720 -6.52%
471.omnetpp (max) 49.000 28.95%
471.omnetpp (max) (percentage) 1.580 28.46%
471.omnetpp (unexplained diff vs previous) 49.000 444.44%
471.omnetpp (unexplained diff vs previous) (percentage) 1.550 434.48%
473.astar 99.000 -10.81%
473.astar (avg) 99.000 -10.81%
473.astar (avg) (percentage) 2.020 -10.62%
473.astar (max) 10.000 -65.52%
473.astar (max) (percentage) 0.210 -65.00%
473.astar (unexplained diff vs previous) 9.000 28.57%
473.astar (unexplained diff vs previous) (percentage) 0.180 28.57%
482.sphinx3 17.000 -15.00%
482.sphinx3 (avg) 17.000 -15.00%
482.sphinx3 (avg) (percentage) 1.810 -12.98%
482.sphinx3 (max) 8.000 -20.00%
482.sphinx3 (max) (percentage) 0.830 -23.85%
482.sphinx3 (unexplained diff vs previous) 1.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -
483.xalancbmk 154.000 -4.94%
483.xalancbmk (avg) 154.000 -4.94%
483.xalancbmk (avg) (percentage) 3.960 -3.88%
483.xalancbmk (max) 34.000 -17.07%
483.xalancbmk (max) (percentage) 0.890 -15.24%
Geometric Mean 3.510 -13.13%