Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/49893fbff367294913988dea01f8f4ceb418e922 (+ 176 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/79/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0079 (llvmorg-18-init-09361-g49893fbff367) 2023-10-19T13:55:54 0:00:00
Previous 0078 (llvmorg-18-init-09185-g7e3d1103e6e7) 2023-10-15T02:44:30 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 26
Performance Improvements 62 105
Added Tests 4 8
Unchanged Tests 696 641
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 1.80% 501.000 510.000 - -92.70% -
462.libquantum 1.63% 184.000 187.000 - -98.70% -
433.milc 1.04% 1154.000 1166.000 - -91.43% -
483.xalancbmk 1.04% 3373.000 3408.000 - -63.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 2950.00% 0.020 0.610 - 205.00% -
473.astar (unexplained diff vs previous) 2800.00% 1.000 29.000 - 16.00% -
483.xalancbmk (unexplained diff vs previous) 337.50% 8.000 35.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 329.17% 0.240 1.030 - 0.00% -
456.hmmer (unexplained diff vs previous) 283.33% 6.000 23.000 - -50.00% -
456.hmmer (unexplained diff vs previous) (percentage) 275.00% 0.160 0.600 - 53.85% -
456.hmmer (max) 187.50% 8.000 23.000 - -98.15% -
456.hmmer (max) (percentage) 177.27% 0.220 0.610 - -94.18% -
471.omnetpp (unexplained diff vs previous) (percentage) 128.21% 0.390 0.890 - -9.18% -
471.omnetpp (unexplained diff vs previous) 127.27% 11.000 25.000 - -75.73% -
483.xalancbmk (max) 75.00% 20.000 35.000 - -97.11% -
483.xalancbmk (max) (percentage) 70.49% 0.610 1.040 - -91.94% -
473.astar (max) 38.10% 21.000 29.000 - -96.47% -
473.astar (max) (percentage) 34.78% 0.460 0.620 - -90.75% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.00% 60.000 57.000 - -99.40% -
444.namd -1.59% 819.000 806.000 - -93.50% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -86.00% 0.500 0.070 - -98.84% -
470.lbm (unexplained diff vs previous) -85.00% 20.000 3.000 - -99.63% -
429.mcf (unexplained diff vs previous) (percentage) -80.46% 0.870 0.170 - 6.25% -
429.mcf (unexplained diff vs previous) -80.00% 10.000 2.000 - -90.91% -
458.sjeng (unexplained diff vs previous) -70.21% 47.000 14.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -70.18% 0.570 0.170 - 0.00% -
450.soplex (unexplained diff vs previous) -66.67% 9.000 3.000 - -95.65% -
450.soplex (unexplained diff vs previous) (percentage) -66.27% 1.660 0.560 - 21.74% -
482.sphinx3 (max) -33.33% 3.000 2.000 - -99.77% -
450.soplex (max) (percentage) -30.59% 2.190 1.520 - -7.88% -
450.soplex (max) -27.27% 11.000 8.000 - -96.79% -
429.mcf (max) -20.00% 10.000 8.000 - -99.65% -
429.mcf (max) (percentage) -17.24% 0.870 0.720 - -95.59% -
444.namd (max) -14.29% 14.000 12.000 - -98.80% -
464.h264ref (max) -14.29% 7.000 6.000 - -90.00% -
401.bzip2 (max) (percentage) -12.50% 0.560 0.490 - -87.04% -
401.bzip2 (unexplained diff vs previous) (percentage) -12.50% 0.560 0.490 - 145.00% -
401.bzip2 (max) -12.50% 16.000 14.000 - -97.70% -
401.bzip2 (unexplained diff vs previous) -12.50% 16.000 14.000 - -57.58% -
433.milc (max) -10.00% 10.000 9.000 - -91.67% -
470.lbm (max) -10.00% 20.000 18.000 - -97.63% -
470.lbm (max) (percentage) -10.00% 0.500 0.450 - -92.13% -
433.milc (max) (percentage) -9.57% 0.940 0.850 - 6.25% -
447.dealII (max) -9.09% 11.000 10.000 - -95.52% -
458.sjeng (max) (percentage) -8.93% 0.560 0.510 - -90.08% -
458.sjeng (max) -8.70% 46.000 42.000 - -95.21% -
444.namd (max) (percentage) -8.62% 1.740 1.590 - -80.35% -
444.namd (unexplained diff vs previous) -7.14% 14.000 13.000 - 62.50% -
471.omnetpp (max) -6.90% 29.000 27.000 - -97.22% -
444.namd (unexplained diff vs previous) (percentage) -5.85% 1.710 1.610 - 2583.33% -
471.omnetpp (max) (percentage) -5.83% 1.030 0.970 - -89.55% -
462.libquantum (max) (percentage) -3.76% 1.860 1.790 - -71.94% -
471.omnetpp -3.61% 83.000 80.000 - -52.10% -
471.omnetpp (avg) -3.61% 83.000 80.000 - -52.10% -
464.h264ref (avg) (percentage) -3.57% 0.560 0.540 - 86.21% -
429.mcf -3.57% 28.000 27.000 - -90.88% -
429.mcf (avg) -3.57% 28.000 27.000 - -90.88% -
470.lbm (avg) (percentage) -3.51% 1.710 1.650 - -50.45% -
447.dealII (max) (percentage) -3.51% 0.570 0.550 - -76.89% -
482.sphinx3 (max) (percentage) -3.33% 0.300 0.290 - -91.24% -
429.mcf (avg) (percentage) -3.20% 2.500 2.420 - 14.15% -
464.h264ref -3.03% 33.000 32.000 - -23.81% -
464.h264ref (avg) -3.03% 33.000 32.000 - -23.81% -
470.lbm -2.94% 68.000 66.000 - -85.03% -
470.lbm (avg) -2.94% 68.000 66.000 - -85.03% -
458.sjeng (avg) (percentage) -2.78% 0.720 0.700 - -12.50% -
483.xalancbmk (avg) (percentage) -2.64% 3.030 2.950 - 39.15% -
456.hmmer (avg) (percentage) -2.39% 2.510 2.450 - 76.26% -
456.hmmer -2.11% 95.000 93.000 - -43.29% -
456.hmmer (avg) -2.11% 95.000 93.000 - -43.29% -
471.omnetpp (avg) (percentage) -2.04% 2.940 2.880 - 80.00% -
483.xalancbmk -1.96% 102.000 100.000 - -49.49% -
483.xalancbmk (avg) -1.96% 102.000 100.000 - -49.49% -
458.sjeng -1.69% 59.000 58.000 - -57.35% -
458.sjeng (avg) -1.69% 59.000 58.000 - -57.35% -
453.povray (max) (percentage) -1.65% 1.210 1.190 - 230.56% -
473.astar (avg) (percentage) -1.65% 1.210 1.190 - 29.35% -
401.bzip2 (avg) (percentage) -1.32% 0.760 0.750 - 15.38% -
403.gcc (max) (percentage) -1.22% 4.930 4.870 - 109.01% -
450.soplex (avg) (percentage) -1.11% 0.900 0.890 - 78.00% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.13% 146765.000 149896.000 - -0.01% -
471.omnetpp 1.45% 316676.000 321281.000 - -0.01% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 15900.00% 0.010 1.600 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 2583.33% 0.060 1.610 - -5.85% -
453.povray (max) (percentage) 230.56% 0.360 1.190 - -1.65% -
473.astar (unexplained diff vs previous) (percentage) 205.00% 0.200 0.610 - 2950.00% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 0.00% -
403.gcc (avg) (percentage) 183.64% 0.550 1.560 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 145.00% 0.200 0.490 - -12.50% -
462.libquantum (avg) (percentage) 123.38% 0.770 1.720 - -0.58% -
403.gcc (max) (percentage) 109.01% 2.330 4.870 - -1.22% -
464.h264ref (avg) (percentage) 86.21% 0.290 0.540 - -3.57% -
471.omnetpp (avg) (percentage) 80.00% 1.600 2.880 - -2.04% -
450.soplex (avg) (percentage) 78.00% 0.500 0.890 - -1.11% -
456.hmmer (avg) (percentage) 76.26% 1.390 2.450 - -2.39% -
444.namd (unexplained diff vs previous) 62.50% 8.000 13.000 - -7.14% -
456.hmmer (unexplained diff vs previous) (percentage) 53.85% 0.390 0.600 - 275.00% -
483.xalancbmk (avg) (percentage) 39.15% 2.120 2.950 - -2.64% -
473.astar (avg) (percentage) 29.35% 0.920 1.190 - -1.65% -
450.soplex (unexplained diff vs previous) (percentage) 21.74% 0.460 0.560 - -66.27% -
453.povray (avg) (percentage) 17.50% 0.800 0.940 - 0.00% -
473.astar (unexplained diff vs previous) 16.00% 25.000 29.000 - 2800.00% -
401.bzip2 (avg) (percentage) 15.38% 0.650 0.750 - -1.32% -
429.mcf (avg) (percentage) 14.15% 2.120 2.420 - -3.20% -
429.mcf (unexplained diff vs previous) (percentage) 6.25% 0.160 0.170 - -80.46% -
433.milc (max) (percentage) 6.25% 0.800 0.850 - -9.57% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.15% 7239.000 7011.000 - 0.00% -
462.libquantum -2.41% 12504.000 12203.000 - 0.00% -
453.povray -1.88% 524493.000 514631.000 - -0.01% -
433.milc -1.41% 47001.000 46337.000 - 0.08% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9509.000 57.000 - -5.00% -
462.libquantum -98.70% 14409.000 187.000 - 1.63% -
450.soplex -96.43% 15112.000 540.000 - -0.55% -
482.sphinx3 -96.27% 26682.000 996.000 - -0.40% -
444.namd -93.50% 12400.000 806.000 - -1.59% -
453.povray -92.70% 6987.000 510.000 - 1.80% -
429.mcf -91.76% 13988.000 1153.000 - -0.17% -
433.milc -91.43% 13601.000 1166.000 - 1.04% -
401.bzip2 -82.15% 16137.000 2881.000 - 0.49% -
447.dealII -78.77% 9380.000 1991.000 - -0.70% -
471.omnetpp -73.25% 10477.000 2803.000 - -0.88% -
470.lbm -69.73% 13259.000 4014.000 - 0.07% -
456.hmmer -67.75% 11854.000 3823.000 - 0.61% -
483.xalancbmk -63.65% 9376.000 3408.000 - 1.04% -
473.astar -61.41% 12272.000 4736.000 - 0.62% -
464.h264ref -58.66% 14498.000 5993.000 - 0.00% -
445.gobmk -55.91% 11093.000 4891.000 - -0.24% -
458.sjeng -51.32% 17055.000 8303.000 - 0.17% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (max) -99.77% 883.000 2.000 - -33.33% -
462.libquantum (max) -99.67% 919.000 3.000 - 0.00% -
429.mcf (max) -99.65% 2281.000 8.000 - -20.00% -
470.lbm (unexplained diff vs previous) -99.63% 804.000 3.000 - -85.00% -
403.gcc (max) -99.10% 221.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.84% 6.060 0.070 - -86.00% -
444.namd (max) -98.80% 1003.000 12.000 - -14.29% -
456.hmmer (max) -98.15% 1242.000 23.000 - 187.50% -
401.bzip2 (max) -97.70% 609.000 14.000 - -12.50% -
482.sphinx3 -97.63% 464.000 11.000 - 0.00% -
482.sphinx3 (avg) -97.63% 464.000 11.000 - 0.00% -
470.lbm (max) -97.63% 758.000 18.000 - -10.00% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
471.omnetpp (max) -97.22% 972.000 27.000 - -6.90% -
483.xalancbmk (max) -97.11% 1209.000 35.000 - 75.00% -
450.soplex (max) -96.79% 249.000 8.000 - -27.27% -
473.astar (max) -96.47% 822.000 29.000 - 38.10% -
445.gobmk (max) -95.88% 413.000 17.000 - 0.00% -
450.soplex (unexplained diff vs previous) -95.65% 69.000 3.000 - -66.67% -
444.namd -95.60% 318.000 14.000 - 0.00% -
444.namd (avg) -95.60% 318.000 14.000 - 0.00% -
429.mcf (max) (percentage) -95.59% 16.310 0.720 - -17.24% -
447.dealII (max) -95.52% 223.000 10.000 - -9.09% -
458.sjeng (max) -95.21% 876.000 42.000 - -8.70% -
450.soplex -94.67% 75.000 4.000 - 0.00% -
450.soplex (avg) -94.67% 75.000 4.000 - 0.00% -
456.hmmer (max) (percentage) -94.18% 10.480 0.610 - 177.27% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
470.lbm (max) (percentage) -92.13% 5.720 0.450 - -10.00% -
483.xalancbmk (max) (percentage) -91.94% 12.900 1.040 - 70.49% -
433.milc (max) -91.67% 108.000 9.000 - -10.00% -
482.sphinx3 (max) (percentage) -91.24% 3.310 0.290 - -3.33% -
429.mcf (unexplained diff vs previous) -90.91% 22.000 2.000 - -80.00% -
429.mcf -90.88% 296.000 27.000 - -3.57% -
429.mcf (avg) -90.88% 296.000 27.000 - -3.57% -
473.astar (max) (percentage) -90.75% 6.700 0.620 - 34.78% -
445.gobmk (max) (percentage) -90.62% 3.730 0.350 - 0.00% -
458.sjeng (max) (percentage) -90.08% 5.140 0.510 - -8.93% -
464.h264ref (max) -90.00% 60.000 6.000 - -14.29% -
471.omnetpp (max) (percentage) -89.55% 9.280 0.970 - -5.83% -
401.bzip2 (max) (percentage) -87.04% 3.780 0.490 - -12.50% -
470.lbm -85.03% 441.000 66.000 - -2.94% -
470.lbm (avg) -85.03% 441.000 66.000 - -2.94% -
447.dealII -82.65% 98.000 17.000 - 0.00% -
447.dealII (avg) -82.65% 98.000 17.000 - 0.00% -
444.namd (max) (percentage) -80.35% 8.090 1.590 - -8.62% -
401.bzip2 -79.81% 104.000 21.000 - 0.00% -
401.bzip2 (avg) -79.81% 104.000 21.000 - 0.00% -
447.dealII (max) (percentage) -76.89% 2.380 0.550 - -3.51% -
453.povray (max) -76.00% 25.000 6.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -75.73% 103.000 25.000 - 127.27% -
464.h264ref (max) (percentage) -73.81% 0.420 0.110 - -8.33% -
462.libquantum (max) (percentage) -71.94% 6.380 1.790 - -3.76% -
445.gobmk -66.22% 74.000 25.000 - 0.00% -
445.gobmk (avg) -66.22% 74.000 25.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -57.58% 33.000 14.000 - -12.50% -
458.sjeng -57.35% 136.000 58.000 - -1.69% -
458.sjeng (avg) -57.35% 136.000 58.000 - -1.69% -
471.omnetpp -52.10% 167.000 80.000 - -3.61% -
471.omnetpp (avg) -52.10% 167.000 80.000 - -3.61% -
470.lbm (avg) (percentage) -50.45% 3.330 1.650 - -3.51% -
456.hmmer (unexplained diff vs previous) -50.00% 46.000 23.000 - 283.33% -
473.astar -50.00% 112.000 56.000 - 0.00% -
473.astar (avg) -50.00% 112.000 56.000 - 0.00% -
483.xalancbmk -49.49% 198.000 100.000 - -1.96% -
483.xalancbmk (avg) -49.49% 198.000 100.000 - -1.96% -
456.hmmer -43.29% 164.000 93.000 - -2.11% -
456.hmmer (avg) -43.29% 164.000 93.000 - -2.11% -
482.sphinx3 (avg) (percentage) -33.91% 1.740 1.150 - 0.00% -
444.namd (avg) (percentage) -31.52% 2.570 1.760 - -0.56% -
464.h264ref -23.81% 42.000 32.000 - -3.03% -
464.h264ref (avg) -23.81% 42.000 32.000 - -3.03% -
445.gobmk (avg) (percentage) -20.90% 0.670 0.530 - 0.00% -
447.dealII (avg) (percentage) -17.14% 1.050 0.870 - 0.00% -
433.milc (avg) (percentage) -16.28% 0.860 0.720 - 0.00% -
458.sjeng (avg) (percentage) -12.50% 0.800 0.700 - -2.78% -
471.omnetpp (unexplained diff vs previous) (percentage) -9.18% 0.980 0.890 - 128.21% -
450.soplex (max) (percentage) -7.88% 1.650 1.520 - -30.59% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.42s
Execution (seconds)
Name Current %
401.bzip2 2881.000 -
403.gcc 57.000 -5.00%
429.mcf 1153.000 -
433.milc 1166.000 1.04%
444.namd 806.000 -1.59%
445.gobmk 4891.000 -
447.dealII 1991.000 -
450.soplex 540.000 -
453.povray 510.000 1.80%
456.hmmer 3823.000 -
458.sjeng 8303.000 -
462.libquantum 187.000 1.63%
464.h264ref 5993.000 -
470.lbm 4014.000 -
471.omnetpp 2803.000 -
473.astar 4736.000 -
482.sphinx3 996.000 -
483.xalancbmk 3408.000 1.04%
Geometric Mean 1562.190 -
Code Size (bytes)
Name Current %
401.bzip2 33717.000 -
403.gcc 1665471.000 -
429.mcf 7011.000 -
433.milc 46337.000 -
444.namd 124246.000 -
445.gobmk 1258981.000 -
447.dealII 197142.000 -
450.soplex 149896.000 -
453.povray 514631.000 -
456.hmmer 80401.000 -
458.sjeng 79834.000 -
462.libquantum 12203.000 -
464.h264ref 301775.000 -
470.lbm 9236.000 -
471.omnetpp 321281.000 -
473.astar 15603.000 -
482.sphinx3 87696.000 -
483.xalancbmk 1612144.000 -
Geometric Mean 111159.244 -
sample variability
Name Current %
401.bzip2 21.000 -
401.bzip2 (avg) 21.000 -
401.bzip2 (avg) (percentage) 0.750 -1.32%
401.bzip2 (max) 14.000 -12.50%
401.bzip2 (max) (percentage) 0.490 -12.50%
401.bzip2 (unexplained diff vs previous) 14.000 -12.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.490 -12.50%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.560 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.870 -1.22%
429.mcf 27.000 -3.57%
429.mcf (avg) 27.000 -3.57%
429.mcf (avg) (percentage) 2.420 -3.20%
429.mcf (max) 8.000 -20.00%
429.mcf (max) (percentage) 0.720 -17.24%
429.mcf (unexplained diff vs previous) 2.000 -80.00%
429.mcf (unexplained diff vs previous) (percentage) 0.170 -80.46%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.720 -
433.milc (max) 9.000 -10.00%
433.milc (max) (percentage) 0.850 -9.57%
444.namd 14.000 -
444.namd (avg) 14.000 -
444.namd (avg) (percentage) 1.760 -
444.namd (max) 12.000 -14.29%
444.namd (max) (percentage) 1.590 -8.62%
444.namd (unexplained diff vs previous) 13.000 -7.14%
444.namd (unexplained diff vs previous) (percentage) 1.610 -5.85%
445.gobmk 25.000 -
445.gobmk (avg) 25.000 -
445.gobmk (avg) (percentage) 0.530 -
445.gobmk (max) 17.000 -
445.gobmk (max) (percentage) 0.350 -
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 0.870 -
447.dealII (max) 10.000 -9.09%
447.dealII (max) (percentage) 0.550 -3.51%
450.soplex 4.000 -
450.soplex (avg) 4.000 -
450.soplex (avg) (percentage) 0.890 -1.11%
450.soplex (max) 8.000 -27.27%
450.soplex (max) (percentage) 1.520 -30.59%
450.soplex (unexplained diff vs previous) 3.000 -66.67%
450.soplex (unexplained diff vs previous) (percentage) 0.560 -66.27%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.940 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.190 -1.65%
456.hmmer 93.000 -2.11%
456.hmmer (avg) 93.000 -2.11%
456.hmmer (avg) (percentage) 2.450 -2.39%
456.hmmer (max) 23.000 187.50%
456.hmmer (max) (percentage) 0.610 177.27%
456.hmmer (unexplained diff vs previous) 23.000 283.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.600 275.00%
458.sjeng 58.000 -1.69%
458.sjeng (avg) 58.000 -1.69%
458.sjeng (avg) (percentage) 0.700 -2.78%
458.sjeng (max) 42.000 -8.70%
458.sjeng (max) (percentage) 0.510 -8.93%
458.sjeng (unexplained diff vs previous) 14.000 -70.21%
458.sjeng (unexplained diff vs previous) (percentage) 0.170 -70.18%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.720 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.790 -3.76%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.600 -
464.h264ref 32.000 -3.03%
464.h264ref (avg) 32.000 -3.03%
464.h264ref (avg) (percentage) 0.540 -3.57%
464.h264ref (max) 6.000 -14.29%
464.h264ref (max) (percentage) 0.110 -
464.h264ref (unexplained diff vs previous) 0.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.000 -
470.lbm 66.000 -2.94%
470.lbm (avg) 66.000 -2.94%
470.lbm (avg) (percentage) 1.650 -3.51%
470.lbm (max) 18.000 -10.00%
470.lbm (max) (percentage) 0.450 -10.00%
470.lbm (unexplained diff vs previous) 3.000 -85.00%
470.lbm (unexplained diff vs previous) (percentage) 0.070 -86.00%
471.omnetpp 80.000 -3.61%
471.omnetpp (avg) 80.000 -3.61%
471.omnetpp (avg) (percentage) 2.880 -2.04%
471.omnetpp (max) 27.000 -6.90%
471.omnetpp (max) (percentage) 0.970 -5.83%
471.omnetpp (unexplained diff vs previous) 25.000 127.27%
471.omnetpp (unexplained diff vs previous) (percentage) 0.890 128.21%
473.astar 56.000 -
473.astar (avg) 56.000 -
473.astar (avg) (percentage) 1.190 -1.65%
473.astar (max) 29.000 38.10%
473.astar (max) (percentage) 0.620 34.78%
473.astar (unexplained diff vs previous) 29.000 2800.00%
473.astar (unexplained diff vs previous) (percentage) 0.610 2950.00%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.150 -
482.sphinx3 (max) 2.000 -33.33%
482.sphinx3 (max) (percentage) 0.290 -3.33%
483.xalancbmk 100.000 -1.96%
483.xalancbmk (avg) 100.000 -1.96%
483.xalancbmk (avg) (percentage) 2.950 -2.64%
483.xalancbmk (max) 35.000 75.00%
483.xalancbmk (max) (percentage) 1.040 70.49%
483.xalancbmk (unexplained diff vs previous) 35.000 337.50%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.030 329.17%
Geometric Mean 3.042 -16.21%