Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/abe292f9f8d0ff339e7d94d1c3984b9fcb23d546 (+ 431 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/123/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0123 (llvmorg-19-init-05385-gabe292f9f8d0) 2024-03-11T18:25:45 0:00:00
Previous 0122 (llvmorg-19-init-04954-g672fc89347b8) 2024-03-08T05:34:22 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 18
Performance Improvements 56 114
Added Tests 3 9
Unchanged Tests 699 639
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.67% 60.000 61.000 - -99.36% -
447.dealII 1.23% 1954.000 1978.000 - -78.91% -
482.sphinx3 1.21% 988.000 1000.000 - -96.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 933.33% 0.030 0.310 - 55.00% -
401.bzip2 (unexplained diff vs previous) 800.00% 1.000 9.000 - -72.73% -
483.xalancbmk (unexplained diff vs previous) (percentage) 190.91% 0.440 1.280 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 186.67% 15.000 43.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 135.14% 0.370 0.870 - 1350.00% -
444.namd (unexplained diff vs previous) 133.33% 3.000 7.000 - -12.50% -
473.astar (max) 117.65% 17.000 37.000 - -95.50% -
473.astar (unexplained diff vs previous) (percentage) 113.16% 0.380 0.810 - 305.00% -
473.astar (unexplained diff vs previous) 111.11% 18.000 38.000 - 52.00% -
473.astar (max) (percentage) 110.53% 0.380 0.800 - -88.06% -
483.xalancbmk (max) 68.00% 25.000 42.000 - -96.53% -
483.xalancbmk (max) (percentage) 68.00% 0.750 1.260 - -90.23% -
444.namd (max) (percentage) 50.88% 0.570 0.860 - -89.37% -
444.namd (max) 50.00% 4.000 6.000 - -99.40% -
456.hmmer (unexplained diff vs previous) (percentage) 38.10% 0.210 0.290 - -25.64% -
456.hmmer (unexplained diff vs previous) 37.50% 8.000 11.000 - -76.09% -
456.hmmer (max) 22.22% 9.000 11.000 - -99.11% -
456.hmmer (max) (percentage) 11.54% 0.260 0.290 - -97.23% -
482.sphinx3 (avg) (percentage) 1.18% 0.850 0.860 - -50.57% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.37% 12299.000 12131.000 - -2.98% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -1.65% 547.000 538.000 - -96.44% -
483.xalancbmk -1.26% 3406.000 3363.000 - -64.13% -
462.libquantum -1.07% 187.000 185.000 - -98.72% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -97.50% 0.400 0.010 - 0.00% -
458.sjeng (unexplained diff vs previous) -96.97% 33.000 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -69.09% 55.000 17.000 - -83.50% -
471.omnetpp (unexplained diff vs previous) (percentage) -69.07% 1.940 0.600 - -38.78% -
429.mcf (unexplained diff vs previous) (percentage) -69.02% 2.550 0.790 - 393.75% -
429.mcf (unexplained diff vs previous) -68.97% 29.000 9.000 - -59.09% -
464.h264ref (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -57.60% 2.830 1.200 - -65.01% -
482.sphinx3 (unexplained diff vs previous) -57.14% 28.000 12.000 - -98.69% -
450.soplex (unexplained diff vs previous) -50.00% 18.000 9.000 - -86.96% -
450.soplex (unexplained diff vs previous) (percentage) -49.24% 3.290 1.670 - 263.04% -
433.milc (unexplained diff vs previous) (percentage) -34.62% 0.260 0.170 - 70.00% -
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 - -84.62% -
464.h264ref (max) (percentage) -18.18% 0.110 0.090 - -78.57% -
453.povray (max) -16.67% 6.000 5.000 - -80.00% -
464.h264ref (max) -16.67% 6.000 5.000 - -91.67% -
429.mcf (max) -14.29% 28.000 24.000 - -98.95% -
429.mcf (max) (percentage) -12.45% 2.490 2.180 - -86.63% -
482.sphinx3 (max) -11.11% 27.000 24.000 - -97.28% -
482.sphinx3 (max) (percentage) -10.14% 2.760 2.480 - -25.08% -
471.omnetpp (max) -8.93% 56.000 51.000 - -94.75% -
471.omnetpp (max) (percentage) -8.08% 1.980 1.820 - -80.39% -
433.milc (max) -7.69% 13.000 12.000 - -88.89% -
447.dealII (max) -7.69% 13.000 12.000 - -94.62% -
401.bzip2 (max) -7.14% 14.000 13.000 - -97.87% -
445.gobmk (max) (percentage) -6.98% 0.430 0.400 - -89.28% -
447.dealII (max) (percentage) -5.80% 0.690 0.650 - -72.69% -
433.milc (max) (percentage) -5.31% 1.130 1.070 - 33.75% -
450.soplex (max) -5.26% 19.000 18.000 - -92.77% -
464.h264ref -5.26% 19.000 18.000 - -57.14% -
464.h264ref (avg) -5.26% 19.000 18.000 - -57.14% -
458.sjeng (max) (percentage) -5.00% 0.400 0.380 - -92.61% -
445.gobmk (max) -5.00% 20.000 19.000 - -95.40% -
462.libquantum (max) (percentage) -4.21% 2.850 2.730 - -57.21% -
401.bzip2 (max) (percentage) -4.08% 0.490 0.470 - -87.57% -
450.soplex (max) (percentage) -3.69% 3.520 3.390 - 105.45% -
458.sjeng (max) -3.12% 32.000 31.000 - -96.46% -
464.h264ref (avg) (percentage) -3.03% 0.330 0.320 - 10.34% -
458.sjeng -2.70% 37.000 36.000 - -73.53% -
458.sjeng (avg) -2.70% 37.000 36.000 - -73.53% -
458.sjeng (avg) (percentage) -2.22% 0.450 0.440 - -45.00% -
401.bzip2 (avg) (percentage) -1.92% 0.520 0.510 - -21.54% -
471.omnetpp -1.82% 55.000 54.000 - -67.66% -
471.omnetpp (avg) -1.82% 55.000 54.000 - -67.66% -
483.xalancbmk -1.72% 58.000 57.000 - -71.21% -
483.xalancbmk (avg) -1.72% 58.000 57.000 - -71.21% -
453.povray (max) (percentage) -1.65% 1.210 1.190 - 230.56% -
433.milc (avg) (percentage) -1.56% 0.640 0.630 - -26.74% -
471.omnetpp (avg) (percentage) -1.52% 1.970 1.940 - 21.25% -
456.hmmer (avg) (percentage) -1.47% 1.360 1.340 - -3.60% -
429.mcf (avg) (percentage) -1.14% 1.760 1.740 - -17.92% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.97% 146765.000 149660.000 - 0.00% -
471.omnetpp 1.38% 316676.000 321037.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) (percentage) 1350.00% 0.060 0.870 - 135.14% -
429.mcf (unexplained diff vs previous) (percentage) 393.75% 0.160 0.790 - -69.02% -
473.astar (unexplained diff vs previous) (percentage) 305.00% 0.200 0.810 - 113.16% -
450.soplex (unexplained diff vs previous) (percentage) 263.04% 0.460 1.670 - -49.24% -
453.povray (max) (percentage) 230.56% 0.360 1.190 - -1.65% -
450.soplex (avg) (percentage) 182.00% 0.500 1.410 - 0.71% -
403.gcc (avg) (percentage) 114.55% 0.550 1.180 - 0.00% -
450.soplex (max) (percentage) 105.45% 1.650 3.390 - -3.69% -
462.libquantum (avg) (percentage) 102.60% 0.770 1.560 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 70.00% 0.100 0.170 - -34.62% -
401.bzip2 (unexplained diff vs previous) (percentage) 55.00% 0.200 0.310 - 933.33% -
473.astar (unexplained diff vs previous) 52.00% 25.000 38.000 - 111.11% -
433.milc (max) (percentage) 33.75% 0.800 1.070 - -5.31% -
471.omnetpp (avg) (percentage) 21.25% 1.600 1.940 - -1.52% -
453.povray (avg) (percentage) 20.00% 0.800 0.960 - 0.00% -
464.h264ref (avg) (percentage) 10.34% 0.290 0.320 - -3.03% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.92% 7239.000 6955.000 - 0.00% -
462.libquantum -2.98% 12504.000 12131.000 - -1.37% -
453.povray -2.16% 524493.000 513187.000 - -0.00% -
433.milc -2.14% 47001.000 45997.000 - 0.00% -
464.h264ref -1.82% 303767.000 298239.000 - -0.01% -
444.namd -1.57% 124963.000 123006.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9509.000 61.000 - 1.67% -
462.libquantum -98.72% 14409.000 185.000 - -1.07% -
450.soplex -96.44% 15112.000 538.000 - -1.65% -
482.sphinx3 -96.25% 26682.000 1000.000 - 1.21% -
444.namd -93.52% 12400.000 803.000 - -0.86% -
453.povray -92.83% 6987.000 501.000 - 0.20% -
429.mcf -91.81% 13988.000 1145.000 - 0.79% -
433.milc -91.38% 13601.000 1172.000 - 0.17% -
401.bzip2 -82.21% 16137.000 2871.000 - 0.31% -
447.dealII -78.91% 9380.000 1978.000 - 1.23% -
471.omnetpp -73.16% 10477.000 2812.000 - -0.60% -
470.lbm -69.75% 13259.000 4011.000 - 0.15% -
456.hmmer -67.89% 11854.000 3806.000 - -0.29% -
483.xalancbmk -64.13% 9376.000 3363.000 - -1.26% -
473.astar -61.84% 12272.000 4683.000 - -0.80% -
464.h264ref -59.53% 14498.000 5867.000 - -0.02% -
445.gobmk -56.07% 11093.000 4873.000 - 0.33% -
458.sjeng -51.69% 17055.000 8240.000 - -0.01% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (max) -99.47% 758.000 4.000 - 0.00% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
444.namd (max) -99.40% 1003.000 6.000 - 50.00% -
456.hmmer (max) -99.11% 1242.000 11.000 - 22.22% -
429.mcf (max) -98.95% 2281.000 24.000 - -14.29% -
482.sphinx3 (unexplained diff vs previous) -98.69% 914.000 12.000 - -57.14% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
470.lbm (max) (percentage) -98.25% 5.720 0.100 - 0.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
401.bzip2 (max) -97.87% 609.000 13.000 - -7.14% -
482.sphinx3 (max) -97.28% 883.000 24.000 - -11.11% -
456.hmmer (max) (percentage) -97.23% 10.480 0.290 - 11.54% -
444.namd -97.17% 318.000 9.000 - 0.00% -
444.namd (avg) -97.17% 318.000 9.000 - 0.00% -
483.xalancbmk (max) -96.53% 1209.000 42.000 - 68.00% -
458.sjeng (max) -96.46% 876.000 31.000 - -3.12% -
473.astar (max) -95.50% 822.000 37.000 - 117.65% -
445.gobmk (max) -95.40% 413.000 19.000 - -5.00% -
471.omnetpp (max) -94.75% 972.000 51.000 - -8.93% -
447.dealII (max) -94.62% 223.000 12.000 - -7.69% -
433.milc -93.97% 116.000 7.000 - 0.00% -
433.milc (avg) -93.97% 116.000 7.000 - 0.00% -
429.mcf -93.58% 296.000 19.000 - 0.00% -
429.mcf (avg) -93.58% 296.000 19.000 - 0.00% -
450.soplex (max) -92.77% 249.000 18.000 - -5.26% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
458.sjeng (max) (percentage) -92.61% 5.140 0.380 - -5.00% -
470.lbm -92.29% 441.000 34.000 - 0.00% -
470.lbm (avg) -92.29% 441.000 34.000 - 0.00% -
464.h264ref (max) -91.67% 60.000 5.000 - -16.67% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
483.xalancbmk (max) (percentage) -90.23% 12.900 1.260 - 68.00% -
444.namd (max) (percentage) -89.37% 8.090 0.860 - 50.88% -
445.gobmk (max) (percentage) -89.28% 3.730 0.400 - -6.98% -
433.milc (max) -88.89% 108.000 12.000 - -7.69% -
473.astar (max) (percentage) -88.06% 6.700 0.800 - 110.53% -
447.dealII -87.76% 98.000 12.000 - 0.00% -
447.dealII (avg) -87.76% 98.000 12.000 - 0.00% -
401.bzip2 (max) (percentage) -87.57% 3.780 0.470 - -4.08% -
450.soplex (unexplained diff vs previous) -86.96% 69.000 9.000 - -50.00% -
429.mcf (max) (percentage) -86.63% 16.310 2.180 - -12.45% -
401.bzip2 -86.54% 104.000 14.000 - 0.00% -
401.bzip2 (avg) -86.54% 104.000 14.000 - 0.00% -
433.milc (unexplained diff vs previous) -84.62% 13.000 2.000 - -33.33% -
471.omnetpp (unexplained diff vs previous) -83.50% 103.000 17.000 - -69.09% -
471.omnetpp (max) (percentage) -80.39% 9.280 1.820 - -8.08% -
453.povray (max) -80.00% 25.000 5.000 - -16.67% -
464.h264ref (max) (percentage) -78.57% 0.420 0.090 - -18.18% -
456.hmmer (unexplained diff vs previous) -76.09% 46.000 11.000 - 37.50% -
445.gobmk -75.68% 74.000 18.000 - 0.00% -
445.gobmk (avg) -75.68% 74.000 18.000 - 0.00% -
470.lbm (avg) (percentage) -74.17% 3.330 0.860 - 0.00% -
458.sjeng -73.53% 136.000 36.000 - -2.70% -
458.sjeng (avg) -73.53% 136.000 36.000 - -2.70% -
401.bzip2 (unexplained diff vs previous) -72.73% 33.000 9.000 - 800.00% -
447.dealII (max) (percentage) -72.69% 2.380 0.650 - -5.80% -
483.xalancbmk -71.21% 198.000 57.000 - -1.72% -
483.xalancbmk (avg) -71.21% 198.000 57.000 - -1.72% -
473.astar -70.54% 112.000 33.000 - 0.00% -
473.astar (avg) -70.54% 112.000 33.000 - 0.00% -
456.hmmer -68.90% 164.000 51.000 - 0.00% -
456.hmmer (avg) -68.90% 164.000 51.000 - 0.00% -
471.omnetpp -67.66% 167.000 54.000 - -1.82% -
471.omnetpp (avg) -67.66% 167.000 54.000 - -1.82% -
482.sphinx3 (unexplained diff vs previous) (percentage) -65.01% 3.430 1.200 - -57.60% -
429.mcf (unexplained diff vs previous) -59.09% 22.000 9.000 - -68.97% -
462.libquantum (max) (percentage) -57.21% 6.380 2.730 - -4.21% -
464.h264ref -57.14% 42.000 18.000 - -5.26% -
464.h264ref (avg) -57.14% 42.000 18.000 - -5.26% -
444.namd (avg) (percentage) -55.25% 2.570 1.150 - -0.86% -
482.sphinx3 (avg) (percentage) -50.57% 1.740 0.860 - 1.18% -
403.gcc (max) (percentage) -45.49% 2.330 1.270 - -0.78% -
458.sjeng (avg) (percentage) -45.00% 0.800 0.440 - -2.22% -
445.gobmk (avg) (percentage) -43.28% 0.670 0.380 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -38.78% 0.980 0.600 - -69.07% -
447.dealII (avg) (percentage) -38.10% 1.050 0.650 - 0.00% -
433.milc (avg) (percentage) -26.74% 0.860 0.630 - -1.56% -
456.hmmer (unexplained diff vs previous) (percentage) -25.64% 0.390 0.290 - 38.10% -
482.sphinx3 (max) (percentage) -25.08% 3.310 2.480 - -10.14% -
473.astar (avg) (percentage) -22.83% 0.920 0.710 - 0.00% -
401.bzip2 (avg) (percentage) -21.54% 0.650 0.510 - -1.92% -
483.xalancbmk (avg) (percentage) -19.34% 2.120 1.710 - -0.58% -
429.mcf (avg) (percentage) -17.92% 2.120 1.740 - -1.14% -
444.namd (unexplained diff vs previous) -12.50% 8.000 7.000 - 133.33% -
456.hmmer (avg) (percentage) -3.60% 1.390 1.340 - -1.47% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 2871.000 -
403.gcc 61.000 1.67%
429.mcf 1145.000 -
433.milc 1172.000 -
444.namd 803.000 -
445.gobmk 4873.000 -
447.dealII 1978.000 1.23%
450.soplex 538.000 -1.65%
453.povray 501.000 -
456.hmmer 3806.000 -
458.sjeng 8240.000 -
462.libquantum 185.000 -1.07%
464.h264ref 5867.000 -
470.lbm 4011.000 -
471.omnetpp 2812.000 -
473.astar 4683.000 -
482.sphinx3 1000.000 1.21%
483.xalancbmk 3363.000 -1.26%
Geometric Mean 1559.145 -
Code Size (bytes)
Name Current %
401.bzip2 33589.000 -
403.gcc 1661739.000 -
429.mcf 6955.000 -
433.milc 45997.000 -
444.namd 123006.000 -
445.gobmk 1256521.000 -
447.dealII 196398.000 -
450.soplex 149660.000 -
453.povray 513187.000 -
456.hmmer 80393.000 -
458.sjeng 79906.000 -
462.libquantum 12131.000 -1.37%
464.h264ref 298239.000 -
470.lbm 9236.000 -
471.omnetpp 321037.000 -
473.astar 15571.000 -
482.sphinx3 87456.000 -
483.xalancbmk 1610384.000 -
Geometric Mean 110757.750 -
sample variability
Name Current %
401.bzip2 14.000 -
401.bzip2 (avg) 14.000 -
401.bzip2 (avg) (percentage) 0.510 -1.92%
401.bzip2 (max) 13.000 -7.14%
401.bzip2 (max) (percentage) 0.470 -4.08%
401.bzip2 (unexplained diff vs previous) 9.000 800.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 933.33%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.180 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 1.270 -
429.mcf 19.000 -
429.mcf (avg) 19.000 -
429.mcf (avg) (percentage) 1.740 -1.14%
429.mcf (max) 24.000 -14.29%
429.mcf (max) (percentage) 2.180 -12.45%
429.mcf (unexplained diff vs previous) 9.000 -68.97%
429.mcf (unexplained diff vs previous) (percentage) 0.790 -69.02%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.630 -1.56%
433.milc (max) 12.000 -7.69%
433.milc (max) (percentage) 1.070 -5.31%
433.milc (unexplained diff vs previous) 2.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.170 -34.62%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 6.000 50.00%
444.namd (max) (percentage) 0.860 50.88%
444.namd (unexplained diff vs previous) 7.000 133.33%
444.namd (unexplained diff vs previous) (percentage) 0.870 135.14%
445.gobmk 18.000 -
445.gobmk (avg) 18.000 -
445.gobmk (avg) (percentage) 0.380 -
445.gobmk (max) 19.000 -5.00%
445.gobmk (max) (percentage) 0.400 -6.98%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.650 -
447.dealII (max) 12.000 -7.69%
447.dealII (max) (percentage) 0.650 -5.80%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.410 -
450.soplex (max) 18.000 -5.26%
450.soplex (max) (percentage) 3.390 -3.69%
450.soplex (unexplained diff vs previous) 9.000 -50.00%
450.soplex (unexplained diff vs previous) (percentage) 1.670 -49.24%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.960 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.190 -1.65%
456.hmmer 51.000 -
456.hmmer (avg) 51.000 -
456.hmmer (avg) (percentage) 1.340 -1.47%
456.hmmer (max) 11.000 22.22%
456.hmmer (max) (percentage) 0.290 11.54%
456.hmmer (unexplained diff vs previous) 11.000 37.50%
456.hmmer (unexplained diff vs previous) (percentage) 0.290 38.10%
458.sjeng 36.000 -2.70%
458.sjeng (avg) 36.000 -2.70%
458.sjeng (avg) (percentage) 0.440 -2.22%
458.sjeng (max) 31.000 -3.12%
458.sjeng (max) (percentage) 0.380 -5.00%
458.sjeng (unexplained diff vs previous) 1.000 -96.97%
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -97.50%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.560 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.730 -4.21%
464.h264ref 18.000 -5.26%
464.h264ref (avg) 18.000 -5.26%
464.h264ref (avg) (percentage) 0.320 -3.03%
464.h264ref (max) 5.000 -16.67%
464.h264ref (max) (percentage) 0.090 -18.18%
464.h264ref (unexplained diff vs previous) 1.000 -66.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -60.00%
470.lbm 34.000 -
470.lbm (avg) 34.000 -
470.lbm (avg) (percentage) 0.860 -
470.lbm (max) 4.000 -
470.lbm (max) (percentage) 0.100 -
471.omnetpp 54.000 -1.82%
471.omnetpp (avg) 54.000 -1.82%
471.omnetpp (avg) (percentage) 1.940 -1.52%
471.omnetpp (max) 51.000 -8.93%
471.omnetpp (max) (percentage) 1.820 -8.08%
471.omnetpp (unexplained diff vs previous) 17.000 -69.09%
471.omnetpp (unexplained diff vs previous) (percentage) 0.600 -69.07%
473.astar 33.000 -
473.astar (avg) 33.000 -
473.astar (avg) (percentage) 0.710 -
473.astar (max) 37.000 117.65%
473.astar (max) (percentage) 0.800 110.53%
473.astar (unexplained diff vs previous) 38.000 111.11%
473.astar (unexplained diff vs previous) (percentage) 0.810 113.16%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.860 1.18%
482.sphinx3 (max) 24.000 -11.11%
482.sphinx3 (max) (percentage) 2.480 -10.14%
482.sphinx3 (unexplained diff vs previous) 12.000 -57.14%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.200 -57.60%
483.xalancbmk 57.000 -1.72%
483.xalancbmk (avg) 57.000 -1.72%
483.xalancbmk (avg) (percentage) 1.710 -
483.xalancbmk (max) 42.000 68.00%
483.xalancbmk (max) (percentage) 1.260 68.00%
483.xalancbmk (unexplained diff vs previous) 43.000 186.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.280 190.91%
Geometric Mean 2.763 -28.12%