Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9d8ccbc1be78fb4ba0ad1c6ead2dc04b24c66668 (+ 357 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/154/
View Options
Report
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0154 (llvmorg-19-init-08106-g9d8ccbc1be78) 2024-04-09T23:22:22 0:00:00
Previous 0153 (llvmorg-19-init-07749-g3f71d29e2370) 2024-04-07T08:30:50 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 62 2
Performance Improvements 66 3
Added Tests 7 119
Unchanged Tests 909 920
Total Tests 1044

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.07% 2511.000 2563.000 - 1.50% -
400.perlbench 1.92% 1618.000 1649.000 - 0.49% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (max) 650.00% 20.000 150.000 - 0.00% -
465.tonto (max) (percentage) 633.33% 0.030 0.220 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 633.33% 0.030 0.220 - 0.00% -
465.tonto (unexplained diff vs previous) 581.82% 22.000 150.000 - 0.00% -
465.tonto 375.00% 20.000 95.000 - 0.00% -
465.tonto (avg) 375.00% 20.000 95.000 - 0.00% -
465.tonto (avg) (percentage) 366.67% 0.030 0.140 - 0.00% -
445.gobmk (unexplained diff vs previous) 283.33% 6.000 23.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 283.33% 0.120 0.460 - 0.00% -
445.gobmk (max) (percentage) 275.00% 0.120 0.450 - 0.00% -
445.gobmk (max) 266.67% 6.000 22.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 240.00% 5.000 17.000 - 0.00% -
456.hmmer (max) (percentage) 233.33% 0.180 0.600 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 233.33% 0.180 0.600 - 0.00% -
456.hmmer (max) 220.00% 5.000 16.000 - 0.00% -
437.leslie3d (max) 209.09% 22.000 68.000 - 0.00% -
470.lbm (unexplained diff vs previous) 200.00% 5.000 15.000 - 0.00% -
437.leslie3d (max) (percentage) 200.00% 0.040 0.120 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 200.00% 0.040 0.120 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 193.75% 0.160 0.470 - 0.00% -
445.gobmk 180.00% 5.000 14.000 - 0.00% -
445.gobmk (avg) 180.00% 5.000 14.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 176.00% 25.000 69.000 - 0.00% -
445.gobmk (avg) (percentage) 154.55% 0.110 0.280 - 0.00% -
437.leslie3d 131.82% 22.000 51.000 - 0.00% -
437.leslie3d (avg) 131.82% 22.000 51.000 - 0.00% -
437.leslie3d (avg) (percentage) 125.00% 0.040 0.090 - 0.00% -
456.hmmer 120.00% 5.000 11.000 - 0.00% -
456.hmmer (avg) 120.00% 5.000 11.000 - 0.00% -
456.hmmer (avg) (percentage) 105.26% 0.190 0.390 - 0.00% -
410.bwaves (unexplained diff vs previous) 94.12% 17.000 33.000 - 0.00% -
410.bwaves (max) 88.24% 17.000 32.000 - 0.00% -
410.bwaves (max) (percentage) 87.50% 0.080 0.150 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 87.50% 0.080 0.150 - 0.00% -
459.GemsFDTD (max) 73.91% 23.000 40.000 - 0.00% -
459.GemsFDTD (max) (percentage) 70.00% 0.100 0.170 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 70.00% 0.100 0.170 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 66.67% 24.000 40.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 60.55% 1.090 1.750 - 0.00% -
429.mcf (unexplained diff vs previous) 57.14% 21.000 33.000 - 0.00% -
470.lbm 57.14% 7.000 11.000 - 0.00% -
470.lbm (avg) 57.14% 7.000 11.000 - 0.00% -
429.mcf (max) (percentage) 56.36% 1.100 1.720 - 0.00% -
470.lbm (max) 55.56% 9.000 14.000 - 0.00% -
429.mcf (max) 52.38% 21.000 32.000 - 0.00% -
470.lbm (max) (percentage) 51.61% 0.310 0.470 - 0.00% -
470.lbm (avg) (percentage) 50.00% 0.240 0.360 - 0.00% -
410.bwaves (avg) (percentage) 50.00% 0.080 0.120 - 0.00% -
410.bwaves 47.06% 17.000 25.000 - 0.00% -
410.bwaves (avg) 47.06% 17.000 25.000 - 0.00% -
459.GemsFDTD 43.48% 23.000 33.000 - 0.00% -
459.GemsFDTD (avg) 43.48% 23.000 33.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 40.00% 0.100 0.140 - 0.00% -
429.mcf 36.84% 19.000 26.000 - 0.00% -
429.mcf (avg) 36.84% 19.000 26.000 - 0.00% -
429.mcf (avg) (percentage) 33.98% 1.030 1.380 - 0.00% -
471.omnetpp 6.25% 48.000 51.000 - 0.00% -
471.omnetpp (avg) 6.25% 48.000 51.000 - 0.00% -
471.omnetpp (avg) (percentage) 3.63% 1.930 2.000 - 0.00% -
471.omnetpp (max) 1.92% 52.000 53.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -5.62% 89.000 84.000 - -5.62% -
403.gcc -3.33% 60.000 58.000 - -4.92% -
429.mcf -1.72% 1924.000 1891.000 - -1.51% -
453.povray -1.33% 452.000 446.000 - 1.59% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) -81.62% 5.170 0.950 - 0.00% -
450.soplex (unexplained diff vs previous) -81.48% 27.000 5.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -63.08% 0.650 0.240 - 0.00% -
433.milc (unexplained diff vs previous) -62.50% 8.000 3.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -62.04% 2.160 0.820 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -61.73% 81.000 31.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -57.83% 0.830 0.350 - 0.00% -
401.bzip2 (unexplained diff vs previous) -57.14% 21.000 9.000 - 0.00% -
444.namd (unexplained diff vs previous) -42.86% 7.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -42.72% 1.030 0.590 - 0.00% -
450.soplex (avg) (percentage) -40.28% 4.940 2.950 - 0.00% -
450.soplex -40.00% 25.000 15.000 - 0.00% -
450.soplex (avg) -40.00% 25.000 15.000 - 0.00% -
483.xalancbmk -36.71% 79.000 50.000 - 0.00% -
483.xalancbmk (avg) -36.71% 79.000 50.000 - 0.00% -
483.xalancbmk (avg) (percentage) -36.32% 2.120 1.350 - 0.00% -
473.astar (unexplained diff vs previous) -34.78% 23.000 15.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -34.09% 0.440 0.290 - 0.00% -
434.zeusmp (unexplained diff vs previous) -30.77% 13.000 9.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -26.67% 0.150 0.110 - 0.00% -
433.milc (avg) (percentage) -25.00% 0.480 0.360 - 0.00% -
401.bzip2 -21.43% 14.000 11.000 - 0.00% -
401.bzip2 (avg) -21.43% 14.000 11.000 - 0.00% -
473.astar (avg) (percentage) -20.41% 0.490 0.390 - 0.00% -
433.milc -20.00% 5.000 4.000 - 0.00% -
433.milc (avg) -20.00% 5.000 4.000 - 0.00% -
434.zeusmp (max) (percentage) -20.00% 0.150 0.120 - 0.00% -
473.astar -20.00% 25.000 20.000 - 0.00% -
473.astar (avg) -20.00% 25.000 20.000 - 0.00% -
444.namd (avg) (percentage) -19.59% 0.970 0.780 - 0.00% -
401.bzip2 (avg) (percentage) -19.30% 0.570 0.460 - 0.00% -
464.h264ref (max) -18.18% 22.000 18.000 - 0.00% -
447.dealII (max) -17.39% 23.000 19.000 - 0.00% -
464.h264ref (max) (percentage) -17.24% 0.580 0.480 - 0.00% -
433.milc (max) (percentage) -17.19% 0.640 0.530 - 0.00% -
401.bzip2 (max) (percentage) -17.07% 0.820 0.680 - 0.00% -
447.dealII (max) (percentage) -16.78% 1.490 1.240 - 0.00% -
450.soplex (max) (percentage) -16.67% 4.920 4.100 - 0.00% -
444.namd (max) (percentage) -16.67% 1.020 0.850 - 0.00% -
434.zeusmp (max) -16.67% 12.000 10.000 - 0.00% -
444.namd -16.67% 6.000 5.000 - 0.00% -
444.namd (avg) -16.67% 6.000 5.000 - 0.00% -
444.namd (max) -16.67% 6.000 5.000 - 0.00% -
458.sjeng (max) -16.67% 12.000 10.000 - 0.00% -
458.sjeng (max) (percentage) -16.67% 0.180 0.150 - 0.00% -
483.xalancbmk (max) (percentage) -16.51% 2.120 1.770 - 0.00% -
483.xalancbmk (max) -16.46% 79.000 66.000 - 0.00% -
450.soplex (max) -16.00% 25.000 21.000 - 0.00% -
401.bzip2 (max) -15.00% 20.000 17.000 - 0.00% -
433.milc (max) -14.29% 7.000 6.000 - 0.00% -
434.zeusmp (avg) (percentage) -13.33% 0.150 0.130 - 0.00% -
482.sphinx3 (max) -11.76% 17.000 15.000 - 0.00% -
473.astar (max) (percentage) -11.36% 0.440 0.390 - 0.00% -
482.sphinx3 (max) (percentage) -11.11% 2.160 1.920 - 0.00% -
453.povray (max) (percentage) -10.88% 2.390 2.130 - 0.00% -
453.povray (max) -10.00% 10.000 9.000 - 0.00% -
473.astar (max) -9.09% 22.000 20.000 - 0.00% -
434.zeusmp -8.33% 12.000 11.000 - 0.00% -
434.zeusmp (avg) -8.33% 12.000 11.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -5.58% 2.150 2.030 - 0.00% -
471.omnetpp (unexplained diff vs previous) -3.70% 54.000 52.000 - 0.00% -
471.omnetpp (max) (percentage) -1.90% 2.110 2.070 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
453.povray 1.59% 439.000 446.000 - -1.33% -
471.omnetpp 1.50% 2525.000 2563.000 - 2.07% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.62% 89.000 84.000 - -5.62% -
403.gcc -4.92% 61.000 58.000 - -3.33% -
429.mcf -1.51% 1920.000 1891.000 - -1.72% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
400.perlbench 1649.000 1.92%
401.bzip2 2549.000 -
403.gcc 58.000 -3.33%
410.bwaves 21470.000 -
429.mcf 1891.000 -1.72%
433.milc 1238.000 -
434.zeusmp 8492.000 -
437.leslie3d 56679.000 -
444.namd 681.000 -
445.gobmk 5032.000 -
447.dealII 1593.000 -
450.soplex 527.000 -
453.povray 446.000 -1.33%
456.hmmer 2828.000 -
458.sjeng 7176.000 -
459.GemsFDTD 23621.000 -
462.libquantum 84.000 -5.62%
464.h264ref 3955.000 -
465.tonto 68240.000 -
470.lbm 3189.000 -
471.omnetpp 2563.000 2.07%
473.astar 5183.000 -
482.sphinx3 804.000 -
483.xalancbmk 3775.000 -
Geometric Mean 2616.231 -
Code Size (bytes)
Name Current %
400.perlbench 1042135.000 -
401.bzip2 53812.000 -
403.gcc 3000568.000 -
410.bwaves 670608.000 -
429.mcf 11523.000 -
433.milc 103480.000 -
434.zeusmp 1364900.000 -
437.leslie3d 1134986.000 -
444.namd 193170.000 -
445.gobmk 1951390.000 -
447.dealII 2612189.000 -
450.soplex 302434.000 -
453.povray 771353.000 -
456.hmmer 251426.000 -
458.sjeng 124735.000 -
459.GemsFDTD 2148587.000 -
462.libquantum 36000.000 -
464.h264ref 460355.000 -
465.tonto 14242763.000 -
470.lbm 11420.000 -
471.omnetpp 630065.000 -
473.astar 34620.000 -
482.sphinx3 167633.000 -
483.xalancbmk 3925037.000 -
Geometric Mean 386674.161 -
sample variability
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 11.000 -21.43%
401.bzip2 (avg) 11.000 -21.43%
401.bzip2 (avg) (percentage) 0.460 -19.30%
401.bzip2 (max) 17.000 -15.00%
401.bzip2 (max) (percentage) 0.680 -17.07%
401.bzip2 (unexplained diff vs previous) 9.000 -57.14%
401.bzip2 (unexplained diff vs previous) (percentage) 0.350 -57.83%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.000 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
410.bwaves 25.000 47.06%
410.bwaves (avg) 25.000 47.06%
410.bwaves (avg) (percentage) 0.120 50.00%
410.bwaves (max) 32.000 88.24%
410.bwaves (max) (percentage) 0.150 87.50%
410.bwaves (unexplained diff vs previous) 33.000 94.12%
410.bwaves (unexplained diff vs previous) (percentage) 0.150 87.50%
429.mcf 26.000 36.84%
429.mcf (avg) 26.000 36.84%
429.mcf (avg) (percentage) 1.380 33.98%
429.mcf (max) 32.000 52.38%
429.mcf (max) (percentage) 1.720 56.36%
429.mcf (unexplained diff vs previous) 33.000 57.14%
429.mcf (unexplained diff vs previous) (percentage) 1.750 60.55%
433.milc 4.000 -20.00%
433.milc (avg) 4.000 -20.00%
433.milc (avg) (percentage) 0.360 -25.00%
433.milc (max) 6.000 -14.29%
433.milc (max) (percentage) 0.530 -17.19%
433.milc (unexplained diff vs previous) 3.000 -62.50%
433.milc (unexplained diff vs previous) (percentage) 0.240 -63.08%
434.zeusmp 11.000 -8.33%
434.zeusmp (avg) 11.000 -8.33%
434.zeusmp (avg) (percentage) 0.130 -13.33%
434.zeusmp (max) 10.000 -16.67%
434.zeusmp (max) (percentage) 0.120 -20.00%
434.zeusmp (unexplained diff vs previous) 9.000 -30.77%
434.zeusmp (unexplained diff vs previous) (percentage) 0.110 -26.67%
437.leslie3d 51.000 131.82%
437.leslie3d (avg) 51.000 131.82%
437.leslie3d (avg) (percentage) 0.090 125.00%
437.leslie3d (max) 68.000 209.09%
437.leslie3d (max) (percentage) 0.120 200.00%
437.leslie3d (unexplained diff vs previous) 69.000 176.00%
437.leslie3d (unexplained diff vs previous) (percentage) 0.120 200.00%
444.namd 5.000 -16.67%
444.namd (avg) 5.000 -16.67%
444.namd (avg) (percentage) 0.780 -19.59%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.850 -16.67%
444.namd (unexplained diff vs previous) 4.000 -42.86%
444.namd (unexplained diff vs previous) (percentage) 0.590 -42.72%
445.gobmk 14.000 180.00%
445.gobmk (avg) 14.000 180.00%
445.gobmk (avg) (percentage) 0.280 154.55%
445.gobmk (max) 22.000 266.67%
445.gobmk (max) (percentage) 0.450 275.00%
445.gobmk (unexplained diff vs previous) 23.000 283.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.460 283.33%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.160 -
447.dealII (max) 19.000 -17.39%
447.dealII (max) (percentage) 1.240 -16.78%
450.soplex 15.000 -40.00%
450.soplex (avg) 15.000 -40.00%
450.soplex (avg) (percentage) 2.950 -40.28%
450.soplex (max) 21.000 -16.00%
450.soplex (max) (percentage) 4.100 -16.67%
450.soplex (unexplained diff vs previous) 5.000 -81.48%
450.soplex (unexplained diff vs previous) (percentage) 0.950 -81.62%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.210 -
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 2.130 -10.88%
456.hmmer 11.000 120.00%
456.hmmer (avg) 11.000 120.00%
456.hmmer (avg) (percentage) 0.390 105.26%
456.hmmer (max) 16.000 220.00%
456.hmmer (max) (percentage) 0.600 233.33%
456.hmmer (unexplained diff vs previous) 17.000 240.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.600 233.33%
458.sjeng 9.000 -
458.sjeng (avg) 9.000 -
458.sjeng (avg) (percentage) 0.130 -
458.sjeng (max) 10.000 -16.67%
458.sjeng (max) (percentage) 0.150 -16.67%
459.GemsFDTD 33.000 43.48%
459.GemsFDTD (avg) 33.000 43.48%
459.GemsFDTD (avg) (percentage) 0.140 40.00%
459.GemsFDTD (max) 40.000 73.91%
459.GemsFDTD (max) (percentage) 0.170 70.00%
459.GemsFDTD (unexplained diff vs previous) 40.000 66.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.170 70.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.810 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 5.620 -
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 5.950 -
464.h264ref 22.000 -
464.h264ref (avg) 22.000 -
464.h264ref (avg) (percentage) 0.580 -
464.h264ref (max) 18.000 -18.18%
464.h264ref (max) (percentage) 0.480 -17.24%
465.tonto 95.000 375.00%
465.tonto (avg) 95.000 375.00%
465.tonto (avg) (percentage) 0.140 366.67%
465.tonto (max) 150.000 650.00%
465.tonto (max) (percentage) 0.220 633.33%
465.tonto (unexplained diff vs previous) 150.000 581.82%
465.tonto (unexplained diff vs previous) (percentage) 0.220 633.33%
470.lbm 11.000 57.14%
470.lbm (avg) 11.000 57.14%
470.lbm (avg) (percentage) 0.360 50.00%
470.lbm (max) 14.000 55.56%
470.lbm (max) (percentage) 0.470 51.61%
470.lbm (unexplained diff vs previous) 15.000 200.00%
470.lbm (unexplained diff vs previous) (percentage) 0.470 193.75%
471.omnetpp 51.000 6.25%
471.omnetpp (avg) 51.000 6.25%
471.omnetpp (avg) (percentage) 2.000 3.63%
471.omnetpp (max) 53.000 1.92%
471.omnetpp (max) (percentage) 2.070 -1.90%
471.omnetpp (unexplained diff vs previous) 52.000 -3.70%
471.omnetpp (unexplained diff vs previous) (percentage) 2.030 -5.58%
473.astar 20.000 -20.00%
473.astar (avg) 20.000 -20.00%
473.astar (avg) (percentage) 0.390 -20.41%
473.astar (max) 20.000 -9.09%
473.astar (max) (percentage) 0.390 -11.36%
473.astar (unexplained diff vs previous) 15.000 -34.78%
473.astar (unexplained diff vs previous) (percentage) 0.290 -34.09%
482.sphinx3 18.000 -
482.sphinx3 (avg) 18.000 -
482.sphinx3 (avg) (percentage) 2.340 -
482.sphinx3 (max) 15.000 -11.76%
482.sphinx3 (max) (percentage) 1.920 -11.11%
483.xalancbmk 50.000 -36.71%
483.xalancbmk (avg) 50.000 -36.71%
483.xalancbmk (avg) (percentage) 1.350 -36.32%
483.xalancbmk (max) 66.000 -16.46%
483.xalancbmk (max) (percentage) 1.770 -16.51%
483.xalancbmk (unexplained diff vs previous) 31.000 -61.73%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.820 -62.04%
Geometric Mean 2.425 23.17%