Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e3d64ccf9f559731896ae8ce1ac44f7caa824bb6 (+ 599 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_tk1-llvm-master-arm-spec2k6-O2/369/
View Options
Report
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 2022-03-02T08:21:26 0:00:00
Previous 0203 (llvmorg-19-init-09944-g8009bbec59d1) 2024-04-27T14:57:22 0:00:00
Baseline 0001 (llvmorg-16-init-16024-ga455c91601a8) 2022-12-31T07:27:27 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 49 37
Performance Improvements 55 59
Added Tests 9 6
Unchanged Tests 667 678
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 4.92% 33184.000 34817.000 - -1.53% -
444.namd 3.49% 220982.000 228698.000 - 0.84% -
464.h264ref 1.63% 618105.000 628206.000 - 0.89% -
453.povray 1.52% 901104.000 914782.000 - 0.17% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 24.11% 11877.000 14740.000 - 0.42% -
458.sjeng 6.42% 13912.000 14805.000 - 0.98% -
464.h264ref 2.22% 9609.000 9822.000 - 0.67% -
403.gcc 2.13% 6541.000 6680.000 - 1.01% -
471.omnetpp 1.72% 7274.000 7399.000 - 0.31% -
453.povray 1.39% 4548.000 4611.000 - -0.07% -
450.soplex 1.25% 8351.000 8455.000 - 0.67% -
433.milc 1.23% 11829.000 11974.000 - 0.17% -
444.namd 1.07% 9899.000 10005.000 - 0.12% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) 1900.00% 1.000 20.000 - 233.33% -
444.namd (unexplained diff vs previous) (percentage) 1900.00% 0.010 0.200 - 233.33% -
464.h264ref (unexplained diff vs previous) (percentage) 350.00% 0.120 0.540 - -40.66% -
464.h264ref (unexplained diff vs previous) 341.67% 12.000 53.000 - -40.45% -
433.milc (unexplained diff vs previous) 200.00% 2.000 6.000 - -45.45% -
482.sphinx3 (unexplained diff vs previous) (percentage) 181.82% 0.110 0.310 - 14.81% -
482.sphinx3 (unexplained diff vs previous) 166.67% 21.000 56.000 - 14.29% -
433.milc (unexplained diff vs previous) (percentage) 150.00% 0.020 0.050 - -44.44% -
444.namd (max) 150.00% 8.000 20.000 - -20.00% -
462.libquantum 137.50% 24.000 57.000 - 200.00% -
462.libquantum (avg) 137.50% 24.000 57.000 - 200.00% -
444.namd (max) (percentage) 122.22% 0.090 0.200 - -23.08% -
462.libquantum (avg) (percentage) 85.71% 0.210 0.390 - 200.00% -
403.gcc 72.22% 18.000 31.000 - 34.78% -
403.gcc (avg) 72.22% 18.000 31.000 - 34.78% -
403.gcc (avg) (percentage) 62.07% 0.290 0.470 - 30.56% -
470.lbm (avg) (percentage) 58.33% 0.240 0.380 - 26.67% -
470.lbm 57.89% 38.000 60.000 - 27.66% -
470.lbm (avg) 57.89% 38.000 60.000 - 27.66% -
473.astar (unexplained diff vs previous) (percentage) 50.00% 0.080 0.120 - -29.41% -
473.astar (unexplained diff vs previous) 37.50% 8.000 11.000 - -31.25% -
482.sphinx3 (max) (percentage) 37.04% 0.270 0.370 - 37.04% -
482.sphinx3 (max) 36.73% 49.000 67.000 - 36.73% -
444.namd 27.27% 11.000 14.000 - -12.50% -
444.namd (avg) 27.27% 11.000 14.000 - -12.50% -
471.omnetpp 19.67% 61.000 73.000 - 128.12% -
471.omnetpp (avg) 19.67% 61.000 73.000 - 128.12% -
471.omnetpp (avg) (percentage) 17.86% 0.840 0.990 - 125.00% -
444.namd (avg) (percentage) 16.67% 0.120 0.140 - -17.65% -
450.soplex 12.50% 16.000 18.000 - 20.00% -
450.soplex (avg) 12.50% 16.000 18.000 - 20.00% -
482.sphinx3 (avg) (percentage) 12.12% 0.330 0.370 - -27.45% -
482.sphinx3 11.67% 60.000 67.000 - -27.17% -
482.sphinx3 (avg) 11.67% 60.000 67.000 - -27.17% -
450.soplex (avg) (percentage) 10.00% 0.200 0.220 - 15.79% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
429.mcf -5.17% 11654.000 11051.000 - 0.29% -
401.bzip2 -5.01% 78091.000 74180.000 - 0.80% -
473.astar -3.83% 37527.000 36091.000 - 0.57% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -1.28% 9718.000 9594.000 - -0.12% -
482.sphinx3 -1.09% 18389.000 18189.000 - -0.24% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng -97.40% 77.000 2.000 - -97.83% -
458.sjeng (avg) -97.40% 77.000 2.000 - -97.83% -
458.sjeng (avg) (percentage) -96.43% 0.560 0.020 - -96.83% -
458.sjeng (max) -95.10% 102.000 5.000 - -90.20% -
458.sjeng (unexplained diff vs previous) (percentage) -95.00% 0.200 0.010 - 0.00% -
458.sjeng (max) (percentage) -94.59% 0.740 0.040 - -88.57% -
458.sjeng (unexplained diff vs previous) -92.86% 28.000 2.000 - 0.00% -
445.gobmk (max) -92.31% 39.000 3.000 - -90.00% -
445.gobmk (max) (percentage) -91.67% 0.360 0.030 - -88.89% -
453.povray (max) -82.14% 84.000 15.000 - -48.28% -
453.povray (max) (percentage) -81.72% 1.860 0.340 - -46.03% -
429.mcf (max) -79.07% 43.000 9.000 - -10.00% -
445.gobmk -78.95% 19.000 4.000 - -83.33% -
445.gobmk (avg) -78.95% 19.000 4.000 - -83.33% -
429.mcf (max) (percentage) -77.78% 0.450 0.100 - -9.09% -
429.mcf (unexplained diff vs previous) (percentage) -77.78% 0.450 0.100 - 100.00% -
445.gobmk (avg) (percentage) -77.78% 0.180 0.040 - -81.82% -
429.mcf (unexplained diff vs previous) -77.27% 44.000 10.000 - 100.00% -
462.libquantum (max) (percentage) -68.82% 0.930 0.290 - 383.33% -
429.mcf -62.50% 16.000 6.000 - -14.29% -
429.mcf (avg) -62.50% 16.000 6.000 - -14.29% -
462.libquantum (max) -61.82% 110.000 42.000 - 425.00% -
433.milc (max) -61.54% 13.000 5.000 - -50.00% -
429.mcf (avg) (percentage) -58.82% 0.170 0.070 - -12.50% -
433.milc (max) (percentage) -54.55% 0.110 0.050 - -44.44% -
471.omnetpp (unexplained diff vs previous) (percentage) -52.58% 1.940 0.920 - 1214.29% -
471.omnetpp (max) (percentage) -52.11% 1.900 0.910 - 97.83% -
471.omnetpp (unexplained diff vs previous) -51.77% 141.000 68.000 - 1260.00% -
471.omnetpp (max) -51.45% 138.000 67.000 - 103.03% -
464.h264ref (max) (percentage) -46.00% 1.000 0.540 - -40.00% -
464.h264ref (max) -44.79% 96.000 53.000 - -39.08% -
473.astar (max) (percentage) -42.86% 0.210 0.120 - -29.41% -
473.astar (max) -42.11% 19.000 11.000 - -26.67% -
450.soplex (max) (percentage) -38.46% 0.260 0.160 - -33.33% -
450.soplex (max) -38.10% 21.000 13.000 - -35.00% -
464.h264ref (avg) (percentage) -35.71% 0.560 0.360 - -43.75% -
464.h264ref -33.96% 53.000 35.000 - -43.55% -
464.h264ref (avg) -33.96% 53.000 35.000 - -43.55% -
453.povray -28.57% 28.000 20.000 - -9.09% -
453.povray (avg) -28.57% 28.000 20.000 - -9.09% -
453.povray (avg) (percentage) -27.42% 0.620 0.450 - -8.16% -
483.xalancbmk (max) (percentage) -20.88% 0.910 0.720 - -33.33% -
473.astar -20.00% 10.000 8.000 - -27.27% -
473.astar (avg) -20.00% 10.000 8.000 - -27.27% -
473.astar (avg) (percentage) -18.18% 0.110 0.090 - -25.00% -
403.gcc (max) (percentage) -7.89% 0.380 0.350 - -55.13% -
403.gcc (max) -4.17% 24.000 23.000 - -54.90% -
470.lbm (unexplained diff vs previous) -1.52% 66.000 65.000 - 333.33% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 5.88% 17.000 18.000 - 0.00% -
nb_compile_successful 5.56% 18.000 19.000 - 0.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
447.dealII (max)
447.dealII (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.77% 309981.000 315481.000 - -0.83% -
471.omnetpp 1.00% 527703.000 533003.000 - -0.39% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 2.89% 7481.000 7697.000 - -0.82% -
403.gcc 1.01% 6613.000 6680.000 - 2.13% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (unexplained diff vs previous) 1260.00% 5.000 68.000 - -51.77% -
471.omnetpp (unexplained diff vs previous) (percentage) 1214.29% 0.070 0.920 - -52.58% -
462.libquantum (max) 425.00% 8.000 42.000 - -61.82% -
462.libquantum (max) (percentage) 383.33% 0.060 0.290 - -68.82% -
470.lbm (unexplained diff vs previous) (percentage) 355.56% 0.090 0.410 - 0.00% -
470.lbm (unexplained diff vs previous) 333.33% 15.000 65.000 - -1.52% -
444.namd (unexplained diff vs previous) 233.33% 6.000 20.000 - 1900.00% -
444.namd (unexplained diff vs previous) (percentage) 233.33% 0.060 0.200 - 1900.00% -
462.libquantum 200.00% 19.000 57.000 - 137.50% -
462.libquantum (avg) 200.00% 19.000 57.000 - 137.50% -
462.libquantum (avg) (percentage) 200.00% 0.130 0.390 - 85.71% -
470.lbm (max) 132.14% 28.000 65.000 - 0.00% -
471.omnetpp 128.12% 32.000 73.000 - 19.67% -
471.omnetpp (avg) 128.12% 32.000 73.000 - 19.67% -
470.lbm (max) (percentage) 127.78% 0.180 0.410 - 0.00% -
471.omnetpp (avg) (percentage) 125.00% 0.440 0.990 - 17.86% -
471.omnetpp (max) 103.03% 33.000 67.000 - -51.45% -
429.mcf (unexplained diff vs previous) 100.00% 5.000 10.000 - -77.27% -
429.mcf (unexplained diff vs previous) (percentage) 100.00% 0.050 0.100 - -77.78% -
471.omnetpp (max) (percentage) 97.83% 0.460 0.910 - -52.11% -
482.sphinx3 (max) (percentage) 37.04% 0.270 0.370 - 37.04% -
482.sphinx3 (max) 36.73% 49.000 67.000 - 36.73% -
403.gcc 34.78% 23.000 31.000 - 72.22% -
403.gcc (avg) 34.78% 23.000 31.000 - 72.22% -
403.gcc (avg) (percentage) 30.56% 0.360 0.470 - 62.07% -
470.lbm 27.66% 47.000 60.000 - 57.89% -
470.lbm (avg) 27.66% 47.000 60.000 - 57.89% -
470.lbm (avg) (percentage) 26.67% 0.300 0.380 - 58.33% -
450.soplex 20.00% 15.000 18.000 - 12.50% -
450.soplex (avg) 20.00% 15.000 18.000 - 12.50% -
450.soplex (avg) (percentage) 15.79% 0.190 0.220 - 10.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 14.81% 0.270 0.310 - 181.82% -
482.sphinx3 (unexplained diff vs previous) 14.29% 49.000 56.000 - 166.67% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -1.53% 35357.000 34817.000 - 4.92% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk -5.08% 5921.000 5620.000 - 0.00% -
445.gobmk -1.63% 11199.000 11016.000 - -0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -97.83% 92.000 2.000 - -97.40% -
458.sjeng (avg) -97.83% 92.000 2.000 - -97.40% -
458.sjeng (avg) (percentage) -96.83% 0.630 0.020 - -96.43% -
458.sjeng (max) -90.20% 51.000 5.000 - -95.10% -
445.gobmk (max) -90.00% 30.000 3.000 - -92.31% -
445.gobmk (max) (percentage) -88.89% 0.270 0.030 - -91.67% -
458.sjeng (max) (percentage) -88.57% 0.350 0.040 - -94.59% -
445.gobmk -83.33% 24.000 4.000 - -78.95% -
445.gobmk (avg) -83.33% 24.000 4.000 - -78.95% -
445.gobmk (avg) (percentage) -81.82% 0.220 0.040 - -77.78% -
403.gcc (max) (percentage) -55.13% 0.780 0.350 - -7.89% -
403.gcc (max) -54.90% 51.000 23.000 - -4.17% -
433.milc (max) -50.00% 10.000 5.000 - -61.54% -
453.povray (max) -48.28% 29.000 15.000 - -82.14% -
453.povray (max) (percentage) -46.03% 0.630 0.340 - -81.72% -
433.milc (unexplained diff vs previous) -45.45% 11.000 6.000 - 200.00% -
433.milc (max) (percentage) -44.44% 0.090 0.050 - -54.55% -
433.milc (unexplained diff vs previous) (percentage) -44.44% 0.090 0.050 - 150.00% -
464.h264ref (avg) (percentage) -43.75% 0.640 0.360 - -35.71% -
464.h264ref -43.55% 62.000 35.000 - -33.96% -
464.h264ref (avg) -43.55% 62.000 35.000 - -33.96% -
464.h264ref (unexplained diff vs previous) (percentage) -40.66% 0.910 0.540 - 350.00% -
464.h264ref (unexplained diff vs previous) -40.45% 89.000 53.000 - 341.67% -
464.h264ref (max) (percentage) -40.00% 0.900 0.540 - -46.00% -
464.h264ref (max) -39.08% 87.000 53.000 - -44.79% -
483.xalancbmk (max) -36.51% 63.000 40.000 - 0.00% -
450.soplex (max) -35.00% 20.000 13.000 - -38.10% -
483.xalancbmk (max) (percentage) -33.33% 1.080 0.720 - -20.88% -
450.soplex (max) (percentage) -33.33% 0.240 0.160 - -38.46% -
473.astar (unexplained diff vs previous) -31.25% 16.000 11.000 - 37.50% -
473.astar (max) (percentage) -29.41% 0.170 0.120 - -42.86% -
473.astar (unexplained diff vs previous) (percentage) -29.41% 0.170 0.120 - 50.00% -
482.sphinx3 (avg) (percentage) -27.45% 0.510 0.370 - 12.12% -
473.astar -27.27% 11.000 8.000 - -20.00% -
473.astar (avg) -27.27% 11.000 8.000 - -20.00% -
482.sphinx3 -27.17% 92.000 67.000 - 11.67% -
482.sphinx3 (avg) -27.17% 92.000 67.000 - 11.67% -
473.astar (max) -26.67% 15.000 11.000 - -42.11% -
483.xalancbmk -25.93% 54.000 40.000 - 0.00% -
483.xalancbmk (avg) -25.93% 54.000 40.000 - 0.00% -
473.astar (avg) (percentage) -25.00% 0.120 0.090 - -18.18% -
444.namd (max) (percentage) -23.08% 0.260 0.200 - 122.22% -
483.xalancbmk (avg) (percentage) -21.74% 0.920 0.720 - 0.00% -
444.namd (max) -20.00% 25.000 20.000 - 150.00% -
444.namd (avg) (percentage) -17.65% 0.170 0.140 - 16.67% -
433.milc (avg) (percentage) -14.29% 0.070 0.060 - 0.00% -
429.mcf -14.29% 7.000 6.000 - -62.50% -
429.mcf (avg) -14.29% 7.000 6.000 - -62.50% -
433.milc -12.50% 8.000 7.000 - 0.00% -
433.milc (avg) -12.50% 8.000 7.000 - 0.00% -
444.namd -12.50% 16.000 14.000 - 27.27% -
444.namd (avg) -12.50% 16.000 14.000 - 27.27% -
429.mcf (max) -10.00% 10.000 9.000 - -79.07% -
453.povray -9.09% 22.000 20.000 - -28.57% -
453.povray (avg) -9.09% 22.000 20.000 - -28.57% -
453.povray (avg) (percentage) -8.16% 0.490 0.450 - -27.42% -

Added Tests - sample variability
447.dealII (max)
447.dealII (max) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
401.bzip2 11382.000 -
403.gcc 6680.000 2.13%
429.mcf 9594.000 -1.28%
433.milc 11974.000 1.23%
444.namd 10005.000 1.07%
445.gobmk 11016.000 -
447.dealII 5197.000 -
450.soplex 8455.000 1.25%
453.povray 4611.000 1.39%
456.hmmer 7697.000 -
458.sjeng 14805.000 6.42%
462.libquantum 14740.000 24.11%
464.h264ref 9822.000 2.22%
470.lbm 15909.000 -
471.omnetpp 7399.000 1.72%
473.astar 9430.000 -
482.sphinx3 18189.000 -1.09%
483.xalancbmk 5620.000 -
Geometric Mean 9455.640 -
Code Size (bytes)
Name Current %
401.bzip2 74180.000 -5.01%
403.gcc 3224513.000 -
429.mcf 11051.000 -5.17%
433.milc 113915.000 -
444.namd 228698.000 3.49%
445.gobmk 1589047.000 -
447.dealII 2627059.000 -
450.soplex 315481.000 -
453.povray 914782.000 1.52%
456.hmmer 258974.000 -
458.sjeng 149653.000 -
462.libquantum 34817.000 4.92%
464.h264ref 628206.000 1.63%
470.lbm 11281.000 -
471.omnetpp 533003.000 -
473.astar 36091.000 -3.83%
482.sphinx3 165808.000 -
483.xalancbmk 3355672.000 -
Geometric Mean 242629.641 16.49%
Score
Name Current %
nb_compile_successful 19.000 5.56%
nb_execution_successful 18.000 5.88%
nb_total_tests 19.000 -5.00%
Geometric Mean 18.661 2.02%
sample variability
Name Current %
403.gcc 31.000 72.22%
403.gcc (avg) 31.000 72.22%
403.gcc (avg) (percentage) 0.470 62.07%
403.gcc (max) 23.000 -4.17%
403.gcc (max) (percentage) 0.350 -7.89%
429.mcf 6.000 -62.50%
429.mcf (avg) 6.000 -62.50%
429.mcf (avg) (percentage) 0.070 -58.82%
429.mcf (max) 9.000 -79.07%
429.mcf (max) (percentage) 0.100 -77.78%
429.mcf (unexplained diff vs previous) 10.000 -77.27%
429.mcf (unexplained diff vs previous) (percentage) 0.100 -77.78%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.060 -
433.milc (max) 5.000 -61.54%
433.milc (max) (percentage) 0.050 -54.55%
433.milc (unexplained diff vs previous) 6.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 0.050 150.00%
444.namd 14.000 27.27%
444.namd (avg) 14.000 27.27%
444.namd (avg) (percentage) 0.140 16.67%
444.namd (max) 20.000 150.00%
444.namd (max) (percentage) 0.200 122.22%
444.namd (unexplained diff vs previous) 20.000 1900.00%
444.namd (unexplained diff vs previous) (percentage) 0.200 1900.00%
445.gobmk 4.000 -78.95%
445.gobmk (avg) 4.000 -78.95%
445.gobmk (avg) (percentage) 0.040 -77.78%
445.gobmk (max) 3.000 -92.31%
445.gobmk (max) (percentage) 0.030 -91.67%
447.dealII (max) 0.000 -
447.dealII (max) (percentage) 0.000 -
450.soplex 18.000 12.50%
450.soplex (avg) 18.000 12.50%
450.soplex (avg) (percentage) 0.220 10.00%
450.soplex (max) 13.000 -38.10%
450.soplex (max) (percentage) 0.160 -38.46%
453.povray 20.000 -28.57%
453.povray (avg) 20.000 -28.57%
453.povray (avg) (percentage) 0.450 -27.42%
453.povray (max) 15.000 -82.14%
453.povray (max) (percentage) 0.340 -81.72%
458.sjeng 2.000 -97.40%
458.sjeng (avg) 2.000 -97.40%
458.sjeng (avg) (percentage) 0.020 -96.43%
458.sjeng (max) 5.000 -95.10%
458.sjeng (max) (percentage) 0.040 -94.59%
458.sjeng (unexplained diff vs previous) 2.000 -92.86%
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -95.00%
462.libquantum 57.000 137.50%
462.libquantum (avg) 57.000 137.50%
462.libquantum (avg) (percentage) 0.390 85.71%
462.libquantum (max) 42.000 -61.82%
462.libquantum (max) (percentage) 0.290 -68.82%
464.h264ref 35.000 -33.96%
464.h264ref (avg) 35.000 -33.96%
464.h264ref (avg) (percentage) 0.360 -35.71%
464.h264ref (max) 53.000 -44.79%
464.h264ref (max) (percentage) 0.540 -46.00%
464.h264ref (unexplained diff vs previous) 53.000 341.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.540 350.00%
470.lbm 60.000 57.89%
470.lbm (avg) 60.000 57.89%
470.lbm (avg) (percentage) 0.380 58.33%
470.lbm (max) 65.000 -
470.lbm (max) (percentage) 0.410 -
470.lbm (unexplained diff vs previous) 65.000 -1.52%
470.lbm (unexplained diff vs previous) (percentage) 0.410 -
471.omnetpp 73.000 19.67%
471.omnetpp (avg) 73.000 19.67%
471.omnetpp (avg) (percentage) 0.990 17.86%
471.omnetpp (max) 67.000 -51.45%
471.omnetpp (max) (percentage) 0.910 -52.11%
471.omnetpp (unexplained diff vs previous) 68.000 -51.77%
471.omnetpp (unexplained diff vs previous) (percentage) 0.920 -52.58%
473.astar 8.000 -20.00%
473.astar (avg) 8.000 -20.00%
473.astar (avg) (percentage) 0.090 -18.18%
473.astar (max) 11.000 -42.11%
473.astar (max) (percentage) 0.120 -42.86%
473.astar (unexplained diff vs previous) 11.000 37.50%
473.astar (unexplained diff vs previous) (percentage) 0.120 50.00%
482.sphinx3 67.000 11.67%
482.sphinx3 (avg) 67.000 11.67%
482.sphinx3 (avg) (percentage) 0.370 12.12%
482.sphinx3 (max) 67.000 36.73%
482.sphinx3 (max) (percentage) 0.370 37.04%
482.sphinx3 (unexplained diff vs previous) 56.000 166.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.310 181.82%
483.xalancbmk 40.000 -
483.xalancbmk (avg) 40.000 -
483.xalancbmk (avg) (percentage) 0.720 -
483.xalancbmk (max) 40.000 -
483.xalancbmk (max) (percentage) 0.720 -20.88%
483.xalancbmk (unexplained diff vs previous) 41.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.730 -
Geometric Mean 2.253 -38.67%