Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c232137d93425dd87ccf960ca9ad515417325634 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/155/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0155 (no-change) 2024-05-31T17:35:50 0:00:00
Previous 0152 (no-change) 2024-05-31T17:21:43 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 53 12
Performance Improvements 102 16
Added Tests 6 173
Unchanged Tests 1015 975
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 9.09% 77.000 84.000 - -22.22% -
481.wrf 6.27% 2998.000 3186.000 - 0.00% -
400.perlbench 5.31% 1468.000 1546.000 - 4.88% -
450.soplex 3.63% 523.000 542.000 - 0.37% -
435.gromacs 3.31% 4266.000 4407.000 - 0.00% -
482.sphinx3 2.99% 702.000 723.000 - 8.89% -
437.leslie3d 2.81% 6699.000 6887.000 - 0.00% -
459.GemsFDTD 1.67% 5161.000 5247.000 - 0.00% -
444.namd 1.64% 672.000 683.000 - 1.64% -
433.milc 1.32% 1064.000 1078.000 - 2.28% -
447.dealII 1.32% 988.000 1001.000 - 0.00% -
470.lbm 1.28% 3285.000 3327.000 - 2.84% -
429.mcf 1.11% 1446.000 1462.000 - -22.19% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) 250.00% 2.000 7.000 - 0.00% -
462.libquantum (max) (percentage) 177.13% 3.280 9.090 - 0.00% -
444.namd (max) 175.00% 4.000 11.000 - 0.00% -
444.namd (unexplained diff vs previous) 175.00% 4.000 11.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 168.33% 0.600 1.610 0.000 0.00% 0.000
444.namd (max) (percentage) 148.48% 0.660 1.640 - 0.00% -
447.dealII (unexplained diff vs previous) 62.50% 8.000 13.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) 60.49% 0.810 1.300 0.000 0.00% 0.000
481.wrf 36.67% 30.000 41.000 - 0.00% -
481.wrf (avg) 36.67% 30.000 41.000 - 0.00% -
481.wrf (max) 34.34% 99.000 133.000 - 0.00% -
481.wrf (max) (percentage) 25.90% 3.320 4.180 - 0.00% -
481.wrf (avg) (percentage) 25.24% 1.030 1.290 - 0.00% -
462.libquantum (avg) (percentage) 19.08% 1.520 1.810 - 0.00% -
433.milc 9.09% 11.000 12.000 - 0.00% -
433.milc (avg) 9.09% 11.000 12.000 - 0.00% -
416.gamess (avg) (percentage) 8.33% 0.120 0.130 - 0.00% -
450.soplex 8.33% 12.000 13.000 - 0.00% -
450.soplex (avg) 8.33% 12.000 13.000 - 0.00% -
400.perlbench (max) 5.56% 18.000 19.000 - 0.00% -
416.gamess 5.56% 18.000 19.000 - 0.00% -
416.gamess (avg) 5.56% 18.000 19.000 - 0.00% -
450.soplex (max) 5.56% 18.000 19.000 - 0.00% -
450.soplex (unexplained diff vs previous) 5.56% 18.000 19.000 0.000 0.00% 0.000
459.GemsFDTD 5.36% 56.000 59.000 - 0.00% -
459.GemsFDTD (avg) 5.36% 56.000 59.000 - 0.00% -
400.perlbench 5.26% 19.000 20.000 - 0.00% -
400.perlbench (avg) 5.26% 19.000 20.000 - 0.00% -
456.hmmer (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -
459.GemsFDTD (avg) (percentage) 3.64% 1.100 1.140 - 0.00% -
470.lbm 3.23% 31.000 32.000 - 0.00% -
470.lbm (avg) 3.23% 31.000 32.000 - 0.00% -
435.gromacs 3.09% 97.000 100.000 - 0.00% -
435.gromacs (avg) 3.09% 97.000 100.000 - 0.00% -
450.soplex (avg) (percentage) 2.54% 2.360 2.420 - 0.00% -
444.namd (avg) (percentage) 2.11% 0.950 0.970 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 2.03% 3.440 3.510 0.000 0.00% 0.000
450.soplex (max) (percentage) 1.97% 3.560 3.630 - 0.00% -
470.lbm (avg) (percentage) 1.03% 0.970 0.980 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -6.06% 66.000 62.000 - 113.79% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.75% 57.000 56.000 - -5.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) -98.80% 5.010 0.060 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -98.78% 245.000 3.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -95.98% 27.110 1.090 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -95.92% 392.000 16.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -95.43% 3.940 0.180 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -95.35% 86.000 4.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -91.58% 95.000 8.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -91.33% 1.500 0.130 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -91.06% 123.000 11.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -91.04% 2.680 0.240 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -88.35% 103.000 12.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -88.27% 3.750 0.440 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -86.10% 2.590 0.360 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -86.00% 50.000 7.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -74.63% 2.720 0.690 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -74.29% 35.000 9.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -68.37% 2.150 0.680 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -68.04% 97.000 31.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -62.96% 7.370 2.730 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -61.94% 494.000 188.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -61.58% 2.030 0.780 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) -61.04% 77.000 30.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -50.57% 2.630 1.300 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -50.00% 28.000 14.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -44.41% 2.950 1.640 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -43.42% 152.000 86.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -34.39% 4.420 2.900 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -32.26% 31.000 21.000 0.000 0.00% 0.000
453.povray (max) -25.00% 8.000 6.000 - 0.00% -
453.povray -20.00% 5.000 4.000 - 0.00% -
453.povray (avg) -20.00% 5.000 4.000 - 0.00% -
436.cactusADM (max) -17.65% 34.000 28.000 - 0.00% -
459.GemsFDTD (max) (percentage) -16.83% 3.030 2.520 - 0.00% -
445.gobmk (max) (percentage) -16.73% 2.750 2.290 - 0.00% -
433.milc (max) (percentage) -16.67% 2.700 2.250 - 0.00% -
403.gcc (max) -16.67% 6.000 5.000 - 0.00% -
445.gobmk (max) -16.67% 126.000 105.000 - 0.00% -
436.cactusADM (max) (percentage) -16.60% 2.650 2.210 - 0.00% -
453.povray (max) (percentage) -16.50% 2.000 1.670 - 0.00% -
429.mcf (max) (percentage) -16.36% 21.330 17.840 - 0.00% -
429.mcf (max) -15.58% 308.000 260.000 - 0.00% -
459.GemsFDTD (max) -15.38% 156.000 132.000 - 0.00% -
433.milc (max) -14.29% 28.000 24.000 - 0.00% -
401.bzip2 (max) -13.08% 107.000 93.000 - 0.00% -
401.bzip2 (max) (percentage) -12.56% 3.900 3.410 - 0.00% -
464.h264ref (max) (percentage) -12.56% 2.070 1.810 - 0.00% -
434.zeusmp (max) (percentage) -12.41% 2.660 2.330 - 0.00% -
434.zeusmp (max) -11.76% 51.000 45.000 - 0.00% -
464.h264ref (max) -11.54% 78.000 69.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 0.000 0.00% 0.000
410.bwaves (max) -10.10% 99.000 89.000 - 0.00% -
437.leslie3d (max) (percentage) -10.05% 7.960 7.160 - 0.00% -
410.bwaves (max) (percentage) -10.00% 2.200 1.980 - 0.00% -
435.gromacs (max) (percentage) -9.95% 6.430 5.790 - 0.00% -
456.hmmer (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -9.38% 0.320 0.290 0.000 0.00% 0.000
458.sjeng (max) (percentage) -8.55% 1.520 1.390 - 0.00% -
458.sjeng (max) -8.33% 96.000 88.000 - 0.00% -
482.sphinx3 (max) (percentage) -8.23% 4.620 4.240 - 0.00% -
473.astar (max) -7.61% 276.000 255.000 - 0.00% -
437.leslie3d (max) -7.50% 533.000 493.000 - 0.00% -
471.omnetpp (max) (percentage) -7.47% 4.950 4.580 - 0.00% -
473.astar (max) (percentage) -7.43% 5.650 5.230 - 0.00% -
471.omnetpp (max) -7.41% 108.000 100.000 - 0.00% -
470.lbm (max) (percentage) -7.21% 2.220 2.060 - 0.00% -
447.dealII (max) -7.14% 14.000 13.000 - 0.00% -
447.dealII (max) (percentage) -7.04% 1.420 1.320 - 0.00% -
435.gromacs (max) -6.93% 274.000 255.000 - 0.00% -
482.sphinx3 (max) -6.25% 32.000 30.000 - 0.00% -
453.povray (avg) (percentage) -6.20% 1.290 1.210 - 0.00% -
416.gamess (max) -6.06% 33.000 31.000 - 0.00% -
403.gcc (max) (percentage) -5.68% 10.920 10.300 - 0.00% -
470.lbm (max) -5.56% 72.000 68.000 - 0.00% -
445.gobmk (avg) (percentage) -5.00% 1.000 0.950 - 0.00% -
434.zeusmp (avg) (percentage) -4.60% 0.870 0.830 - 0.00% -
416.gamess (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -4.55% 0.220 0.210 0.000 0.00% 0.000
445.gobmk -4.44% 45.000 43.000 - 0.00% -
445.gobmk (avg) -4.44% 45.000 43.000 - 0.00% -
471.omnetpp (avg) (percentage) -4.38% 2.970 2.840 - 0.00% -
473.astar -4.04% 99.000 95.000 - 0.00% -
473.astar (avg) -4.04% 99.000 95.000 - 0.00% -
473.astar (avg) (percentage) -3.92% 2.040 1.960 - 0.00% -
401.bzip2 -3.77% 53.000 51.000 - 0.00% -
401.bzip2 (avg) -3.77% 53.000 51.000 - 0.00% -
401.bzip2 (avg) (percentage) -3.57% 1.960 1.890 - 0.00% -
458.sjeng (avg) (percentage) -3.45% 0.580 0.560 - 0.00% -
471.omnetpp -3.12% 64.000 62.000 - 0.00% -
471.omnetpp (avg) -3.12% 64.000 62.000 - 0.00% -
416.gamess (unexplained diff vs previous) -3.03% 33.000 32.000 0.000 0.00% 0.000
458.sjeng -2.78% 36.000 35.000 - 0.00% -
458.sjeng (avg) -2.78% 36.000 35.000 - 0.00% -
429.mcf (avg) (percentage) -2.70% 4.450 4.330 - 0.00% -
437.leslie3d (avg) (percentage) -1.94% 4.130 4.050 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -1.56% 1.280 1.260 0.000 0.00% 0.000
429.mcf -1.56% 64.000 63.000 - 0.00% -
429.mcf (avg) -1.56% 64.000 63.000 - 0.00% -
436.cactusADM (avg) (percentage) -1.08% 0.930 0.920 - 0.00% -
465.tonto (max) (percentage) -1.05% 0.950 0.940 - 0.00% -
465.tonto (max) -1.05% 191.000 189.000 - 0.00% -
464.h264ref (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -

Added Tests - sample variability
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.73% 128200.000 130424.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.92% 2510.000 2734.000 - -0.44% -
482.sphinx3 8.89% 664.000 723.000 - 2.99% -
456.hmmer 5.57% 2637.000 2784.000 - -0.29% -
473.astar 5.28% 4638.000 4883.000 - -0.06% -
400.perlbench 4.88% 1474.000 1546.000 - 5.31% -
470.lbm 2.84% 3235.000 3327.000 - 1.28% -
433.milc 2.28% 1054.000 1078.000 - 1.32% -
444.namd 1.64% 672.000 683.000 - 1.64% -
471.omnetpp 1.53% 2153.000 2186.000 - 0.18% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.02% 45013.000 38251.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.12% 168697.000 165116.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
471.omnetpp -1.64% 754667.000 742320.000 - 0.00% -
450.soplex -1.42% 319083.000 314543.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.03% 1269683.000 1256624.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -22.22% 108.000 84.000 - 9.09% -
429.mcf -22.19% 1879.000 1462.000 - 1.11% -
403.gcc -5.08% 59.000 56.000 - -1.75% -
464.h264ref -3.51% 3965.000 3826.000 - 0.79% -
453.povray -2.85% 421.000 409.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - -6.06% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1546.000 5.31%
401.bzip2 2734.000 -
403.gcc 56.000 -1.75%
410.bwaves 4537.000 -
416.gamess 15166.000 -
429.mcf 1462.000 1.11%
433.milc 1078.000 1.32%
434.zeusmp 1935.000 -
435.gromacs 4407.000 3.31%
436.cactusADM 1295.000 -
437.leslie3d 6887.000 2.81%
444.namd 683.000 1.64%
445.gobmk 4608.000 -
447.dealII 1001.000 1.32%
450.soplex 542.000 3.63%
453.povray 409.000 -
456.hmmer 2784.000 -
458.sjeng 6334.000 -
459.GemsFDTD 5247.000 1.67%
462.libquantum 84.000 9.09%
464.h264ref 3826.000 -
465.tonto 20198.000 -
470.lbm 3327.000 1.28%
471.omnetpp 2186.000 -
473.astar 4883.000 -
481.wrf 3186.000 6.27%
482.sphinx3 723.000 2.99%
Geometric Mean 1949.177 1.54%
Name Current %
400.perlbench 1256624.000 -
401.bzip2 68318.000 -
403.gcc 3788143.000 -
410.bwaves 632124.000 -
416.gamess 8288905.000 -
429.mcf 11448.000 -
433.milc 130424.000 -
434.zeusmp 1011947.000 -
435.gromacs 701836.000 -
436.cactusADM 1141398.000 -
437.leslie3d 944605.000 -
444.namd 165116.000 -
445.gobmk 2238948.000 -
447.dealII 556182.000 -
450.soplex 314543.000 -
453.povray 1125697.000 -
456.hmmer 163763.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1244166.000 -
462.libquantum 38251.000 -
464.h264ref 768477.000 -
465.tonto 9844714.000 -
470.lbm 10777.000 -
471.omnetpp 742320.000 -
473.astar 32444.000 -
481.wrf 6124978.000 -
482.sphinx3 175838.000 -
Geometric Mean 443969.240 -
Name Current %
nb_compile_successful 54.000 -
nb_execution_successful 54.000 -
nb_total_tests 62.000 -6.06%
Geometric Mean 56.545 -2.06%
Name Current %
400.perlbench 20.000 5.26%
400.perlbench (avg) 20.000 5.26%
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 19.000 5.56%
400.perlbench (max) (percentage) 1.280 -
401.bzip2 51.000 -3.77%
401.bzip2 (avg) 51.000 -3.77%
401.bzip2 (avg) (percentage) 1.890 -3.57%
401.bzip2 (max) 93.000 -13.08%
401.bzip2 (max) (percentage) 3.410 -12.56%
401.bzip2 (unexplained diff vs previous) 12.000 -88.35%
401.bzip2 (unexplained diff vs previous) (percentage) 0.440 -88.27%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.890 -
403.gcc (max) 5.000 -16.67%
403.gcc (max) (percentage) 10.300 -5.68%
410.bwaves 35.000 -
410.bwaves (avg) 35.000 -
410.bwaves (avg) (percentage) 0.780 -
410.bwaves (max) 89.000 -10.10%
410.bwaves (max) (percentage) 1.980 -10.00%
410.bwaves (unexplained diff vs previous) 31.000 -68.04%
410.bwaves (unexplained diff vs previous) (percentage) 0.680 -68.37%
416.gamess 19.000 5.56%
416.gamess (avg) 19.000 5.56%
416.gamess (avg) (percentage) 0.130 8.33%
416.gamess (max) 31.000 -6.06%
416.gamess (max) (percentage) 0.210 -4.55%
416.gamess (unexplained diff vs previous) 32.000 -3.03%
416.gamess (unexplained diff vs previous) (percentage) 0.210 -4.55%
429.mcf 63.000 -1.56%
429.mcf (avg) 63.000 -1.56%
429.mcf (avg) (percentage) 4.330 -2.70%
429.mcf (max) 260.000 -15.58%
429.mcf (max) (percentage) 17.840 -16.36%
429.mcf (unexplained diff vs previous) 16.000 -95.92%
429.mcf (unexplained diff vs previous) (percentage) 1.090 -95.98%
433.milc 12.000 9.09%
433.milc (avg) 12.000 9.09%
433.milc (avg) (percentage) 1.120 -
433.milc (max) 24.000 -14.29%
433.milc (max) (percentage) 2.250 -16.67%
433.milc (unexplained diff vs previous) 14.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 1.300 -50.57%
434.zeusmp 16.000 -
434.zeusmp (avg) 16.000 -
434.zeusmp (avg) (percentage) 0.830 -4.60%
434.zeusmp (max) 45.000 -11.76%
434.zeusmp (max) (percentage) 2.330 -12.41%
434.zeusmp (unexplained diff vs previous) 7.000 -86.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.360 -86.10%
435.gromacs 100.000 3.09%
435.gromacs (avg) 100.000 3.09%
435.gromacs (avg) (percentage) 2.280 -
435.gromacs (max) 255.000 -6.93%
435.gromacs (max) (percentage) 5.790 -9.95%
435.gromacs (unexplained diff vs previous) 0.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.000 -
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.920 -1.08%
436.cactusADM (max) 28.000 -17.65%
436.cactusADM (max) (percentage) 2.210 -16.60%
436.cactusADM (unexplained diff vs previous) 9.000 -74.29%
436.cactusADM (unexplained diff vs previous) (percentage) 0.690 -74.63%
437.leslie3d 278.000 -
437.leslie3d (avg) 278.000 -
437.leslie3d (avg) (percentage) 4.050 -1.94%
437.leslie3d (max) 493.000 -7.50%
437.leslie3d (max) (percentage) 7.160 -10.05%
437.leslie3d (unexplained diff vs previous) 188.000 -61.94%
437.leslie3d (unexplained diff vs previous) (percentage) 2.730 -62.96%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.970 2.11%
444.namd (max) 11.000 175.00%
444.namd (max) (percentage) 1.640 148.48%
444.namd (unexplained diff vs previous) 11.000 175.00%
444.namd (unexplained diff vs previous) (percentage) 1.610 168.33%
445.gobmk 43.000 -4.44%
445.gobmk (avg) 43.000 -4.44%
445.gobmk (avg) (percentage) 0.950 -5.00%
445.gobmk (max) 105.000 -16.67%
445.gobmk (max) (percentage) 2.290 -16.73%
445.gobmk (unexplained diff vs previous) 11.000 -91.06%
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -91.04%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.280 -
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 1.320 -7.04%
447.dealII (unexplained diff vs previous) 13.000 62.50%
447.dealII (unexplained diff vs previous) (percentage) 1.300 60.49%
450.soplex 13.000 8.33%
450.soplex (avg) 13.000 8.33%
450.soplex (avg) (percentage) 2.420 2.54%
450.soplex (max) 19.000 5.56%
450.soplex (max) (percentage) 3.630 1.97%
450.soplex (unexplained diff vs previous) 19.000 5.56%
450.soplex (unexplained diff vs previous) (percentage) 3.510 2.03%
453.povray 4.000 -20.00%
453.povray (avg) 4.000 -20.00%
453.povray (avg) (percentage) 1.210 -6.20%
453.povray (max) 6.000 -25.00%
453.povray (max) (percentage) 1.670 -16.50%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.230 4.55%
456.hmmer (max) 8.000 -
456.hmmer (max) (percentage) 0.290 -9.38%
456.hmmer (unexplained diff vs previous) 8.000 -11.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.290 -9.38%
458.sjeng 35.000 -2.78%
458.sjeng (avg) 35.000 -2.78%
458.sjeng (avg) (percentage) 0.560 -3.45%
458.sjeng (max) 88.000 -8.33%
458.sjeng (max) (percentage) 1.390 -8.55%
458.sjeng (unexplained diff vs previous) 8.000 -91.58%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 -91.33%
459.GemsFDTD 59.000 5.36%
459.GemsFDTD (avg) 59.000 5.36%
459.GemsFDTD (avg) (percentage) 1.140 3.64%
459.GemsFDTD (max) 132.000 -15.38%
459.GemsFDTD (max) (percentage) 2.520 -16.83%
459.GemsFDTD (unexplained diff vs previous) 86.000 -43.42%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.640 -44.41%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.810 19.08%
462.libquantum (max) 7.000 250.00%
462.libquantum (max) (percentage) 9.090 177.13%
462.libquantum (unexplained diff vs previous) 7.000 -
462.libquantum (unexplained diff vs previous) (percentage) 8.330 -
464.h264ref 37.000 -
464.h264ref (avg) 37.000 -
464.h264ref (avg) (percentage) 0.990 -1.00%
464.h264ref (max) 69.000 -11.54%
464.h264ref (max) (percentage) 1.810 -12.56%
464.h264ref (unexplained diff vs previous) 30.000 -61.04%
464.h264ref (unexplained diff vs previous) (percentage) 0.780 -61.58%
465.tonto 195.000 -
465.tonto (avg) 195.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 189.000 -1.05%
465.tonto (max) (percentage) 0.940 -1.05%
470.lbm 32.000 3.23%
470.lbm (avg) 32.000 3.23%
470.lbm (avg) (percentage) 0.980 1.03%
470.lbm (max) 68.000 -5.56%
470.lbm (max) (percentage) 2.060 -7.21%
470.lbm (unexplained diff vs previous) 42.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.260 -1.56%
471.omnetpp 62.000 -3.12%
471.omnetpp (avg) 62.000 -3.12%
471.omnetpp (avg) (percentage) 2.840 -4.38%
471.omnetpp (max) 100.000 -7.41%
471.omnetpp (max) (percentage) 4.580 -7.47%
471.omnetpp (unexplained diff vs previous) 4.000 -95.35%
471.omnetpp (unexplained diff vs previous) (percentage) 0.180 -95.43%
473.astar 95.000 -4.04%
473.astar (avg) 95.000 -4.04%
473.astar (avg) (percentage) 1.960 -3.92%
473.astar (max) 255.000 -7.61%
473.astar (max) (percentage) 5.230 -7.43%
473.astar (unexplained diff vs previous) 3.000 -98.78%
473.astar (unexplained diff vs previous) (percentage) 0.060 -98.80%
481.wrf 41.000 36.67%
481.wrf (avg) 41.000 36.67%
481.wrf (avg) (percentage) 1.290 25.24%
481.wrf (max) 133.000 34.34%
481.wrf (max) (percentage) 4.180 25.90%
481.wrf (unexplained diff vs previous) 0.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.000 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.480 -
482.sphinx3 (max) 30.000 -6.25%
482.sphinx3 (max) (percentage) 4.240 -8.23%
482.sphinx3 (unexplained diff vs previous) 21.000 -32.26%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.900 -34.39%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.700 -
Geometric Mean 5.215 -39.83%