Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c232137d93425dd87ccf960ca9ad515417325634 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/152/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0152 (no-change) 2024-05-31T17:21:43 0:00:00
Previous 0150 (no-change) 2024-05-31T16:53:29 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 109 9
Performance Improvements 64 18
Added Tests 2 173
Unchanged Tests 1001 976
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 7.96% 6205.000 6699.000 - 0.00% -
473.astar 5.28% 4641.000 4886.000 - 5.35% -
482.sphinx3 4.62% 671.000 702.000 - 5.72% -
471.omnetpp 4.10% 2096.000 2182.000 - 1.35% -
401.bzip2 3.90% 2643.000 2746.000 - 9.40% -
450.soplex 3.56% 505.000 523.000 - -3.15% -
459.GemsFDTD 3.03% 5009.000 5161.000 - 0.00% -
445.gobmk 2.75% 4474.000 4597.000 - -0.43% -
433.milc 2.70% 1036.000 1064.000 - 0.95% -
434.zeusmp 2.66% 1878.000 1928.000 - 0.00% -
410.bwaves 2.20% 4409.000 4506.000 - 0.00% -
464.h264ref 2.07% 3719.000 3796.000 - -4.26% -
453.povray 2.00% 401.000 409.000 - -2.85% -
435.gromacs 1.67% 4196.000 4266.000 - 0.00% -
458.sjeng 1.52% 6231.000 6326.000 - -0.42% -
470.lbm 1.30% 3243.000 3285.000 - 1.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) 166.67% 3.000 8.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) 161.33% 0.750 1.960 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 100.00% 2.000 4.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.300 0.600 0.000 0.00% 0.000
437.leslie3d (max) 63.00% 327.000 533.000 - 0.00% -
437.leslie3d (max) (percentage) 50.76% 5.280 7.960 - 0.00% -
456.hmmer (unexplained diff vs previous) 50.00% 6.000 9.000 0.000 0.00% 0.000
456.hmmer (max) (percentage) 45.45% 0.220 0.320 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 45.45% 0.220 0.320 0.000 0.00% 0.000
445.gobmk (max) 44.83% 87.000 126.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 42.77% 346.000 494.000 0.000 0.00% 0.000
445.gobmk (max) (percentage) 41.03% 1.950 2.750 - 0.00% -
464.h264ref (max) 39.29% 56.000 78.000 - 0.00% -
445.gobmk (unexplained diff vs previous) 38.20% 89.000 123.000 0.000 0.00% 0.000
464.h264ref (max) (percentage) 37.09% 1.510 2.070 - 0.00% -
464.h264ref (unexplained diff vs previous) 35.09% 57.000 77.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 34.67% 1.990 2.680 0.000 0.00% 0.000
453.povray (max) 33.33% 6.000 8.000 - 0.00% -
456.hmmer (max) 33.33% 6.000 8.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 32.68% 1.530 2.030 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 32.08% 5.580 7.370 0.000 0.00% 0.000
416.gamess (max) 32.00% 25.000 33.000 - 0.00% -
416.gamess (max) (percentage) 29.41% 0.170 0.220 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 29.41% 0.170 0.220 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 28.42% 21.110 27.110 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) 26.92% 26.000 33.000 0.000 0.00% 0.000
453.povray 25.00% 4.000 5.000 - 0.00% -
453.povray (avg) 25.00% 4.000 5.000 - 0.00% -
434.zeusmp (max) 24.39% 41.000 51.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 23.64% 2.200 2.720 0.000 0.00% 0.000
434.zeusmp 23.08% 13.000 16.000 - 0.00% -
434.zeusmp (avg) 23.08% 13.000 16.000 - 0.00% -
453.povray (max) (percentage) 22.70% 1.630 2.000 - 0.00% -
434.zeusmp (max) (percentage) 21.46% 2.190 2.660 - 0.00% -
436.cactusADM (unexplained diff vs previous) 20.69% 29.000 35.000 0.000 0.00% 0.000
459.GemsFDTD 19.15% 47.000 56.000 - 0.00% -
459.GemsFDTD (avg) 19.15% 47.000 56.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 19.05% 42.000 50.000 0.000 0.00% 0.000
436.cactusADM (max) (percentage) 18.30% 2.240 2.650 - 0.00% -
434.zeusmp (avg) (percentage) 17.57% 0.740 0.870 - 0.00% -
436.cactusADM (max) 17.24% 29.000 34.000 - 0.00% -
429.mcf (avg) (percentage) 16.19% 3.830 4.450 - 0.00% -
459.GemsFDTD (avg) (percentage) 15.79% 0.950 1.100 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 15.62% 2.240 2.590 0.000 0.00% 0.000
445.gobmk 15.38% 39.000 45.000 - 0.00% -
445.gobmk (avg) 15.38% 39.000 45.000 - 0.00% -
437.leslie3d 15.00% 240.000 276.000 - 0.00% -
437.leslie3d (avg) 15.00% 240.000 276.000 - 0.00% -
482.sphinx3 (max) 14.29% 28.000 32.000 - 0.00% -
482.sphinx3 13.33% 15.000 17.000 - 0.00% -
482.sphinx3 (avg) 13.33% 15.000 17.000 - 0.00% -
410.bwaves 12.90% 31.000 35.000 - 0.00% -
410.bwaves (avg) 12.90% 31.000 35.000 - 0.00% -
416.gamess 12.50% 16.000 18.000 - 0.00% -
416.gamess (avg) 12.50% 16.000 18.000 - 0.00% -
473.astar 12.50% 88.000 99.000 - 0.00% -
473.astar (avg) 12.50% 88.000 99.000 - 0.00% -
445.gobmk (avg) (percentage) 12.36% 0.890 1.000 - 0.00% -
436.cactusADM (avg) (percentage) 12.05% 0.830 0.930 - 0.00% -
433.milc 10.00% 10.000 11.000 - 0.00% -
433.milc (avg) 10.00% 10.000 11.000 - 0.00% -
436.cactusADM 10.00% 10.000 11.000 - 0.00% -
436.cactusADM (avg) 10.00% 10.000 11.000 - 0.00% -
410.bwaves (avg) (percentage) 9.86% 0.710 0.780 - 0.00% -
458.sjeng (avg) (percentage) 9.43% 0.530 0.580 - 0.00% -
450.soplex 9.09% 11.000 12.000 - 0.00% -
450.soplex (avg) 9.09% 11.000 12.000 - 0.00% -
458.sjeng 9.09% 33.000 36.000 - 0.00% -
458.sjeng (avg) 9.09% 33.000 36.000 - 0.00% -
464.h264ref 8.82% 34.000 37.000 - 0.00% -
464.h264ref (avg) 8.82% 34.000 37.000 - 0.00% -
401.bzip2 8.16% 49.000 53.000 - 0.00% -
401.bzip2 (avg) 8.16% 49.000 53.000 - 0.00% -
482.sphinx3 (max) (percentage) 7.94% 4.280 4.620 - 0.00% -
464.h264ref (avg) (percentage) 7.53% 0.930 1.000 - 0.00% -
473.astar (avg) (percentage) 7.37% 1.900 2.040 - 0.00% -
401.bzip2 (max) 7.00% 100.000 107.000 - 0.00% -
433.milc (avg) (percentage) 6.73% 1.040 1.110 - 0.00% -
437.leslie3d (avg) (percentage) 6.72% 3.870 4.130 - 0.00% -
471.omnetpp 6.67% 60.000 64.000 - 0.00% -
471.omnetpp (avg) 6.67% 60.000 64.000 - 0.00% -
482.sphinx3 (avg) (percentage) 5.58% 2.330 2.460 - 0.00% -
401.bzip2 (avg) (percentage) 5.38% 1.860 1.960 - 0.00% -
453.povray (avg) (percentage) 4.03% 1.240 1.290 - 0.00% -
470.lbm 3.33% 30.000 31.000 - 0.00% -
470.lbm (avg) 3.33% 30.000 31.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 3.33% 30.000 31.000 0.000 0.00% 0.000
401.bzip2 (max) (percentage) 2.90% 3.790 3.900 - 0.00% -
450.soplex (avg) (percentage) 2.61% 2.300 2.360 - 0.00% -
470.lbm (avg) (percentage) 2.11% 0.950 0.970 - 0.00% -
471.omnetpp (avg) (percentage) 2.06% 2.910 2.970 - 0.00% -
429.mcf (unexplained diff vs previous) 1.03% 388.000 392.000 0.000 0.00% 0.000
410.bwaves (max) 1.02% 98.000 99.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -21.33% 1838.000 1446.000 - -23.04% -
436.cactusADM -2.65% 1321.000 1286.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
481.wrf (unexplained diff vs previous) -90.40% 125.000 12.000 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) (percentage) -90.36% 4.150 0.400 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -80.41% 8.370 1.640 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -80.06% 351.000 70.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -58.25% 1.940 0.810 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -57.89% 19.000 8.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -49.41% 2.530 1.280 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) -48.78% 82.000 42.000 0.000 0.00% 0.000
429.mcf (max) -37.27% 491.000 308.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -32.30% 5.820 3.940 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -29.51% 122.000 86.000 0.000 0.00% 0.000
447.dealII (max) (percentage) -25.26% 1.900 1.420 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -25.22% 6.700 5.010 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -24.40% 4.550 3.440 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -22.98% 3.830 2.950 0.000 0.00% 0.000
447.dealII (max) -22.22% 18.000 14.000 - 0.00% -
450.soplex (unexplained diff vs previous) -21.74% 23.000 18.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -21.22% 311.000 245.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -20.83% 192.000 152.000 0.000 0.00% 0.000
429.mcf (max) (percentage) -20.29% 26.760 21.330 - 0.00% -
450.soplex (max) (percentage) -18.35% 4.360 3.560 - 0.00% -
450.soplex (max) -18.18% 22.000 18.000 - 0.00% -
459.GemsFDTD (max) (percentage) -17.89% 3.690 3.030 - 0.00% -
481.wrf (max) -17.50% 120.000 99.000 - 0.00% -
481.wrf (max) (percentage) -16.79% 3.990 3.320 - 0.00% -
435.gromacs (max) (percentage) -16.71% 7.720 6.430 - 0.00% -
459.GemsFDTD (max) -15.22% 184.000 156.000 - 0.00% -
435.gromacs (max) -15.17% 323.000 274.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -14.89% 3.090 2.630 0.000 0.00% 0.000
462.libquantum (max) (percentage) -12.53% 3.750 3.280 - 0.00% -
433.milc (unexplained diff vs previous) -12.50% 32.000 28.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -10.18% 1.670 1.500 0.000 0.00% 0.000
470.lbm (max) (percentage) -10.12% 2.470 2.220 - 0.00% -
473.astar (max) (percentage) -10.03% 6.280 5.650 - 0.00% -
470.lbm (max) -10.00% 80.000 72.000 - 0.00% -
471.omnetpp (max) (percentage) -10.00% 5.500 4.950 - 0.00% -
433.milc (max) (percentage) -10.00% 3.000 2.700 - 0.00% -
433.milc (max) -9.68% 31.000 28.000 - 0.00% -
481.wrf -9.09% 33.000 30.000 - 0.00% -
481.wrf (avg) -9.09% 33.000 30.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -8.65% 104.000 95.000 0.000 0.00% 0.000
429.mcf -8.57% 70.000 64.000 - 0.00% -
429.mcf (avg) -8.57% 70.000 64.000 - 0.00% -
403.gcc (max) (percentage) -7.46% 11.800 10.920 - 0.00% -
458.sjeng (max) (percentage) -7.32% 1.640 1.520 - 0.00% -
481.wrf (avg) (percentage) -6.36% 1.100 1.030 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -6.11% 2.290 2.150 0.000 0.00% 0.000
471.omnetpp (max) -6.09% 115.000 108.000 - 0.00% -
458.sjeng (max) -5.88% 102.000 96.000 - 0.00% -
400.perlbench (max) -5.26% 19.000 18.000 - 0.00% -
473.astar (max) -5.15% 291.000 276.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -4.58% 3.930 3.750 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -3.96% 101.000 97.000 0.000 0.00% 0.000
462.libquantum (avg) (percentage) -3.80% 1.580 1.520 - 0.00% -
447.dealII (avg) (percentage) -2.29% 1.310 1.280 - 0.00% -
435.gromacs (avg) (percentage) -2.14% 2.340 2.290 - 0.00% -
410.bwaves (max) (percentage) -1.79% 2.240 2.200 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -1.12% 4.470 4.420 0.000 0.00% 0.000
444.namd (avg) (percentage) -1.04% 0.960 0.950 - 0.00% -
435.gromacs -1.02% 98.000 97.000 - 0.00% -
435.gromacs (avg) -1.02% 98.000 97.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 6.45% 62.000 66.000 - 127.59% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.73% 128200.000 130424.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 9.40% 2510.000 2746.000 - 3.90% -
456.hmmer 5.88% 2637.000 2792.000 - 0.32% -
482.sphinx3 5.72% 664.000 702.000 - 4.62% -
473.astar 5.35% 4638.000 4886.000 - 5.28% -
470.lbm 1.55% 3235.000 3285.000 - 1.30% -
471.omnetpp 1.35% 2153.000 2182.000 - 4.10% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.02% 45013.000 38251.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.12% 168697.000 165116.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
471.omnetpp -1.64% 754667.000 742320.000 - 0.00% -
450.soplex -1.42% 319083.000 314543.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.03% 1269683.000 1256624.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -28.70% 108.000 77.000 - 0.00% -
429.mcf -23.04% 1879.000 1446.000 - -21.33% -
464.h264ref -4.26% 3965.000 3796.000 - 2.07% -
403.gcc -3.39% 59.000 57.000 - 0.00% -
450.soplex -3.15% 540.000 523.000 - 3.56% -
453.povray -2.85% 421.000 409.000 - 2.00% -
447.dealII -1.30% 1001.000 988.000 - 0.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 127.59% 29.000 66.000 - 6.45% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1468.000 -
401.bzip2 2746.000 3.90%
403.gcc 57.000 -
410.bwaves 4506.000 2.20%
416.gamess 15198.000 -
429.mcf 1446.000 -21.33%
433.milc 1064.000 2.70%
434.zeusmp 1928.000 2.66%
435.gromacs 4266.000 1.67%
436.cactusADM 1286.000 -2.65%
437.leslie3d 6699.000 7.96%
444.namd 672.000 -
445.gobmk 4597.000 2.75%
447.dealII 988.000 -
450.soplex 523.000 3.56%
453.povray 409.000 2.00%
456.hmmer 2792.000 -
458.sjeng 6326.000 1.52%
459.GemsFDTD 5161.000 3.03%
462.libquantum 77.000 -
464.h264ref 3796.000 2.07%
465.tonto 20152.000 -
470.lbm 3285.000 1.30%
471.omnetpp 2182.000 4.10%
473.astar 4886.000 5.28%
481.wrf 2998.000 -
482.sphinx3 702.000 4.62%
Geometric Mean 1919.589 -
Name Current %
400.perlbench 1256624.000 -
401.bzip2 68318.000 -
403.gcc 3788143.000 -
410.bwaves 632124.000 -
416.gamess 8288905.000 -
429.mcf 11448.000 -
433.milc 130424.000 -
434.zeusmp 1011947.000 -
435.gromacs 701836.000 -
436.cactusADM 1141398.000 -
437.leslie3d 944605.000 -
444.namd 165116.000 -
445.gobmk 2238948.000 -
447.dealII 556182.000 -
450.soplex 314543.000 -
453.povray 1125697.000 -
456.hmmer 163763.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1244166.000 -
462.libquantum 38251.000 -
464.h264ref 768477.000 -
465.tonto 9844726.000 -
470.lbm 10777.000 -
471.omnetpp 742320.000 -
473.astar 32444.000 -
481.wrf 6124978.000 -
482.sphinx3 175838.000 -
Geometric Mean 443969.260 -
Name Current %
nb_compile_successful 54.000 -
nb_execution_successful 54.000 -
nb_total_tests 66.000 6.45%
Geometric Mean 57.736 2.11%
Name Current %
400.perlbench 19.000 -
400.perlbench (avg) 19.000 -
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 18.000 -5.26%
400.perlbench (max) (percentage) 1.290 -
401.bzip2 53.000 8.16%
401.bzip2 (avg) 53.000 8.16%
401.bzip2 (avg) (percentage) 1.960 5.38%
401.bzip2 (max) 107.000 7.00%
401.bzip2 (max) (percentage) 3.900 2.90%
401.bzip2 (unexplained diff vs previous) 103.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 3.750 -4.58%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.890 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.920 -7.46%
410.bwaves 35.000 12.90%
410.bwaves (avg) 35.000 12.90%
410.bwaves (avg) (percentage) 0.780 9.86%
410.bwaves (max) 99.000 1.02%
410.bwaves (max) (percentage) 2.200 -1.79%
410.bwaves (unexplained diff vs previous) 97.000 -3.96%
410.bwaves (unexplained diff vs previous) (percentage) 2.150 -6.11%
416.gamess 18.000 12.50%
416.gamess (avg) 18.000 12.50%
416.gamess (avg) (percentage) 0.120 -
416.gamess (max) 33.000 32.00%
416.gamess (max) (percentage) 0.220 29.41%
416.gamess (unexplained diff vs previous) 33.000 26.92%
416.gamess (unexplained diff vs previous) (percentage) 0.220 29.41%
429.mcf 64.000 -8.57%
429.mcf (avg) 64.000 -8.57%
429.mcf (avg) (percentage) 4.450 16.19%
429.mcf (max) 308.000 -37.27%
429.mcf (max) (percentage) 21.330 -20.29%
429.mcf (unexplained diff vs previous) 392.000 1.03%
429.mcf (unexplained diff vs previous) (percentage) 27.110 28.42%
433.milc 11.000 10.00%
433.milc (avg) 11.000 10.00%
433.milc (avg) (percentage) 1.110 6.73%
433.milc (max) 28.000 -9.68%
433.milc (max) (percentage) 2.700 -10.00%
433.milc (unexplained diff vs previous) 28.000 -12.50%
433.milc (unexplained diff vs previous) (percentage) 2.630 -14.89%
434.zeusmp 16.000 23.08%
434.zeusmp (avg) 16.000 23.08%
434.zeusmp (avg) (percentage) 0.870 17.57%
434.zeusmp (max) 51.000 24.39%
434.zeusmp (max) (percentage) 2.660 21.46%
434.zeusmp (unexplained diff vs previous) 50.000 19.05%
434.zeusmp (unexplained diff vs previous) (percentage) 2.590 15.62%
435.gromacs 97.000 -1.02%
435.gromacs (avg) 97.000 -1.02%
435.gromacs (avg) (percentage) 2.290 -2.14%
435.gromacs (max) 274.000 -15.17%
435.gromacs (max) (percentage) 6.430 -16.71%
435.gromacs (unexplained diff vs previous) 70.000 -80.06%
435.gromacs (unexplained diff vs previous) (percentage) 1.640 -80.41%
436.cactusADM 11.000 10.00%
436.cactusADM (avg) 11.000 10.00%
436.cactusADM (avg) (percentage) 0.930 12.05%
436.cactusADM (max) 34.000 17.24%
436.cactusADM (max) (percentage) 2.650 18.30%
436.cactusADM (unexplained diff vs previous) 35.000 20.69%
436.cactusADM (unexplained diff vs previous) (percentage) 2.720 23.64%
437.leslie3d 276.000 15.00%
437.leslie3d (avg) 276.000 15.00%
437.leslie3d (avg) (percentage) 4.130 6.72%
437.leslie3d (max) 533.000 63.00%
437.leslie3d (max) (percentage) 7.960 50.76%
437.leslie3d (unexplained diff vs previous) 494.000 42.77%
437.leslie3d (unexplained diff vs previous) (percentage) 7.370 32.08%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 -1.04%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.660 -
444.namd (unexplained diff vs previous) 4.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.600 100.00%
445.gobmk 45.000 15.38%
445.gobmk (avg) 45.000 15.38%
445.gobmk (avg) (percentage) 1.000 12.36%
445.gobmk (max) 126.000 44.83%
445.gobmk (max) (percentage) 2.750 41.03%
445.gobmk (unexplained diff vs previous) 123.000 38.20%
445.gobmk (unexplained diff vs previous) (percentage) 2.680 34.67%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.280 -2.29%
447.dealII (max) 14.000 -22.22%
447.dealII (max) (percentage) 1.420 -25.26%
447.dealII (unexplained diff vs previous) 8.000 -57.89%
447.dealII (unexplained diff vs previous) (percentage) 0.810 -58.25%
450.soplex 12.000 9.09%
450.soplex (avg) 12.000 9.09%
450.soplex (avg) (percentage) 2.360 2.61%
450.soplex (max) 18.000 -18.18%
450.soplex (max) (percentage) 3.560 -18.35%
450.soplex (unexplained diff vs previous) 18.000 -21.74%
450.soplex (unexplained diff vs previous) (percentage) 3.440 -24.40%
453.povray 5.000 25.00%
453.povray (avg) 5.000 25.00%
453.povray (avg) (percentage) 1.290 4.03%
453.povray (max) 8.000 33.33%
453.povray (max) (percentage) 2.000 22.70%
453.povray (unexplained diff vs previous) 8.000 166.67%
453.povray (unexplained diff vs previous) (percentage) 1.960 161.33%
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.220 -
456.hmmer (max) 8.000 33.33%
456.hmmer (max) (percentage) 0.320 45.45%
456.hmmer (unexplained diff vs previous) 9.000 50.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.320 45.45%
458.sjeng 36.000 9.09%
458.sjeng (avg) 36.000 9.09%
458.sjeng (avg) (percentage) 0.580 9.43%
458.sjeng (max) 96.000 -5.88%
458.sjeng (max) (percentage) 1.520 -7.32%
458.sjeng (unexplained diff vs previous) 95.000 -8.65%
458.sjeng (unexplained diff vs previous) (percentage) 1.500 -10.18%
459.GemsFDTD 56.000 19.15%
459.GemsFDTD (avg) 56.000 19.15%
459.GemsFDTD (avg) (percentage) 1.100 15.79%
459.GemsFDTD (max) 156.000 -15.22%
459.GemsFDTD (max) (percentage) 3.030 -17.89%
459.GemsFDTD (unexplained diff vs previous) 152.000 -20.83%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.950 -22.98%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.520 -3.80%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 3.280 -12.53%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 37.000 8.82%
464.h264ref (avg) 37.000 8.82%
464.h264ref (avg) (percentage) 1.000 7.53%
464.h264ref (max) 78.000 39.29%
464.h264ref (max) (percentage) 2.070 37.09%
464.h264ref (unexplained diff vs previous) 77.000 35.09%
464.h264ref (unexplained diff vs previous) (percentage) 2.030 32.68%
465.tonto 195.000 -
465.tonto (avg) 195.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 191.000 -
465.tonto (max) (percentage) 0.950 -
470.lbm 31.000 3.33%
470.lbm (avg) 31.000 3.33%
470.lbm (avg) (percentage) 0.970 2.11%
470.lbm (max) 72.000 -10.00%
470.lbm (max) (percentage) 2.220 -10.12%
470.lbm (unexplained diff vs previous) 42.000 -48.78%
470.lbm (unexplained diff vs previous) (percentage) 1.280 -49.41%
471.omnetpp 64.000 6.67%
471.omnetpp (avg) 64.000 6.67%
471.omnetpp (avg) (percentage) 2.970 2.06%
471.omnetpp (max) 108.000 -6.09%
471.omnetpp (max) (percentage) 4.950 -10.00%
471.omnetpp (unexplained diff vs previous) 86.000 -29.51%
471.omnetpp (unexplained diff vs previous) (percentage) 3.940 -32.30%
473.astar 99.000 12.50%
473.astar (avg) 99.000 12.50%
473.astar (avg) (percentage) 2.040 7.37%
473.astar (max) 276.000 -5.15%
473.astar (max) (percentage) 5.650 -10.03%
473.astar (unexplained diff vs previous) 245.000 -21.22%
473.astar (unexplained diff vs previous) (percentage) 5.010 -25.22%
481.wrf 30.000 -9.09%
481.wrf (avg) 30.000 -9.09%
481.wrf (avg) (percentage) 1.030 -6.36%
481.wrf (max) 99.000 -17.50%
481.wrf (max) (percentage) 3.320 -16.79%
481.wrf (unexplained diff vs previous) 12.000 -90.40%
481.wrf (unexplained diff vs previous) (percentage) 0.400 -90.36%
482.sphinx3 17.000 13.33%
482.sphinx3 (avg) 17.000 13.33%
482.sphinx3 (avg) (percentage) 2.460 5.58%
482.sphinx3 (max) 32.000 14.29%
482.sphinx3 (max) (percentage) 4.620 7.94%
482.sphinx3 (unexplained diff vs previous) 31.000 3.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 4.420 -1.12%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.750 -
Geometric Mean 8.487 -11.91%