Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b5598c33f02732e805e50a3eb5c67b17952c5683 (+ 1341 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/221/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0221 (llvmorg-20-init-07997-gb5598c33f027) 2024-09-27T23:47:22 0:00:00
Previous 0220 (llvmorg-20-init-06656-g8a6248b739d7) 2024-09-21T13:30:08 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 17 50
Performance Improvements 59 76
Added Tests 10 79
Unchanged Tests 958 839
Total Tests 1044

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.48% 73.000 77.000 - -99.24% -
435.gromacs 5.38% 4327.000 4560.000 - 0.00% -
482.sphinx3 2.57% 818.000 839.000 - -96.47% -
450.soplex 1.86% 537.000 547.000 - -96.09% -
471.omnetpp 1.76% 3185.000 3241.000 - -72.80% -
400.perlbench 1.52% 1972.000 2002.000 - -81.94% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) 26.67% 0.150 0.190 - 0.00% -
470.lbm (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
435.gromacs 5.22% 115.000 121.000 - 0.00% -
435.gromacs (avg) 5.22% 115.000 121.000 - 0.00% -
435.gromacs (max) 4.13% 218.000 227.000 - 0.00% -
471.omnetpp 1.89% 53.000 54.000 - -23.94% -
471.omnetpp (avg) 1.89% 53.000 54.000 - -23.94% -
400.perlbench 1.54% 65.000 66.000 - 17.86% -
400.perlbench (avg) 1.54% 65.000 66.000 - 17.86% -
465.tonto 1.08% 93.000 94.000 - 0.00% -
465.tonto (avg) 1.08% 93.000 94.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
473.astar -1.46% 5202.000 5126.000 - -61.46% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) -79.02% 2.860 0.600 - 0.00% -
444.namd (unexplained diff vs previous) -78.95% 19.000 4.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -60.27% 0.730 0.290 - 0.00% -
401.bzip2 (max) -60.00% 55.000 22.000 - 266.67% -
436.cactusADM (unexplained diff vs previous) -60.00% 10.000 4.000 - 0.00% -
401.bzip2 (max) (percentage) -58.91% 2.020 0.830 - 1560.00% -
436.cactusADM (max) -58.82% 17.000 7.000 - 0.00% -
436.cactusADM (max) (percentage) -56.92% 1.300 0.560 - 0.00% -
458.sjeng (max) (percentage) -46.99% 0.830 0.440 - 91.30% -
458.sjeng (max) -46.77% 62.000 33.000 - -5.71% -
462.libquantum (max) -25.00% 4.000 3.000 - 0.00% -
433.milc (max) -11.11% 9.000 8.000 - -97.03% -
433.milc (max) (percentage) -9.59% 0.730 0.660 - -64.32% -
473.astar (max) -7.96% 201.000 185.000 - 1750.00% -
410.bwaves (max) -7.58% 66.000 61.000 - 0.00% -
450.soplex (max) -7.14% 14.000 13.000 - -91.50% -
429.mcf (max) -6.91% 188.000 175.000 - 157.35% -
473.astar (max) (percentage) -6.70% 3.880 3.620 - 4425.00% -
429.mcf (max) (percentage) -6.67% 12.600 11.760 - 3166.67% -
471.omnetpp (max) (percentage) -6.48% 1.080 1.010 - 1.00% -
410.bwaves (max) (percentage) -6.38% 1.410 1.320 - 0.00% -
462.libquantum (max) (percentage) -6.19% 4.040 3.790 - 9375.00% -
444.namd (max) (percentage) -6.12% 2.780 2.610 - -49.61% -
470.lbm (max) (percentage) -6.02% 0.830 0.780 - 1200.00% -
471.omnetpp (max) -5.88% 34.000 32.000 - -73.11% -
444.namd (max) -5.56% 18.000 17.000 - -96.49% -
401.bzip2 -4.17% 24.000 23.000 - 76.92% -
401.bzip2 (avg) -4.17% 24.000 23.000 - 76.92% -
481.wrf (max) -4.00% 150.000 144.000 - 0.00% -
470.lbm (max) -3.85% 26.000 25.000 - 316.67% -
450.soplex (max) (percentage) -3.80% 2.630 2.530 - 130.00% -
459.GemsFDTD (max) -3.23% 124.000 120.000 - 0.00% -
482.sphinx3 (max) (percentage) -3.08% 3.250 3.150 - 356.52% -
464.h264ref (max) (percentage) -3.03% 1.320 1.280 - 374.07% -
481.wrf (max) (percentage) -2.99% 4.350 4.220 - 0.00% -
434.zeusmp (max) -2.94% 34.000 33.000 - 0.00% -
434.zeusmp (max) (percentage) -2.84% 1.760 1.710 - 0.00% -
447.dealII (max) (percentage) -2.80% 1.070 1.040 - -25.18% -
456.hmmer (max) (percentage) -2.78% 0.360 0.350 - -53.33% -
459.GemsFDTD (max) (percentage) -2.66% 1.880 1.830 - 0.00% -
470.lbm -2.56% 39.000 38.000 - -40.62% -
470.lbm (avg) -2.56% 39.000 38.000 - -40.62% -
436.cactusADM (avg) (percentage) -2.33% 0.860 0.840 - 0.00% -
429.mcf -2.30% 87.000 85.000 - 23.19% -
429.mcf (avg) -2.30% 87.000 85.000 - 23.19% -
401.bzip2 (avg) (percentage) -2.25% 0.890 0.870 - 770.00% -
429.mcf (avg) (percentage) -2.23% 5.830 5.700 - 1440.54% -
462.libquantum (avg) (percentage) -2.16% 2.310 2.260 - 1954.55% -
464.h264ref (max) -1.69% 59.000 58.000 - 81.25% -
470.lbm (avg) (percentage) -1.64% 1.220 1.200 - 106.90% -
445.gobmk (max) -1.48% 135.000 133.000 - 90.00% -
435.gromacs (max) (percentage) -1.38% 5.060 4.990 - 0.00% -
453.povray (max) (percentage) -1.35% 2.960 2.920 - 175.47% -
473.astar -1.30% 77.000 76.000 - 744.44% -
473.astar (avg) -1.30% 77.000 76.000 - 744.44% -
445.gobmk (max) (percentage) -1.20% 2.490 2.460 - 310.00% -
444.namd (avg) (percentage) -1.11% 0.900 0.890 - -60.96% -
450.soplex (avg) (percentage) -1.09% 2.760 2.730 - 405.56% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.15% 224407.000 226994.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 9375.00% 0.040 3.790 - -6.19% -
473.astar (max) (percentage) 4425.00% 0.080 3.620 - -6.70% -
429.mcf (max) (percentage) 3166.67% 0.360 11.760 - -6.67% -
473.astar (avg) (percentage) 2028.57% 0.070 1.490 - 0.00% -
462.libquantum (avg) (percentage) 1954.55% 0.110 2.260 - -2.16% -
473.astar (max) 1750.00% 10.000 185.000 - -7.96% -
401.bzip2 (max) (percentage) 1560.00% 0.050 0.830 - -58.91% -
429.mcf (avg) (percentage) 1440.54% 0.370 5.700 - -2.23% -
403.gcc (max) (percentage) 1375.00% 0.400 5.900 - -0.84% -
470.lbm (max) (percentage) 1200.00% 0.060 0.780 - -6.02% -
403.gcc (avg) (percentage) 983.87% 0.310 3.360 - 0.00% -
401.bzip2 (avg) (percentage) 770.00% 0.100 0.870 - -2.25% -
473.astar 744.44% 9.000 76.000 - -1.30% -
473.astar (avg) 744.44% 9.000 76.000 - -1.30% -
400.perlbench (avg) (percentage) 550.98% 0.510 3.320 - 0.00% -
400.perlbench (max) (percentage) 498.57% 0.700 4.190 - -0.48% -
450.soplex (avg) (percentage) 405.56% 0.540 2.730 - -1.09% -
464.h264ref (max) (percentage) 374.07% 0.270 1.280 - -3.03% -
482.sphinx3 (max) (percentage) 356.52% 0.690 3.150 - -3.08% -
470.lbm (max) 316.67% 6.000 25.000 - -3.85% -
445.gobmk (max) (percentage) 310.00% 0.600 2.460 - -1.20% -
401.bzip2 (max) 266.67% 6.000 22.000 - -60.00% -
471.omnetpp (avg) (percentage) 178.33% 0.600 1.670 - 0.00% -
453.povray (max) (percentage) 175.47% 1.060 2.920 - -1.35% -
429.mcf (max) 157.35% 68.000 175.000 - -6.91% -
450.soplex (max) (percentage) 130.00% 1.100 2.530 - -3.80% -
445.gobmk (avg) (percentage) 118.75% 0.320 0.700 - 0.00% -
458.sjeng (avg) (percentage) 108.70% 0.230 0.480 - 0.00% -
470.lbm (avg) (percentage) 106.90% 0.580 1.200 - -1.64% -
482.sphinx3 (avg) (percentage) 105.49% 0.910 1.870 - 0.00% -
458.sjeng (max) (percentage) 91.30% 0.230 0.440 - -46.99% -
445.gobmk (max) 90.00% 70.000 133.000 - -1.48% -
464.h264ref (max) 81.25% 32.000 58.000 - -1.69% -
401.bzip2 76.92% 13.000 23.000 - -4.17% -
401.bzip2 (avg) 76.92% 13.000 23.000 - -4.17% -
464.h264ref (avg) (percentage) 75.68% 0.370 0.650 - 0.00% -
453.povray (avg) (percentage) 72.60% 0.730 1.260 - 0.00% -
429.mcf 23.19% 69.000 85.000 - -2.30% -
429.mcf (avg) 23.19% 69.000 85.000 - -2.30% -
433.milc (avg) (percentage) 18.07% 0.830 0.980 - 0.00% -
400.perlbench 17.86% 56.000 66.000 - 1.54% -
400.perlbench (avg) 17.86% 56.000 66.000 - 1.54% -
447.dealII (avg) (percentage) 8.79% 0.910 0.990 - 0.00% -
400.perlbench (max) 7.79% 77.000 83.000 - 0.00% -
458.sjeng 2.86% 35.000 36.000 - 0.00% -
458.sjeng (avg) 2.86% 35.000 36.000 - 0.00% -
445.gobmk 2.70% 37.000 38.000 - 0.00% -
445.gobmk (avg) 2.70% 37.000 38.000 - 0.00% -
471.omnetpp (max) (percentage) 1.00% 1.000 1.010 - -6.48% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -5.34% 143421.000 135760.000 - 0.00% -
464.h264ref -3.60% 399974.000 385591.000 - 0.06% -
462.libquantum -3.07% 16989.000 16468.000 - 0.00% -
453.povray -2.87% 691522.000 671707.000 - 0.02% -
403.gcc -2.71% 2486993.000 2419504.000 - -0.02% -
482.sphinx3 -2.16% 120254.000 117653.000 - -0.03% -
400.perlbench -1.89% 900243.000 883203.000 - -0.02% -
445.gobmk -1.53% 1850383.000 1822022.000 - -0.01% -
456.hmmer -1.53% 113613.000 111872.000 - -0.04% -
470.lbm -1.52% 10313.000 10156.000 - 0.00% -
458.sjeng -1.45% 106872.000 105323.000 - 0.00% -
401.bzip2 -1.36% 44357.000 43752.000 - 0.00% -
433.milc -1.03% 62863.000 62214.000 - 0.15% -
429.mcf -1.01% 9249.000 9156.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.24% 10150.000 77.000 - 5.48% -
462.libquantum -98.93% 9659.000 103.000 - 0.00% -
482.sphinx3 -96.47% 23779.000 839.000 - 2.57% -
450.soplex -96.09% 13988.000 547.000 - 1.86% -
444.namd -92.87% 9377.000 669.000 - 0.60% -
453.povray -92.78% 7301.000 527.000 - 0.19% -
429.mcf -92.09% 18905.000 1495.000 - 0.13% -
433.milc -91.43% 14590.000 1251.000 - 0.08% -
400.perlbench -81.94% 11085.000 2002.000 - 1.52% -
401.bzip2 -80.35% 13962.000 2743.000 - 0.29% -
447.dealII -78.69% 9102.000 1940.000 - 0.62% -
471.omnetpp -72.80% 11917.000 3241.000 - 1.76% -
470.lbm -70.82% 11046.000 3223.000 - -0.19% -
456.hmmer -67.78% 9122.000 2939.000 - 0.24% -
464.h264ref -62.63% 12142.000 4538.000 - 0.42% -
473.astar -61.46% 13301.000 5126.000 - -1.46% -
445.gobmk -53.41% 11668.000 5436.000 - -0.07% -
458.sjeng -50.67% 15282.000 7539.000 - 0.44% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd -97.65% 213.000 5.000 - 0.00% -
444.namd (avg) -97.65% 213.000 5.000 - 0.00% -
433.milc (max) -97.03% 269.000 8.000 - -11.11% -
444.namd (max) -96.49% 485.000 17.000 - -5.56% -
403.gcc -93.55% 31.000 2.000 - 0.00% -
403.gcc (avg) -93.55% 31.000 2.000 - 0.00% -
482.sphinx3 -93.06% 216.000 15.000 - 0.00% -
482.sphinx3 (avg) -93.06% 216.000 15.000 - 0.00% -
450.soplex (max) -91.50% 153.000 13.000 - -7.14% -
433.milc -90.08% 121.000 12.000 - 0.00% -
433.milc (avg) -90.08% 121.000 12.000 - 0.00% -
403.gcc (max) -90.00% 40.000 4.000 - 0.00% -
453.povray -88.68% 53.000 6.000 - 0.00% -
453.povray (avg) -88.68% 53.000 6.000 - 0.00% -
456.hmmer (max) -85.29% 68.000 10.000 - 0.00% -
456.hmmer -85.00% 80.000 12.000 - 0.00% -
456.hmmer (avg) -85.00% 80.000 12.000 - 0.00% -
482.sphinx3 (max) -84.15% 164.000 26.000 - 0.00% -
447.dealII (max) -84.13% 126.000 20.000 - 0.00% -
450.soplex -81.33% 75.000 14.000 - 0.00% -
450.soplex (avg) -81.33% 75.000 14.000 - 0.00% -
453.povray (max) -80.52% 77.000 15.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
447.dealII -76.83% 82.000 19.000 - 0.00% -
447.dealII (avg) -76.83% 82.000 19.000 - 0.00% -
471.omnetpp (max) -73.11% 119.000 32.000 - -5.88% -
433.milc (max) (percentage) -64.32% 1.850 0.660 - -9.59% -
444.namd (avg) (percentage) -60.96% 2.280 0.890 - -1.11% -
456.hmmer (max) (percentage) -53.33% 0.750 0.350 - -2.78% -
456.hmmer (avg) (percentage) -50.00% 0.880 0.440 - 0.00% -
444.namd (max) (percentage) -49.61% 5.180 2.610 - -6.12% -
470.lbm -40.62% 64.000 38.000 - -2.56% -
470.lbm (avg) -40.62% 64.000 38.000 - -2.56% -
464.h264ref -34.09% 44.000 29.000 - 0.00% -
464.h264ref (avg) -34.09% 44.000 29.000 - 0.00% -
483.xalancbmk (max) (percentage) -27.45% 0.510 0.370 - 0.00% -
447.dealII (max) (percentage) -25.18% 1.390 1.040 - -2.80% -
471.omnetpp -23.94% 71.000 54.000 - 1.89% -
471.omnetpp (avg) -23.94% 71.000 54.000 - 1.89% -
458.sjeng (max) -5.71% 35.000 33.000 - -46.77% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 63.16% 19.000 31.000 - 0.00% -
nb_compile_successful 42.11% 19.000 27.000 - 0.00% -
nb_execution_successful 42.11% 19.000 27.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 2002.000 1.52%
401.bzip2 2743.000 -
403.gcc 77.000 5.48%
410.bwaves 4690.000 -
416.gamess 12339.000 -
429.mcf 1495.000 -
433.milc 1251.000 -
434.zeusmp 1941.000 -
435.gromacs 4560.000 5.38%
436.cactusADM 1366.000 -
437.leslie3d 17245.000 -
444.namd 669.000 -
445.gobmk 5436.000 -
447.dealII 1940.000 -
450.soplex 547.000 1.86%
453.povray 527.000 -
456.hmmer 2939.000 -
458.sjeng 7539.000 -
459.GemsFDTD 6599.000 -
462.libquantum 103.000 -
464.h264ref 4538.000 -
465.tonto 28502.000 -
470.lbm 3223.000 -
471.omnetpp 3241.000 1.76%
473.astar 5126.000 -1.46%
481.wrf 3435.000 -
482.sphinx3 839.000 2.57%
Geometric Mean 2299.856 -
Name Current %
400.perlbench 883203.000 -
401.bzip2 43752.000 -
403.gcc 2419504.000 -
410.bwaves 573918.000 -
416.gamess 7367913.000 -
429.mcf 9156.000 -
433.milc 62214.000 -
434.zeusmp 936646.000 -
435.gromacs 500891.000 -
436.cactusADM 935790.000 -
437.leslie3d 807743.000 -
444.namd 135760.000 -
445.gobmk 1822022.000 -
447.dealII 324235.000 -
450.soplex 226994.000 -
453.povray 671707.000 -
456.hmmer 111872.000 -
458.sjeng 105323.000 -
459.GemsFDTD 1754397.000 -
462.libquantum 16468.000 -
464.h264ref 385591.000 -
465.tonto 7650234.000 -
470.lbm 10156.000 -
471.omnetpp 485562.000 -
473.astar 23844.000 -
481.wrf 5765126.000 -
482.sphinx3 117653.000 -
Geometric Mean 327014.136 -
Name Current %
400.perlbench 66.000 1.54%
400.perlbench (avg) 66.000 1.54%
400.perlbench (avg) (percentage) 3.320 -
400.perlbench (max) 83.000 -
400.perlbench (max) (percentage) 4.190 -
401.bzip2 23.000 -4.17%
401.bzip2 (avg) 23.000 -4.17%
401.bzip2 (avg) (percentage) 0.870 -2.25%
401.bzip2 (max) 22.000 -60.00%
401.bzip2 (max) (percentage) 0.830 -58.91%
401.bzip2 (unexplained diff vs previous) 8.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.290 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.360 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 5.900 -
410.bwaves 48.000 -
410.bwaves (avg) 48.000 -
410.bwaves (avg) (percentage) 1.040 -
410.bwaves (max) 61.000 -7.58%
410.bwaves (max) (percentage) 1.320 -6.38%
416.gamess 17.000 -
416.gamess (avg) 17.000 -
416.gamess (avg) (percentage) 0.140 -
416.gamess (max) 23.000 -
416.gamess (max) (percentage) 0.190 -
429.mcf 85.000 -2.30%
429.mcf (avg) 85.000 -2.30%
429.mcf (avg) (percentage) 5.700 -2.23%
429.mcf (max) 175.000 -6.91%
429.mcf (max) (percentage) 11.760 -6.67%
429.mcf (unexplained diff vs previous) 2.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.130 -
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 0.980 -
433.milc (max) 8.000 -11.11%
433.milc (max) (percentage) 0.660 -9.59%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.880 -
434.zeusmp (max) 33.000 -2.94%
434.zeusmp (max) (percentage) 1.710 -2.84%
435.gromacs 121.000 5.22%
435.gromacs (avg) 121.000 5.22%
435.gromacs (avg) (percentage) 2.660 -
435.gromacs (max) 227.000 4.13%
435.gromacs (max) (percentage) 4.990 -1.38%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.840 -2.33%
436.cactusADM (max) 7.000 -58.82%
436.cactusADM (max) (percentage) 0.560 -56.92%
436.cactusADM (unexplained diff vs previous) 4.000 -60.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.290 -60.27%
437.leslie3d 236.000 -
437.leslie3d (avg) 236.000 -
437.leslie3d (avg) (percentage) 1.370 -
437.leslie3d (max) 331.000 -
437.leslie3d (max) (percentage) 1.920 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.890 -1.11%
444.namd (max) 17.000 -5.56%
444.namd (max) (percentage) 2.610 -6.12%
444.namd (unexplained diff vs previous) 4.000 -78.95%
444.namd (unexplained diff vs previous) (percentage) 0.600 -79.02%
445.gobmk 38.000 -
445.gobmk (avg) 38.000 -
445.gobmk (avg) (percentage) 0.700 -
445.gobmk (max) 133.000 -1.48%
445.gobmk (max) (percentage) 2.460 -1.20%
447.dealII 19.000 -
447.dealII (avg) 19.000 -
447.dealII (avg) (percentage) 0.990 -
447.dealII (max) 20.000 -
447.dealII (max) (percentage) 1.040 -2.80%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.730 -1.09%
450.soplex (max) 13.000 -7.14%
450.soplex (max) (percentage) 2.530 -3.80%
450.soplex (unexplained diff vs previous) 10.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.830 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.260 -
453.povray (max) 15.000 -
453.povray (max) (percentage) 2.920 -1.35%
456.hmmer 12.000 -
456.hmmer (avg) 12.000 -
456.hmmer (avg) (percentage) 0.440 -
456.hmmer (max) 10.000 -
456.hmmer (max) (percentage) 0.350 -2.78%
458.sjeng 36.000 -
458.sjeng (avg) 36.000 -
458.sjeng (avg) (percentage) 0.480 -
458.sjeng (max) 33.000 -46.77%
458.sjeng (max) (percentage) 0.440 -46.99%
458.sjeng (unexplained diff vs previous) 33.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.440 -
459.GemsFDTD 69.000 -
459.GemsFDTD (avg) 69.000 -
459.GemsFDTD (avg) (percentage) 1.050 -
459.GemsFDTD (max) 120.000 -3.23%
459.GemsFDTD (max) (percentage) 1.830 -2.66%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.260 -2.16%
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 3.790 -6.19%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 29.000 -
464.h264ref (avg) 29.000 -
464.h264ref (avg) (percentage) 0.650 -
464.h264ref (max) 58.000 -1.69%
464.h264ref (max) (percentage) 1.280 -3.03%
465.tonto 94.000 1.08%
465.tonto (avg) 94.000 1.08%
465.tonto (avg) (percentage) 0.330 -
465.tonto (max) 65.000 -
465.tonto (max) (percentage) 0.230 -
470.lbm 38.000 -2.56%
470.lbm (avg) 38.000 -2.56%
470.lbm (avg) (percentage) 1.200 -1.64%
470.lbm (max) 25.000 -3.85%
470.lbm (max) (percentage) 0.780 -6.02%
470.lbm (unexplained diff vs previous) 6.000 20.00%
470.lbm (unexplained diff vs previous) (percentage) 0.190 26.67%
471.omnetpp 54.000 1.89%
471.omnetpp (avg) 54.000 1.89%
471.omnetpp (avg) (percentage) 1.670 -
471.omnetpp (max) 32.000 -5.88%
471.omnetpp (max) (percentage) 1.010 -6.48%
473.astar 76.000 -1.30%
473.astar (avg) 76.000 -1.30%
473.astar (avg) (percentage) 1.490 -
473.astar (max) 185.000 -7.96%
473.astar (max) (percentage) 3.620 -6.70%
481.wrf 64.000 -
481.wrf (avg) 64.000 -
481.wrf (avg) (percentage) 1.870 -
481.wrf (max) 144.000 -4.00%
481.wrf (max) (percentage) 4.220 -2.99%
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.870 -
482.sphinx3 (max) 26.000 -
482.sphinx3 (max) (percentage) 3.150 -3.08%
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) (percentage) 0.370 -
Geometric Mean 5.966 -25.72%