Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ce4aada6e2135e29839f672a6599db628b53295d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/236/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0236 (no-change) 2024-07-11T12:48:14 0:00:00
Previous 0234 (no-change) 2024-07-11T02:46:53 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 123 6
Performance Improvements 42 16
Added Tests 0 168
Unchanged Tests 999 974
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
473.astar 6.85% 4887.000 5222.000 - 7.34% -
450.soplex 6.16% 503.000 534.000 - -0.37% -
435.gromacs 5.09% 4596.000 4830.000 - 0.00% -
481.wrf 4.44% 3106.000 3244.000 - 0.00% -
437.leslie3d 4.05% 6292.000 6547.000 - 0.00% -
434.zeusmp 3.95% 1875.000 1949.000 - 0.00% -
403.gcc 3.64% 55.000 57.000 - -10.94% -
482.sphinx3 3.57% 672.000 696.000 - 3.57% -
459.GemsFDTD 3.49% 4986.000 5160.000 - 0.00% -
471.omnetpp 3.25% 2400.000 2478.000 - -5.20% -
470.lbm 3.21% 3208.000 3311.000 - 1.91% -
410.bwaves 2.64% 4618.000 4740.000 - 0.00% -
445.gobmk 2.10% 4773.000 4873.000 - -0.29% -
464.h264ref 1.84% 3798.000 3868.000 - -4.16% -
401.bzip2 1.73% 2605.000 2650.000 - 5.96% -
433.milc 1.69% 1184.000 1204.000 - 0.50% -
400.perlbench 1.63% 1652.000 1679.000 - 0.90% -
462.libquantum 1.27% 79.000 80.000 - -24.53% -
458.sjeng 1.21% 6434.000 6512.000 - -3.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) 6600.00% 5.000 335.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 6320.00% 0.100 6.420 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 4250.00% 4.000 174.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 4112.50% 0.080 3.370 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 2771.30% 1.150 33.020 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 2500.00% 9.000 234.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 2320.00% 0.200 4.840 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) 2052.38% 21.000 452.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) 1566.67% 6.000 100.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) 1476.92% 0.130 2.050 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) 1300.00% 5.000 70.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 1292.31% 0.130 1.810 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 900.00% 0.120 1.200 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) 875.00% 8.000 78.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 617.65% 17.000 122.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 594.59% 0.370 2.570 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 572.73% 11.000 74.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 544.07% 0.590 3.800 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 275.00% 12.000 45.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 269.57% 0.460 1.700 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 244.44% 9.000 31.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 243.33% 30.000 103.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 230.85% 0.940 3.110 0.000 0.00% 0.000
434.zeusmp (max) 230.43% 23.000 76.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 224.58% 1.790 5.810 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 213.49% 1.260 3.950 - 0.00% -
471.omnetpp (unexplained diff vs previous) 200.00% 26.000 78.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 191.67% 1.080 3.150 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 166.67% 9.000 24.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 157.46% 1.340 3.450 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) 146.43% 56.000 138.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 145.28% 0.530 1.300 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) 142.86% 7.000 17.000 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) (percentage) 136.11% 1.800 4.250 0.000 0.00% 0.000
410.bwaves (max) 131.48% 54.000 125.000 - 0.00% -
416.gamess (unexplained diff vs previous) 131.25% 16.000 37.000 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) (percentage) 126.67% 0.150 0.340 0.000 0.00% 0.000
410.bwaves (max) (percentage) 125.64% 1.170 2.640 - 0.00% -
433.milc (unexplained diff vs previous) 100.00% 10.000 20.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 97.62% 0.840 1.660 0.000 0.00% 0.000
473.astar (max) 72.46% 207.000 357.000 - 0.00% -
473.astar (max) (percentage) 61.56% 4.240 6.850 - 0.00% -
470.lbm (max) 53.62% 69.000 106.000 - 0.00% -
470.lbm (max) (percentage) 48.61% 2.160 3.210 - 0.00% -
437.leslie3d (unexplained diff vs previous) 45.71% 175.000 255.000 0.000 0.00% 0.000
437.leslie3d (max) 45.60% 182.000 265.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 39.93% 2.780 3.890 0.000 0.00% 0.000
437.leslie3d (max) (percentage) 39.66% 2.900 4.050 - 0.00% -
471.omnetpp (max) 29.03% 62.000 80.000 - 0.00% -
471.omnetpp (max) (percentage) 25.00% 2.600 3.250 - 0.00% -
473.astar 14.93% 67.000 77.000 - 0.00% -
473.astar (avg) 14.93% 67.000 77.000 - 0.00% -
459.GemsFDTD (max) 13.92% 158.000 180.000 - 0.00% -
434.zeusmp 11.11% 18.000 20.000 - 0.00% -
434.zeusmp (avg) 11.11% 18.000 20.000 - 0.00% -
459.GemsFDTD (max) (percentage) 10.09% 3.170 3.490 - 0.00% -
459.GemsFDTD 9.09% 55.000 60.000 - 0.00% -
459.GemsFDTD (avg) 9.09% 55.000 60.000 - 0.00% -
481.wrf 8.45% 71.000 77.000 - 0.00% -
481.wrf (avg) 8.45% 71.000 77.000 - 0.00% -
435.gromacs 7.87% 127.000 137.000 - 0.00% -
435.gromacs (avg) 7.87% 127.000 137.000 - 0.00% -
473.astar (avg) (percentage) 7.19% 1.390 1.490 - 0.00% -
450.soplex 7.14% 14.000 15.000 - 0.00% -
450.soplex (avg) 7.14% 14.000 15.000 - 0.00% -
470.lbm 7.14% 28.000 30.000 - 0.00% -
470.lbm (avg) 7.14% 28.000 30.000 - 0.00% -
434.zeusmp (avg) (percentage) 7.07% 0.990 1.060 - 0.00% -
445.gobmk 6.98% 43.000 46.000 - 0.00% -
445.gobmk (avg) 6.98% 43.000 46.000 - 0.00% -
482.sphinx3 6.67% 15.000 16.000 - 0.00% -
482.sphinx3 (avg) 6.67% 15.000 16.000 - 0.00% -
471.omnetpp 6.25% 48.000 51.000 - 0.00% -
471.omnetpp (avg) 6.25% 48.000 51.000 - 0.00% -
429.mcf (avg) (percentage) 5.94% 5.560 5.890 - 0.00% -
459.GemsFDTD (avg) (percentage) 5.41% 1.110 1.170 - 0.00% -
464.h264ref 5.26% 38.000 40.000 - 0.00% -
464.h264ref (avg) 5.26% 38.000 40.000 - 0.00% -
456.hmmer (max) 5.00% 20.000 21.000 - 0.00% -
481.wrf (avg) (percentage) 4.80% 2.290 2.400 - 0.00% -
416.gamess 4.00% 25.000 26.000 - 0.00% -
416.gamess (avg) 4.00% 25.000 26.000 - 0.00% -
410.bwaves 3.85% 52.000 54.000 - 0.00% -
410.bwaves (avg) 3.85% 52.000 54.000 - 0.00% -
437.leslie3d 3.62% 276.000 286.000 - 0.00% -
437.leslie3d (avg) 3.62% 276.000 286.000 - 0.00% -
470.lbm (avg) (percentage) 3.33% 0.900 0.930 - 0.00% -
445.gobmk (avg) (percentage) 3.26% 0.920 0.950 - 0.00% -
456.hmmer (avg) (percentage) 3.13% 0.320 0.330 - 0.00% -
401.bzip2 3.12% 32.000 33.000 - 0.00% -
401.bzip2 (avg) 3.12% 32.000 33.000 - 0.00% -
435.gromacs (avg) (percentage) 2.89% 2.770 2.850 - 0.00% -
410.bwaves (avg) (percentage) 2.65% 1.130 1.160 - 0.00% -
458.sjeng 2.63% 38.000 39.000 - 0.00% -
458.sjeng (avg) 2.63% 38.000 39.000 - 0.00% -
450.soplex (avg) (percentage) 2.08% 2.880 2.940 - 0.00% -
400.perlbench (max) 2.04% 49.000 50.000 - 0.00% -
445.gobmk (max) 2.00% 100.000 102.000 - 0.00% -
464.h264ref (avg) (percentage) 1.96% 1.020 1.040 - 0.00% -
458.sjeng (avg) (percentage) 1.67% 0.600 0.610 - 0.00% -
482.sphinx3 (avg) (percentage) 1.32% 2.280 2.310 - 0.00% -
456.hmmer (max) (percentage) 1.30% 0.770 0.780 - 0.00% -
436.cactusADM (avg) (percentage) 1.11% 0.900 0.910 - 0.00% -
433.milc (avg) (percentage) 1.05% 0.950 0.960 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -24.82% 1821.000 1369.000 - -28.17% -
436.cactusADM -1.28% 1329.000 1312.000 - 0.00% -
453.povray -1.19% 420.000 415.000 - -10.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) -61.54% 13.000 5.000 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) -61.29% 3.100 1.200 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -50.59% 2.530 1.250 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -40.00% 10.000 6.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -39.19% 1.480 0.900 0.000 0.00% 0.000
429.mcf (max) -29.38% 480.000 339.000 - 0.00% -
453.povray (max) -25.00% 12.000 9.000 - 0.00% -
453.povray (max) (percentage) -25.00% 3.000 2.250 - 0.00% -
429.mcf -20.79% 101.000 80.000 - 0.00% -
429.mcf (avg) -20.79% 101.000 80.000 - 0.00% -
436.cactusADM (max) -12.00% 25.000 22.000 - 0.00% -
462.libquantum (max) (percentage) -11.32% 3.710 3.290 - 0.00% -
401.bzip2 (max) (percentage) -11.17% 2.060 1.830 - 0.00% -
436.cactusADM (max) (percentage) -10.42% 1.920 1.720 - 0.00% -
458.sjeng (max) (percentage) -10.07% 1.390 1.250 - 0.00% -
450.soplex (max) (percentage) -10.06% 6.960 6.260 - 0.00% -
444.namd (max) (percentage) -10.00% 1.600 1.440 - 0.00% -
444.namd (max) -10.00% 10.000 9.000 - 0.00% -
482.sphinx3 (max) (percentage) -9.96% 4.520 4.070 - 0.00% -
464.h264ref (max) (percentage) -9.91% 2.320 2.090 - 0.00% -
435.gromacs (max) (percentage) -9.89% 6.170 5.560 - 0.00% -
433.milc (max) (percentage) -9.76% 2.870 2.590 - 0.00% -
416.gamess (max) (percentage) -9.52% 0.420 0.380 - 0.00% -
401.bzip2 (max) -9.43% 53.000 48.000 - 0.00% -
464.h264ref (max) -9.09% 88.000 80.000 - 0.00% -
458.sjeng (max) -8.99% 89.000 81.000 - 0.00% -
416.gamess (max) -8.89% 45.000 41.000 - 0.00% -
482.sphinx3 (max) -6.67% 30.000 28.000 - 0.00% -
433.milc (max) -6.06% 33.000 31.000 - 0.00% -
429.mcf (max) (percentage) -5.95% 26.390 24.820 - 0.00% -
450.soplex (max) -5.71% 35.000 33.000 - 0.00% -
435.gromacs (max) -5.30% 283.000 268.000 - 0.00% -
481.wrf (max) (percentage) -4.31% 5.570 5.330 - 0.00% -
403.gcc (max) (percentage) -3.42% 3.510 3.390 - 0.00% -
465.tonto (max) -2.30% 87.000 85.000 - 0.00% -
465.tonto (max) (percentage) -2.27% 0.440 0.430 - 0.00% -
447.dealII (max) (percentage) -1.59% 0.630 0.620 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -1.28% 0.780 0.770 0.000 0.00% 0.000

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
473.astar 7.34% 4865.000 5222.000 - 6.85% -
401.bzip2 5.96% 2501.000 2650.000 - 1.73% -
482.sphinx3 3.57% 672.000 696.000 - 3.57% -
456.hmmer 3.18% 2639.000 2723.000 - 0.78% -
470.lbm 1.91% 3249.000 3311.000 - 3.21% -
444.namd 1.06% 662.000 669.000 - -0.89% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.65% 42589.000 40182.000 - 0.00% -
444.namd -2.93% 212450.000 206233.000 - 0.00% -
464.h264ref -2.65% 749591.000 729721.000 - 0.00% -
458.sjeng -1.63% 146102.000 143726.000 - 0.00% -
470.lbm -1.28% 12229.000 12073.000 - 0.00% -
450.soplex -1.24% 370392.000 365794.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -28.17% 1906.000 1369.000 - -24.82% -
462.libquantum -24.53% 106.000 80.000 - 1.27% -
403.gcc -10.94% 64.000 57.000 - 3.64% -
453.povray -10.75% 465.000 415.000 - -1.19% -
471.omnetpp -5.20% 2614.000 2478.000 - 3.25% -
464.h264ref -4.16% 4036.000 3868.000 - 1.84% -
458.sjeng -3.55% 6752.000 6512.000 - 1.21% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 173.68% 19.000 52.000 - 0.00% -
nb_execution_successful 173.68% 19.000 52.000 - 0.00% -
nb_total_tests 120.69% 29.000 64.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII (avg) (percentage)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1679.000 1.63%
401.bzip2 2650.000 1.73%
403.gcc 57.000 3.64%
410.bwaves 4740.000 2.64%
416.gamess 10963.000 -
429.mcf 1369.000 -24.82%
433.milc 1204.000 1.69%
434.zeusmp 1949.000 3.95%
435.gromacs 4830.000 5.09%
436.cactusADM 1312.000 -1.28%
437.leslie3d 6547.000 4.05%
444.namd 669.000 -
445.gobmk 4873.000 2.10%
450.soplex 534.000 6.16%
453.povray 415.000 -1.19%
456.hmmer 2723.000 -
458.sjeng 6512.000 1.21%
459.GemsFDTD 5160.000 3.49%
462.libquantum 80.000 1.27%
464.h264ref 3868.000 1.84%
465.tonto 19953.000 -
470.lbm 3311.000 3.21%
471.omnetpp 2478.000 3.25%
473.astar 5222.000 6.85%
481.wrf 3244.000 4.44%
482.sphinx3 696.000 3.57%
Geometric Mean 2002.528 1.18%
Name Current %
400.perlbench 1184693.000 -
401.bzip2 76442.000 -
403.gcc 3429139.000 -
410.bwaves 658643.000 -
416.gamess 8902098.000 -
429.mcf 13243.000 -
433.milc 137516.000 -
434.zeusmp 1056044.000 -
435.gromacs 905716.000 -
436.cactusADM 1449508.000 -
437.leslie3d 962281.000 -
444.namd 206233.000 -
445.gobmk 2111621.000 -
450.soplex 365794.000 -
453.povray 962320.000 -
456.hmmer 300004.000 -
458.sjeng 143726.000 -
459.GemsFDTD 1289639.000 -
462.libquantum 40182.000 -
464.h264ref 729721.000 -
465.tonto 10950792.000 -
470.lbm 12073.000 -
471.omnetpp 682767.000 -
473.astar 41948.000 -
481.wrf 7021941.000 -
482.sphinx3 196277.000 -
Geometric Mean 482085.332 -
Name Current %
400.perlbench 29.000 -
400.perlbench (avg) 29.000 -
400.perlbench (avg) (percentage) 1.780 -
400.perlbench (max) 50.000 2.04%
400.perlbench (max) (percentage) 3.000 -
401.bzip2 33.000 3.12%
401.bzip2 (avg) 33.000 3.12%
401.bzip2 (avg) (percentage) 1.260 -
401.bzip2 (max) 48.000 -9.43%
401.bzip2 (max) (percentage) 1.830 -11.17%
401.bzip2 (unexplained diff vs previous) 45.000 275.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.700 269.57%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.460 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.390 -3.42%
410.bwaves 54.000 3.85%
410.bwaves (avg) 54.000 3.85%
410.bwaves (avg) (percentage) 1.160 2.65%
410.bwaves (max) 125.000 131.48%
410.bwaves (max) (percentage) 2.640 125.64%
410.bwaves (unexplained diff vs previous) 122.000 617.65%
410.bwaves (unexplained diff vs previous) (percentage) 2.570 594.59%
416.gamess 26.000 4.00%
416.gamess (avg) 26.000 4.00%
416.gamess (avg) (percentage) 0.240 -
416.gamess (max) 41.000 -8.89%
416.gamess (max) (percentage) 0.380 -9.52%
416.gamess (unexplained diff vs previous) 37.000 131.25%
416.gamess (unexplained diff vs previous) (percentage) 0.340 126.67%
429.mcf 80.000 -20.79%
429.mcf (avg) 80.000 -20.79%
429.mcf (avg) (percentage) 5.890 5.94%
429.mcf (max) 339.000 -29.38%
429.mcf (max) (percentage) 24.820 -5.95%
429.mcf (unexplained diff vs previous) 452.000 2052.38%
429.mcf (unexplained diff vs previous) (percentage) 33.020 2771.30%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 0.960 1.05%
433.milc (max) 31.000 -6.06%
433.milc (max) (percentage) 2.590 -9.76%
433.milc (unexplained diff vs previous) 20.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 1.660 97.62%
434.zeusmp 20.000 11.11%
434.zeusmp (avg) 20.000 11.11%
434.zeusmp (avg) (percentage) 1.060 7.07%
434.zeusmp (max) 76.000 230.43%
434.zeusmp (max) (percentage) 3.950 213.49%
434.zeusmp (unexplained diff vs previous) 74.000 572.73%
434.zeusmp (unexplained diff vs previous) (percentage) 3.800 544.07%
435.gromacs 137.000 7.87%
435.gromacs (avg) 137.000 7.87%
435.gromacs (avg) (percentage) 2.850 2.89%
435.gromacs (max) 268.000 -5.30%
435.gromacs (max) (percentage) 5.560 -9.89%
435.gromacs (unexplained diff vs previous) 234.000 2500.00%
435.gromacs (unexplained diff vs previous) (percentage) 4.840 2320.00%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.910 1.11%
436.cactusADM (max) 22.000 -12.00%
436.cactusADM (max) (percentage) 1.720 -10.42%
436.cactusADM (unexplained diff vs previous) 17.000 142.86%
436.cactusADM (unexplained diff vs previous) (percentage) 1.300 145.28%
437.leslie3d 286.000 3.62%
437.leslie3d (avg) 286.000 3.62%
437.leslie3d (avg) (percentage) 4.380 -
437.leslie3d (max) 265.000 45.60%
437.leslie3d (max) (percentage) 4.050 39.66%
437.leslie3d (unexplained diff vs previous) 255.000 45.71%
437.leslie3d (unexplained diff vs previous) (percentage) 3.890 39.93%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.900 -
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.440 -10.00%
444.namd (unexplained diff vs previous) 6.000 -40.00%
444.namd (unexplained diff vs previous) (percentage) 0.900 -39.19%
445.gobmk 46.000 6.98%
445.gobmk (avg) 46.000 6.98%
445.gobmk (avg) (percentage) 0.950 3.26%
445.gobmk (max) 102.000 2.00%
445.gobmk (max) (percentage) 2.100 -
445.gobmk (unexplained diff vs previous) 100.000 1566.67%
445.gobmk (unexplained diff vs previous) (percentage) 2.050 1476.92%
447.dealII (avg) (percentage) 1.460 -
447.dealII (max) (percentage) 0.620 -1.59%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.940 2.08%
450.soplex (max) 33.000 -5.71%
450.soplex (max) (percentage) 6.260 -10.06%
450.soplex (unexplained diff vs previous) 31.000 244.44%
450.soplex (unexplained diff vs previous) (percentage) 5.810 224.58%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.500 -
453.povray (max) 9.000 -25.00%
453.povray (max) (percentage) 2.250 -25.00%
453.povray (unexplained diff vs previous) 5.000 -61.54%
453.povray (unexplained diff vs previous) (percentage) 1.200 -61.29%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.330 3.13%
456.hmmer (max) 21.000 5.00%
456.hmmer (max) (percentage) 0.780 1.30%
456.hmmer (unexplained diff vs previous) 21.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.770 -1.28%
458.sjeng 39.000 2.63%
458.sjeng (avg) 39.000 2.63%
458.sjeng (avg) (percentage) 0.610 1.67%
458.sjeng (max) 81.000 -8.99%
458.sjeng (max) (percentage) 1.250 -10.07%
458.sjeng (unexplained diff vs previous) 78.000 875.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.200 900.00%
459.GemsFDTD 60.000 9.09%
459.GemsFDTD (avg) 60.000 9.09%
459.GemsFDTD (avg) (percentage) 1.170 5.41%
459.GemsFDTD (max) 180.000 13.92%
459.GemsFDTD (max) (percentage) 3.490 10.09%
459.GemsFDTD (unexplained diff vs previous) 174.000 4250.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.370 4112.50%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.070 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 3.290 -11.32%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.250 -50.59%
464.h264ref 40.000 5.26%
464.h264ref (avg) 40.000 5.26%
464.h264ref (avg) (percentage) 1.040 1.96%
464.h264ref (max) 80.000 -9.09%
464.h264ref (max) (percentage) 2.090 -9.91%
464.h264ref (unexplained diff vs previous) 70.000 1300.00%
464.h264ref (unexplained diff vs previous) (percentage) 1.810 1292.31%
465.tonto 55.000 -
465.tonto (avg) 55.000 -
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 85.000 -2.30%
465.tonto (max) (percentage) 0.430 -2.27%
470.lbm 30.000 7.14%
470.lbm (avg) 30.000 7.14%
470.lbm (avg) (percentage) 0.930 3.33%
470.lbm (max) 106.000 53.62%
470.lbm (max) (percentage) 3.210 48.61%
470.lbm (unexplained diff vs previous) 103.000 243.33%
470.lbm (unexplained diff vs previous) (percentage) 3.110 230.85%
471.omnetpp 51.000 6.25%
471.omnetpp (avg) 51.000 6.25%
471.omnetpp (avg) (percentage) 2.060 -
471.omnetpp (max) 80.000 29.03%
471.omnetpp (max) (percentage) 3.250 25.00%
471.omnetpp (unexplained diff vs previous) 78.000 200.00%
471.omnetpp (unexplained diff vs previous) (percentage) 3.150 191.67%
473.astar 77.000 14.93%
473.astar (avg) 77.000 14.93%
473.astar (avg) (percentage) 1.490 7.19%
473.astar (max) 357.000 72.46%
473.astar (max) (percentage) 6.850 61.56%
473.astar (unexplained diff vs previous) 335.000 6600.00%
473.astar (unexplained diff vs previous) (percentage) 6.420 6320.00%
481.wrf 77.000 8.45%
481.wrf (avg) 77.000 8.45%
481.wrf (avg) (percentage) 2.400 4.80%
481.wrf (max) 172.000 -
481.wrf (max) (percentage) 5.330 -4.31%
481.wrf (unexplained diff vs previous) 138.000 146.43%
481.wrf (unexplained diff vs previous) (percentage) 4.250 136.11%
482.sphinx3 16.000 6.67%
482.sphinx3 (avg) 16.000 6.67%
482.sphinx3 (avg) (percentage) 2.310 1.32%
482.sphinx3 (max) 28.000 -6.67%
482.sphinx3 (max) (percentage) 4.070 -9.96%
482.sphinx3 (unexplained diff vs previous) 24.000 166.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.450 157.46%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.100 -
Geometric Mean 10.044 49.80%