Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7064e4b1633811da984261fdc585ba4438efe827 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/134/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0134 (no-change) 2024-05-20T02:36:15 0:00:00
Previous 0132 (no-change) 2024-05-19T05:11:53 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 58 14
Performance Improvements 97 14
Added Tests 4 165
Unchanged Tests 981 947
Total Tests 1140

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 8.67% 2156.000 2343.000 - 8.82% -
403.gcc 5.26% 57.000 60.000 - 1.69% -
437.leslie3d 4.31% 6504.000 6784.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 1125.00% 0.040 0.490 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 1100.00% 2.000 24.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 1068.75% 16.000 187.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 978.38% 0.740 7.980 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 900.00% 1.000 10.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 900.00% 0.140 1.400 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 833.33% 0.030 0.280 0.000 0.00% 0.000
471.omnetpp (max) 822.73% 22.000 203.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 800.00% 2.000 18.000 0.000 0.00% 0.000
471.omnetpp (max) (percentage) 741.75% 1.030 8.670 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 500.00% 0.030 0.180 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) 440.00% 5.000 27.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 210.00% 0.100 0.310 0.000 0.00% 0.000
403.gcc (max) 200.00% 1.000 3.000 - 0.00% -
403.gcc (unexplained diff vs previous) 200.00% 1.000 3.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 200.00% 2.000 6.000 0.000 0.00% 0.000
403.gcc (unexplained diff vs previous) (percentage) 185.71% 1.750 5.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 112.12% 132.000 280.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 103.45% 2.030 4.130 0.000 0.00% 0.000
437.leslie3d (max) 100.00% 146.000 292.000 - 0.00% -
437.leslie3d (max) (percentage) 90.71% 2.260 4.310 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 83.53% 0.850 1.560 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) 81.48% 27.000 49.000 0.000 0.00% 0.000
481.wrf (max) (percentage) 81.18% 0.850 1.540 - 0.00% -
481.wrf (max) 77.78% 27.000 48.000 - 0.00% -
403.gcc (max) (percentage) 57.01% 3.350 5.260 - 0.00% -
464.h264ref (unexplained diff vs previous) 38.89% 18.000 25.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 38.30% 0.470 0.650 0.000 0.00% 0.000
471.omnetpp 30.61% 49.000 64.000 - 0.00% -
471.omnetpp (avg) 30.61% 49.000 64.000 - 0.00% -
416.gamess (max) 30.00% 20.000 26.000 - 0.00% -
416.gamess (max) (percentage) 28.57% 0.140 0.180 - 0.00% -
416.gamess 21.43% 14.000 17.000 - 0.00% -
416.gamess (avg) 21.43% 14.000 17.000 - 0.00% -
471.omnetpp (avg) (percentage) 20.00% 2.300 2.760 - 0.00% -
416.gamess (avg) (percentage) 20.00% 0.100 0.120 - 0.00% -
403.gcc (avg) (percentage) 19.62% 2.600 3.110 - 0.00% -
481.wrf (avg) (percentage) 19.28% 0.830 0.990 - 0.00% -
481.wrf 19.23% 26.000 31.000 - 0.00% -
481.wrf (avg) 19.23% 26.000 31.000 - 0.00% -
464.h264ref (max) (percentage) 18.18% 0.550 0.650 - 0.00% -
464.h264ref (max) 14.29% 21.000 24.000 - 0.00% -
470.lbm (max) 13.64% 22.000 25.000 - 0.00% -
470.lbm (max) (percentage) 10.14% 0.690 0.760 - 0.00% -
437.leslie3d 9.47% 190.000 208.000 - 0.00% -
437.leslie3d (avg) 9.47% 190.000 208.000 - 0.00% -
459.GemsFDTD 9.09% 33.000 36.000 - 0.00% -
459.GemsFDTD (avg) 9.09% 33.000 36.000 - 0.00% -
470.lbm (unexplained diff vs previous) 8.70% 23.000 25.000 0.000 0.00% 0.000
458.sjeng (max) (percentage) 7.69% 0.260 0.280 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 7.14% 0.700 0.750 0.000 0.00% 0.000
458.sjeng (max) 6.25% 16.000 17.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 6.15% 0.650 0.690 - 0.00% -
437.leslie3d (avg) (percentage) 5.12% 2.930 3.080 - 0.00% -
436.cactusADM (avg) (percentage) 4.60% 0.870 0.910 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
481.wrf -1.54% 3187.000 3138.000 - 0.00% -
482.sphinx3 -1.38% 723.000 713.000 - 7.38% -
436.cactusADM -1.30% 1305.000 1288.000 - 0.00% -
435.gromacs -1.13% 4508.000 4457.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) -83.49% 1.090 0.180 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -83.33% 6.000 1.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -73.33% 0.150 0.040 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -71.43% 7.000 2.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -66.67% 3.000 1.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -65.91% 0.440 0.150 0.000 0.00% 0.000
450.soplex (max) -64.29% 14.000 5.000 - 0.00% -
450.soplex (max) (percentage) -63.10% 2.710 1.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -62.50% 32.000 12.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -62.39% 1.170 0.440 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -51.43% 105.000 51.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -51.07% 2.330 1.140 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -50.00% 14.000 7.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -50.00% 1.400 0.700 0.000 0.00% 0.000
447.dealII (max) (percentage) -41.94% 2.480 1.440 - 0.00% -
447.dealII (max) -41.67% 24.000 14.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -40.28% 1.440 0.860 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -40.00% 5.000 3.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -40.00% 75.000 45.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -40.00% 0.350 0.210 0.000 0.00% 0.000
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
462.libquantum (max) (percentage) -25.07% 3.750 2.810 - 0.00% -
433.milc (max) -25.00% 8.000 6.000 - 0.00% -
444.namd (max) -20.00% 5.000 4.000 - 0.00% -
410.bwaves (max) -14.71% 34.000 29.000 - 0.00% -
435.gromacs -14.38% 146.000 125.000 - 0.00% -
435.gromacs (avg) -14.38% 146.000 125.000 - 0.00% -
435.gromacs (avg) (percentage) -13.50% 3.260 2.820 - 0.00% -
433.milc (max) (percentage) -13.33% 0.750 0.650 - 0.00% -
459.GemsFDTD (max) (percentage) -12.68% 1.420 1.240 - 0.00% -
433.milc (unexplained diff vs previous) -12.50% 8.000 7.000 0.000 0.00% 0.000
444.namd -12.50% 8.000 7.000 - 0.00% -
444.namd (avg) -12.50% 8.000 7.000 - 0.00% -
459.GemsFDTD (max) -12.33% 73.000 64.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -12.16% 0.740 0.650 0.000 0.00% 0.000
410.bwaves (max) (percentage) -12.00% 0.750 0.660 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -12.00% 0.750 0.660 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -11.76% 34.000 30.000 0.000 0.00% 0.000
436.cactusADM (max) -11.11% 18.000 16.000 - 0.00% -
453.povray (avg) (percentage) -10.00% 1.200 1.080 - 0.00% -
445.gobmk -9.68% 62.000 56.000 - 0.00% -
445.gobmk (avg) -9.68% 62.000 56.000 - 0.00% -
445.gobmk (avg) (percentage) -9.56% 1.360 1.230 - 0.00% -
444.namd (max) (percentage) -9.46% 0.740 0.670 - 0.00% -
473.astar (max) (percentage) -9.09% 0.770 0.700 - 0.00% -
433.milc -9.09% 11.000 10.000 - 0.00% -
433.milc (avg) -9.09% 11.000 10.000 - 0.00% -
434.zeusmp -9.09% 11.000 10.000 - 0.00% -
434.zeusmp (avg) -9.09% 11.000 10.000 - 0.00% -
429.mcf (max) -8.33% 24.000 22.000 - 0.00% -
473.astar (max) -8.11% 37.000 34.000 - 0.00% -
450.soplex (avg) (percentage) -7.74% 2.970 2.740 - 0.00% -
429.mcf (max) (percentage) -7.69% 1.690 1.560 - 0.00% -
434.zeusmp (max) -7.41% 27.000 25.000 - 0.00% -
447.dealII (avg) (percentage) -7.24% 1.520 1.410 - 0.00% -
436.cactusADM (max) (percentage) -7.14% 1.400 1.300 - 0.00% -
401.bzip2 -6.94% 72.000 67.000 - 0.00% -
401.bzip2 (avg) -6.94% 72.000 67.000 - 0.00% -
401.bzip2 (avg) (percentage) -6.79% 2.650 2.470 - 0.00% -
447.dealII -6.67% 15.000 14.000 - 0.00% -
447.dealII (avg) -6.67% 15.000 14.000 - 0.00% -
434.zeusmp (max) (percentage) -6.34% 1.420 1.330 - 0.00% -
450.soplex -6.25% 16.000 15.000 - 0.00% -
450.soplex (avg) -6.25% 16.000 15.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -5.56% 18.000 17.000 0.000 0.00% 0.000
482.sphinx3 -5.56% 18.000 17.000 - 0.00% -
482.sphinx3 (avg) -5.56% 18.000 17.000 - 0.00% -
434.zeusmp (avg) (percentage) -5.17% 0.580 0.550 - 0.00% -
429.mcf -5.08% 59.000 56.000 - 0.00% -
429.mcf (avg) -5.08% 59.000 56.000 - 0.00% -
410.bwaves -5.00% 40.000 38.000 - 0.00% -
410.bwaves (avg) -5.00% 40.000 38.000 - 0.00% -
473.astar (avg) (percentage) -4.69% 2.130 2.030 - 0.00% -
462.libquantum (avg) (percentage) -4.60% 1.740 1.660 - 0.00% -
464.h264ref -4.55% 44.000 42.000 - 0.00% -
464.h264ref (avg) -4.55% 44.000 42.000 - 0.00% -
429.mcf (avg) (percentage) -4.38% 4.110 3.930 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -4.35% 1.380 1.320 0.000 0.00% 0.000
464.h264ref (avg) (percentage) -4.27% 1.170 1.120 - 0.00% -
482.sphinx3 (avg) (percentage) -4.25% 2.590 2.480 - 0.00% -
444.namd (avg) (percentage) -4.17% 1.200 1.150 - 0.00% -
473.astar -3.85% 104.000 100.000 - 0.00% -
473.astar (avg) -3.85% 104.000 100.000 - 0.00% -
453.povray (max) (percentage) -3.36% 1.190 1.150 - 0.00% -
458.sjeng (avg) (percentage) -3.17% 0.630 0.610 - 0.00% -
445.gobmk (max) (percentage) -3.00% 1.000 0.970 - 0.00% -
458.sjeng -2.56% 39.000 38.000 - 0.00% -
458.sjeng (avg) -2.56% 39.000 38.000 - 0.00% -
410.bwaves (avg) (percentage) -2.27% 0.880 0.860 - 0.00% -
445.gobmk (max) -2.22% 45.000 44.000 - 0.00% -
435.gromacs (max) -1.99% 201.000 197.000 - 0.00% -
433.milc (avg) (percentage) -1.96% 1.020 1.000 - 0.00% -
483.xalancbmk (max) (percentage) -1.32% 7.600 7.500 - 0.00% -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.45% 66682.000 68318.000 - 0.00% -
433.milc 1.74% 128200.000 130432.000 - 0.00% -
447.dealII 1.35% 548786.000 556182.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 8.82% 2153.000 2343.000 - 8.67% -
401.bzip2 8.57% 2510.000 2725.000 - -0.44% -
482.sphinx3 7.38% 664.000 713.000 - -1.38% -
473.astar 6.53% 4638.000 4941.000 - 0.49% -
456.hmmer 5.92% 2637.000 2793.000 - 0.25% -
400.perlbench 4.82% 1474.000 1545.000 - -0.19% -
470.lbm 2.84% 3235.000 3327.000 - 0.76% -
444.namd 2.08% 672.000 686.000 - 0.15% -
433.milc 1.90% 1054.000 1074.000 - -0.65% -
403.gcc 1.69% 59.000 60.000 - 5.26% -
450.soplex 1.67% 540.000 549.000 - -0.18% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.00% 45013.000 38259.000 - 0.00% -
458.sjeng -2.27% 131729.000 128745.000 - 0.00% -
444.namd -2.22% 168697.000 164956.000 - 0.00% -
473.astar -1.83% 33048.000 32444.000 - 0.00% -
450.soplex -1.42% 319083.000 314567.000 - 0.00% -
470.lbm -1.14% 10901.000 10777.000 - 0.00% -
400.perlbench -1.04% 1269683.000 1256540.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -23.15% 108.000 83.000 - 0.00% -
429.mcf -22.88% 1879.000 1449.000 - 0.21% -
464.h264ref -3.66% 3965.000 3820.000 - -0.65% -
453.povray -2.61% 421.000 410.000 - -0.24% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1545.000 -
401.bzip2 2725.000 -
403.gcc 60.000 5.26%
410.bwaves 4523.000 -
416.gamess 14957.000 -
429.mcf 1449.000 -
433.milc 1074.000 -
434.zeusmp 1905.000 -
435.gromacs 4457.000 -1.13%
436.cactusADM 1288.000 -1.30%
437.leslie3d 6784.000 4.31%
444.namd 686.000 -
445.gobmk 4588.000 -
447.dealII 1007.000 -
450.soplex 549.000 -
453.povray 410.000 -
456.hmmer 2793.000 -
458.sjeng 6355.000 -
459.GemsFDTD 5236.000 -
462.libquantum 83.000 -
464.h264ref 3820.000 -
465.tonto 20293.000 -
470.lbm 3327.000 -
471.omnetpp 2343.000 8.67%
473.astar 4941.000 -
481.wrf 3138.000 -1.54%
482.sphinx3 713.000 -1.38%
Geometric Mean 1954.926 -
Name Current %
400.perlbench 1256540.000 -
401.bzip2 68318.000 -
403.gcc 3788231.000 -
410.bwaves 632040.000 -
416.gamess 8286269.000 -
429.mcf 11448.000 -
433.milc 130432.000 -
434.zeusmp 1011867.000 -
435.gromacs 701816.000 -
436.cactusADM 1141318.000 -
437.leslie3d 944525.000 -
444.namd 164956.000 -
445.gobmk 2238960.000 -
447.dealII 556182.000 -
450.soplex 314567.000 -
453.povray 1125527.000 -
456.hmmer 163771.000 -
458.sjeng 128745.000 -
459.GemsFDTD 1244082.000 -
462.libquantum 38259.000 -
464.h264ref 768341.000 -
465.tonto 9844166.000 -
470.lbm 10777.000 -
471.omnetpp 749679.000 -
473.astar 32444.000 -
481.wrf 6124442.000 -
482.sphinx3 175842.000 -
Geometric Mean 444101.189 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 67.000 -6.94%
401.bzip2 (avg) 67.000 -6.94%
401.bzip2 (avg) (percentage) 2.470 -6.79%
401.bzip2 (max) 113.000 -
401.bzip2 (max) (percentage) 4.150 -
401.bzip2 (unexplained diff vs previous) 12.000 -62.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.440 -62.39%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 3.110 19.62%
403.gcc (max) 3.000 200.00%
403.gcc (max) (percentage) 5.260 57.01%
403.gcc (unexplained diff vs previous) 3.000 200.00%
403.gcc (unexplained diff vs previous) (percentage) 5.000 185.71%
410.bwaves 38.000 -5.00%
410.bwaves (avg) 38.000 -5.00%
410.bwaves (avg) (percentage) 0.860 -2.27%
410.bwaves (max) 29.000 -14.71%
410.bwaves (max) (percentage) 0.660 -12.00%
410.bwaves (unexplained diff vs previous) 30.000 -11.76%
410.bwaves (unexplained diff vs previous) (percentage) 0.660 -12.00%
416.gamess 17.000 21.43%
416.gamess (avg) 17.000 21.43%
416.gamess (avg) (percentage) 0.120 20.00%
416.gamess (max) 26.000 30.00%
416.gamess (max) (percentage) 0.180 28.57%
416.gamess (unexplained diff vs previous) 27.000 440.00%
416.gamess (unexplained diff vs previous) (percentage) 0.180 500.00%
429.mcf 56.000 -5.08%
429.mcf (avg) 56.000 -5.08%
429.mcf (avg) (percentage) 3.930 -4.38%
429.mcf (max) 22.000 -8.33%
429.mcf (max) (percentage) 1.560 -7.69%
429.mcf (unexplained diff vs previous) 3.000 -40.00%
429.mcf (unexplained diff vs previous) (percentage) 0.210 -40.00%
433.milc 10.000 -9.09%
433.milc (avg) 10.000 -9.09%
433.milc (avg) (percentage) 1.000 -1.96%
433.milc (max) 6.000 -25.00%
433.milc (max) (percentage) 0.650 -13.33%
433.milc (unexplained diff vs previous) 7.000 -12.50%
433.milc (unexplained diff vs previous) (percentage) 0.650 -12.16%
434.zeusmp 10.000 -9.09%
434.zeusmp (avg) 10.000 -9.09%
434.zeusmp (avg) (percentage) 0.550 -5.17%
434.zeusmp (max) 25.000 -7.41%
434.zeusmp (max) (percentage) 1.330 -6.34%
434.zeusmp (unexplained diff vs previous) 6.000 200.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.310 210.00%
435.gromacs 125.000 -14.38%
435.gromacs (avg) 125.000 -14.38%
435.gromacs (avg) (percentage) 2.820 -13.50%
435.gromacs (max) 197.000 -1.99%
435.gromacs (max) (percentage) 4.430 -
435.gromacs (unexplained diff vs previous) 51.000 -51.43%
435.gromacs (unexplained diff vs previous) (percentage) 1.140 -51.07%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.910 4.60%
436.cactusADM (max) 16.000 -11.11%
436.cactusADM (max) (percentage) 1.300 -7.14%
436.cactusADM (unexplained diff vs previous) 17.000 -5.56%
436.cactusADM (unexplained diff vs previous) (percentage) 1.320 -4.35%
437.leslie3d 208.000 9.47%
437.leslie3d (avg) 208.000 9.47%
437.leslie3d (avg) (percentage) 3.080 5.12%
437.leslie3d (max) 292.000 100.00%
437.leslie3d (max) (percentage) 4.310 90.71%
437.leslie3d (unexplained diff vs previous) 280.000 112.12%
437.leslie3d (unexplained diff vs previous) (percentage) 4.130 103.45%
444.namd 7.000 -12.50%
444.namd (avg) 7.000 -12.50%
444.namd (avg) (percentage) 1.150 -4.17%
444.namd (max) 4.000 -20.00%
444.namd (max) (percentage) 0.670 -9.46%
444.namd (unexplained diff vs previous) 1.000 -66.67%
444.namd (unexplained diff vs previous) (percentage) 0.150 -65.91%
445.gobmk 56.000 -9.68%
445.gobmk (avg) 56.000 -9.68%
445.gobmk (avg) (percentage) 1.230 -9.56%
445.gobmk (max) 44.000 -2.22%
445.gobmk (max) (percentage) 0.970 -3.00%
445.gobmk (unexplained diff vs previous) 2.000 -71.43%
445.gobmk (unexplained diff vs previous) (percentage) 0.040 -73.33%
447.dealII 14.000 -6.67%
447.dealII (avg) 14.000 -6.67%
447.dealII (avg) (percentage) 1.410 -7.24%
447.dealII (max) 14.000 -41.67%
447.dealII (max) (percentage) 1.440 -41.94%
447.dealII (unexplained diff vs previous) 7.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.700 -50.00%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.740 -7.74%
450.soplex (max) 5.000 -64.29%
450.soplex (max) (percentage) 1.000 -63.10%
450.soplex (unexplained diff vs previous) 1.000 -83.33%
450.soplex (unexplained diff vs previous) (percentage) 0.180 -83.49%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.080 -10.00%
453.povray (max) 4.000 -
453.povray (max) (percentage) 1.150 -3.36%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.240 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.270 -
456.hmmer (max) 6.000 -
456.hmmer (max) (percentage) 0.250 -
456.hmmer (unexplained diff vs previous) 7.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.250 -
458.sjeng 38.000 -2.56%
458.sjeng (avg) 38.000 -2.56%
458.sjeng (avg) (percentage) 0.610 -3.17%
458.sjeng (max) 17.000 6.25%
458.sjeng (max) (percentage) 0.280 7.69%
458.sjeng (unexplained diff vs previous) 18.000 800.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.280 833.33%
459.GemsFDTD 36.000 9.09%
459.GemsFDTD (avg) 36.000 9.09%
459.GemsFDTD (avg) (percentage) 0.690 6.15%
459.GemsFDTD (max) 64.000 -12.33%
459.GemsFDTD (max) (percentage) 1.240 -12.68%
459.GemsFDTD (unexplained diff vs previous) 45.000 -40.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.860 -40.28%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.660 -4.60%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 2.810 -25.07%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 42.000 -4.55%
464.h264ref (avg) 42.000 -4.55%
464.h264ref (avg) (percentage) 1.120 -4.27%
464.h264ref (max) 24.000 14.29%
464.h264ref (max) (percentage) 0.650 18.18%
464.h264ref (unexplained diff vs previous) 25.000 38.89%
464.h264ref (unexplained diff vs previous) (percentage) 0.650 38.30%
470.lbm 38.000 -
470.lbm (avg) 38.000 -
470.lbm (avg) (percentage) 1.150 -
470.lbm (max) 25.000 13.64%
470.lbm (max) (percentage) 0.760 10.14%
470.lbm (unexplained diff vs previous) 25.000 8.70%
470.lbm (unexplained diff vs previous) (percentage) 0.750 7.14%
471.omnetpp 64.000 30.61%
471.omnetpp (avg) 64.000 30.61%
471.omnetpp (avg) (percentage) 2.760 20.00%
471.omnetpp (max) 203.000 822.73%
471.omnetpp (max) (percentage) 8.670 741.75%
471.omnetpp (unexplained diff vs previous) 187.000 1068.75%
471.omnetpp (unexplained diff vs previous) (percentage) 7.980 978.38%
473.astar 100.000 -3.85%
473.astar (avg) 100.000 -3.85%
473.astar (avg) (percentage) 2.030 -4.69%
473.astar (max) 34.000 -8.11%
473.astar (max) (percentage) 0.700 -9.09%
473.astar (unexplained diff vs previous) 24.000 1100.00%
473.astar (unexplained diff vs previous) (percentage) 0.490 1125.00%
481.wrf 31.000 19.23%
481.wrf (avg) 31.000 19.23%
481.wrf (avg) (percentage) 0.990 19.28%
481.wrf (max) 48.000 77.78%
481.wrf (max) (percentage) 1.540 81.18%
481.wrf (unexplained diff vs previous) 49.000 81.48%
481.wrf (unexplained diff vs previous) (percentage) 1.560 83.53%
482.sphinx3 17.000 -5.56%
482.sphinx3 (avg) 17.000 -5.56%
482.sphinx3 (avg) (percentage) 2.480 -4.25%
482.sphinx3 (max) 30.000 -
482.sphinx3 (max) (percentage) 4.230 -
482.sphinx3 (unexplained diff vs previous) 10.000 900.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.400 900.00%
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 7.500 -1.32%
Geometric Mean 4.152 -13.36%