Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e635520be888335dd59874038d33e60cca3a7143 (+ 1 commits)
regression LLVM-1232
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/201/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0201 (llvmorg-19-init-13359-ge635520be888) 2024-06-04T22:34:05 0:00:00
Previous 0200 (llvmorg-19-init-13358-g043cc5a2275d) 2024-06-04T11:09:17 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 11
Performance Improvements 125 15
Added Tests 4 173
Unchanged Tests 1033 977
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.51% 57.000 59.000 - -7.81% -
450.soplex 3.38% 533.000 551.000 - 2.80% -
482.sphinx3 1.73% 694.000 706.000 - 5.06% -
429.mcf 1.67% 1380.000 1403.000 - -26.39% -
437.leslie3d 1.61% 6415.000 6518.000 - 0.00% -
401.bzip2 1.24% 2655.000 2688.000 - 7.48% -
434.zeusmp 1.04% 1919.000 1939.000 - 0.00% -
464.h264ref 1.03% 3879.000 3919.000 - -2.90% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc 50.00% 2.000 3.000 - 0.00% -
403.gcc (avg) 50.00% 2.000 3.000 - 0.00% -
400.perlbench (avg) (percentage) 32.84% 1.340 1.780 - 0.00% -
400.perlbench 30.43% 23.000 30.000 - 0.00% -
400.perlbench (avg) 30.43% 23.000 30.000 - 0.00% -
434.zeusmp (avg) (percentage) 1.12% 0.890 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -3.22% 1770.000 1713.000 - 2.94% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) -96.69% 2.420 0.080 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -96.64% 119.000 4.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -95.00% 32.830 1.640 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -94.92% 453.000 23.000 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) -92.49% 173.000 13.000 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) (percentage) -92.39% 5.390 0.410 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) (percentage) -92.33% 3.000 0.230 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -92.31% 13.000 1.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -92.15% 1.910 0.150 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -92.00% 25.000 2.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -90.43% 115.000 11.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -90.37% 4.570 0.440 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -89.12% 147.000 16.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -89.03% 3.100 0.340 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -88.00% 3.250 0.390 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) -87.96% 108.000 13.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -86.74% 264.000 35.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -86.65% 5.470 0.730 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -85.66% 244.000 35.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -85.50% 4.760 0.690 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -84.74% 1.900 0.290 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -84.62% 13.000 2.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -83.60% 189.000 31.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -83.56% 3.650 0.600 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) -82.76% 29.000 5.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -81.61% 2.230 0.410 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -81.48% 27.000 5.000 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) (percentage) -80.77% 0.260 0.050 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -78.52% 149.000 32.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -78.51% 2.280 0.490 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -75.20% 1.250 0.310 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -75.00% 16.000 4.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -66.09% 4.660 1.580 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -65.55% 299.000 103.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -57.48% 7.690 3.270 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -56.10% 41.000 18.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -52.78% 3.600 1.700 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) -52.00% 25.000 12.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) -37.50% 16.000 10.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -37.29% 0.590 0.370 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -33.97% 1.560 1.030 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -33.33% 30.000 20.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -28.90% 1.730 1.230 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -28.26% 46.000 33.000 0.000 0.00% 0.000
435.gromacs (max) -25.45% 279.000 208.000 - 0.00% -
435.gromacs (max) (percentage) -24.91% 5.780 4.340 - 0.00% -
462.libquantum (max) -20.00% 5.000 4.000 - 0.00% -
471.omnetpp (max) -17.50% 120.000 99.000 - 0.00% -
458.sjeng (max) -17.11% 152.000 126.000 - 0.00% -
458.sjeng (max) (percentage) -16.74% 2.330 1.940 - 0.00% -
471.omnetpp (max) (percentage) -16.70% 4.790 3.990 - 0.00% -
450.soplex (max) (percentage) -16.69% 8.330 6.940 - 0.00% -
429.mcf (max) (percentage) -16.67% 24.710 20.590 - 0.00% -
436.cactusADM (max) -16.67% 24.000 20.000 - 0.00% -
410.bwaves (max) (percentage) -16.56% 3.200 2.670 - 0.00% -
444.namd (max) (percentage) -16.49% 1.940 1.620 - 0.00% -
436.cactusADM (max) (percentage) -16.49% 1.880 1.570 - 0.00% -
401.bzip2 (max) (percentage) -16.48% 1.760 1.470 - 0.00% -
410.bwaves (max) -15.89% 151.000 127.000 - 0.00% -
444.namd (max) -15.38% 13.000 11.000 - 0.00% -
429.mcf (max) -15.29% 340.000 288.000 - 0.00% -
401.bzip2 (max) -15.22% 46.000 39.000 - 0.00% -
462.libquantum (max) (percentage) -14.35% 6.410 5.490 - 0.00% -
450.soplex (max) -13.64% 44.000 38.000 - 0.00% -
433.milc (max) (percentage) -12.72% 2.280 1.990 - 0.00% -
437.leslie3d (max) (percentage) -12.58% 4.450 3.890 - 0.00% -
456.hmmer (max) -12.50% 16.000 14.000 - 0.00% -
456.hmmer (max) (percentage) -11.86% 0.590 0.520 - 0.00% -
437.leslie3d (max) -11.23% 285.000 253.000 - 0.00% -
433.milc (max) -11.11% 27.000 24.000 - 0.00% -
436.cactusADM -11.11% 9.000 8.000 - 0.00% -
436.cactusADM (avg) -11.11% 9.000 8.000 - 0.00% -
470.lbm (max) -10.81% 111.000 99.000 - 0.00% -
416.gamess (max) (percentage) -10.81% 0.370 0.330 - 0.00% -
473.astar (max) -10.59% 255.000 228.000 - 0.00% -
481.wrf (max) -10.44% 182.000 163.000 - 0.00% -
470.lbm (max) (percentage) -10.12% 3.360 3.020 - 0.00% -
459.GemsFDTD (max) (percentage) -10.03% 3.790 3.410 - 0.00% -
473.astar (max) (percentage) -10.02% 4.990 4.490 - 0.00% -
481.wrf (max) (percentage) -10.02% 5.690 5.120 - 0.00% -
416.gamess (max) -10.00% 40.000 36.000 - 0.00% -
445.gobmk (max) -9.92% 131.000 118.000 - 0.00% -
445.gobmk (max) (percentage) -9.74% 2.670 2.410 - 0.00% -
459.GemsFDTD (max) -9.69% 196.000 177.000 - 0.00% -
434.zeusmp (max) -9.30% 43.000 39.000 - 0.00% -
434.zeusmp (max) (percentage) -8.85% 2.260 2.060 - 0.00% -
482.sphinx3 (max) (percentage) -8.29% 3.740 3.430 - 0.00% -
453.povray (max) -7.69% 13.000 12.000 - 0.00% -
400.perlbench (max) -6.67% 60.000 56.000 - 0.00% -
481.wrf -6.25% 48.000 45.000 - 0.00% -
481.wrf (avg) -6.25% 48.000 45.000 - 0.00% -
453.povray (max) (percentage) -6.13% 3.100 2.910 - 0.00% -
481.wrf (avg) (percentage) -6.00% 1.500 1.410 - 0.00% -
464.h264ref (max) (percentage) -5.88% 3.400 3.200 - 0.00% -
416.gamess (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
447.dealII -4.76% 21.000 20.000 - 0.00% -
447.dealII (avg) -4.76% 21.000 20.000 - 0.00% -
464.h264ref (max) -4.58% 131.000 125.000 - 0.00% -
416.gamess -4.55% 22.000 21.000 - 0.00% -
416.gamess (avg) -4.55% 22.000 21.000 - 0.00% -
447.dealII (max) -4.35% 23.000 22.000 - 0.00% -
482.sphinx3 (max) -4.00% 25.000 24.000 - 0.00% -
435.gromacs -3.96% 101.000 97.000 - 0.00% -
435.gromacs (avg) -3.96% 101.000 97.000 - 0.00% -
447.dealII (max) (percentage) -3.87% 1.810 1.740 - 0.00% -
400.perlbench (max) (percentage) -3.54% 3.390 3.270 - 0.00% -
435.gromacs (avg) (percentage) -3.33% 2.100 2.030 - 0.00% -
447.dealII (avg) (percentage) -3.01% 1.660 1.610 - 0.00% -
436.cactusADM (avg) (percentage) -2.86% 0.700 0.680 - 0.00% -
453.povray (avg) (percentage) -2.63% 1.520 1.480 - 0.00% -
445.gobmk -2.50% 40.000 39.000 - 0.00% -
445.gobmk (avg) -2.50% 40.000 39.000 - 0.00% -
445.gobmk (avg) (percentage) -2.44% 0.820 0.800 - 0.00% -
444.namd (avg) (percentage) -2.30% 0.870 0.850 - 0.00% -
462.libquantum (avg) (percentage) -2.13% 1.880 1.840 - 0.00% -
471.omnetpp -1.92% 52.000 51.000 - 0.00% -
471.omnetpp (avg) -1.92% 52.000 51.000 - 0.00% -
473.astar -1.61% 62.000 61.000 - 0.00% -
473.astar (avg) -1.61% 62.000 61.000 - 0.00% -
437.leslie3d (avg) (percentage) -1.46% 3.430 3.380 - 0.00% -
471.omnetpp (avg) (percentage) -1.44% 2.090 2.060 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
470.lbm (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
403.gcc (max) (percentage) -1.31% 10.720 10.580 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.02% 3240486.000 3306102.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 7.48% 2501.000 2688.000 - 1.24% -
482.sphinx3 5.06% 672.000 706.000 - 1.73% -
447.dealII 4.84% 1220.000 1279.000 - 0.31% -
473.astar 4.71% 4865.000 5094.000 - -0.68% -
444.namd 3.63% 662.000 686.000 - 0.29% -
456.hmmer 3.56% 2639.000 2733.000 - 0.37% -
400.perlbench 2.94% 1664.000 1713.000 - -3.22% -
450.soplex 2.80% 536.000 551.000 - 3.38% -
470.lbm 1.91% 3249.000 3311.000 - -0.39% -
433.milc 1.34% 1198.000 1214.000 - 0.41% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.19% 42589.000 40378.000 - 0.00% -
464.h264ref -2.66% 749591.000 729625.000 - -0.01% -
444.namd -2.25% 212450.000 207669.000 - 0.00% -
458.sjeng -1.49% 146102.000 143918.000 - 0.00% -
450.soplex -1.35% 370392.000 365394.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.39% 1906.000 1403.000 - 1.67% -
462.libquantum -21.70% 106.000 83.000 - 0.00% -
403.gcc -7.81% 64.000 59.000 - 3.51% -
453.povray -6.67% 465.000 434.000 - 0.23% -
471.omnetpp -4.13% 2614.000 2506.000 - -0.44% -
458.sjeng -3.55% 6752.000 6512.000 - -0.49% -
464.h264ref -2.90% 4036.000 3919.000 - 1.03% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.39s
Name Current %
400.perlbench 1713.000 -3.22%
401.bzip2 2688.000 1.24%
403.gcc 59.000 3.51%
410.bwaves 4761.000 -
416.gamess 11065.000 -
429.mcf 1403.000 1.67%
433.milc 1214.000 -
434.zeusmp 1939.000 1.04%
435.gromacs 4794.000 -
436.cactusADM 1310.000 -
437.leslie3d 6518.000 1.61%
444.namd 686.000 -
445.gobmk 4916.000 -
447.dealII 1279.000 -
450.soplex 551.000 3.38%
453.povray 434.000 -
456.hmmer 2733.000 -
458.sjeng 6512.000 -
459.GemsFDTD 5206.000 -
462.libquantum 83.000 -
464.h264ref 3919.000 1.03%
465.tonto 20056.000 -
470.lbm 3311.000 -
471.omnetpp 2506.000 -
473.astar 5094.000 -
481.wrf 3199.000 -
482.sphinx3 706.000 1.73%
Geometric Mean 1988.679 -
Name Current %
400.perlbench 1184097.000 -
401.bzip2 76394.000 -
403.gcc 3429115.000 -
410.bwaves 634479.000 -
416.gamess 8879566.000 -
429.mcf 13255.000 -
433.milc 137212.000 -
434.zeusmp 1032688.000 -
435.gromacs 905388.000 -
436.cactusADM 1425416.000 -
437.leslie3d 954785.000 -
444.namd 207669.000 -
445.gobmk 2112105.000 -
447.dealII 3306102.000 -
450.soplex 365394.000 -
453.povray 961212.000 -
456.hmmer 299640.000 -
458.sjeng 143918.000 -
459.GemsFDTD 1288163.000 -
462.libquantum 40378.000 -
464.h264ref 729625.000 -
465.tonto 10977198.000 -
470.lbm 12117.000 -
471.omnetpp 682755.000 -
473.astar 41968.000 -
481.wrf 7292236.000 -
482.sphinx3 196345.000 -
Geometric Mean 517021.182 -
Name Current %
400.perlbench 30.000 30.43%
400.perlbench (avg) 30.000 30.43%
400.perlbench (avg) (percentage) 1.780 32.84%
400.perlbench (max) 56.000 -6.67%
400.perlbench (max) (percentage) 3.270 -3.54%
400.perlbench (unexplained diff vs previous) 57.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.330 -
401.bzip2 34.000 -
401.bzip2 (avg) 34.000 -
401.bzip2 (avg) (percentage) 1.290 -
401.bzip2 (max) 39.000 -15.22%
401.bzip2 (max) (percentage) 1.470 -16.48%
401.bzip2 (unexplained diff vs previous) 33.000 -28.26%
401.bzip2 (unexplained diff vs previous) (percentage) 1.230 -28.90%
403.gcc 3.000 50.00%
403.gcc (avg) 3.000 50.00%
403.gcc (avg) (percentage) 5.150 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.580 -1.31%
410.bwaves 48.000 -
410.bwaves (avg) 48.000 -
410.bwaves (avg) (percentage) 1.010 -
410.bwaves (max) 127.000 -15.89%
410.bwaves (max) (percentage) 2.670 -16.56%
410.bwaves (unexplained diff vs previous) 16.000 -89.12%
410.bwaves (unexplained diff vs previous) (percentage) 0.340 -89.03%
416.gamess 21.000 -4.55%
416.gamess (avg) 21.000 -4.55%
416.gamess (avg) (percentage) 0.190 -5.00%
416.gamess (max) 36.000 -10.00%
416.gamess (max) (percentage) 0.330 -10.81%
416.gamess (unexplained diff vs previous) 5.000 -82.76%
416.gamess (unexplained diff vs previous) (percentage) 0.050 -80.77%
429.mcf 49.000 -
429.mcf (avg) 49.000 -
429.mcf (avg) (percentage) 3.560 -
429.mcf (max) 288.000 -15.29%
429.mcf (max) (percentage) 20.590 -16.67%
429.mcf (unexplained diff vs previous) 23.000 -94.92%
429.mcf (unexplained diff vs previous) (percentage) 1.640 -95.00%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.820 -
433.milc (max) 24.000 -11.11%
433.milc (max) (percentage) 1.990 -12.72%
433.milc (unexplained diff vs previous) 5.000 -81.48%
433.milc (unexplained diff vs previous) (percentage) 0.410 -81.61%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.900 1.12%
434.zeusmp (max) 39.000 -9.30%
434.zeusmp (max) (percentage) 2.060 -8.85%
434.zeusmp (unexplained diff vs previous) 20.000 -33.33%
434.zeusmp (unexplained diff vs previous) (percentage) 1.030 -33.97%
435.gromacs 97.000 -3.96%
435.gromacs (avg) 97.000 -3.96%
435.gromacs (avg) (percentage) 2.030 -3.33%
435.gromacs (max) 208.000 -25.45%
435.gromacs (max) (percentage) 4.340 -24.91%
435.gromacs (unexplained diff vs previous) 35.000 -86.74%
435.gromacs (unexplained diff vs previous) (percentage) 0.730 -86.65%
436.cactusADM 8.000 -11.11%
436.cactusADM (avg) 8.000 -11.11%
436.cactusADM (avg) (percentage) 0.680 -2.86%
436.cactusADM (max) 20.000 -16.67%
436.cactusADM (max) (percentage) 1.570 -16.49%
436.cactusADM (unexplained diff vs previous) 2.000 -92.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.150 -92.15%
437.leslie3d 220.000 -
437.leslie3d (avg) 220.000 -
437.leslie3d (avg) (percentage) 3.380 -1.46%
437.leslie3d (max) 253.000 -11.23%
437.leslie3d (max) (percentage) 3.890 -12.58%
437.leslie3d (unexplained diff vs previous) 103.000 -65.55%
437.leslie3d (unexplained diff vs previous) (percentage) 1.580 -66.09%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.850 -2.30%
444.namd (max) 11.000 -15.38%
444.namd (max) (percentage) 1.620 -16.49%
444.namd (unexplained diff vs previous) 2.000 -84.62%
444.namd (unexplained diff vs previous) (percentage) 0.290 -84.74%
445.gobmk 39.000 -2.50%
445.gobmk (avg) 39.000 -2.50%
445.gobmk (avg) (percentage) 0.800 -2.44%
445.gobmk (max) 118.000 -9.92%
445.gobmk (max) (percentage) 2.410 -9.74%
445.gobmk (unexplained diff vs previous) 4.000 -96.64%
445.gobmk (unexplained diff vs previous) (percentage) 0.080 -96.69%
447.dealII 20.000 -4.76%
447.dealII (avg) 20.000 -4.76%
447.dealII (avg) (percentage) 1.610 -3.01%
447.dealII (max) 22.000 -4.35%
447.dealII (max) (percentage) 1.740 -3.87%
447.dealII (unexplained diff vs previous) 4.000 -75.00%
447.dealII (unexplained diff vs previous) (percentage) 0.310 -75.20%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.660 -
450.soplex (max) 38.000 -13.64%
450.soplex (max) (percentage) 6.940 -16.69%
450.soplex (unexplained diff vs previous) 18.000 -56.10%
450.soplex (unexplained diff vs previous) (percentage) 3.270 -57.48%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.480 -2.63%
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 2.910 -6.13%
453.povray (unexplained diff vs previous) 1.000 -92.31%
453.povray (unexplained diff vs previous) (percentage) 0.230 -92.33%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 14.000 -12.50%
456.hmmer (max) (percentage) 0.520 -11.86%
456.hmmer (unexplained diff vs previous) 10.000 -37.50%
456.hmmer (unexplained diff vs previous) (percentage) 0.370 -37.29%
458.sjeng 35.000 -
458.sjeng (avg) 35.000 -
458.sjeng (avg) (percentage) 0.550 -
458.sjeng (max) 126.000 -17.11%
458.sjeng (max) (percentage) 1.940 -16.74%
458.sjeng (unexplained diff vs previous) 32.000 -78.52%
458.sjeng (unexplained diff vs previous) (percentage) 0.490 -78.51%
459.GemsFDTD 38.000 -
459.GemsFDTD (avg) 38.000 -
459.GemsFDTD (avg) (percentage) 0.740 -1.33%
459.GemsFDTD (max) 177.000 -9.69%
459.GemsFDTD (max) (percentage) 3.410 -10.03%
459.GemsFDTD (unexplained diff vs previous) 31.000 -83.60%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.600 -83.56%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.840 -2.13%
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 5.490 -14.35%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 36.000 -
464.h264ref (avg) 36.000 -
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) 125.000 -4.58%
464.h264ref (max) (percentage) 3.200 -5.88%
465.tonto 56.000 -
465.tonto (avg) 56.000 -
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 92.000 -
465.tonto (max) (percentage) 0.460 -
470.lbm 24.000 -
470.lbm (avg) 24.000 -
470.lbm (avg) (percentage) 0.740 -1.33%
470.lbm (max) 99.000 -10.81%
470.lbm (max) (percentage) 3.020 -10.12%
470.lbm (unexplained diff vs previous) 13.000 -87.96%
470.lbm (unexplained diff vs previous) (percentage) 0.390 -88.00%
471.omnetpp 51.000 -1.92%
471.omnetpp (avg) 51.000 -1.92%
471.omnetpp (avg) (percentage) 2.060 -1.44%
471.omnetpp (max) 99.000 -17.50%
471.omnetpp (max) (percentage) 3.990 -16.70%
471.omnetpp (unexplained diff vs previous) 11.000 -90.43%
471.omnetpp (unexplained diff vs previous) (percentage) 0.440 -90.37%
473.astar 61.000 -1.61%
473.astar (avg) 61.000 -1.61%
473.astar (avg) (percentage) 1.200 -
473.astar (max) 228.000 -10.59%
473.astar (max) (percentage) 4.490 -10.02%
473.astar (unexplained diff vs previous) 35.000 -85.66%
473.astar (unexplained diff vs previous) (percentage) 0.690 -85.50%
481.wrf 45.000 -6.25%
481.wrf (avg) 45.000 -6.25%
481.wrf (avg) (percentage) 1.410 -6.00%
481.wrf (max) 163.000 -10.44%
481.wrf (max) (percentage) 5.120 -10.02%
481.wrf (unexplained diff vs previous) 13.000 -92.49%
481.wrf (unexplained diff vs previous) (percentage) 0.410 -92.39%
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.040 -
482.sphinx3 (max) 24.000 -4.00%
482.sphinx3 (max) (percentage) 3.430 -8.29%
482.sphinx3 (unexplained diff vs previous) 12.000 -52.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.700 -52.78%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.230 -
Geometric Mean 5.935 -43.58%