Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f7516c7f3f00fca7271056cc9abeda2da4687c17 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/179/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0179 (no-change) 2024-05-16T22:24:06 0:00:00
Previous 0178 (llvmorg-19-init-11663-gf7516c7f3f00) 2024-05-16T02:48:33 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 39 10
Performance Improvements 93 15
Added Tests 8 173
Unchanged Tests 1036 978
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.00% 60.000 63.000 - -1.56% -
450.soplex 2.64% 531.000 545.000 - 1.68% -
447.dealII 2.38% 1261.000 1291.000 - 5.82% -
482.sphinx3 1.89% 688.000 701.000 - 4.32% -
462.libquantum 1.23% 81.000 82.000 - -22.64% -
465.tonto 1.02% 19923.000 20126.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 2000.00% 1.000 21.000 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 1500.00% 0.020 0.320 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 550.00% 0.020 0.130 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) 550.00% 2.000 13.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 537.93% 0.290 1.850 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 500.00% 1.000 6.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) 202.27% 0.440 1.330 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) 200.00% 3.000 9.000 0.000 0.00% 0.000
450.soplex (max) 180.00% 5.000 14.000 - 0.00% -
447.dealII (unexplained diff vs previous) 172.73% 11.000 30.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) 166.67% 0.870 2.320 0.000 0.00% 0.000
450.soplex (max) (percentage) 135.71% 1.120 2.640 - 0.00% -
450.soplex (unexplained diff vs previous) 133.33% 6.000 14.000 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) 127.43% 1.130 2.570 0.000 0.00% 0.000
470.lbm (max) 100.00% 6.000 12.000 - 0.00% -
470.lbm (max) (percentage) 85.71% 0.210 0.390 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 85.71% 0.210 0.390 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 85.71% 7.000 13.000 0.000 0.00% 0.000
447.dealII (max) 76.47% 17.000 30.000 - 0.00% -
447.dealII (max) (percentage) 71.22% 1.390 2.380 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) 43.75% 0.160 0.230 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) 38.89% 18.000 25.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 33.33% 6.000 8.000 0.000 0.00% 0.000
403.gcc (max) 25.00% 4.000 5.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 25.00% 0.120 0.150 0.000 0.00% 0.000
482.sphinx3 (max) 8.33% 12.000 13.000 - 0.00% -
482.sphinx3 (max) (percentage) 6.18% 1.780 1.890 - 0.00% -
465.tonto 1.82% 55.000 56.000 - 0.00% -
465.tonto (avg) 1.82% 55.000 56.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 1.27% 1.580 1.600 0.000 0.00% 0.000
447.dealII (avg) (percentage) 1.14% 1.750 1.770 - 0.00% -
444.namd (avg) (percentage) 1.09% 0.920 0.930 - 0.00% -
465.tonto (max) 1.03% 97.000 98.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.58% 444.000 437.000 - -6.02% -
429.mcf -1.36% 1400.000 1381.000 - -27.54% -
444.namd -1.31% 686.000 677.000 - 2.27% -
437.leslie3d -1.25% 6550.000 6468.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) (percentage) -97.14% 2.100 0.060 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) -97.09% 103.000 3.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -94.00% 100.000 6.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -93.91% 3.940 0.240 0.000 0.00% 0.000
464.h264ref (max) -75.71% 70.000 17.000 - 0.00% -
464.h264ref (max) (percentage) -74.73% 1.820 0.460 - 0.00% -
464.h264ref (unexplained diff vs previous) -40.00% 20.000 12.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -39.22% 0.510 0.310 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -29.69% 0.640 0.450 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -29.63% 27.000 19.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -29.41% 17.000 12.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -28.50% 1.930 1.380 0.000 0.00% 0.000
433.milc (max) -25.00% 8.000 6.000 - 0.00% -
433.milc (max) (percentage) -24.32% 0.740 0.560 - 0.00% -
445.gobmk (unexplained diff vs previous) -16.67% 48.000 40.000 0.000 0.00% 0.000
471.omnetpp (max) -16.67% 96.000 80.000 - 0.00% -
471.omnetpp (max) (percentage) -16.62% 3.790 3.160 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -15.46% 0.970 0.820 0.000 0.00% 0.000
429.mcf (max) -15.38% 26.000 22.000 - 0.00% -
453.povray (max) -14.29% 7.000 6.000 - 0.00% -
429.mcf (max) (percentage) -12.70% 1.890 1.650 - 0.00% -
481.wrf (avg) (percentage) -11.93% 1.090 0.960 - 0.00% -
481.wrf -11.76% 34.000 30.000 - 0.00% -
481.wrf (avg) -11.76% 34.000 30.000 - 0.00% -
435.gromacs (avg) (percentage) -11.11% 1.980 1.760 - 0.00% -
435.gromacs -10.42% 96.000 86.000 - 0.00% -
435.gromacs (avg) -10.42% 96.000 86.000 - 0.00% -
445.gobmk (max) -10.42% 48.000 43.000 - 0.00% -
462.libquantum (max) (percentage) -10.10% 1.980 1.780 - 0.00% -
433.milc -10.00% 10.000 9.000 - 0.00% -
433.milc (avg) -10.00% 10.000 9.000 - 0.00% -
435.gromacs (max) (percentage) -9.77% 2.150 1.940 - 0.00% -
435.gromacs (max) -9.52% 105.000 95.000 - 0.00% -
473.astar (max) -8.33% 36.000 33.000 - 0.00% -
445.gobmk (max) (percentage) -8.16% 0.980 0.900 - 0.00% -
410.bwaves (max) -7.69% 26.000 24.000 - 0.00% -
458.sjeng (max) -7.69% 26.000 24.000 - 0.00% -
436.cactusADM (avg) (percentage) -7.46% 0.670 0.620 - 0.00% -
458.sjeng (max) (percentage) -7.32% 0.410 0.380 - 0.00% -
410.bwaves (max) (percentage) -7.14% 0.560 0.520 - 0.00% -
473.astar (max) (percentage) -7.04% 0.710 0.660 - 0.00% -
434.zeusmp -6.25% 16.000 15.000 - 0.00% -
434.zeusmp (avg) -6.25% 16.000 15.000 - 0.00% -
401.bzip2 (max) (percentage) -6.15% 1.300 1.220 - 0.00% -
401.bzip2 (max) -5.88% 34.000 32.000 - 0.00% -
456.hmmer (max) -5.56% 18.000 17.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -5.41% 0.370 0.350 0.000 0.00% 0.000
434.zeusmp (max) -5.26% 19.000 18.000 - 0.00% -
473.astar (unexplained diff vs previous) -5.26% 19.000 18.000 0.000 0.00% 0.000
434.zeusmp (max) (percentage) -4.95% 1.010 0.960 - 0.00% -
481.wrf (max) (percentage) -4.47% 1.790 1.710 - 0.00% -
437.leslie3d (max) -4.27% 445.000 426.000 - 0.00% -
470.lbm -4.17% 24.000 23.000 - 0.00% -
470.lbm (avg) -4.17% 24.000 23.000 - 0.00% -
437.leslie3d -3.63% 248.000 239.000 - 0.00% -
437.leslie3d (avg) -3.63% 248.000 239.000 - 0.00% -
481.wrf (max) -3.57% 56.000 54.000 - 0.00% -
434.zeusmp (avg) (percentage) -3.49% 0.860 0.830 - 0.00% -
437.leslie3d (max) (percentage) -3.09% 6.800 6.590 - 0.00% -
456.hmmer (max) (percentage) -2.99% 0.670 0.650 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.90% 0.690 0.670 - 0.00% -
436.cactusADM (max) (percentage) -2.86% 1.050 1.020 - 0.00% -
459.GemsFDTD -2.86% 35.000 34.000 - 0.00% -
459.GemsFDTD (avg) -2.86% 35.000 34.000 - 0.00% -
416.gamess (max) (percentage) -2.70% 0.370 0.360 - 0.00% -
459.GemsFDTD (max) (percentage) -2.56% 0.780 0.760 - 0.00% -
416.gamess (max) -2.50% 40.000 39.000 - 0.00% -
459.GemsFDTD (max) -2.50% 40.000 39.000 - 0.00% -
429.mcf -2.44% 41.000 40.000 - 0.00% -
429.mcf (avg) -2.44% 41.000 40.000 - 0.00% -
433.milc (avg) (percentage) -2.41% 0.830 0.810 - 0.00% -
437.leslie3d (avg) (percentage) -2.37% 3.800 3.710 - 0.00% -
401.bzip2 (avg) (percentage) -2.29% 1.310 1.280 - 0.00% -
464.h264ref (avg) (percentage) -2.22% 0.900 0.880 - 0.00% -
410.bwaves -2.04% 49.000 48.000 - 0.00% -
410.bwaves (avg) -2.04% 49.000 48.000 - 0.00% -
483.xalancbmk (max) (percentage) -1.95% 2.570 2.520 - 0.00% -
471.omnetpp (avg) (percentage) -1.92% 2.080 2.040 - 0.00% -
471.omnetpp -1.92% 52.000 51.000 - 0.00% -
471.omnetpp (avg) -1.92% 52.000 51.000 - 0.00% -
410.bwaves (avg) (percentage) -1.90% 1.050 1.030 - 0.00% -
473.astar (avg) (percentage) -1.69% 1.180 1.160 - 0.00% -
473.astar -1.67% 60.000 59.000 - 0.00% -
473.astar (avg) -1.67% 60.000 59.000 - 0.00% -
470.lbm (avg) (percentage) -1.37% 0.730 0.720 - 0.00% -
429.mcf (avg) (percentage) -1.36% 2.950 2.910 - 0.00% -
453.povray (max) (percentage) -1.25% 1.600 1.580 - 0.00% -
403.gcc (max) (percentage) -1.11% 8.090 8.000 - 0.00% -
403.gcc (avg) (percentage) -1.05% 5.700 5.640 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.86% 3240486.000 3300638.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 7.04% 2501.000 2677.000 - 0.45% -
447.dealII 5.82% 1220.000 1291.000 - 2.38% -
473.astar 5.73% 4865.000 5144.000 - 0.35% -
482.sphinx3 4.32% 672.000 701.000 - 1.89% -
456.hmmer 3.26% 2639.000 2725.000 - 0.15% -
444.namd 2.27% 662.000 677.000 - -1.31% -
470.lbm 1.94% 3249.000 3312.000 - -0.39% -
450.soplex 1.68% 536.000 545.000 - 2.64% -
400.perlbench 1.38% 1664.000 1687.000 - -0.71% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.00% 42589.000 40458.000 - 0.00% -
464.h264ref -2.70% 749591.000 729361.000 - 0.00% -
444.namd -2.31% 212450.000 207537.000 - 0.00% -
458.sjeng -1.49% 146102.000 143918.000 - 0.00% -
450.soplex -1.34% 370392.000 365434.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -27.54% 1906.000 1381.000 - -1.36% -
462.libquantum -22.64% 106.000 82.000 - 1.23% -
453.povray -6.02% 465.000 437.000 - -1.58% -
458.sjeng -3.48% 6752.000 6517.000 - 0.32% -
464.h264ref -3.39% 4036.000 3899.000 - 0.31% -
471.omnetpp -3.06% 2614.000 2534.000 - -0.24% -
403.gcc -1.56% 64.000 63.000 - 5.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1687.000 -
401.bzip2 2677.000 -
403.gcc 63.000 5.00%
410.bwaves 4725.000 -
416.gamess 11052.000 -
429.mcf 1381.000 -1.36%
433.milc 1207.000 -
434.zeusmp 1926.000 -
435.gromacs 4898.000 -
436.cactusADM 1310.000 -
437.leslie3d 6468.000 -1.25%
444.namd 677.000 -1.31%
445.gobmk 4884.000 -
447.dealII 1291.000 2.38%
450.soplex 545.000 2.64%
453.povray 437.000 -1.58%
456.hmmer 2725.000 -
458.sjeng 6517.000 -
459.GemsFDTD 5176.000 -
462.libquantum 82.000 1.23%
464.h264ref 3899.000 -
465.tonto 20126.000 1.02%
470.lbm 3312.000 -
471.omnetpp 2534.000 -
473.astar 5144.000 -
481.wrf 3169.000 -
482.sphinx3 701.000 1.89%
Geometric Mean 1988.045 -
Name Current %
400.perlbench 1183841.000 -
401.bzip2 76394.000 -
403.gcc 3429267.000 -
410.bwaves 632575.000 -
416.gamess 8875350.000 -
429.mcf 13255.000 -
433.milc 137200.000 -
434.zeusmp 1033056.000 -
435.gromacs 905424.000 -
436.cactusADM 1423528.000 -
437.leslie3d 953105.000 -
444.namd 207537.000 -
445.gobmk 2111917.000 -
447.dealII 3300638.000 -
450.soplex 365434.000 -
453.povray 960938.000 -
456.hmmer 299664.000 -
458.sjeng 143918.000 -
459.GemsFDTD 1287843.000 -
462.libquantum 40458.000 -
464.h264ref 729361.000 -
465.tonto 10952878.000 -
470.lbm 12117.000 -
471.omnetpp 679918.000 -
473.astar 41968.000 -
481.wrf 7291308.000 -
482.sphinx3 196345.000 -
Geometric Mean 516752.311 -
Name Current %
400.perlbench 22.000 -
400.perlbench (avg) 22.000 -
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 60.000 -
400.perlbench (max) (percentage) 3.560 -
401.bzip2 34.000 -
401.bzip2 (avg) 34.000 -
401.bzip2 (avg) (percentage) 1.280 -2.29%
401.bzip2 (max) 32.000 -5.88%
401.bzip2 (max) (percentage) 1.220 -6.15%
401.bzip2 (unexplained diff vs previous) 12.000 -29.41%
401.bzip2 (unexplained diff vs previous) (percentage) 0.450 -29.69%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.640 -1.05%
403.gcc (max) 5.000 25.00%
403.gcc (max) (percentage) 8.000 -1.11%
403.gcc (unexplained diff vs previous) 3.000 -
403.gcc (unexplained diff vs previous) (percentage) 4.760 -
410.bwaves 48.000 -2.04%
410.bwaves (avg) 48.000 -2.04%
410.bwaves (avg) (percentage) 1.030 -1.90%
410.bwaves (max) 24.000 -7.69%
410.bwaves (max) (percentage) 0.520 -7.14%
410.bwaves (unexplained diff vs previous) 6.000 500.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.130 550.00%
416.gamess 23.000 -
416.gamess (avg) 23.000 -
416.gamess (avg) (percentage) 0.210 -
416.gamess (max) 39.000 -2.50%
416.gamess (max) (percentage) 0.360 -2.70%
416.gamess (unexplained diff vs previous) 25.000 38.89%
416.gamess (unexplained diff vs previous) (percentage) 0.230 43.75%
429.mcf 40.000 -2.44%
429.mcf (avg) 40.000 -2.44%
429.mcf (avg) (percentage) 2.910 -1.36%
429.mcf (max) 22.000 -15.38%
429.mcf (max) (percentage) 1.650 -12.70%
429.mcf (unexplained diff vs previous) 19.000 -29.63%
429.mcf (unexplained diff vs previous) (percentage) 1.380 -28.50%
433.milc 9.000 -10.00%
433.milc (avg) 9.000 -10.00%
433.milc (avg) (percentage) 0.810 -2.41%
433.milc (max) 6.000 -25.00%
433.milc (max) (percentage) 0.560 -24.32%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
434.zeusmp 15.000 -6.25%
434.zeusmp (avg) 15.000 -6.25%
434.zeusmp (avg) (percentage) 0.830 -3.49%
434.zeusmp (max) 18.000 -5.26%
434.zeusmp (max) (percentage) 0.960 -4.95%
434.zeusmp (unexplained diff vs previous) 2.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.100 -
435.gromacs 86.000 -10.42%
435.gromacs (avg) 86.000 -10.42%
435.gromacs (avg) (percentage) 1.760 -11.11%
435.gromacs (max) 95.000 -9.52%
435.gromacs (max) (percentage) 1.940 -9.77%
435.gromacs (unexplained diff vs previous) 3.000 -97.09%
435.gromacs (unexplained diff vs previous) (percentage) 0.060 -97.14%
436.cactusADM 8.000 -
436.cactusADM (avg) 8.000 -
436.cactusADM (avg) (percentage) 0.620 -7.46%
436.cactusADM (max) 13.000 -
436.cactusADM (max) (percentage) 1.020 -2.86%
436.cactusADM (unexplained diff vs previous) 2.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.150 -
437.leslie3d 239.000 -3.63%
437.leslie3d (avg) 239.000 -3.63%
437.leslie3d (avg) (percentage) 3.710 -2.37%
437.leslie3d (max) 426.000 -4.27%
437.leslie3d (max) (percentage) 6.590 -3.09%
437.leslie3d (unexplained diff vs previous) 82.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 1.270 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.930 1.09%
444.namd (max) 8.000 -
444.namd (max) (percentage) 1.310 -
444.namd (unexplained diff vs previous) 9.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 1.330 202.27%
445.gobmk 38.000 -
445.gobmk (avg) 38.000 -
445.gobmk (avg) (percentage) 0.780 -
445.gobmk (max) 43.000 -10.42%
445.gobmk (max) (percentage) 0.900 -8.16%
445.gobmk (unexplained diff vs previous) 40.000 -16.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.820 -15.46%
447.dealII 22.000 -
447.dealII (avg) 22.000 -
447.dealII (avg) (percentage) 1.770 1.14%
447.dealII (max) 30.000 76.47%
447.dealII (max) (percentage) 2.380 71.22%
447.dealII (unexplained diff vs previous) 30.000 172.73%
447.dealII (unexplained diff vs previous) (percentage) 2.320 166.67%
450.soplex 12.000 -
450.soplex (avg) 12.000 -
450.soplex (avg) (percentage) 2.310 -
450.soplex (max) 14.000 180.00%
450.soplex (max) (percentage) 2.640 135.71%
450.soplex (unexplained diff vs previous) 14.000 133.33%
450.soplex (unexplained diff vs previous) (percentage) 2.570 127.43%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.440 -
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.580 -1.25%
453.povray (unexplained diff vs previous) 7.000 -
453.povray (unexplained diff vs previous) (percentage) 1.600 1.27%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 17.000 -5.56%
456.hmmer (max) (percentage) 0.650 -2.99%
456.hmmer (unexplained diff vs previous) 4.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.150 -
458.sjeng 33.000 -
458.sjeng (avg) 33.000 -
458.sjeng (avg) (percentage) 0.510 -
458.sjeng (max) 24.000 -7.69%
458.sjeng (max) (percentage) 0.380 -7.32%
458.sjeng (unexplained diff vs previous) 21.000 2000.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.320 1500.00%
459.GemsFDTD 34.000 -2.86%
459.GemsFDTD (avg) 34.000 -2.86%
459.GemsFDTD (avg) (percentage) 0.670 -2.90%
459.GemsFDTD (max) 39.000 -2.50%
459.GemsFDTD (max) (percentage) 0.760 -2.56%
459.GemsFDTD (unexplained diff vs previous) 8.000 33.33%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.150 25.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.620 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.780 -10.10%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.220 -
464.h264ref 34.000 -
464.h264ref (avg) 34.000 -
464.h264ref (avg) (percentage) 0.880 -2.22%
464.h264ref (max) 17.000 -75.71%
464.h264ref (max) (percentage) 0.460 -74.73%
464.h264ref (unexplained diff vs previous) 12.000 -40.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.310 -39.22%
465.tonto 56.000 1.82%
465.tonto (avg) 56.000 1.82%
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 98.000 1.03%
465.tonto (max) (percentage) 0.490 -
470.lbm 23.000 -4.17%
470.lbm (avg) 23.000 -4.17%
470.lbm (avg) (percentage) 0.720 -1.37%
470.lbm (max) 12.000 100.00%
470.lbm (max) (percentage) 0.390 85.71%
470.lbm (unexplained diff vs previous) 13.000 85.71%
470.lbm (unexplained diff vs previous) (percentage) 0.390 85.71%
471.omnetpp 51.000 -1.92%
471.omnetpp (avg) 51.000 -1.92%
471.omnetpp (avg) (percentage) 2.040 -1.92%
471.omnetpp (max) 80.000 -16.67%
471.omnetpp (max) (percentage) 3.160 -16.62%
471.omnetpp (unexplained diff vs previous) 6.000 -94.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.240 -93.91%
473.astar 59.000 -1.67%
473.astar (avg) 59.000 -1.67%
473.astar (avg) (percentage) 1.160 -1.69%
473.astar (max) 33.000 -8.33%
473.astar (max) (percentage) 0.660 -7.04%
473.astar (unexplained diff vs previous) 18.000 -5.26%
473.astar (unexplained diff vs previous) (percentage) 0.350 -5.41%
481.wrf 30.000 -11.76%
481.wrf (avg) 30.000 -11.76%
481.wrf (avg) (percentage) 0.960 -11.93%
481.wrf (max) 54.000 -3.57%
481.wrf (max) (percentage) 1.710 -4.47%
481.wrf (unexplained diff vs previous) 4.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.130 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.060 -
482.sphinx3 (max) 13.000 8.33%
482.sphinx3 (max) (percentage) 1.890 6.18%
482.sphinx3 (unexplained diff vs previous) 13.000 550.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.850 537.93%
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.520 -1.95%
Geometric Mean 4.329 -1.75%