Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=13556f4057d37f510f77143a1632febcc5618d1f (+ 234 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/203b127fccc9abe5373c9e3cc03a476c35b1f594 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=22a46dee24351fd5f4f188ad80554cad79c82524 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=d2744c7f77915c085712ac4daadd769ba7a570a8 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/342/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0342 (-00000-) 2022-11-24T01:36:56 0:00:00
Previous 0339 (2-changed-components) 2024-12-16T01:32:00 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 141 61
Performance Improvements 56 173
Added Tests 63 0
Unchanged Tests 976 1002
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 9.42% 54370.000 59491.000 - 0.02% -
459.GemsFDTD 5.33% 232644.000 245040.000 - 0.13% -
434.zeusmp 4.65% 146883.000 153713.000 - 1.10% -
444.namd 3.37% 182224.000 188365.000 - -0.01% -
447.dealII 2.06% 306198.000 312518.000 - 0.30% -
462.libquantum 2.03% 15797.000 16117.000 - 0.20% -
458.sjeng 1.65% 102311.000 104004.000 - -0.04% -
410.bwaves 1.65% 16476.000 16748.000 - -0.07% -
470.lbm 1.47% 9547.000 9687.000 - -0.04% -
435.gromacs 1.31% 493840.000 500327.000 - 0.21% -
450.soplex 1.31% 202418.000 205068.000 - -0.01% -
433.milc 1.22% 60484.000 61222.000 - -0.26% -
401.bzip2 1.21% 43711.000 44241.000 - 0.02% -
471.omnetpp 1.04% 475220.000 480176.000 - 0.45% -
482.sphinx3 1.00% 111718.000 112839.000 - -0.02% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8261.59% 138.000 11539.000 - 8142.14% -
482.sphinx3 3550.30% 847.000 30918.000 - 3171.75% -
450.soplex 2635.09% 587.000 16055.000 - 2731.57% -
444.namd 1203.21% 748.000 9748.000 - 1204.95% -
453.povray 1076.98% 556.000 6544.000 - 1096.34% -
433.milc 1048.31% 1155.000 13263.000 - 1052.30% -
429.mcf 744.41% 2040.000 17226.000 - 1109.69% -
434.zeusmp 497.57% 2302.000 13756.000 - 447.18% -
447.dealII 458.62% 1641.000 9167.000 - 431.73% -
401.bzip2 396.01% 3011.000 14935.000 - 407.82% -
459.GemsFDTD 347.05% 5303.000 23707.000 - 284.04% -
471.omnetpp 296.94% 2710.000 10757.000 - 294.90% -
470.lbm 234.22% 3834.000 12814.000 - 238.28% -
473.astar 177.56% 5112.000 14189.000 - 176.70% -
445.gobmk 135.27% 4948.000 11641.000 - 131.75% -
410.bwaves 132.19% 5928.000 13764.000 - 143.52% -
435.gromacs 117.96% 7193.000 15678.000 - 115.68% -
458.sjeng 93.91% 7343.000 14239.000 - 88.17% -
437.leslie3d 35.02% 10908.000 14728.000 - 26.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) 37800.00% 2.000 758.000 - -90.93% -
434.zeusmp (unexplained diff vs previous) 35100.00% 1.000 352.000 - -96.88% -
450.soplex (unexplained diff vs previous) 28500.00% 1.000 286.000 - -98.03% -
433.milc (unexplained diff vs previous) 23200.00% 1.000 233.000 - -97.94% -
482.sphinx3 (max) 10444.44% 9.000 949.000 - 4.17% -
444.namd (max) 9022.22% 9.000 821.000 - 19.85% -
434.zeusmp (max) 8925.00% 4.000 361.000 - -82.43% -
482.sphinx3 (unexplained diff vs previous) 8500.00% 5.000 430.000 - -98.35% -
434.zeusmp (unexplained diff vs previous) (percentage) 6300.00% 0.040 2.560 - -99.43% -
470.lbm (max) 5381.82% 11.000 603.000 - -78.04% -
444.namd 5225.00% 8.000 426.000 - 526.47% -
444.namd (avg) 5225.00% 8.000 426.000 - 526.47% -
433.milc (max) 4157.14% 7.000 298.000 - -71.46% -
482.sphinx3 4071.43% 14.000 584.000 - 689.19% -
482.sphinx3 (avg) 4071.43% 14.000 584.000 - 689.19% -
447.dealII (unexplained diff vs previous) 3933.33% 3.000 121.000 - -98.28% -
410.bwaves (max) 3268.75% 16.000 539.000 - -83.55% -
450.soplex (max) 3266.67% 9.000 303.000 - -44.40% -
444.namd (unexplained diff vs previous) (percentage) 2781.48% 0.270 7.780 - -99.30% -
462.libquantum 2300.00% 2.000 48.000 - 380.00% -
462.libquantum (avg) 2300.00% 2.000 48.000 - 380.00% -
433.milc (unexplained diff vs previous) (percentage) 1855.56% 0.090 1.760 - -99.82% -
433.milc 1815.38% 13.000 249.000 - 260.87% -
433.milc (avg) 1815.38% 13.000 249.000 - 260.87% -
470.lbm (max) (percentage) 1524.14% 0.290 4.710 - -93.50% -
434.zeusmp (max) (percentage) 1361.11% 0.180 2.630 - -96.78% -
410.bwaves (max) (percentage) 1300.00% 0.280 3.920 - -93.24% -
450.soplex 1276.92% 13.000 179.000 - 397.22% -
450.soplex (avg) 1276.92% 13.000 179.000 - 397.22% -
462.libquantum (max) 1233.33% 3.000 40.000 - -71.01% -
462.libquantum (unexplained diff vs previous) 1133.33% 3.000 37.000 - -99.73% -
445.gobmk (unexplained diff vs previous) 1100.00% 10.000 120.000 - -97.85% -
453.povray (max) 1050.00% 16.000 184.000 - -63.13% -
453.povray 1025.00% 8.000 90.000 - 114.29% -
453.povray (avg) 1025.00% 8.000 90.000 - 114.29% -
434.zeusmp 970.00% 20.000 214.000 - 45.58% -
434.zeusmp (avg) 970.00% 20.000 214.000 - 45.58% -
450.soplex (unexplained diff vs previous) (percentage) 947.06% 0.170 1.780 - -99.93% -
416.gamess (max) (percentage) 780.56% 0.360 3.170 - -91.78% -
470.lbm 726.67% 30.000 248.000 - 3.77% -
470.lbm (avg) 726.67% 30.000 248.000 - 3.77% -
445.gobmk (max) 706.67% 15.000 121.000 - -95.42% -
447.dealII (unexplained diff vs previous) (percentage) 633.33% 0.180 1.320 - -99.68% -
473.astar (unexplained diff vs previous) 612.50% 8.000 57.000 - -99.44% -
459.GemsFDTD (max) 606.12% 49.000 346.000 - -92.16% -
447.dealII (max) 594.74% 19.000 132.000 - -90.46% -
444.namd (max) (percentage) 563.78% 1.270 8.430 - -90.82% -
401.bzip2 (max) 444.44% 18.000 98.000 - -95.76% -
410.bwaves (unexplained diff vs previous) 433.33% 6.000 32.000 - -99.59% -
410.bwaves 432.65% 49.000 261.000 - 4.82% -
410.bwaves (avg) 432.65% 49.000 261.000 - 4.82% -
445.gobmk (unexplained diff vs previous) (percentage) 415.00% 0.200 1.030 - -99.07% -
481.wrf (max) (percentage) 392.50% 0.800 3.940 - -94.26% -
447.dealII 350.00% 18.000 81.000 - -18.18% -
447.dealII (avg) 350.00% 18.000 81.000 - -18.18% -
454.calculix (max) (percentage) 297.56% 0.820 3.260 - -96.73% -
435.gromacs (max) 278.38% 111.000 420.000 - -88.25% -
444.namd (avg) (percentage) 277.59% 1.160 4.380 - -52.49% -
435.gromacs (unexplained diff vs previous) 261.95% 113.000 409.000 - -94.18% -
433.milc (max) (percentage) 257.14% 0.630 2.250 - -97.52% -
459.GemsFDTD 230.30% 66.000 218.000 - -39.44% -
459.GemsFDTD (avg) 230.30% 66.000 218.000 - -39.44% -
445.gobmk (max) (percentage) 225.00% 0.320 1.040 - -98.02% -
436.cactusADM (max) (percentage) 222.22% 0.900 2.900 - -96.73% -
470.lbm (unexplained diff vs previous) 218.18% 11.000 35.000 - -99.65% -
416.gamess (avg) (percentage) 175.00% 0.760 2.090 - -52.71% -
482.sphinx3 (max) (percentage) 166.96% 1.150 3.070 - -96.82% -
437.leslie3d (unexplained diff vs previous) 160.87% 230.000 600.000 - -74.07% -
473.astar (unexplained diff vs previous) (percentage) 150.00% 0.160 0.400 - -99.80% -
456.hmmer (max) (percentage) 143.59% 0.390 0.950 - -98.71% -
470.lbm (avg) (percentage) 142.50% 0.800 1.940 - -69.35% -
482.sphinx3 (unexplained diff vs previous) (percentage) 135.59% 0.590 1.390 - -99.95% -
410.bwaves (unexplained diff vs previous) (percentage) 130.00% 0.100 0.230 - -99.83% -
429.mcf (max) 129.17% 24.000 55.000 - -95.84% -
410.bwaves (avg) (percentage) 128.92% 0.830 1.900 - -56.92% -
471.omnetpp 123.64% 55.000 123.000 - -44.84% -
471.omnetpp (avg) 123.64% 55.000 123.000 - -44.84% -
429.mcf (unexplained diff vs previous) 107.69% 13.000 27.000 - -99.85% -
435.gromacs 99.20% 125.000 249.000 - -32.15% -
435.gromacs (avg) 99.20% 125.000 249.000 - -32.15% -
437.leslie3d (unexplained diff vs previous) (percentage) 92.89% 2.110 4.070 - -79.53% -
445.gobmk 78.05% 41.000 73.000 - -62.76% -
445.gobmk (avg) 78.05% 41.000 73.000 - -62.76% -
434.zeusmp (avg) (percentage) 75.28% 0.890 1.560 - -73.33% -
464.h264ref (max) (percentage) 74.36% 0.390 0.680 - -98.75% -
435.gromacs (max) (percentage) 72.90% 1.550 2.680 - -94.55% -
465.tonto (unexplained diff vs previous) (percentage) 71.58% 0.950 1.630 - -89.93% -
401.bzip2 70.00% 40.000 68.000 - -57.76% -
401.bzip2 (avg) 70.00% 40.000 68.000 - -57.76% -
435.gromacs (unexplained diff vs previous) (percentage) 66.24% 1.570 2.610 - -97.30% -
436.cactusADM (avg) (percentage) 65.71% 1.050 1.740 - -70.90% -
401.bzip2 (unexplained diff vs previous) 64.71% 17.000 28.000 - -99.74% -
459.GemsFDTD (max) (percentage) 56.99% 0.930 1.460 - -97.96% -
433.milc (avg) (percentage) 56.67% 1.200 1.880 - -68.93% -
437.leslie3d (max) 28.07% 488.000 625.000 - -67.60% -
465.tonto (unexplained diff vs previous) 27.36% 106.000 135.000 - -92.38% -
473.astar (max) 27.27% 44.000 56.000 - -98.36% -
458.sjeng (unexplained diff vs previous) 23.53% 17.000 21.000 - -99.69% -
471.omnetpp (max) 22.73% 66.000 81.000 - -96.27% -
400.perlbench (max) (percentage) 22.08% 2.400 2.930 - -96.51% -
447.dealII (max) (percentage) 20.00% 1.200 1.440 - -98.21% -
450.soplex (max) (percentage) 13.17% 1.670 1.890 - -98.04% -
482.sphinx3 (avg) (percentage) 13.17% 1.670 1.890 - -76.17% -
456.hmmer (avg) (percentage) 9.62% 0.520 0.570 - -87.07% -
481.wrf (avg) (percentage) 7.22% 1.800 1.930 - -69.07% -
401.bzip2 (max) (percentage) 6.45% 0.620 0.660 - -99.16% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -23.68% 38.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto -1.18% 1971787.000 1948611.000 - 0.13% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -25.30% 11114.000 8302.000 - -24.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (avg) (percentage) -94.77% 4.590 0.240 - -96.87% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -94.68% 0.940 0.050 - -99.98% -
403.gcc (avg) (percentage) -92.73% 5.090 0.370 - -94.95% -
453.povray (unexplained diff vs previous) (percentage) -92.06% 2.520 0.200 - -99.98% -
473.astar (avg) (percentage) -88.31% 1.540 0.180 - -95.67% -
462.libquantum (max) (percentage) -85.42% 2.400 0.350 - -99.65% -
462.libquantum (unexplained diff vs previous) (percentage) -85.25% 2.170 0.320 - -100.00% -
403.gcc (max) (percentage) -83.42% 3.740 0.620 - -99.38% -
471.omnetpp (unexplained diff vs previous) (percentage) -82.95% 1.290 0.220 - -99.94% -
462.libquantum (avg) (percentage) -77.42% 1.860 0.420 - -94.52% -
458.sjeng (max) (percentage) -75.90% 0.830 0.200 - -99.58% -
429.mcf (unexplained diff vs previous) (percentage) -75.00% 0.640 0.160 - -99.99% -
459.GemsFDTD (unexplained diff vs previous) -74.00% 50.000 13.000 - -99.92% -
429.mcf (max) (percentage) -73.33% 1.200 0.320 - -99.66% -
483.xalancbmk (avg) (percentage) -72.64% 2.960 0.810 - -87.54% -
471.omnetpp (max) (percentage) -68.85% 2.440 0.760 - -99.05% -
454.calculix (avg) (percentage) -68.33% 3.600 1.140 - -85.79% -
473.astar -67.95% 78.000 25.000 - -88.26% -
473.astar (avg) -67.95% 78.000 25.000 - -88.26% -
458.sjeng (avg) (percentage) -66.67% 0.570 0.190 - -94.04% -
401.bzip2 (unexplained diff vs previous) (percentage) -66.07% 0.560 0.190 - -99.95% -
401.bzip2 (avg) (percentage) -65.67% 1.340 0.460 - -91.61% -
429.mcf -55.91% 93.000 41.000 - -62.39% -
429.mcf (avg) -55.91% 93.000 41.000 - -62.39% -
473.astar (max) (percentage) -54.55% 0.880 0.400 - -99.40% -
458.sjeng (max) -53.33% 60.000 28.000 - -99.22% -
450.soplex (avg) (percentage) -52.94% 2.380 1.120 - -82.58% -
483.xalancbmk (max) (percentage) -51.41% 1.770 0.860 - -98.75% -
464.h264ref (avg) (percentage) -50.70% 0.710 0.350 - -93.12% -
471.omnetpp (avg) (percentage) -43.63% 2.040 1.150 - -85.98% -
437.leslie3d (avg) (percentage) -40.09% 4.390 2.630 - -13.77% -
465.tonto -38.24% 136.000 84.000 - -76.99% -
465.tonto (avg) -38.24% 136.000 84.000 - -76.99% -
458.sjeng (unexplained diff vs previous) (percentage) -34.78% 0.230 0.150 - -99.83% -
458.sjeng -34.15% 41.000 27.000 - -88.80% -
458.sjeng (avg) -34.15% 41.000 27.000 - -88.80% -
471.omnetpp (unexplained diff vs previous) -31.43% 35.000 24.000 - -99.77% -
465.tonto (max) -27.47% 182.000 132.000 - -93.75% -
459.GemsFDTD (avg) (percentage) -26.40% 1.250 0.920 - -84.25% -
445.gobmk (avg) (percentage) -25.00% 0.840 0.630 - -83.89% -
447.dealII (avg) (percentage) -21.24% 1.130 0.890 - -84.58% -
437.leslie3d -19.04% 478.000 387.000 - 9.01% -
437.leslie3d (avg) -19.04% 478.000 387.000 - 9.01% -
465.tonto (avg) (percentage) -17.07% 1.230 1.020 - -69.46% -
453.povray (avg) (percentage) -12.10% 1.570 1.380 - -82.33% -
435.gromacs (avg) (percentage) -8.62% 1.740 1.590 - -68.58% -
453.povray (max) (percentage) -7.54% 3.050 2.820 - -96.91% -
453.povray (unexplained diff vs previous) -7.14% 14.000 13.000 - -99.77% -
470.lbm (unexplained diff vs previous) (percentage) -6.90% 0.290 0.270 - -99.90% -
437.leslie3d (max) (percentage) -5.13% 4.480 4.250 - -74.37% -
465.tonto (max) (percentage) -2.44% 1.640 1.600 - -91.71% -
400.perlbench (avg) (percentage) -1.03% 1.940 1.920 - -69.76% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 45.00% 20.000 29.000 - 0.00% -
nb_execution_successful 45.00% 20.000 29.000 - 0.00% -

Added Tests - Code Size
400.perlbench
403.gcc
416.gamess
436.cactusADM
454.calculix
456.hmmer
464.h264ref
481.wrf
483.xalancbmk

Added Tests - Execution
400.perlbench
403.gcc
416.gamess
436.cactusADM
454.calculix
456.hmmer
464.h264ref
481.wrf
483.xalancbmk

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (max)
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (max)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (max)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
454.calculix
454.calculix (avg)
454.calculix (max)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (max)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (max)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (max)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 1.10% 152037.000 153713.000 - 4.65% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 36196.77% 62.000 22504.000 - 0.00% -
403.gcc 16064.29% 56.000 9052.000 - 0.00% -
462.libquantum 8142.14% 140.000 11539.000 - 8261.59% -
482.sphinx3 3171.75% 945.000 30918.000 - 3550.30% -
450.soplex 2731.57% 567.000 16055.000 - 2635.09% -
444.namd 1204.95% 747.000 9748.000 - 1203.21% -
429.mcf 1109.69% 1424.000 17226.000 - 744.41% -
453.povray 1096.34% 547.000 6544.000 - 1076.98% -
433.milc 1052.30% 1151.000 13263.000 - 1048.31% -
436.cactusADM 773.31% 2083.000 18191.000 - 0.00% -
400.perlbench 566.33% 1663.000 11081.000 - 0.00% -
434.zeusmp 447.18% 2514.000 13756.000 - 497.57% -
447.dealII 431.73% 1724.000 9167.000 - 458.62% -
401.bzip2 407.82% 2941.000 14935.000 - 396.01% -
471.omnetpp 294.90% 2724.000 10757.000 - 296.94% -
459.GemsFDTD 284.04% 6173.000 23707.000 - 347.05% -
456.hmmer 270.16% 2882.000 10668.000 - 0.00% -
470.lbm 238.28% 3788.000 12814.000 - 234.22% -
481.wrf 204.10% 5534.000 16829.000 - 0.00% -
483.xalancbmk 182.56% 3818.000 10788.000 - 0.00% -
473.astar 176.70% 5128.000 14189.000 - 177.56% -
410.bwaves 143.52% 5652.000 13764.000 - 132.19% -
464.h264ref 138.19% 5761.000 13722.000 - 0.00% -
445.gobmk 131.75% 5023.000 11641.000 - 135.27% -
435.gromacs 115.68% 7269.000 15678.000 - 117.96% -
458.sjeng 88.17% 7567.000 14239.000 - 93.91% -
416.gamess 70.40% 12465.000 21240.000 - 0.00% -
437.leslie3d 26.53% 11640.000 14728.000 - 35.02% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 6300.00% 4.000 256.000 - 0.00% -
454.calculix (avg) 6300.00% 4.000 256.000 - 0.00% -
454.calculix (max) 1101.64% 61.000 733.000 - 0.00% -
403.gcc 725.00% 4.000 33.000 - 0.00% -
403.gcc (avg) 725.00% 4.000 33.000 - 0.00% -
482.sphinx3 689.19% 74.000 584.000 - 4071.43% -
482.sphinx3 (avg) 689.19% 74.000 584.000 - 4071.43% -
444.namd 526.47% 68.000 426.000 - 5225.00% -
444.namd (avg) 526.47% 68.000 426.000 - 5225.00% -
450.soplex 397.22% 36.000 179.000 - 1276.92% -
450.soplex (avg) 397.22% 36.000 179.000 - 1276.92% -
462.libquantum 380.00% 10.000 48.000 - 2300.00% -
462.libquantum (avg) 380.00% 10.000 48.000 - 2300.00% -
433.milc 260.87% 69.000 249.000 - 1815.38% -
433.milc (avg) 260.87% 69.000 249.000 - 1815.38% -
436.cactusADM 154.84% 124.000 316.000 - 0.00% -
436.cactusADM (avg) 154.84% 124.000 316.000 - 0.00% -
453.povray 114.29% 42.000 90.000 - 1025.00% -
453.povray (avg) 114.29% 42.000 90.000 - 1025.00% -
400.perlbench 101.90% 105.000 212.000 - 0.00% -
400.perlbench (avg) 101.90% 105.000 212.000 - 0.00% -
434.zeusmp 45.58% 147.000 214.000 - 970.00% -
434.zeusmp (avg) 45.58% 147.000 214.000 - 970.00% -
444.namd (max) 19.85% 685.000 821.000 - 9022.22% -
437.leslie3d 9.01% 355.000 387.000 - -19.04% -
437.leslie3d (avg) 9.01% 355.000 387.000 - -19.04% -
410.bwaves 4.82% 249.000 261.000 - 432.65% -
410.bwaves (avg) 4.82% 249.000 261.000 - 432.65% -
482.sphinx3 (max) 4.17% 911.000 949.000 - 10444.44% -
470.lbm 3.77% 239.000 248.000 - 726.67% -
470.lbm (avg) 3.77% 239.000 248.000 - 726.67% -
403.gcc (max) 1.82% 55.000 56.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383416.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -24.12% 10941.000 8302.000 - -25.30% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 0.160 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.320 - -85.25% -
403.gcc (unexplained diff vs previous) (percentage) -100.00% 15435.710 0.550 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.160 - -75.00% -
453.povray (unexplained diff vs previous) (percentage) -99.98% 1043.330 0.200 - -92.06% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.98% 250.410 0.050 - -94.68% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.390 - 135.59% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.95% 368.340 0.190 - -66.07% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.94% 391.300 0.220 - -82.95% -
481.wrf (unexplained diff vs previous) (percentage) -99.94% 219.530 0.140 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.93% 2557.320 1.780 - 947.06% -
459.GemsFDTD (unexplained diff vs previous) -99.92% 15458.000 13.000 - -74.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.90% 263.730 0.270 - -6.90% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.89% 219.170 0.240 - 0.00% -
429.mcf (unexplained diff vs previous) -99.85% 18593.000 27.000 - 107.69% -
454.calculix (unexplained diff vs previous) -99.84% 22953.000 36.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.83% 90.870 0.150 - -34.78% -
410.bwaves (unexplained diff vs previous) (percentage) -99.83% 137.900 0.230 - 130.00% -
433.milc (unexplained diff vs previous) (percentage) -99.82% 980.800 1.760 - 1855.56% -
481.wrf (unexplained diff vs previous) -99.81% 12149.000 23.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.80% 197.850 0.400 - 150.00% -
471.omnetpp (unexplained diff vs previous) -99.77% 10659.000 24.000 - -31.43% -
453.povray (unexplained diff vs previous) -99.77% 5707.000 13.000 - -7.14% -
401.bzip2 (unexplained diff vs previous) -99.74% 10833.000 28.000 - 64.71% -
462.libquantum (unexplained diff vs previous) -99.73% 13518.000 37.000 - 1133.33% -
458.sjeng (unexplained diff vs previous) -99.69% 6876.000 21.000 - 23.53% -
483.xalancbmk (unexplained diff vs previous) -99.69% 8368.000 26.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.68% 407.020 1.320 - 633.33% -
429.mcf (max) (percentage) -99.66% 92.890 0.320 - -73.33% -
456.hmmer (unexplained diff vs previous) (percentage) -99.66% 278.630 0.960 - 0.00% -
470.lbm (unexplained diff vs previous) -99.65% 9990.000 35.000 - 218.18% -
462.libquantum (max) (percentage) -99.65% 98.970 0.350 - -85.42% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.64% 787.130 2.810 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.63% 527.480 1.960 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.59% 7794.000 32.000 - 433.33% -
458.sjeng (max) (percentage) -99.58% 47.610 0.200 - -75.90% -
473.astar (unexplained diff vs previous) -99.44% 10146.000 57.000 - 612.50% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.43% 448.690 2.560 - 6300.00% -
403.gcc (unexplained diff vs previous) -99.42% 8644.000 50.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.42% 118.780 0.690 - 0.00% -
473.astar (max) (percentage) -99.40% 66.430 0.400 - -54.55% -
403.gcc (max) (percentage) -99.38% 99.360 0.620 - -83.42% -
444.namd (unexplained diff vs previous) (percentage) -99.30% 1118.610 7.780 - 2781.48% -
458.sjeng (max) -99.22% 3602.000 28.000 - -53.33% -
401.bzip2 (max) (percentage) -99.16% 78.650 0.660 - 6.45% -
445.gobmk (unexplained diff vs previous) (percentage) -99.07% 111.110 1.030 - 415.00% -
471.omnetpp (max) (percentage) -99.05% 79.650 0.760 - -68.85% -
483.xalancbmk (max) (percentage) -98.75% 68.670 0.860 - -51.41% -
464.h264ref (max) (percentage) -98.75% 54.290 0.680 - 74.36% -
456.hmmer (unexplained diff vs previous) -98.73% 8030.000 102.000 - 0.00% -
456.hmmer (max) (percentage) -98.71% 73.590 0.950 - 143.59% -
464.h264ref (unexplained diff vs previous) -98.63% 6843.000 94.000 - 0.00% -
473.astar (max) -98.36% 3406.000 56.000 - 27.27% -
482.sphinx3 (unexplained diff vs previous) -98.35% 26073.000 430.000 - 8500.00% -
447.dealII (unexplained diff vs previous) -98.28% 7017.000 121.000 - 3933.33% -
447.dealII (max) (percentage) -98.21% 80.280 1.440 - 20.00% -
450.soplex (max) (percentage) -98.04% 96.240 1.890 - 13.17% -
450.soplex (unexplained diff vs previous) -98.03% 14500.000 286.000 - 28500.00% -
445.gobmk (max) (percentage) -98.02% 52.630 1.040 - 225.00% -
459.GemsFDTD (max) (percentage) -97.96% 71.460 1.460 - 56.99% -
433.milc (unexplained diff vs previous) -97.94% 11289.000 233.000 - 23200.00% -
445.gobmk (unexplained diff vs previous) -97.85% 5581.000 120.000 - 1100.00% -
400.perlbench (unexplained diff vs previous) -97.53% 8772.000 217.000 - 0.00% -
433.milc (max) (percentage) -97.52% 90.750 2.250 - 257.14% -
435.gromacs (unexplained diff vs previous) (percentage) -97.30% 96.680 2.610 - 66.24% -
464.h264ref (max) -97.03% 3127.000 93.000 - 0.00% -
453.povray (max) (percentage) -96.91% 91.250 2.820 - -7.54% -
434.zeusmp (unexplained diff vs previous) -96.88% 11280.000 352.000 - 35100.00% -
436.cactusADM (unexplained diff vs previous) -96.88% 16396.000 512.000 - 0.00% -
429.mcf (avg) (percentage) -96.87% 7.670 0.240 - -94.77% -
482.sphinx3 (max) (percentage) -96.82% 96.500 3.070 - 166.96% -
434.zeusmp (max) (percentage) -96.78% 81.770 2.630 - 1361.11% -
436.cactusADM (max) (percentage) -96.73% 88.730 2.900 - 222.22% -
454.calculix (max) (percentage) -96.73% 99.730 3.260 - 297.56% -
400.perlbench (max) (percentage) -96.51% 84.060 2.930 - 22.08% -
483.xalancbmk (max) -96.49% 2621.000 92.000 - 0.00% -
471.omnetpp (max) -96.27% 2169.000 81.000 - 22.73% -
429.mcf (max) -95.84% 1322.000 55.000 - 129.17% -
401.bzip2 (max) -95.76% 2313.000 98.000 - 444.44% -
473.astar (avg) (percentage) -95.67% 4.160 0.180 - -88.31% -
445.gobmk (max) -95.42% 2643.000 121.000 - 706.67% -
456.hmmer (max) -95.24% 2120.000 101.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -95.11% 62.730 3.070 - 0.00% -
403.gcc (avg) (percentage) -94.95% 7.320 0.370 - -92.73% -
435.gromacs (max) (percentage) -94.55% 49.160 2.680 - 72.90% -
462.libquantum (avg) (percentage) -94.52% 7.660 0.420 - -77.42% -
481.wrf (max) (percentage) -94.26% 68.700 3.940 - 392.50% -
435.gromacs (unexplained diff vs previous) -94.18% 7028.000 409.000 - 261.95% -
458.sjeng (avg) (percentage) -94.04% 3.190 0.190 - -66.67% -
465.tonto (max) -93.75% 2112.000 132.000 - -27.47% -
470.lbm (max) (percentage) -93.50% 72.510 4.710 - 1524.14% -
410.bwaves (max) (percentage) -93.24% 57.970 3.920 - 1300.00% -
464.h264ref (avg) (percentage) -93.12% 5.090 0.350 - -50.70% -
465.tonto (unexplained diff vs previous) -92.38% 1771.000 135.000 - 27.36% -
459.GemsFDTD (max) -92.16% 4411.000 346.000 - 606.12% -
416.gamess (max) (percentage) -91.78% 38.550 3.170 - 780.56% -
465.tonto (max) (percentage) -91.71% 19.310 1.600 - -2.44% -
416.gamess (unexplained diff vs previous) -91.66% 7819.000 652.000 - 0.00% -
401.bzip2 (avg) (percentage) -91.61% 5.480 0.460 - -65.67% -
444.namd (unexplained diff vs previous) -90.93% 8356.000 758.000 - 37800.00% -
444.namd (max) (percentage) -90.82% 91.790 8.430 - 563.78% -
447.dealII (max) -90.46% 1384.000 132.000 - 594.74% -
465.tonto (unexplained diff vs previous) (percentage) -89.93% 16.190 1.630 - 71.58% -
458.sjeng -88.80% 241.000 27.000 - -34.15% -
458.sjeng (avg) -88.80% 241.000 27.000 - -34.15% -
473.astar -88.26% 213.000 25.000 - -67.95% -
473.astar (avg) -88.26% 213.000 25.000 - -67.95% -
435.gromacs (max) -88.25% 3573.000 420.000 - 278.38% -
483.xalancbmk (avg) (percentage) -87.54% 6.500 0.810 - -72.64% -
456.hmmer (avg) (percentage) -87.07% 4.410 0.570 - 9.62% -
416.gamess (max) -85.99% 4805.000 673.000 - 0.00% -
471.omnetpp (avg) (percentage) -85.98% 8.200 1.150 - -43.63% -
454.calculix (avg) (percentage) -85.79% 8.020 1.140 - -68.33% -
447.dealII (avg) (percentage) -84.58% 5.770 0.890 - -21.24% -
459.GemsFDTD (avg) (percentage) -84.25% 5.840 0.920 - -26.40% -
445.gobmk (avg) (percentage) -83.89% 3.910 0.630 - -25.00% -
464.h264ref -83.62% 293.000 48.000 - 0.00% -
464.h264ref (avg) -83.62% 293.000 48.000 - 0.00% -
410.bwaves (max) -83.55% 3276.000 539.000 - 3268.75% -
450.soplex (avg) (percentage) -82.58% 6.430 1.120 - -52.94% -
481.wrf (max) -82.56% 3801.000 663.000 - 0.00% -
434.zeusmp (max) -82.43% 2055.000 361.000 - 8925.00% -
453.povray (avg) (percentage) -82.33% 7.810 1.380 - -12.10% -
437.leslie3d (unexplained diff vs previous) (percentage) -79.53% 19.880 4.070 - 92.89% -
470.lbm (max) -78.04% 2746.000 603.000 - 5381.82% -
465.tonto -76.99% 365.000 84.000 - -38.24% -
465.tonto (avg) -76.99% 365.000 84.000 - -38.24% -
400.perlbench (max) -76.81% 1397.000 324.000 - 0.00% -
482.sphinx3 (avg) (percentage) -76.17% 7.930 1.890 - 13.17% -
437.leslie3d (max) (percentage) -74.37% 16.580 4.250 - -5.13% -
437.leslie3d (unexplained diff vs previous) -74.07% 2314.000 600.000 - 160.87% -
434.zeusmp (avg) (percentage) -73.33% 5.850 1.560 - 75.28% -
436.cactusADM (max) -71.48% 1848.000 527.000 - 0.00% -
433.milc (max) -71.46% 1044.000 298.000 - 4157.14% -
462.libquantum (max) -71.01% 138.000 40.000 - 1233.33% -
436.cactusADM (avg) (percentage) -70.90% 5.980 1.740 - 65.71% -
400.perlbench (avg) (percentage) -69.76% 6.350 1.920 - -1.03% -
465.tonto (avg) (percentage) -69.46% 3.340 1.020 - -17.07% -
470.lbm (avg) (percentage) -69.35% 6.330 1.940 - 142.50% -
481.wrf (avg) (percentage) -69.07% 6.240 1.930 - 7.22% -
433.milc (avg) (percentage) -68.93% 6.050 1.880 - 56.67% -
435.gromacs (avg) (percentage) -68.58% 5.060 1.590 - -8.62% -
437.leslie3d (max) -67.60% 1929.000 625.000 - 28.07% -
483.xalancbmk -64.92% 248.000 87.000 - 0.00% -
483.xalancbmk (avg) -64.92% 248.000 87.000 - 0.00% -
453.povray (max) -63.13% 499.000 184.000 - 1050.00% -
445.gobmk -62.76% 196.000 73.000 - 78.05% -
445.gobmk (avg) -62.76% 196.000 73.000 - 78.05% -
429.mcf -62.39% 109.000 41.000 - -55.91% -
429.mcf (avg) -62.39% 109.000 41.000 - -55.91% -
401.bzip2 -57.76% 161.000 68.000 - 70.00% -
401.bzip2 (avg) -57.76% 161.000 68.000 - 70.00% -
410.bwaves (avg) (percentage) -56.92% 4.410 1.900 - 128.92% -
456.hmmer -52.76% 127.000 60.000 - 0.00% -
456.hmmer (avg) -52.76% 127.000 60.000 - 0.00% -
416.gamess (avg) (percentage) -52.71% 4.420 2.090 - 175.00% -
444.namd (avg) (percentage) -52.49% 9.220 4.380 - 277.59% -
471.omnetpp -44.84% 223.000 123.000 - 123.64% -
471.omnetpp (avg) -44.84% 223.000 123.000 - 123.64% -
450.soplex (max) -44.40% 545.000 303.000 - 3266.67% -
459.GemsFDTD -39.44% 360.000 218.000 - 230.30% -
459.GemsFDTD (avg) -39.44% 360.000 218.000 - 230.30% -
435.gromacs -32.15% 367.000 249.000 - 99.20% -
435.gromacs (avg) -32.15% 367.000 249.000 - 99.20% -
416.gamess -19.45% 550.000 443.000 - 0.00% -
416.gamess (avg) -19.45% 550.000 443.000 - 0.00% -
447.dealII -18.18% 99.000 81.000 - 350.00% -
447.dealII (avg) -18.18% 99.000 81.000 - 350.00% -
437.leslie3d (avg) (percentage) -13.77% 3.050 2.630 - -40.09% -
481.wrf -6.09% 345.000 324.000 - 0.00% -
481.wrf (avg) -6.09% 345.000 324.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 11081.000 -
401.bzip2 14935.000 396.01%
403.gcc 9052.000 -
410.bwaves 13764.000 132.19%
416.gamess 21240.000 -
429.mcf 17226.000 744.41%
433.milc 13263.000 1048.31%
434.zeusmp 13756.000 497.57%
435.gromacs 15678.000 117.96%
436.cactusADM 18191.000 -
437.leslie3d 14728.000 35.02%
444.namd 9748.000 1203.21%
445.gobmk 11641.000 135.27%
447.dealII 9167.000 458.62%
450.soplex 16055.000 2635.09%
453.povray 6544.000 1076.98%
454.calculix 22504.000 -
456.hmmer 10668.000 -
458.sjeng 14239.000 93.91%
459.GemsFDTD 23707.000 347.05%
462.libquantum 11539.000 8261.59%
464.h264ref 13722.000 -
465.tonto 8302.000 -25.30%
470.lbm 12814.000 234.22%
471.omnetpp 10757.000 296.94%
473.astar 14189.000 177.56%
481.wrf 16829.000 -
482.sphinx3 30918.000 3550.30%
483.xalancbmk 10788.000 -
Geometric Mean 13595.682 466.31%
Code Size (bytes)
Name Current %
400.perlbench 892912.000 -
401.bzip2 44241.000 1.21%
403.gcc 2446120.000 -
410.bwaves 16748.000 1.65%
416.gamess 5732285.000 -
429.mcf 9123.000 -
433.milc 61222.000 1.22%
434.zeusmp 153713.000 4.65%
435.gromacs 500327.000 1.31%
436.cactusADM 352867.000 -
437.leslie3d 59491.000 9.42%
444.namd 188365.000 3.37%
445.gobmk 1377606.000 -
447.dealII 312518.000 2.06%
450.soplex 205068.000 1.31%
453.povray 657755.000 -
454.calculix 845075.000 -
456.hmmer 108691.000 -
458.sjeng 104004.000 1.65%
459.GemsFDTD 245040.000 5.33%
462.libquantum 16117.000 2.03%
464.h264ref 383416.000 -
465.tonto 1948611.000 -1.18%
470.lbm 9687.000 1.47%
471.omnetpp 480176.000 1.04%
473.astar 22944.000 -
481.wrf 1965892.000 -
482.sphinx3 112839.000 1.00%
483.xalancbmk 2342986.000 -
Geometric Mean 223970.600 96.48%
Score
Name Current %
nb_compile_successful 29.000 45.00%
nb_execution_successful 29.000 45.00%
nb_total_tests 29.000 -23.68%
Geometric Mean 29.000 17.07%
sample variability
Name Current %
400.perlbench 212.000 -
400.perlbench (avg) 212.000 -
400.perlbench (avg) (percentage) 1.920 -1.03%
400.perlbench (max) 324.000 -
400.perlbench (max) (percentage) 2.930 22.08%
400.perlbench (unexplained diff vs previous) 217.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.960 -
401.bzip2 68.000 70.00%
401.bzip2 (avg) 68.000 70.00%
401.bzip2 (avg) (percentage) 0.460 -65.67%
401.bzip2 (max) 98.000 444.44%
401.bzip2 (max) (percentage) 0.660 6.45%
401.bzip2 (unexplained diff vs previous) 28.000 64.71%
401.bzip2 (unexplained diff vs previous) (percentage) 0.190 -66.07%
403.gcc 33.000 -
403.gcc (avg) 33.000 -
403.gcc (avg) (percentage) 0.370 -92.73%
403.gcc (max) 56.000 -
403.gcc (max) (percentage) 0.620 -83.42%
403.gcc (unexplained diff vs previous) 50.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.550 -
410.bwaves 261.000 432.65%
410.bwaves (avg) 261.000 432.65%
410.bwaves (avg) (percentage) 1.900 128.92%
410.bwaves (max) 539.000 3268.75%
410.bwaves (max) (percentage) 3.920 1300.00%
410.bwaves (unexplained diff vs previous) 32.000 433.33%
410.bwaves (unexplained diff vs previous) (percentage) 0.230 130.00%
416.gamess 443.000 -
416.gamess (avg) 443.000 -
416.gamess (avg) (percentage) 2.090 175.00%
416.gamess (max) 673.000 -
416.gamess (max) (percentage) 3.170 780.56%
416.gamess (unexplained diff vs previous) 652.000 -
416.gamess (unexplained diff vs previous) (percentage) 3.070 -
429.mcf 41.000 -55.91%
429.mcf (avg) 41.000 -55.91%
429.mcf (avg) (percentage) 0.240 -94.77%
429.mcf (max) 55.000 129.17%
429.mcf (max) (percentage) 0.320 -73.33%
429.mcf (unexplained diff vs previous) 27.000 107.69%
429.mcf (unexplained diff vs previous) (percentage) 0.160 -75.00%
433.milc 249.000 1815.38%
433.milc (avg) 249.000 1815.38%
433.milc (avg) (percentage) 1.880 56.67%
433.milc (max) 298.000 4157.14%
433.milc (max) (percentage) 2.250 257.14%
433.milc (unexplained diff vs previous) 233.000 23200.00%
433.milc (unexplained diff vs previous) (percentage) 1.760 1855.56%
434.zeusmp 214.000 970.00%
434.zeusmp (avg) 214.000 970.00%
434.zeusmp (avg) (percentage) 1.560 75.28%
434.zeusmp (max) 361.000 8925.00%
434.zeusmp (max) (percentage) 2.630 1361.11%
434.zeusmp (unexplained diff vs previous) 352.000 35100.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.560 6300.00%
435.gromacs 249.000 99.20%
435.gromacs (avg) 249.000 99.20%
435.gromacs (avg) (percentage) 1.590 -8.62%
435.gromacs (max) 420.000 278.38%
435.gromacs (max) (percentage) 2.680 72.90%
435.gromacs (unexplained diff vs previous) 409.000 261.95%
435.gromacs (unexplained diff vs previous) (percentage) 2.610 66.24%
436.cactusADM 316.000 -
436.cactusADM (avg) 316.000 -
436.cactusADM (avg) (percentage) 1.740 65.71%
436.cactusADM (max) 527.000 -
436.cactusADM (max) (percentage) 2.900 222.22%
436.cactusADM (unexplained diff vs previous) 512.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 2.810 -
437.leslie3d 387.000 -19.04%
437.leslie3d (avg) 387.000 -19.04%
437.leslie3d (avg) (percentage) 2.630 -40.09%
437.leslie3d (max) 625.000 28.07%
437.leslie3d (max) (percentage) 4.250 -5.13%
437.leslie3d (unexplained diff vs previous) 600.000 160.87%
437.leslie3d (unexplained diff vs previous) (percentage) 4.070 92.89%
444.namd 426.000 5225.00%
444.namd (avg) 426.000 5225.00%
444.namd (avg) (percentage) 4.380 277.59%
444.namd (max) 821.000 9022.22%
444.namd (max) (percentage) 8.430 563.78%
444.namd (unexplained diff vs previous) 758.000 37800.00%
444.namd (unexplained diff vs previous) (percentage) 7.780 2781.48%
445.gobmk 73.000 78.05%
445.gobmk (avg) 73.000 78.05%
445.gobmk (avg) (percentage) 0.630 -25.00%
445.gobmk (max) 121.000 706.67%
445.gobmk (max) (percentage) 1.040 225.00%
445.gobmk (unexplained diff vs previous) 120.000 1100.00%
445.gobmk (unexplained diff vs previous) (percentage) 1.030 415.00%
447.dealII 81.000 350.00%
447.dealII (avg) 81.000 350.00%
447.dealII (avg) (percentage) 0.890 -21.24%
447.dealII (max) 132.000 594.74%
447.dealII (max) (percentage) 1.440 20.00%
447.dealII (unexplained diff vs previous) 121.000 3933.33%
447.dealII (unexplained diff vs previous) (percentage) 1.320 633.33%
450.soplex 179.000 1276.92%
450.soplex (avg) 179.000 1276.92%
450.soplex (avg) (percentage) 1.120 -52.94%
450.soplex (max) 303.000 3266.67%
450.soplex (max) (percentage) 1.890 13.17%
450.soplex (unexplained diff vs previous) 286.000 28500.00%
450.soplex (unexplained diff vs previous) (percentage) 1.780 947.06%
453.povray 90.000 1025.00%
453.povray (avg) 90.000 1025.00%
453.povray (avg) (percentage) 1.380 -12.10%
453.povray (max) 184.000 1050.00%
453.povray (max) (percentage) 2.820 -7.54%
453.povray (unexplained diff vs previous) 13.000 -7.14%
453.povray (unexplained diff vs previous) (percentage) 0.200 -92.06%
454.calculix 256.000 -
454.calculix (avg) 256.000 -
454.calculix (avg) (percentage) 1.140 -68.33%
454.calculix (max) 733.000 -
454.calculix (max) (percentage) 3.260 297.56%
454.calculix (unexplained diff vs previous) 36.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.160 -
456.hmmer 60.000 -
456.hmmer (avg) 60.000 -
456.hmmer (avg) (percentage) 0.570 9.62%
456.hmmer (max) 101.000 -
456.hmmer (max) (percentage) 0.950 143.59%
456.hmmer (unexplained diff vs previous) 102.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.960 -
458.sjeng 27.000 -34.15%
458.sjeng (avg) 27.000 -34.15%
458.sjeng (avg) (percentage) 0.190 -66.67%
458.sjeng (max) 28.000 -53.33%
458.sjeng (max) (percentage) 0.200 -75.90%
458.sjeng (unexplained diff vs previous) 21.000 23.53%
458.sjeng (unexplained diff vs previous) (percentage) 0.150 -34.78%
459.GemsFDTD 218.000 230.30%
459.GemsFDTD (avg) 218.000 230.30%
459.GemsFDTD (avg) (percentage) 0.920 -26.40%
459.GemsFDTD (max) 346.000 606.12%
459.GemsFDTD (max) (percentage) 1.460 56.99%
459.GemsFDTD (unexplained diff vs previous) 13.000 -74.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.050 -94.68%
462.libquantum 48.000 2300.00%
462.libquantum (avg) 48.000 2300.00%
462.libquantum (avg) (percentage) 0.420 -77.42%
462.libquantum (max) 40.000 1233.33%
462.libquantum (max) (percentage) 0.350 -85.42%
462.libquantum (unexplained diff vs previous) 37.000 1133.33%
462.libquantum (unexplained diff vs previous) (percentage) 0.320 -85.25%
464.h264ref 48.000 -
464.h264ref (avg) 48.000 -
464.h264ref (avg) (percentage) 0.350 -50.70%
464.h264ref (max) 93.000 -
464.h264ref (max) (percentage) 0.680 74.36%
464.h264ref (unexplained diff vs previous) 94.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.690 -
465.tonto 84.000 -38.24%
465.tonto (avg) 84.000 -38.24%
465.tonto (avg) (percentage) 1.020 -17.07%
465.tonto (max) 132.000 -27.47%
465.tonto (max) (percentage) 1.600 -2.44%
465.tonto (unexplained diff vs previous) 135.000 27.36%
465.tonto (unexplained diff vs previous) (percentage) 1.630 71.58%
470.lbm 248.000 726.67%
470.lbm (avg) 248.000 726.67%
470.lbm (avg) (percentage) 1.940 142.50%
470.lbm (max) 603.000 5381.82%
470.lbm (max) (percentage) 4.710 1524.14%
470.lbm (unexplained diff vs previous) 35.000 218.18%
470.lbm (unexplained diff vs previous) (percentage) 0.270 -6.90%
471.omnetpp 123.000 123.64%
471.omnetpp (avg) 123.000 123.64%
471.omnetpp (avg) (percentage) 1.150 -43.63%
471.omnetpp (max) 81.000 22.73%
471.omnetpp (max) (percentage) 0.760 -68.85%
471.omnetpp (unexplained diff vs previous) 24.000 -31.43%
471.omnetpp (unexplained diff vs previous) (percentage) 0.220 -82.95%
473.astar 25.000 -67.95%
473.astar (avg) 25.000 -67.95%
473.astar (avg) (percentage) 0.180 -88.31%
473.astar (max) 56.000 27.27%
473.astar (max) (percentage) 0.400 -54.55%
473.astar (unexplained diff vs previous) 57.000 612.50%
473.astar (unexplained diff vs previous) (percentage) 0.400 150.00%
481.wrf 324.000 -
481.wrf (avg) 324.000 -
481.wrf (avg) (percentage) 1.930 7.22%
481.wrf (max) 663.000 -
481.wrf (max) (percentage) 3.940 392.50%
481.wrf (unexplained diff vs previous) 23.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.140 -
482.sphinx3 584.000 4071.43%
482.sphinx3 (avg) 584.000 4071.43%
482.sphinx3 (avg) (percentage) 1.890 13.17%
482.sphinx3 (max) 949.000 10444.44%
482.sphinx3 (max) (percentage) 3.070 166.96%
482.sphinx3 (unexplained diff vs previous) 430.000 8500.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.390 135.59%
483.xalancbmk 87.000 -
483.xalancbmk (avg) 87.000 -
483.xalancbmk (avg) (percentage) 0.810 -72.64%
483.xalancbmk (max) 92.000 -
483.xalancbmk (max) (percentage) 0.860 -51.41%
483.xalancbmk (unexplained diff vs previous) 26.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.240 -
Geometric Mean 16.460 256.42%