Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=52480b9ef499870c36c8dfb34df31e67df7bb4dd (+ 52 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/e4703bd0e15b4ed6e5eae36604b28bd4ca4f8cee (+ 27 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=103a469dc7755fd9e8ccf362f3dd4c55dc761908 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=41ef90ef3d60f744371a36bff5b5c8fbe78099d7 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-arm-master-Os_LTO-build/4/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0004 (2-changed-components) 2023-01-17T20:05:31 0:00:00
Previous 0003 (basepoints/gcc-13-06321-g05a3fc910c3) 2023-02-21T09:25:14 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 66 175
Performance Improvements 158 53
Added Tests 9 0
Unchanged Tests 1003 1008
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 50153.12% 64.000 32162.000 - -1.01% -
403.gcc 15583.64% 55.000 8626.000 - -2.97% -
462.libquantum 10788.96% 163.000 17749.000 - 4.38% -
482.sphinx3 3560.19% 927.000 33930.000 - -7.26% -
450.soplex 2461.47% 597.000 15292.000 - -2.65% -
444.namd 1628.36% 899.000 15538.000 - -2.63% -
429.mcf 1471.27% 926.000 14550.000 - 24.07% -
453.povray 1370.99% 555.000 8164.000 - 10.40% -
433.milc 1063.92% 1128.000 13129.000 - -3.94% -
436.cactusADM 816.95% 2590.000 23749.000 - -2.65% -
434.zeusmp 675.86% 2709.000 21018.000 - 0.41% -
400.perlbench 607.67% 1590.000 11252.000 - 0.33% -
401.bzip2 434.00% 3012.000 16084.000 - -5.23% -
447.dealII 390.39% 1883.000 9234.000 - 1.46% -
470.lbm 359.58% 3723.000 17110.000 - 4.89% -
456.hmmer 320.26% 4461.000 18748.000 - -1.30% -
471.omnetpp 299.43% 2825.000 11284.000 - 21.79% -
481.wrf 254.13% 6279.000 22236.000 - 1.11% -
459.GemsFDTD 242.02% 7171.000 24526.000 - -3.30% -
473.astar 175.75% 4861.000 13404.000 - 3.24% -
445.gobmk 144.88% 5051.000 12369.000 - -0.22% -
410.bwaves 137.21% 5961.000 14140.000 - -4.10% -
464.h264ref 123.02% 6216.000 13863.000 - -8.84% -
458.sjeng 118.73% 7692.000 16825.000 - 5.04% -
435.gromacs 97.59% 7713.000 15240.000 - -9.57% -
416.gamess 87.83% 14787.000 27774.000 - -5.56% -
437.leslie3d 46.91% 12176.000 17888.000 - -1.01% -
465.tonto 2.77% 12929.000 13287.000 - 1.86% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) 15500.00% 1.000 156.000 - 200.00% -
454.calculix 15325.00% 4.000 617.000 - -6.37% -
454.calculix (avg) 15325.00% 4.000 617.000 - -6.37% -
482.sphinx3 1002.99% 67.000 739.000 - -13.97% -
482.sphinx3 (avg) 1002.99% 67.000 739.000 - -13.97% -
462.libquantum 700.00% 9.000 72.000 - 125.00% -
462.libquantum (avg) 700.00% 9.000 72.000 - 125.00% -
444.namd 649.28% 69.000 517.000 - 24.88% -
444.namd (avg) 649.28% 69.000 517.000 - 24.88% -
454.calculix (max) 476.19% 63.000 363.000 - 33.46% -
453.povray 325.00% 40.000 170.000 - 50.44% -
453.povray (avg) 325.00% 40.000 170.000 - 50.44% -
436.cactusADM 268.89% 180.000 664.000 - 13.50% -
436.cactusADM (avg) 268.89% 180.000 664.000 - 13.50% -
429.mcf 229.49% 78.000 257.000 - 358.93% -
429.mcf (avg) 229.49% 78.000 257.000 - 358.93% -
470.lbm 143.82% 267.000 651.000 - 7.07% -
470.lbm (avg) 143.82% 267.000 651.000 - 7.07% -
450.soplex 114.71% 34.000 73.000 - 97.30% -
450.soplex (avg) 114.71% 34.000 73.000 - 97.30% -
434.zeusmp 100.63% 158.000 317.000 - 24.31% -
434.zeusmp (avg) 100.63% 158.000 317.000 - 24.31% -
433.milc 96.88% 64.000 126.000 - 34.04% -
433.milc (avg) 96.88% 64.000 126.000 - 34.04% -
483.xalancbmk (max) (percentage) 76.95% 2.430 4.300 - 367.39% -
465.tonto (max) 52.59% 367.000 560.000 - 151.12% -
465.tonto (max) (percentage) 48.59% 2.840 4.220 - 146.78% -
481.wrf 38.28% 418.000 578.000 - 2.30% -
481.wrf (avg) 38.28% 418.000 578.000 - 2.30% -
410.bwaves 18.00% 300.000 354.000 - 22.49% -
410.bwaves (avg) 18.00% 300.000 354.000 - 22.49% -
444.namd (max) 17.00% 847.000 991.000 - 12.74% -
471.omnetpp 14.75% 217.000 249.000 - 128.44% -
471.omnetpp (avg) 14.75% 217.000 249.000 - 128.44% -
459.GemsFDTD 5.53% 416.000 439.000 - 24.72% -
459.GemsFDTD (avg) 5.53% 416.000 439.000 - 24.72% -
447.dealII 4.72% 106.000 111.000 - 40.51% -
447.dealII (avg) 4.72% 106.000 111.000 - 40.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 10350.920 0.060 - -25.00% -
454.calculix (unexplained diff vs previous) (percentage) -100.00% 50484.380 0.870 - 16.00% -
470.lbm (unexplained diff vs previous) (percentage) -100.00% 337.470 0.010 - -99.80% -
482.sphinx3 (unexplained diff vs previous) (percentage) -100.00% 3892.660 0.140 - -95.42% -
470.lbm (unexplained diff vs previous) -99.98% 12564.000 2.000 - -99.76% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2547.240 0.720 - 63.64% -
429.mcf (unexplained diff vs previous) (percentage) -99.97% 1156.700 0.380 - 322.22% -
456.hmmer (unexplained diff vs previous) (percentage) -99.97% 334.300 0.110 - -78.85% -
462.libquantum (unexplained diff vs previous) -99.93% 16872.000 11.000 - -21.43% -
473.astar (unexplained diff vs previous) (percentage) -99.90% 157.700 0.160 - -65.96% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.90% 223.430 0.230 - -65.67% -
462.libquantum (max) (percentage) -99.89% 99.040 0.110 - 37.50% -
481.wrf (unexplained diff vs previous) (percentage) -99.88% 248.990 0.310 - -92.38% -
400.perlbench (unexplained diff vs previous) (percentage) -99.87% 636.480 0.810 - 161.29% -
482.sphinx3 (unexplained diff vs previous) -99.87% 36085.000 47.000 - -95.80% -
456.hmmer (unexplained diff vs previous) -99.87% 14913.000 20.000 - -79.59% -
433.milc (unexplained diff vs previous) (percentage) -99.83% 1112.320 1.870 - 167.14% -
453.povray (unexplained diff vs previous) (percentage) -99.83% 1317.480 2.250 - -1.75% -
445.gobmk (unexplained diff vs previous) (percentage) -99.79% 135.620 0.290 - 93.33% -
464.h264ref (unexplained diff vs previous) (percentage) -99.77% 139.330 0.320 - -15.79% -
473.astar (unexplained diff vs previous) -99.71% 7666.000 22.000 - -63.93% -
458.sjeng (unexplained diff vs previous) (percentage) -99.70% 106.920 0.320 - 6.67% -
444.namd (unexplained diff vs previous) (percentage) -99.69% 1653.620 5.150 - -1.53% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.66% 446.710 1.520 - 270.73% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.64% 665.820 2.370 - 5.33% -
447.dealII (unexplained diff vs previous) (percentage) -99.61% 405.360 1.580 - 110.67% -
471.omnetpp (unexplained diff vs previous) -99.59% 6312.000 26.000 - -58.06% -
429.mcf (max) (percentage) -99.59% 92.040 0.380 - 18.75% -
481.wrf (unexplained diff vs previous) -99.56% 15634.000 69.000 - -92.28% -
445.gobmk (max) (percentage) -99.50% 57.560 0.290 - 7.41% -
464.h264ref (unexplained diff vs previous) -99.48% 8661.000 45.000 - -22.41% -
429.mcf (unexplained diff vs previous) -99.48% 10711.000 56.000 - 460.00% -
445.gobmk (unexplained diff vs previous) -99.47% 6850.000 36.000 - 100.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.40% 843.630 5.090 - 5.82% -
458.sjeng (unexplained diff vs previous) -99.34% 8224.000 54.000 - 12.50% -
450.soplex (unexplained diff vs previous) -99.28% 15207.000 110.000 - 59.42% -
454.calculix (unexplained diff vs previous) -99.13% 32310.000 281.000 - 15.16% -
400.perlbench (unexplained diff vs previous) -99.10% 10120.000 91.000 - 160.00% -
400.perlbench (max) (percentage) -99.05% 86.420 0.820 - 2.50% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.93% 255.930 2.730 - 18.70% -
456.hmmer (max) (percentage) -98.87% 76.970 0.870 - 67.31% -
454.calculix (max) (percentage) -98.87% 99.800 1.130 - 34.52% -
445.gobmk (max) -98.80% 2907.000 35.000 - 6.06% -
401.bzip2 (unexplained diff vs previous) -98.18% 13455.000 245.000 - 255.07% -
447.dealII (unexplained diff vs previous) -98.09% 7633.000 146.000 - 114.71% -
435.gromacs (unexplained diff vs previous) (percentage) -98.06% 113.690 2.210 - 27.75% -
433.milc (unexplained diff vs previous) -98.04% 12547.000 246.000 - 156.25% -
433.milc (max) (percentage) -97.92% 91.750 1.910 - 169.01% -
453.povray (unexplained diff vs previous) -97.48% 7312.000 184.000 - 8.88% -
434.zeusmp (max) (percentage) -97.32% 86.940 2.330 - 1.30% -
482.sphinx3 (max) (percentage) -97.24% 97.500 2.690 - -14.60% -
434.zeusmp (unexplained diff vs previous) -97.23% 18037.000 499.000 - 6.17% -
473.astar (max) (percentage) -97.09% 61.200 1.780 - 278.72% -
450.soplex (max) (percentage) -96.93% 96.220 2.950 - 570.45% -
447.dealII (max) (percentage) -96.87% 80.210 2.510 - 52.12% -
416.gamess (unexplained diff vs previous) (percentage) -96.81% 96.330 3.070 - 0.66% -
459.GemsFDTD (unexplained diff vs previous) -96.35% 18353.000 670.000 - 14.73% -
435.gromacs (unexplained diff vs previous) -96.16% 8769.000 337.000 - 15.41% -
401.bzip2 (max) (percentage) -95.46% 81.710 3.710 - 827.50% -
410.bwaves (unexplained diff vs previous) (percentage) -95.45% 150.410 6.840 - 293.10% -
481.wrf (max) (percentage) -95.29% 71.350 3.360 - -19.23% -
456.hmmer (max) -95.25% 3433.000 163.000 - 66.33% -
437.leslie3d (unexplained diff vs previous) (percentage) -94.84% 48.840 2.520 - 144.66% -
444.namd (unexplained diff vs previous) -94.62% 14866.000 800.000 - -4.08% -
436.cactusADM (max) (percentage) -94.59% 89.400 4.840 - -4.16% -
436.cactusADM (unexplained diff vs previous) -94.47% 21850.000 1208.000 - 2.98% -
459.GemsFDTD (max) (percentage) -94.38% 71.900 4.040 - 77.19% -
453.povray (max) (percentage) -94.34% 92.950 5.260 - 103.09% -
445.gobmk (avg) (percentage) -94.07% 4.050 0.240 - 9.09% -
416.gamess (unexplained diff vs previous) -94.00% 14245.000 854.000 - -4.69% -
416.gamess (max) (percentage) -93.93% 49.070 2.980 - -5.10% -
429.mcf (max) -93.54% 852.000 55.000 - 48.65% -
400.perlbench (max) -93.30% 1374.000 92.000 - 3.37% -
444.namd (max) (percentage) -93.23% 94.300 6.380 - 15.79% -
462.libquantum (avg) (percentage) -92.98% 5.840 0.410 - 115.79% -
456.hmmer (avg) (percentage) -92.82% 4.320 0.310 - 3.33% -
437.leslie3d (unexplained diff vs previous) -92.42% 5947.000 451.000 - 141.18% -
470.lbm (max) (percentage) -92.34% 77.140 5.910 - 7.85% -
473.astar (max) -92.00% 2974.000 238.000 - 290.16% -
450.soplex (avg) (percentage) -91.71% 5.790 0.480 - 100.00% -
458.sjeng (max) (percentage) -91.52% 51.670 4.380 - 1360.00% -
400.perlbench (avg) (percentage) -91.06% 5.370 0.480 - 23.08% -
410.bwaves (max) (percentage) -89.35% 60.070 6.400 - 261.58% -
410.bwaves (unexplained diff vs previous) -89.21% 8966.000 967.000 - 276.26% -
464.h264ref (max) (percentage) -88.97% 58.220 6.420 - 1546.15% -
416.gamess (max) -88.60% 7255.000 827.000 - -10.40% -
437.leslie3d (max) (percentage) -88.30% 32.810 3.840 - 23.87% -
462.libquantum (max) -88.20% 161.000 19.000 - 46.15% -
401.bzip2 (avg) (percentage) -88.04% 5.770 0.690 - 155.56% -
435.gromacs (max) (percentage) -88.03% 53.200 6.370 - 261.93% -
473.astar (avg) (percentage) -87.10% 4.110 0.530 - 32.50% -
458.sjeng (avg) (percentage) -85.79% 3.800 0.540 - 134.78% -
445.gobmk -85.78% 204.000 29.000 - 7.41% -
445.gobmk (avg) -85.78% 204.000 29.000 - 7.41% -
447.dealII (max) -84.70% 1510.000 231.000 - 54.00% -
481.wrf (max) -83.33% 4480.000 747.000 - -18.27% -
433.milc (avg) (percentage) -83.16% 5.700 0.960 - 39.13% -
437.leslie3d (max) -82.82% 3994.000 686.000 - 22.50% -
464.h264ref (avg) (percentage) -81.67% 4.800 0.880 - 125.64% -
458.sjeng (max) -81.48% 3974.000 736.000 - 1433.33% -
471.omnetpp (max) (percentage) -81.17% 69.080 13.010 - 599.46% -
459.GemsFDTD (max) -80.80% 5155.000 990.000 - 71.28% -
434.zeusmp (max) -79.24% 2355.000 489.000 - 1.66% -
429.mcf (avg) (percentage) -79.23% 8.520 1.770 - 268.75% -
447.dealII (avg) (percentage) -78.66% 5.670 1.210 - 39.08% -
435.gromacs (max) -76.36% 4103.000 970.000 - 227.70% -
433.milc (max) -75.82% 1034.000 250.000 - 157.73% -
401.bzip2 (max) -75.78% 2461.000 596.000 - 789.55% -
464.h264ref (max) -75.40% 3618.000 890.000 - 1408.47% -
410.bwaves (max) -74.75% 3580.000 904.000 - 247.69% -
434.zeusmp (avg) (percentage) -74.19% 5.850 1.510 - 23.77% -
454.calculix (avg) (percentage) -73.18% 7.160 1.920 - -5.42% -
453.povray (avg) (percentage) -71.37% 7.300 2.090 - 36.60% -
471.omnetpp (avg) (percentage) -71.30% 7.700 2.210 - 87.29% -
435.gromacs (avg) (percentage) -71.03% 5.350 1.550 - 63.16% -
482.sphinx3 (avg) (percentage) -69.93% 7.250 2.180 - -7.23% -
456.hmmer -69.79% 192.000 58.000 - 3.57% -
456.hmmer (avg) -69.79% 192.000 58.000 - 3.57% -
459.GemsFDTD (avg) (percentage) -69.19% 5.810 1.790 - 28.78% -
458.sjeng -69.18% 292.000 90.000 - 150.00% -
458.sjeng (avg) -69.18% 292.000 90.000 - 150.00% -
465.tonto (unexplained diff vs previous) (percentage) -68.66% 1.340 0.420 - -62.83% -
465.tonto (unexplained diff vs previous) -67.63% 173.000 56.000 - -62.16% -
470.lbm (max) -64.79% 2871.000 1011.000 - 13.21% -
473.astar -64.32% 199.000 71.000 - 39.22% -
473.astar (avg) -64.32% 199.000 71.000 - 39.22% -
481.wrf (avg) (percentage) -60.96% 6.660 2.600 - 1.17% -
436.cactusADM (avg) (percentage) -59.89% 6.980 2.800 - 16.67% -
464.h264ref -59.40% 298.000 121.000 - 105.08% -
464.h264ref (avg) -59.40% 298.000 121.000 - 105.08% -
444.namd (avg) (percentage) -56.98% 7.740 3.330 - 28.08% -
416.gamess (avg) (percentage) -55.68% 4.400 1.950 - 18.18% -
436.cactusADM (max) -50.37% 2315.000 1149.000 - -6.66% -
410.bwaves (avg) (percentage) -50.20% 5.040 2.510 - 28.06% -
470.lbm (avg) (percentage) -46.94% 7.180 3.810 - 2.14% -
437.leslie3d (avg) (percentage) -43.69% 3.090 1.740 - 4.19% -
435.gromacs -42.72% 412.000 236.000 - 47.50% -
435.gromacs (avg) -42.72% 412.000 236.000 - 47.50% -
403.gcc (avg) (percentage) -39.36% 0.940 0.570 - 32.56% -
400.perlbench -36.47% 85.000 54.000 - 25.58% -
400.perlbench (avg) -36.47% 85.000 54.000 - 25.58% -
401.bzip2 -36.42% 173.000 110.000 - 144.44% -
401.bzip2 (avg) -36.42% 173.000 110.000 - 144.44% -
471.omnetpp (max) -24.76% 1951.000 1468.000 - 753.49% -
450.soplex (max) -21.43% 574.000 451.000 - 553.62% -
437.leslie3d -17.29% 376.000 311.000 - 3.32% -
437.leslie3d (avg) -17.29% 376.000 311.000 - 3.32% -
416.gamess -16.77% 650.000 541.000 - 11.55% -
416.gamess (avg) -16.77% 650.000 541.000 - 11.55% -
453.povray (max) -16.70% 515.000 429.000 - 124.61% -
465.tonto (avg) (percentage) -14.81% 1.620 1.380 - 21.05% -
465.tonto -12.44% 209.000 183.000 - 23.65% -
465.tonto (avg) -12.44% 209.000 183.000 - 23.65% -
403.gcc (max) (percentage) -12.08% 2.070 1.820 - 208.47% -
483.xalancbmk (avg) (percentage) -7.89% 1.140 1.050 - 87.50% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 3.57% 28.000 29.000 - 0.00% -
nb_execution_successful 3.57% 28.000 29.000 - 0.00% -
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.07% 11727.000 14550.000 - 1471.27% -
471.omnetpp 21.79% 9265.000 11284.000 - 299.43% -
453.povray 10.40% 7395.000 8164.000 - 1370.99% -
483.xalancbmk 8.18% 8027.000 8684.000 - 0.00% -
458.sjeng 5.04% 16018.000 16825.000 - 118.73% -
470.lbm 4.89% 16312.000 17110.000 - 359.58% -
462.libquantum 4.38% 17005.000 17749.000 - 10788.96% -
473.astar 3.24% 12983.000 13404.000 - 175.75% -
465.tonto 1.86% 13044.000 13287.000 - 2.77% -
447.dealII 1.46% 9101.000 9234.000 - 390.39% -
481.wrf 1.11% 21991.000 22236.000 - 254.13% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
464.h264ref (max) (percentage) 1546.15% 0.390 6.420 - -88.97% -
458.sjeng (max) 1433.33% 48.000 736.000 - -81.48% -
464.h264ref (max) 1408.47% 59.000 890.000 - -75.40% -
458.sjeng (max) (percentage) 1360.00% 0.300 4.380 - -91.52% -
401.bzip2 (max) (percentage) 827.50% 0.400 3.710 - -95.46% -
401.bzip2 (max) 789.55% 67.000 596.000 - -75.78% -
471.omnetpp (max) 753.49% 172.000 1468.000 - -24.76% -
471.omnetpp (max) (percentage) 599.46% 1.860 13.010 - -81.17% -
450.soplex (max) (percentage) 570.45% 0.440 2.950 - -96.93% -
450.soplex (max) 553.62% 69.000 451.000 - -21.43% -
429.mcf (unexplained diff vs previous) 460.00% 10.000 56.000 - -99.48% -
483.xalancbmk (max) 410.96% 73.000 373.000 - 0.00% -
483.xalancbmk (max) (percentage) 367.39% 0.920 4.300 - 76.95% -
429.mcf 358.93% 56.000 257.000 - 229.49% -
429.mcf (avg) 358.93% 56.000 257.000 - 229.49% -
429.mcf (unexplained diff vs previous) (percentage) 322.22% 0.090 0.380 - -99.97% -
410.bwaves (unexplained diff vs previous) (percentage) 293.10% 1.740 6.840 - -95.45% -
473.astar (max) 290.16% 61.000 238.000 - -92.00% -
473.astar (max) (percentage) 278.72% 0.470 1.780 - -97.09% -
410.bwaves (unexplained diff vs previous) 276.26% 257.000 967.000 - -89.21% -
401.bzip2 (unexplained diff vs previous) (percentage) 270.73% 0.410 1.520 - -99.66% -
429.mcf (avg) (percentage) 268.75% 0.480 1.770 - -79.23% -
435.gromacs (max) (percentage) 261.93% 1.760 6.370 - -88.03% -
410.bwaves (max) (percentage) 261.58% 1.770 6.400 - -89.35% -
401.bzip2 (unexplained diff vs previous) 255.07% 69.000 245.000 - -98.18% -
410.bwaves (max) 247.69% 260.000 904.000 - -74.75% -
435.gromacs (max) 227.70% 296.000 970.000 - -76.36% -
403.gcc (max) (percentage) 208.47% 0.590 1.820 - -12.08% -
403.gcc (max) 200.00% 52.000 156.000 - 15500.00% -
433.milc (max) (percentage) 169.01% 0.710 1.910 - -97.92% -
433.milc (unexplained diff vs previous) (percentage) 167.14% 0.700 1.870 - -99.83% -
400.perlbench (unexplained diff vs previous) (percentage) 161.29% 0.310 0.810 - -99.87% -
400.perlbench (unexplained diff vs previous) 160.00% 35.000 91.000 - -99.10% -
433.milc (max) 157.73% 97.000 250.000 - -75.82% -
433.milc (unexplained diff vs previous) 156.25% 96.000 246.000 - -98.04% -
401.bzip2 (avg) (percentage) 155.56% 0.270 0.690 - -88.04% -
465.tonto (max) 151.12% 223.000 560.000 - 52.59% -
458.sjeng 150.00% 36.000 90.000 - -69.18% -
458.sjeng (avg) 150.00% 36.000 90.000 - -69.18% -
465.tonto (max) (percentage) 146.78% 1.710 4.220 - 48.59% -
437.leslie3d (unexplained diff vs previous) (percentage) 144.66% 1.030 2.520 - -94.84% -
401.bzip2 144.44% 45.000 110.000 - -36.42% -
401.bzip2 (avg) 144.44% 45.000 110.000 - -36.42% -
437.leslie3d (unexplained diff vs previous) 141.18% 187.000 451.000 - -92.42% -
458.sjeng (avg) (percentage) 134.78% 0.230 0.540 - -85.79% -
471.omnetpp 128.44% 109.000 249.000 - 14.75% -
471.omnetpp (avg) 128.44% 109.000 249.000 - 14.75% -
464.h264ref (avg) (percentage) 125.64% 0.390 0.880 - -81.67% -
462.libquantum 125.00% 32.000 72.000 - 700.00% -
462.libquantum (avg) 125.00% 32.000 72.000 - 700.00% -
453.povray (max) 124.61% 191.000 429.000 - -16.70% -
462.libquantum (avg) (percentage) 115.79% 0.190 0.410 - -92.98% -
447.dealII (unexplained diff vs previous) 114.71% 68.000 146.000 - -98.09% -
447.dealII (unexplained diff vs previous) (percentage) 110.67% 0.750 1.580 - -99.61% -
483.xalancbmk 106.82% 44.000 91.000 - 0.00% -
483.xalancbmk (avg) 106.82% 44.000 91.000 - 0.00% -
464.h264ref 105.08% 59.000 121.000 - -59.40% -
464.h264ref (avg) 105.08% 59.000 121.000 - -59.40% -
453.povray (max) (percentage) 103.09% 2.590 5.260 - -94.34% -
445.gobmk (unexplained diff vs previous) 100.00% 18.000 36.000 - -99.47% -
450.soplex (avg) (percentage) 100.00% 0.240 0.480 - -91.71% -
450.soplex 97.30% 37.000 73.000 - 114.71% -
450.soplex (avg) 97.30% 37.000 73.000 - 114.71% -
445.gobmk (unexplained diff vs previous) (percentage) 93.33% 0.150 0.290 - -99.79% -
483.xalancbmk (avg) (percentage) 87.50% 0.560 1.050 - -7.89% -
471.omnetpp (avg) (percentage) 87.29% 1.180 2.210 - -71.30% -
459.GemsFDTD (max) (percentage) 77.19% 2.280 4.040 - -94.38% -
459.GemsFDTD (max) 71.28% 578.000 990.000 - -80.80% -
456.hmmer (max) (percentage) 67.31% 0.520 0.870 - -98.87% -
456.hmmer (max) 66.33% 98.000 163.000 - -95.25% -
450.soplex (unexplained diff vs previous) (percentage) 63.64% 0.440 0.720 - -99.97% -
435.gromacs (avg) (percentage) 63.16% 0.950 1.550 - -71.03% -
450.soplex (unexplained diff vs previous) 59.42% 69.000 110.000 - -99.28% -
447.dealII (max) 54.00% 150.000 231.000 - -84.70% -
447.dealII (max) (percentage) 52.12% 1.650 2.510 - -96.87% -
453.povray 50.44% 113.000 170.000 - 325.00% -
453.povray (avg) 50.44% 113.000 170.000 - 325.00% -
429.mcf (max) 48.65% 37.000 55.000 - -93.54% -
435.gromacs 47.50% 160.000 236.000 - -42.72% -
435.gromacs (avg) 47.50% 160.000 236.000 - -42.72% -
462.libquantum (max) 46.15% 13.000 19.000 - -88.20% -
447.dealII 40.51% 79.000 111.000 - 4.72% -
447.dealII (avg) 40.51% 79.000 111.000 - 4.72% -
473.astar 39.22% 51.000 71.000 - -64.32% -
473.astar (avg) 39.22% 51.000 71.000 - -64.32% -
433.milc (avg) (percentage) 39.13% 0.690 0.960 - -83.16% -
447.dealII (avg) (percentage) 39.08% 0.870 1.210 - -78.66% -
462.libquantum (max) (percentage) 37.50% 0.080 0.110 - -99.89% -
453.povray (avg) (percentage) 36.60% 1.530 2.090 - -71.37% -
454.calculix (max) (percentage) 34.52% 0.840 1.130 - -98.87% -
433.milc 34.04% 94.000 126.000 - 96.88% -
433.milc (avg) 34.04% 94.000 126.000 - 96.88% -
454.calculix (max) 33.46% 272.000 363.000 - 476.19% -
403.gcc (avg) (percentage) 32.56% 0.430 0.570 - -39.36% -
473.astar (avg) (percentage) 32.50% 0.400 0.530 - -87.10% -
403.gcc 28.95% 38.000 49.000 - 0.00% -
403.gcc (avg) 28.95% 38.000 49.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 28.78% 1.390 1.790 - -69.19% -
444.namd (avg) (percentage) 28.08% 2.600 3.330 - -56.98% -
410.bwaves (avg) (percentage) 28.06% 1.960 2.510 - -50.20% -
435.gromacs (unexplained diff vs previous) (percentage) 27.75% 1.730 2.210 - -98.06% -
400.perlbench 25.58% 43.000 54.000 - -36.47% -
400.perlbench (avg) 25.58% 43.000 54.000 - -36.47% -
444.namd 24.88% 414.000 517.000 - 649.28% -
444.namd (avg) 24.88% 414.000 517.000 - 649.28% -
459.GemsFDTD 24.72% 352.000 439.000 - 5.53% -
459.GemsFDTD (avg) 24.72% 352.000 439.000 - 5.53% -
434.zeusmp 24.31% 255.000 317.000 - 100.63% -
434.zeusmp (avg) 24.31% 255.000 317.000 - 100.63% -
437.leslie3d (max) (percentage) 23.87% 3.100 3.840 - -88.30% -
434.zeusmp (avg) (percentage) 23.77% 1.220 1.510 - -74.19% -
465.tonto 23.65% 148.000 183.000 - -12.44% -
465.tonto (avg) 23.65% 148.000 183.000 - -12.44% -
400.perlbench (avg) (percentage) 23.08% 0.390 0.480 - -91.06% -
437.leslie3d (max) 22.50% 560.000 686.000 - -82.82% -
410.bwaves 22.49% 289.000 354.000 - 18.00% -
410.bwaves (avg) 22.49% 289.000 354.000 - 18.00% -
465.tonto (avg) (percentage) 21.05% 1.140 1.380 - -14.81% -
429.mcf (max) (percentage) 18.75% 0.320 0.380 - -99.59% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 18.70% 2.300 2.730 - -98.93% -
416.gamess (avg) (percentage) 18.18% 1.650 1.950 - -55.68% -
436.cactusADM (avg) (percentage) 16.67% 2.400 2.800 - -59.89% -
483.xalancbmk (unexplained diff vs previous) 16.33% 49.000 57.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) 16.00% 0.750 0.870 - -100.00% -
444.namd (max) (percentage) 15.79% 5.510 6.380 - -93.23% -
435.gromacs (unexplained diff vs previous) 15.41% 292.000 337.000 - -96.16% -
454.calculix (unexplained diff vs previous) 15.16% 244.000 281.000 - -99.13% -
459.GemsFDTD (unexplained diff vs previous) 14.73% 584.000 670.000 - -96.35% -
436.cactusADM 13.50% 585.000 664.000 - 268.89% -
436.cactusADM (avg) 13.50% 585.000 664.000 - 268.89% -
470.lbm (max) 13.21% 893.000 1011.000 - -64.79% -
444.namd (max) 12.74% 879.000 991.000 - 17.00% -
458.sjeng (unexplained diff vs previous) 12.50% 48.000 54.000 - -99.34% -
416.gamess 11.55% 485.000 541.000 - -16.77% -
416.gamess (avg) 11.55% 485.000 541.000 - -16.77% -
445.gobmk (avg) (percentage) 9.09% 0.220 0.240 - -94.07% -
453.povray (unexplained diff vs previous) 8.88% 169.000 184.000 - -97.48% -
483.xalancbmk (unexplained diff vs previous) (percentage) 8.20% 0.610 0.660 - 0.00% -
470.lbm (max) (percentage) 7.85% 5.480 5.910 - -92.34% -
445.gobmk 7.41% 27.000 29.000 - -85.78% -
445.gobmk (avg) 7.41% 27.000 29.000 - -85.78% -
445.gobmk (max) (percentage) 7.41% 0.270 0.290 - -99.50% -
470.lbm 7.07% 608.000 651.000 - 143.82% -
470.lbm (avg) 7.07% 608.000 651.000 - 143.82% -
458.sjeng (unexplained diff vs previous) (percentage) 6.67% 0.300 0.320 - -99.70% -
434.zeusmp (unexplained diff vs previous) 6.17% 470.000 499.000 - -97.23% -
445.gobmk (max) 6.06% 33.000 35.000 - -98.80% -
436.cactusADM (unexplained diff vs previous) (percentage) 5.82% 4.810 5.090 - -99.40% -
434.zeusmp (unexplained diff vs previous) (percentage) 5.33% 2.250 2.370 - -99.64% -
437.leslie3d (avg) (percentage) 4.19% 1.670 1.740 - -43.69% -
456.hmmer 3.57% 56.000 58.000 - -69.79% -
456.hmmer (avg) 3.57% 56.000 58.000 - -69.79% -
400.perlbench (max) 3.37% 89.000 92.000 - -93.30% -
456.hmmer (avg) (percentage) 3.33% 0.300 0.310 - -92.82% -
437.leslie3d 3.32% 301.000 311.000 - -17.29% -
437.leslie3d (avg) 3.32% 301.000 311.000 - -17.29% -
436.cactusADM (unexplained diff vs previous) 2.98% 1173.000 1208.000 - -94.47% -
400.perlbench (max) (percentage) 2.50% 0.800 0.820 - -99.05% -
481.wrf 2.30% 565.000 578.000 - 38.28% -
481.wrf (avg) 2.30% 565.000 578.000 - 38.28% -
470.lbm (avg) (percentage) 2.14% 3.730 3.810 - -46.94% -
434.zeusmp (max) 1.66% 481.000 489.000 - -79.24% -
434.zeusmp (max) (percentage) 1.30% 2.300 2.330 - -97.32% -
481.wrf (avg) (percentage) 1.17% 2.570 2.600 - -60.96% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
435.gromacs -9.57% 16853.000 15240.000 - 97.59% -
464.h264ref -8.84% 15208.000 13863.000 - 123.02% -
482.sphinx3 -7.26% 36586.000 33930.000 - 3560.19% -
416.gamess -5.56% 29409.000 27774.000 - 87.83% -
401.bzip2 -5.23% 16971.000 16084.000 - 434.00% -
410.bwaves -4.10% 14745.000 14140.000 - 137.21% -
433.milc -3.94% 13668.000 13129.000 - 1063.92% -
459.GemsFDTD -3.30% 25364.000 24526.000 - 242.02% -
403.gcc -2.97% 8890.000 8626.000 - 15583.64% -
450.soplex -2.65% 15709.000 15292.000 - 2461.47% -
436.cactusADM -2.65% 24396.000 23749.000 - 816.95% -
444.namd -2.63% 15957.000 15538.000 - 1628.36% -
456.hmmer -1.30% 18995.000 18748.000 - 320.26% -
454.calculix -1.01% 32491.000 32162.000 - 50153.12% -
437.leslie3d -1.01% 18070.000 17888.000 - 46.91% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) (percentage) -99.80% 5.040 0.010 - -100.00% -
470.lbm (unexplained diff vs previous) -99.76% 822.000 2.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) -95.80% 1118.000 47.000 - -99.87% -
482.sphinx3 (unexplained diff vs previous) (percentage) -95.42% 3.060 0.140 - -100.00% -
481.wrf (unexplained diff vs previous) (percentage) -92.38% 4.070 0.310 - -99.88% -
481.wrf (unexplained diff vs previous) -92.28% 894.000 69.000 - -99.56% -
403.gcc (unexplained diff vs previous) -90.38% 52.000 5.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -89.66% 0.580 0.060 - 0.00% -
456.hmmer (unexplained diff vs previous) -79.59% 98.000 20.000 - -99.87% -
456.hmmer (unexplained diff vs previous) (percentage) -78.85% 0.520 0.110 - -99.97% -
473.astar (unexplained diff vs previous) (percentage) -65.96% 0.470 0.160 - -99.90% -
471.omnetpp (unexplained diff vs previous) (percentage) -65.67% 0.670 0.230 - -99.90% -
473.astar (unexplained diff vs previous) -63.93% 61.000 22.000 - -99.71% -
465.tonto (unexplained diff vs previous) (percentage) -62.83% 1.130 0.420 - -68.66% -
465.tonto (unexplained diff vs previous) -62.16% 148.000 56.000 - -67.63% -
471.omnetpp (unexplained diff vs previous) -58.06% 62.000 26.000 - -99.59% -
462.libquantum (unexplained diff vs previous) (percentage) -25.00% 0.080 0.060 - -100.00% -
464.h264ref (unexplained diff vs previous) -22.41% 58.000 45.000 - -99.48% -
462.libquantum (unexplained diff vs previous) -21.43% 14.000 11.000 - -99.93% -
482.sphinx3 (max) -20.83% 1152.000 912.000 - 1.00% -
481.wrf (max) (percentage) -19.23% 4.160 3.360 - -95.29% -
481.wrf (max) -18.27% 914.000 747.000 - -83.33% -
464.h264ref (unexplained diff vs previous) (percentage) -15.79% 0.380 0.320 - -99.77% -
482.sphinx3 (max) (percentage) -14.60% 3.150 2.690 - -97.24% -
482.sphinx3 -13.97% 859.000 739.000 - 1002.99% -
482.sphinx3 (avg) -13.97% 859.000 739.000 - 1002.99% -
416.gamess (max) -10.40% 923.000 827.000 - -88.60% -
482.sphinx3 (avg) (percentage) -7.23% 2.350 2.180 - -69.93% -
436.cactusADM (max) -6.66% 1231.000 1149.000 - -50.37% -
454.calculix -6.37% 659.000 617.000 - 15325.00% -
454.calculix (avg) -6.37% 659.000 617.000 - 15325.00% -
454.calculix (avg) (percentage) -5.42% 2.030 1.920 - -73.18% -
416.gamess (max) (percentage) -5.10% 3.140 2.980 - -93.93% -
416.gamess (unexplained diff vs previous) -4.69% 896.000 854.000 - -94.00% -
436.cactusADM (max) (percentage) -4.16% 5.050 4.840 - -94.59% -
444.namd (unexplained diff vs previous) -4.08% 834.000 800.000 - -94.62% -
453.povray (unexplained diff vs previous) (percentage) -1.75% 2.290 2.250 - -99.83% -
444.namd (unexplained diff vs previous) (percentage) -1.53% 5.230 5.150 - -99.69% -

Report Time: 0.56s
Execution (seconds)
Name Current %
400.perlbench 11252.000 607.67%
401.bzip2 16084.000 434.00%
403.gcc 8626.000 15583.64%
410.bwaves 14140.000 137.21%
416.gamess 27774.000 87.83%
429.mcf 14550.000 1471.27%
433.milc 13129.000 1063.92%
434.zeusmp 21018.000 675.86%
435.gromacs 15240.000 97.59%
436.cactusADM 23749.000 816.95%
437.leslie3d 17888.000 46.91%
444.namd 15538.000 1628.36%
445.gobmk 12369.000 144.88%
447.dealII 9234.000 390.39%
450.soplex 15292.000 2461.47%
453.povray 8164.000 1370.99%
454.calculix 32162.000 50153.12%
456.hmmer 18748.000 320.26%
458.sjeng 16825.000 118.73%
459.GemsFDTD 24526.000 242.02%
462.libquantum 17749.000 10788.96%
464.h264ref 13863.000 123.02%
465.tonto 13287.000 2.77%
470.lbm 17110.000 359.58%
471.omnetpp 11284.000 299.43%
473.astar 13404.000 175.75%
481.wrf 22236.000 254.13%
482.sphinx3 33930.000 3560.19%
483.xalancbmk 8684.000 -
Geometric Mean 15708.032 622.50%
Code Size (bytes)
Name Current %
400.perlbench 563471.000 -
401.bzip2 33660.000 -
403.gcc 1589843.000 -
410.bwaves 14722.000 -
416.gamess 4554464.000 -
429.mcf 7717.000 -
433.milc 47493.000 -
434.zeusmp 141060.000 -
435.gromacs 393982.000 -
436.cactusADM 256968.000 -
437.leslie3d 48001.000 -
444.namd 162769.000 -
445.gobmk 1088192.000 -
447.dealII 191120.000 -
450.soplex 135592.000 -
453.povray 488965.000 -
454.calculix 682304.000 -
456.hmmer 74969.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195766.000 -
462.libquantum 13066.000 -
464.h264ref 301358.000 -
465.tonto 1436045.000 -
470.lbm 10845.000 -
471.omnetpp 295640.000 -
473.astar 15549.000 -
481.wrf 1539717.000 -
482.sphinx3 80058.000 -
483.xalancbmk 1462834.000 -
Geometric Mean 169866.850 7.99%
Score
Name Current %
nb_compile_successful 29.000 3.57%
nb_execution_successful 29.000 3.57%
nb_total_tests 29.000 3.57%
Geometric Mean 29.000 3.57%
sample variability
Name Current %
400.perlbench 54.000 -36.47%
400.perlbench (avg) 54.000 -36.47%
400.perlbench (avg) (percentage) 0.480 -91.06%
400.perlbench (max) 92.000 -93.30%
400.perlbench (max) (percentage) 0.820 -99.05%
400.perlbench (unexplained diff vs previous) 91.000 -99.10%
400.perlbench (unexplained diff vs previous) (percentage) 0.810 -99.87%
401.bzip2 110.000 -36.42%
401.bzip2 (avg) 110.000 -36.42%
401.bzip2 (avg) (percentage) 0.690 -88.04%
401.bzip2 (max) 596.000 -75.78%
401.bzip2 (max) (percentage) 3.710 -95.46%
401.bzip2 (unexplained diff vs previous) 245.000 -98.18%
401.bzip2 (unexplained diff vs previous) (percentage) 1.520 -99.66%
403.gcc 49.000 -
403.gcc (avg) 49.000 -
403.gcc (avg) (percentage) 0.570 -39.36%
403.gcc (max) 156.000 15500.00%
403.gcc (max) (percentage) 1.820 -12.08%
403.gcc (unexplained diff vs previous) 5.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.060 -
410.bwaves 354.000 18.00%
410.bwaves (avg) 354.000 18.00%
410.bwaves (avg) (percentage) 2.510 -50.20%
410.bwaves (max) 904.000 -74.75%
410.bwaves (max) (percentage) 6.400 -89.35%
410.bwaves (unexplained diff vs previous) 967.000 -89.21%
410.bwaves (unexplained diff vs previous) (percentage) 6.840 -95.45%
416.gamess 541.000 -16.77%
416.gamess (avg) 541.000 -16.77%
416.gamess (avg) (percentage) 1.950 -55.68%
416.gamess (max) 827.000 -88.60%
416.gamess (max) (percentage) 2.980 -93.93%
416.gamess (unexplained diff vs previous) 854.000 -94.00%
416.gamess (unexplained diff vs previous) (percentage) 3.070 -96.81%
429.mcf 257.000 229.49%
429.mcf (avg) 257.000 229.49%
429.mcf (avg) (percentage) 1.770 -79.23%
429.mcf (max) 55.000 -93.54%
429.mcf (max) (percentage) 0.380 -99.59%
429.mcf (unexplained diff vs previous) 56.000 -99.48%
429.mcf (unexplained diff vs previous) (percentage) 0.380 -99.97%
433.milc 126.000 96.88%
433.milc (avg) 126.000 96.88%
433.milc (avg) (percentage) 0.960 -83.16%
433.milc (max) 250.000 -75.82%
433.milc (max) (percentage) 1.910 -97.92%
433.milc (unexplained diff vs previous) 246.000 -98.04%
433.milc (unexplained diff vs previous) (percentage) 1.870 -99.83%
434.zeusmp 317.000 100.63%
434.zeusmp (avg) 317.000 100.63%
434.zeusmp (avg) (percentage) 1.510 -74.19%
434.zeusmp (max) 489.000 -79.24%
434.zeusmp (max) (percentage) 2.330 -97.32%
434.zeusmp (unexplained diff vs previous) 499.000 -97.23%
434.zeusmp (unexplained diff vs previous) (percentage) 2.370 -99.64%
435.gromacs 236.000 -42.72%
435.gromacs (avg) 236.000 -42.72%
435.gromacs (avg) (percentage) 1.550 -71.03%
435.gromacs (max) 970.000 -76.36%
435.gromacs (max) (percentage) 6.370 -88.03%
435.gromacs (unexplained diff vs previous) 337.000 -96.16%
435.gromacs (unexplained diff vs previous) (percentage) 2.210 -98.06%
436.cactusADM 664.000 268.89%
436.cactusADM (avg) 664.000 268.89%
436.cactusADM (avg) (percentage) 2.800 -59.89%
436.cactusADM (max) 1149.000 -50.37%
436.cactusADM (max) (percentage) 4.840 -94.59%
436.cactusADM (unexplained diff vs previous) 1208.000 -94.47%
436.cactusADM (unexplained diff vs previous) (percentage) 5.090 -99.40%
437.leslie3d 311.000 -17.29%
437.leslie3d (avg) 311.000 -17.29%
437.leslie3d (avg) (percentage) 1.740 -43.69%
437.leslie3d (max) 686.000 -82.82%
437.leslie3d (max) (percentage) 3.840 -88.30%
437.leslie3d (unexplained diff vs previous) 451.000 -92.42%
437.leslie3d (unexplained diff vs previous) (percentage) 2.520 -94.84%
444.namd 517.000 649.28%
444.namd (avg) 517.000 649.28%
444.namd (avg) (percentage) 3.330 -56.98%
444.namd (max) 991.000 17.00%
444.namd (max) (percentage) 6.380 -93.23%
444.namd (unexplained diff vs previous) 800.000 -94.62%
444.namd (unexplained diff vs previous) (percentage) 5.150 -99.69%
445.gobmk 29.000 -85.78%
445.gobmk (avg) 29.000 -85.78%
445.gobmk (avg) (percentage) 0.240 -94.07%
445.gobmk (max) 35.000 -98.80%
445.gobmk (max) (percentage) 0.290 -99.50%
445.gobmk (unexplained diff vs previous) 36.000 -99.47%
445.gobmk (unexplained diff vs previous) (percentage) 0.290 -99.79%
447.dealII 111.000 4.72%
447.dealII (avg) 111.000 4.72%
447.dealII (avg) (percentage) 1.210 -78.66%
447.dealII (max) 231.000 -84.70%
447.dealII (max) (percentage) 2.510 -96.87%
447.dealII (unexplained diff vs previous) 146.000 -98.09%
447.dealII (unexplained diff vs previous) (percentage) 1.580 -99.61%
450.soplex 73.000 114.71%
450.soplex (avg) 73.000 114.71%
450.soplex (avg) (percentage) 0.480 -91.71%
450.soplex (max) 451.000 -21.43%
450.soplex (max) (percentage) 2.950 -96.93%
450.soplex (unexplained diff vs previous) 110.000 -99.28%
450.soplex (unexplained diff vs previous) (percentage) 0.720 -99.97%
453.povray 170.000 325.00%
453.povray (avg) 170.000 325.00%
453.povray (avg) (percentage) 2.090 -71.37%
453.povray (max) 429.000 -16.70%
453.povray (max) (percentage) 5.260 -94.34%
453.povray (unexplained diff vs previous) 184.000 -97.48%
453.povray (unexplained diff vs previous) (percentage) 2.250 -99.83%
454.calculix 617.000 15325.00%
454.calculix (avg) 617.000 15325.00%
454.calculix (avg) (percentage) 1.920 -73.18%
454.calculix (max) 363.000 476.19%
454.calculix (max) (percentage) 1.130 -98.87%
454.calculix (unexplained diff vs previous) 281.000 -99.13%
454.calculix (unexplained diff vs previous) (percentage) 0.870 -100.00%
456.hmmer 58.000 -69.79%
456.hmmer (avg) 58.000 -69.79%
456.hmmer (avg) (percentage) 0.310 -92.82%
456.hmmer (max) 163.000 -95.25%
456.hmmer (max) (percentage) 0.870 -98.87%
456.hmmer (unexplained diff vs previous) 20.000 -99.87%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -99.97%
458.sjeng 90.000 -69.18%
458.sjeng (avg) 90.000 -69.18%
458.sjeng (avg) (percentage) 0.540 -85.79%
458.sjeng (max) 736.000 -81.48%
458.sjeng (max) (percentage) 4.380 -91.52%
458.sjeng (unexplained diff vs previous) 54.000 -99.34%
458.sjeng (unexplained diff vs previous) (percentage) 0.320 -99.70%
459.GemsFDTD 439.000 5.53%
459.GemsFDTD (avg) 439.000 5.53%
459.GemsFDTD (avg) (percentage) 1.790 -69.19%
459.GemsFDTD (max) 990.000 -80.80%
459.GemsFDTD (max) (percentage) 4.040 -94.38%
459.GemsFDTD (unexplained diff vs previous) 670.000 -96.35%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.730 -98.93%
462.libquantum 72.000 700.00%
462.libquantum (avg) 72.000 700.00%
462.libquantum (avg) (percentage) 0.410 -92.98%
462.libquantum (max) 19.000 -88.20%
462.libquantum (max) (percentage) 0.110 -99.89%
462.libquantum (unexplained diff vs previous) 11.000 -99.93%
462.libquantum (unexplained diff vs previous) (percentage) 0.060 -100.00%
464.h264ref 121.000 -59.40%
464.h264ref (avg) 121.000 -59.40%
464.h264ref (avg) (percentage) 0.880 -81.67%
464.h264ref (max) 890.000 -75.40%
464.h264ref (max) (percentage) 6.420 -88.97%
464.h264ref (unexplained diff vs previous) 45.000 -99.48%
464.h264ref (unexplained diff vs previous) (percentage) 0.320 -99.77%
465.tonto 183.000 -12.44%
465.tonto (avg) 183.000 -12.44%
465.tonto (avg) (percentage) 1.380 -14.81%
465.tonto (max) 560.000 52.59%
465.tonto (max) (percentage) 4.220 48.59%
465.tonto (unexplained diff vs previous) 56.000 -67.63%
465.tonto (unexplained diff vs previous) (percentage) 0.420 -68.66%
470.lbm 651.000 143.82%
470.lbm (avg) 651.000 143.82%
470.lbm (avg) (percentage) 3.810 -46.94%
470.lbm (max) 1011.000 -64.79%
470.lbm (max) (percentage) 5.910 -92.34%
470.lbm (unexplained diff vs previous) 2.000 -99.98%
470.lbm (unexplained diff vs previous) (percentage) 0.010 -100.00%
471.omnetpp 249.000 14.75%
471.omnetpp (avg) 249.000 14.75%
471.omnetpp (avg) (percentage) 2.210 -71.30%
471.omnetpp (max) 1468.000 -24.76%
471.omnetpp (max) (percentage) 13.010 -81.17%
471.omnetpp (unexplained diff vs previous) 26.000 -99.59%
471.omnetpp (unexplained diff vs previous) (percentage) 0.230 -99.90%
473.astar 71.000 -64.32%
473.astar (avg) 71.000 -64.32%
473.astar (avg) (percentage) 0.530 -87.10%
473.astar (max) 238.000 -92.00%
473.astar (max) (percentage) 1.780 -97.09%
473.astar (unexplained diff vs previous) 22.000 -99.71%
473.astar (unexplained diff vs previous) (percentage) 0.160 -99.90%
481.wrf 578.000 38.28%
481.wrf (avg) 578.000 38.28%
481.wrf (avg) (percentage) 2.600 -60.96%
481.wrf (max) 747.000 -83.33%
481.wrf (max) (percentage) 3.360 -95.29%
481.wrf (unexplained diff vs previous) 69.000 -99.56%
481.wrf (unexplained diff vs previous) (percentage) 0.310 -99.88%
482.sphinx3 739.000 1002.99%
482.sphinx3 (avg) 739.000 1002.99%
482.sphinx3 (avg) (percentage) 2.180 -69.93%
482.sphinx3 (max) 912.000 -
482.sphinx3 (max) (percentage) 2.690 -97.24%
482.sphinx3 (unexplained diff vs previous) 47.000 -99.87%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.140 -100.00%
483.xalancbmk 91.000 -
483.xalancbmk (avg) 91.000 -
483.xalancbmk (avg) (percentage) 1.050 -7.89%
483.xalancbmk (max) 373.000 -
483.xalancbmk (max) (percentage) 4.300 76.95%
483.xalancbmk (unexplained diff vs previous) 57.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.660 -
Geometric Mean 22.104 -87.71%