Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=49c3ed081fed6b8e2b48fdc48f805f11e4589514 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7d37c7f67c1bb75f85ad0c07bfff51ca579e1476 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5652e12cce80825297c3e0666991deb10310343c (+ 7 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=ca898c727516c7e7261162b45f9d3a4d64f5283a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/300/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0300 (-00000-) 2022-09-14T04:46:56 0:00:00
Previous 0299 (3-changed-components) 2024-09-22T04:42:50 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 140 60
Performance Improvements 45 173
Added Tests 75 2
Unchanged Tests 976 1001
Total Tests 1236

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 8.43% 54786.000 59403.000 - -0.13% -
459.GemsFDTD 6.53% 232732.000 247940.000 - 1.31% -
434.zeusmp 4.93% 146667.000 153897.000 - 1.22% -
450.soplex 4.21% 202558.000 211092.000 - 2.93% -
435.gromacs 2.14% 489745.000 500203.000 - 0.19% -
464.h264ref 2.08% 379348.000 387228.000 - -0.13% -
410.bwaves 1.85% 16464.000 16768.000 - 0.05% -
470.lbm 1.72% 9547.000 9711.000 - 0.21% -
447.dealII 1.64% 307900.000 312944.000 - 0.43% -
471.omnetpp 1.49% 475384.000 482480.000 - 0.93% -
444.namd 1.36% 185768.000 188301.000 - -0.04% -
456.hmmer 1.30% 107239.000 108631.000 - -0.06% -
436.cactusADM 1.28% 348359.000 352831.000 - -0.02% -
453.povray 1.24% 653881.000 661959.000 - 0.09% -
433.milc 1.19% 60509.000 61230.000 - -0.25% -
401.bzip2 1.16% 43715.000 44221.000 - -0.03% -
400.perlbench 1.06% 887723.000 897104.000 - 0.36% -
482.sphinx3 1.04% 111671.000 112831.000 - -0.02% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8451.85% 135.000 11545.000 - 8146.43% -
482.sphinx3 3587.44% 836.000 30827.000 - 3162.12% -
450.soplex 2610.43% 585.000 15856.000 - 2696.47% -
453.povray 1108.82% 544.000 6576.000 - 1102.19% -
444.namd 1048.40% 783.000 8992.000 - 1103.75% -
433.milc 1025.71% 1155.000 13002.000 - 1029.63% -
429.mcf 807.67% 1904.000 17282.000 - 1113.62% -
436.cactusADM 733.79% 2122.000 17693.000 - 749.40% -
400.perlbench 625.40% 1508.000 10939.000 - 557.79% -
447.dealII 441.09% 1638.000 8863.000 - 414.10% -
434.zeusmp 433.25% 2535.000 13518.000 - 437.71% -
401.bzip2 395.86% 3019.000 14970.000 - 409.01% -
459.GemsFDTD 340.31% 5366.000 23627.000 - 282.75% -
456.hmmer 287.03% 2875.000 11127.000 - 286.09% -
471.omnetpp 283.82% 2781.000 10674.000 - 291.85% -
470.lbm 238.20% 3785.000 12801.000 - 237.94% -
473.astar 177.06% 5114.000 14169.000 - 176.31% -
410.bwaves 142.85% 5891.000 14306.000 - 153.11% -
464.h264ref 137.48% 5769.000 13700.000 - 137.81% -
445.gobmk 133.47% 4948.000 11552.000 - 129.98% -
435.gromacs 113.16% 7143.000 15226.000 - 109.46% -
458.sjeng 89.64% 7400.000 14033.000 - 85.45% -
437.leslie3d 25.92% 11259.000 14177.000 - 21.80% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) 27900.00% 6.000 1680.000 - 84.41% -
444.namd (max) 19266.67% 3.000 581.000 - -15.18% -
450.soplex (max) 10933.33% 6.000 662.000 - 21.47% -
462.libquantum 5800.00% 2.000 118.000 - 1080.00% -
462.libquantum (avg) 5800.00% 2.000 118.000 - 1080.00% -
434.zeusmp (max) 4583.33% 6.000 281.000 - -86.33% -
482.sphinx3 4313.33% 15.000 662.000 - 794.59% -
482.sphinx3 (avg) 4313.33% 15.000 662.000 - 794.59% -
444.namd 3622.22% 9.000 335.000 - 392.65% -
444.namd (avg) 3622.22% 9.000 335.000 - 392.65% -
456.hmmer (max) 2600.00% 2.000 54.000 - -97.45% -
433.milc (max) 2046.15% 13.000 279.000 - -73.28% -
436.cactusADM (max) 1815.79% 19.000 364.000 - -80.30% -
462.libquantum (max) 1675.00% 4.000 71.000 - -48.55% -
433.milc (unexplained diff vs previous) 1500.00% 5.000 80.000 - -99.29% -
470.lbm (max) 1454.17% 24.000 373.000 - -86.42% -
433.milc 1364.29% 14.000 205.000 - 197.10% -
433.milc (avg) 1364.29% 14.000 205.000 - 197.10% -
453.povray (max) 1222.22% 9.000 119.000 - -76.15% -
444.namd (max) (percentage) 1194.00% 0.500 6.470 - -92.95% -
453.povray 1050.00% 8.000 92.000 - 119.05% -
453.povray (avg) 1050.00% 8.000 92.000 - 119.05% -
436.cactusADM 958.33% 24.000 254.000 - 104.84% -
436.cactusADM (avg) 958.33% 24.000 254.000 - 104.84% -
450.soplex 950.00% 14.000 147.000 - 308.33% -
450.soplex (avg) 950.00% 14.000 147.000 - 308.33% -
447.dealII (max) 779.31% 29.000 255.000 - -81.58% -
459.GemsFDTD (max) 762.96% 27.000 233.000 - -94.72% -
470.lbm 724.24% 33.000 272.000 - 13.81% -
470.lbm (avg) 724.24% 33.000 272.000 - 13.81% -
434.zeusmp 700.00% 25.000 200.000 - 36.05% -
434.zeusmp (avg) 700.00% 25.000 200.000 - 36.05% -
434.zeusmp (max) (percentage) 700.00% 0.260 2.080 - -97.46% -
410.bwaves (max) 663.83% 47.000 359.000 - -89.04% -
482.sphinx3 (max) (percentage) 617.11% 0.760 5.450 - -94.35% -
401.bzip2 (unexplained diff vs previous) 600.00% 5.000 35.000 - -99.68% -
416.gamess (max) (percentage) 560.53% 0.380 2.510 - -93.49% -
410.bwaves (unexplained diff vs previous) 545.00% 20.000 129.000 - -98.34% -
456.hmmer (max) (percentage) 444.44% 0.090 0.490 - -99.33% -
400.perlbench (max) 413.89% 36.000 185.000 - -86.76% -
470.lbm (max) (percentage) 342.42% 0.660 2.920 - -95.97% -
481.wrf (max) (percentage) 313.25% 0.830 3.430 - -95.01% -
435.gromacs (max) 309.20% 87.000 356.000 - -90.04% -
447.dealII 294.74% 19.000 75.000 - -24.24% -
447.dealII (avg) 294.74% 19.000 75.000 - -24.24% -
400.perlbench 280.00% 30.000 114.000 - 8.57% -
400.perlbench (avg) 280.00% 30.000 114.000 - 8.57% -
450.soplex (max) (percentage) 280.00% 1.100 4.180 - -95.66% -
459.GemsFDTD 269.44% 72.000 266.000 - -26.11% -
459.GemsFDTD (avg) 269.44% 72.000 266.000 - -26.11% -
445.gobmk (max) 262.50% 32.000 116.000 - -95.61% -
410.bwaves 259.26% 54.000 194.000 - -22.09% -
410.bwaves (avg) 259.26% 54.000 194.000 - -22.09% -
458.sjeng (max) 220.00% 10.000 32.000 - -99.11% -
410.bwaves (max) (percentage) 213.75% 0.800 2.510 - -95.67% -
456.hmmer 213.33% 15.000 47.000 - -62.99% -
456.hmmer (avg) 213.33% 15.000 47.000 - -62.99% -
444.namd (avg) (percentage) 200.81% 1.240 3.730 - -59.54% -
464.h264ref (max) 176.47% 51.000 141.000 - -95.49% -
465.tonto (max) (percentage) 167.14% 0.700 1.870 - -90.32% -
410.bwaves (unexplained diff vs previous) (percentage) 164.71% 0.340 0.900 - -99.35% -
471.omnetpp 146.67% 60.000 148.000 - -33.63% -
471.omnetpp (avg) 146.67% 60.000 148.000 - -33.63% -
470.lbm (avg) (percentage) 139.33% 0.890 2.130 - -66.35% -
436.cactusADM (max) (percentage) 119.15% 0.940 2.060 - -97.68% -
465.tonto (max) 112.99% 77.000 164.000 - -92.23% -
435.gromacs (max) (percentage) 91.80% 1.220 2.340 - -95.24% -
459.GemsFDTD (max) (percentage) 90.38% 0.520 0.990 - -98.61% -
433.milc (max) (percentage) 88.60% 1.140 2.150 - -97.63% -
401.bzip2 82.22% 45.000 82.000 - -49.07% -
401.bzip2 (avg) 82.22% 45.000 82.000 - -49.07% -
464.h264ref 74.42% 43.000 75.000 - -74.40% -
464.h264ref (avg) 74.42% 43.000 75.000 - -74.40% -
458.sjeng (max) (percentage) 64.29% 0.140 0.230 - -99.52% -
447.dealII (max) (percentage) 60.89% 1.790 2.880 - -96.41% -
445.gobmk (max) (percentage) 55.38% 0.650 1.010 - -98.08% -
429.mcf 52.13% 94.000 143.000 - 31.19% -
429.mcf (avg) 52.13% 94.000 143.000 - 31.19% -
434.zeusmp (avg) (percentage) 49.49% 0.990 1.480 - -74.70% -
410.bwaves (avg) (percentage) 47.83% 0.920 1.360 - -69.16% -
433.milc (unexplained diff vs previous) (percentage) 44.19% 0.430 0.620 - -99.94% -
471.omnetpp (unexplained diff vs previous) 44.00% 25.000 36.000 - -99.66% -
401.bzip2 (unexplained diff vs previous) (percentage) 35.29% 0.170 0.230 - -99.94% -
435.gromacs 35.20% 125.000 169.000 - -53.95% -
435.gromacs (avg) 35.20% 125.000 169.000 - -53.95% -
433.milc (avg) (percentage) 27.42% 1.240 1.580 - -73.88% -
436.cactusADM (avg) (percentage) 26.32% 1.140 1.440 - -75.92% -
429.mcf (max) 25.81% 31.000 39.000 - -97.05% -
454.calculix (max) (percentage) 21.69% 0.830 1.010 - -98.99% -
482.sphinx3 (avg) (percentage) 18.78% 1.810 2.150 - -72.89% -
464.h264ref (max) (percentage) 14.44% 0.900 1.030 - -98.10% -
445.gobmk 13.64% 44.000 50.000 - -74.49% -
445.gobmk (avg) 13.64% 44.000 50.000 - -74.49% -
471.omnetpp (max) 9.09% 33.000 36.000 - -98.34% -
416.gamess (avg) (percentage) 6.58% 0.760 0.810 - -81.67% -
453.povray (max) (percentage) 1.68% 1.790 1.820 - -98.01% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -57.35% 68.000 29.000 - 0.00% -
nb_compile_successful -39.58% 48.000 29.000 - 0.00% -
nb_execution_successful -39.58% 48.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.21% 106376.000 104028.000 - -0.02% -
465.tonto -1.57% 1976555.000 1945443.000 - -0.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -21.16% 11133.000 8777.000 - -19.78% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) (percentage) -96.04% 4.550 0.180 - -99.73% -
403.gcc (avg) (percentage) -93.91% 5.090 0.310 - -95.77% -
403.gcc (max) (percentage) -92.69% 3.830 0.280 - -99.72% -
483.xalancbmk (avg) (percentage) -90.88% 2.960 0.270 - -95.85% -
454.calculix (avg) (percentage) -90.00% 3.600 0.360 - -95.51% -
473.astar (max) -89.22% 232.000 25.000 - -99.27% -
429.mcf (max) (percentage) -86.23% 1.670 0.230 - -99.75% -
429.mcf (avg) (percentage) -83.23% 4.950 0.830 - -89.18% -
401.bzip2 (max) (percentage) -82.86% 1.400 0.240 - -99.69% -
462.libquantum (max) (percentage) -81.55% 3.360 0.620 - -99.37% -
483.xalancbmk (max) (percentage) -79.10% 1.770 0.370 - -99.46% -
473.astar (avg) (percentage) -72.56% 1.640 0.450 - -89.18% -
458.sjeng (avg) (percentage) -71.43% 0.630 0.180 - -94.36% -
471.omnetpp (max) (percentage) -71.43% 1.190 0.340 - -99.57% -
437.leslie3d (max) (percentage) -70.21% 14.300 4.260 - -74.31% -
401.bzip2 (avg) (percentage) -63.82% 1.520 0.550 - -89.96% -
450.soplex (avg) (percentage) -63.24% 2.530 0.930 - -85.54% -
437.leslie3d (max) -62.55% 1610.000 603.000 - -68.74% -
471.omnetpp (unexplained diff vs previous) (percentage) -62.22% 0.900 0.340 - -99.91% -
437.leslie3d (avg) (percentage) -58.37% 4.540 1.890 - -38.03% -
445.gobmk (avg) (percentage) -50.56% 0.890 0.440 - -88.75% -
465.tonto -49.26% 136.000 69.000 - -81.10% -
465.tonto (avg) -49.26% 136.000 69.000 - -81.10% -
400.perlbench (avg) (percentage) -48.53% 2.040 1.050 - -83.46% -
437.leslie3d -47.75% 511.000 267.000 - -24.79% -
437.leslie3d (avg) -47.75% 511.000 267.000 - -24.79% -
458.sjeng -45.65% 46.000 25.000 - -89.63% -
458.sjeng (avg) -45.65% 46.000 25.000 - -89.63% -
462.libquantum (avg) (percentage) -44.02% 1.840 1.030 - -86.55% -
435.gromacs (avg) (percentage) -36.93% 1.760 1.110 - -78.06% -
465.tonto (avg) (percentage) -35.77% 1.230 0.790 - -76.35% -
471.omnetpp (avg) (percentage) -35.65% 2.160 1.390 - -83.05% -
481.wrf (avg) (percentage) -32.22% 1.800 1.220 - -80.45% -
447.dealII (avg) (percentage) -30.33% 1.220 0.850 - -85.27% -
400.perlbench (max) (percentage) -29.46% 2.410 1.700 - -97.98% -
464.h264ref (avg) (percentage) -27.63% 0.760 0.550 - -89.19% -
473.astar -24.10% 83.000 63.000 - -70.42% -
473.astar (avg) -24.10% 83.000 63.000 - -70.42% -
456.hmmer (avg) (percentage) -20.37% 0.540 0.430 - -90.25% -
401.bzip2 (max) -16.67% 42.000 35.000 - -98.49% -
459.GemsFDTD (avg) (percentage) -16.30% 1.350 1.130 - -80.65% -
453.povray (avg) (percentage) -8.44% 1.540 1.410 - -81.95% -

Added Tests - Code Size
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - Execution
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (max)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix
454.calculix (avg)
454.calculix (max)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (max)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.93% 205081.000 211092.000 - 4.21% -
459.GemsFDTD 1.31% 244728.000 247940.000 - 6.53% -
434.zeusmp 1.22% 152037.000 153897.000 - 4.93% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 43943.55% 62.000 27307.000 - 0.00% -
403.gcc 16132.14% 56.000 9090.000 - 0.00% -
462.libquantum 8146.43% 140.000 11545.000 - 8451.85% -
482.sphinx3 3162.12% 945.000 30827.000 - 3587.44% -
450.soplex 2696.47% 567.000 15856.000 - 2610.43% -
429.mcf 1113.62% 1424.000 17282.000 - 807.67% -
444.namd 1103.75% 747.000 8992.000 - 1048.40% -
453.povray 1102.19% 547.000 6576.000 - 1108.82% -
433.milc 1029.63% 1151.000 13002.000 - 1025.71% -
436.cactusADM 749.40% 2083.000 17693.000 - 733.79% -
400.perlbench 557.79% 1663.000 10939.000 - 625.40% -
434.zeusmp 437.71% 2514.000 13518.000 - 433.25% -
447.dealII 414.10% 1724.000 8863.000 - 441.09% -
401.bzip2 409.01% 2941.000 14970.000 - 395.86% -
471.omnetpp 291.85% 2724.000 10674.000 - 283.82% -
456.hmmer 286.09% 2882.000 11127.000 - 287.03% -
459.GemsFDTD 282.75% 6173.000 23627.000 - 340.31% -
470.lbm 237.94% 3788.000 12801.000 - 238.20% -
481.wrf 204.50% 5534.000 16851.000 - 0.00% -
483.xalancbmk 202.38% 3818.000 11545.000 - 0.00% -
473.astar 176.31% 5128.000 14169.000 - 177.06% -
410.bwaves 153.11% 5652.000 14306.000 - 142.85% -
464.h264ref 137.81% 5761.000 13700.000 - 137.48% -
445.gobmk 129.98% 5023.000 11552.000 - 133.47% -
435.gromacs 109.46% 7269.000 15226.000 - 113.16% -
458.sjeng 85.45% 7567.000 14033.000 - 89.64% -
416.gamess 65.17% 12465.000 20588.000 - 0.00% -
437.leslie3d 21.80% 11640.000 14177.000 - 25.92% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 2350.00% 4.000 98.000 - 0.00% -
454.calculix (avg) 2350.00% 4.000 98.000 - 0.00% -
462.libquantum 1080.00% 10.000 118.000 - 5800.00% -
462.libquantum (avg) 1080.00% 10.000 118.000 - 5800.00% -
482.sphinx3 794.59% 74.000 662.000 - 4313.33% -
482.sphinx3 (avg) 794.59% 74.000 662.000 - 4313.33% -
403.gcc 600.00% 4.000 28.000 - 0.00% -
403.gcc (avg) 600.00% 4.000 28.000 - 0.00% -
444.namd 392.65% 68.000 335.000 - 3622.22% -
444.namd (avg) 392.65% 68.000 335.000 - 3622.22% -
454.calculix (max) 350.82% 61.000 275.000 - 0.00% -
450.soplex 308.33% 36.000 147.000 - 950.00% -
450.soplex (avg) 308.33% 36.000 147.000 - 950.00% -
433.milc 197.10% 69.000 205.000 - 1364.29% -
433.milc (avg) 197.10% 69.000 205.000 - 1364.29% -
453.povray 119.05% 42.000 92.000 - 1050.00% -
453.povray (avg) 119.05% 42.000 92.000 - 1050.00% -
436.cactusADM 104.84% 124.000 254.000 - 958.33% -
436.cactusADM (avg) 104.84% 124.000 254.000 - 958.33% -
482.sphinx3 (max) 84.41% 911.000 1680.000 - 27900.00% -
434.zeusmp 36.05% 147.000 200.000 - 700.00% -
434.zeusmp (avg) 36.05% 147.000 200.000 - 700.00% -
429.mcf 31.19% 109.000 143.000 - 52.13% -
429.mcf (avg) 31.19% 109.000 143.000 - 52.13% -
450.soplex (max) 21.47% 545.000 662.000 - 10933.33% -
470.lbm 13.81% 239.000 272.000 - 724.24% -
470.lbm (avg) 13.81% 239.000 272.000 - 724.24% -
400.perlbench 8.57% 105.000 114.000 - 280.00% -
400.perlbench (avg) 8.57% 105.000 114.000 - 280.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -19.78% 10941.000 8777.000 - -21.16% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 0.030 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.080 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -100.00% 15435.710 0.260 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -100.00% 2557.320 0.080 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -100.00% 1305.690 0.050 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.99% 787.130 0.060 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.98% 62.730 0.010 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.98% 278.630 0.050 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.98% 1043.330 0.210 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.240 - 0.00% -
416.gamess (unexplained diff vs previous) -99.96% 7819.000 3.000 - 0.00% -
454.calculix (unexplained diff vs previous) -99.96% 22953.000 9.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.96% 527.480 0.210 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.95% 219.170 0.100 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.320 - 0.00% -
429.mcf (unexplained diff vs previous) -99.95% 18593.000 9.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.94% 448.690 0.250 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.94% 407.020 0.240 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.94% 197.850 0.120 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.94% 16396.000 10.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.94% 368.340 0.230 - 35.29% -
433.milc (unexplained diff vs previous) (percentage) -99.94% 980.800 0.620 - 44.19% -
462.libquantum (unexplained diff vs previous) -99.93% 13518.000 9.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.93% 8030.000 6.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.91% 391.300 0.340 - -62.22% -
450.soplex (unexplained diff vs previous) -99.91% 14500.000 13.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -99.91% 96.680 0.090 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.90% 90.870 0.090 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.90% 250.410 0.260 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.89% 219.530 0.240 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.87% 118.780 0.150 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -99.87% 8368.000 11.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.86% 111.110 0.150 - 0.00% -
473.astar (unexplained diff vs previous) -99.83% 10146.000 17.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -99.82% 7028.000 13.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.81% 6876.000 13.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.75% 5707.000 14.000 - 0.00% -
429.mcf (max) (percentage) -99.75% 92.890 0.230 - -86.23% -
400.perlbench (unexplained diff vs previous) -99.74% 8772.000 23.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.74% 8356.000 22.000 - 0.00% -
473.astar (max) (percentage) -99.73% 66.430 0.180 - -96.04% -
403.gcc (unexplained diff vs previous) -99.72% 8644.000 24.000 - 0.00% -
403.gcc (max) (percentage) -99.72% 99.360 0.280 - -92.69% -
447.dealII (unexplained diff vs previous) -99.70% 7017.000 21.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.70% 11280.000 34.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.70% 5581.000 17.000 - 0.00% -
401.bzip2 (max) (percentage) -99.69% 78.650 0.240 - -82.86% -
464.h264ref (unexplained diff vs previous) -99.69% 6843.000 21.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.68% 10833.000 35.000 - 600.00% -
481.wrf (unexplained diff vs previous) -99.66% 12149.000 41.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.66% 10659.000 36.000 - 44.00% -
459.GemsFDTD (unexplained diff vs previous) -99.60% 15458.000 62.000 - 0.00% -
471.omnetpp (max) (percentage) -99.57% 79.650 0.340 - -71.43% -
458.sjeng (max) (percentage) -99.52% 47.610 0.230 - 64.29% -
437.leslie3d (unexplained diff vs previous) (percentage) -99.50% 19.880 0.100 - 0.00% -
483.xalancbmk (max) (percentage) -99.46% 68.670 0.370 - -79.10% -
437.leslie3d (unexplained diff vs previous) -99.39% 2314.000 14.000 - 0.00% -
462.libquantum (max) (percentage) -99.37% 98.970 0.620 - -81.55% -
410.bwaves (unexplained diff vs previous) (percentage) -99.35% 137.900 0.900 - 164.71% -
456.hmmer (max) (percentage) -99.33% 73.590 0.490 - 444.44% -
465.tonto (unexplained diff vs previous) -99.32% 1771.000 12.000 - 0.00% -
433.milc (unexplained diff vs previous) -99.29% 11289.000 80.000 - 1500.00% -
473.astar (max) -99.27% 3406.000 25.000 - -89.22% -
465.tonto (unexplained diff vs previous) (percentage) -99.14% 16.190 0.140 - 0.00% -
458.sjeng (max) -99.11% 3602.000 32.000 - 220.00% -
454.calculix (max) (percentage) -98.99% 99.730 1.010 - 21.69% -
459.GemsFDTD (max) (percentage) -98.61% 71.460 0.990 - 90.38% -
401.bzip2 (max) -98.49% 2313.000 35.000 - -16.67% -
482.sphinx3 (unexplained diff vs previous) -98.44% 26073.000 408.000 - 0.00% -
483.xalancbmk (max) -98.40% 2621.000 42.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -98.34% 7794.000 129.000 - 545.00% -
471.omnetpp (max) -98.34% 2169.000 36.000 - 9.09% -
464.h264ref (max) (percentage) -98.10% 54.290 1.030 - 14.44% -
445.gobmk (max) (percentage) -98.08% 52.630 1.010 - 55.38% -
453.povray (max) (percentage) -98.01% 91.250 1.820 - 1.68% -
400.perlbench (max) (percentage) -97.98% 84.060 1.700 - -29.46% -
436.cactusADM (max) (percentage) -97.68% 88.730 2.060 - 119.15% -
433.milc (max) (percentage) -97.63% 90.750 2.150 - 88.60% -
434.zeusmp (max) (percentage) -97.46% 81.770 2.080 - 700.00% -
456.hmmer (max) -97.45% 2120.000 54.000 - 2600.00% -
429.mcf (max) -97.05% 1322.000 39.000 - 25.81% -
447.dealII (max) (percentage) -96.41% 80.280 2.880 - 60.89% -
470.lbm (max) (percentage) -95.97% 72.510 2.920 - 342.42% -
483.xalancbmk (avg) (percentage) -95.85% 6.500 0.270 - -90.88% -
403.gcc (avg) (percentage) -95.77% 7.320 0.310 - -93.91% -
410.bwaves (max) (percentage) -95.67% 57.970 2.510 - 213.75% -
450.soplex (max) (percentage) -95.66% 96.240 4.180 - 280.00% -
445.gobmk (max) -95.61% 2643.000 116.000 - 262.50% -
454.calculix (avg) (percentage) -95.51% 8.020 0.360 - -90.00% -
464.h264ref (max) -95.49% 3127.000 141.000 - 176.47% -
435.gromacs (max) (percentage) -95.24% 49.160 2.340 - 91.80% -
481.wrf (max) (percentage) -95.01% 68.700 3.430 - 313.25% -
459.GemsFDTD (max) -94.72% 4411.000 233.000 - 762.96% -
458.sjeng (avg) (percentage) -94.36% 3.190 0.180 - -71.43% -
482.sphinx3 (max) (percentage) -94.35% 96.500 5.450 - 617.11% -
416.gamess (max) (percentage) -93.49% 38.550 2.510 - 560.53% -
444.namd (max) (percentage) -92.95% 91.790 6.470 - 1194.00% -
465.tonto (max) -92.23% 2112.000 164.000 - 112.99% -
465.tonto (max) (percentage) -90.32% 19.310 1.870 - 167.14% -
456.hmmer (avg) (percentage) -90.25% 4.410 0.430 - -20.37% -
435.gromacs (max) -90.04% 3573.000 356.000 - 309.20% -
401.bzip2 (avg) (percentage) -89.96% 5.480 0.550 - -63.82% -
458.sjeng -89.63% 241.000 25.000 - -45.65% -
458.sjeng (avg) -89.63% 241.000 25.000 - -45.65% -
416.gamess (max) -89.26% 4805.000 516.000 - 0.00% -
464.h264ref (avg) (percentage) -89.19% 5.090 0.550 - -27.63% -
473.astar (avg) (percentage) -89.18% 4.160 0.450 - -72.56% -
429.mcf (avg) (percentage) -89.18% 7.670 0.830 - -83.23% -
410.bwaves (max) -89.04% 3276.000 359.000 - 663.83% -
445.gobmk (avg) (percentage) -88.75% 3.910 0.440 - -50.56% -
483.xalancbmk -87.50% 248.000 31.000 - 0.00% -
483.xalancbmk (avg) -87.50% 248.000 31.000 - 0.00% -
400.perlbench (max) -86.76% 1397.000 185.000 - 413.89% -
462.libquantum (avg) (percentage) -86.55% 7.660 1.030 - -44.02% -
470.lbm (max) -86.42% 2746.000 373.000 - 1454.17% -
434.zeusmp (max) -86.33% 2055.000 281.000 - 4583.33% -
450.soplex (avg) (percentage) -85.54% 6.430 0.930 - -63.24% -
447.dealII (avg) (percentage) -85.27% 5.770 0.850 - -30.33% -
481.wrf (max) -84.82% 3801.000 577.000 - 0.00% -
400.perlbench (avg) (percentage) -83.46% 6.350 1.050 - -48.53% -
471.omnetpp (avg) (percentage) -83.05% 8.200 1.390 - -35.65% -
453.povray (avg) (percentage) -81.95% 7.810 1.410 - -8.44% -
416.gamess (avg) (percentage) -81.67% 4.420 0.810 - 6.58% -
447.dealII (max) -81.58% 1384.000 255.000 - 779.31% -
465.tonto -81.10% 365.000 69.000 - -49.26% -
465.tonto (avg) -81.10% 365.000 69.000 - -49.26% -
459.GemsFDTD (avg) (percentage) -80.65% 5.840 1.130 - -16.30% -
481.wrf (avg) (percentage) -80.45% 6.240 1.220 - -32.22% -
436.cactusADM (max) -80.30% 1848.000 364.000 - 1815.79% -
435.gromacs (avg) (percentage) -78.06% 5.060 1.110 - -36.93% -
465.tonto (avg) (percentage) -76.35% 3.340 0.790 - -35.77% -
453.povray (max) -76.15% 499.000 119.000 - 1222.22% -
436.cactusADM (avg) (percentage) -75.92% 5.980 1.440 - 26.32% -
434.zeusmp (avg) (percentage) -74.70% 5.850 1.480 - 49.49% -
445.gobmk -74.49% 196.000 50.000 - 13.64% -
445.gobmk (avg) -74.49% 196.000 50.000 - 13.64% -
464.h264ref -74.40% 293.000 75.000 - 74.42% -
464.h264ref (avg) -74.40% 293.000 75.000 - 74.42% -
437.leslie3d (max) (percentage) -74.31% 16.580 4.260 - -70.21% -
433.milc (avg) (percentage) -73.88% 6.050 1.580 - 27.42% -
433.milc (max) -73.28% 1044.000 279.000 - 2046.15% -
482.sphinx3 (avg) (percentage) -72.89% 7.930 2.150 - 18.78% -
473.astar -70.42% 213.000 63.000 - -24.10% -
473.astar (avg) -70.42% 213.000 63.000 - -24.10% -
416.gamess -69.82% 550.000 166.000 - 0.00% -
416.gamess (avg) -69.82% 550.000 166.000 - 0.00% -
410.bwaves (avg) (percentage) -69.16% 4.410 1.360 - 47.83% -
437.leslie3d (max) -68.74% 1929.000 603.000 - -62.55% -
470.lbm (avg) (percentage) -66.35% 6.330 2.130 - 139.33% -
456.hmmer -62.99% 127.000 47.000 - 213.33% -
456.hmmer (avg) -62.99% 127.000 47.000 - 213.33% -
444.namd (avg) (percentage) -59.54% 9.220 3.730 - 200.81% -
403.gcc (max) -54.55% 55.000 25.000 - 0.00% -
435.gromacs -53.95% 367.000 169.000 - 35.20% -
435.gromacs (avg) -53.95% 367.000 169.000 - 35.20% -
401.bzip2 -49.07% 161.000 82.000 - 82.22% -
401.bzip2 (avg) -49.07% 161.000 82.000 - 82.22% -
462.libquantum (max) -48.55% 138.000 71.000 - 1675.00% -
481.wrf -40.58% 345.000 205.000 - 0.00% -
481.wrf (avg) -40.58% 345.000 205.000 - 0.00% -
437.leslie3d (avg) (percentage) -38.03% 3.050 1.890 - -58.37% -
471.omnetpp -33.63% 223.000 148.000 - 146.67% -
471.omnetpp (avg) -33.63% 223.000 148.000 - 146.67% -
459.GemsFDTD -26.11% 360.000 266.000 - 269.44% -
459.GemsFDTD (avg) -26.11% 360.000 266.000 - 269.44% -
437.leslie3d -24.79% 355.000 267.000 - -47.75% -
437.leslie3d (avg) -24.79% 355.000 267.000 - -47.75% -
447.dealII -24.24% 99.000 75.000 - 294.74% -
447.dealII (avg) -24.24% 99.000 75.000 - 294.74% -
410.bwaves -22.09% 249.000 194.000 - 259.26% -
410.bwaves (avg) -22.09% 249.000 194.000 - 259.26% -
444.namd (max) -15.18% 685.000 581.000 - 19266.67% -

Added Tests - sample variability
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)


Report Time: 0.40s
Name Current %
400.perlbench 10939.000 625.40%
401.bzip2 14970.000 395.86%
403.gcc 9090.000 -
410.bwaves 14306.000 142.85%
416.gamess 20588.000 -
429.mcf 17282.000 807.67%
433.milc 13002.000 1025.71%
434.zeusmp 13518.000 433.25%
435.gromacs 15226.000 113.16%
436.cactusADM 17693.000 733.79%
437.leslie3d 14177.000 25.92%
444.namd 8992.000 1048.40%
445.gobmk 11552.000 133.47%
447.dealII 8863.000 441.09%
450.soplex 15856.000 2610.43%
453.povray 6576.000 1108.82%
454.calculix 27307.000 -
456.hmmer 11127.000 287.03%
458.sjeng 14033.000 89.64%
459.GemsFDTD 23627.000 340.31%
462.libquantum 11545.000 8451.85%
464.h264ref 13700.000 137.48%
465.tonto 8777.000 -21.16%
470.lbm 12801.000 238.20%
471.omnetpp 10674.000 283.82%
473.astar 14169.000 177.06%
481.wrf 16851.000 -
482.sphinx3 30827.000 3587.44%
483.xalancbmk 11545.000 -
Geometric Mean 13628.687 455.16%
Name Current %
400.perlbench 897104.000 1.06%
401.bzip2 44221.000 1.16%
403.gcc 2460192.000 -
410.bwaves 16768.000 1.85%
416.gamess 5742349.000 -
429.mcf 9123.000 -
433.milc 61230.000 1.19%
434.zeusmp 153897.000 4.93%
435.gromacs 500203.000 2.14%
436.cactusADM 352831.000 1.28%
437.leslie3d 59403.000 8.43%
444.namd 188301.000 1.36%
445.gobmk 1377598.000 -
447.dealII 312944.000 1.64%
450.soplex 211092.000 4.21%
453.povray 661959.000 1.24%
454.calculix 844607.000 -
456.hmmer 108631.000 1.30%
458.sjeng 104028.000 -2.21%
459.GemsFDTD 247940.000 6.53%
462.libquantum 16045.000 -
464.h264ref 387228.000 2.08%
465.tonto 1945443.000 -1.57%
470.lbm 9711.000 1.72%
471.omnetpp 482480.000 1.49%
473.astar 22952.000 -
481.wrf 1962288.000 -
482.sphinx3 112831.000 1.04%
483.xalancbmk 2342185.000 -
Geometric Mean 224502.528 64.14%
Name Current %
nb_compile_successful 29.000 -39.58%
nb_execution_successful 29.000 -39.58%
nb_total_tests 29.000 -57.35%
Geometric Mean 29.000 -46.21%
Name Current %
400.perlbench 114.000 280.00%
400.perlbench (avg) 114.000 280.00%
400.perlbench (avg) (percentage) 1.050 -48.53%
400.perlbench (max) 185.000 413.89%
400.perlbench (max) (percentage) 1.700 -29.46%
400.perlbench (unexplained diff vs previous) 23.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.210 -
401.bzip2 82.000 82.22%
401.bzip2 (avg) 82.000 82.22%
401.bzip2 (avg) (percentage) 0.550 -63.82%
401.bzip2 (max) 35.000 -16.67%
401.bzip2 (max) (percentage) 0.240 -82.86%
401.bzip2 (unexplained diff vs previous) 35.000 600.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.230 35.29%
403.gcc 28.000 -
403.gcc (avg) 28.000 -
403.gcc (avg) (percentage) 0.310 -93.91%
403.gcc (max) 25.000 -
403.gcc (max) (percentage) 0.280 -92.69%
403.gcc (unexplained diff vs previous) 24.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.260 -
410.bwaves 194.000 259.26%
410.bwaves (avg) 194.000 259.26%
410.bwaves (avg) (percentage) 1.360 47.83%
410.bwaves (max) 359.000 663.83%
410.bwaves (max) (percentage) 2.510 213.75%
410.bwaves (unexplained diff vs previous) 129.000 545.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.900 164.71%
416.gamess 166.000 -
416.gamess (avg) 166.000 -
416.gamess (avg) (percentage) 0.810 6.58%
416.gamess (max) 516.000 -
416.gamess (max) (percentage) 2.510 560.53%
416.gamess (unexplained diff vs previous) 3.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.010 -
429.mcf 143.000 52.13%
429.mcf (avg) 143.000 52.13%
429.mcf (avg) (percentage) 0.830 -83.23%
429.mcf (max) 39.000 25.81%
429.mcf (max) (percentage) 0.230 -86.23%
429.mcf (unexplained diff vs previous) 9.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.050 -
433.milc 205.000 1364.29%
433.milc (avg) 205.000 1364.29%
433.milc (avg) (percentage) 1.580 27.42%
433.milc (max) 279.000 2046.15%
433.milc (max) (percentage) 2.150 88.60%
433.milc (unexplained diff vs previous) 80.000 1500.00%
433.milc (unexplained diff vs previous) (percentage) 0.620 44.19%
434.zeusmp 200.000 700.00%
434.zeusmp (avg) 200.000 700.00%
434.zeusmp (avg) (percentage) 1.480 49.49%
434.zeusmp (max) 281.000 4583.33%
434.zeusmp (max) (percentage) 2.080 700.00%
434.zeusmp (unexplained diff vs previous) 34.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.250 -
435.gromacs 169.000 35.20%
435.gromacs (avg) 169.000 35.20%
435.gromacs (avg) (percentage) 1.110 -36.93%
435.gromacs (max) 356.000 309.20%
435.gromacs (max) (percentage) 2.340 91.80%
435.gromacs (unexplained diff vs previous) 13.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.090 -
436.cactusADM 254.000 958.33%
436.cactusADM (avg) 254.000 958.33%
436.cactusADM (avg) (percentage) 1.440 26.32%
436.cactusADM (max) 364.000 1815.79%
436.cactusADM (max) (percentage) 2.060 119.15%
436.cactusADM (unexplained diff vs previous) 10.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.060 -
437.leslie3d 267.000 -47.75%
437.leslie3d (avg) 267.000 -47.75%
437.leslie3d (avg) (percentage) 1.890 -58.37%
437.leslie3d (max) 603.000 -62.55%
437.leslie3d (max) (percentage) 4.260 -70.21%
437.leslie3d (unexplained diff vs previous) 14.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.100 -
444.namd 335.000 3622.22%
444.namd (avg) 335.000 3622.22%
444.namd (avg) (percentage) 3.730 200.81%
444.namd (max) 581.000 19266.67%
444.namd (max) (percentage) 6.470 1194.00%
444.namd (unexplained diff vs previous) 22.000 -
444.namd (unexplained diff vs previous) (percentage) 0.240 -
445.gobmk 50.000 13.64%
445.gobmk (avg) 50.000 13.64%
445.gobmk (avg) (percentage) 0.440 -50.56%
445.gobmk (max) 116.000 262.50%
445.gobmk (max) (percentage) 1.010 55.38%
445.gobmk (unexplained diff vs previous) 17.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.150 -
447.dealII 75.000 294.74%
447.dealII (avg) 75.000 294.74%
447.dealII (avg) (percentage) 0.850 -30.33%
447.dealII (max) 255.000 779.31%
447.dealII (max) (percentage) 2.880 60.89%
447.dealII (unexplained diff vs previous) 21.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.240 -
450.soplex 147.000 950.00%
450.soplex (avg) 147.000 950.00%
450.soplex (avg) (percentage) 0.930 -63.24%
450.soplex (max) 662.000 10933.33%
450.soplex (max) (percentage) 4.180 280.00%
450.soplex (unexplained diff vs previous) 13.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.080 -
453.povray 92.000 1050.00%
453.povray (avg) 92.000 1050.00%
453.povray (avg) (percentage) 1.410 -8.44%
453.povray (max) 119.000 1222.22%
453.povray (max) (percentage) 1.820 1.68%
453.povray (unexplained diff vs previous) 14.000 -
453.povray (unexplained diff vs previous) (percentage) 0.210 -
454.calculix 98.000 -
454.calculix (avg) 98.000 -
454.calculix (avg) (percentage) 0.360 -90.00%
454.calculix (max) 275.000 -
454.calculix (max) (percentage) 1.010 21.69%
454.calculix (unexplained diff vs previous) 9.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.030 -
456.hmmer 47.000 213.33%
456.hmmer (avg) 47.000 213.33%
456.hmmer (avg) (percentage) 0.430 -20.37%
456.hmmer (max) 54.000 2600.00%
456.hmmer (max) (percentage) 0.490 444.44%
456.hmmer (unexplained diff vs previous) 6.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.050 -
458.sjeng 25.000 -45.65%
458.sjeng (avg) 25.000 -45.65%
458.sjeng (avg) (percentage) 0.180 -71.43%
458.sjeng (max) 32.000 220.00%
458.sjeng (max) (percentage) 0.230 64.29%
458.sjeng (unexplained diff vs previous) 13.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -
459.GemsFDTD 266.000 269.44%
459.GemsFDTD (avg) 266.000 269.44%
459.GemsFDTD (avg) (percentage) 1.130 -16.30%
459.GemsFDTD (max) 233.000 762.96%
459.GemsFDTD (max) (percentage) 0.990 90.38%
459.GemsFDTD (unexplained diff vs previous) 62.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 -
462.libquantum 118.000 5800.00%
462.libquantum (avg) 118.000 5800.00%
462.libquantum (avg) (percentage) 1.030 -44.02%
462.libquantum (max) 71.000 1675.00%
462.libquantum (max) (percentage) 0.620 -81.55%
462.libquantum (unexplained diff vs previous) 9.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.080 -
464.h264ref 75.000 74.42%
464.h264ref (avg) 75.000 74.42%
464.h264ref (avg) (percentage) 0.550 -27.63%
464.h264ref (max) 141.000 176.47%
464.h264ref (max) (percentage) 1.030 14.44%
464.h264ref (unexplained diff vs previous) 21.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.150 -
465.tonto 69.000 -49.26%
465.tonto (avg) 69.000 -49.26%
465.tonto (avg) (percentage) 0.790 -35.77%
465.tonto (max) 164.000 112.99%
465.tonto (max) (percentage) 1.870 167.14%
465.tonto (unexplained diff vs previous) 12.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.140 -
470.lbm 272.000 724.24%
470.lbm (avg) 272.000 724.24%
470.lbm (avg) (percentage) 2.130 139.33%
470.lbm (max) 373.000 1454.17%
470.lbm (max) (percentage) 2.920 342.42%
470.lbm (unexplained diff vs previous) 0.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.000 -
471.omnetpp 148.000 146.67%
471.omnetpp (avg) 148.000 146.67%
471.omnetpp (avg) (percentage) 1.390 -35.65%
471.omnetpp (max) 36.000 9.09%
471.omnetpp (max) (percentage) 0.340 -71.43%
471.omnetpp (unexplained diff vs previous) 36.000 44.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.340 -62.22%
473.astar 63.000 -24.10%
473.astar (avg) 63.000 -24.10%
473.astar (avg) (percentage) 0.450 -72.56%
473.astar (max) 25.000 -89.22%
473.astar (max) (percentage) 0.180 -96.04%
473.astar (unexplained diff vs previous) 17.000 -
473.astar (unexplained diff vs previous) (percentage) 0.120 -
481.wrf 205.000 -
481.wrf (avg) 205.000 -
481.wrf (avg) (percentage) 1.220 -32.22%
481.wrf (max) 577.000 -
481.wrf (max) (percentage) 3.430 313.25%
481.wrf (unexplained diff vs previous) 41.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.240 -
482.sphinx3 662.000 4313.33%
482.sphinx3 (avg) 662.000 4313.33%
482.sphinx3 (avg) (percentage) 2.150 18.78%
482.sphinx3 (max) 1680.000 27900.00%
482.sphinx3 (max) (percentage) 5.450 617.11%
482.sphinx3 (unexplained diff vs previous) 408.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.320 -
483.xalancbmk 31.000 -
483.xalancbmk (avg) 31.000 -
483.xalancbmk (avg) (percentage) 0.270 -90.88%
483.xalancbmk (max) 42.000 -
483.xalancbmk (max) (percentage) 0.370 -79.10%
483.xalancbmk (unexplained diff vs previous) 11.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.100 -
Geometric Mean 8.769 30.39%