Baseline and compare_to are the same: disabling baseline. ×
Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=edf64cd235f5ecb3725e7cf1ff83bbdb6dd53340 (+ 136 commits) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/6610daa1cfb75b72500c22ae97988ec2a48b85c6 (+ 89 commits) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=402853be1db5a233ec688f8c5343b73191629fbd (+ 14 commits) |
git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=41b44b9371c2f83b41ab81093836a8000c65cbab (+ 16893 commits) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-arm-master-Os_LTO-build/1/ |
Filter
gnu-arm-master-Os_LTO test results
Run | Order | Start Time | Duration | |
---|---|---|---|---|
Current | 0001 (4-changed-components) | 2023-01-07T12:49:28 | 0:00:00 | |
Previous | 0001 (3-changed-components) | 2022-12-30T06:27:35 | 0:00:00 | |
No Baseline Run |
Tests Summary
Status Group | # |
---|---|
Performance Regressions | 156 |
Performance Improvements | 49 |
Unchanged Tests | 1031 |
Total Tests | 1236 |
Performance Regressions - Execution | Δ | Previous | Current | σ |
---|---|---|---|---|
429.mcf | 24.06% | 11727.000 | 14549.000 | - |
471.omnetpp | 22.73% | 9265.000 | 11371.000 | - |
453.povray | 10.32% | 7395.000 | 8158.000 | - |
483.xalancbmk | 8.27% | 8027.000 | 8691.000 | - |
458.sjeng | 5.18% | 16018.000 | 16847.000 | - |
462.libquantum | 4.30% | 17005.000 | 17736.000 | - |
473.astar | 3.66% | 12983.000 | 13458.000 | - |
470.lbm | 3.18% | 16312.000 | 16830.000 | - |
447.dealII | 2.68% | 9101.000 | 9345.000 | - |
465.tonto | 1.58% | 13044.000 | 13250.000 | - |
481.wrf | 1.53% | 21991.000 | 22327.000 | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ |
---|---|---|---|---|
429.mcf (max) | 7805.41% | 37.000 | 2925.000 | - |
429.mcf (max) (percentage) | 6184.37% | 0.320 | 20.110 | - |
462.libquantum (max) | 5000.00% | 13.000 | 663.000 | - |
462.libquantum (max) (percentage) | 4575.00% | 0.080 | 3.740 | - |
464.h264ref (max) (percentage) | 1756.41% | 0.390 | 7.240 | - |
458.sjeng (max) | 1612.50% | 48.000 | 822.000 | - |
464.h264ref (max) | 1598.31% | 59.000 | 1002.000 | - |
458.sjeng (max) (percentage) | 1526.67% | 0.300 | 4.880 | - |
401.bzip2 (max) (percentage) | 962.50% | 0.400 | 4.250 | - |
471.omnetpp (max) | 931.98% | 172.000 | 1775.000 | - |
401.bzip2 (max) | 922.39% | 67.000 | 685.000 | - |
471.omnetpp (max) (percentage) | 739.25% | 1.860 | 15.610 | - |
483.xalancbmk (max) | 660.27% | 73.000 | 555.000 | - |
450.soplex (max) (percentage) | 656.82% | 0.440 | 3.330 | - |
450.soplex (max) | 633.33% | 69.000 | 506.000 | - |
483.xalancbmk (max) (percentage) | 594.57% | 0.920 | 6.390 | - |
429.mcf | 408.93% | 56.000 | 285.000 | - |
429.mcf (avg) | 408.93% | 56.000 | 285.000 | - |
473.astar (max) | 368.85% | 61.000 | 286.000 | - |
473.astar (max) (percentage) | 353.19% | 0.470 | 2.130 | - |
403.gcc (max) (percentage) | 345.76% | 0.590 | 2.630 | - |
447.dealII (unexplained diff vs previous) | 345.59% | 68.000 | 303.000 | - |
403.gcc (max) | 336.54% | 52.000 | 227.000 | - |
447.dealII (unexplained diff vs previous) (percentage) | 332.00% | 0.750 | 3.240 | - |
429.mcf (avg) (percentage) | 308.33% | 0.480 | 1.960 | - |
435.gromacs (max) (percentage) | 303.41% | 1.760 | 7.100 | - |
435.gromacs (max) | 266.55% | 296.000 | 1085.000 | - |
433.milc (max) (percentage) | 223.94% | 0.710 | 2.300 | - |
464.h264ref (unexplained diff vs previous) (percentage) | 213.16% | 0.380 | 1.190 | - |
433.milc (max) | 211.34% | 97.000 | 302.000 | - |
465.tonto (max) | 187.89% | 223.000 | 642.000 | - |
471.omnetpp (unexplained diff vs previous) | 187.10% | 62.000 | 178.000 | - |
464.h264ref (unexplained diff vs previous) | 184.48% | 58.000 | 165.000 | - |
465.tonto (max) (percentage) | 183.63% | 1.710 | 4.850 | - |
453.povray (max) | 169.63% | 191.000 | 515.000 | - |
458.sjeng | 169.44% | 36.000 | 97.000 | - |
458.sjeng (avg) | 169.44% | 36.000 | 97.000 | - |
471.omnetpp | 155.96% | 109.000 | 279.000 | - |
471.omnetpp (avg) | 155.96% | 109.000 | 279.000 | - |
458.sjeng (avg) (percentage) | 152.17% | 0.230 | 0.580 | - |
464.h264ref (avg) (percentage) | 151.28% | 0.390 | 0.980 | - |
462.libquantum | 146.88% | 32.000 | 79.000 | - |
462.libquantum (avg) | 146.88% | 32.000 | 79.000 | - |
453.povray (max) (percentage) | 144.02% | 2.590 | 6.320 | - |
462.libquantum (avg) (percentage) | 136.84% | 0.190 | 0.450 | - |
471.omnetpp (unexplained diff vs previous) (percentage) | 134.33% | 0.670 | 1.570 | - |
464.h264ref | 128.81% | 59.000 | 135.000 | - |
464.h264ref (avg) | 128.81% | 59.000 | 135.000 | - |
401.bzip2 (avg) (percentage) | 114.81% | 0.270 | 0.580 | - |
483.xalancbmk | 113.64% | 44.000 | 94.000 | - |
483.xalancbmk (avg) | 113.64% | 44.000 | 94.000 | - |
447.dealII (max) | 108.67% | 150.000 | 313.000 | - |
471.omnetpp (avg) (percentage) | 108.47% | 1.180 | 2.460 | - |
401.bzip2 | 106.67% | 45.000 | 93.000 | - |
401.bzip2 (avg) | 106.67% | 45.000 | 93.000 | - |
450.soplex (avg) (percentage) | 104.17% | 0.240 | 0.490 | - |
447.dealII (max) (percentage) | 103.03% | 1.650 | 3.350 | - |
450.soplex | 100.00% | 37.000 | 74.000 | - |
450.soplex (avg) | 100.00% | 37.000 | 74.000 | - |
456.hmmer (max) (percentage) | 98.08% | 0.520 | 1.030 | - |
459.GemsFDTD (max) (percentage) | 97.37% | 2.280 | 4.500 | - |
456.hmmer (max) | 96.94% | 98.000 | 193.000 | - |
483.xalancbmk (avg) (percentage) | 94.64% | 0.560 | 1.090 | - |
454.calculix (max) (percentage) | 94.05% | 0.840 | 1.630 | - |
454.calculix (max) | 92.28% | 272.000 | 523.000 | - |
459.GemsFDTD (max) | 90.31% | 578.000 | 1100.000 | - |
473.astar (unexplained diff vs previous) | 73.77% | 61.000 | 106.000 | - |
473.astar (unexplained diff vs previous) (percentage) | 68.09% | 0.470 | 0.790 | - |
462.libquantum (unexplained diff vs previous) | 64.29% | 14.000 | 23.000 | - |
462.libquantum (unexplained diff vs previous) (percentage) | 62.50% | 0.080 | 0.130 | - |
435.gromacs (avg) (percentage) | 57.89% | 0.950 | 1.500 | - |
473.astar | 49.02% | 51.000 | 76.000 | - |
473.astar (avg) | 49.02% | 51.000 | 76.000 | - |
453.povray | 48.67% | 113.000 | 168.000 | - |
453.povray (avg) | 48.67% | 113.000 | 168.000 | - |
403.gcc (avg) (percentage) | 44.19% | 0.430 | 0.620 | - |
435.gromacs | 43.12% | 160.000 | 229.000 | - |
435.gromacs (avg) | 43.12% | 160.000 | 229.000 | - |
473.astar (avg) (percentage) | 42.50% | 0.400 | 0.570 | - |
445.gobmk (max) (percentage) | 40.74% | 0.270 | 0.380 | - |
403.gcc | 39.47% | 38.000 | 53.000 | - |
403.gcc (avg) | 39.47% | 38.000 | 53.000 | - |
445.gobmk (max) | 39.39% | 33.000 | 46.000 | - |
453.povray (avg) (percentage) | 35.29% | 1.530 | 2.070 | - |
470.lbm (max) | 33.59% | 893.000 | 1193.000 | - |
465.tonto | 31.08% | 148.000 | 194.000 | - |
465.tonto (avg) | 31.08% | 148.000 | 194.000 | - |
470.lbm (max) (percentage) | 29.38% | 5.480 | 7.090 | - |
444.namd (max) (percentage) | 29.04% | 5.510 | 7.110 | - |
465.tonto (avg) (percentage) | 28.95% | 1.140 | 1.470 | - |
482.sphinx3 (max) (percentage) | 26.98% | 3.150 | 4.000 | - |
444.namd (max) | 24.80% | 879.000 | 1097.000 | - |
470.lbm (unexplained diff vs previous) | 24.45% | 822.000 | 1023.000 | - |
447.dealII | 24.05% | 79.000 | 98.000 | - |
447.dealII (avg) | 24.05% | 79.000 | 98.000 | - |
433.milc (avg) (percentage) | 23.19% | 0.690 | 0.850 | - |
481.wrf (max) | 21.88% | 914.000 | 1114.000 | - |
447.dealII (avg) (percentage) | 20.69% | 0.870 | 1.050 | - |
470.lbm (unexplained diff vs previous) (percentage) | 20.63% | 5.040 | 6.080 | - |
481.wrf (max) (percentage) | 19.95% | 4.160 | 4.990 | - |
444.namd (avg) (percentage) | 18.85% | 2.600 | 3.090 | - |
459.GemsFDTD (avg) (percentage) | 18.71% | 1.390 | 1.650 | - |
433.milc | 18.09% | 94.000 | 111.000 | - |
433.milc (avg) | 18.09% | 94.000 | 111.000 | - |
482.sphinx3 (max) | 17.36% | 1152.000 | 1352.000 | - |
456.hmmer (avg) (percentage) | 16.67% | 0.300 | 0.350 | - |
434.zeusmp | 16.47% | 255.000 | 297.000 | - |
434.zeusmp (avg) | 16.47% | 255.000 | 297.000 | - |
434.zeusmp (max) | 16.42% | 481.000 | 560.000 | - |
470.lbm | 16.12% | 608.000 | 706.000 | - |
470.lbm (avg) | 16.12% | 608.000 | 706.000 | - |
456.hmmer | 16.07% | 56.000 | 65.000 | - |
456.hmmer (avg) | 16.07% | 56.000 | 65.000 | - |
434.zeusmp (max) (percentage) | 15.65% | 2.300 | 2.660 | - |
434.zeusmp (avg) (percentage) | 15.57% | 1.220 | 1.410 | - |
444.namd | 14.98% | 414.000 | 476.000 | - |
444.namd (avg) | 14.98% | 414.000 | 476.000 | - |
459.GemsFDTD | 14.49% | 352.000 | 403.000 | - |
459.GemsFDTD (avg) | 14.49% | 352.000 | 403.000 | - |
470.lbm (avg) (percentage) | 12.60% | 3.730 | 4.200 | - |
400.perlbench | 11.63% | 43.000 | 48.000 | - |
400.perlbench (avg) | 11.63% | 43.000 | 48.000 | - |
481.wrf | 10.62% | 565.000 | 625.000 | - |
481.wrf (avg) | 10.62% | 565.000 | 625.000 | - |
400.perlbench (avg) (percentage) | 10.26% | 0.390 | 0.430 | - |
416.gamess (avg) (percentage) | 9.09% | 1.650 | 1.800 | - |
445.gobmk (avg) (percentage) | 9.09% | 0.220 | 0.240 | - |
481.wrf (avg) (percentage) | 8.95% | 2.570 | 2.800 | - |
445.gobmk | 7.41% | 27.000 | 29.000 | - |
445.gobmk (avg) | 7.41% | 27.000 | 29.000 | - |
410.bwaves (unexplained diff vs previous) (percentage) | 6.90% | 1.740 | 1.860 | - |
416.gamess (unexplained diff vs previous) (percentage) | 6.23% | 3.050 | 3.240 | - |
482.sphinx3 (avg) (percentage) | 5.96% | 2.350 | 2.490 | - |
400.perlbench (max) | 5.62% | 89.000 | 94.000 | - |
436.cactusADM (avg) (percentage) | 5.42% | 2.400 | 2.530 | - |
400.perlbench (max) (percentage) | 5.00% | 0.800 | 0.840 | - |
435.gromacs (unexplained diff vs previous) (percentage) | 4.62% | 1.730 | 1.810 | - |
416.gamess | 3.09% | 485.000 | 500.000 | - |
416.gamess (avg) | 3.09% | 485.000 | 500.000 | - |
410.bwaves (max) (percentage) | 2.82% | 1.770 | 1.820 | - |
436.cactusADM | 2.74% | 585.000 | 601.000 | - |
436.cactusADM (avg) | 2.74% | 585.000 | 601.000 | - |
410.bwaves (unexplained diff vs previous) | 2.33% | 257.000 | 263.000 | - |
433.milc (unexplained diff vs previous) (percentage) | 1.43% | 0.700 | 0.710 | - |
436.cactusADM (unexplained diff vs previous) (percentage) | 1.25% | 4.810 | 4.870 | - |
Performance Improvements - Execution | Δ | Previous | Current | σ |
---|---|---|---|---|
435.gromacs | -9.30% | 16853.000 | 15286.000 | - |
464.h264ref | -8.99% | 15208.000 | 13841.000 | - |
482.sphinx3 | -7.61% | 36586.000 | 33801.000 | - |
416.gamess | -5.44% | 29409.000 | 27808.000 | - |
401.bzip2 | -4.97% | 16971.000 | 16128.000 | - |
410.bwaves | -3.87% | 14745.000 | 14174.000 | - |
433.milc | -3.74% | 13668.000 | 13157.000 | - |
459.GemsFDTD | -3.56% | 25364.000 | 24461.000 | - |
444.namd | -3.27% | 15957.000 | 15435.000 | - |
450.soplex | -3.26% | 15709.000 | 15197.000 | - |
436.cactusADM | -2.53% | 24396.000 | 23778.000 | - |
403.gcc | -2.53% | 8890.000 | 8665.000 | - |
456.hmmer | -1.16% | 18995.000 | 18774.000 | - |
454.calculix | -1.07% | 32491.000 | 32144.000 | - |
Report Time: 0.34s