Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fe70001da2d56544ab1954cfd70646c9602c77c4 (+ 18 commits) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/2790800c61fb5748cd336e09a691848dd3e74090 (unchanged) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=e7c14e542d8d858b824b5df4f4e3dc93695e6171 (+ 14 commits) |
git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e09f6f42432c3144acf9c954b3bc0d9212d88a6a (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/240/ |
Filter
gnu-aarch64-master-O3_LTO test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0240 (2-changed-components) | 2024-08-14T01:19:52 | 0:00:00 |
Previous | 0237 (3-changed-components) | 2024-08-11T02:39:18 | 0:00:00 |
Baseline | 0001 (4-changed-components) | 2023-03-05T09:27:13 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 22 | 12 |
Performance Improvements | 113 | 23 |
Added Tests | 7 | 113 |
Unchanged Tests | 836 | 830 |
Total Tests | 978 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
628.pop2_s | 11.54% | 26.000 | 29.000 | - | -99.71% | - |
603.bwaves_s | 2.11% | 8930.000 | 9118.000 | - | 1.08% | - |
619.lbm_s | 1.60% | 29415.000 | 29885.000 | - | -0.29% | - |
644.nab_s | 1.06% | 10341.000 | 10451.000 | - | 2.52% | - |
Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
nb_total_tests | -8.00% | 50.000 | 46.000 | - | 91.67% | - |
nb_execution_successful | -4.55% | 44.000 | 42.000 | - | 82.61% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
625.x264_s (unexplained diff vs previous) (percentage) | -78.95% | 0.950 | 0.200 | 0.000 | 0.00% | 0.000 |
625.x264_s (unexplained diff vs previous) | -78.57% | 14.000 | 3.000 | 0.000 | 0.00% | 0.000 |
619.lbm_s (max) (percentage) | -74.61% | 126.900 | 32.220 | - | 0.00% | - |
619.lbm_s (max) | -74.21% | 37327.000 | 9628.000 | - | 0.00% | - |
605.mcf_s (unexplained diff vs previous) | -71.92% | 146.000 | 41.000 | 0.000 | 0.00% | 0.000 |
605.mcf_s (unexplained diff vs previous) (percentage) | -71.85% | 2.380 | 0.670 | 0.000 | 0.00% | 0.000 |
511.povray_r (unexplained diff vs previous) | -71.43% | 7.000 | 2.000 | 0.000 | 0.00% | 0.000 |
511.povray_r (unexplained diff vs previous) (percentage) | -71.07% | 1.970 | 0.570 | 0.000 | 0.00% | 0.000 |
607.cactuBSSN_s (unexplained diff vs previous) | -66.67% | 39.000 | 13.000 | 0.000 | 0.00% | 0.000 |
607.cactuBSSN_s (unexplained diff vs previous) (percentage) | -65.82% | 0.790 | 0.270 | 0.000 | 0.00% | 0.000 |
603.bwaves_s (max) (percentage) | -61.99% | 44.410 | 16.880 | - | 0.00% | - |
603.bwaves_s (max) | -61.19% | 3965.000 | 1539.000 | - | 0.00% | - |
631.deepsjeng_s (unexplained diff vs previous) | -53.33% | 15.000 | 7.000 | 0.000 | 0.00% | 0.000 |
631.deepsjeng_s (unexplained diff vs previous) (percentage) | -52.27% | 0.440 | 0.210 | 0.000 | 0.00% | 0.000 |
619.lbm_s (unexplained diff vs previous) (percentage) | -52.13% | 3.280 | 1.570 | 0.000 | 0.00% | 0.000 |
619.lbm_s (unexplained diff vs previous) | -51.24% | 964.000 | 470.000 | 0.000 | 0.00% | 0.000 |
605.mcf_s (max) | -50.49% | 1820.000 | 901.000 | - | 0.00% | - |
605.mcf_s (max) (percentage) | -50.15% | 29.650 | 14.780 | - | 0.00% | - |
631.deepsjeng_s (max) (percentage) | -46.65% | 23.280 | 12.420 | - | 0.00% | - |
631.deepsjeng_s (max) | -46.51% | 789.000 | 422.000 | - | 0.00% | - |
603.bwaves_s (unexplained diff vs previous) (percentage) | -46.07% | 3.820 | 2.060 | 0.000 | 0.00% | 0.000 |
603.bwaves_s (unexplained diff vs previous) | -44.87% | 341.000 | 188.000 | 0.000 | 0.00% | 0.000 |
600.perlbench_s (unexplained diff vs previous) (percentage) | -43.62% | 1.490 | 0.840 | 0.000 | 0.00% | 0.000 |
600.perlbench_s (unexplained diff vs previous) | -43.33% | 30.000 | 17.000 | 0.000 | 0.00% | 0.000 |
623.xalancbmk_s (max) (percentage) | -37.57% | 7.400 | 4.620 | - | 0.00% | - |
623.xalancbmk_s (max) | -36.91% | 233.000 | 147.000 | - | 0.00% | - |
526.blender_r (unexplained diff vs previous) | -34.69% | 49.000 | 32.000 | 0.000 | 0.00% | 0.000 |
526.blender_r (unexplained diff vs previous) (percentage) | -34.00% | 0.500 | 0.330 | 0.000 | 0.00% | 0.000 |
511.povray_r (max) (percentage) | -31.36% | 2.200 | 1.510 | - | 0.00% | - |
511.povray_r (max) | -28.57% | 7.000 | 5.000 | - | 0.00% | - |
657.xz_s (unexplained diff vs previous) (percentage) | -15.62% | 0.320 | 0.270 | 0.000 | 0.00% | 0.000 |
657.xz_s (unexplained diff vs previous) | -14.29% | 7.000 | 6.000 | 0.000 | 0.00% | 0.000 |
623.xalancbmk_s (unexplained diff vs previous) (percentage) | -10.53% | 0.950 | 0.850 | 0.000 | 0.00% | 0.000 |
623.xalancbmk_s (unexplained diff vs previous) | -10.00% | 30.000 | 27.000 | 0.000 | 0.00% | 0.000 |
641.leela_s (max) | -6.74% | 356.000 | 332.000 | - | 0.00% | - |
648.exchange2_s | -6.67% | 15.000 | 14.000 | - | 0.00% | - |
648.exchange2_s (avg) | -6.67% | 15.000 | 14.000 | - | 0.00% | - |
508.namd_r (max) (percentage) | -6.33% | 7.740 | 7.250 | - | 0.00% | - |
641.leela_s (max) (percentage) | -6.31% | 10.300 | 9.650 | - | 0.00% | - |
607.cactuBSSN_s | -6.13% | 359.000 | 337.000 | - | 0.00% | - |
607.cactuBSSN_s (avg) | -6.13% | 359.000 | 337.000 | - | 0.00% | - |
508.namd_r (max) | -5.88% | 187.000 | 176.000 | - | 0.00% | - |
648.exchange2_s (max) | -5.88% | 34.000 | 32.000 | - | 0.00% | - |
510.parest_r | -5.86% | 307.000 | 289.000 | - | 0.00% | - |
510.parest_r (avg) | -5.86% | 307.000 | 289.000 | - | 0.00% | - |
510.parest_r (avg) (percentage) | -5.83% | 5.660 | 5.330 | - | 0.00% | - |
607.cactuBSSN_s (avg) (percentage) | -5.74% | 7.320 | 6.900 | - | 0.00% | - |
526.blender_r | -5.56% | 252.000 | 238.000 | - | 0.00% | - |
526.blender_r (avg) | -5.56% | 252.000 | 238.000 | - | 0.00% | - |
648.exchange2_s (max) (percentage) | -5.51% | 2.540 | 2.400 | - | 0.00% | - |
526.blender_r (avg) (percentage) | -5.43% | 2.580 | 2.440 | - | 0.00% | - |
625.x264_s (avg) (percentage) | -5.26% | 2.090 | 1.980 | - | 0.00% | - |
620.omnetpp_s (max) | -5.23% | 1569.000 | 1487.000 | - | 0.00% | - |
526.blender_r (max) | -5.07% | 1066.000 | 1012.000 | - | 0.00% | - |
638.imagick_s (avg) (percentage) | -5.01% | 3.590 | 3.410 | - | 0.00% | - |
607.cactuBSSN_s (max) | -5.01% | 1955.000 | 1857.000 | - | 0.00% | - |
631.deepsjeng_s (avg) (percentage) | -4.92% | 3.660 | 3.480 | - | 0.00% | - |
510.parest_r (max) | -4.89% | 1717.000 | 1633.000 | - | 0.00% | - |
631.deepsjeng_s | -4.84% | 124.000 | 118.000 | - | 0.00% | - |
631.deepsjeng_s (avg) | -4.84% | 124.000 | 118.000 | - | 0.00% | - |
638.imagick_s (max) (percentage) | -4.79% | 20.030 | 19.070 | - | 0.00% | - |
526.blender_r (max) (percentage) | -4.78% | 10.880 | 10.360 | - | 0.00% | - |
600.perlbench_s (max) (percentage) | -4.77% | 17.400 | 16.570 | - | 0.00% | - |
625.x264_s (max) | -4.76% | 231.000 | 220.000 | - | 0.00% | - |
620.omnetpp_s (max) (percentage) | -4.76% | 39.720 | 37.830 | - | 0.00% | - |
654.roms_s (max) (percentage) | -4.76% | 87.450 | 83.290 | - | 0.00% | - |
649.fotonik3d_s (max) (percentage) | -4.76% | 46.680 | 44.460 | - | 0.00% | - |
657.xz_s (max) (percentage) | -4.75% | 35.770 | 34.070 | - | 0.00% | - |
510.parest_r (max) (percentage) | -4.75% | 31.580 | 30.080 | - | 0.00% | - |
607.cactuBSSN_s (max) (percentage) | -4.74% | 39.860 | 37.970 | - | 0.00% | - |
654.roms_s (avg) (percentage) | -4.73% | 12.260 | 11.680 | - | 0.00% | - |
625.x264_s (max) (percentage) | -4.73% | 15.650 | 14.910 | - | 0.00% | - |
644.nab_s (max) (percentage) | -4.71% | 4.880 | 4.650 | - | 0.00% | - |
657.xz_s (avg) (percentage) | -4.70% | 5.110 | 4.870 | - | 0.00% | - |
600.perlbench_s (avg) (percentage) | -4.67% | 4.070 | 3.880 | - | 0.00% | - |
649.fotonik3d_s (avg) (percentage) | -4.53% | 6.620 | 6.320 | - | 0.00% | - |
657.xz_s | -4.50% | 111.000 | 106.000 | - | 0.00% | - |
657.xz_s (avg) | -4.50% | 111.000 | 106.000 | - | 0.00% | - |
657.xz_s (max) | -4.49% | 779.000 | 744.000 | - | 0.00% | - |
605.mcf_s | -4.41% | 272.000 | 260.000 | - | 0.00% | - |
605.mcf_s (avg) | -4.41% | 272.000 | 260.000 | - | 0.00% | - |
638.imagick_s (max) | -4.35% | 667.000 | 638.000 | - | 0.00% | - |
641.leela_s (avg) (percentage) | -4.26% | 1.880 | 1.800 | - | 0.00% | - |
638.imagick_s | -4.20% | 119.000 | 114.000 | - | 0.00% | - |
638.imagick_s (avg) | -4.20% | 119.000 | 114.000 | - | 0.00% | - |
600.perlbench_s (max) | -4.01% | 349.000 | 335.000 | - | 0.00% | - |
649.fotonik3d_s (max) | -3.92% | 4564.000 | 4385.000 | - | 0.00% | - |
654.roms_s (max) | -3.91% | 20349.000 | 19553.000 | - | 0.00% | - |
654.roms_s | -3.86% | 2852.000 | 2742.000 | - | 0.00% | - |
654.roms_s (avg) | -3.86% | 2852.000 | 2742.000 | - | 0.00% | - |
605.mcf_s (avg) (percentage) | -3.83% | 4.440 | 4.270 | - | 0.00% | - |
620.omnetpp_s | -3.78% | 185.000 | 178.000 | - | 0.00% | - |
620.omnetpp_s (avg) | -3.78% | 185.000 | 178.000 | - | 0.00% | - |
644.nab_s (max) | -3.77% | 504.000 | 485.000 | - | 0.00% | - |
649.fotonik3d_s | -3.71% | 647.000 | 623.000 | - | 0.00% | - |
649.fotonik3d_s (avg) | -3.71% | 647.000 | 623.000 | - | 0.00% | - |
600.perlbench_s | -3.70% | 81.000 | 78.000 | - | 0.00% | - |
600.perlbench_s (avg) | -3.70% | 81.000 | 78.000 | - | 0.00% | - |
625.x264_s | -3.33% | 30.000 | 29.000 | - | 0.00% | - |
625.x264_s (avg) | -3.33% | 30.000 | 29.000 | - | 0.00% | - |
623.xalancbmk_s (avg) (percentage) | -3.23% | 1.860 | 1.800 | - | 0.00% | - |
620.omnetpp_s (avg) (percentage) | -3.19% | 4.700 | 4.550 | - | 0.00% | - |
619.lbm_s (avg) (percentage) | -3.15% | 12.400 | 12.010 | - | 0.00% | - |
641.leela_s | -3.12% | 64.000 | 62.000 | - | 0.00% | - |
641.leela_s (avg) | -3.12% | 64.000 | 62.000 | - | 0.00% | - |
511.povray_r (avg) (percentage) | -3.10% | 1.290 | 1.250 | - | 0.00% | - |
508.namd_r (avg) (percentage) | -2.78% | 1.440 | 1.400 | - | 0.00% | - |
648.exchange2_s (avg) (percentage) | -2.73% | 1.100 | 1.070 | - | 0.00% | - |
603.bwaves_s (avg) (percentage) | -2.33% | 5.160 | 5.040 | - | 0.00% | - |
623.xalancbmk_s | -1.72% | 58.000 | 57.000 | - | 0.00% | - |
623.xalancbmk_s (avg) | -1.72% | 58.000 | 57.000 | - | 0.00% | - |
619.lbm_s | -1.59% | 3647.000 | 3589.000 | - | 0.00% | - |
619.lbm_s (avg) | -1.59% | 3647.000 | 3589.000 | - | 0.00% | - |
Added Tests - Execution |
---|
627.cam4_s |
Added Tests - sample variability |
---|
627.cam4_s |
627.cam4_s (avg) |
627.cam4_s (max) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (max) |
Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
657.xz_s | 5.12% | 150385.000 | 158085.000 | - | 0.00% | - |
600.perlbench_s | 4.72% | 2649560.000 | 2774715.000 | - | 0.00% | - |
508.namd_r | 4.25% | 707624.000 | 737678.000 | - | 0.00% | - |
607.cactuBSSN_s | 3.89% | 3684442.000 | 3827616.000 | - | 0.00% | - |
510.parest_r | 2.09% | 1733486.000 | 1769678.000 | - | 0.00% | - |
526.blender_r | 2.07% | 11474556.000 | 11711934.000 | - | 0.00% | - |
623.xalancbmk_s | 1.17% | 3748643.000 | 3792516.000 | - | 0.00% | - |
644.nab_s | 1.16% | 105482.000 | 106710.000 | - | 0.00% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
644.nab_s | 2.52% | 10194.000 | 10451.000 | - | 1.06% | - |
607.cactuBSSN_s | 1.98% | 4798.000 | 4893.000 | - | -0.26% | - |
508.namd_r | 1.08% | 2408.000 | 2434.000 | - | 0.58% | - |
603.bwaves_s | 1.08% | 9021.000 | 9118.000 | - | 2.11% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
625.x264_s | -4.92% | 646275.000 | 614450.000 | - | 0.00% | - |
648.exchange2_s | -4.60% | 164878.000 | 157286.000 | - | 0.00% | - |
649.fotonik3d_s | -3.10% | 343226.000 | 332581.000 | - | 0.00% | - |
620.omnetpp_s | -2.91% | 1922167.000 | 1866178.000 | - | 0.00% | - |
641.leela_s | -2.60% | 108742.000 | 105916.000 | - | 0.00% | - |
619.lbm_s | -1.73% | 13445.000 | 13213.000 | - | 0.00% | - |
603.bwaves_s | -1.07% | 52595.000 | 52031.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
628.pop2_s | -99.71% | 10109.000 | 29.000 | - | 11.54% | - |
625.x264_s | -8.92% | 1626.000 | 1481.000 | - | 0.20% | - |
623.xalancbmk_s | -6.49% | 3407.000 | 3186.000 | - | 0.85% | - |
657.xz_s | -5.82% | 2319.000 | 2184.000 | - | 0.28% | - |
600.perlbench_s | -5.81% | 2152.000 | 2027.000 | - | 0.85% | - |
511.povray_r | -5.36% | 373.000 | 353.000 | - | -0.56% | - |
605.mcf_s | -4.63% | 6394.000 | 6098.000 | - | -0.67% | - |
641.leela_s | -4.36% | 3605.000 | 3448.000 | - | -0.26% | - |
648.exchange2_s | -3.45% | 1422.000 | 1373.000 | - | 0.29% | - |
654.roms_s | -2.32% | 24034.000 | 23477.000 | - | 0.89% | - |
602.gcc_s | -2.28% | 4126.000 | 4032.000 | - | -0.22% | - |
649.fotonik3d_s | -2.21% | 10088.000 | 9865.000 | - | 0.88% | - |
526.blender_r | -1.81% | 9950.000 | 9770.000 | - | -0.33% | - |
Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
nb_compile_successful | 91.67% | 24.000 | 46.000 | - | 0.00% | - |
nb_total_tests | 91.67% | 24.000 | 46.000 | - | -8.00% | - |
nb_execution_successful | 82.61% | 23.000 | 42.000 | - | -4.55% | - |
Added Tests - Execution |
---|
627.cam4_s |
Added Tests - sample variability |
---|
508.namd_r |
508.namd_r (avg) |
508.namd_r (avg) (percentage) |
508.namd_r (max) |
508.namd_r (max) (percentage) |
510.parest_r |
510.parest_r (avg) |
510.parest_r (avg) (percentage) |
510.parest_r (max) |
510.parest_r (max) (percentage) |
511.povray_r |
511.povray_r (avg) |
511.povray_r (avg) (percentage) |
511.povray_r (max) |
511.povray_r (max) (percentage) |
526.blender_r |
526.blender_r (avg) |
526.blender_r (avg) (percentage) |
526.blender_r (max) |
526.blender_r (max) (percentage) |
600.perlbench_s |
600.perlbench_s (avg) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) |
600.perlbench_s (max) (percentage) |
603.bwaves_s |
603.bwaves_s (avg) |
603.bwaves_s (avg) (percentage) |
603.bwaves_s (max) |
603.bwaves_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
607.cactuBSSN_s |
607.cactuBSSN_s (avg) |
607.cactuBSSN_s (avg) (percentage) |
607.cactuBSSN_s (max) |
607.cactuBSSN_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
621.wrf_s (avg) (percentage) |
621.wrf_s (max) (percentage) |
623.xalancbmk_s |
623.xalancbmk_s (avg) |
623.xalancbmk_s (avg) (percentage) |
623.xalancbmk_s (max) |
623.xalancbmk_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
627.cam4_s |
627.cam4_s (avg) |
627.cam4_s (avg) (percentage) |
627.cam4_s (max) |
627.cam4_s (max) (percentage) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (avg) (percentage) |
628.pop2_s (max) |
628.pop2_s (max) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
648.exchange2_s |
648.exchange2_s (avg) |
648.exchange2_s (avg) (percentage) |
648.exchange2_s (max) |
648.exchange2_s (max) (percentage) |
649.fotonik3d_s |
649.fotonik3d_s (avg) |
649.fotonik3d_s (avg) (percentage) |
649.fotonik3d_s (max) |
649.fotonik3d_s (max) (percentage) |
654.roms_s |
654.roms_s (avg) |
654.roms_s (avg) (percentage) |
654.roms_s (max) |
654.roms_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
Report Time: 0.36s