I can't test with other sd, I a have only 3 sdhc memory and all have same issue.
I compile linux in buildroot with all armbian patch (5.10, 5.15) and try with different uboot and atf and I have the same problem.
Also I use the libreelec/lakka patch with buildroot and the board boot always without issue with linux kernel 5.10.109. (uboot+atf+crust)