I tried to replicate this issue on i686 box running Debian Bookworm and it works there, no problem.
1) Create file for disk, 50GB
# dd if=/dev/zero of=xfstest.bin bs=1M count=50000
2) Format disk with XFS
# mkfs.xfs xfstest.bin
3) show XFS details
# xfs_info xfstest.bin
meta-data=/dev/loop0 isize=512 agcount=4, agsize=3276800 blks
= sectsz=512 attr=2, projid32bit=1
= crc=1 finobt=1, sparse=1, rmapbt=0
= reflink=1 bigtime=1 inobtcount=1 nrext64=0
data = bsize=4096 blocks=13107200, imaxpct=25
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096 ascii-ci=0, ftype=1
log =internal log bsize=4096 blocks=16384, version=2
= sectsz=512 sunit=0 blks, lazy-count=1
realtime =none extsz=4096 blocks=0, rtextents=0
4) mount FS, no issue here!
# mount -o loop xfstest.bin /srv
#
# mount | grep xfs
/root/xfstest.bin on /srv type xfs (rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota)
5) check dmesg
# dmesg | grep XFS
[2992759.600513] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled
[2992759.618175] XFS (loop0): Mounting V5 Filesystem
[2992759.649994] XFS (loop0): Ending clean mount
6) system info, kernel is 6.1.0
# uname -a
Linux worm 6.1.0-12-686-pae #1 SMP PREEMPT_DYNAMIC Debian 6.1.52-1 (2023-09-07) i686 GNU/Linux
#
# dpkg -l | grep xfsprogs
ii xfsprogs 6.1.0-1 i386 Utilities for managing the XFS filesystem
So, I assume that issue is really the kernel 5.x that is delivered with Armbian for Odroid XU4 (HC1/HC2)...