Update :
I haven't downgrade to bullseye, but seeing there's a new update for the bookworm, I try it.
it seems this latest update is making it stable:
linux-dtb-current-sunxi:armhf (24.2.1, 24.5.1), linux-u-boot-orangepione-current:armhf (24.2.1, 24.5.1), linux-image-current-sunxi:armhf (24.2.1, 24.5.1)
been running for 48 hours without error.
I even tried to install the newest armbian-firmware yesterday.