@Spo0lsh This makes sense!.
This looks like an equivalent of the "vendor-provided fix" I got from Orange Pi folks. Re-flash SPi with current, good u-boot, and all of sudden things work again. It seems that the DDR driver included with u-boot might be the culprit. I originally had V1.08 20220617 and it was unstable. With the update, I have
DDR d5483af87d cym 23/11/23-16:15:24,fwver: v1.15
and things are looking good.
The commit message in rockchip-linux/rkbin (place where si0ls/u-boot-orangepi5 gets its blobs from) says "rk3588: ddr: update ddrbin to v1.16". So, chances are, the u-boot there has a DDR driver v1.16
Armbian latest 24.5.1 bookworm image seems to contain u-boot with DDR driver version V1.08 20220617. So, if this gets flashed in SPI, Orange pi5 plus (32 GB version) will become unstable.
In hindsite, this is what happened to me.