Hi Bro,
Today after trying a lot of distros and images (uboot part as well) it turned out one specific uboot is working fine stock Debian and Armian image as well.
I followed this how to: https://github.com/inindev/odroid-m1/tree/main/uboot
with the latest loader from this repo: https://github.com/inindev/odroid-m1/releases
Have to be checked what is the difference between this and armbian uboot images.