I had installed stuff and slightly increased the system space usage, it's likely it was bigger than the partition created for the system on the eMMC. Since the whole system is copied as is, I assume it tried to copy the whole thing with the additional stuff and went over the available space.
After flashing a fresh install into the SD card, I tried it again and it worked first try.
