An update to my issue, I tried to make a image with ddrescue from my card but the hash did not match. I then tried to make a new hash from the card and surprise surprise the hash was not the same as the first time.
I replaced the card and tried md5sum again and now I get the same hash everytime, so you were correct the SD was crap And that is why I couldn't clone it either...