I checked the drive's health with badblocks tonight, which wiped everything unfortunately.
Then I tried another distro (Ubuntu) and the issue was gone.
I didn't check the hash for failing files, but I downloaded with rsync also and the issue still happened.
Thank you very much for your help though. When I find the time I'll reinstall Fedora, and if the issue repeats itself I'll do more tests.