There where no tasks running outside whatever is setup out of the box when installing jellyfin. I have recently discovered that jellyfin can delete your media if it thinks the media has been removed...

Wierdest logic by the devs.