So basically the problem is bus factor = 1 and that one person is often away from the hardware and not able to remote in.
This has been happening for a long time it sounds like? This is very unfortunate but really could've been avoided with some planning it feels like.