That's why most places use "core hours" for varied schedules.
If you need collaboration then you do it from 10 AM to 2 PM. Everyone works those hours whether you leave early, or come in late. Any meetings should happen in those times.
This isn't a difficult problem to solve.
If you can't regularly get your job don't with a few hours of not having immediate assistance - I feel like you probably need to rethink your processes, or who you're employing.