The lunch thing is definitely something I miss, and the white board collaborations. I haven't found any decent equivalent virtual tool for the latter, and if you're starting a new job in-person collaboration can be a jump start.

That said I've worked remote for a decade and the pros outweigh the cons greatly. A huge perk for me is being able to workout at lunch in my home gym. I'm not a morning person and I'm often so drained by end-of-day that working out after work is a non-starter. I know my physical health would be worse if I had to go into an office because I just wouldn't end up working out like I do now.