It took me a bit to figure out how to make a call (definitely bad UX). What got it working for me was adding the other user as a contact (beyond just messaging them, it's like a different thing), and then making sure they also added me as contact, and each person accepted that contact request, then the call button seemed to show up, and the call worked fine, even video.