There are a lot of people out there who would take the opportunity if it presented itself, but that doesn't mean they're not really your friend or that you need to worry about them trying anything while you're in a relationship. I'd say your boyfriend is right to be a little wary as long as he isn't trying to use this as a reason to be controlling (which it sounds like he's not).