Yes but unless you're a statistical outlier that still won't make a significant difference to counting calories. When it comes to gaining or losing weight yes it is purely calorie in calorie out. The difference in caloric maintenance between an active lifestyle and a sedentary one is 4 to 6 hundred kcal. That's a bowl of cereal. Your metabolism has little overall impact.