Anxiety might help, but it's probably more likely that you eat "trash" but just not a lot of it. If you count your calories you probably eat a pretty reasonable amount for whatever your weight is. Especially if you're a tall man, you can potentially eat up to like 2500-3000 calories a day without really gaining weight.

Also a real killer for people is sugary drinks, alcohol, and other liquid calories. I dunno if you drink any, but those add up fast.