The scraping wouldn’t be a problem if Reddit simply provided an RSS feed or other data-efficient API

Reddit does provide RSS feeds, e.g.: https://www.reddit.com/r/SonicTheHedgehog/.rss

Frankly, I'm surprised they still offer RSS feeds. They've been slowly but surely killing off all ways of accessing their content for years. One day they'll disable them, but for now they still work.