The original subreddit simulator ran on simple Markov chains.

Subreddit simulator GPT2 used GPT2, and was already so spookily accurate that IIRC its creators specifically said they wouldn't create one based on GPT3 out of fear that people wouldn't be able to tell the difference between real and not generated content