I recommend trying to make your own Markov chain based chatbot. You can produce grammaticality correct nonsense just by using raw probability and without even attempting to categorize words as nouns or verbs. All you need is a dataset to build your probabilistic model... Sounds familiar?

I'm not a CS major and I don't know exactly how LLMs work but I think you will find Markov chains interesting and highly relevant.