I think this is a good perspective, it's important to recognize that things are always changing. Newer LLMs when provided enough context are much more capable than something like GPT-4 which is what I think most people were exposed to. I think a lot of people tried using ChatGPT, GPT-4 first released in March 2023 was the huge initial hype. I have no doubt that LLMs are able to assist with math successfully.