So let's talk about the Anthropic models, cause that's what I'm playing with on the company dime.
Wire up a few mcp configs (don't even start me on the inherent risks associated with current MCP permissions model...) and give it a run book and it's great at generating reports for me about stuff I kinda care about.
Could if replace an entry level grad? Sure. Will that company have all kinds of strange problems - hell yes. Think of it as an intern. You can give it all the crappy intern tasks while you make coffee. Only the intern improves when you give feedback...