Exactly! LLMs are useful when used properly, and terrible when not used properly, like any other tool. Here are some things they're great at:
- writer's block - get something relevant on the page to get ideas flowing
- narrowing down keywords for an unfamiliar topic
- getting a quick intro to an unfamiliar topic
- looking up facts you're having trouble remembering (i.e. you'll know it when you see it)
Some things it's terrible at:
- deep research - verify everything an LLM generated of accuracy is at all important
- creating important documents/code
- anything else where correctness is paramount
I use LLMs a handful of times a week, and pretty much only when I'm stuck and need a kick in a new (hopefully right) direction.