you are viewing a single comment's thread
view the rest of the comments
[–] 15 points 8 months ago* (last edited 8 months ago) (2 children)

More like a manual. Google has become really shitty for complex queries, LLMs can find relevant keywords, documents much more realiably. Granted, if you are asking questions about niche libraries it hallucinates functions quite often so I never ask it to write full pieces of code but just use it more like a stepping stone.

I find it amusing how shamelessly it lies about its hallucinations though. When I point out that a certain function it makes up does not exist the answer is always sth of the form "Sorry you are right that function existed before version X / that function existed in some of the online documentation" etc lol. It is like a halluception. If you ask it to find some links regarding these old versions or documentations they also somehow don't exist anymore.

  • source
  • hideshow 2 child comments
  • [–] 2 points 8 months ago (1 child)

    I wonder if you need to explicitly prompt it to check if a function really exists before suggesting it? Think about how a human brain works... we are constantly evaluating whether or not things are really true based on info in our heads... but we are not telling the models to do the same thing and instead they just yolo some shit that is confidently-wrong (not unlike many humans, admittedly).

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 8 months ago

    Yeah I am not a very efficient user that is for sure, I just ask my question as if typing to a search engine. If one uses a specification document like more serious users do, it probably becomes more accurate.

  • source
  • parent