you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 10 months ago* (3 children)

Yes, that is the major problem with LLMs in general. There is no solution aside from "train on another different source (like Reddit)", but then we rinse & repeat.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 10 months ago (2 children)
  • [–] 2 points 10 months ago (1 child)

    I guess, though I'm pretty ignorant as to how RLVR would fix the issue that arises from new coding languages or even new major versions. I'm not sure how LLMs would ever get to a correct answer if they don't have good reference material to start from or reference.

  • source
  • parent
  • hideshow 1 child comment