I haven't heard discussion on this topic, but isn't it possible for the LLM to interpret that 30k as good, reinforcing its own bad habits?
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I haven't heard discussion on this topic, but isn't it possible for the LLM to interpret that 30k as good, reinforcing its own bad habits?