New NVIDIA paper says AI models do not always need huge amounts of past conversation history (context) to work well. They show that regularly shortening the history (compaction) keeps accuracy almost the same on hard, long tasks.

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 3 days ago

The robots would probley be better off with out us. We would probley be better off with out them. Its a two way street.

  • source
  • parent