all 10 comments

sorted by: hot top controversial new old
[–] 22 points 1 week ago* (3 children)

All we need now is affordable hardware with the memory to store that much context.

  • source
  • hideshow 3 child comments
  • [–] 7 points 1 week ago

    Fantastic news. My only gripe with 3.8 is that 262k is very limiting with all the reasoning the model does.

    Pi ends up compacting history 3-4 times for larger tasks before it finishes.

  • source
  • [–] 3 points 1 week ago (4 children)

    So they didn't even start training it?

  • source
  • hideshow 4 child comments
  • [–] [S] 1 point 1 week ago (3 children)

    They most likely used a local fork for a while.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 week ago* (2 children)

    If that were the case wouldn't they just merge the working local fork rather than merging and reviewing changes one by one?

  • source
  • parent
  • hideshow 2 child comments