you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 1 year ago (1 child)

It also sets context length to 2k by default iirc, which breaks a lot of tasks, and gives a general bad first impression to users who are likely using local models for the first time.

  • source
  • parent
  • hideshow 1 child comment