you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago

You can control how much context should be fitted with --fit-ctx and how much space the algorithm should leave unallocated (even on a per-GPU basis) with --fit-target.

  • source
  • parent