you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago

So - I setup that model according to the docs and gave it this prompt:

Write me a highly optimized n-queens solver in go. It should take advantage of parallelism (what little there is) and output only the solution and how long it took.

After 10 minutes it gave me code that didn't compile.

It took another 3 mins to fix the compile error and the output is not correct.

As I said - LLMs on 8Gig VRAM just aren't worth it.

  • source
  • parent