running a model on a reasonably specced laptop

my 128GB M5 Max MacBook Pro

TIL a $7000 laptop is "reasonably specced"

im not bothered by it.
but also.. i wouldn't use it as my sole model to perform every task. [waves hand toward huggingface.] ( a gazillion bajillion models, specialized for all types of tasks).

edit: i checked. and there aren't as many models as i expected, for this task(didnt test them). and.. small multimodal model failed badly(see picture of the iguana .. or whatever the hell that is)
it's a strange benchmark. but it seems reasonable to expect LLMs to be able to do this.

Just like me fr

i tried using it as conversation agent for home assistant and it always calculated the dates wrong

Same

Me too, Queen 3.8 27B. Me too.

Waiting for some Cortecs provider to make it available.... I use these small models usually without thinking. Don't feel like thinking helps a lot; if you need thinking maybe just use a slightly more powerful model IMO.