Nope, not top, but apparently not awful (seems to be her husband coding). Some interesting things happening currently with memory systems for local AI which seem to truly enhance (make smarter) smaller thinking models, meaning you can use more, and more coherent context.

As with most of this stuff I'm waiting for a bit more maturity before looking deeply at it, but there's definitely some excitement at the moment, and it has the potential to make models that fit on say a 16GB video card capable of many more use cases than previously.

Are we now just bumbling random words together?

Probably slop all the way down.

I had read randomly in a comment somewhere that this was already shown to be basically a scam. Totally unverified, but it sure has the smell of one.

It is based off of other open source code, which is actually where the performance comes from (ChromaDB).