you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 9 months ago

Let me know when they create an alternative to transformers, pytorch, and create a tokenizer without the Open AI QKV hidden layers of alignment. That is where all the fuckery is happening. This is standard and used for all models. It is totally proprietary and a primary reason why they are "open weights" but not Open Source.

  • source