Context tokens are not directly based on the model unless talking about very large token counts. Context tokens come from the amount of memory it is given to work with, which costs more to host. Some models (not any of the Llama models) are better at managing this memory, but it still uses a lot of resources to host a large token context.

I agree, people have been waiting for over a year now since one of perchance's reddit mods said it will be updated, I think the mod's comment goes back to early/mid 2024, even if it was Llama 3, it will be a welcome change, but I feel like that Llama 3.3 will provide future proofing until the dev update to Llama 4 or 5 two or three years from now because of its superior context window size. The rapid progress of Ai is terrifying, it's like going from 8 gb of storage all the way to 1 Tb in a flash, don't be surprised if the upcoming models (not just Llama, all LLMs in general) have billions and billions of context windows, which will probably be enough to write someone's entire life story.