I do wonder about that though. The Big AI operating costs include being able to service a certain number of customers within a certain amount of time. So if they need to service 10,000 requests per minute and fulfill them within 2-4 seconds, that's a big datacenter.

Now if a company does a few dozen requests a minute and on average needs double-digit response times... the costs to implement could be much different. The thing is finding a model that will do that and provide accurate (enough) output versus how much it Claude's pricing is built around speed+volume versus accuracy.