bountygiver comments on Managers

People Twitter

10,578 readers

4,722 active

165 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

Mark NSFW content.
No doxxing people.
Must be a pic of the tweet or similar. No direct links to the tweet.
No international politcs
Be excellent to each other.
Provide an archived link to the tweet (or similar) being shown if it's a major celebrity, figure or any politician

https://www.sotwe.com/
https://twitterviewer.net/Note: Archive.is is no longer recommended because they remove/alter content.

If a tweet (or similar) makes a statement of fact, either mark it as "satire" in the body or provide the original source link backing up the statement (see rule 6)

founded 3 years ago

moderators

[–] bountygiver@lemmy.ml 57 points 5 months ago (2 children)

Show them claude's operating cost and ask if your boss is willing to invest in that.

permalink

fedilink

source

hideshow 2 child comments

[–] phx@lemmy.world 2 points 5 months ago (1 child)

I do wonder about that though. The Big AI operating costs include being able to service a certain number of customers within a certain amount of time. So if they need to service 10,000 requests per minute and fulfill them within 2-4 seconds, that's a big datacenter.

Now if a company does a few dozen requests a minute and on average needs double-digit response times... the costs to implement could be much different. The thing is finding a model that will do that and provide accurate (enough) output versus how much it Claude's pricing is built around speed+volume versus accuracy.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] bountygiver@lemmy.ml 3 points 5 months ago

A lot of cost is on training it as well. Which you need if you want to "build your own claude". If you run only the inferences with an open model then ya it's directly correlated to how fast you want the responses to come in.

permalink

fedilink

source

parent