Full circle (lemmy.ugjka.net)
submitted 6 months ago by to c/fuck_ai@lemmy.world
:facepalm: 3
 

all 35 comments

sorted by: hot top controversial new old
[–] 122 points 6 months ago (7 children)
  • [+] 80 points 6 months ago* (3 children)
  • [–] 35 points 6 months ago (2 children)

    The limitation of 'simple code' makes me think it has to be a joke, since it's the opposite of usual expectations.

    If it's too expensive for simple code, it's too expensive for all code.

    To the extent it gets expensive, it's more likely with higher end code.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 6 months ago (1 child)

    I love watching people discussing AI taking over programmer jobs. I mean I hate that its happening and wish it would just stop, but I still like watching the general tone change.

    it can never. Its science fiction

    well ok kinda but it can never understand what its doing, it can only parrot semi random code that looks right

    well ok it can do some properly but it can never do the job well enough to replace us

    well ok but its too expensive

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 6 months ago

    Multiple things can be true at once.

    The scenario where it was incredibly expensive for a task at work was because someone rigged it to do it until all the tests pass, and it got in a loop where it never passed. So they spent a lot of money to get nowhere.

    This is the workaround for it not being very good that drives expense. It's not expensive to generate code once, but it frequently fails. There a non zero chance that a retry with stuff about the failure in the context window will work, so the current situation is you are supposed to have the correct state as perfectly modeled with test cases, example implementation, whatever and then rig it to retry until it works. Which is a lot of work, frequently impossible to really do, and frequently still ends in failure so in practice you probably should cap it at 3 or 4 retries.

    But this particular thread discussed cost, so other issues were off topic.

  • source
  • parent
  • [+] 1 point 6 months ago (3 children)
  • [–] 3 points 6 months ago

    Agentic coding would still have the context issues of changing code whether it’s AI or a human: somebody changed something, how do you record that for the next person. You either log it in memory or point it to the git PR, either way it needs to surface the changes.

    So yeah, if AI is too expensive to code small problems for a given company than it’s too expensive for them period.

  • source
  • parent
  • load more comments (-1 replies)
    [–] 69 points 6 months ago* (5 children)

    For those asking / pronouncing this has to be satire, perhaps. But not for long. AI is still not making a profit. So whatever it costs today at the growth-at-all-costs subsidized rate, think how much more expensive it will be when investors start insisting on profit after market consolidation*.

    Because if you think there is a competitive barrier to entry for smartphones, operating systems, CPUs, and streaming services, you ain't seen NOTHING yet

  • source
  • hideshow 5 child comments
  • [–] 18 points 6 months ago (3 children)

    They're spending $3 per $1 of revenue. The price per token will rise dramatically.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 9 points 6 months ago* (2 children)

    I suspect it's even worse than that.

    A Claude Max subscription is $200 a month, which is roughly $7 a day. I'm forced to use Claude Code at work, and I frequently run the /usage command out of morbid curiosity to see how many tokens in wasting. I'm not exactly a power user, but even with my bare-minimum usage I typically burn about $50 of tokens per day — so roughly 7 times that $7 a day figure.

    And that's just based on Anthropic's official per-token pricing, which itself is almost certainly subsidized... so it's likely I'm costing them something closer to $20-$30 for every $1 of revenue. And again, I'm only using it for the bare minimum. I know people with much higher usage than me.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 6 months ago (1 child)

    Similar boat, lots of people on the loss-leading phase, 'the first hit is free/cheap' is in play and I know development organizations that are explicitly designing hard dependencies on hosted AI as the 'foundation' of their processes. They are going for mainframe-style lockin where customers are too scared to change when it gets too expensive.

    I know one organization that at least is being more careful, their LLM usage is only based on whatever they can run indefinitely on-premise without sweating future traps around pricing changes.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 6 months ago

    Yeah. I would prefer to work at an organization that uses no AI at all, but at the very least companies should be moving to on-prem local models so that they don't suddenly get rug-pulled the moment the investment cash runs out and AI firms are forced to raise prices or die.

    I've been yelling this at my own org for months, but no one cares.

    Move fast and break things, even if the thing you're breaking is your own fucking business...

  • source
  • parent
  • [–] 59 points 6 months ago (2 children)

    Except now everyone is getting paid less

  • source
  • hideshow 2 child comments
  • [–] 44 points 6 months ago (1 child)

    This is exactly what it is for.

    It is to scare tech workers to accept lesser salary.

    LLM is just great at fooling people to think it is greater at something than it actually is.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 32 points 6 months ago

    Congrats on LLM agents on the promotion. One day maybe they'll even make it to management.

  • source
  • [–] 28 points 6 months ago (3 children)

    Junior Developer doesn't boil oceans to do their job

  • source
  • hideshow 3 child comments
  • [–] 2 points 6 months ago

    We don't usually take into account what employees do to nature on their spare time.

    In a way, we would have to equate all the money spent on employees and what it is used for.

    Getting rid of an employee would surely be a net gain for the environment, right? If an LLM could offset 50 employees, perhaps that would be neutral in that sense.

    This doesn't make a lot of sense, esoecially morally. We can't really blame the company for what employees do out of work, can we?

  • source
  • parent
  • [–] 14 points 6 months ago

    that is not a morale building tweet

  • source
  • [–] 2 points 6 months ago (1 child)

    no they will just hire a senior engineer, and have a bunch of low wages from eastern europe or south america to do the work.

  • source
  • hideshow 1 child comment
  • [–] 1 point 6 months ago

    Capitalism...so innovative

  • source
  • [+] -6 points 6 months ago (9 children)
  • [–] 16 points 6 months ago (8 children)

    Satire is dead, reality is absurd. Imagine how actual boomers are processing the world right now? Why do you think fox news is taken seriously by half the population?

  • source
  • parent
  • hideshow 8 child comments
  • [+] -1 points 6 months ago (7 children)
  • [–] 4 points 6 months ago (6 children)

    Sorry to break it to you, but this problem is not limited to the US. The US is just a really big and obvious example.

  • source
  • parent
  • hideshow 6 child comments
  • [+] 1 point 6 months ago* (5 children)
  • [–] 1 point 6 months ago

    there have been people in my country who, when confronted with the choice between voting for a candidate that promised to legalise same-sex civil union and a candidate that praised a dictator that was allied with nazi germany during world war 2 and said the west is putting microchips in soda, chose the latter

    the second candidate was predicted to win before the election was cancelled (and later the candidate banned) due to russian connections

    i have seen teachers talk about how great the current president of the united states is, the ruler of a country half a continent and an ocean away

  • source
  • parent
  • [–] 0 points 6 months ago (3 children)

    Exactly what I said, good job on your reading comprehension.

  • source
  • parent
  • hideshow 3 child comments
  • [+] -1 points 6 months ago* (2 children)