574
I'm witnessing the death of my profession (discuss.tchncs.de)
submitted 1 week ago by to c/fuck_ai@lemmy.world
300 comments fedilink hide all child comments
 

Just to make this clear up front: I was always very skeptical of LLMs (I'll never call them AI) and still see them as fundamentally limited and unreliable. See my post history if you don't believe me.

Having said that: I work in business software and the models have progressed to the point where typing code and writing classes and functions by hand has become uneconomical. We review the output closely to avoid the idiocy of "vibe-coding", but the quality has improved to the point where we rarely have to outright reject solutions. The discussions have moved to high-level architectural points, where we just request better implementations than the first-shot. We get them, review again and move on. Maybe there are deeper, latent problems beeing embedded in the code-base through this process, but we can't spot any although we are looking intently.

And just like that, my profession has died. Nobody in my team writes code anymore. Things that would have taken days are now done in minutes. We are all just considering design and architecture. We are changing our processes since they are not fit for the new way of doing things. Scrum? What's even the point anymore? We can work through a sprint-backlog that would've taken two weeks in two days now. We do reviews 90% of the time. When we request changes they come back in minutes.

I have a feeling like the ground has been taken from below me. My son wanted to become a developer, that isn't a real job anymore. Everyone around me feels the same way, including our management. We are a small team and a small company, everyone is effective and our jobs are not in danger as long as our product is succesful. But my profession is essentially dead. It's a craft I honed for many, many years and the craft itself is now automated. I wanted to improve my typing skills to code faster, this is now a ridiculous endeavour. We don't know what comes next, but I now only have my analytical skills and knowledge of good architecture to fall back on.

And it all changed so fast. I don't think this will transfer to other professions so easily, but for programming LLMs ended it all in the span of the last four months. I thought I knew what my future holds as a senior dev, now I can barely see past christmas.This is a nightmare.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 days ago (1 child)

Calculators don't need to change because arithmetic doesn't change. They don't have a moving target. But with code, languages gain new features over time and new languages get developed altogether. Same is true for libraries, frameworks, platforms etc. New CPU designs change what code is optimal, ways of designing software go in and out of favour and so on. And you can only take having the model read documentation or explicitly instructing it to do things in a certain way so far. So a model that doesn't get updated will definitely become less relevant over time, and these days that would be pretty quickly.

I don't think CPUs and RAM managing to move beyond what were thought to be plateaus is a very meaningful precedent. For those, the rules that govern what sequence of inputs lead to what outputs are defined externally from the implementation. As long as it enforces those rules, whatever Rube Goldberg machine is between the inputs and outputs is only really bound by physics (...and the IC manufacturing process), so there's a lot of flexibility in how they can be designed.

But for a neural network, those rules are encoded in the model itself, i.e. the expensive bit. So you can't really fundamentally restructure it without having to do the training all over again, and there are only so many ways you can represent a given model in memory and optimisations are pretty limited in what they can avoid doing. Like yeah, given the sheer size of these models, minimising the amount of memory reads through batching will absolutely have a meaningful effect on performance, but you're pretty limited by memory how big those batches can be (especially given how large context windows get with "agentic" use) and you're ultimately still doing the same number of calculations. These affect the incline of the curve more than they do the shape.

And again, advancement in this area depends on continuing investment.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 6 days ago

    Once a model knows python 3.14 there's little need to update it until 3.14 is EOL. Most professional settings pin dependencies and runtimes and only move them for security issues or planned migrations.

    Several embedded platform only support C++14 as the latest target. That's a lag of 10 or more years. This is similar to how the calculator chips are redone once a decade or so depending on new fab process giving enough benefits. Once something gets used for years, a large investment makes more sense than the current senseless frontier models every month or two.

  • permalink
  • fedilink
  • source
  • parent