you are viewing a single comment's thread
view the rest of the comments
[–] 72 points 4 months ago* (last edited 4 months ago) (30 children)

In my experience, AI is an amplifier.

Good engineers will produce more good code, because they ask the right questions, know what good looks like and check the output.

Bad engineers will produce reams more bad code. The mistakes they make will be amplified. They will give wrong and incomplete instructions, won't see what the problems are with the result and will ship it anyway.

This amplification also means people will spend a larger proportion of time reviewing than coding, which I think is less interesting.

All of this is stuff that can, to some extent, be addressed with policy. You help and instruct juniors, encourage people to better understand and own their code, or at worst reprimand them if they don't.

You can adjust expectations of product managers and explain to them that more is not better, as it always has been. Faster development can often come with bugs and tech debt and this is more of the same.

All I've said above is puts aside the ethical arguments of using or not using AI of course. That's a separate can of worms entirely.

  • source
  • hideshow 30 child comments
  • [–] 16 points 4 months ago (2 children)

    Good engineers will produce more good code, because they ask the right questions, know what good looks like and check the output.

    Best code is the code that is never written in the first place. But that concept is difficult to explain and measure for management purposes. Just because "AI" can automate well-structured, tested boilerplate for "good" developers does not mean all that boilerplate should be there.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 4 months ago* (last edited 4 months ago)

    Bad & meh engineers get praised because they "waste" less time directing ai and reviewing output - barely working is good enough in the race to market.

    I've seen things as serious as a privileged user for one customer having admin access to all customers being discovered during the last minute pentest literally days before the planned product launch. That product is supposed(and likely will) to move 250M USD for customers in the second half of this year. Under the current policy at my day job, coming all the way from the top, reviewing ai generated code at all should be an exception reserved for 0.1% most critical code. Yes, in finance.

  • source
  • parent
  • [–] 7 points 4 months ago* (last edited 4 months ago)

    Insane stuff.

    Hopefully, those are the sorts of companies that should fail or get sued, so they learn their lesson. Not holding my breath though.

    Companies have been doing insane shit for the sake of saving a buck or getting to market fast for decades, it's nothing new. AI may or may not just make it worse.

  • source
  • parent
  • [+] 1 point 4 months ago (1 child)
  • [–] 1 point 4 months ago

    The neck of the finance woods my employer is in is highly regulated.

    Just failing to notify a regulator on time you blocked a transaction attempt involving a sanctioned individual means hundreds of thousands in fines per transaction (not up to, flat 6-digit fine) + potential prison time (can't remember if it was up to 15 or 20 years)

  • source
  • parent
  • load more comments (-2 replies)
  • load more comments (-2 replies)
  • load more comments (-2 replies)
  • [–] 14 points 4 months ago* (12 children)

    Nah, good engineers are retiring, bad engineers are running rampant. You give yourself away calling us engineers, we were never, except for some yearly title increase instead of money. Just programmers, and that is fine. Engineer is a whole other thing from the steam age, my BSc was in Math, worked fine to get me in.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 41 points 4 months ago (12 children)

    Engineer is a whole other thing from the steam age, my BSc was in Math, worked fine to get me in.

    As a mechanical engineer, I would beg to differ. When you strip away all the fancy math, engineering is ultimately about critical thought and solving problems/achieving functionality with limited resources. As one of my professors liked to say, "Anyone can build a bridge to support a load, but only an engineer can design a bridge that just barely holds that load."

    Engineering is an ancient domain that goes back to the very beginnings of civilization and continues to grow with our needs as we progress. Where once it was just mechanical, we now have domains like electrical, materials, and biomedical engineering. If we've hit a point where we need engineers who specialize in software, why shouldn't we welcome in a new domain?

    While it does feel weird calling software developers 'engineers', that is arguably what they do. It's no less reductionist to suggest they are just programmers than it is to suggest that mechanical engineers are simply CAD and Excel jockeys. There's a layer of comprehension about the systems in play and how they can be manipulated that gets lost in the reduction.

    My only real sticking point about software engineers where I tend to push back is that Professional Engineer is a legally protected title and indicates licensure, at least in the US. It requires the right degree(s) and several years of work supervised by a PE to qualify for that licensure. The importance of the PE license is that you are recognized as an authority in your field- for good or ill. You can make big decisions, but you will also be held accountable if something goes wrong.

    In my experience, many software engineers brush aside the importance of those types of qualifications because their field wasn't quite as rigorous to enter. As we continue to develop a society where software mistakes can absolutely kill people (e.g. self-driving vehicles, robots, automated decision tools in medicine and insurance, etc) or cause massive economic damage, it's critical that we decide how software engineers play a role in preventing those things and how we hold them accountable when they don't.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 13 points 4 months ago

    Wow, that was a screed, (a worthy one) and yeah, an engineering degree should be special IMO, as perhaps a (pure) Math one. should also be. We have a tendency to regard you lesser, in self defense,, but that professional responsibility is significant, a more elegant weapon from a more civilized age. I do apologize,, the steam age thing was out of line (but meant with heart, trains rock, and IMO is where 'engineering' started) has it's roots.

  • source
  • parent
  • [–] 8 points 4 months ago* (3 children)

    As a software developer who also has a background in civil engineering and an EIT, I rue the fact that NCEES got rid of the software engineering PE exam before I had a chance to take it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 4 months ago (2 children)

    I didn't know NCEES even entertained doing a software engineering license, interesting. When was that?

  • source
  • parent
  • hideshow 2 child comments
  • [+] 6 points 4 months ago (1 child)
  • [–] 2 points 4 months ago* (last edited 4 months ago)

    You clearly have a lot more experience than me- I'm fairly fresh out the gate. Like you, though, I work in a field where licensure isn't super relevant (manufacturing).

    It was drilled into my head in school and by my dad (cheme but does civil work and is on the committee that writes the cheme PE) that that for some domains, like civil and chem, it's nigh impossible to find work without a PE (even entry level often requires at least the EIT accreditation).

    Our system is, frankly, still very wild-west in terms of accountability for engineers in emerging fields.

    It's deeply unfortunate that your experience with the accountability side of things went the way it did. That's another thing that they drilled into my head at school- if you sign a drawing and that part killed or hurt someone, the victims could call on you in a court of law to explain or even include you as a defendant in the suit. Does that always happen? Obviously not, but at least the possibly is there I guess.

    Agreed, but software has already had life-safety-critical and massively financially impactful roles in society for 50+ years now, and I see precious little progress toward formal accountability.

    Fully agreed here, I was just struggling to think of older life-critical examples after travelling for 22 hours lol (long day yesterday).

  • source
  • parent
  • [–] 1 point 4 months ago (6 children)

    Does the same argument apply to calling janitors custodians "sanitation engineers"? I've seen that some places.

    Like, if the word "custodian" is too offensive, then maybe it's just because the job sucks and comes with stigma, and anything you call it is going to sound derogatory after a few years...

    I get that it's a critical job, and the people in those roles should be treated with dignity and respect like everyone else. The social stigma is wrong, for sure. But simply changing the title doesn't solve anything...

  • source
  • parent
  • hideshow 6 child comments
  • [–] 5 points 4 months ago (5 children)

    What? That's a very different situation than what I was talking about with software development. I thought I pretty clearly outlined the core of what it means to be an engineer- Custodians aren't doing engineering work. As you said, that doesn't make the role less important or less deserving of dignity.

    Just calling someone an engineer because it sounds better is silly and demeans both the actual role and the work that engineers do.

  • source
  • parent
  • hideshow 5 child comments
  • [–] -1 points 4 months ago (4 children)

    Okay, so the argument does not apply to that situation. A simple "no" would have sufficed...

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 4 months ago (3 children)

    It is more useful to explain why something is wrong

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 4 months ago (2 children)

    Yeah the explanation was fine but the "What? That's a very different situation" seemed unnecessarily hostile. But maybe it just have my panties in a bunch today, it could be me

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 4 months ago* (1 child)

    I wasn't intentionally trying to be rude, it genuinely took me aback. I'm sorry to have come across that way.

    From my perspective, tt felt like you hadn't actually read my argument and were responding in bad faith, since this comparison is the sort of thing that people say to dismiss software engineering as a sort of thought-terminating cliche.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 4 months ago

    Oh, my bad. I didn't really need to take offense to it, I was probably just grumpy and didn't know what else to say. It wasn't that big a deal.

    But no, I wasn't trying to be dismissive of your argument qua software engineering, but I see how it came off that way. I think it was a good argument, I was just bringing up something tangentially related out of nothing more than free-association style banter. In hindsight it wasn't really that relevant to the conversation anyway...

  • source
  • parent
  • load more comments (-2 replies)
  • [–] 12 points 4 months ago* (last edited 4 months ago) (-1 children)

    Any shaved ape can code. One thing that distinguishes worthwhile coding from crap is adherence to engineering principles. Nitpicking about the semantics of the word "engineer" avoids the incontrovertible fact that empirically derived principles and best practices exist and that software engineering is a thing.

    Coincidentally, my MSc is in mathematics and statistics, after a dual BSc in math and physics, so we're from similar starting points. My education as a software engineer and later as a systems architect only came once I began coding. There's a considerable body of empirical knowledge in the literature (along with too much irreproducible fluffy bullshit), but in my experience, the general awareness of that knowledge is worse among the newer generation of coders than older ones. I suspect that's because they generally assume that the toolchain and processes do it for them.

    The widespread adoption of Scrum has been another source of knowledge loss: it's used in a number of situations where it does more harm than good, and even where it could succeed, it's often misapplied (partially because some agile principles are impossible to implement in most real-life organizations, so misapplication is the only posssible kind of application). There are times when architecture and design matter greatly, and some agile practicioners seem to actually believe that they can be done on the fly or major shortcuts can be taken. "We're not doing waterfall!" You know what? I've been in the business since before some of those fools were born, and I've never done a waterfall project. It was already an anti-pattern in Fred Brooks's 1970 magnum opus. Agile vs waterfall was always a false dichotomy. It's just that some of the OG agile people were too ignorant to know that, or too self-interested to admit it.

  • source
  • parent
  • hideshow -1 child comments
  • load more comments (-1 replies)
  • load more comments (-1 replies)
  • [+] 11 points 4 months ago* (last edited 4 months ago) (5 children)
  • [–] 13 points 4 months ago

    In my experience the time spent getting AI to do what I want can just be used to write good code in the first place.

  • source
  • parent
  • [–] 1 point 4 months ago* (last edited 4 months ago)

    I was just planning to do some sort of write up on this topic, although it will be internal only.

    Of the three projects I’m currently on

    • existing code base where AI sometimes has good ideas but almost never able to implement them successfully. This is legacy code, all human generated, and is probably too tightly coupled. Test framework is tightly coupled to the environment so ai cannot run it
    • new tool implementation to give cheaper and faster context across all repos (Spotify Backstage)
    • new code base almost entirely ai generated. Much more loosely coupled. There is no test /mock framework available, so it’s all scripts, which the ai is able to run at will to refine its guesses

    There’s definitely distinct conditions where ai can be the right tool and can succeed vs when it can’t. In managements blind rush to vibe code everything, they need to better understand where it works and where it doesn’t

    In particular, functionality I’m working on this week

    • existing code base ”modify function x to cover scenario y” at best gives a useful strategy
    • new code base “implement function x similar to existing code base, but that also covers scenario y” seems to work
  • source
  • parent
  • load more comments (-1 replies)
  • [–] 3 points 4 months ago (3 children)

    This is the first comment section i've seen on lemmy with a reasonable discussion about AI use that wasnt instantly downvoted into oblivion for being pro-AI

    Usually this place is full of the "EVERYTHING IS SLOP" crowd without any nuance as to how it is being actually used to do small tasks well under the supervision of a qualified person.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 13 points 4 months ago (2 children)

    This comment thread reads 100% like AI astroturfing. AI is not an amplifier, there’s literally no evidence from any study that’s been done that backs that. That’s just AI company marketing.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 8 points 4 months ago* (last edited 4 months ago) (1 child)

    "AI IS AMAZING AND INEVITABLE!!!" = astroturfing

    "AI sucks at X, but sometimes useful at Y... use with caution." = astroturfing

    "AI SUCKS AT LITERALLY EVERY TASK!!! ITS ALL SLOP!!! SLOP SLOP SLOPPITTY SLOP!!!" = only organic discussion and reasonable take....

    Look, there are 100s of valid reasons why AI sucks and is unethical... in fact, it's pretty much 100% built on unethical methods, no doubt...

    But "AI sucks at everything and literally has zero good use cases" is not a real argument, but it seems to be the most popular opinion around here.

    I disagree with 90% of the pro-AI stuff out there, i'm just pointing out that its rare to hear a reasonable discussin on the topic here that isnt just 100% hate

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    If AI actually adds value, it should be trivial to demonstrate that value-add in a way that passes scientific rigor.

    The underlying problem is that we don't have a good way to measure code value. Software quality is most closely coporable to a weird combination of scientific paper, mechanical diagnostic, and toy instructuon. And we don't have good ways to measure those, either.

    There was apparently one study from Stanford:

    https://medium.com/@manusf08/does-ai-really-boost-developer-productivity-a-stanford-study-of-100-000-devs-has-answers-4f64c64ebe97

    Note that the headline is misleading -- stanford apparently trainded an AI model to "rate code" in a way that agreed with some of their staff and then ran that on a bunch of projects. The "good at simple and new, bad at complex and old" matches my intuition, but isn't really a stronger test than counting minutes spent in a project or dollars spent on programming with or without AI.


    And all AI output is slop. It's just that for some things slop is good enough.

    Which really should be an argument more for discarding those things than boiling oceans to generate more of them, but capitalism loves doing wasteful things

  • source
  • parent
  • load more comments (-1 replies)
  • [–] 2 points 4 months ago* (1 child)

    Good engineers will produce more good code, because they ask the right questions, know what good looks like and check the output.

    So what's the point then ?

    There have been coding frameworks like game engines for decades, if system coding is beyond your ability.

    If AI can't write usable code from the start its worthless.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    Maybe you've misunderstood something.

    No matter what framework or language you are using, AI can make the development process faster. It can help you debug a problem, write tests and refactor code. In some situations, it will be faster than writing code yourself, in others not.

  • source
  • parent
  • [–] 2 points 4 months ago (2 children)

    Provlem being is that it is not an equal amplifier.

    Good engineer spends a morning going back and forth and maybe gets something done that wild have taken them all day.

    Bad engineer puts first draft slop in production in a couple of minutes.

    Bad engineer gets to put out something every few minutes, good engineer works too make it actually right instead of merely looking specifically right.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 4 months ago (1 child)

    That's true, but spaghetti code was always faster to write than good code before as well. I will agree that the speed gap probably has grown though. That's why tools like AI need discipline.

    If managers and engineers don't understand that their code will turn into garbage and the business will get reputational harm and lose customers / get sued / have more tech debt to fix and they'll eventually learn their lesson. In the meantime it's going to be a painful process where upper management see extra speed, expand their scope or downsize their staff, then learn that they have crumbling foundations and need to adjust. This has publically happened a few times already. Things will stabilize in time.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    Complication is, broadly speaking, much of the decision making only thinks to when their current bonus stock vests. So long term thinking is not well rewarded. If you think long term, then your short term thinking competitor screws you up long enough anyway.

    I strongly suspect the next step is for a dramatic reduction in the compensation for software development. If it's not really significantly any more profitable than another trade, then you won't see as many people who seem to actively hate it trying to do it anyway.

    Reminds me of a conversation I overhead, a guy trying to impress a girl with how much money he was going to get back in college. He was going into software development to make big money. Girl asks "but I thought you were majoring in communications, why do that if you want to do software?". "Oh, well, I tried but I couldn't understand the course work, so dropped it, figured I'd just get some degree, and then just get some certification and do software development for the money without the dumb coursework". Basically since the late 90s we've had a flood of those types, and this phenomenon just exacerbates the problem.

  • source
  • parent
  • [–] 1 point 4 months ago

    No it's not because it causes brain damage. If you look at slop all day you no longer produces good code even you're good engineer, you're producing slop code because your standards keep getting lower and lower until you become bad engineer but you even haven't figured it out. If good engineers would produce good code with AI we would have working software. Look how quality of software lowered after AI. We used to say that developers from coding bootcamps were bad now we're lowering standards even more to praise investors.

  • source
  • parent
  • load more comments (-2 replies)