I just finished a PhD in stats, and before that, studied computer science. I had planned to go back to industry to do software engineering or be a data scientist afterwards.

However, it seems that in the meantime, vibe coding has taken over the software industry and swallowed most data scientist roles. Few open positions, and the ones that do exist are just pushing a button instead of thinking and solving problems. Is this a correct assessment? Should I try to get back in or just find a new career? I am not too keen on staying in academia either.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 23 hours ago (18 children)

don’t bring idea

In my experience the AI agents do if you ask them. Rather than giving them a problem and telling them to solve it autonomously, I ask them to give me feedback on my plan and propose potential alternatives before starting any coding, and often I get good suggestions from them this way.

  • source
  • parent
  • hideshow 18 child comments
  • [–] 7 points 21 hours ago (17 children)

    If your idea of an idea is "concept that I personally am not aware of but which has been conceived, elaborated on and documented by another human being"…

    Then yes, totally!

  • source
  • parent
  • hideshow 17 child comments
  • [–] 4 points 21 hours ago (15 children)

    The AI can extrapolate, but even if it couldn't, ultimately I need an idea that works, not necessarily a completely original idea that works (and most humans don't come up with completely original ideas very often either).

  • source
  • parent
  • hideshow 15 child comments
  • [–] 6 points 20 hours ago

    Yeah, I was gonna say, most engineers are gonna be taking a lot of code from the internet anyway. Most problems modern companies face have already been solved in one way or another, its just figuring out what fits your specific product and needs. That being said, I'm pro "ai as a tool in non-creative fields", but it certainly doesn't replace engey level engineers. I see it closer to a calculator or like factory machine. It can cut out the grunt work and summarize things well, but it takes a looooot of steering to actually work. And the engineer can maybe learn some new concepts or techniques along the way

  • source
  • parent
  • [–] 0 points 20 hours ago (13 children)
  • [–] 3 points 20 hours ago* (12 children)

    Well, I have my personal experience, but there are also all those math problems that AI has been solving recently... Here's one mathematician's discussion, with links to blog posts by other mathematicians who had spent years unsuccessfully working on some of those problems. He says:

    Also, if you were wondering: apparently they tried the model on about 4,000 problems. So, right now it “merely” solves ~10% of the longstanding open mathematical problems that it’s asked about, the problems that whole communities have spent years on, after a single 3-hour attempt on them.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 2 points 20 hours ago (2 children)

    That's what's gotta sting the most about this. Imagine you worked a problem for a long time… and then The Giant Pattern Matcher With Zero Fluid Intelligence actually finds something.

    If it did find something, that implies the solution already existed in bits and pieces in the published literature. You would "just" have had to have read about it, and remember it, for successful application.

    But suppose you had succeeded in that. You would have published a paper that enumerates a bunch of results some other people had reached, then plugs them together for a supposedly new theorem. Sort of like importing a dozen Python libraries, adding around fifty lines of glue code around them and then going, yeah, here's a "new" thing, Fields Medal plz!

    How much remaining interestingness did your chosen problem really have if the new math you had to create for it fits on the placemat buttressing the campus cafeteria sandwich you had for lunch?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 19 hours ago* (1 child)

    What I've seen appears to indicate some genuinely new approaches by the AI, rather than putting together existing information. That blog post, for example, quotes some running commentary from a mathematician studying the proof of the theorem that she had been working on for years:

    It feels like something written by someone who’s on psychedelics. So much unclear and doesn’t make sense. Lots of name dropping of previous work without discussing why it can be used despite impossibility results

    Basically the paper is so horribly written that it’s impossible to read it without AI help

    I asked Astra for reasonable completeness and soundness claims of the noise gadget and it gave them by combining claims from all over the paper

    They also have direct optimal NP hardness of approximation proofs for the main applications of the UGC (Max Cut and all CSP) that bypass the UGC.

    The UGC proof invents a completely new bizarre code with a noise test. It’s some crazy recursive construction.

    It’s not the long code, not the short code – some alien craziness

    I still think that there maybe is a proof that uses the half space code (which is natural)

    The citations are often irrelevant and confusing

    A possible future is a math world that’s heavenly if you have vision/creative ideas that AI could help check and implement.

    And of course there’s a lot for us to learn from the aliens

    Note that this particular proof is correct, according to that same mathematician.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 19 hours ago

    The issue with longstanding problems such as these is that yes, they can be used to establish evidence of plagiarizing if your LLM is simply regurgitating stuff, but suppose you cannot come up with any… you don't really know if it's because this particular line of thought is new, or because you just hadn't read about it.

    That's true even if you're an expert practitioner; LLMs have been trained on All Of The Text and have superhuman recall after all.

  • source
  • parent
  • [–] 1 point 20 hours ago (1 child)

    But it also appears that no human has understood just about any of these proofs yet; the race to do so has just started.

    Sounds like a pretty smart mathematician

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 19 hours ago

    The blog post was written less than a day after the proofs were released, and apparently they're very hard for humans to follow. Now that a month has passed, there are human mathematicians' explanations of how the proofs work up on the internet.

  • source
  • parent
  • [–] 0 points 13 hours ago* (last edited 10 hours ago) (3 children)

    I think the blog says exactly the opposite, the AI is very bad at explaining its solution and core idea.

    I think the interesting part is that explaining ideas is something that don't seem to have an obvious reward for RL to train on, unless mathematicians keeps handing them training data.

    (OMG of course this guy is a rationalist 🫠

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 8 hours ago* (2 children)

    Both can be true at once - it is coming up with original ideas but explaining them poorly. I'm not a mathematician but I find that in my field (software development) the AI is much better at writing code than it is at writing documentation - it will write documentation if you ask it to, but the documentation will be unfocused and difficult to read, with explanations of things that don't matter and garden path sentences. I got this sentence from it recently:

    A restart build gives a particle or pair its specs restrain without saying where the anchor recorded for it.

    That is actually not gibberish - it's technically correct, but it certainly isn't clear.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 6 hours ago (1 child)

    Maybe I miss understand what "extrapolate" means in your context. To me that means "extract the core idea and explain/apply them", as AI do not learn by producing output (unlike human), applying core idea requires it to be explained in clear language.

    I was arguing that AI, at present, cannot effectively extract core idea which is what I would characterize as "extrapolate".

  • source
  • parent
  • hideshow 1 child comment
  • No, by "extrapolate" I mean to learn a pattern in the training data and then apply that pattern (in a useful way) to a problem outside the domain of the training data. An AI that cannot extrapolate would only be able to do the specific things that it had been taught to do, whereas an AI that can extrapolate is capable of solving new problems.

    As for the language, I suspect that it is clear to the AI itself. During their training, programming AIs communicate with other programming AIs more than they do with humans, so they develop their own dialect of sorts which is good for exchanging information among themselves. This is just conjecture on my part, but my evidence is that if the AI really was internally confused about those math problems, it wouldn't have been able to solve them.

  • source
  • parent
  • [–] [S] 0 points 15 hours ago (2 children)

    "one mathematician" who happened to work at openAI, btw.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 15 hours ago* (1 child)

    You can look at Terence Tao's blog instead if you'd like. Just from the last week or so, there are the following headlines:

    • Egoless Mathematics in the AI Era
    • Mathematics has changed. Let’s act like it
    • The mathematical sciences in an AI-enabled world
    • Report of the Summit on Math Research in the Age of AI
    • AI, Mathematics, Education, and a public goods problem
  • source
  • parent
  • hideshow 1 child comment