Machine learning by itself is already paying off. LLMs the way normal people use it are fine, but not the way bosses want to use it - you can't rationalize away employees with this, you can only give them them a tool that empowers them; there will be a lot of heads rolling in management in the corporations where this hasn't been realized yet.

Code Generation might get better over the next years, but looking at the current trajectory i would say with current tech there will never be a point reached where you can simply replace a dev with an agentic AI without the generated code being full of inefficiencies, bugs and security issues.

It also might open up the first therapeutic LLM (without the current fuckups) if there is a focus in development - THIS would be something that is labor intensive, priced so that exactly the people that need it can't afford it on a regular basis, and definitely possible to attain without much of a technological limit.

ImageGen can also pay off in some areas - creating tons of "stony wall" textures isn't fun, but implementing a tiny model that creates as many "stony walls" as you want in your game with differing amounts of stones or dirt as a variable might be worth the effort.

Prototyping is also a big thing in both of those areas (Code Gen/ImageGen), but i think that's no secret anymore.

Videogen in the current way is a waste of energy. The models need something that anchors them, to make sure that the Coke truck in one camera angle stays the same Coke truck in the next angle; currently it's just ImageGen *25/second, which causes those issues - and the massive energy consumption. This is the only area where the generation process itself chews through more electrons than the global energy bill allows for. Someone smart will probably crack that nut too - i believe that the solution to those 2 issues (energy consumption and missing object permanence) might be linked.

Edit: The missing permanence might also be a reason for many of the issues of LLM's, some kind of "self" with a sense of the passage of time to return to. I'm pretty sure i'm not the first one who thought of that, and there are probably a lot of people with even more PhDs at work here.