Phones, sure. I -personally- think it's massively problematic how the phone operating system ecosystem is basically a monopoly of two companies. And I almost can't do my paperwork or get a doctor's appointment or train ticket anymore without accepting to forward my personal information to a list of 40 "partner" companies, a good chunk of them abroad in the USA. And then it's massively complicated and I need 3 authenticator apps, and they do device verification and SafetyNet to make sure my(?) phone isn't controlled by me, but Google.
So yes, in reality it's not how I envision it to be. Phones just do what Google wants them to do and that certainly also includes Gemini AI. All of this is almost impossible to avoid, and it's getting harder each day. It certainly is that way.
(Same with edge-cases in general. I had to contact modern customer support lately, and that just got way worse than it already was before AI chatbots. We just don't do edge-cases any more. Everyone needs to get in line, have the same life and same common issues or they're screwed.)
With Linux, I doubt it. Traditionally it's a lot about choice. Caters to its user group who (on the desktop) include a good amount of privacy advocates, people with older computers, nerds... I think we'd need some paradigm shift first. Before any of the larger distributions change their defaults. I like to believe we're relatively safe here. And my biggest issue isn't AI in itself, but how large, annoying companies shove it down our throats. And that's really not how Linux works.
I've been pondering productivity as well. I once did some AI assisted coding. Took notes and did a similar task after that the old-school way. In that case AI had wasted time, I was faster without. But it's been a while and AI tools have improved in the last months. So I probably should repeat that experiment. And do it a couple times to get some solid numbers. I find it hard to apply it the exact right way, though. It'd underperform (on me) if I don't get the prompt right, feed it the right amount of context if there's a pre-existing project... It's better at some tasks and not so good at other ones... So with the current state of technology it's not that straightforward to delegate stuff to AI, and it'd just increase productivity. At least that's been my previous experience. But we get a plethora of contradicting and weird reports on AI's performance when used for coding.