If everyone in the world population of 8.3 billion wasted that much energy per year (5.4 kWh), that would represent a global increase of 44.8 terawatt hours.
Global energy use was about 177,000 terawatt hours in 2025 so that represents about 0.025% of total energy use.
Consumer electronics, especially mobile devices, just don't use any significant amount of energy worth talking about, and has basically no effect on overall demand. Making them half as efficient wouldn't be noticeable on any scale.
For comparison, a liter of gasoline contains 8.9 kWh of stored energy. There's probably a lot more to gain by just getting people to drive something like 5 km less per year, rather than trying to squeeze just a little bit more efficiency out of their phone chargers.