Yes, obviously AI is emitting way too much. It shouldn't even be producing 0.2% of global emissions, let alone 2%. My main grievance is that no one ever talks about improving industrial and agricultural processes even though they produce around 29% of emissions and 20% of emissions respectively.
A lot of it comes down to how much people want the product, combined with how easy it is to get rid of carbon emissions in the process. If people are against AI in the first place, it's easy to get rid of the carbon emissions. Getting rid of the emissions from concrete production is a much more difficult proposition.