• They still put crap in the environment from the tires
• much of the energy powering them isn't green
• car culture still creates horrible spaces to live in
• crashes are still a common, ruinous, event
• doesn't solve DUI
• still is expensive to own, maintain, insure
• car culture promotes isolated, sedentary life, which is bad for physical and mental health

Just off the top of my head. If you swapped all the gas cars for electric cars, you still have all those problems.

Tailpipe CO2 emissions are indeed only a fraction of the problem with ICE cars. EVs still cause CO2 emissions from production, maintenance, and especially infrastructure, in addition to being just as dangerous, noisy, and socially disruptive as an ICE car.

Further, if they are cheaper to operate, the Jevons Paradox means that we'll end up using more total energy for EVs than we currently do for ICE vehicles, with all of the knock-on effects of pollution and environmental destruction wrought by automobile-oriented land use. That environmental destruction also drives climate change, and the Antheopocene mass extinction currently in progress.

You could put your bike on the front of a transit bus if those existed.