I'm not a climate scientist, but my understanding is that oil is matter that was previously part of the climate cycle that was buried, and thus removed from the wheel.
Then we dug it up and burned it, reintroducing it to the cycle for the first time in many millions of years.
So if we stop emitting now, that would be better than not emitting. Not making things worse is a great start. But I think to "fix" it, we need to spend a boatload of money taking all that extra carbon we spent the last hundred years releasing, and put it back in the ground where we found it. Or a big box, or space, or whatever. It needs to be removed, or else this level is the new normal.