Because Al doesn’t seem to be that sophisticated a guy to be a problem at all. Dexter knows his real name. But he doesn’t know Dexter’s real identity.
Plus he has a family, is he actually going to give it up to save himself ?
Also as a last resort, dexter can just release Prater’s file on Al to the public.
None of that really matters, he wants to kill Al for the urge.