I think the better alternative would be for browsers to have some kind of per-site override instead of relying on every single site building the same system and putting the option in a different place.

If a setting is universally supported by all sites (which dark mode should be, along with the other common accessibility flags), it shouldn't be something that the site needs to control.