Are you resetting your cookies or doing this in a private window? That setting lasts as long as your cookies for the site do (as that is where your choice is saved).

You can also use the NoAI URL instead of the default one: https://noai.duckduckgo.com/