What version are you running? I just tried on Ventura, worked fine on both a .dmg package and some terminal script, both unsigned, and both would need the settings thing if I simply double clicked to open. You still get a prompt, but you have an “open anyways” option.