First, you should learn about Wine prefixes. Arch Wiki has a good write-up about it.
After the game is installed, you need to edit that setup.exe you added as a non-Steam game and point it to the game's actual executable.
Steam's Wine prefixes are usually located in ~/.local/share/Steam/steamapps/compatdata. This directory should have some text config files that you can read to find out what ID Steam has assigned to it.
Also, you might have more luck with Bottles (available through flatpak) which is more suited for such tasks.