I have a 3070 and generally I have no issues with gaming or working in X11.

I have previously had major issues with Nvidia and Wayland and I don't use Wayland as a result on that machine . Many of those issues may have been resolved now but at present there isn't a need to be using Wayland although it is being increasingly pushed. Problems I had were laggyness in the desktop, and videos becoming choppy if I had more than one major process running on the GPU (eg game and video in browser, or two browser windows both with video). I believe such issues have been fixed in the past 12-18m but I'm now in the habit of using X11 on the machine with no incentive to try Wayland again for now.

It is very easy to avoid Wayland - as simple as ensuring X11 is installed and then logging out of a Wayland desktop session and logging into an X11 session once and keeping with that as the default.

I do have a separate AMD machine with integrated GPU and that has been running Wayland from the get go. On that machine I've never even had to think about this issue and have just let my fedora based distro (Nobara) default to Wayland. It's been very much an Nvidia issue.