Yeah I have a 3070 and have experienced similar sorts of minor annoyances when using Wayland. When I see reports that issues are fixed I try a Wayland session and still find various oddities or issues.
They may be marginal useages but for me I have a dual screen set up and I might game on one and have a video open on another, or even have two video streams open, one on each screen. I find videos slow down and lag, or have artefacts. Issues I don't get on X11 or when I was in windows.
I'm in the same position of looking to upgrade my graphics card and I'm looking at AMD to avoid any more Nvidia related issues. I love using Linux but I don't want to be dealing with Nvidia drivers after past experience.