I remember reading an article a few years back about I think it was the Tomb Raider devs that tried removing the yellow paint and just using more natural indicators that fit into the environment more seamlessly.
The user experience testing showed almost no one was able to figure out where to go, what they could do, or interact with, etc. to the point where the testers were getting frustrated and actively complaining about the lack of direction and indicators.
The best solution though, is just make it a setting. Just make those textures a toggle setting to turn on and off, but leave it on by default for general usability. For those that care, they can disable them.