I formed that opinion based onnfeedbacj I received from native Japanese speakers. And it makes a lot of sense. I've also watched compilations just admiring bad voice acting in muktiple languages- sometimes there aren't even words, just noises and exclamations and sounds that are terrible. Sometimes its easy to tell a flat delivery even if you don't speak the language.
And I LIKE bad voice acting sometimes. Depending on the situation it can be more entertaining than good acting.
There is good and bad voice acting in animation written for English-speaking people. Further beyond just the acting itself, there is the writing and and direction and editing and mixing to consider. I've seen stuff with voice actors that I know are good that sounds terrible because of these other factors.
And yes, the acting will change depending on the individual performance, but I don't think that just because someone was the first to do it means they will be the best. For most of human history, plays were performed by hundreds, maybe thousands of different actors across centuries. How many different men have played Romeo or Hamlet? Even with bad actors, you can still usually appreciate the stories.
I would have absolutely no problem with replacing James Earl Jones with another actor in a remake. Heck, there are probably a lot of actors in their prime in Hollywood right now that have spent most of their lives working on their Darth Vader. I don't think that's disrespectful at all. Characters get re-cast quite often as their actors age out or die or jisy have scheduling conflicts. And you see this in anime too: sometimes the Japanese voice actor changes over time, sometimes the English ones do, its not really a big deal.