For me, it comes down to not being able to decide moment to moment if I want to engage with monsters. It's not a problem grinding, however, being forced to delay exploration and progressing the story because of bad RNG is infuriating.
And I feel that most of the ways that random monsters have been implemented can be accomplished with at the very least visible indications of monsters on the map.
Maybe there is a way to lean into the frustration and create a meaningful experience, but for a traditional JRPG, I have to force myself to overcome random encounters. Heck, even later JRPS implemented systems to liven up the experience with auto battles and realtime elements.