No touchscreen is tough I'll admit. I'm sure you've already looked at the FiiO M3K, that one even has a Rockbox port.

I can recommend the FiiO X5II as a no-thrills modern-ish player (it's basically a hi-res iPod). It's 10 years old but you can change the battery pretty easily and there are options to mod the firmware yourself.