What does ls show?
you can escape special charcters with \ something like \'folder\'\$\'\\003\' might work
be careful with rm -rf as you might delete your entire disk if done badly. use some other command to test if it targets the correct directory like ls \'folder\'\$\'\\003\'