Windows 95 let installers trash its files then fixed the mess behind their backs
(www.theregister.com)
Are you sure you're using the best version of 95?
Like 95a didn't even have out-of-the-box USB support.
You'll want to use B or C versions for optimal driver support, including USB.