You can try another os in a live usb environment, without installing. It's important so you can be sure it's not something in the hardware. I once had some problem with noise, and it took me years to find the cause. I even bought a usb sound card to be able to use a mic. In the end, it was a problem in the power source generating interference (probably along with poor isolation).
In the software side, have you tried using alsamixer or a similar tool to 1- mute everything not related to the mic and the output 2 - lower the mic volume (high mic volume can generate noise)? It's also worth checking if you have conflicting sound servers or something like that. Have you installed anything related to sound, or are you using the defaults?