Yes, match the underwear to your skin tone if you want it to be invisible. That's why most undergarments are available in some sort of medium tan/pink/brown. Even if you can't match the color, matching the value can often be enough. A grey will almost always be less visible than white or black.