Preserving a mass while maintaining the ability to fly would require you to significantly increase in size, which comes with all sorts of drawbacks.

Humans can't fly precisely because we're too dense. Birds and other flying creatures have plenty of adaptations meant to reduce mass (or, rather, density) by all means possible.