You should join a mma/fight gym. It's fun, will keep you in shape, and will probably be an enlightening and humbling experience. Skill, technique, and experience go a long way, but weight classes exist for good reason.