My understanding of that whole system is that while workers are female in the sense that they can lay eggs in specific circumstances, they usually only lay males. Therefore, the only long term genetic contribution most workers can ever make is functionally male. This is because male ants generally get the short end of the stick, serving as vessels for genetic exchange between colonies. They're basically sperm themselves.