French Press coffee tends to have a bit more coffee grounds in it than other methods, so this might be the case for you as well.

There are different kinds of french press plungers that mitigate this. Some people also put a paper filter on their plunger to remove more of the grounds.

I rarely drink french press but I love my aeropress, which also removes all the grounds.