There's also no reason to believe that the big bang happened at one “point”. I believe that the universe (and therefore the big bang) are infinite.
Everything is relative, so something infinite can still expand: since there's no absolute speed, galaxies can move away from each other everywhere, at all times.