And an infinitely dense point in spacetime doesn't necessarily exist: it's just what general relativity predicts is at the center of a black hole.
The last time our physical model of the universe predicted an infinite value, we ended up discovering new physics eventually (the ultraviolet catastrophe). (Edit: ultrasound was a typo).