As I understand it, the "matter" part is a hold over from physicists trying to fix their faulty calculations.

Looking for "matter" that only interacts with gravity is a bit like looking for the perfectly smooth frictionless plane. I mean, somethings gotta account for the sums being off, but the real world explanation is anybody's guess.