To be fair, the official D&D rules call it "Two-Weapon Fighting". Not sure if it's to avoid this confusion.
Identical weapons are what I typically picture in that scenario, but it makes sense mechanically to allow different types (especially with a rapier/dagger combo being a thing in a lot of fantasy, and probably historically? I dunno).