I would personally argue that any wealthy individual under capitalism is only able to be wealthy on the basis of exploitation. In my view labor creates value, so no matter how far you have to go back you will always find rampant exploitation of labor when you see a wealthy individual or family.
This is plain to see when you critically think about this idea of development of land into housing for landlords to rent out. The landlord (wealthy individual due to exploitation of labor) buys land, hires people to do labor on it (exploitation), which creates value that's added to said land.
I would also disagree on the idea that landlords are in any way victims of this system, they are more like the benefactors of it, as the system as a whole is set up to benefit their class and is much easier on them. They pay less taxes in a lot of regions, they don't have to sell their labor power to eat, they can always get favored treatment with banks and financial institutions, and, at least where I live, they can send lobbyists to local, state, and federal governing bodies to advocate for their interests with money (bribery).