Ancient IBM wisdom (from 1979) that the bosses just straight up promptly forgot
(media.piefed.social)
Tbf that leads to the problem of:
Company/Individual makes program that is in no way meant for making management decision.
Someone else comes and deploys that program to make management decisions.
The ones that made that program couldn't stop the ones that deployed it from deploying it.
Even if the maker aimed to make a decision-making program, and marketed it as so. Whoever deployed it is ultimately the responsible for it. As long as the maker doesn't fake tests or certifications of course, I'm sure that would violate many laws.