Judge someone by not just their past but their potential.

A dual edged sword. I would moderate that by saying whether they strive to work toward actualization of that potential, within the means available or presented to them.