Both need to have responsibility, yes, however we need to stop coddling pedestrians because they're too unwilling to be safe when they cross. There are far bigger dangers on the road than people speeding.
A better solution would just be to strip the right of way from pedestrians, but everybody would get their panties in a bunch over that too because of this stupid selfish mentality that people have. When I walk, I let cars go ahead - they'll clear the area faster than I can, and it clears the risk from my path when they go. Eliminating the risk and really putting no inconvenience on anybody.
Further addressing the issue would mean putting in additional crosswalks to prevent jat- walking and unsafe crossings, as would improved public transit.
If we're so hellbent on speeding drivers, maybe we should also start ticketing people who walk faster than most on the sidewalk too?