From what I understand, many US towns have been taxing tourists much more heavily than locals. As such, their city budgets are disproportionately reliant on tourism. So a relatively small drop in Canadian tourists leaves a gaping hole in budgets.

If possible, communicate with the councils of the towns you might have visited and let them know why you aren't visiting.