While most cities would be better off if they invested a portion of police department resources into mental health support and other social welfare programs, a police department of some kind is inevitably necessary in cities beyond a certain scale, such as New York. Crime is inevitable to some extent.
For rural areas, it's probably more efficient to just have a county sheriff office instead.