Part of the problem is that the interviewing process is hard to figure out for the hiring manager. You've got inflated resumes, a bunch of spam, and generally a condition where there isn't a qualified candidate so you have to gamble on a pick anyway.
Then again, I usually prefer an in-person review because I haven't figured out the best way to get them to draw something over video.