It's a parity issue. For an unsolvable configuration, one should be able to solve it up to the point where exactly two tiles need to be swapped. At that point, you know that it is unsolvable, and need not try any further.