Yeah, it's a crystal structure and it's really a shame that it causes so many health issues because it's kind of an amazing material otherwise. It's lightweight and strong enough to make bricks with but you can also make flexible fabric out of it, and it can hold up to really impressive amounts of heat. As the poster above said, it is still in use in some industrial applications because in some situations there is no effective alternative.
Of course the problem is that if you damage an asbestos brick or bend an asbestos fabric you get lots of tiny little asbestos fibers that come loose. My understanding is that the fibers are so small that they pierce cell walls and damage DNA strands, hence the cancer.