It's the so called travellers that are evil. Pretty much all travellers in some places are roma, but it seems increasingly few roma are travellers because I haven't really heard much of them recently in my country.
Generally, travellers raise their children to be thieves at a young age. Once they break out of that isolated crime community cycle, they're just people and blend into society.
Unfortunately in a lot of people's eyes, roma people are still a travellers. Seems in my country they've mostly gotten jobs instead of stealing and telling fortunes though, so nobody really cares about them anymore.
Edit: A lot of people are not getting this apparently (and also many are). Travellers are pretty much equivalent to gangs, but in a way even worse (yet also significantly less violent, luckily). They don't want their children to get educated, because they don't want better lives for their children. So yes, the original (and generally still ongoing) cause is poverty and discrimination, but there's an element of "we don't even WANT to be part of society" here. They have entirely different values from most other people as such. As such, just treating Roma as equals isn't enough. There's a need for outreach programs to try to get them to even WANT to integrate in larger numbers. It used to be that basically all Roma were travellers, and a huge problem is that people are still so prejudiced that in at least some European languages, the word for traveller and Roma is the same (it being essentially a slur, such as gypsy). Also through no fault of their own, knowledge of the word "roma" or "romani" is not as widespread as it should be... And the word itself sounds a lot like we're talking about someone from Rome or Romania.