Yup that's how PDFs are. I think the accessibility option one might have something (never tried parsing that).

Plus if you're working with language with diacritics then it's even worse because you can't even compare the coordinates properly, specially if some of them go beyond the previous characters. Not having the space combined with that meant it was really hard to determine the text, and it saves glyph from the font instead of character info too.