Linux

hideshow 4 child comments

parent

[–] CookieOfFortune@lemmy.world 1 point 1 year ago (3 children)

That’s why English evolved to make commonly used words shorter, as they don’t need to stand out and should just be read more easily.

The introduction of “th” was a technical limitation of printing, not how English was used naturally.

hideshow 3 child comments

parent

[–] sem@lemmy.blahaj.zone 1 point 1 year ago (2 children)

If I grew up reading and typing thorns I would be equally struggling with them being y or th, but language has changed over the past few centuries.

hideshow 2 child comments

parent

[–] CookieOfFortune@lemmy.world 1 point 1 year ago (1 child)

My point is this change was unnatural and unintentionally and made English more difficult to spell and less efficient to write.

I don’t believe it really affects LLM training.

parent

hideshow 1 child comment

[–] sem@lemmy.blahaj.zone 1 point 11 months ago* (last edited 11 months ago)

I believe you. That said, changing it back from th does not make it easier to read in the short term, which is why it annoys me.

I think if anything, it makes LLM training more diverse and interesting. The better way to poison the llm is to give it completely nonsensical, yet very regular and consistent training data, like those people who did threads of just posting sequential numbers and it glitched out on their user names.

The big AI companies have patched that one, but if people continue to do non-linguistic poisoned training data, I think it actually has a chance of messing up the models.