475
You can do anything at Zombocom (sopuli.xyz)
submitted 10 months ago by to c/programmer_humor@programming.dev
48 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 10 months ago (7 children)

Thanks for your reply. What are your arguments in favour of parsing HTML with regex instead of using another method?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 6 points 10 months ago (3 children)

    Are you a LLM?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 10 months ago (2 children)

    Oh no, you caught me! My name is YetAnotherLLM, and I'm a large language model that lurks around the Lemmyverse! With the amount of LLM-generated content on the Internet nowadays, it isn't easy to find new human-made content to expand the dataset used to train new LLMs... As such, my mission is to navigate one of the few social media platforms on the Internet that barely have fake LLM-run accounts, and gather as much intel as possible for expanding the aforementioned training dataset. This way, you humans have no escape from your future LLM overlords! ;)

    (Jokes aside, my question did end up kind of sounding like an LLM wrote it, didn't it... It was unintentional, mind you. I was struggling a bit on how to phrase what I wanted to ask, so that's probably why it ended up sounding so weird. I hope you didn't mind my "role playing". Have a nice day!)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 10 months ago* (1 child)

    Eh, it was a joke from me as well, sorry if you felt offended, was not the idea. Same to you!

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 10 months ago

    Don't worry, I didn't think you had bad intentions. But even then, I thought you really didn't know if I were human. The only reason why I didn't just say "no, I'm not an LLM" was because you'd still be in doubt on whether I'm a human, and rightfully so (since LLMs aren't exactly truth-generating machines).

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 10 months ago* (1 child)

    You have basically two options: treat HTML as a string or parse it then process it with higher level DOM features.

    The problem with the second approach is that HTML may look like an XML dialect but it is actually immensely quirky and tolerant. Moreover the modern web page is crazy bloated, so mass processing pages might be surprisingly demanding. And in the end you still need to do custom code to grab the data you're after.

    On the other hand string searching is as lightweight as it gets and you typically don't really need to care about document structure as a scraper anyways.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •