you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 1 month ago* (last edited 1 month ago) (10 children)

Isn't this a case where regex may be the worse choice?

  • source
  • parent
  • hideshow 10 child comments
  • [–] 6 points 1 month ago (3 children)

    write out several thousand regex patterns

    Oh my! This thing is more likely to gain sentience than any llm.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 month ago (2 children)

    it is a truly absurd number, simply due to the inane BS variations on terminology and notation.

    It might have been more reasonable to train a local LLM on this material and then just query -that-..... but hey 30ish seconds of claude's free tier usage; and i've got a script that's ~99.99% as good as a human in terms of pattern recognition. Pretty neat when you think about it.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 month ago (1 child)

    And 'truly absurd number' might still be a bit of an understatement here. Saying that Claude can generate several thousand regexes for you is not really a selling point for llms in my book.

    On the other hand. Have you tried running them on the bible or something like that? I bet it finds it talks about ww2, 9-11, the nintendo wii, and shit...

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 1 month ago*

    If, by bible, you refer to the holy book of the local Building Code; then no, I have not.

    and again; the regex in the script generated works, it's just a teeny bit cursed and maybe a little bit sentient. Praise be to the Omnissaiah, and its blessed machine.

  • source
  • parent
  • [–] 4 points 1 month ago (2 children)

    Can't be worse than when I was an intern, the product was literally based around parsing arbitrary HTML with regex and not even decent regex, POSIX regex from like the '80s for reasons known only unto the programming gods.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 3 points 1 month ago (1 child)

    When I wrote my numerical parser, people told me to use regexes to detect what kind of numerical value is being parsed. I just did it in one go. Only regex-like checking is for ISO datetime values.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 month ago

    regex is computationally pretty cheap, from what I've read; due to something about it being a simple AND gate or something..... . IDR, and to be honest it doesn't really matter in the era of 16-core/32thread 5GHz processors.... but when you just want it to work..... it does "just work". /shrug.

  • source
  • parent
  • [–] 2 points 1 month ago

    Not really. There will only ever be about a hundred people who ever use this tool, and it's really just a massive timesaver that keeps people from needing to open a smorgasbord of files to get a few tidbits from each file; then collate it into one doc....

    If I get ~99.99% of all the information, and one hundred people use this, odds are, nobody will ever see the .01% edge case of missed info. and even if it does happen, it's not like it's obsfucated information in each file, it's just a pain to open a hundred files and wait for them all to load at once through the disk-heavy GUI application we have to use.

    simpler to just read via the regex patterns, and then put it out into the terminal for the info needed.

  • source
  • parent