137
Cloudflare AI block finally fixed!!!! (lemmy.today)
submitted 1 month ago by to c/fuck_ai@lemmy.world
27 comments fedilink hide all child comments
 

Now AI blocking will get you more precise control over your website! Now AI crawlers will be allowed to grab your website! But don't worry! They promised and pinky swore they wouldn't train any AI on your data. So your data is protected!

Isn't that great!!?

all 27 comments

sorted by: hot top controversial new old
[–] 46 points 1 month ago (12 children)

Fucking hell. Why have a website anymore? Can we get a separate Internet where AI doesn’t exist?

  • permalink
  • fedilink
  • source
  • hideshow 12 child comments
    •
  • [–] 8 points 1 month ago (10 children)

    I would suggest Usenet but my guess is that there are bots there too.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 10 child comments
    •
  • [–] 6 points 1 month ago (5 children)

    needs something like treehouse from the novel otherland by tad williams. an anarchist online space, with changing entrypoints that are told only to members of said space... or to stay in reality, something like CACert, where you could get an SSL Certificate for your website for free by talking to people in person and stuff.... but nowadays youd make really sure the person you're inviting isnt some predatory submarine aibro looking for easy content...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 5 points 1 month ago (4 children)

    I wonder if something like that could be achieved with Meshtastic or HAMNET.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 month ago (1 child)

    The range is too small with Meshtastic to be useful for connecting a large group. I did some practical range testing with myself and a friend both running a node and me driving around to see what sort of range I could get. We’re 3.5 miles away from each other and it seemed like we’d need a decent amount of repeaters to be able to chat without an internet backbone doing the work.

    Maybe in a smaller town with more active neighbors believing in this it would be easier. In a large (flat) metro area, it’s tough to get meaningful coverage without putting in a lot of work building human connections and convincing people to run nodes.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    Then I wonder about using HAMNET as the backbone? HAM radio signals can go 100 miles/161 kilometers with the world record being like 4000 miles/6440 kilometers. Obviously you don’t actually need the Meshtastic for HAMNET, but my understanding is that Meshtastic and others like Meshcore are far cheaper and in places like the US you need a license for HAM.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 month ago (1 child)

    i dont quite get why you need to change the physical layer too but i wont be to critical because meshtastic and hamnet are both pretty cool.

    only trouble with hamnet is: afaik in some countries it is illegal to use it to transmit anything encrypted

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    I haven’t used Usenet for anything other than file sharing, but I think i will give it a try. I kind of imagine it is like the internet in IRC format. Does anyone have suggestions for interesting newsgroups?

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 1 month ago (2 children)

    How would one enter Usenet nowadays?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 month ago (1 child)

    You need to join a newsgroup. Some are open some are private. I would suggest you start with one of the Usenet communities on here. They aren’t super updated but several people have posted info on connecting over the last couple years.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
    • [–] 12 points 1 month ago (4 children)

    Crawlers are a big fucking problem and we really didn't build the internet to accomodate them. Maybe if we said in 1990 "hey what if datacenters with Tbps connections will mass query all websites" we'd have a solution by now, but obviously that wasn't really an issue back then. Anubis seems great but proof of work to prove you are a human seems to have it's issues.

  • permalink
  • fedilink
  • source
  • hideshow 4 child comments
    •
  • [–] 5 points 1 month ago (3 children)

    The solution is smarter secure mirroring for any static public content, stuff like Jekyll + Git or Atproto based sites. For dynamic content there's no universal solution against misbehaving data centers other than blocking them

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 1 month ago* (last edited 1 month ago) (2 children)

    Wait, can you expand more sbout Jekyll + git? Seems interessing but i can't find anything, also, why AT protocol instead of ActivityPub?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 1 month ago* (1 child)

    Activitypub suffer from virality, it doesn't offload. The original hosting server always gets pinged for every interaction. Meanwhile AT protocol is capable of simply acting like a series of pure mirrors so a self hosted PDS (account host) doesn't get tanked if you get flooded with replies and reposts and more, as the appviews does the job of indexing those responses and your client only need to look at the index (threads, like count, etc) it produced for you.

    Jekyll simply creates and updates static HTML files. Git for version control. Multiple sites (including github pages) can natively publish that format of static files as a website.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    Oh interessing, i didn't knew

    Multiple sites (including github pages) can natively publish that format of static files as a website.

    Yeah i used to do that but to be noted: that's not a Git feature but a feature provided from the various Git forges

  • permalink
  • fedilink
  • source
  • parent
    • [–] 8 points 1 month ago (2 children)

    Yeah, search engines used to enable us to look up stuff online.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 5 points 1 month ago (1 child)

    You're gonna hate when you find HOW they generated their search data for your searching.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 7 points 1 month ago* (last edited 1 month ago)

    I liked it. I regularly have lots of niche problems and back in the day I'd just put it into Google and find someone on Reddit or whatever who already tackled it 2 years ago. Now I don't.

    Also used to occasionally watch the web server logs and see how the search engines check for updates on the organization I'm volunteering at. Or index my employer's website. Or the Fediverse apps I run. And tweak my visibility according to my liking. Now that changed quite dramatically as well.

    Or archive some of the stuff online for people with an attention span > 30s. Nowadays that constitutes "suspicious activity". While when I'm at the giving end, I get hammered by stupid AI crawlers. It's a shame.

    (But I found a very good solution to the Cloudflare issue, if you're running web servers yourself: Don't use Cloudflare. It's as simple as that.)

  • permalink
  • fedilink
  • source
  • parent
    • [–] 14 points 1 month ago (3 children)

    Dear Tim Berners-Lee, Did you have a backup internet that the rest of us could use?

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
    • [–] 2 points 1 month ago (1 child)

    awesome

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •