[–] 14 points 1 week ago (3 children)

It looks like it's fixed now. it was some changes I made to nginx and whilest combatting scrapers. If you continue to see the problem, please let me kow.

  • source
  • [–] 14 points 1 week ago

    Ok, I think I’ve got this fixed now. I’m testing. You might get signed out once more. I was just experimenting with filtering cookies out so help me differentiate between the bots and scrapers that keep killing the site and the legitimate uses but I made an error in the nginx config. I’ll keep an eye on it.

  • source
  • Fedia update (fedia.io)
    submitted 6 months ago by to c/fedia@fedia.io
     

    Ok, there are three problems going on. First, the site has been intermittently super slow. This is happening because of some database locking conflicts and long running queries. I don't have this fully mitigated yet, but I know what I need to do and just need to get it scripted so it can recover automatically and gracefully.

    My attempts to solve the prior problem broke federation by causing the messenger services to think they didn't have a connection to the database. This should be fixed now, and now that I know it happens, I can mitigate it in the future.

    The other problem is with only being able to go back one to three pages (some times the first page is all you get). This is a known issue in the new version of mbin and the devs are going to revert the pagination scheme to the prior version until the bugs get worked out. In the mean time, if you click on "combined", you will be able to go back for miles (or kilometers).

     

    Hi all. I've implemented anubis in front of fedia.io in an attempt to mitigate the absolutely insane amount of crawlers hammering the site. I have also reenabled anonymous access, hoping that anubis will be effective at keeping the bots out and letting legit people in.

    For reference, I run 17 different instances*. All are using a common postgres database server, running on a latest gen AMD Epyc server with 48 physical/96 logical cores. When I enabled anonymous access previously, fedia.io would consume 6 times the amount of database resources as all the other 16 instances using the database server combined. It's off the hook absurd.

    So far, it's going ok with anubis in place and anonymous access. I'll see how it performs over the next day or so.

     

    In an effort to reduce costs due to the exchange rate and declining donations, I’m going to be consolidating Fedia.io onto another existing server so I can decommission and return the server that it is running on. I’ll be turning off unauthenticated access to content again because that drastically reduces the bandwidth/compute load that Fedia uses. I am not sure on timing yet - likely around 2PM ET/6PM UTC. I’ll plan for an hour downtime but I’m hoping it should only be a few minutes if I do things correctly.

    view more: next ›