This website made me reconsider if 99.9999% SLA and always online is really that important for lots of websites. I used to self-host my own server in my own apartment, but gave up on that after my internet provider had their first major outage that lasted almost a week. Also I didn't want to worry about the fire hazard, or the server going down when I was traveling etc.

But a solar powered server seems interesting, if the batteries could be made fire safe.

top 96 comments

sorted by: hot top controversial new old
[–] 51 points 2 months ago (1 child)

Companies claiming 99.9999 uptime is an absurd goal for a SLA, and wouldn’t even survive a small internet outage like a DDoS attack or Akamai outage. I remember in the 90s selling the idea of 5 9’s - 99.999% on my resume until some manager who Interviewed me asked me to state the expected downtime. I stopped claiming that number because it’s impossible without full active redundancy in different locations and not dependent on external providers like cloudflare ever going down.

And please don’t argue maintenance windows “cover it” because that’s not how they work in the real world today.

Downtime per year:

  • 99% ~3.65 days (5,256 min)
  • 99.9% ~8.77 hours (526 min)
  • 99.99% ~52.6 min
  • 99.999% ~5.26 min
  • 99.9999% ~31.5 seconds

For my home lab I’m happy my stuff is online and content I hardly lose access when there’s a power outage thanks to my ups. But if I tracked I’d be closer to 95%. Good enough but I can’t wait till I just don’t care to run anything.

  • source
  • hideshow 1 child comment
  • [–] 4 points 2 months ago

    Also, any non-trivial system has failure modes that are not binary. Like, if your convertible car has the roof stuck down you can drive it, but you will be sad if it rains. So, is the car "up" or not? Similarly, if your site has writes offline for a database upgrade, but reads work fine, is it "up"?

    The concept is just advertising and something that makes sense to senior management, but provides no actual useful metrics.

  • source
  • parent
  • [–] 100 points 2 months ago (23 children)

    I have never been a fan of anything above 3 nines of uptime even in a business situation.

    Your business will not collapse because of 10 min of downtime a week, and if it does that is not technologies fault.

    I don't even bother to track my home setup.

  • source
  • hideshow 23 child comments
  • [–] 87 points 2 months ago (4 children)

    My home server is 100% up, because I never check it and that's how it works, right?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 4 points 2 months ago* (1 child)

    This reminds me of a news story from the start of Covid.

    Tanzanian President, "We have zero bases of Covid!"

    Rest of the Earth, "Cool beans! How did you do it‽"

    Tanzany Prez, "Easy, we just didn't test for it."

    https://en.wikipedia.org/wiki/COVID-19_pandemic_in_Tanzania

  • source
  • parent
  • hideshow 1 child comment
  • [–] 21 points 2 months ago (6 children)

    Your business will not collapse because of 10 min of downtime a week, and if it does that is not technologies fault.

    Hospitals? Air traffic control? Power grid operators? Like these are exceptional businesses, but they're out there.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 0 points 2 months ago* (1 child)

    Those do actually go down. Hospitals have to be evacuated after an earthquake, airports force all aircraft to divert or the grid has the sort of outage that gets it's own Wikipedia page and needs to be black started.

  • source
  • parent
  • hideshow 1 child comment
  • Those do actually go down.

    That's the point I'm making: when those examples go down unplanned, in particular hospitals and the power grid, in particular the examples you gave, those can be catastrophic events. I.e., if we ignore planned downtime, then these businesses really need five lines of reliability during the times they are expected to be up.

    I agree with the overall point that the average business doesn't need five nines of availability, but I wanted to point out that there are definitely businesses that do.

  • source
  • parent
  • [–] 9 points 2 months ago (3 children)

    I found the GitHub employee! 😉

  • source
  • parent
  • hideshow 3 child comments
  • [–] 8 points 2 months ago (4 children)

    There are plentiful scenarios where 10 minutes of sequential downtime would be a critical issue. Say you're a telecoms or internet provider - even a one minute delay to a life-saving message can be enough for someone to die.

    Furthermore, lots of things are interconnected now. Your business might be able to handle 10 minutes of downtime, but lets say my business relies on 12 different service providers like you, who each have 10 minutes of downtime during a week using your rationale. That could up being 2hrs of downtime each week.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 2 months ago (1 child)

    99.999% is about 5 minutes and 16 seconds of downtime per year.

    12 services down perfectly sequentially works out to 76 minutes per year, not 2hours per week.

    Not saying there aren't applications where that can't be catastrophic, but you're scale is off for three 9 downtime.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 34 points 2 months ago (2 children)

    100% uptime since the last time we turned it on!

  • source
  • hideshow 2 child comments
  • [–] 32 points 2 months ago (3 children)

    doesn’t every website go down when there is no power? ;)

  • source
  • hideshow 3 child comments
  • [–] 28 points 2 months ago* (1 child)

    There's a nifty project on Mastodon where someone is running an instance entirely on solar (and I think a battery?). They've been tinkering with some of the code to do things like optimise images for reduced weight or CPU cost.

    The project is called @solaradmin@solarcene.community and the account for the person running it is on a separate instance, presumably so people can message them about problems: @smallsolar@techhub.social.

  • source
  • hideshow 1 child comment
  • [–] 24 points 2 months ago

    I used to work on the website for a utility company that insisted on ridiculous uptime. Our major deployments risked taking the system down for a few seconds, though in practice that never happened.

    As a result, they made us do deployments starting at 3:00 in the morning since that was the least active time on the site. Fuuuuuuuuck that place.

  • source
  • [–] 23 points 2 months ago

    Uptime for home users is useless. More important is recovery, reboot and resume (the 3'Rs)

    You server should reboot automatically, storage should restore itself from unsafe shutdown and your services should resume operations like nothing happened.

    This means test your reboot, ensure stuff doesn't break, and so on.

    Failing storage after an hard reboot is the hardest.

    For network, i have two ISP connections and a an auto switch script Incase one goes down. But honestly it's overkill and not needed for 99% of home hosters.

    Buying some kind of UPS like a battery powered power strip is also nice but keep in mind that require maintenance to replace batteries once every few years (long enough to forget) and so be useless. The ups shall only last enough to perform a controlled server shutdown using NUTS.

  • source
  • [–] 13 points 2 months ago (5 children)

    Over a period of roughly one year (351 days, from 12 December 2018 to 28 November 2019) the server was up for 95.26% of the time. This means that we were offline for 399 hours (which corresponds to 16.64 days).

    Not bad at all really, at least for non-mission critical sites. I have solar and I really like it. Solar power on two barns, and a lot of my security cams run on solar. I'm not sure if it's the formatting of this site, or the grainy pictures, but it oddly reminds me of the Trojan Room coffee pot.

  • source
  • hideshow 5 child comments
  • [–] 4 points 2 months ago (4 children)

    I would be curious to know this uptime relative to any other self-hosted sites.

    I remember Reddit and Twitter constantly suffering from uptime issues and they were far more decentralized, with modern infrastructure to match.

    Is 95.2% all that far out of the realm of expectation?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 2 months ago (1 child)

    95% isn't great. I run my own servers on solar and I don't think I've had more than a hourof unexpected downtime in the last 3 years, excluding the usual update reboots.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 2 months ago

    Well, the article did go on to provide better stats once they changed out the panel and battery:

    Since then, the uptime has been 100% (March to September 2020), even though we have added a lot of content by making the website multilingual. This is due to the larger (brand new) battery but also to the better orientation of the smaller solar panel. The battery’s capacity will decline over time, so the higher storage capacity will make it last longer. If the uptime remains 100% through the winter 2020/2021, we will probably downgrade to a 20W solar panel.

  • source
  • parent
  • [–] 13 points 2 months ago* (1 child)

    garage is a software project made for communal home hosting. Tech literates will talk about its S3 API but that's the least interesting part: the most interesting is that it has been purposely built to be hosted on (actual) commodity hardware like second-hand nucs, running on flaky home power and internet and linked together through usual isps. Nodes may come up and down but the cluster withstands all of that.

    Garage would be a pretty nice project to run a solar-powered mini-cluster. If sufficiently far from each other, you could even run without polluting batteries !

    https://garagehq.deuxfleurs.fr/

  • source
  • hideshow 1 child comment
  • [–] 12 points 2 months ago (6 children)

    "Hey look everyone! We never heard of grid scale batteries!"

  • source
  • hideshow 6 child comments
  • [–] 0 points 2 months ago (3 children)

    Grid scale batteries are only a solution for transients, if that. Actual energy storage needs to be scalable like pumped storage hydro which accounts for 95% of all storage capacity worldwide.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 2 months ago (2 children)

    Scaling means you buy 2 instead of one.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 2 months ago (1 child)

    That is literally the opposite definition to scalable. Scalable things don't require twice the resources for twice the capacity.

    Buy two instead of one is exactly the worst case scalability you can have.

    95% of the world grid storage capacity is pumped storage hydro and batteries will literally never be able to compete because water is the cheapest energy storage medium we could possibly have at grid scale. North America was the world leader on PSH in the 1970-2000 but now China is eating our lunch and our governments no longer have the ability to start real infrastructure projects because of crony capitalism.

    I can't believe we're watching China become the world leader in renewables while we pretend like batteries are a smart way of storing GWhs of power because that's the most profitable solution to the private sector.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 10 points 2 months ago

    I host my personal site at home with a 15-min battery backup. After that, I accept the downtime. Rarely happens and I haven’t had a single complaint when it does.

  • source
  • [–] 10 points 2 months ago (1 child)

    It's honestly impressive what you can do with under 3W of power these days

  • source
  • hideshow 1 child comment
  • [–] 9 points 2 months ago (1 child)

    Appreciate the website itself, with it's dithered low-colour PNG illustrations.

  • source
  • hideshow 1 child comment
  • [–] 8 points 2 months ago

    i love this website. The articles they wrote is always interesting

  • source
  • [–] 8 points 2 months ago

    Use a gell cell lead acid battery (the kind that go in regular UPSs). No fire hazzard, ans bonus, they can survive freezing temperatures just fine if outdoors. Downside is replacing a cheap battery every 3 years.

  • source
  • [–] 8 points 2 months ago

    Having everything open, on and available 24/7/365 sounds nice until you realize the human toll for things which aren’t that necessary and can be planned around. Down time is a good thing.

  • source
  • [–] 8 points 2 months ago (1 child)

    The 1% of the time it's down, there's always the Internet Archive or reading your own downloaded copy.

  • source
  • hideshow 1 child comment
  • [–] 7 points 2 months ago (1 child)

    Current uptime of over 23 weeks, not bad

  • source
  • hideshow 1 child comment
  • [+] 19 points 2 months ago* (5 children)
  • [–] 6 points 2 months ago

    Now they can get better hardware, but should they? They take seriously the low tech part, and part of being low tech is fighting against consumerism culture and keeping with what they have, which is wotking fine

  • source
  • parent
  • [–] 3 points 2 months ago*

    A 40Kwh battery is like 10 grand, I'm not sure why you brought that up. I'd be more likely to invest in a second battery and solar panel. It's been up for over 23 weeks right now, I'd guess a second solar panel and battery could keeping it up nearly 100% of the time, and it'd cost under $100 for a 200wh battery and 30w panel.

  • source
  • parent
  • [–] 6 points 2 months ago*

    All websites go offline when there is no power ...

  • source
  • [–] 5 points 2 months ago

    This actually cool.

  • source
  • [–] 5 points 2 months ago (6 children)

    Does anyone remember when businesses would operate their websites only during business hours and then take most of the functionality offline after hours?

    I'm possibly also mis-remembering my early internet years and just talking shit.

  • source
  • hideshow 6 child comments
  • [–] 3 points 2 months ago* (1 child)

    This is sometimes still a thing. I know of at least one religious news organisation that takes the website offline on Sundays.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago

    IIRC, the USA Social Security Administration's website operates somewhat like this, because they seem to still do batch processing (a la mainframes) during the evening hours. As a result, they prevent people from logging in so that they don't get interstitial data about their public pension.

  • source
  • parent
  • [–] 8 points 2 months ago

    I love Low Tech magazine! I have been reading them for years.

  • source
  • [–] 4 points 2 months ago

    My brother in efficiency, let me introduce you to https://wiki.slrpnk.net/articles:start

  • source
  • [–] 7 points 2 months ago* (6 children)

    Interesting concept. I haven't seen lowtechmagazine before, going to have to definitely check it out.

    I spin down our development environments when they have sit idle for a period of time, not at all the same but makes me think deeper about the entire concept.

    Update: This is a really cool website. I see some fun projects here too that I could have my kids work on!

  • source
  • hideshow 6 child comments
  • [–] 2 points 2 months ago (4 children)

    On that site: Communal Luxury: The Public Bathhouse - Throughout history, people have bathed in public rather than in private. Should we bring back the public bathhouse for the sake of sustainability?

    The max amount of people I want in a bathtub is 2.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 4 points 2 months ago (3 children)

    Eh.. a bath house != Bath tub

    Bath houses still exist in Japan and a bunch of other countries. They don't feel thaaaat weird after the initial shock wears off.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -2 points 2 months ago (2 children)

    after the initial shock wears off.

    Your shock or mine? The problem is akin to females that protest the patriarchy by taking off their clothes in public. I never seems to be any of the beautiful people.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 9 points 2 months ago (3 children)

    This is actually great!
    Social media sites should do this. There's never a good reason to be on [Insert Corporate Slop Social Media Website here] at 3AM.

  • source
  • hideshow 3 child comments
  • [–] 19 points 2 months ago (2 children)

    Never a good reason, like different timezones, different working/sleeping hours. Theres no better or worse hour for every single person.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 2 months ago

    It's not like those major social media sites don't have some kind of data center (or rent one) in every "major" (population wise) timezone they operate in. Your other arguments still hold true, but I think even then it would be better for all of us if those websites went down every now and then.

  • source
  • parent
  • [–] 3 points 2 months ago (2 children)

    Barcelona pff… now do it in Oslo! 🤣

  • source
  • hideshow 2 child comments
  • [–] 3 points 2 months ago

    There are solutions like IPFS for decentralized content hosting so downtime of a primary resource is less important.

  • source
  • load more comments
    view more: next ›