My automatic weekly backup ran for the first time last night. Everything worked nicely.
post
Nothing really cool per se, but I installed Radicale on my local network as I am slowly moving away from my cloud providers.
Once I find some hardware to host Immich, I'll be fully self supporting on all my tech.
Yeah, working some radicale related stuff on my end. Roommate decided tasks.org was the most useful to-do list app/implementation for keeping track of house chores. Gotta say, hate that radicale has basically no front end, but boy has it been crazy easy on the plug and play side.
But yeah, looking to take an old tablet and set it up as a kiosk for showing the days chore list. Might be the beginnings of me trying my hand at building a full fledged smart speaker (X to doubt tho).
Radicale and immich replaced my nextcloud instance and I never looked back. I have both updating through apt like everything else and it's amazing how little maintenance it requires.
I'm into this as a regular thing!
Pinned, I think a lot of us really enjoy seeing what others have been doing to take back and make improvements to our own setup.
Glad you like it! I tried to go for a 2-3 week cycle as I realized every week is a bit too often (less comments). I also tried to do it alternating with the community on slrpnk but they're currently down. I often forget to do these anyways :D
Anyone can make these, of course. I always enjoy doing them and talking about stuff I enjoy.
I recently got around to setting up OIDC for my internal apps using Pocket ID.
Sonarr v5 adds OIDC support, currently only in beta
Jellyfin SSO plugin
Nextcloud with the Nextcloud OIDC app
Mealie, Paperless, and Immich natively support OIDC
Calibre-Web I migrated to AutoCaliWeb, which supports generic OIDC
Sadly Navidrome doesn't natively support OIDC and forward auth is a bit jank due to the subsonic API
How does the Jellyfin SSO plugin work for you? I've set it up with LDAP at the moment so that tv clients and such can still login normally
Decided to get back into podcasts recently, but baked-in ads and sponsor reads make standard listening unbearable.
I spent the weekend spinning up MinusPod, an open-source tool that detects ad reads and strips them using ffmpeg. It uses Whisper for local transcription, then feeds the transcript to an LLM to identify exact timestamps for sponsor segments and commercial breaks before slicing them out. I routed the text processing through Gemini Flash, which runs about $0.07 per episode. Clean, ad-free audio feeds with zero manual editing.
This reminds me of a project idea I've had.
Auto-muting a TV using an HDMI splitter and an SBC running some sort of algorithm that detects if there's an ad on the TV.
After the recent plex player debacle I'm once again trying to come up with a way for me and my diaspora to share media using Jellyfin, but without relying on Tailscale. We have several media libraries, and some of the library hosters are not too tech savvy, so coming up with a solution to replace the ease-of-use of plex hasn't been easy.
Hey, I did the same. It’s not as bad as it seems. Get yourself a domain name from cloudflare and use it. I got mine for $10 a year. Then just installed cloudflare on my Debian server and all that (I’m sure you know the rest) then made users on my admin jellyfin dashboard and started sending people their usernames and passwords. The only difference for them is now they would need to enter the server URL on the first page of whatever they use then username and password. Good thing these jellyfin clients have the page of entering the server URL in your face with their “connect to server” button. Let me know if you have any questions.
Careful with using CF Tunnels for streaming content. It's against their ToS to use the free tier for streaming content, so they can technically turn it off whenever they want from my understanding.
From what I understand, if you turn off caching you aren’t violating their TOS. I’ve been doing this for about 2 years now and have yet to have anything happen. Multiple friends use my Jellyfin server daily.
Against whose TOS? Jellyfin’s? I’ve never heard of that. Do explain why please.
Edit: I re-read your comment a couple of times (English is my second language), then searched some stuff. I didn’t even know cloudflare did that. I’ve been using them for over 2 years with no issues. I guess I don’t stress their servers enough? lol. If they stop me, I’ll just move to another company. I won’t even bother asking them or anything.
Thanks for the details. I don't think that covers my main problem though: letting other people who are not tech savvy share their libraries with me.
A user story would be: "I want to enter a search and find the result across all my friends' shared libraries."
Procrastination. Want to move may lab off my pi onto my mini PC.
I have done the backup off the pi, just need to restore it but motivation doesn't line up when the family is out of the house.
I bought some hardware last winter… still sitting in boxes. I do have adhd though
Part of it is I want to shuffle around some stuff, like switch my mobo out on my main pc and use its mobo in the new server
Not quite server related, but in the middle of a workday this week, I decided I was done with Windows on my home PC. Installed Zorin OS and things have been going really well. Any issues I've had have been really minor and mostly revolve around me being picky about theming.
I haven't found a native mp3 tagger that makes sense to me yet, so I just installed Mp3tag. I'm open to suggestions on that front.
On the server side, it's mostly just keeping on. A friend has me considering Home Assistant, I just don't know if the value is there for me. I need to do some housekeeping today and update and clean up unused containers.
I have opinions about music tagging! I'm picky; I don't trust any amount of automation to find the exact right release with the right album art I want, so I use GUIs instead of a CLI -
MusicBrainz has Picard, and that's pretty slick. Also includes a handy renaming tool for keeping files organized. Quod Libet is also worth a look. I'm not as familiar with its feature set, but it'll run on a toaster.
One day I might try to tackle Beets. Heard lots of good about that as an auto-tagging solution, so maybe check that out, too.
Yeah, same. Earlier this year I thought "Hey, people seem to love auto tagging with MB, Picard, Beets. I should try it."
But that was short lived. I don't want release information outside of artists, titles, albums, year. I just have no need for it. I know how to get what I want from mp3tag.
I am looking at using Beets to keep things clean, maybe find missing artwork, and fetch lyrics. But the vital information I'll keep reviewing.
I haven't ever gotten comfortable with how Picard works, but I'll check out QL. Thanks!
I am trying to find affordable 2x16Gb ram modules that are just right to run on my asrock J5040 and push my proxmox to more possibilities.
Because my needs for ram are increasing since its not just about have the services availble anymore. I plan to add gitlab and k3s and with the rest of my services the 16GB ram are pretty tight.
Good luck! I've been watching auctions for some weeks on ebay when I needed 2x32GB SODIMM some months ago and eventually got a pair for 230€. Fucking expensive but cheaper than most other offers I found.
Feeling better every day having my stuff under my control and away from prying eyes of trackers and other unsavory stuff.
Upgrading one of my powerhouse Dell R410 proxmox nodes to 128GB of smoking hot PC10500 DDR3 ECC Ram from 64.
Now it's cutting edge.
Last week I had to update everything to make sure that it didn't fall back on DST because the fucking idjits in my backwoods province decided that they needed to create a new time zone.
-
I've taken the opportunity to update most of my hosted services to newer image versions.
They're all in Docker and behind private access (Tailscale, mTLS, IP whitelist etc.) so I'm not usually too worried. I update images manually whenever I can find time on a slow weekend, so this wasn't strictly speaking related to the recent vulnerabilities. Volume data and container definitions are backed up automatically once a day and I also take manual copies of the old images when I update them.
-
I've switched to new major versions of Immich and Jellyfin in the process and I'm very pleased with the new releases, amazing great work from the developers, they've been killing it lately.
-
I've been tinkering with some custom images that I use for various things like syncing specialized data (logs off FTP services, archive email over IMAP from my mail provider, grab Garmin data copies, run monitors and log parameters to Influx, run port forwarders etc.)
I typically want to lock down this kind of images as much as possible, so I tweak them towards running with an unprivileged user, remove all caps and only grant strictly necessary ones, make the storage read-only inside the container etc.
-
Some needs have been recurring inside this type of containers, like having a decent process manager to keep some things running and restart them, or having a decent cron service. So I've been toying with the idea of making a "universal" image for this kind of thing and maybe publishing it for others to use as a base too. If I get around to it I'll be announcing it here.
I shut everything down only to discover nothing runs on php, while shit was going down at work. And I just recently discovered how to run docker compose updates through Komodo which is great.
I love Komodo! Have you attached Renovate as well?
Thanks for this post, something I miss from earlier selfhosting communities.
I have simply running two SFF Lenovo Thinkcentres—one for all local services and another for all online services. They could run on one but I keep them separate for security and stability reasons. I often crash the local one by running out of space…
I finally got to building a second backup recently which I am happy about.
Honestly, since moving and downsizing from several services at home and at work, this solution works. I run out of space frequently but it forces me to not hoard things I will not actually use. My previous rack server seeded something like 50tb as I kept everything I leached to benefit the community, now less possible.
This has also made me move away from services that are not needed.
-
[ ] I would like to offload all my home videos to an external drive as I am running out of space for actual services and Jellyfin media.
-
[ ] I would like to consolidate all of my local and online databases rather than run a new one for each container stack.
Finally took the leap and wiped my NUC to start doing things over. Originally had a family member who works in IT set everything up, but he did the absolute bare minimum and I screwed some stuff up along the way the first time around, so I figured now was as good at time as any to teach myself to set things up from scratch!
I also have moved from Portainer, to Dokploy, to Arcane for docker management, and I actually really like Arcane. I've also accomplished something I'm really damn proud of, which is getting HTTPS working on Tailscale (so, for example, arcane.(my subdomain).ts.net but with HTTPS!) alongside Pocket ID for all of it. Maybe it's just me, but I had trouble finding clear documentation on how to do this, no matter how much I searched. But I documented it for myself, at least. And it's probably that I lack a lot of knowledge in this field, too.
I have some questions, and although I know there's a chance this gets buried, I figured I'd try asking anyway. Little skittish about making a thread myself.
My NUC is running Debian 13, and I was wondering some security things. Everything is behind Tailscale and I don't plan on exposing anything to the internet (even through Tailscale Funnel, I'm using Tailscale Serve for the HTTPS.)
- How valuable is a firewall in this case? I've never used one, and I'm wondering if it'll just make adding services more of a hassle than it's worth for the security since everything is staying local.
- Similarly, what about Fail2Ban? I have it on my RPi and it's not a big deal to set up, but I was reading a firewall is more important?
- Is it okay to run unattended updates for security OS stuff on the NUC? I don't always check updates, admittedly I'm easily distracted and forgetful. I'm a little worried about auto restarting it to finish the updates up just because I utilize a NAS and sometimes it's annoying to get them to reconnect to each other (even with the fstab edited) when there's a restart for either of them.
- Thoughts on auto updates on docker containers? I know this is pretty personal preference, but I mostly ask because I'm forgetful and distractable. I know this is kinda my own problem, but I want to know other people's thoughts if possible.
Thank you for reading my very long update! And any answers to my questions are very appreciated. Hope everyone else is doing well!
F2B/FW: If it's only available locally/via VPN, I think your threat model is your LAN. People in your wifi or rogue smart home stuff. I think a firewall makes more sense here, but if it's just 1 machine, you should be fine with ufw or the like. If you have several VMs that are supposed to be separated, the solution would depend on the virtualization software.
Unattended upgrades are way better than none at all, both for system and docker. Of course it depends on how important it is that your services are "always" available and I get the NAS struggle though.
Hey, thank you for the comment!
That makes sense, that I would be tightening security on the LAN. It's not just one machine, I have a Raspberry Pi 4 as well running a flavor of Debian (and the Synology NAS), so I would assume a firewall on both the Raspberry Pi and my NUC would make sense? I don't have any VMs that I'm aware of, and I've heard of VLANs but don't know anything about those.
Services don't always have to be available! It's just me and my partner who are accessing them, so nothing like a lot of people who need media playback. I'll have to weigh if it's worth fighting with the NAS over auto reboots, but I'm leaning towards yes as an experiment. I'll have to actually look into how to do unattended Debian security updates, though.
I hosted Donetick. It was awful. Everything is processed server-side, which makes it crazy slow. Data should be backed up locally on device. Shame because it seems an otherwise sophisticated software.
Sounds great, I'll try it out.
I've just uninstalled Super Productivity because all the data was client side and server sync was problematic. I'm always going to use it on the home network. This sounds like what I wanted with time tracking and everything.
Same with removing Affine having recently removed that. Same client side data nonsense. I want everything processed on the server.
Other than this.... I've been trying to keep up with updating everything with all the vulnerabilities with PHP, Debian Kernel vulnerability, etc.
Oh I also set up Homarr. I didn't think I needed a dashboard. But this has been amazing.
I hope it works out well for you. I don't have problem with server-side processing, I just wish it would be backed up locally so I didn't have to stare at a spinning circle for 5 seconds just to mark a task as completed. Currently I use Tasks (tasks.org) and there's a "completed" option right in the notification.
A while ago I made my first attempt at setting up a SSO for some of the things I host. I figured out things that have built in support, like Immich, but struggled with getting it done through Proxy for things that don't have baked in OAuth or OIDC support.
I revisited it yesterday and figured everything out so I'm happy about that. Navidrome was one of the more difficult ones to figure out because I need SSO authentication for the web-ui, but username/password for the API. That was actually pretty easy once I wrapped my head around it.
I picked Authentik based on general positive things I've heard about it, and I use Nginx Proxy Manager for reverse proxy.
OMG patching all the vulns. I actually pulled my wordpress offline overnight for that one. Still waiting on the Ubuntu patch for that IPv4 kernel CVE.
That reminds me - It's time to do No NAT November again. This CVE gives me an excuse. Last year, the Nintendo Switch Switch and Steam were the big standouts. I think the Switch 2 will actually work with it now.
Oh, and my workplace is shifting offices, so my offsite backup is not offsite. Must take care to not burn the place down. I just put new fans in my PoE switch and now I can hear a server fan is dying too. There's a lot of maintenance work to all this.
I was 429ing a little too liberally, so I upped my burst rate. This week, just like last week, most of my traffic was bots. But if a real user does come by, I want his or her experience to be pleasant enough.
Just completed my set of needed services by adding nextcloud to the list. Now life is good. Jellyfin: check. Navidrome: check. Pihole: check. Invidious: check. Nextcloud: check. What else? lol
I finally ran a hardware accelerated ML container for immich.
My immich is in a VPS and my GPU is in my home server. Cheaper to run that than to rent GPU compute.
This week, I've mainly been handling the fallout from the PHP vulnerability that occurred in late October. Following that incident, I made a few changes: I've opened only the necessary ports to the outside world, and the admin panel is now accessible only via VPN. I've created an inventory list for each server, clearly detailing which services are running and their versions, so that the next time a CVE is released, I'll know immediately which servers are affected. In addition to running daily automatic backups, I periodically restore them to a clean machine to verify they work.
Remember: Always treat your servers as if they might be lost tomorrow, and make sure to have a thorough recovery plan in place.
I set up crowdsec on all my internet-facing services. Couldn’t seem to get the online dashboard connected but I could at least confirm that it can block requests.
I’m also struggling with a new Home Assistant automation to send a live notification to my phone when my washer and dryer are running. The notification action works when I run it manually, and the automation as a whole gets triggered when the machine is on, and Home Assistant says it activates the notification, but I get nothing on my phone during a real test. Gonna keep fiddling.
Crowdsec is on my to-do list as well. Should be easy to set up on OpnSense, just never pulled the trigger.
I have HA notifications set up for the same thing, but sometimes they simply won't work. Have you set up all the energy settings? There's a way to create a manual notification from HA, does that work?
The manual notification works, yep. And it’s using a vibration sensor, which looks to be working. I can see the Automation getting triggered, and the trace says it’s executing the notification step. The notif just never seems to arrive.
Edit: I tested again and it worked. Who knows what it could have been.
I can report crowdsec runs great via opnsense. I run this container to get fancy home hosted info https://github.com/TheDuffman85/crowdsec-web-ui
Got a static IP routed in from https://getrealip.net/ so I can go back to hosting my own servers at home again properly without needing to hack up everything to route through Cloudflare with Tailscale. CGNAT is really messing up the internet. The service even supports reverse DNS, yay.
Weekly update and restart of my servers. Also planning migration of my k3s cluster from Archlinux to NixOS.
I've mainly been looking up some good ways to backup my Podman services. I manually copy my volumes every couple or months or so. (Which I was thankful when my hard drive started failing on me). I saw a post about Portabase here last week and figured it's time to look into something less involved.
I also used that as an excuse to start moving my 5 mysql containers that each service ran themselves into a single mariadb container.
The updates from the last CVEs were seamless. Nothing surprising since I have very little installed on my Debian server.
I didn't change my view on anything from the recent CVEs. I always assumed my server can be compromised, so everything sensitive is encrypted anyway, and I update all my systems/software often or automatically. The latter of which comes with its own set of risks I'm willing to take
Using nix to maintain my fleet with automated updates so I didn't really need to worry about it thankfully; just checking that I had relevant/patched versions. All my services are nice and up to date so didn't even have to take anything down (yay)
What I'm excited for today is to progress personal slop project (be gentle) I started yesterday. Hoping it'll just be one or two weekends.
I've been hallucinating a transcoding suite/workbench. Includes experimental sampling matrix of ffmpeg settings with a composable / layer-based project configuration; rust egui+mpv desktop client. Then the hosted orchestration server can distribute ffmpeg jobs across my worker machines (via my local headscale tailnet). Output produces a project+metadata bundle that includes hand-picked source:result JXL frame comparisons alongside both human readable reports and client readable configuration that makes the projects (more or less) reproducible (with worker tool env versioning via nix flake.lock) and logs provenance.
I intend for this to be a replacement to the piles of crappy python scripts I've been using for the last decade; my current workflow is to move files into host-labeled ingest folders with an argument string in a text file, then ssh to the host to run the job.
But what I'm most excited for is the experimentation matrix. I hope that it will reduce my electricity usage and disk thrashing; it will let me sample settings for ~1minute of footage around the sample frame and let me iterate my tuning much faster. Currently, it's faster (in terms of hands-on time) to just transcode whole episodes or even entire seasons multiple times with different settings and then just discard the ones that underperform. Extremely wasteful; testing a settings matrix is something I've always wanted, but never had the time to build (and still don't, hence slop).
I'm currently in the process of writing yet another script. This time my aim is to make one that will setup a server from a fresh Operating System install.
I want to do this for two reasons. The first is so that I have an alternative to backups. It would also help with major Operating System updates because sometimes those are a bit messy.
The second reason is because I want to help other people setup a simple, minimal and more secure setup for a home server as well.
It will all be POSIX portable too so it won't be limited by extra requirements. I've already made a lot of progress with it because I started doing the same with my personal computer. I've been able to focus on that because my home server is super simple and I've been able to ignore all the recent vulnerabilities.
Don't create another Omarchy please!
I have a similar thing but I'm using Ansible. That way, I don't have to handle all the error checking etc myself.
I don't like bloat or AI/LLMs and I focus more on minimalism to reduce surface attack areas while still focusing on security. There's nothing flashy about how I plan to approach this project. It's going to look ugly.
My main focus is to help create communication for local communities and not create tech that enables control over other peoples freedom.
I highly doubt my project will ever leave my community and that's fine, I'm not interested in making a name in an already crowded space.
What are you building for your community? I think smaller communities is really the spot where this hobby can have a greater impact in enabling people to collaborate in different ways.
The end goal at the moment is to have the script setup a minimal environment that would host a forum. That way people can organize themselves based on local community needs.
My current and more manageable goal is to create a script to setup a minimal environment for a basic blog. At the very least someone can make posts for their community or themselves. Once I have that baseline, then I'd work towards the larger goal if that's still how I feel after getting there.
I'm also interested in exploring different ways to be able to share local community servers/sites. It may look ugly, and may add slight inconveniences but it would be nice to have alternatives to big tech offerings. I'm leaning towards a small web concept. A focus on local communities helping themselves and neighbouring communities.
i have an asustor nas and i set it up with my hdd raid 1 drives as volume1, and installed my ssd later as volume2. now docker is constantly making my hdds tick and I can't move it to the SSD because asustor don't allow it ☠️ so I'm looking at reeeeaaallly testing my backups, wiping the device and reinstalling everything. It's all in docker so it's theoretically easy enough 🤞
I've been focused so much on work-related stuff involving DST changes that I neglected my own systems!
In terms of my setup, there was basically no impact. I use Debian (servers and some workstations) and Arch (couple of laptops and a couple of miscellaneous task-oriented devices I want more recent builds on than Debian will give me)
Work? Different story, so much manual updating!
Otherwise just regular stuff this week like backups (monthly incl since yesterday was the 31st), reviewing changelogs for minor updates, etc.
Hit a bit of a wall in my animal identification tools I'm making, so I'm going back to do some more reading to see if I can find a way to improve efficiency more and make it smaller while maintaining accuracy.
What kind of id tools? Like the bird sound thing?
Similar but not the whole thing. I'm identifying more broadly (deer, horse, chicken, etc) but more focused on their movement and condition. Are their coats are healthy, their movements normal, so on.
Classification then changes which CV model is used to evaluate the rest.
Right now they are too big to be fast enough, and going smaller is breaking the model. N9t because there aren't unnecessary bits to trim out, but because I'm not doing a good enough job at minimizing what's actually needed.
I've been working on it for a while now, but still have a long way to go unfortunately.
That sounds very cool! Did you have prior knowledge in that field or are you learning as you do it?
I deleted a bunch of services I’m not actually using on my home server. Nothing used php, but it was good to do some house cleaning.
I also started a blog (Hugo is much nicer than I thought). The procrastination has helped me get a lot of other things done.
Is there an easy way to do that ? I often think about all the random libraries and crap I've downloaded over time.. auto remove doesn't really clean anything up but if I look through the apt list I've got no idea what's a dependency of what.
From my logs nothing bad happened to any of my services. I turned off my entire homelab for a few days until every single app/service had an update. Then I turned everything on, updated and that was that.
One cool thing I have is https://github.com/lklynet/hypermind totally pointless, but I like it.
Recently picked up a lenovo system x 3650 m5. Came with 16 GB DDR4 which is already worth more than I paid for it. Now to find the time to mess with it....
I've been a Joplin user and using their Joplin Sync server for a few years now. Last night, I migrated everything over to Obisdian and just finished setting up a self hosted obsidian sync. I will say that the self hosted sync was nothing short of a puzzle for me but finally nailed that down between my phone and desktop app. So, I have the same as Joplin now for that functionality.
What got me started on this little side journey, is I've been seeing more and more pretty cool uses for Obsidian and have a lot of great things about it. I'm not dumping Joplin yet, but am giving this a solid try before I make any hasty decisions.
I did the opposite this past weekend and migrated from Obsidian to Joplin. Obsidian is a fantastic tool, but with my AuDHD, it's an absolute productivity trap.
I spent 90% of my time tweaking community plugins, designing complex custom templates, and configuring graph views, and maybe 10% actually writing notes. Joplin lacks the infinite customization rabbit holes, which turns out to be a feature: it forces you to use the tool for documentation instead of endless system design.
I got a network rack and a rack mounted UPS that I need to install today and then move everything over too. Looking forward and not to getting it done lol
Ordered a cheap Coral TPU for my server (an older HD mini PC with AMD CPU, no discrete GPU), just waiting on it to show up.
Last week, I finally got my Tapo cameras + Frigate + Home Assistant all working together, but now my server's CPU idles between 65% and 90%, hence the TPU.
I have electric baseboard heaters so i like to heat my home with my server in the winter. I dont use it enough in the summer to warrant the power draw, but i'm looking forward to doing so this winter.
I'm hoping the AI bubble pops soon... i'd really like to pick up a decent accelerator card for AI for my desktop. My current server doesn't have the PCIe slots left (all filled with U.2 drives on PCIe adapters or HBAs) so it would need to go in my desktop... i thought 64GB was a lot when i built this 3 years ago but now i'm wishing I put 128GB in it...
My server has 238GB though (ordered a 256GB kit and one stick was dead. Caught that on the 4th test cycle with memtest86+ pro which I 100% paid for.) Since I use it for not only ZFS but also all of my random containers and game server VMs.
I got new rack gear. I don't 3d print so I ordered metal face plates for my 10 inch rack. got them here https://www.rackmountplates.com/
I am not affiliated. just a happy customer that stumbled on a solution to a problem. Sharing in case others have similar needs
Home Assistant got a larger STT recognition model thanks to openvino (on an Intel NUC). The intent was to get better recognition of music artists names.
It's better, but not perfect. Instead I'm scraping the music directory for names and injecting them into a database that the automation can query.
top 100 comments