I don’t think people are archiving LLM output. The article indicates there’s increased storage because increased security risks. I’m dubious of that. To me the size of the models themselves probably drives this. But also, I think companies are likely retaining more of their user data in the hopes that they can use it to train models on later. For example, call centers might be retaining more call recordings in the hopes that they can train a “top salesman” model to either coach other humans or directly sell itself
comments
Why would I want to archive what it produces? I can literally regenerate at will and it's entirely based in the training set, do it anything the training should be archived, which it already mostly is. At least the relevant parts.
This is exactly the kind of project that's easy to take for granted until the day you need a specific BIOS and every download you find is dead or unverifiable. Checking against emulator source rather than trusting whatever's floating around is the right call, that's usually where these collections go wrong.
Bookmarked for when my Batocera box inevitably needs a re-flash. Do you have a cadence for pulling in new releases as RetroArch etc. cut new versions, or is this more of an as-needed refresh?
Rough one if the creator's actually gone dark, that project's been load-bearing infrastructure for a long time. A few things holding the fort while the dust settles:
- The AUR package might just be pulled because the upstream download link broke, not necessarily dead-dead. Worth checking the AUR comments or grabbing an archived copy of the last known-good installer if you need to keep ripping today.
- makemkv-oss exists as a stripped decrypt-only fork on some distros, handles the AACS/BD+ decryption piece even without the GUI wrapped around it.
- For the actual muxing after decryption, ffmpeg with libbluray compiled in will read a decrypted BD structure fine, it's just not as one-click as MakeMKV was.
- The part that's genuinely hard to replace is ongoing AACS key updates for new discs, that's usually the real value MakeMKV was providing beyond the rip itself, not just the tool.
Hoping someone picks it back up.
Weather update. I THOUGHT I read through the makeMKV forums. cough Looked at the top 5 or so posts. See the post datea are old. Leave cough
Turns out if you look a bit further down, all the posts are saying the same as the comments here
So my bad for not doing my research properly. (Hey. I got glasses. It's not my fault /s)
This project might be up your alley if you want to rebuilt your stack:
https://github.com/automatic-ripping-machine/automatic-ripping-machine
Not sure about the AUR, but the site goes down all the time and the creator has been MIA for months in the past. It's still on flathub and you can download publicly maintained keydbs, so even if the creator and website vanished permanently it'll keep working. If it were to stop working at some point you could probably cobble together a replacement with a few other tools: aaru to dump the disc, something to decrypt the aacs files, and mkvtoolnix to remux.
I noticed this too.. Especially for Linux this may be tough.
I'm surprised by the fact that this is 14 gigs and seemingly missing 5 years of new hacks!
Do you know if these parched roms are included in any dat?
haven't tried it but i think the thing i've read about before is https://archivebox.io/
Have you looked at hunchly - https://hunch.ly/ ? It indexes sites as you browse and let's you search for content within them - and only the sites you hit, so its not crawling the rest of a domain. It's built for investigations, really, but it sounds like it does what you're describing. Its not free, unfortunately, and uses an installed program coupled with a browser extension to do what it does.
there's also downloadha.ir and yasdl.com
Lmao it's par for the course for open directories, plenty of them in the past I've accessed with just bare IP addresses XD
That link is lookin' reeeeeeeal suspicious, lol.
I've been looking around SciOp; https://sciop.net/docs/intro/overview/
@WhyIHateTheInternet@lemmy.world
When it comes to old drives, you may very well only get one good read out of it before its gone for good. (Or at least solidly in a very pricey data recovery service territory)
If you have the means to do so, consider a data recovery service first and foremost if you can't afford it or don't want to proceed on
So the first thing you want to do is make a byte-by-byte raw image of the drive(s) with a tool like this https://hddguru.com/software/HDD-Raw-Copy-Tool/
BUT you will need a destination drive that's at least the same size as your source. So if your old drive is 500GB you'll need a destination that has 500GB free or more. Id personally go a tad bigger because ya never know and remember this might be the last time you get a good read
Second it sounds like you did plug it into android and it tried adding in it's default folders, but 1) it probably picked up the 500MB or so tiny boot partition windows makes 2) it only adds folders, it doesn't wipe partitions.
So in both your data is probably fine BUT
It does sound like your drive isnt particularly healthy, so until you're ready to make that image keep it offline and disconnected
Once you have the image, you do all your work from there and keep your source drive safe until you're 100% you don't need it anymore
I'm a data purist. Compression scares me.
Videos as in for Plex? Like the other commenter said, Tdarr, but double check the clients you use for Plex. If they don't support AVIF you'll drop to transcoding which may or may not be problematic for you (If you have a beefy server and don't mind transcoding or it's just you you probably won't notice)
I have played around with Tdarr to transcode some videos.
Techno Tim has a video on how to get it up and running.
Seagate screwed me over on three drives I all at one time. Everyone of them died within 30 days of the warranty being up.
So yeah, I've not bought anything from them in years either - nor will I in the future!
I could use 32TB but I’m not trusting Seagate again!
Is it that shocking though? That’s a lot of storage. I’m sure when like 14TB etc came out that was also a ludicrous amount.
It's quite an unfair caption for their work. If you read their own article you'll see the effort to preserve metadata is huge, and they're not even necessarily planning to share torrents of individual songs in the short term.
BRB gotta buy 300TB worth of storage.