It's A Digital Disease!

This is an automated archive.

The original was posted on /r/datahoarder by /u/Nice_guy1234556 on 2023-08-15 07:34:00+00:00.

Wanted to buy crucial mx500 1TB and pair with up with this enclosure

I heard mx500 has dram so it's better , but will it really make a difference in being an external enclosure over say a bx500 over a 5gbps limited usb 3.0 data port ? Also , is it better to choose a local brand enclosure with a better controller over a known brand with a bad controller

For example this is an enclosure from a local brand with a JMS578 chip , should I take this over Orico enclosure with apparently a norelsys chip according to the comments which is inferior?

This is an automated archive.

The original was posted on /r/datahoarder by /u/Maora234 on 2023-08-15 07:01:00+00:00.

Hello, one and all.

As the title suggests, I am looking for advice on what hardware to get for the Silverstone DS380B case. The reason why I'm looking for advice is due to the fact that, unlike full-size computer towers that are spacious, I don't have much experience regarding the preferred hardware for the small form factor cases.

From what I read, the case requires a HBA card, so I bought the LSI 9240-8i kit from Server Labs (though I don't know how it's different to the Dell model they have listed). But that is all I have bought in terms of hardware for the case.

Use Case:

I plan to use the NAS as a backup system and as a file server for the most part. I also intend on using all 12 bays for hard drives, although cooling might be an issue (from what I read). Though it will also host media files, I don't know if it's better to host / run the Plex Media Server (for example) through the NAS System itself or have a separate computer system to host / run Plex Media Server and connect it to a shared directory for the media.

The reason why I'm entertaining the 2nd option is due to the fact that the quality of the media are not in 4K or remuxed and is in 1080p or lower, and I have a Dell Optiplex with a small form factor video card installed that might be suitable for the job.

I also plan on having the backup and files in one dedicated pool and the media in another, as a way to keep things separate. Like the important stuff in one and not as important in another.

Deciding on the Operating System:

As for the operating system, I am having trouble with what to use between OpenMediaVault, XigmaNAS, and UnRAID. Although I am leaning towards UnRAID, what troubles me is that I've seen a number of users experiencing some sort of data corruption or loss, which I would like to avoid if possible.

Regarding budget:

I happen to live in Australia living on disability, and from what I noticed, the prices for computer and server hardware are usually fairly high, and the deals for hard drives doesn't happen all too often, and when they do happen, the discounts / savings are fairly small. Especially when it's compared to the Amazon deals that are shared here on reddit.

As such, with a limited income and overall costs needed for the project, I intend on getting the hard drives after acquiring the other hardware. Once that's done, I'd first get the hard drives for the internal bays before using up the hot swappable bays.

So, with that said, what would you recommend?

I do have a couple of other questions, and I'm sure that the answers are going to be different depending on what operating system is in use. So, any answers would be deeply appreciated, whether it's for one operating system or more.

1. What I am curious about is the best use for the hard drives in the internal bays?
2. If I were to use UnRAID as the operating system, would using two hard drives for cache and the other two for parity (or a similar setup) be acceptable?

To those who read the post and / replied, thank you in advance.

This is an automated archive.

The original was posted on /r/datahoarder by /u/Merchant_Lawrence on 2023-08-15 06:42:31+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/AjayGhale420 on 2023-08-15 00:38:57+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/lostmanwandering on 2023-08-15 05:34:26+00:00.

Title basically. I have a family member that installs security cameras for a living. He gives me tons of these WD20PURX drives. Problem is 2tb and only 5400rpm. What's the best way to use them? Raid 0, 4?? I probably have 15 of them on the floor and I'm using 3 in my PC with more if I ask.

Bonus Q: I keep maxing out by 1 TB monthly bandwith (cox is cocks) Which public places have fast, unrestricted wifi ?

This is an automated archive.

The original was posted on /r/datahoarder by /u/fuckadminswitharake on 2023-08-15 05:30:47+00:00.

Along with other domains. Anyone else experiencing this?

This is an automated archive.

The original was posted on /r/datahoarder by /u/Greged17 on 2023-08-15 04:07:50+00:00.

Hi, fellow data hoarders! I just discovered this sub and read through some of the Wiki and FAQs and learned have a pretty poor understanding of things. My technical knowhow only goes so far (and it's not that far). I'm concerned that the way I am doing things is not great and am seeking help/advice.

I have a collection of movies/TV that right now that is a little under 8TB total. I have been growing this collection for probably the last 15 years or so. During this time, I have exclusively used external hard drives to house all my stuff, with no backups or copies (pause for cringing). Over the years, I have replaced HDs as my size demands increased. My current external hard drive is a WD MyBook 16TB. I have a plex server for all my TV & movies on this drive. I also have a 5TB WD Elements portable that I keep other things on (projects, laptop backup, misc. overflow stuff to save space on my desktop), and an older 2TB MyBook that I keep an archive of mostly sports games/highlights on. I have them plugged into my MacBook Air M2 (2022).

I know that not having a backup of my media library is really dangerous, and the more time I spend on this sub, the more I'd like to fix it. My question is, what is your recommendation of how to optimize my setup? Would a NAS be the best thing for me, and if so, what even is it (ELI5)? Or is it as simple as getting another large external to house the backup? Or do I go the cloud route?

Thank you for your help!

This is an automated archive.

The original was posted on /r/datahoarder by /u/Immediate_Ad_8428 on 2023-08-15 03:57:41+00:00.

I have a plex server running on an old dell optiplex 3080 micro I bought on ebay. It has 4TB on total storage as of today is at ~80% full.

I want to upgrade my storage but dont have the funds to buy a NAS.

What other options do I have?

Can I just buy one of those docking stations and chuck large capacity hhd and call it a day?

For now im looking for something cheap.

Thank you

This is an automated archive.

The original was posted on /r/datahoarder by /u/Traditional_Cycle192 on 2023-08-15 03:57:14+00:00.

I don’t want my parents to see my photos and vice versa. Amazon photos offers unlimited photo storage for prime members up to 6 people on family prime account yet there is no way to set access privileges on folders?

This is an automated archive.

The original was posted on /r/datahoarder by /u/milanove on 2023-08-15 03:41:46+00:00.

I've come to accept two core truths of data archival:

(1) All data posted online is ephemeral. There's no guarantee the content you see today will be there tomorrow. Your favorite song, video, or website that you've visited everyday for ten years may suddenly disappear without warning tomorrow, never to be re-uploaded. I think this is the reason most of us here hoard data.

(2) The internet does have limits on how far it can reach. You have to accept that not everything has been uploaded to the public internet, and there's no guarantee it ever will be. There's absolute gold mines of rare media out there (obscure movies and TV shows, rare interviews, books, etc) sitting in someone's hard drives, never to see the light of day online.

I used to find this annoying and disappointing. If I have a 720p copy of a video, could there be someone out there that has a never-before-seen 1080p or 4k copy they never uploaded? However, I've since come to find a sense of solace and mystery in this over the years. I take solace in the fact that the file I'm looking for probably exists out there somewhere; I find mystery in wondering where it is and who has it.

It's intriguing to think that there exists enormous private collections of obscure niche media out there somewhere, which are simply not connected to the public web. Data that exists, but cannot be searched, collated, and archived by others. For example, people's personal hard drives or cloud storage.

A notable example: Just two years ago someone uploaded a never-before-seen video of the Techno Viking taken on the same day as the original viral video. They were just sitting on that VHS tape for 20 years.

This is an automated archive.

The original was posted on /r/datahoarder by /u/kram96 on 2023-08-15 00:45:20+00:00.

I'd like to consolidate all of my storage and update a bit. I have a mix of raids and external drives that are a mess (and outdated) at this point. I have 80TB now and want to expand to 140TB or more.

I currently have 3 Synology RAIDS (1511+,1515+,1515+), 2 G-Speed - WB(4 bay), misc JBOD drives connected to a Mac Mini over TB & USB3. The drives range from 2TB up to 14TB.

What VALUE options do I have to store 140TB or more? I can host all over a modern Mac mini which may save me in cost. I also have an ESXi (super micro - i3)box but not sure what that will get me. I'd like to get 100MB/sec (aka 1GB). Thanks!

This is an automated archive.

The original was posted on /r/datahoarder by /u/vinhdizzo on 2023-08-14 23:49:00+00:00.

Hi,

My current practice is to backup my photos/videos on Google Drive. However, I just hit my 2TB threshold and will now have to pay $250 for 5TB/year (used to be $100 for 2TB/year). Planning to use rclone and Amazon Glacier Deep Archive to keep costs down. For the record, I also have these files on my local NAS for ready-access.

Was curious on any recommendations this community might have with using rclone and this storage option. For example, I read that I should do "rclone copy" as opposed to "rsync sync" to reduce metadata access calls (as it requires a comparison of files?. Anything else? How much more in cost is sync vs copy? I don't intend to delete or move files often, but I could see that happening. My preference is to do sync or something similar to capture the changes, but not if it costs a whole lot.

Thanks in advance for your help.

This is an automated archive.

The original was posted on /r/datahoarder by /u/SimplifyAndAddCoffee on 2023-08-14 23:30:57+00:00.

With google announcing crackdowns on ad-blocking etc I really feel like the days of free access to youtube are numbered, and I want to archive/save what I can, and I'd like to be able to browse some of those channels/shows like TV shows alongside my other media in jellyfin etc. Is there a good way of fetching sorting and storing metadata etc in a format condusive to this?

This is an automated archive.

The original was posted on /r/datahoarder by /u/wsg49 on 2023-08-14 21:11:02+00:00.

Dumb question of the day. I see I can get 2TB m.2 SSDs for about $65. I was wondering if anyone makes an m.2 bank or plugin module?. Seems like you can get 10TB of very fast quiet storage for around $350. I would like that for my HTPC.

This is an automated archive.

The original was posted on /r/datahoarder by /u/Pale-Medium-7455 on 2023-08-14 20:44:43+00:00.

Hi,

I've almost lost all my files (I think) and now I don't want to risk again..

I'm a graphic designer and I started 5 years ago, over this time I did accumulate more or less 1TB of files, that I want to keep safe. recently I had some corrupted issue with windows and there was a possibility of losing my files, I had no idea how to proceed so I bringed to a repair shop, that luckily saved everything. I asked them to keep the hard disk with ''old files'' and install me and copy a new one (keep as a backup).

But I want to do something different, I need something that is easy to use, that I can turn on and off daily (sometimes we have electrical problems and happens quite often that the electricity come and go, I will buy a power continuity but still I want to be able to turn on and off easily).

I don't need something massive, 2tb is more than enough and doesn't need to be cloud based, I don't mind cable or attaching usb or whatever.

I don't really need a nas, and all das that I'm seeing look difficult to set up or not really something easy to turn on and off.

Looks like a external storage (hard disk-ssd) could be a good fit but is it something that I can trust?

I'm also not really sure about uploading everything on the cloud, even tho seems quite tempting.

This is an automated archive.

The original was posted on /r/datahoarder by /u/NoEcho3 on 2023-08-14 17:43:15+00:00.

Hello, I'm planning on scanning family pictures from 5 decades. My family had very little interest in archiving so there are no dates or places written on the pictures. I'm planning to show my parents the pictures and try to archive as many info as possible.

I know that i can use AI like the one available on google photos to search the pictures by face or object on it. But do you know of any way i can regroup pictures from the same event using AI ? I know that the pictures are not necessarily in oder and some pictures from the same event might be scattered around. I would like to mass scan everything and use software to help me make albums by event.

This is an automated archive.

The original was posted on /r/datahoarder by /u/socookre on 2023-08-15 02:04:54+00:00.

We can't just keep our heads down every time something we hold dear is threatened. Instead why not organise a global level activism worldwide in support of Internet Archive not unlike the anti-PIPA movement?

Internet blackouts, street protest, boycotts, lobbying and graffitis are the major ways. Names to choose include ProtectHistories, SafeguardHistories and PreserveNotDestroy. It is even better if we can consolidate scattered movements such as the protests against the API price hikes into this one.

This is an automated archive.

The original was posted on /r/datahoarder by /u/socookre on 2023-08-15 01:57:22+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/Rabbi69 on 2023-08-15 00:12:18+00:00.

Hey All,

The company I work for currently has an HPE LTO-8 Ultrium 30750 SAS External Tape Drive. We want to begin using it to read and write backups. However, when we contacted HPE to get access to the drivers needed to get the drive working, we were given a $1400 quote to renew our access.

Is there a cheaper way we can get our Tape Drive working? (i.e Open source software) or is there another Tape Drive maker we could go to for a cheaper tape drive?

This is an automated archive.

The original was posted on /r/datahoarder by /u/koempleh on 2023-08-14 23:05:04+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/148637415963 on 2023-08-14 22:48:56+00:00.

Hi guys.

I've got a couple of old rewriteable DVDs that I'm trying to copy files from, but ordinary copy and paste gets hung up on corrupted files. "Time remaining: Calculating..." forever.

Is there a program that will copy off only the okay files without getting frozen by the rest?

Thanks.

This is an automated archive.

The original was posted on /r/datahoarder by /u/pepethefrogs on 2023-08-14 22:46:39+00:00.

I'm looking for a YouTube archiving site that was made by a user here, all I remember is the interface was simple I believe black background and it had one bar where you're supposed to type the video id you're searching for.

This is an automated archive.

The original was posted on /r/datahoarder by /u/Leaksahoy on 2023-08-14 22:45:32+00:00.

I'm very new to this concept, but with all the raised pricing on multiple streaming services I can't take it much more. I want to have as big of a Nas/server as possible that would run Jellyfin and would have full redundancy. I'd like to have at least 200TB in normal storage, but I'm not even sure this project is doable. Is what I'm asking for realistic and is it scalable?

This is an automated archive.

The original was posted on /r/datahoarder by /u/Shadow362 on 2023-08-14 22:27:00+00:00.

With the hardware currently at my disposal, what is the most efficient and cost effective way to upgrade.

My current pc was built in 2018 and is starting to show its age. Ideally, I would like to build a new gaming pc and keep/repurpose my current pc as a full-time server pc. Doubling my current storage also seems like the next logical step but isn't 100% needed at this point. I don't have a strict budget in mind but would like to keep the storage and pc upgrades around the $2,000 mark.

My current pc specs:

Phanteks P400s

Ryzen 7 1700x

32gb DDR4 @ 3200mhz

GTX 1070ti

EVGA 750w

500gb sata ssd boot drive, 1tb WD blue, 2tb WD Green, 8tb WD Green. The 1 and 2 tb drives should be retired soon and currently only store steam games.

I am also running a 4-bay Synology DS920+ with 42tb usable storage (4x16tb) in raid 5. There is currently 12tb of free space remaining.

I run a plex server off of my pc. I had contemplated running it off of my nas but would prefer to keep running on a pc with better specs than the nas for the purpose of hardware transcoding.

I have three used 8tb drives and two lightly used 12tb drives. One of the 8tb drives has a partial backup of my plex server. I lack a proper backup. Other than that one 8tb drive, the other drives are completely unused.

I am open to any suggestions as to how to upgrade or what I should be upgrading first. And yes I know I need a proper backup. That should probably be the first thing I address.

This is an automated archive.

The original was posted on /r/datahoarder by /u/Quafley on 2023-08-14 21:30:39+00:00.

Hello everyone! :D

You may know me from my last post I made: old post

Well, I figured making a new post would be best as these changes to the script are pretty major, and the old script is basically completely replaced. You can find the script over on Github, make sure to install the packages which can be found in the requirements (httpx being the new one introduced)

With my script it will allow you to download your whole library of Gfycats within minutes. The updated script introduces the following features for you to use:

1. The script is now asynchronous. The speed has improved at least by 10x.

2. The script will now query the following subdomains. Giant.gfycat.com > fat.gfycat.com > zip.gfycat.com, based on the response.

Before, the script would only download from Giant. The reason this is important is because only the larger sized gfycats are uploaded to this subdomain! So, we are essentially missing a fair amount of downloads.

I hope you enjoy this final version of the script and I hope you can savor your memories with it!

Have a fantastic day!