this post was submitted on 17 Dec 2024
38 points (97.5% liked)

Selfhosted

40645 readers
190 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

I was thinking on buying a 2-4 bay HDD powered enclosure as a NAS for my mini pc, since I already have that, and buying or building a full-fledged diy NAS seems a bit expensive.

I want to hear some opinions from you guys, since it seems using this method is a mixed area from the selfhosted pros. I would be hoping that by using a powered enclosure, that would alleviate or solve the USB port overcharging issue, which have appeared in my mini pc when trying out an external HDD with a normal sata to usb converter.

Did you have any experiences with a setup like this one?

top 50 comments
sorted by: hot top controversial new old
[–] ftbd@feddit.org 1 points 4 hours ago

There are small SATA backplanes that allow you to fit 3 HDDs into two 5.25" slots (or 4 HDDs in 3 slots). You can find used ones for cheap (mine was 30€), and with some cheap tower case you could get something NAS-like with hot-swap drive bays for way cheaper

[–] elucubra@sopuli.xyz 3 points 18 hours ago (1 children)

I would either get a used HP Proliant microserver Gen 8 (I own one. Pretty sweet) or get a mini ITX nas case, 4 or more bays. Depending on USB doesn't seem like a good idea to me. You can always sell your mini PC. I have slowly learned to avoid the sunk cost fallacy.

[–] Entropywins@lemmy.world 2 points 14 hours ago

Those microservers are dope!

[–] bmcgonag@lemmy.world 2 points 17 hours ago

I use a couple of mini pcs in exactly the setup you are talking about. Only downside is throughput. Anything built in is gonna be faster for read write ops, but usb3 is plenty fast for most things including media and data sync. I run Ubuntu with ZFS, and created raid arrays for data redundancy. It works really well. I virtualize using Incus with docker inside of those tiny VMs. It’s awesome.

[–] 2xsaiko@discuss.tchncs.de 6 points 1 day ago (1 children)

I have the QNAP TL-D800S. It’s an 8 bay DAS but there is also a 4 bay variant. Works well for me. It uses SFF cables to connect to the PC and comes with the appropriate PCIe card which seems more robust to me than anything USB for this.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago (2 children)

Yeah this option seems like a more robust option than using an USB one. Unfortunately my mini PC doesn't offer a sata connection, but thank you for the suggestion!

[–] Elkenders@feddit.uk 2 points 1 day ago

I use the usb version of the qnap 4 bay and never had an issue. Into a nuc holding all media. Boot and docker config all on the nuc nvme.

[–] 2xsaiko@discuss.tchncs.de 3 points 1 day ago

It would need a PCIe slot, not a SATA connection. But I assume it doesn’t have that either then.

[–] zod000@lemmy.ml 3 points 1 day ago* (last edited 1 day ago)

I have used mini PCs as a servers for years with file serving being a major duty of them. Granted my storage needs aren't excessive, but most NUCs or Nuc-likes can hold two drives, some can have a third if you include 2.5" drives. My AsRock A300 can hold 4 drives (two of each), but its m.2 support sucks so that's not as much of a boon as it sounds. If you need significant storage, there is no replacement for something that can hold 3.5" drives though since those can now reach 20+ GB a drive.

[–] schizo@forum.uncomfortable.business 18 points 1 day ago (5 children)

It's viable, but when you're buying a DAS for the drives, figure out what the USB chipset is and make sure it's not a flaky piece of crap.

Things have gotten better, but some random manufacturers are still using trash bridge chips and you'll be in for a bad time. (By which I mean your drives will vanish in the middle of a write, and corrupt themselves.)

[–] frazorth@feddit.uk 5 points 1 day ago

I've had "trash controllers" in Orico units which rewite the drive details which makes them annoying to work with but I've never heard of

your drives will vanish in the middle of a write, and corrupt themselves

That sounds likes its underpowered and when the draw is up the supply can't handle it, which could happen for internal drives if your supply isn't up to powering enough drives.

Use a reputable brand like TerraMaster and you'll not have those sorts of problems.

load more comments (4 replies)
[–] 3aqn5k6ryk@lemmy.world 2 points 1 day ago* (last edited 1 day ago)

I used intel nuc j5005 for 4 years iirc with 2 bay hdd enclosure, Orico brand. Never had any problem that i hear about such as random diaconnecting. Granted i used it to host my media. So i dont pratically mind if the data is gone.

I used openmediavault with usb boot drive. Internal 2.5’ drive as docker appdata. All my media files is stored on the external enclosure. The only problem i noticed is the temperature but thats because of high ambient temp.

If youre planning to use ext enclosure for critical data. Might wanna think twice. But, if you have proper backup plan. Sure why not.

[–] frazorth@feddit.uk 5 points 1 day ago (4 children)

If you use a reputable brand, such as TerraMaster you'll avoid all of the scare stories you hear.

Almost everything bad seems to be along the lines of

I bought "off brand" XzzYyG from Amazon/EBay/Wish and it failed

Something like this:

https://www.terra-master.com/uk/products/homesoho-das/d6-320.html

It'll be faster than your spinning rust anyway, as long as you have high speed ports on your mini PC.

[–] nis@feddit.dk 1 points 1 day ago (2 children)

I was very intrigued until they wanted my email before showing me the "Quick Installation Guide".

[–] frazorth@feddit.uk 6 points 1 day ago (1 children)

Err, you mean the piece of paper that came in the box, or is available to download on their website as a link without having to register?

https://www.terra-master.com/us/d6-320.html?page=menu&mid=1336

[–] nis@feddit.dk 3 points 1 day ago* (last edited 1 day ago) (1 children)

I followed the support link in their menu, clicked on quick guide and got this page: https://support.terra-master.com/quickguide/

Are you not presented with a form forcing you to enter an email?

[–] frazorth@feddit.uk 3 points 1 day ago (1 children)

That's weird that there are several ways to get access to the Quick Guides, and some seem to want an email.

However it doesn't use it and takes junk (I just used a@b.com which was accepted), but sad that the form you found needed it.

But to answer your question, no I missed that link and went to "downloads" which also has the guide but doesn't appear to require any email.

[–] nis@feddit.dk 3 points 1 day ago

Great, was starting to wonder if I was being singled out and they just wanted my email 😀

I still don't understand why they have that form at all.

[–] ancoraunamoka@lemmy.dbzer0.com 3 points 1 day ago* (last edited 1 day ago) (1 children)

No such thing in their website from europe

[–] frazorth@feddit.uk 3 points 1 day ago* (last edited 1 day ago) (1 children)

I just did a websearch and first result was a download link on their US website too which didn't require registration.

There seems to be a lot of nonsense on here.

[–] ancoraunamoka@lemmy.dbzer0.com 2 points 19 hours ago

I don't know but usually uk websites are the worsts of the bunch

load more comments (3 replies)
[–] CmdrShepard42@lemm.ee 6 points 1 day ago (2 children)

I built my own and it honestly wasn't that expensive (at the time back in 2018). I just started with the basics but built it to be expandable. I used a Define 6 case which gave me room for 12 HDDs, a mobo with the highest number of SATA ports, processor, RAM, etc and then just added drives 1-2 at a time as they filled up. My only regret is that I didn't and still haven't learned Linux well enough to rely on it because it runs Windows, the PC is showing its age now, and I need to think about the replacement solution and how I'll be able to migrate 70+ TB of media and all my configurations to the new machine.

If you do run Windows, Drivepool and SnapRAID are useful for pooling everything into a single virtual disk and setting up a software RAID that will protect from drive failures without locking your data away.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago (1 children)

And what kinda mobo have you went with? A microATX perhaps?

[–] CmdrShepard42@lemm.ee 2 points 21 hours ago* (last edited 21 hours ago)

It's a midtower case so I just went with an ATX board. I would like to figure out a compact solution for the future but it's hard to house and control a bunch of HDDs in a small footprint. I don't want to spend thousands on a NAS and I haven't found a trustworthy DAS solution that will hold all my drives.

You might play around with PCPartPicker since it allows for so many filtering options for things like SATA ports on a mobo or drive slots in a case and see what you can come up with.

[–] sem@lemmy.blahaj.zone 5 points 1 day ago

You can also use snapraid (and mergefs) on Linux to do the same thing! I'm excited to recognize this because I recently turned an old PC into a crappy nas with Open Media Vault and used these two.

[–] DolphinMath@slrpnk.net 5 points 1 day ago* (last edited 1 day ago) (1 children)

I’ve personally gone with an N100 Mini PC running Proxmox and two of these daisy-chained (purchased on sale). https://www.amazon.com/MAIWO-Enclosure-Cooling-Storage-Expansion/dp/B0D28Q187R/

The MAIWO DAS uses garbage JMicron firmware by default, and there are significant issues with their sleep functions. Because of that, it took me forever to figure out why SnapRAID kept failing mid-sync. Fortunately, new firmware seems to have fixed their issues and they’ve been rock solid ever since. I specifically had to update the firmware for all 4 of the USB controllers on each DAS.

Direct link to firmware that worked for me. https://gbatemp.net/attachments/bin-16028_jms578_std_v00-04-01-04_self_power_odd_20190611-zip.230929/

JMS578_STD_v00.04.01.04_Self Power + ODD.bin

MD5: 7701fb7a968e3ad4ca926dd7854806ff

Firmware updater tool for Windows found here. I ran this from a Virtualbox Windows 10 VM inside my Arch install: https://gbatemp.net/attachments/jmicron-jms578-sata-crystal-enclosure-fwupdate-zip.216335/

FwUpdateTool_v1_19_16_24.exe

MD5: 735ec8d9f99c457ce793739480c55706

Mirrors for posterity:

https://files.catbox.moe/e4121s.zip

https://mega.nz/file/OJAX2KhQ#67kIDJun92nqi56mFur_9vALSi2yTJXXv7ew5pYSJVY

Blog post detailing firmware update procedure for an external drive: https://ralimtek.com/posts/2021/jms578/

Detailed post on JMS578: https://gbatemp.net/threads/how-to-update-firmware-of-jmicron-jms578-usb3-0-sata-enclosure-black-screen-lock-music-stop.569158/

Alternate FOSS software for flashing I found later, but never used. https://github.com/BertoldVdb/jms578flash

[–] PrivateNoob@sopuli.xyz 3 points 1 day ago

Wow thank you for these links, you're insane. And if you would start this homelab process again, then would you go with this mini PC + DAS layout again, or with desktop pc as a NAS?

[–] fprawn@lemmy.world 4 points 1 day ago (1 children)

I had a setup similar to this for a year or two that ended with an hdd destroying itself one night. Probably because of the drive and not the usb enclosure I was using. Until then it worked fine, it’s definitely a viable route.

If you can swing a desktop pc case it’ll probably end up easier and cheaper and have some headroom for upgrades, that’s the route I went down after trying an escalating series of mini-pcs and running into their limits one too many times.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago* (last edited 1 day ago)

Sounds like a good idea, since according to the comments it seems I really shouldn't be using DAS as a primary storage (not with USB specifically).

I am currently getting a replacement for my old win10+drivepool setup using hand me down parts from my old main pc. I decided to go with UNRAID this time and other than a few headaches, its been pretty simple to get going. I am already a big fan of the container/docker/app setup. My setup is 3 12tb seagate iron wolf nas drives recertified/refurbished from ebay, the nvme ssd I used as my prior boot drive as a cache drive, and a r7 1700 and ab350m pro 4 mobo with a pny xlr8 1070gpu. It was mostly free since I was replacing it with a newer gaming build. I think I spent $280 on the hdds?

[–] entropicdrift@lemmy.sdf.org 4 points 1 day ago (1 children)

I use an M1 Mac Mini running Asahi Linux with a USB 3.0 4-bay enclosure. Works great so far.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago (1 children)

And what's your experience with it? Is the data transfer speed fast enough for you? Where do you do backups?

[–] entropicdrift@lemmy.sdf.org 2 points 1 day ago* (last edited 1 day ago)

I don't have backups, but I do have a 14TB parity drive in the DAS, using SnapRAID to update it nightly.

The transfer speed of the USB connection is higher than my ethernet speed, so it never bottlenecks me.

[–] vk6flab@lemmy.radio 4 points 1 day ago

Consider the machine being on 24/7 and cooling.

Furthermore, depending on the current power supply, you might need to upgrade it to keep everything running.

[–] badlotus@discuss.online 2 points 1 day ago (2 children)

You may not be able to do RAID or other redundant/performant arrays with USB. You can definitely achieve a big JBOD array but it will be less resilient and slower than a RAID array. Enclosures often don’t cool as well so heat may degrade your disks faster as well. I did this for a while with some old disks and some $30 HDD toasters. I only put data on there I could afford to lose. I wish there was a standalone hardware RAID solution… like a NAS without the network. That would have a huge draw for hobbyists that don’t want to buy an expensive NAS. I’ve searched for this but haven’t found anything. Message me if you know of such a product! Maybe consider building your own NAS with an old PC. Way cheaper than a prebuilt and fun to build! I had an old Dell Optiplex 990 that is now a 32 TB NAS. Had to get a new case but it’s a decent backup to my Synology.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago

Yeah a DIY NAS PC sounds like a fun choice, it's just too bad that this mini PC was a waste of cash if talking about storage. I do have an old PC, but it's a 3770K which is mighty beast for sure, but definitely a more power hungry device.

[–] frazorth@feddit.uk 3 points 1 day ago

This is completely untrue.

You can get plently of performant arrays over USB. You do know how much USB 3.1 or 4 can transmit?

Enclosures often don’t cool as well so heat may degrade your disks faster as well.

DAS enclosures can do a great job of cooling by separating and not sharing the air inside a single case.

[–] fmstrat@lemmy.nowsci.com 3 points 1 day ago (6 children)

Yes, and you might want to ask in the datahoarders community.

While I dont use a mini-pc, I have a server with 48TB in it on spinning disks, and I've built a hybrid DAS/NAS that I back up to.

I use this 4-bay DAS: https://www.amazon.com/gp/aw/d/B078YQHWYW I chose it because it supports USB 3.2 Gen 2 and I've been pretty happy with it.

It's usually plugged into my server directly, and I use ZFS to snapshot and send to it. However, I also can plug it into a Pi5 and use ZFS send over SSH to treat it like a NAS. The Pi can of course run Samba/CIFS and SSH for sshfs.

The biggest downside to this structure is probably the metadata speeds for ZFS over USB (looking up snapshot names), but you could always use a cache drive with ZFS.

I highly, highly recommend ZFS and figuring out your software requirements before picking hardware.

Happy to answer any specific questions, too.

[–] PrivateNoob@sopuli.xyz 2 points 1 day ago (1 children)

Have you had data loss occurences in these bay enclosures? Some other commenters have said, that using it as a primary storage is really risky because some crappy controllers could ruin the drives's data for example.

[–] fmstrat@lemmy.nowsci.com 2 points 1 day ago

I have not, but I also run it as a RAIDZ, so if I did have issues with one, the parity should cover it. That being said it is a backup for me.

load more comments (5 replies)
[–] TCB13@lemmy.world 3 points 1 day ago

Get a USB-C DAS (enclosure) for your disks, those use their own power supply. Since it is USB-C performance will be very good and stable and you'll be happy with it.

load more comments
view more: next ›