Go Back   Hardware Canucks > HARDWARE > Storage

    
Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old March 3, 2011, 12:10 PM
Blu's Avatar
Blu Blu is offline
MVP
 
Join Date: Dec 2010
Location: Grande Prairie, Alberta
Posts: 394

My System Specs

Default Whats best for a massive storage system?

I'm looking to build a file server with about 20 2TB drives, now I was planning on using unraid for this as it seemed stable but then a friend of mine told me about how there are alot of people saying it doesn't keep your data backed up properly and when a drive fails it usually fails to re build it. He suggested I go with ZFS (Raidz) and use raidz2 to make it more redundant and safer then one parity drive. What do you guys all think here?

Also what type of hard drive should I be buying for this? He suggested these and said the WD greens are terrible for massive storage,
Newegg.ca - HITACHI Deskstar 7K3000 HDS723020BLA642 (0f12115) 2TB 7200 RPM 64MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive -Bare Drive
or if I don't mind loosing some speed,
Newegg.ca - HITACHI Deskstar 5K3000 HDS5C3020ALA632 (0F12117) 2TB 32MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive -Bare Drive

What do you guys suggest I do? I'm ready to start saving up for this and buy it all at once (prices should be down a bit more by then right?) and am hoping to spend maybe 2500-3000 into it.

As for a mobo for this, I have a brand new 880GMA gigabyte motherboard I never used cause it had not enough pci slots for my HTPC. The thing here is, I read that raidz uses your ram as a "super cache" to write faster so I would want to have alot of ram he said. Would a 4x4GB (16GB ram) be enough you think?
Reply With Quote
  #2 (permalink)  
Old March 3, 2011, 02:19 PM
spikexp's Avatar
Top Prospect
 
Join Date: Apr 2010
Location: Quebec
Posts: 94

My System Specs

Default

The reason why caviar green are know as being "terrible" for massive storage is 'cause of the head parking (a problem which can be easily bypass with a WD program
Link )

So, caviar green are not that bad for massive storage.

Wow, you talked about raid method that I don't know, I think I might need to go check them out.
Reply With Quote
  #3 (permalink)  
Old March 3, 2011, 02:21 PM
tangrisser's Avatar
Top Prospect
 
Join Date: Jul 2009
Location: Metro Vancouver
Posts: 163
Default

I'm not sure about unRAID but with capacity that you are headed. It's likely to fail while recovering from previous failure. If you only have single redundancy then your whole RAID would fail as there no redundancy for the second point of failed drive. By using ZFZ and RAIDZ2, you will have more redundancy since you will have two drives that can fail at once without killing the RAID. As for RAIDZ2, it is said that more RAM the faster according to a lot of articles I have read.

If you decide the go with software solution, I think it doesn't really matter what hard drive you use. Even the Caviar Green 2TB should work fine. For hard drives, I would highly recommend purchasing them at once and burn-in before you actually put data on it.

Keep in mind that RAID is not back up and is only for sake of having redundancy.
__________________
Check out my SALE page

Last edited by tangrisser; March 3, 2011 at 02:23 PM. Reason: additional information
Reply With Quote
  #4 (permalink)  
Old March 3, 2011, 02:39 PM
Hall Of Fame
 
Join Date: Oct 2007
Posts: 1,588
Default

I think the supercache you're referring to is the L2ARC - completely not necessary unless your array is going to be heavily accessed consistently through a huge pipe. In a write once read occasionally scenario, cache won't be much an issue, over 20 drives the array will most likely be starved over a network. however, ZFS loves alot of ram. I don't think you *need* 16 gigs for a dedicated box, 8 might do (don't quote me on this though.)
Reply With Quote
  #5 (permalink)  
Old March 3, 2011, 08:17 PM
JD's Avatar
JD JD is offline
Moderator
F@H
 
Join Date: Jul 2007
Location: Toronto, ON
Posts: 6,970

My System Specs

Default

There's also the Samsung F4 2TB 5400RPM drives. They would also probably do fine.

As for 16GB of RAM, I'm going to say it'll be pointless unless you have a huge amount of people concurrently accessing this file share and some aggregated network links to it as well. And I'd assume the cache is only used for writes, not reads.

Run-of-the-mill 4GB will probably be plenty, unless you're going to have a bunch of people writing to it heavily.

I assume you'll be getting a 24-port SAS card too?
Reply With Quote
  #6 (permalink)  
Old March 3, 2011, 09:24 PM
Perineum's Avatar
Hall Of Fame
F@H
 
Join Date: Mar 2009
Location: Surrey, B.C.
Posts: 4,049

My System Specs

Default

I think the first thing you need to do is go through all your data and delete the garbage....

My storage array will be done soon but I'm going to start off with 6 or 8TB, and that's storing all my stuff, images of the HD of clients machines I've built and everything else I can think of.... I will expand it as I go, but what what do you need 36+ TB of storage for?
Reply With Quote
  #7 (permalink)  
Old March 3, 2011, 09:36 PM
lowfat's Avatar
Moderator
 
Join Date: Feb 2007
Location: Grande Prairie, AB
Posts: 8,120

My System Specs

Default

Quote:
Originally Posted by Perineum View Post
I think the first thing you need to do is go through all your data and delete the garbage....

My storage array will be done soon but I'm going to start off with 6 or 8TB, and that's storing all my stuff, images of the HD of clients machines I've built and everything else I can think of.... I will expand it as I go, but what what do you need 36+ TB of storage for?
Media + backups can fill a lot of storage up very fast.
__________________
Mael
Big Lian Li
Forever Alone
Reply With Quote
  #8 (permalink)  
Old March 3, 2011, 09:41 PM
Banned
F@H
 
Join Date: Aug 2007
Location: mtl
Posts: 12,694
Default

what kind of data are we looking at?

a gizillion billion trillion little tiny files or large 50-100 gig ones?

id probably back up every drive to its brother manually,well,by way of soft.

no way you wont lose out stuff unless you go mental/very expensive :)
Reply With Quote
  #9 (permalink)  
Old March 3, 2011, 10:52 PM
Banned
 
Join Date: Dec 2010
Posts: 206
Default

Hello... Blu...
If you ask me, I think there's two choices for 'storage' drives:

I would always check newegg since they sell both:
Newegg.ca - HITACHI Deskstar 5K3000 HDS5C3020ALA632 (0F12117) 2TB 32MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive -Bare Drive

Newegg.ca - SAMSUNG Spinpoint F4 HD204UI 2TB 5400 RPM 32MB Cache SATA 3.0Gb/s 3.5" Internal Hard Drive -Bare Drive
Reply With Quote
  #10 (permalink)  
Old March 5, 2011, 11:38 AM
Blu's Avatar
Blu Blu is offline
MVP
 
Join Date: Dec 2010
Location: Grande Prairie, Alberta
Posts: 394

My System Specs

Default

Quote:
Originally Posted by JD View Post
There's also the Samsung F4 2TB 5400RPM drives. They would also probably do fine.

As for 16GB of RAM, I'm going to say it'll be pointless unless you have a huge amount of people concurrently accessing this file share and some aggregated network links to it as well. And I'd assume the cache is only used for writes, not reads.

Run-of-the-mill 4GB will probably be plenty, unless you're going to have a bunch of people writing to it heavily.

I assume you'll be getting a 24-port SAS card too?
I was looking at this card, Newegg.ca - HighPoint RocketRAID 2340 PCI -Express X8 SATA I & SATA II Controller Card but there looks like there might be other ways around it if they don't re stock that one, might end up with two 8 port cards and then using the motherboard sata ports for the rest that I need. The reason I need so much storage is I'm building a massive HD movie/TV collection and it starts to eat up space pretty quick, If you got any links to a good cheap 24 port SAS card mind showing me it :D?
Reply With Quote
Reply


Thread Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
CRIA files massive lawsuit against isohunt... BrainEater Off Topic 9 February 16, 2011 08:57 PM
battlefield 2142 help.. Massive artifacting. EaGle1337 Gaming 0 January 6, 2009 04:36 PM
Massive new Scythe cooler?! Cptn Vortex Press Releases & Tech News 26 March 3, 2008 05:43 PM
Massive Scythe Cooler, among others. Cptn Vortex Rumor Mill 8 November 29, 2007 02:11 PM