+ Post New Thread
Page 1 of 2 12 LastLast
Results 1 to 15 of 18
Hardware Thread, Best way to store 20TB of Data? in Technical; Hello EduGeeks, One of my clients needs to be able to store about 20TB of data, he's currently got a ...
  1. #1

    Join Date
    May 2011
    Location
    United Kingdom
    Posts
    56
    Thank Post
    0
    Thanked 0 Times in 0 Posts
    Rep Power
    0

    Red face Best way to store 20TB of Data?

    Hello EduGeeks,

    One of my clients needs to be able to store about 20TB of data, he's currently got a cupboard load of external hard drives hence the reason I want to move them all onto one server and have it network accessible, what would be the best solution to achieve this?

    Should I use RAID5? with 2TB Disks x 11?

  2. #2
    Cools's Avatar
    Join Date
    Jan 2009
    Location
    Bedfordshire
    Posts
    498
    Thank Post
    24
    Thanked 62 Times in 57 Posts
    Rep Power
    25
    yep sounds good to me..

  3. #3
    ricki's Avatar
    Join Date
    Jul 2005
    Location
    uk
    Posts
    1,475
    Thank Post
    20
    Thanked 164 Times in 157 Posts
    Rep Power
    52
    Buy a couple of tera station pros one as his storage place and the other as a backup of the first.

    Richard

  4. #4

    plexer's Avatar
    Join Date
    Dec 2005
    Location
    Norfolk
    Posts
    13,341
    Thank Post
    624
    Thanked 1,584 Times in 1,421 Posts
    Rep Power
    414
    Is it pure archival of data storage or in use production data storage?

    Ben

  5. #5

    plexer's Avatar
    Join Date
    Dec 2005
    Location
    Norfolk
    Posts
    13,341
    Thank Post
    624
    Thanked 1,584 Times in 1,421 Posts
    Rep Power
    414
    Quote Originally Posted by ricki View Post
    Buy a couple of tera station pros one as his storage place and the other as a backup of the first.

    Richard
    Why suggest something that doesn't provide enough storage capacity? he asked for 20TB buffalo tera stations do a maximum of 8TB.

    Ben

  6. #6

    mac_shinobi's Avatar
    Join Date
    Aug 2005
    Posts
    9,708
    Thank Post
    3,244
    Thanked 1,048 Times in 970 Posts
    Rep Power
    364
    Quote Originally Posted by BackCat3 View Post
    Should I use RAID5? with 2TB Disks x 11?
    12 Disks with 2 spare disks - making a total of 14 disks, that way if 1 or 2 die then you can easily pop another one or two in.

  7. #7
    Duke's Avatar
    Join Date
    May 2009
    Posts
    1,017
    Thank Post
    300
    Thanked 174 Times in 160 Posts
    Rep Power
    57
    Quote Originally Posted by BackCat3 View Post
    Hello EduGeeks,

    One of my clients needs to be able to store about 20TB of data, he's currently got a cupboard load of external hard drives hence the reason I want to move them all onto one server and have it network accessible, what would be the best solution to achieve this?

    Should I use RAID5? with 2TB Disks x 11?
    20TB's a lot of data, what type of server are you planning on using this with? Personally I wouldn't fancy a 20TB Windows server...

    When you say network accessible, does just one server need to access it (you could use iSCSI - SAN) or do client PCs need to talk directly to it (CIFS for Windows, NFS for Linux - NAS)? If the latter I'd suggest a decent NAS box from any of the usual names (Dell, HP, NetApp, Oracle), but find one that doesn't charge you extra for the protocol licences.

    Will you ever need to expand beyond 20TB? If so find a solution that'll take extra disk trays - you don't want to have to replace the whole box and restore data to a new one when they fill it.

    Personally I'd want RAID 6 with two hotspares for that much data. By the time you've taken RAID 6, spare disks and formatting into equation you generally end up with about two-thirds of your space being usable. So, if you need 20TB usable I'd say 15 2TB disks.

    Just my 2 pence.

    Chris

  8. #8

    dhicks's Avatar
    Join Date
    Aug 2005
    Location
    Knightsbridge
    Posts
    5,621
    Thank Post
    1,239
    Thanked 777 Times in 674 Posts
    Rep Power
    235
    Quote Originally Posted by BackCat3 View Post
    One of my clients needs to be able to store about 20TB of data
    Bear in mind that a disk manufactuer's definition of "2TB" might differ from the capacity you actually see - by the time you've got a dozen disks in a RAID5 array and accounted for space lost in formating and differences in the definition of "gigabyte", you might need a few more disks to actually get you up to 20TB. Either buy a bigger array or maybe look at 3TB disks.

  9. #9

    glennda's Avatar
    Join Date
    Jun 2009
    Location
    Sussex
    Posts
    7,799
    Thank Post
    272
    Thanked 1,134 Times in 1,030 Posts
    Rep Power
    349
    How much you got to spend?

    I'm currently looking into building a Server using a Supermicro chassis and then wacking in a load of disks

  10. #10

    Join Date
    May 2011
    Location
    United Kingdom
    Posts
    56
    Thank Post
    0
    Thanked 0 Times in 0 Posts
    Rep Power
    0
    It's mostly digital images of a VERY high megapixel rate, hence the high storage space required, this is mostly for archiving but it will be accessed a few times every week for an image.

  11. #11


    Join Date
    Oct 2006
    Posts
    3,411
    Thank Post
    184
    Thanked 356 Times in 285 Posts
    Rep Power
    148
    imo RAID 6 or RAID 5 + hotspare at the least. 20tbs is a hell of a lot of data to loose!

    I've been looking at a backup server today and given you will need at least 13 * 2tb or 9 * 3tb drives you will be looking at a few grand for the server itself without drives. From what I could see Dell only do 12 and 24 drive powervaults in 3.5inch form factor. Have a price up of whether a 12 bay with 3tb drives will be cheaper than a 24 bay with 2tb. Obviously if you just buy the powervault and stick in the HDs yourself it will be considerably cheaper

  12. #12

    Join Date
    Mar 2007
    Posts
    1,752
    Thank Post
    79
    Thanked 288 Times in 219 Posts
    Rep Power
    70
    Thats a heck of a lot of data, prehaps more than one server would be better?. you could use dfrs to make it appear as one server

  13. #13
    morganw's Avatar
    Join Date
    Apr 2009
    Location
    Cambridge
    Posts
    816
    Thank Post
    46
    Thanked 132 Times in 126 Posts
    Rep Power
    39
    Perhaps more interesting will be the next topic, how to backup 20TB of data?
    Back to the cupboard full of external drives?

    Given that there will barely be any data transfer and it's mainly for archiving it might be cheaper to rent the space in a datacenter and let them take care of the backup as well.

  14. #14

    m25man's Avatar
    Join Date
    Oct 2005
    Location
    Romford, Essex
    Posts
    1,621
    Thank Post
    49
    Thanked 451 Times in 334 Posts
    Rep Power
    137
    Readynas 3200 24TB will do the job, all the file system support you would ever need and as you are storing images the added ability to have DNLA and Apple support will be handy.
    We use then in all sorts of configurations and I have a 12 TB Pro myself, pm me if you want any more details.

    BTW they are Supermicro Chassis.

  15. #15

    SYNACK's Avatar
    Join Date
    Oct 2007
    Posts
    11,060
    Thank Post
    853
    Thanked 2,674 Times in 2,269 Posts
    Blog Entries
    9
    Rep Power
    768
    Plus one to RAID6, with that many large drives you need at least two redundant ones and probably a hotspare. Might even be worth trying to use 3TB drives just to cut down the spindle count a little.

SHARE:
+ Post New Thread
Page 1 of 2 12 LastLast

Similar Threads

  1. [Pics] App Store Can't Help With This One
    By DaveP in forum Jokes/Interweb Things
    Replies: 0
    Last Post: 17th February 2011, 06:59 PM
  2. Programatic data extraction from SIMS.net Data Base
    By NetworkGeezer in forum MIS Systems
    Replies: 108
    Last Post: 16th February 2010, 09:22 PM
  3. Where do you store your profiles?
    By zag in forum Windows
    Replies: 10
    Last Post: 22nd September 2009, 04:22 PM
  4. Best way to store notes
    By danIT in forum General Chat
    Replies: 8
    Last Post: 15th April 2009, 05:26 PM

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •