+ Post New Thread
Page 1 of 2 12 LastLast
Results 1 to 15 of 16
Thin Client and Virtual Machines Thread, Moving VM's from datastores in Technical; Scenario: One ESXi host with 2 raid cards (identical) and a raid array on each. One is the new one, ...
  1. #1

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524

    Moving VM's from datastores

    Scenario:

    One ESXi host with 2 raid cards (identical) and a raid array on each.

    One is the new one, one is the old one. It hosts a single guest which I need to move from one to the other.

    Copying one of the virtual disks over (which is 1.2TB) is HORRENDOUSLY slow. As in, it's currently got 50 hours remaining.
    These aren't particularly slow drives, RAID10 arrays on both.
    That's just a standard copy operation from within the GUI. I don't particularly want to risk using vmkfstools in SSH to do it with the reports of it timing out for large files for so many people, plus I don't trust the thick/thin provisioning properties of it.

    Is there a quicker way to do it? Starting to think restoring from backup would be far faster!

  2. #2
    DMcCoy's Avatar
    Join Date
    Oct 2005
    Location
    Isle of Wight
    Posts
    3,505
    Thank Post
    10
    Thanked 508 Times in 445 Posts
    Rep Power
    116
    Beyond VAAI, vCenter and shared storage? Not really. You may indeed find a windows server backup of a large data drive and restore is quicker, if you can find fast and large storage in the middle.

  3. #3

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    That's something we don't have. Just ESXi and vSphere.

    3157 minutes remaining Floppy disks weren't this slow.

  4. #4

    glennda's Avatar
    Join Date
    Jun 2009
    Location
    Sussex
    Posts
    7,821
    Thank Post
    272
    Thanked 1,140 Times in 1,036 Posts
    Rep Power
    351
    Is it on shared storage?

  5. #5

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    As the original post, it's dedicated, local storage and neither are loaded/doing anything.

    Actually going up in time and has been fairly steadily. 4347 minutes remaining now. I wouldn't mind, but we rather need this working by tomorrow night, and I have another 800GB to copy over to it >:|
    Last edited by synaesthesia; 8th April 2014 at 07:42 PM.

  6. #6
    Marshall_IT's Avatar
    Join Date
    Jul 2011
    Location
    Leeds
    Posts
    669
    Thank Post
    84
    Thanked 95 Times in 76 Posts
    Blog Entries
    1
    Rep Power
    24
    My experience with esxi and local storage is always slow. I just don't think they designed it to work that way. Not much help to you right now but you certainly have my sympathy!

  7. #7


    Join Date
    Feb 2007
    Location
    Northamptonshire
    Posts
    4,706
    Thank Post
    354
    Thanked 807 Times in 722 Posts
    Rep Power
    348
    Use Veeam quick migrate (free version can do it too), tends to work out a lot quicker than a full fat copy and it'll work live most of the time except the suspend + boot up at the end.

  8. #8

    glennda's Avatar
    Join Date
    Jun 2009
    Location
    Sussex
    Posts
    7,821
    Thank Post
    272
    Thanked 1,140 Times in 1,036 Posts
    Rep Power
    351
    Quote Originally Posted by synaesthesia View Post
    As the original post, it's dedicated, local storage and neither are loaded/doing anything.

    Actually going up in time and has been fairly steadily. 4347 minutes remaining now. I wouldn't mind, but we rather need this working by tomorrow night, and I have another 800GB to copy over to it >:|
    Sorry i misread it!

  9. #9

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    No worries @glennda. Cheers, @kmount - will that work when the VM is staying on the same host, just a different datastore? I imagine it's a similar process to using vcenter converter (which is my next line of enquiry!)

    Something isn't right regardless - it managed to fail and in doing so lost the VMDK descriptor file. I excreted a brick thinking it'd corrupted the whole virtual disk, thankfully found a guide on recreating that file and the server is back up and running. I'm not convinced the new datastore is working right. It's pretty much identical to the old one, the drives are identical spec just twice the size, same RAID controller, same array type yet it's diabolically slow. Copying a 1GB ISO file to the old datastore takes 10 seconds. 3 minutes to the new one!
    Last edited by synaesthesia; 8th April 2014 at 08:37 PM.

  10. #10


    Join Date
    Feb 2007
    Location
    Northamptonshire
    Posts
    4,706
    Thank Post
    354
    Thanked 807 Times in 722 Posts
    Rep Power
    348
    Yes, it will work fine on the same host, just two different datastores. (did this last night to move a vCenter VM which was offline as I did not have storage vmotion to move it online).

    I would not use the converter because it will re-mac etc. (though you could override it).

    Using the quick migrate will allow you to continue running 'live' whilst it does its thing then it'll snapshot + copy differences at the end.

    - - - Updated - - -

    Block in VMware the same?
    Block/strip size on the HBA the same?

  11. #11

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    I'm going to check those when I'm on site in the morning. I've just run ESXTop out of interest...

    Copying a 7GB ISO to the old datastore (which is prefixed naa.GUID for some reason) DQLEN 254 CMDS/S 1508.95 WRITES/s 1335.49 MBWRTN/s 217.62

    Copying to the new one, the DS i'm trying to copy the above VM to... DQLEN 254 CMDS/s 119.90 WRITES/s 109.05 MBWRTN/s 21.88. That has a T10.guid prefix on that. I'm not sure on the relevance of those.

    I suspect there's an issue there.

    Both are VMFS5, block size in VMWare 1MB on both. I'll power off tomorrow morning and check the raid controller itself. That's quite a serious difference in performance. 4 x WD RE 2TB in RAID10. (The old datastore is 4 x WD RE 1TB in RAID10)
    Last edited by synaesthesia; 8th April 2014 at 09:10 PM.

  12. #12

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    Sigh. Everything's identical. The only difference was firmware (the "new" raid controller had an older firmware). Upgraded that and it's made no difference at all. 14MB/s according to esxtop. Really not good.

  13. #13
    AButters's Avatar
    Join Date
    Feb 2012
    Location
    Wales
    Posts
    562
    Thank Post
    187
    Thanked 126 Times in 97 Posts
    Rep Power
    46
    What is your status of the write cache on both arrays? I am suspecting the second (new) array does not have write cache enabled wheras maybe the first one does?

    Give us more hardware specs too?

  14. #14

    tmcd35's Avatar
    Join Date
    Jul 2005
    Location
    Norfolk
    Posts
    6,069
    Thank Post
    902
    Thanked 1,013 Times in 825 Posts
    Blog Entries
    9
    Rep Power
    350
    I can only offer two thoughts, possibilities - Is the writeback cache settings the same on both controllers? Do they have the same amount of cache ram?

    Also, could it be a PCI bandwidth problem? What happens if you swap the cards over? or move the new one to another slot?

  15. #15

    synaesthesia's Avatar
    Join Date
    Jan 2009
    Location
    Northamptonshire
    Posts
    6,511
    Thank Post
    627
    Thanked 1,173 Times in 900 Posts
    Blog Entries
    15
    Rep Power
    524
    All settings identical.
    System is Intel 5500 motherboard with twin quad core xeon e5520, 20GB RAM.
    Controller (new) is a 9650SE-12ML., 256MB cache (same on both, other was a 9650SE-4ML. New one is higher spec)

    I've just put the old array on the new controller to see what performance that gets.#

    ****

    Controller isn't right. Swapped controllers, drives fine.
    Last edited by synaesthesia; 9th April 2014 at 10:47 AM.



SHARE:
+ Post New Thread
Page 1 of 2 12 LastLast

Similar Threads

  1. XenServer (free version) - moving vms from a downed host server cleanly?
    By pete in forum Thin Client and Virtual Machines
    Replies: 1
    Last Post: 15th January 2010, 09:42 PM
  2. Moving to Googlemail from Exchange 2007
    By cjohnsonuk in forum Internet Related/Filtering/Firewall
    Replies: 20
    Last Post: 11th June 2009, 10:23 PM
  3. Looking to move to Europe from US
    By goaliepride in forum General Chat
    Replies: 13
    Last Post: 31st July 2008, 10:29 AM
  4. Replies: 2
    Last Post: 8th March 2008, 03:18 PM
  5. Replies: 0
    Last Post: 30th August 2007, 12:19 PM

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •