DalekSec Posted October 12, 2022 Posted October 12, 2022 Hi All, I'm currently in the process of moving 615,000* files from one SharePoint to another. But is taking a long time, about an hour to move 2 folders (of which there are 200+). I've tried using the copy function in the web interface but takes ages, I've tried the OneDrive client syncing, downloading and copying to new one, this is a bit faster but requires more input. Does anyone know of any tools that will speed this up? *Reason i'm moving in case you're wondering: The company syncs 4 SharePoint sites by default, someone decided to stick a ton of gigapans in a default SharePoint people sync, thus everyone has to sync all these files constantly! Moving to it's own dedicated SharePoint so only the people that need them have to sync them!
EssentialRug Posted October 12, 2022 Posted October 12, 2022 Hi All, I'm currently in the process of moving 615,000* files from one SharePoint to another. But is taking a long time, about an hour to move 2 folders (of which there are 200+). I've tried using the copy function in the web interface but takes ages, I've tried the OneDrive client syncing, downloading and copying to new one, this is a bit faster but requires more input. Does anyone know of any tools that will speed this up? *Reason i'm moving in case you're wondering: The company syncs 4 SharePoint sites by default, someone decided to stick a ton of gigapans in a default SharePoint people sync, thus everyone has to sync all these files constantly! Moving to it's own dedicated SharePoint so only the people that need them have to sync them! Have you tried using Mover.io? 1
supportman Posted October 12, 2022 Posted October 12, 2022 I just used the web interface for mine, think it only works with about 5gb per move before crashing or whatever. Took a couple of weeks but we got there 1
DalekSec Posted October 12, 2022 Author Posted October 12, 2022 Have you tried using Mover.io? Will have a look, a lot of tools seem to help to move data up to the cloud but not between the same cloud! I just used the web interface for mine, think it only works with about 5gb per move before crashing or whatever. Took a couple of weeks but we got there Luckily file size isnt an issue, only 32GB worth of files but is a limit of the amount of files you can move...
EssentialRug Posted October 12, 2022 Posted October 12, 2022 Have you tried using Mover.io? We use Mover a lot for migrating data between M365 tenancies so it should fit the bill for you.
DalekSec Posted October 12, 2022 Author Posted October 12, 2022 We use Mover a lot for migrating data between M365 tenancies so it should fit the bill for you. Can't seem to get it to work, it's not moving files between tenancies, files staying on same tenant just another SharePoint site.
EssentialRug Posted October 12, 2022 Posted October 12, 2022 Can't seem to get it to work, it's not moving files between tenancies, files staying on same tenant just another SharePoint site. Ahh just tried and you're right you can't move data in the same tenancy...well that's annoying
Chris_Cook Posted October 12, 2022 Posted October 12, 2022 Would something like rclone work? not sure if it does sharepoint.
psydii Posted October 12, 2022 Posted October 12, 2022 Its been a while since I did similar, but when I did, somehow I ended up with PFE/CE on the phone.... and this is my understanding of how it should work on Sharepoint online. When moving between libraries / site collections, the browser sends instructions back to SharePoint to begin the move, and then 'monitors' the move. The actual process runs server side. Also for jobs of a certain size (which yours undoubtedly is) the process isn't file by file, but actually similar to how the SharePoint Migration tool works, the job creates a blob in azure storage containing a copy of the original file and all their metadata, and then from there copies that data back out to the destination library, and only then removes the original. I've left jobs overnight and they completed fine. If you are finding it isn't working you should open a ticket with support, and with careful persistence they may tweak somethings to allow the move to complete.
IT_JB Posted October 12, 2022 Posted October 12, 2022 Sharepoint migration tool will do it, you can use an Azure storage location instead of local cache to maximise transfer speeds and bypass the throttle (I think) but you will incur some azure cost.
DalekSec Posted October 12, 2022 Author Posted October 12, 2022 Thanks all for suggestions, tried all/most of what you suggested and no luck... will just have to keep moving 2-3 folders at a time. Not looking forward to moving the 100k items folder...
psydii Posted October 12, 2022 Posted October 12, 2022 Have faith.. just set of the move via the standard web interface to the library, leave the window open if you want, and then review it tomorrow.
Accura2k7 Posted October 13, 2022 Posted October 13, 2022 Filezilla Pro, you can FTP to the first Microsoft sharepoint, download to a PC and then upload to the new sharepoint location. I got fed up with the slow speeds and crashing so found this way was far more reliable. 1
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now