Amilia Posted November 18, 2021 Posted November 18, 2021 We need to copy a lot of large files from windows to AWS S3, we tried Azcopy but through our testing, the network got so saturated due to the bandwidth consumed. after doing a full search we found somehow to do it via the Azcopy command but unfortunately, it was ineffective. we are looking for a reliable way to limit the transfer speed while uploading to S3 to give our data center the space to run smoothly day and night.I know Azcopy is a strong tool but it really takes most of the bandwidth. Thank You
andy_b Posted November 18, 2021 Posted November 18, 2021 https://docs.microsoft.com/en-us/azure/storage/common/storage-ref-azcopy-env?toc=/azure/storage/blobs/toc.json --cap-mbps float Caps the transfer rate, in megabits per second. Moment-by-moment throughput might vary slightly from the cap. If this option is set to zero, or it is omitted, the throughput isn't capped. ? 1
Amilia Posted November 20, 2021 Author Posted November 20, 2021 https://docs.microsoft.com/en-us/azure/storage/common/storage-ref-azcopy-env?toc=/azure/storage/blobs/toc.json--cap-mbps float Caps the transfer rate, in megabits per second. Moment-by-moment throughput might vary slightly from the cap. If this option is set to zero, or it is omitted, the throughput isn't capped.? Thanks, andy_b , I checked out "--cap-mbps float" before, unfortunately, this was not effective to what we aimed. So we are checking out now some tools found in the search results that can do these tasks and you can help me if you have any experience with these kinds of tools or similarities, I found Carbonite , Duplicate and Gs Richcopy 360 . Thanks in advance
Amilia Posted November 24, 2021 Author Posted November 24, 2021 My problem was solved and I would share with you how I found the solution. We finally used the Enterprise version of Gs Richcopy 360, and we set the upload speed to a specific speed, now we have good results with our data center, it works smoothly while the syncing is running.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now