Fast datacentre code deployment using modified bittorrent. Interesting read.
Writeup: Twitter Engineering: Murder: Fast datacenter code deploys using BitTorrent
and apparently Facebook does a similar thing. (No link, just random forum posts).
What took them so long? People have been using BitTorrent for deploying software since at least early 2008...
TorrentFreak - Dutch University Uses BitTorrent to Update Workstations
TorrentFreak - DistriBrute: P2P Powered Desktop Deployment
pete (16th August 2011)
If think the interesting thing (in the video on the twitter engineering article) is the way they've told bittornado to distribute stuff.
Rather than using many<-->many (and suffering the inter-server chatter / processing overhead) they've told it to go server1-server2-server3-server4-server5-server6-serverNth, which means they don't have processing overhead on each node (and twitter webservers don't go pear-shaped under the load). They also found out that over however many thousand servers, there's no real difference in speed.
There are currently 1 users browsing this thread. (0 members and 1 guests)