Ooh, I could murder a..... datacentre code repository? Wut?

[pete]

Fast datacentre code deployment using modified bittorrent. Interesting read.

 

Writeup: Twitter Engineering: Murder: Fast datacenter code deploys using BitTorrent

Source: https://github.com/lg/murder

[pete]

and apparently Facebook does a similar thing. (No link, just random forum posts).

[Arthur]

What took them so long? People have been using BitTorrent for deploying software since at least early 2008...

 

TorrentFreak - Dutch University Uses BitTorrent to Update Workstations

TorrentFreak - DistriBrute: P2P Powered Desktop Deployment

[pete]

If think the interesting thing (in the video on the twitter engineering article) is the way they've told bittornado to distribute stuff.

 

Rather than using many<-->many (and suffering the inter-server chatter / processing overhead) they've told it to go server1-server2-server3-server4-server5-server6-serverNth, which means they don't have processing overhead on each node (and twitter webservers don't go pear-shaped under the load). They also found out that over however many thousand servers, there's no real difference in speed.

[mac_shinobi]

What took them so long? People have been using BitTorrent for deploying software since at least early 2008...

 

TorrentFreak - Dutch University Uses BitTorrent to Update Workstations

TorrentFreak - DistriBrute: P2P Powered Desktop Deployment

 

So if someone injected / inserted a virus / malware / spyware into one of the machines / peers that were using the bit torrent client(s) then it would share this with other machines and hence the bit torrent clients ( Distribrute ) would act like a virus itself as it would share this with other machines etc ?

[pete]

So if someone injected / inserted a virus / malware / spyware into one of the machines / peers that were using the bit torrent client(s) then it would share this with other machines and hence the bit torrent clients ( Distribrute ) would act like a virus itself as it would share this with other machines etc ?

 

I suspect it'd fail the hash check. If you compromised the seeding server(s), you'd have more luck.