+ Post New Thread
Results 1 to 6 of 6
Wireless Networks Thread, Best platform for distributed processing? in Technical; Hello All, We'll (hopefully) be getting a bunch of nice new PCs turning up this summer. They'll be running Windows ...
  1. #1

    dhicks's Avatar
    Join Date
    Aug 2005
    Location
    Knightsbridge
    Posts
    5,683
    Thank Post
    1,268
    Thanked 788 Times in 685 Posts
    Rep Power
    237

    Best platform for distributed processing?

    Hello All,

    We'll (hopefully) be getting a bunch of nice new PCs turning up this summer. They'll be running Windows XP, but I'll be installing our own imaging system on them that consists of a small Linux distribution (SystemRescueCD) that can copy disk images off a central server. I was thinking that as I'd be setting up each workstation with this system anyway, I could go one step further and add a couple more Linux distributions to do some distributed processing of some kind overnight.

    Does anyone have any recommendations? With the release of Big Bug Bunny, we might try and get people interested in using Blender, so it might be an idea to have a Blender render farm available for use - is DrQueue the best/only choice? There's also BOINC, which would seem to be a generic platform for running various projects on top of. Is BOINC the best generic distributed processing platform? Is there, by any chance, a Blender render farm that will run on top of BOINC? Would I be best mixing the two by having two separate Linux distributions installed on our machines, one with BOINC installed and one with DrQueue?

    --
    David Hicks

  2. #2

    SYNACK's Avatar
    Join Date
    Oct 2007
    Posts
    11,239
    Thank Post
    882
    Thanked 2,742 Times in 2,316 Posts
    Blog Entries
    11
    Rep Power
    784
    I can't find a download link but this:
    Penguin Computing - Linux Servers & Clusters - Scyld ClusterWare™ HPC
    may be something that could work. It is only installed on the master computer and just uses a small image to boot the other machines into slaves.

    extra link:
    CDROM with Scyld Beowulf - Linux Central the /root for Linux resources

    Edit:
    This page looks directly at the clustering of blender but is quite old:
    http://blenderartists.org/forum/showthread.php?t=10018
    Last edited by SYNACK; 2nd June 2008 at 12:22 AM.

  3. #3

    dhicks's Avatar
    Join Date
    Aug 2005
    Location
    Knightsbridge
    Posts
    5,683
    Thank Post
    1,268
    Thanked 788 Times in 685 Posts
    Rep Power
    237
    Quote Originally Posted by SYNACK View Post
    Scyld ClusterWare may be something that could work. It is only installed on the master computer and just uses a small image to boot the other machines into slaves.
    Thanks, looks interesting. Beowulf - of course, how could I forget that one? I also found OpenMosix via your links, but that project seems to now be closed. Ideally I guess I want something that lets our computers be used for something useful for as much time as possible.

    --
    David Hicks

  4. #4

    Ric_'s Avatar
    Join Date
    Jun 2005
    Location
    London
    Posts
    7,592
    Thank Post
    109
    Thanked 770 Times in 598 Posts
    Rep Power
    183
    I believe that Solaris and 'N1 Grid' is also meant to be good and easy to use - although the N1 stuff might have license implications if you aren't using Sun hardware.

  5. #5


    Join Date
    Jan 2006
    Posts
    8,202
    Thank Post
    442
    Thanked 1,032 Times in 812 Posts
    Rep Power
    339
    Parallel Knoppix can boot over the network, by PXE

    If you could automatically update the dhcp configuration and have the XP boxes reboot by PXE into linux, you'd have yourself a server farm

    Ideally the script would change the dhcp config back and reboot them into XP before the teachers come into school.

    ParallelKnoppix: Create a HPC cluster in 5 minutes

  6. #6

    SYNACK's Avatar
    Join Date
    Oct 2007
    Posts
    11,239
    Thank Post
    882
    Thanked 2,742 Times in 2,316 Posts
    Blog Entries
    11
    Rep Power
    784
    Ok, if you are after maximum usability while doing it these should work for you. There are client background app options that work with Windows, OSX and Linux. They also include all the management stuff to split up the jobs.

    SourceForge.net: Distriblend
    Farmerjoe - The render Farmer
    Yadra - Yet Another Distributed Rendering App at BlenderNation
    ATPM 10.06 - How To: Distributed Blender Rendering

SHARE:
+ Post New Thread

Similar Threads

  1. Distributed Gameing for Science
    By SYNACK in forum General Chat
    Replies: 0
    Last Post: 11th May 2008, 02:44 AM
  2. Why can't we print from word processing software?
    By broc in forum Office Software
    Replies: 7
    Last Post: 25th April 2008, 02:43 PM
  3. Learning Platform Map
    By thom in forum Virtual Learning Platforms
    Replies: 0
    Last Post: 4th April 2007, 08:11 AM
  4. VLE/Learning Platform
    By monkeyx in forum Virtual Learning Platforms
    Replies: 1
    Last Post: 27th March 2007, 01:33 PM
  5. Anyone running any distributed computing projects?
    By ChrisH in forum General Chat
    Replies: 5
    Last Post: 15th February 2006, 06:21 PM

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •