MapScale is a Python tool for embarrassingly parallel python workflows. It works like Python’s built-in multiprocessing Pool.map(), except MapScale uses ZeroMQ messaging to create work servers. This lets you reduce overhead–workers are setup just once, and can be re-used with several map calls–and allows you to add workers from across the Internet.
MapScale is being developed at https://www.github.com/jonathansick/mapscale. To install:
git clone https://github.com/jonathansick/mapscale.git
cd mapscale
python setup.py install
Note, you will need to also install pyzmq.