underlayer is a symmetric decentralized parallel computing and load balancing framework.
Version: 2.01underlayer is a symmetric decentralized parallel computing and load balancing framework, providing c, perl and java APIs for distributed job management.
Operating System: Linux
INSTALLATION AND RUNNING:
to get the perl API going:
to get the Java API going:
edit make_java.sh to point to your jdk.
to start the underlayer daemon:
to query the underlayer:
to register an already running service at port :
to start a new abstract listening service:
see the underlayer man page
c parallel programming:
see example1, pm.c
see the Underlayer man page
perl parallel programming:
see example2, master_example.plx
perl parallel programming in detail:
create a working directory:
start a listener for service_id 19 at port 1919.
ideally, do this on as many servers running an abstract machine
at service_id 19 as possible.
change to the examples directory
given a large phrase list and a small phrase list, at 50 threads...
>perl master_example.plx largelist.txt smalllist.txt 50 > results.txt
note that if you do this on a single server, it will never get to anywhere near 50 threads. it blocks as soon as the processor is maxxed out. you can check the load state by running
if you built the java library and program, you can use the GUI monitor:
add 20 servers and try again! you'll be pleased with the speed. you can set the serial speed by running only the slave:
>perl slave_example.plx largelist smalllist.txt > results_serial.txt