parallelization scripts

This commit is contained in:
Florian Stecker 2022-06-15 18:04:42 +02:00
parent ec34567ace
commit 979cbe7922
5 changed files with 42 additions and 3 deletions

6
parallelization/check_hostfile Executable file
View File

@ -0,0 +1,6 @@
#!/bin/bash
for a in $(cat $1 | egrep -o '^[^ ]*'); do
echo -n "$a "
ssh -o ConnectTimeout=5 $a "cat /proc/cpuinfo | egrep '^processor' | wc -l"
done

View File

@ -2,13 +2,13 @@
wordlength = 16 wordlength = 16
n = 101038 n = 101038
res = 50 res = 200
radius = 1.0 radius = 1
q = [1,1,1] q = [1,1,1]
denom = round(res/radius) denom = round(res/radius)
cmd = "IDLIST=./output/idlist_{len} ./complex_anosov summary {n} {q1} {q2} {q3} {rnum}/{rden} {inum}/{iden}" cmd = "IDLIST=idlist_{len} ../complex_anosov summary {n} {q1} {q2} {q3} {rnum}/{rden} {inum}/{iden}"
for i in range(-res,res+1): for i in range(-res,res+1):
for j in range(0,res+1): for j in range(0,res+1):

View File

@ -0,0 +1,19 @@
instructions to run in parallel on a cluster:
the hostfile should look like this:
host1 slots=2
host2 slots=4
host3 slots=4
host4 slots=8
...
- git clone
- fix dependencies
- compile
- ./generate_commands.py > commands
- get hostfile
- check hostfile, delete entries which don't work
- get idlist
- ./sync
- delete old result and done files
- execute ./run on server

7
parallelization/run Executable file
View File

@ -0,0 +1,7 @@
#!/bin/bash
cd /home/stecker/compute/triangle_reflection_complex/parallelization
unset DISPLAY
time mpirun -n 50 -x LD_LIBRARY_PATH=/home/stecker/compute/mps/lib --hostfile hostfile_big python3 runjobs.py

7
parallelization/sync Executable file
View File

@ -0,0 +1,7 @@
#!/bin/bash
rsync -rvt * utexas:compute/triangle_reflection_complex/parallelization/
#rsync -lvt /usr/lib/libmps.so* utexas:compute/mps/lib/
#rsync -rvt /usr/include/mps utexas:compute/mps/include/
# now run it with ssh utexas compute/triangle_reflection_complex/parallelization/run