parallelization scripts
This commit is contained in:
		
							
								
								
									
										6
									
								
								parallelization/check_hostfile
									
									
									
									
									
										Executable file
									
								
							
							
						
						
									
										6
									
								
								parallelization/check_hostfile
									
									
									
									
									
										Executable file
									
								
							@@ -0,0 +1,6 @@
 | 
			
		||||
#!/bin/bash
 | 
			
		||||
 | 
			
		||||
for a in $(cat $1 | egrep -o '^[^ ]*'); do
 | 
			
		||||
	echo -n "$a "
 | 
			
		||||
	ssh -o ConnectTimeout=5 $a "cat /proc/cpuinfo | egrep '^processor' | wc -l"
 | 
			
		||||
done
 | 
			
		||||
@@ -2,13 +2,13 @@
 | 
			
		||||
 | 
			
		||||
wordlength = 16
 | 
			
		||||
n = 101038
 | 
			
		||||
res = 50
 | 
			
		||||
radius = 1.0
 | 
			
		||||
res = 200
 | 
			
		||||
radius = 1
 | 
			
		||||
q = [1,1,1]
 | 
			
		||||
 | 
			
		||||
denom = round(res/radius)
 | 
			
		||||
 | 
			
		||||
cmd = "IDLIST=./output/idlist_{len} ./complex_anosov summary {n} {q1} {q2} {q3} {rnum}/{rden} {inum}/{iden}"
 | 
			
		||||
cmd = "IDLIST=idlist_{len} ../complex_anosov summary {n} {q1} {q2} {q3} {rnum}/{rden} {inum}/{iden}"
 | 
			
		||||
 | 
			
		||||
for i in range(-res,res+1):
 | 
			
		||||
	for j in range(0,res+1):
 | 
			
		||||
 
 | 
			
		||||
							
								
								
									
										19
									
								
								parallelization/instructions
									
									
									
									
									
										Normal file
									
								
							
							
						
						
									
										19
									
								
								parallelization/instructions
									
									
									
									
									
										Normal file
									
								
							@@ -0,0 +1,19 @@
 | 
			
		||||
instructions to run in parallel on a cluster:
 | 
			
		||||
 | 
			
		||||
the hostfile should look like this:
 | 
			
		||||
host1 slots=2
 | 
			
		||||
host2 slots=4
 | 
			
		||||
host3 slots=4
 | 
			
		||||
host4 slots=8
 | 
			
		||||
...
 | 
			
		||||
 | 
			
		||||
- git clone
 | 
			
		||||
- fix dependencies
 | 
			
		||||
- compile
 | 
			
		||||
- ./generate_commands.py > commands
 | 
			
		||||
- get hostfile
 | 
			
		||||
- check hostfile, delete entries which don't work
 | 
			
		||||
- get idlist
 | 
			
		||||
- ./sync
 | 
			
		||||
- delete old result and done files
 | 
			
		||||
- execute ./run on server
 | 
			
		||||
							
								
								
									
										7
									
								
								parallelization/run
									
									
									
									
									
										Executable file
									
								
							
							
						
						
									
										7
									
								
								parallelization/run
									
									
									
									
									
										Executable file
									
								
							@@ -0,0 +1,7 @@
 | 
			
		||||
#!/bin/bash
 | 
			
		||||
 | 
			
		||||
cd /home/stecker/compute/triangle_reflection_complex/parallelization
 | 
			
		||||
 | 
			
		||||
unset DISPLAY
 | 
			
		||||
 | 
			
		||||
time mpirun -n 50 -x LD_LIBRARY_PATH=/home/stecker/compute/mps/lib --hostfile hostfile_big python3 runjobs.py
 | 
			
		||||
							
								
								
									
										7
									
								
								parallelization/sync
									
									
									
									
									
										Executable file
									
								
							
							
						
						
									
										7
									
								
								parallelization/sync
									
									
									
									
									
										Executable file
									
								
							@@ -0,0 +1,7 @@
 | 
			
		||||
#!/bin/bash
 | 
			
		||||
 | 
			
		||||
rsync -rvt * utexas:compute/triangle_reflection_complex/parallelization/
 | 
			
		||||
#rsync -lvt /usr/lib/libmps.so* utexas:compute/mps/lib/
 | 
			
		||||
#rsync -rvt /usr/include/mps utexas:compute/mps/include/
 | 
			
		||||
 | 
			
		||||
# now run it with ssh utexas compute/triangle_reflection_complex/parallelization/run
 | 
			
		||||
		Reference in New Issue
	
	Block a user