Small Footprint Processing

Summary

In order to avoid overwriting files, we create separate directories for each batch tiling job that we do. However, with the landmarks and mapfiles growing so much (50,000 files each), it is becoming unwieldily.

File Structure

There are two directories that are needed for this system to work.

1. run-master. This directory contains a full set of what is needed to do all SPC tasks (either actual or symbolic links). Basically, I will make symbolic links to the ~/Dropbox/Dawn-shape/Vesta directory for images, seed files, etc. Then for items that get changed, such as landmarks and mapfiles, I have my own copy. I use an rsync script (update.sh) to keep my copy of these files up to date which what is in the Dropbox.

• There are two tasks that we use this directory for.
• Generation of the big map. We use the command ["bigmap.e"] to figure out which files need to be copied into a working directory that are required for tiling. It is important to do this is its own directory, otherwise, you'd be changing stuff within Dropbox itself, which effects everyone else. b. A source for the required landmarks and mapfiles