|
Size: 1194
Comment:
|
Size: 3107
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = Export and Import = (Modified by JRW from text written by EEP) These two programs will allow you to export landmarks from multiple machines, which can then be added to another machine. Instead of merging two or more datasets, a similar end result is achieved by adding all landmarks to a "main" or "head" machine. While this is useful for combining data from multiple users, it was originally intended to be a tool which would allow someone to tile an object/bigmap simultaneously on multiple machines, then combine the results onto a single machine. Hence it uses [[LMRKLIST1.TXT]], which is a list of newly added landmarks. |
|
| Line 3: | Line 11: |
| We generate a script that will remove unneeded files and take the new landmarks and put them into a tar ball. Makes EXPORT.b and the script EXPORT.TXT, [[map_coverage]] |
=== REQUIRES === * [[MAPFILES]]/ - a directory containing the full suite of maplets; * [[LMKFILES]]/ - a directory containing the full suite of landmarks; * [[LMRKLIST1.TXT]] - a list of the new landmarks; === OUTPUT === * EXPORT.TXT - Script that will execute the EXPORT.B script & clean up the previous version of NEW_FILES * EXPORT.B - Script that will cp new maplet and landmark files to NEW_FILE We generate a script that will copy the new landmarks and put them into a tar ball. Makes EXPORT.B and the script EXPORT.TXT. If you notice, EXPORT.TXT will run the script EXPORT.B. The key thing you need to ensure is that LMRKLIST1.TXT only has the recently created landmarks. If it has older ones, then you might need to trim the top of the file. You should also ensure that there aren't any maplets or landmarks remaining in [[NEW_FILES]]. If [[NEW_FILES]] does not exist, you will need to create NEW_FILES, as well as NEW_FILES/LMKFILES and NEW_FILES/MAPFILES. |
| Line 8: | Line 25: |
| This will create the directory NEW_FILES and populate it with copies of the newly created mapfiles and landmarks. | |
| Line 10: | Line 28: |
| The script EXPORT.TXT is: | The script EXPORT.TXT looks this, but you don't need to understand it to use it: |
| Line 32: | Line 50: |
| NEW_FILES_<bigmapName>.tar | new_<bigmapName>.tar |
| Line 34: | Line 52: |
| and e-mail to me or put in dropbox. | and transfer the tar file to the other computer. |
| Line 39: | Line 57: |
| Untar to recover NEW_FILES directory, [[import]] ~/bin/IMPORT cp NEWLIST.TXT make_script.in For make_scriptF.seed use: |
Untar to recover NEW_FILES directory. If you didn't rename the tar file, from the working directory all you need to do is type... |
| Line 47: | Line 59: |
| n n g u 1 o RECENT n 1 q END |
tar -xf NEW_FILES.TAR |
| Line 60: | Line 62: |
| Run these commands (copy into window) | which should create the directory NEW_FILE if it doesn't already exist. If you are concerned about overwriting data in the current directory, use "tar" to check the location the data will be written to. Once confirmed, from the working directory type ... |
| Line 62: | Line 65: |
| sh rem_script.b rm TESTFILES/* rm TESTFILES1/* ~/bin/make_scriptF.e ./run_script.b & |
/usr/local/bin/IMPORT |
| Line 69: | Line 68: |
| (!) Type this from time to time to see how it is going, [[import]]. {{{ ~/bin/find_nofitT (this didn't seem to work, but find_nofitP.e gave output that made sense) }}} |
which will import the new landmarks. '''NOTE:''' The imported landmarks will be renamed based upon region! This renaming procedure ensures no existing landmarks will be overwritten. It also means you may end up with duplicate landmarks if you didn't make sure to exclude them when you created LMRKLIST1.TXT. |
Export and Import
(Modified by JRW from text written by EEP)
These two programs will allow you to export landmarks from multiple machines, which can then be added to another machine. Instead of merging two or more datasets, a similar end result is achieved by adding all landmarks to a "main" or "head" machine.
While this is useful for combining data from multiple users, it was originally intended to be a tool which would allow someone to tile an object/bigmap simultaneously on multiple machines, then combine the results onto a single machine. Hence it uses LMRKLIST1.TXT, which is a list of newly added landmarks.
Export
REQUIRES
MAPFILES/ - a directory containing the full suite of maplets;
LMKFILES/ - a directory containing the full suite of landmarks;
LMRKLIST1.TXT - a list of the new landmarks;
OUTPUT
EXPORT.TXT - Script that will execute the EXPORT.B script & clean up the previous version of NEW_FILES
- EXPORT.B - Script that will cp new maplet and landmark files to NEW_FILE
We generate a script that will copy the new landmarks and put them into a tar ball. Makes EXPORT.B and the script EXPORT.TXT. If you notice, EXPORT.TXT will run the script EXPORT.B. The key thing you need to ensure is that LMRKLIST1.TXT only has the recently created landmarks. If it has older ones, then you might need to trim the top of the file. You should also ensure that there aren't any maplets or landmarks remaining in NEW_FILES. If NEW_FILES does not exist, you will need to create NEW_FILES, as well as NEW_FILES/LMKFILES and NEW_FILES/MAPFILES.
/usr/local/bin/EXPORT
This will create the directory NEW_FILES and populate it with copies of the newly created mapfiles and landmarks.
The script EXPORT.TXT looks this, but you don't need to understand it to use it:
cp LMRKLIST1.TXT NEW_FILES/LMRKLIST.TXT cd NEW_FILES/LMKFILES rm -f *.LMK cd ../.. cd NEW_FILES/MAPFILES rm -f *.MAP cd ../.. chmod +x EXPORT.b ./EXPORT.b tar -cf NEW_FILES.tar NEW_FILES rm -f LMRKLIST1.TXT
Run this script by
sh EXPORT.TXT
Change name of NEW_FILES.tar to something distinctive like
new_<bigmapName>.tar
and transfer the tar file to the other computer.
Import
Untar to recover NEW_FILES directory. If you didn't rename the tar file, from the working directory all you need to do is type...
tar -xf NEW_FILES.TAR
- which should create the directory NEW_FILE if it doesn't already exist. If you are concerned about overwriting data in the current directory, use "tar" to check the location the data will be written to. Once confirmed, from the working directory type ...
/usr/local/bin/IMPORT
which will import the new landmarks. NOTE: The imported landmarks will be renamed based upon region! This renaming procedure ensures no existing landmarks will be overwritten. It also means you may end up with duplicate landmarks if you didn't make sure to exclude them when you created LMRKLIST1.TXT.