Differences between revisions 11 and 39 (spanning 28 versions)
Revision 11 as of 2016-01-15 10:47:35
Size: 4954
Editor: DianeLambert
Comment:
Revision 39 as of 2016-01-25 13:32:48
Size: 5445
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
(Compiled by DL)
Line 3: Line 4:
'''Purpose:''' Generates the run script and .INN files required to tile a bigmap and generate new maplets. '''Purpose:''' Generates the run script and .INN files required to tile a bigmap or shape with a suite of new maplets.
Line 7: Line 8:
 * [[make_scriptT.in]] - text file containing references to the bigmap and make_scripT.seed file, and the bigmap pixel/line locations for the centers of each new maplet.  * [[make_scriptT.in]] - text file containing references to the bigmap and make_scriptT.seed file, and the bigmap pixel/line locations for the centers of each new maplet.
Line 9: Line 10:
 * [[TESTFILES]]/ - Directory in which to store copies of LMRK_DISPLAY1.pgm (output by [[lithos]]) for each landmark.
 * [[TESTFILES1]]/ - Directory in which to store copies of tmpl.pgm (output by [[lithos]]) for each landmark.
Line 16: Line 19:
 * .INN files - lithos seed file for each maplet.  * .INN files - lithos seed file for each new maplet.
 * rem_script.b - run script to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets.
Line 18: Line 22:
 * .OOT files - standard output from lithos for each maplet.
 * [[SUMFILES]]/ - S/C and camera information are updated by [[lithos]] as image shifts are accepted. New landmarks and limb fits are added to the SUMFILE;
 * .OOT files - standard output from lithos for each new maplet.
 * [[TESTFILES]]/ - a copy of LMRK_DISPLAY1.pgm (output by [[lithos]]) is saved for each landmark;
 * [[TESTFILES1]]/ - a copy of tmpl.pgm (output by [[lithos]]) is saved for each landmark;

 * [[SUMFILES]]/ - S/C and camera information are updated by [[lithos]] as image shifts are accepted and the "v 4" is used. New landmarks and limb fits are added to the SUMFILEs;
Line 21: Line 27:
 * [[SUMFILES]]/ - MAPFILES for each new maplet are created and populated by [[lithos]].
 * a number of information text and display files in the working directory are modified by [[lithos]]; please refer to the relevant guide.
 * [[MAPFILES]]/ - MAPFILES for each new maplet are created and populated by [[lithos]].
 * a number of information text and display files in the working directory are modified by [[lithos]]; please refer to the relevant guide for details.
Line 24: Line 30:
== Using make_scriptR == == Using make_scriptT ==

There are a multitude of procedures the user should follow before running make_scriptT; please refer to the [[Basic_tiling]] 'How-To' guide.
Line 28: Line 36:
Example '''make_script.in''' file: Example '''make_scriptT.in''' file (see [[make_scriptT.in]] for further details):
Line 31: Line 39:
 P3T11S2H0409.DAT
 P3T11S2H0410.DAT
 P3T11S2H0411.DAT
XXXXXX
scripts/t11-10.seed
      50 50
     100 50
     150 50
     200 50
      50 100
     100 100
     150 100
     200 100
      50 150
     100 150
     150 150
     200 150
      50 200
     100 200
     150 200
     200 200
Line 37: Line 60:
NB: A space must precede each image filename.

Example '''make_scriptR.seed''' file (see [[make_scriptR.seed]] for further details):
Example '''make_scriptT.seed''' file (see [[make_scriptT.seed]] for further details):
Line 42: Line 63:
s
20
0.00010,49
g
i
a
y
.5
n
x
.025
0
a
b
n
XXXXXX
n
2
b
n
XXXXXX
u
1
v
2
e
a
0,60,.25,.25,0,3
1
0
3
n
0
y


...


u
1
o
RECENT
y
1
o
RECENT
n
Line 46: Line 111:
XSTOP
1
10
3
y
XSTOP
0
y
1, 3, 5 w
i
RECENT
Line 56: Line 116:
v
1
u
1
v
4
o
RECENT
n
1
Line 57: Line 127:
END
Line 59: Line 130:
== Run make_scriptR == == Run make_scriptT ==
Line 61: Line 132:
make_scriptR generates a .INN file for each image (the image filename appended with the register options contained in the make_scriptR.seed file. Example '''P3T11S2H0409.INN''' file: make_scriptT generates a .INN file for each new maplet. The first five lines of the .INN file (see below) create a new landmark in [[lithos]], with a center at the correct bigmap pixel/line location or shape model lat/wlon location. The landmark, initially monikered 'a', is auto-renamed by [[lithos]] (option g) depending on its global lat/long region, for example 'EE0001'. The bigmap is referred to via a temporary file, named XXXXXX. The user must copy the current bigmap to MAPFILES/XXXXXX.MAP. The remainder of the .INN file comprises a copy of the [[lithos]] commands contained in [[make_scriptT.seed]].

Example '''001.INN''' file:
Line 64: Line 137:
P3T11S2H0409
s
20
3
y
XSTOP
1
10
3
y
XSTOP
0
y
n
n
q
c
a
m
XXXXXX
   50.000000000000000 50.000000000000000
0.00010,49
g
i
etc ...
Line 82: Line 148:
make_scriptR also generates the run script - '''run_script.b''': make_scriptT also generates the run script - '''run_script.b''':
Line 85: Line 151:
rm -f P3T11S2H0409.OOT
/usr/local/bin/REGISTER < P3T11S2H0409.INN > P3T11S2H0409.OOT
cp TEMPFILE.pgm ./TESTFILES/P3T11S2H0409.pgm
rm -f P3T11S2H0410.OOT
/usr/local/bin/REGISTER < P3T11S2H0410.INN > P3T11S2H0410.OOT
cp TEMPFILE.pgm ./TESTFILES/P3T11S2H0410.pgm
rm -f P3T11S2H0411.OOT
/usr/local/bin/REGISTER < P3T11S2H0411.INN > P3T11S2H0411.OOT
cp TEMPFILE.pgm ./TESTFILES/P3T11S2H0411.pgm
rm -f 001.OOT
/usr/local/bin/LITHOS < 001.INN > 001.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/001.pgm
cp tmpl.pgm ./TESTFILES1/001.pgm
rm -f 002.OOT
/usr/local/bin/LITHOS < 002.INN > 002.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/002.pgm
cp tmpl.pgm ./TESTFILES1/002.pgm
rm -f 003.OOT
/usr/local/bin/LITHOS < 003.INN > 003.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/003.pgm
cp tmpl.pgm ./TESTFILES1/003.pgm
etc ...
Line 96: Line 166:
== Batch Register Images == == Tile Bigmap with New Maplets ==
Line 102: Line 172:
The register standard output for each image is captured in the .OOT files. The user must review the .OOT files to ascertain the success of the batch image registration process. (A ''find-nofit'' program does not currently exist for batch image registration.)







Make_script is the heart of the tiling process. It generates are large suite of scripts that is run (one for each landmark) and runs [[lithos]] on it.

=== Input - files ===
 * [[make_scriptT.in]] - The script file that defines the landmarks and the map to use

=== Input - stdin ===

 * None

=== Output ===
 * run_script.b - This is the main script you run to align images to the landmarks using [[lithos]]
 * rem_script.b - You use then to clean out the directory of all old working files before you do your next run
 * aaaa.INN - A shell script that runs [[lithos]] for that specific lat/lon
----
CategoryPrograms


= Step1 =
Set up the files for the rn

= Step2 =
Run and monitor

------

= Step1 =

== Overview ==

The will use XXXXXX and XXX020.SEED to generate a suite of files to tile a bigmap.


Output will be exact (diff)


== Prep ==

Copy the reference map to XXXXXX (because Bob likes it that way)
or in the background:
Line 149: Line 174:
cp MAPFILES/REFMAP.MAP MAPFILES/XXXXXX.MAP
}}}

Add map name and seed to the top of the output from [[make_tilefile]], which should be named [[make_scriptT.in]]

It should look like this:

{{{
XXXXXX
XXX020.SEED
      50 50
     100 50
     150 50
     200 50
     250 50
     300 50
     350 50
     400 50
     450 50
     500 50
     550 50
     600 50
...
     900 950
     950 950
END
}}}

== Run ==

{{{
~/bin/make_scriptT
}}}

== Output ==

 . INN files (1 to 361)
 . rem_script.b
 . run_script.b
 . dsp_list.txt

------

= Step 2 =


== Run ==

Run, just run the script to make the whole thing go (in the background)

{{{
Line 203: Line 177:
== Monitor ==
Track the progress with find_nofitT
The [[lithos]] standard output for each image is captured in the .OOT files, and the LMRKDISPLAY1.pgm and tmpl.pgm files output by [[lithos]] are copied once a landmark has been processed, these are stored under the landmark's name in [[TESTFILES]]/ and [[TESTFILES1]]/ respectively.

== Quality Check New Maplets ==

The user must review the .OOT files to ascertain the success of the tiling process, problem landmarks can be detected using the utility program [[find_nofitT]], refer to the relevant guide for further details.

== Clean Working Directory ==

rem_script.b can be used to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets:
Line 207: Line 188:
~/bin/find_nofitT rm -f *.INN
rm -f *.OOT
rm -f run_script*
Line 209: Line 192:
If there are problems with the processing, you'll get a list of landmarks with issues
{{{
  just listed - no significant issue
  * very bad - must fix
  ! not too bad - should fix
}}}

== User Warnings ==
 * The user must copy the current bigmap to MAPFILES/XXXXXX.MAP, the temporary file which the run scripts refer to throughout.

CategoryPrograms

make_scriptT

(Compiled by DL)

Purpose: Generates the run script and .INN files required to tile a bigmap or shape with a suite of new maplets.

Requires

  • make_scriptT.in - text file containing references to the bigmap and make_scriptT.seed file, and the bigmap pixel/line locations for the centers of each new maplet.

  • make_scriptT.seed - text file containing the lithos option commands for generating each maplet.

  • TESTFILES/ - Directory in which to store copies of LMRK_DISPLAY1.pgm (output by lithos) for each landmark.

  • TESTFILES1/ - Directory in which to store copies of tmpl.pgm (output by lithos) for each landmark.

NB: lithos requires a number of directories and files - refer to relevant guide.

Output

make_scriptT outputs:

  • run_script.b - run script for maplet creation.
  • .INN files - lithos seed file for each new maplet.
  • rem_script.b - run script to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets.

run_script.b output:

  • .OOT files - standard output from lithos for each new maplet.
  • TESTFILES/ - a copy of LMRK_DISPLAY1.pgm (output by lithos) is saved for each landmark;

  • TESTFILES1/ - a copy of tmpl.pgm (output by lithos) is saved for each landmark;

  • SUMFILES/ - S/C and camera information are updated by lithos as image shifts are accepted and the "v 4" is used. New landmarks and limb fits are added to the SUMFILEs;

  • LMKFILES/ - LMKFILES for each new maplet are created and populated by lithos.

  • MAPFILES/ - MAPFILES for each new maplet are created and populated by lithos.

  • a number of information text and display files in the working directory are modified by lithos; please refer to the relevant guide for details.

Using make_scriptT

There are a multitude of procedures the user should follow before running make_scriptT; please refer to the Basic_tiling 'How-To' guide.

Create Input Files

Example make_scriptT.in file (see make_scriptT.in for further details):

XXXXXX
scripts/t11-10.seed
      50   50
     100   50
     150   50
     200   50
      50  100
     100  100
     150  100
     200  100
      50  150
     100  150
     150  150
     200  150
      50  200
     100  200
     150  200
     200  200
END

Example make_scriptT.seed file (see make_scriptT.seed for further details):

0.00010,49
g
i
a
y
.5
n
x
.025
0
a
b
n
XXXXXX
n
2
b
n
XXXXXX
u
1
v
2
e
a
0,60,.25,.25,0,3
1
0
3
n
0
y


...


u
1
o
RECENT
y
1
o
RECENT
n
3
y
1, 3, 5 w
i
RECENT
n
n
v
1
u
1
v
4
o
RECENT
n
1
q
END                        

Run make_scriptT

make_scriptT generates a .INN file for each new maplet. The first five lines of the .INN file (see below) create a new landmark in lithos, with a center at the correct bigmap pixel/line location or shape model lat/wlon location. The landmark, initially monikered 'a', is auto-renamed by lithos (option g) depending on its global lat/long region, for example 'EE0001'. The bigmap is referred to via a temporary file, named XXXXXX. The user must copy the current bigmap to MAPFILES/XXXXXX.MAP. The remainder of the .INN file comprises a copy of the lithos commands contained in make_scriptT.seed.

Example 001.INN file:

c
a
m
XXXXXX
   50.000000000000000        50.000000000000000     
0.00010,49                                                                      
g                                                                               
i                                                                               
etc ...

make_scriptT also generates the run script - run_script.b:

rm -f 001.OOT
/usr/local/bin/LITHOS < 001.INN > 001.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/001.pgm
cp tmpl.pgm ./TESTFILES1/001.pgm
rm -f 002.OOT
/usr/local/bin/LITHOS < 002.INN > 002.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/002.pgm
cp tmpl.pgm ./TESTFILES1/002.pgm
rm -f 003.OOT
/usr/local/bin/LITHOS < 003.INN > 003.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/003.pgm
cp tmpl.pgm ./TESTFILES1/003.pgm
etc ...

Tile Bigmap with New Maplets

sh run_script.b

or in the background:

nohup sh run_script.b &

The lithos standard output for each image is captured in the .OOT files, and the LMRKDISPLAY1.pgm and tmpl.pgm files output by lithos are copied once a landmark has been processed, these are stored under the landmark's name in TESTFILES/ and TESTFILES1/ respectively.

Quality Check New Maplets

The user must review the .OOT files to ascertain the success of the tiling process, problem landmarks can be detected using the utility program find_nofitT, refer to the relevant guide for further details.

Clean Working Directory

rem_script.b can be used to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets:

rm -f *.INN
rm -f *.OOT
rm -f run_script*

User Warnings

  • The user must copy the current bigmap to MAPFILES/XXXXXX.MAP, the temporary file which the run scripts refer to throughout.

CategoryPrograms

make_scriptT (last edited 2016-07-24 09:58:33 by BMittan)