Differences between revisions 18 and 37 (spanning 19 versions)
Revision 18 as of 2016-01-15 15:13:30
Size: 7298
Editor: DianeLambert
Comment:
Revision 37 as of 2016-01-21 18:08:53
Size: 5399
Editor: DianeLambert
Comment:
Deletions are marked like this. Additions are marked like this.
Line 4: Line 4:
'''Purpose:''' Generates the run script and .INN files required to tile a bigmap with a suite of new maplets. '''Purpose:''' Generates the run script and .INN files required to tile a bigmap or shape with a suite of new maplets.
Line 10: Line 10:
 * TESTFILES/ - Directory in which to store copies of LMRK_DISPLAY1.pgm (output by [[lithos]]) for each landmark.
 * TESTFILES1/ - Directory in which to store copies of tmpl.pgm (output by [[lithos]]) for each landmark.
Line 18: Line 20:
 * rem_script.b - run script to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets.
Line 20: Line 23:
 * TESTFILES/ - a copy of LMRK_DISPLAY1.pgm (output by [[lithos]]) is saved for each landmark;
 * TESTFILES1/ - a copy of tmpl.pgm (output by [[lithos]]) is saved for each landmark;
Line 22: Line 27:
 * [[SUMFILES]]/ - MAPFILES for each new maplet are created and populated by [[lithos]].
 * a number of information text and display files in the working directory are modified by [[lithos]]; please refer to the relevant guide.
 * [[MAPFILES]]/ - MAPFILES for each new maplet are created and populated by [[lithos]].
 * a number of information text and display files in the working directory are modified by [[lithos]]; please refer to the relevant guide for details.
Line 27: Line 32:
=== Generate a Tiling Bigmap ===

The user must generate a bigmap which covers the region of interest and whose parameters are set up such that the new maplets will overlap by the desired amount.

==== Bigmap .in File ====

The user must adjust the bigmap pixel scale in the tiling .in file in order to achieve the desired maplet overlap ratio. This is done by applying a multiplicative factor to the maplet ground sample distance (GSD) as follows:
 maplet GSD = 10cm<<BR>>
 bigmap scale = 10cm * 1.5 = 15cm to achieve a 25% overlap

Example set of multiplicative factors:
||Multiplicative Factor||Maplet Overlap||Example for Maplet GSD = 10cm||
||0.8||58%||bigmap scale = 10cm * 0.8 = 8cm||
||1.0||50%||bigmap scale = 10cm * 1.0 = 10cm||
||1.3||33%||bigmap scale = 10cm * 1.3 = 13cm||
||1.5||25%||bigmap scale = 10cm * 1.5 = 15cm||
||2.0||0||bigmap scale = 10cm * 2.0 = 20cm||

Example BGMAP1.in:
{{{
m <- Reference to map
START1 <- Reference map name
   49 49 <- Reference map pixel/line location
   0.00007692 130 1.23400 1000 <- scale (km/pixel), Q size, integer random seed, maximum maplet scale
BGMAP1 <- bigmap name
1 <- bigmap program commands
.005
.025
1
0
0
1
1
1
1
1
1
0
0
}}}

In order to achieve the desired

For example:
{{{
bigmap < scripts/BGMAP1.in
}}}

Please refer to the relevant guide for using the program, [[bigmap]].
There are a multitude of procedures the user should follow before running make_scriptT; please refer to the [[Basic_tiling]] 'How-To' guide.
Line 139: Line 95:
1
0
1
n
0
y
0
c
.5
0
0
40
1
0
3
n
0
y
1
0
1
n
0
y
e
o
.5
0
a
u
1
0
0
40
2
8
2
.01
1
4
1, 2.5, 3
6
y
y
0
.025
30
0
u
1
v
1
1
0
1
n
0
y
u
1
0
0
40
1
0
2
n
0
y
1
0
1
n
0
y
e
o
.5
u
1
0
0
40
2
8
2
.01
1
4
1, 2.5, 3
6
y
y
0
.025
30
0
u
1
v
1
1
0
1
n
0
y


...

Line 266: Line 120:
#v
#4
v
4
Line 278: Line 132:
make_scriptT generates a .INN file for each new maplet. The first five lines of the .INN file (see below) create a new landmark in [[lithos]], with a center at the correct bigmap pixel/line location. The landmark, initially monikered 'a', is auto-renamed by [[lithos]]:g depending on its global lat/long region, for example 'EE0001'. The bigmap is referred to via a temporary file, named XXXXXX. The user must copy the current bibmap to MAPFILES/XXXXXX.MAP. make_scriptT generates a .INN file for each new maplet. The first five lines of the .INN file (see below) create a new landmark in [[lithos]], with a center at the correct bigmap pixel/line location or shape model lat/wlon location. The landmark, initially monikered 'a', is auto-renamed by [[lithos]] (option g) depending on its global lat/long region, for example 'EE0001'. The bigmap is referred to via a temporary file, named XXXXXX. The user must copy the current bigmap to MAPFILES/XXXXXX.MAP. The remainder of the .INN file comprises a copy of the [[lithos]] commands contained in [[make_scriptT.seed]].
Line 297: Line 151:
rm -f 001.OOT
/usr/local/bin/LITHOS < 001.INN > 001.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/001.pgm
cp tmpl.pgm ./TESTFILES1/001.pgm
rm -f 002.OOT
/usr/local/bin/LITHOS < 002.INN > 002.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/002.pgm
cp tmpl.pgm ./TESTFILES1/002.pgm
rm -f 003.OOT
/usr/local/bin/LITHOS < 003.INN > 003.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/003.pgm
cp tmpl.pgm ./TESTFILES1/003.pgm
etc ...
Line 306: Line 172:
The [[lithos]] standard output for each image is captured in the .OOT files. The user must review the .OOT files to ascertain the success of the batch image registration process, problem landmarks can be detected using the utility program [[find_nofitT]].







Make_script is the heart of the tiling process. It generates are large suite of scripts that is run (one for each landmark) and runs [[lithos]] on it.

=== Input - files ===
 * [[make_scriptT.in]] - The script file that defines the landmarks and the map to use

=== Input - stdin ===

 * None

=== Output ===
 * run_script.b - This is the main script you run to align images to the landmarks using [[lithos]]
 * rem_script.b - You use then to clean out the directory of all old working files before you do your next run
 * aaaa.INN - A shell script that runs [[lithos]] for that specific lat/lon
----
CategoryPrograms


= Step1 =
Set up the files for the rn

= Step2 =
Run and monitor

------

= Step1 =

== Overview ==

The will use XXXXXX and XXX020.SEED to generate a suite of files to tile a bigmap.


Output will be exact (diff)


== Prep ==

Copy the reference map to XXXXXX (because Bob likes it that way)
or in the background:
Line 353: Line 174:
cp MAPFILES/REFMAP.MAP MAPFILES/XXXXXX.MAP
}}}

Add map name and seed to the top of the output from [[make_tilefile]], which should be named [[make_scriptT.in]]

It should look like this:

{{{
XXXXXX
XXX020.SEED
      50 50
     100 50
     150 50
     200 50
     250 50
     300 50
     350 50
     400 50
     450 50
     500 50
     550 50
     600 50
...
     900 950
     950 950
END
}}}

== Run ==

{{{
~/bin/make_scriptT
}}}

== Output ==

 . INN files (1 to 361)
 . rem_script.b
 . run_script.b
 . dsp_list.txt

------

= Step 2 =


== Run ==

Run, just run the script to make the whole thing go (in the background)

{{{
Line 407: Line 177:
== Monitor ==
Track the progress with find_nofitT
The [[lithos]] standard output for each image is captured in the .OOT files, and the LMRKDISPLAY1.pgm and tmpl.pgm files output by [[lithos]] are copied once a landmark has been processed, these are stored under the landmark's name in TESTFILES/ and TESTFILES1/ respectively.

== Quality Check New Maplets ==

The user must review the .OOT files to ascertain the success of the tiling process, problem landmarks can be detected using the utility program [[find_nofitT]], refer to the relevant guide for further details.

== Clean Working Directory ==

rem_script.b can be used to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets:
Line 411: Line 188:
~/bin/find_nofitT rm -f *.INN
rm -f *.OOT
rm -f run_script*
Line 413: Line 192:
If there are problems with the processing, you'll get a list of landmarks with issues
{{{
  just listed - no significant issue
  * very bad - must fix
  ! not too bad - should fix
}}}

== User Warnings ==
 * The user must copy the current bigmap to MAPFILES/XXXXXX.MAP, the temporary file which the run scripts refer to throughout.

CategoryPrograms

make_scriptT

(Compiled by DL)

Purpose: Generates the run script and .INN files required to tile a bigmap or shape with a suite of new maplets.

Requires

  • make_scriptT.in - text file containing references to the bigmap and make_scriptT.seed file, and the bigmap pixel/line locations for the centers of each new maplet.

  • make_scriptT.seed - text file containing the lithos option commands for generating each maplet.

  • TESTFILES/ - Directory in which to store copies of LMRK_DISPLAY1.pgm (output by lithos) for each landmark.

  • TESTFILES1/ - Directory in which to store copies of tmpl.pgm (output by lithos) for each landmark.

NB: lithos requires a number of directories and files - refer to relevant guide.

Output

make_scriptT outputs:

  • run_script.b - run script for maplet creation.
  • .INN files - lithos seed file for each new maplet.
  • rem_script.b - run script to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets.

run_script.b output:

  • .OOT files - standard output from lithos for each new maplet.
  • TESTFILES/ - a copy of LMRK_DISPLAY1.pgm (output by lithos) is saved for each landmark;

  • TESTFILES1/ - a copy of tmpl.pgm (output by lithos) is saved for each landmark;

  • SUMFILES/ - S/C and camera information are updated by lithos as image shifts are accepted. New landmarks and limb fits are added to the SUMFILEs;

  • LMKFILES/ - LMKFILES for each new maplet are created and populated by lithos.

  • MAPFILES/ - MAPFILES for each new maplet are created and populated by lithos.

  • a number of information text and display files in the working directory are modified by lithos; please refer to the relevant guide for details.

Using make_scriptT

There are a multitude of procedures the user should follow before running make_scriptT; please refer to the Basic_tiling 'How-To' guide.

Create Input Files

Example make_scriptT.in file (see make_scriptT.in for further details):

XXXXXX
scripts/t11-10.seed
      50   50
     100   50
     150   50
     200   50
      50  100
     100  100
     150  100
     200  100
      50  150
     100  150
     150  150
     200  150
      50  200
     100  200
     150  200
     200  200
END

Example make_scriptT.seed file (see make_scriptT.seed for further details):

0.00010,49
g
i
a
y
.5
n
x
.025
0
a
b
n
XXXXXX
n
2
b
n
XXXXXX
u
1
v
2
e
a
0,60,.25,.25,0,3
1
0
3
n
0
y


...


u
1
o
RECENT
y
1
o
RECENT
n
3
y
1, 3, 5 w
i
RECENT
n
n
v
1
u
1
v
4
o
RECENT
n
1
q
END                        

Run make_scriptT

make_scriptT generates a .INN file for each new maplet. The first five lines of the .INN file (see below) create a new landmark in lithos, with a center at the correct bigmap pixel/line location or shape model lat/wlon location. The landmark, initially monikered 'a', is auto-renamed by lithos (option g) depending on its global lat/long region, for example 'EE0001'. The bigmap is referred to via a temporary file, named XXXXXX. The user must copy the current bigmap to MAPFILES/XXXXXX.MAP. The remainder of the .INN file comprises a copy of the lithos commands contained in make_scriptT.seed.

Example 001.INN file:

c
a
m
XXXXXX
   50.000000000000000        50.000000000000000     
0.00010,49                                                                      
g                                                                               
i                                                                               
etc ...

make_scriptT also generates the run script - run_script.b:

rm -f 001.OOT
/usr/local/bin/LITHOS < 001.INN > 001.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/001.pgm
cp tmpl.pgm ./TESTFILES1/001.pgm
rm -f 002.OOT
/usr/local/bin/LITHOS < 002.INN > 002.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/002.pgm
cp tmpl.pgm ./TESTFILES1/002.pgm
rm -f 003.OOT
/usr/local/bin/LITHOS < 003.INN > 003.OOT
cp LMRK_DISPLAY1.pgm ./TESTFILES/003.pgm
cp tmpl.pgm ./TESTFILES1/003.pgm
etc ...

Tile Bigmap with New Maplets

sh run_script.b

or in the background:

nohup sh run_script.b &

The lithos standard output for each image is captured in the .OOT files, and the LMRKDISPLAY1.pgm and tmpl.pgm files output by lithos are copied once a landmark has been processed, these are stored under the landmark's name in TESTFILES/ and TESTFILES1/ respectively.

Quality Check New Maplets

The user must review the .OOT files to ascertain the success of the tiling process, problem landmarks can be detected using the utility program find_nofitT, refer to the relevant guide for further details.

Clean Working Directory

rem_script.b can be used to clean out the directory of make_scriptT working files once tiling is complete and user has quality checked the resulting suite of maplets:

rm -f *.INN
rm -f *.OOT
rm -f run_script*

User Warnings

  • The user must copy the current bigmap to MAPFILES/XXXXXX.MAP, the temporary file which the run scripts refer to throughout.

CategoryPrograms

make_scriptT (last edited 2016-07-24 09:58:33 by BMittan)