Differences between revisions 1 and 13 (spanning 12 versions)

find_nofitP

Category B

Version 3.0

Description

This program searches batch processing output files to identify landmarks or images which may need further work.

find_nofitP is a useful utility for identifying landmarks which may require further work following the batch iteration task set up using make_scriptP.

Required Files

make_script.in - input file for batch processing using make_scriptP
<LMKNM>.OOT files - lithosP standard output listings

Output Files

redo.txt - list of landmarks that
- terminated in error
- do not correlate with at least one image, OR
- correlate weakly with at least one image.

Using find_nofitP

The batch process initiated by make_scriptP produces output file <LMKNM>.OOT that contains listings of the lithosP standard outputs for each input landmark. find_nofitP searches the <LMKNM>.OOT files for each landmark listed in make_script.in to identify landmarks which may need further work.

$/!\$ See find_nofit to identify the flags thrown by find_nofitP.

The command 'cat <LMKNM>.OOT' provides a listing of the output file for more complete diagnostics. find_nofitP also produces a redo.txt file that lists those landmarks that failed one of the first three tests.

The limit for weak correlation is set by the 'NOFIT=' keyword in INIT_LITHOS.TXT. The limit for weak correlation is fixed by the display from the CORRELATE subroutine in LITHOSP at either

0.43 (~3/7) if NOFIT>0.35, OR
0.28 (~2/7) otherwise

Here is an annotated sample output from find_nofitP:

! cat EE0004.OOT       <- process still running or terminated in error
  cat EE0005.OOT       <- low correlation for at least one overlap
. cat EE0006.OOT       <- no correlation for at least one overlap 
  cat EE0007.OOT 
* cat EE0008.OOT       <- maplets not correlating with at least one image 
* cat EE0009.OOT 
. cat EE0010.OOT 
* cat EE0011.OOT 
  cat EE0013.OOT 
  cat EE0017.OOT 
! cat EE0022.OOT

Here is an annotated sample redo.txt file from find_nofitP:

EE0004                <- process still running or terminated in error
* EE0008              <- maplets not correlating with at least one image
* EE0009
* EE0011
EE0022
END

Compiled by KD CategoryPrograms

-  ⇤ ← Revision 1 as of 2016-01-26 10:29:54 → 
  Size: 1672
  Editor: DianeLambert
  Comment:
+   ← Revision 13 as of 2016-06-06 13:08:48 → ⇥
  Size: 2414
  Editor: DianeLambert
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 3:
-Compiled by KD
+||Category B||Version 3.0||
 Line 5:
-At the end of each tiling or iteration, a form of find_nofit (T or P) is used to check for bad landmarks.
+== Description ==
 Line 7:
- * find_nofitT - this routine shows which maplets created during tiling that are faulty.
+This program searches batch processing output files to identify landmarks or images which may need further work.
 Line 9:
- * find_nofitP - this routine shows which maplet created during iteration that are faulty.
+'''find_nofitP''' is a useful utility for identifying landmarks which may require further work following the batch iteration task set up using [[make_scriptP]].
 Line 11:
-The routines listed above determine faulty maplets by going through every .OOT file in the working directory, which are produced at the end of tiling and iteration when run_script.sh or run.sh are used.
+== Required Files ==
 * [[make_script.in]] - input file for batch processing using [[make_scriptP]]
 * <LMKNM>.OOT files - [[lithosP]] standard output listings

== Output Files ==
 * [[redo.txt]] - list of landmarks that
  * terminated in error
  * do not correlate with at least one image, OR
  * correlate weakly with at least one image.
----------
== Using find_nofitP ==

The batch process initiated by [[make_scriptP]] produces output file <LMKNM>.OOT that contains listings of the [[lithosP]] standard outputs for each input landmark.  '''find_nofitP''' searches the <LMKNM>.OOT files for each landmark listed in [[make_script.in]] to identify landmarks which may need further work.  

 /!\ See [[find_nofit]] to identify the flags thrown by '''find_nofitP'''.
-Line 14:
+Line 28:
-=== Input ===
 * <3 digit number>.OOT files in the working directory
+The command 'cat <LMKNM>.OOT' provides a listing of the output file for more complete diagnostics.  '''find_nofitP''' also produces a [[redo.txt]] file that lists those landmarks that failed one of the first three tests.
-Line 17:
+Line 30:
-=== Output ===
 * ! - currently running (logfile isn't complete) or there was an error and the landmark was deleted
 * (blank space)  LMKNM - minor issue
 * * LMKNM - major issue (at least one image didn't correlate at all the with the map)
 * . LMKNM - minor issue (at least one maplet overlap error)
 * + LMKNM - moderate issue (at least one image had a correlation below the value set in init_lithos - usually .3 or .4)
+The limit for weak correlation is set by the 'NOFIT=' keyword in INIT_LITHOS.TXT. The limit for weak correlation is fixed by the display from the CORRELATE subroutine in LITHOSP at either 
 . 0.43 (~3/7) if NOFIT>0.35, OR
 . 0.28 (~2/7) otherwise
-Line 24:
+Line 34:
-== Example of Output ==
+Here is an annotated sample output from '''find_nofitP''':
-Line 26:
+Line 36:
-EQ0004:   cat 004.OOT 
EP0002:   cat 005.OOT 
EP0003:   cat 006.OOT 
EO0003:   cat 007.OOT 
EN0003: * cat 008.OOT 
EN0004: * cat 009.OOT 
EM0003: . cat 010.OOT 
EM0004: * cat 011.OOT 
132 deleted
   !  cat 132.OOTThe
+! cat EE0004.OOT       <- process still running or terminated in error
  cat EE0005.OOT       <- low correlation for at least one overlap
. cat EE0006.OOT       <- no correlation for at least one overlap 
  cat EE0007.OOT 
* cat EE0008.OOT       <- maplets not correlating with at least one image 
* cat EE0009.OOT 
. cat EE0010.OOT 
* cat EE0011.OOT 
  cat EE0013.OOT 
  cat EE0017.OOT 
! cat EE0022.OOT
-Line 38:
+Line 49:
+Here is an annotated sample [[redo.txt]] file from '''find_nofitP''':
{{{
EE0004                <- process still running or terminated in error
* EE0008              <- maplets not correlating with at least one image
* EE0009
* EE0011
EE0022
END
}}}
-Line 39:
+Line 59:
-== John's notes ==
!ZN0205 cat 023.OOT  process still running (okay) or process didn’t finish normally (bummer).

ZN0205 cat 023.OOT no correlation in at least one maplet overlap.  Probably no big deal.

* ZN0205 cat 023.OOT small or no correlation in at least one maplet-image overlap.  Should be checked by hand in LITHOS.

----
+----------
''Compiled by KD''