Differences between revisions 2 and 3
Revision 2 as of 2019-09-26 13:30:00
Size: 2797
Editor: EricPalmer
Comment:
Revision 3 as of 2019-10-03 12:44:39
Size: 2837
Editor: EricPalmer
Comment:
Deletions are marked like this. Additions are marked like this.
Line 41: Line 41:

logP=log/$ID$Res
mkdir -p $logP
Line 84: Line 87:
nftBlockFinish $ID nftBlockFinish nft.$ID

Iterate

Loop as required. Do nftBlockFinish when done with iterations.

Log the following. localLoop.sh will handle this

  • sigma after each iteration
  • nofit "no correlation" flags
    • Stop on a real flag and email
  • Number of nofits
  • corrEval results

Batch Run

Check the following

  • Daemon is running
  • Terminate is unset (if you want more than one)
  • localLoop.sh is set (map=<ID><Res>)

  • interationCount is a useful number. Whatever number is set in "iterationCount" when monitor is start will be increment and used as the $id variable in localLoop.sh. Thus, it is useful to set it to something new if you are doing a different suite of iterations.

For the first 2 full iterations (i.e. over ALL maplets), make sure there are no images with a correlation <0.1 before starting a full iteration. If there are images that are getting a correlation <0.1 even after several iterations, delete if emission angle is >50, illumination coverage (after x-0.025) < 0.5, or phase less than 8 or 9. They are weak images and will not contribute much anyway.

After you have done 2 full iterations, clean according to the criteria for a correlation <0.1, but apply it to correlations <0.3. Again, if after many iterations they still are <0.3, they are not strong anyway.

The final check for an MLN is to use bigEval.sh <Feature Name>A

  • If the resulting bigmap has SigmaScore >2, you are done. Make sure you've run at least 2 full iterations (all maplets) to make sure everything has stabilized.

  • More iterations may help (stop if the avg sigmaScore is going down) or you may need more images, a fill, or some other technique.

Note: Consider changing USRMX to something other than 12. If there are < 24 landmarks, then using N as user max will be faster. While each process takes longer to run, it is faster than doing two maplets in succession.

ROI Iterate

ID=RDL09
Res=5

logP=log/$ID$Res
mkdir -p $logP

bigmap < nftConfig/nftBigmap-$ID-$Res.in

Be sure you have made the bigmap before pasting below

echo map=$ID$Res > config/nftID
echo "Getting read for iteration $ID-$Res" >> notes
date >> notes
echo $ID$Res | tee -a notes
echo ${ID}$Res > tmpRun
cat nftConfig/nftBigmap-${ID}-$Res.in >> tmpRun
cat tmpRun >> notes
bigMapRef < tmpRun
tail -2 SIGMAS.TXT | head -1 | tee -a notes
echo y | cp -v USED_MAPS.TXT LIST.TXT
duplicates

relink.sh scripts/Piterate1St.seed make_scriptP.seed | tee -a notes
ls -l make_scriptP.seed >> notes
MAKE_LMRKLISTX 


make_scriptP | tee run.sh
echo "Running iteration at " `date` >> notes
sh run.sh
monitor

bigMapRef < tmpRun
echo "Post run Sigma" >> notes
tail -2 SIGMAS.TXT | head -1 | tee -a notes

nftBlockFinish nft.$ID

NFT-3-iterate (last edited 2020-06-09 07:40:15 by JohnWeirich)