WIKI for Bob Gaskell's StereoPC

General Info

This is an attempt to document of some of the key programs and support files for Stereo Photoclinometry. I've been taking pretty good notes, and I thought we could all share and benefit from what we each have learned. If you figure something out (or get help from Bob himself), be sure to post it. If you need help with the wiki, let me know (or just send me the info).

• General_Parameters - Resolution scale, etc.

• Questions_to_ask - When I talk to Bob, these are things I am wondering

• Table_of_Contents_For_User's_Manual - We will come up with a table of contents for OSIRIS SPC. Here is where I will be putting my notes. Other's with suggestions are welcome. User Manual Author's Task List

• Training_Notes - Eric's notes for what to introduce and how

• SPC_V_and_V_testing - Directions and guideline for testing

• SPOC v3.02A PDF

• SPOC v3.02A html directory

• Error_evaluation - How to evaluate things for error and consistancy

Versions

• 1.0 -- Initial version of SPC
• 2.0 -- Version of SPC with the Common library created

• 2.1A7 -- This is the baseline version of Gaskell's software. I has gone under SubComponent testing

• 3.0A0 -- These have changed required in SPC to finish the SubComponent testing. It changed regress, process_fits and geometry

• 3.0A1 -- Released by Bob in support of Dawn @ Ceres
• 3.0A1a -- Minor changes
• 3.0A2 -- In development. Includes miscellaneous changes.
• 3.1 -- (in progress) Will have all code improvements from Rosetta. Will receive regression testing.
• 3.2 -- (in progress) Will include polar wobble.

Work Flow

Procedures for Bennu

• Bennu_Initial_Setup

• Bennu_PROCESS_FITS

• Bennu_make_sumfiles

• Bennu_REGISTER

• Bennu_LatLonTiling

Building Landmarks

• Making_new_landmarks - Workflow from the 50m resolution work done for Dawn at Vesta

• Basic_tiling - The core procedures for tiling a bigmap

  • Basic Tiling - Achieving the Desired Maplet Overlap - The bigmap.in file parameters to achieved the desired maplet overlap percentage.

• LatLon_tiling - Tiling using Lat/Lon. Used for the initial sets of landmarks

• Export_Import - Build landmarks on other machines and export them and import them

Test Procedure

• Standard_iteration - Runs lithosP

• Adding new images - How to run autoregister

• Building a shape model - How to run densify

Problems

• Fill_procedure -- Replace current topography with shape or bigmap. Fixes problems

• Fixing_problem_landmarks -- Techniques to deal with landmarks that don't work well

  • When to Fix Landmarks - When?

  • Basic Procedure -- Simple way to fix landmarks using lithos that usually works.

  • Aligning to a Single Image -- What to do if initial image alignment shows no to very miniscule correlation.

  • Manually Moving An Image -- What to do when some images (that you want/need to use for building template) won't auto correlate.

  • Poor topography -- What to do when the topography is too poor for any alignment.

• LITHOSP crashes -- How to recover without starting over

• Obsolete Small_Footprint_Processing - Lets you do tiling copying only the files that you need for the specific task.

Scripts - from AAA.TXT

• Vesta_Notes

• Startup

• LAT/LON_Shape

• Triaxial_Shape

• Batches

• Autoregister

• Parallel_Autoregister

• Parallel_Batch

• Batch Tiling: See make_scriptT.txt

• Geometry_and_Residuals

• Pole

• Export

• Import

• Export,_External_Iteration

• Import,_External_Iteration

• Gravity

• Fill - Take topography from a bigmap and replace a landmark's terrain with it.

Fun Tools

• Support Tools - useful tools that aid the SPC process

• updateDisplay - aid for landmark/maplet visualization

Programs

Lithos

• lithos - aligns maplets to the current shape model and will provide slight changes to the shape (stored in MAPFILES)

• lithosP - A version of lithos intended to be used in batch processing (i.e. run in parallel)

• geometry - figures out a surface based on landmarks

• residuals.e - figures out a surface based on landmarks

• register - aligns a new image with a reference, manually

• autoregister - adds groups of landmarks to an image

• autoregisterP - adds groups of landmarks to an image using parallel processing

• blemishes - masks regions of an image which contain blemishes due to, for example, downlink errors, bad pixels, or a cosmic ray hit.

• convert

• make_sumfiles

• dynamics

Imager

• map_coverage.e - shows the coverage that has been processed by resolution

• coverage.e - shows the global coverage that has been processed by resolution

• image_map_mono.e -

• image_map_rgb.e - Renders a 3D image of a bigmap using red and blue

• image_map_stereo.e -

• view_shape.e - The generates a point-of-view image of the shape model

• panaroma.e - Makes a 360 degree panaroma image from a big map

• surface_imager.e - Makes an image using a surface point of view from a big map

• display.e - Appears to generate an image that shows the location of landmarks on it

• mosaic - Creates a mosaic of images registered to the shape model

• Imager_MG - How to make images from maplets

Shaper

• bigmap - processes maplets to form a bigmap

• spheremapB.e - This reads the Zmap files and makes the resulting map line by line.

• update_infiles.e - generates a list of landmarks and headers for showing coverage

• shape_info - generates DTM information

Utilities

• duplicates - Generates the make_script.in file to accompany make_scriptP, comprising an ordered list of unique landmark names.

• find_nofit - searches batch processing output files to identify landmarks or images which may need further work.

• export.e - builds scripts to package up the new maplets/landmarks into a tar ball

• importL.e - builds script to unpack maplets/landmarks and integrate into a master directory

• make_lmrklistX - generates LMRKLISTX

• make_scriptA - generates the script that batch auto registers images using autoregister

• make_scriptAP - generates the script for batch autoregistering images using parallel processing using autoregisterP

• make_scriptF - generic script maker for user-generated batch processing jobs.

• make_scriptP - generates the script for iterating landmarks using lithosP

• make_scriptR - generates the script that batch registers images using register

• make_scriptT - generates the script that tiles (makes new maplets) using lithos

• refresh_sumfiles.e - updates the sumfiles to match the maplets

• showmap.e - generates an image (.pgm) for a specific bigmap

• pr_template - (copy the codes for when making a new prog page)

• make_pictlistX - Builds the file PICTLISTX.TXT which makes things run faster

• process_img - Takes a list of files and creates make_sumfiles.in. Creates IMAGEFILE for each images

• make_sumfiles - Computes the SUMFILE and NOMINALS

• make_tilefile - Generates the pixel/line maplet-center locations required to complete the tiling of a bigmap.

Gravity

Notes_on_Gravity

• Mgrav.e - Makes MGRAV.TXT and generates gravity images based on a map or bigmap.

• Sgrav.e - Makes a file called SGRAV.TXT that is like SHAPE.TXT but with extra columns for surface acceleration, potential and laplacian (just as a check). Based on a shape model. This is for a non-rotating body with GM=1.

• Sacc.e - Provided the correct GM and Omega, it will use SGRAV.TXT file to create the surface acceleration.

• Selv.e - Provided the correct GM and Omega, it will use SGRAV.TXT file to create the surface elevation (same as geoid).

• Slap - Provided the correct GM and Omega, it will use SGRAV.TXT file to create the surface laplacian.

• Spot.e - Provided the correct GM and Omega, it will use SGRAV.TXT file to create the surface potential.

• Sslpa.e - ?

Directories

• BIGFILES - Directory for BIGMAP LMK files

• DATA - A place for the SPICE kernels

• IMAGEFILES - Directory that holds the image files, .DAT

• LMKFILES - Stores the actual landmarkts, .LMK

• MAPFILES - Stores the maplets, .MAP

• NEW_IMAGES - Directory that holds the new, and unprocessed image files (in pgm format)

• NOMINALS - Directory that holds the sum files, .NOM

• SHAPEFILES - Holds the different types of shapefiles

• SUMFILES - Directory that holds the sum files, .SUM

• TESTFILES - Directory to store display files generated during batch processing jobs.

• TESTFILES1 - Directory to store display files generated during batch processing jobs.

• UTILITIES - Programs that are specific for this project

Key Input Files

• LMRKLIST.TXT - The full list of landmarks

• LMRKLIST1.TXT

• LMRKLISTR.TXT

• LMRKLISTO.TXT

• LMRKLISTX.TXT

• PICTLIST.TXT - List of the images that are in the system

• PICTLISTX.TXT - List of the images that are in the system with precomputed metadata.

• BIGLIST.TXT - List of mapfiles (bigmaps) used to make a new bigmap. Generated from bigmap.e

• NEWFILES.TXT

• OVERLAPS.TXT

• SGRAV.TXT - produced from Sgrav.e. Similar to SHAPE.TXT with extra columns for surface acceleration, potential and laplacian (just as a check).

• MGRAV.TXT - produced by Mgrav.e. It contains vector position, potential, acceleration, slope and delta elevation.

• SHAPE.TXT - The shape model of the object. Done is 3 column format of vertex using x, y, z coordinates

• GEOID.TXT - gives the geoid in X, Y, Z position. A 3 column file.

• SHAPEC.TXT - gives the height above the surface. A 4 column file.

• MOSAIC.TXT - A list of images that mosaic uses to build a moasic

• make_sumfiles.in - List of new images to process

• make_sumfiles.txt - SPICE references

• IFRAME.TXT - Converts to J2000

• INIT_LITHOS.TXT

• SEEDS

• SEEDS (by mission)

Output Files

• check.txt - List of landmarks and overlaps output by residuals for landmarks whose residual standard deviation is greater than the user-specified limit.

• EMPTY.TXT - lithos seed file output by residuals for batch deletion of landmarks which are not contained in any pictures or limbs.

• FLATLIST.TXT - List of flat maps (landmarks containing no topography) output by residuals.

• LIMINFO.TXT - Limb information output by residuals.

• LMKVECS.TXT - Landmark vectors output by residuals for every landmark contained in LMRKLIST.TXT.

• MAPCHK.TXT - List of maplets whose difference between predicted and observed pixel/line locations in attached images is greater than a user-specified limit, or who have two or fewer overlaps attached to them, output by residuals.

• MAPRES.TXT - Maplet resolution information for maplets contained in at least one picture or limb, output by residuals.

• New_Limbs.in - lithos seed file output by residuals to attach map to limbs for every landmark contained in LMRKLIST.TXT.

• NEW_LIST.TXT - List output by find_nofitT of new landmarks created during batch make_scriptT tiling.

• no_update.txt - List of landmarks output by residuals whose associated pictures are not listed by increasing mission time in the .LMK file.

• PRUNE.TXT - List of landmarks for which the number of pictures in which they are contained exceeds the default limit of 500, or the user-specified limit, PRNLM, set within INIT_LITHOS.TXT. File output by residuals.

• RANGES_SOLVED.TXT - Date and range information output by residuals for each picture listed in PICTLISTS.TXT or PICTLIST.TXT.

• redo.txt - List of landmarks output by find_nofit or find-nofitP which after batch lithos or lithosP processing either terminated in error, did not correlate with at least one image, or correlated weakly with at least one image.

• REMOVED.TXT - List of landmarks output by find_nofit which after batch register, autoregister, or autoregisterP processing were eliminated from at least one picture due to low or no correlation.

• veto.txt - lithos seed file output by residuals to detach from landmarks and limbs a map with a residual standard deviation greater than the user-specified limit.

Key Diagnostic Files

• RESIDUALS.TXT - Errors within the map and images

• INSIDE.TXT - Only the maps that are inside of the most recent bigmap created

• USED_MAPS.TXT - All maps used when making a bigmap

• USED_PICS.TXT - All images used when making a bigmap

• PICINFO.TXT - List all the images and parameters about them

Support Files

• Usually these files are used to run batch jobs or scripts.

• make_script.in - Used by various script-makers for batch jobs.

• make_scriptA.seed - Seed file for make_scriptA, the script-maker for batch autoregistering new images.

• make_scriptF.in? seed? -

• make_scriptP.seed - Seed file for make_scriptP, the script-maker for iterating landmarks using lithosP.

• make_scriptR.seed - Seed file for make_scriptR, the script-maker for batch registering new images.

• make_scriptT.in - Used by make_scriptT to build run_script.b

• MAPTRANS - Diagnostic tools to visualize maplet translations.

SPC Lessons

• Lesson 1

  • Gain familiarity with file structure

  • Process new images to use in solution (convert/PROCESS_IMG)

  • display.e an image for context

  • Make SUMFILES and NOMINALS (make_sumfiles)

  • Run dynamics

  • register a couple images

• Lesson 2

  • Generate a maplet with specific parameters
  • Then tile maplet with overlapping better resolution maplets

• Lesson 3

  • Process more images and tile a maplet (3-4 hours)

• Lesson 4

  • AUTOREGISTER, Create Bigmap from 0.4 pm/px maps, set up batch run tiling

Papers and Presentations

• LPSC 20??

Deprecated

• view_maps.in - A list of all the maplets to be used in view_maps.e. The first line isn't read. The file should be terminated with "END"

• view_maps.e - This will do "paper mache" of all the maplets listed in view_maps.in.

Help

Contact me with questions. Email: <epalmer AT SPAMFREE psi DOT edu>

Links to wiki formatting and help https://moinmo.in/HelpOnMoinWikiSyntax

• Test_Files - I'm going to store the scripts here for the testing proceedures

CategoryHomepage