Differences between revisions 10 and 11
Revision 10 as of 2016-07-20 10:06:03
Size: 2833
Editor: DianeLambert
Comment:
Revision 11 as of 2016-07-21 13:56:36
Size: 2867
Editor: EricPalmer
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
Describe Error_evaluation here. == Links ==

 * [[Processing States]] -- What are the states that a shape model goes through as it gets perfected.
Line 4: Line 6:
[[Processing States]] -- What are the states that a shape model goes through as it gets perfected.  * [[Eval-point-cloud]] -- Using a point cloud for CompareOBJ rather than a full OBJ

 * [[Normalized Cross-Correlation Evaluation]] -- Normalized cross-correlation of images of the model and images of truth.
Line 7: Line 11:
[[Eval-point-cloud]] -- Using a point cloud for CompareOBJ rather than a full OBJ

[[Normalized Cross-Correlation Evaluation]] -- Normalized cross-correlation of images of the model and images of truth.
== Tools ==
Line 35: Line 37:
== Example (old) ==
Line 53: Line 57:
General info about error -- as I try to figure out what is best to use == General notes about error -- as I try to figure out what is best to use ==

Tools

Here are a list of error evaluation tools and ideas

  • formal uncertainty -- standard, bottom of the RESIDUALS.TXT. Contains the fit of all the landmarks and overlaps.
  • Best 80% of landmarks. Taken from ?
  • CompareOBJ
  • CompareOBJ TR
  • CompareOBJ --save-plate-error error
  • diffShape and gnuplot delta.gpi
  • SIGMAS.TXT plotted with sig.gpi
  • 2D heat map plot of number of images in landmarks
  • 2D heat map plot of residual errors for landmark
  • 2D heat map plot of residual errors for images
  • Evaluation of delta between truth S/C position and solved for S/C position: as an RMS
  • 2D plot of delta between truth S/C position and solved for S/C position.
  • Number of "issues" (or >>) in MAPINFO, PICINFO and RESIDUALS.TXT

To Do

  • Rebuild shape 3.7
  • Get RMS for each ZMAP
  • Run PreSurvey CompareOBJ

--

Example (old)

  • formal uncertanity 0.5179
  • RMS 1.447
  • RMS w/ TR 1.046
  • DiffShape 1.771

  • Diff shape delta-P10.png

  • Sigmas sigma-P10.png

  • Resolution of maplets MapResP10.jpg

  • Number of images in a maplet imgNo1.jpg imgNo2.jpg

  • MAPINFO's residuals (col 9) for each maplet mapErr.jpg

--


General notes about error -- as I try to figure out what is best to use

RESIDUALS

  • img x, y val val
  • overlap x, y val val
  • img x, y val val
    • The 1st column is a list of 1. IMAGEFILES included in the landmark 2. overlaps with other landmarks 3. Limbs
    • The 2nd column is the error in deltaX (# pixels in image resolution)
    • The 3rd column is the error in deltaY (# pixels in image resolution)
    • The 4th column is the magnitude of the error (combines deltaX and deltaY)
    • The 5th column is the error in physical units (km)
  • .........................
  • name val
    • (Bottom)
      • Meter resolution, difference between predicted and actual
    • (Very bottom)
      • Observations how many things RMS Residual (m) (vector residual)


MAPINFO.TXT name ........ val val

  • col 9 formal uncertainty in meters of the landmark position
  • col 10 Flag
  • ">>" Flag showing landmarks that are below the pixel threshold. You might want to look at.

  • "**" Fewer than 3 images
  • col 11 Residual in meters of the nominals and position


PICINFO.TXT name ....... val dx, dy, dz dCx, dCy, dCz

  • Col 7 - Pixel residual (RMS in pixels)

Error_evaluation (last edited 2016-07-21 13:56:36 by EricPalmer)