== Links == * [[Processing States]] -- What are the states that a shape model goes through as it gets perfected. * [[Eval-point-cloud]] -- Using a point cloud for CompareOBJ rather than a full OBJ * [[Normalized Cross-Correlation Evaluation]] -- Normalized cross-correlation of images of the model and images of truth. == Tools == Here are a list of error evaluation tools and ideas * formal uncertainty -- standard, bottom of the RESIDUALS.TXT. Contains the fit of all the landmarks and overlaps. * Best 80% of landmarks. Taken from ? * CompareOBJ * CompareOBJ TR * CompareOBJ --save-plate-error error * diffShape and gnuplot delta.gpi * SIGMAS.TXT plotted with sig.gpi * 2D heat map plot of number of images in landmarks * 2D heat map plot of residual errors for landmark * 2D heat map plot of residual errors for images * Evaluation of delta between truth S/C position and solved for S/C position: as an RMS * 2D plot of delta between truth S/C position and solved for S/C position. * Number of "issues" (or >>) in MAPINFO, PICINFO and RESIDUALS.TXT == To Do == * Rebuild shape 3.7 * Get RMS for each ZMAP * Run PreSurvey CompareOBJ -- == Example (old) == * formal uncertanity 0.5179 * RMS 1.447 * RMS w/ TR 1.046 * DiffShape 1.771 * Diff shape {{attachment:delta-P10.png}} * Sigmas {{attachment:sigma-P10.png}} * Resolution of maplets {{attachment:MapResP10.jpg}} * Number of images in a maplet {{attachment:imgNo1.jpg}} {{attachment:imgNo2.jpg}} * MAPINFO's residuals (col 9) for each maplet {{attachment:mapErr.jpg}} -- ---- == General notes about error -- as I try to figure out what is best to use == RESIDUALS . img x, y val val . overlap x, y val val . img x, y val val . The 1st column is a list of 1. IMAGEFILES included in the landmark 2. overlaps with other landmarks 3. Limbs . The 2nd column is the error in deltaX (# pixels in image resolution) . The 3rd column is the error in deltaY (# pixels in image resolution) . The 4th column is the magnitude of the error (combines deltaX and deltaY) . The 5th column is the error in physical units (km) . ......................... . name val . (Bottom) . Meter resolution, difference between predicted and actual . (Very bottom) . Observations how many things RMS Residual (m) (vector residual) ---- MAPINFO.TXT name ........ val val . col 9 formal uncertainty in meters of the landmark position . col 10 Flag . ">>" Flag showing landmarks that are below the pixel threshold. You might want to look at. . "**" Fewer than 3 images . col 11 Residual in meters of the nominals and position ---- PICINFO.TXT name ....... val dx, dy, dz dCx, dCy, dCz . Col 7 - Pixel residual (RMS in pixels)