Differences between revisions 5 and 24 (spanning 19 versions)

Running for version 3.0A3 -- waiting for 3.0B3. I'm using this to track the status of the regression for each of the modules. Some links are not current (they are old and should be removed). The status will be documented TBD.

3.1 General Differences

CSPLOT.TXT and CSPLOT.ppm - Polar plots showing the position of the images for a specific maplet. New feature autogenerated by LITHOS. Present in most LITHOS outputs and do not constitute a deviation.
The default reflectance model changed from the old standard without a factor of (McEwen Abstract) to the published modified Lom/Seg (McEwen Paper). To deal with this, I had to set the MCEWEN variable in INIT_LITHOS.TXT. It is in the root directory and replace after sync and right before running the script.
fullRun.log. when running lithos, we get an extra menu option
1. Normal from larger map
TMPLIST.TXT is created with LITHOS. It is not essential.
Clean from prior -- This term is defined for tests that are sequential. Some tests require a specific order. Because the previous test failed, the normal running on this test will (by design) also fail. If that is the case, I reran the test, but using the state from the previously successful test (output-*.* copied over). Then I ran the test again and report it's results. This allows us to see if the module works correctly itself, and not a reflection of a sequence of tests.
ImageMagick version was changed. It is generating bit-level differences in some non-image portion of the image. The current and previous images (when subtracted) are the same, but a binary diff shows some trivial difference. The source files are identical.

- Test_Procedures

Modules

Bennu specific Setup

- 1.1 res_process_img

Deprecated

- 1.2 PolyCam process_fits

Deprecated

- 1.3 NavCam process_fits

Deprecated

Dawn

Dawn-base

- Bring in images and update

7.1 res_make_sumfiles
7.2 res_make_pictlistX

- 7.3 res_pole (Long lunch, large change)

Dawn-partial

2.3 Register	res_register	Clean/ImgMag
2.4 Dynamics (large output)	res_dynamics	Clean
2.6 Coverage_p (get lunch)	res_dynamics	Clean/ImgMag
2.11 Blemishes	res_blemishes	Clean

- Autoregister sequence

2.7 Autoregister	res_autoregister	Clean
2.5 Make_list	res_make_list	Clean

- Batch autoregister sequence

2.8 Make_scriptA prep	res_make_scriptA	Clean
2.12 Make_scriptA run	res_do_make_scriptA	Clean

- Batch parallel autoregister

2.9 Make_scriptAP prep	res_make_scriptAP	Clean
2.13 Make_scriptAP run	res_do_make_scriptAP	Clean

- Batch Register

2.10 Make_scriptR prep	res_make_scriptR	Clean
2.14 Make_scriptR run (Data do not support batch mode)	res_make_scriptR	N/A

Dawn-image

This state has several LAMO images ingested into the system. There are no new landmarks. The shape model is well defined and stable. There are no specific bigmaps for the test region.

3.1 Lithos Create	res_lithos_create	Clean
3.2 Bigmap	res_bigmap	Clean/ImgMag
3.3 Showmap	res_showmap	Clean/ImgMag
3.4 SpheremapB (Get some coffee)	res_spheremapB -	Clean/ImgMag
3.5 Display	res_display	Clean/ImgMag
3.6 Make_tilefile	res_make_tilefile	Clean/ImgMag
3.10 Lithos tuck	res_lithos_tuck	Clean
3.11 BigmapL	res_bigmapL	Clean/ImgMag
3.12 Make_tiles	res_maketiles	Clean
3.13 Make_tilesP	res_maketilesP	Clean

Dawn-land

This state has a single landmark defined, TEST01. It is in the center of our testing region, based to show details of the pits within Marcia crater. It has HAMO and LAMO images already connected to the landmark and aligned. No overlaps or updated topography. Heights are from an existing bigmap.

Notes: lithos update is done for most lithos commands. It will not be explicitly tested because saving the data is required for most of the tests.

4.1 Lithos Delete	res_lithos_delete	Clean
4.2 Lithos Find Images	res_lithos_find_images	Clean
4.3 Lithos Change Resolution	res_lithos_change_resolution	Clean
4.4 Lithos Build Template	res_lithos_build_template	Clean/Img
4.7 Lithos Exclude By Correlation	res_lithos_exclude_by_correlation	Clean
4.8 Lithos Exclude Automatically	res_lithos_exclude_automatically	Clean
4.9 Lithos Manual Exclude	res_lithos_manual_exclude	Clean
4.10 Lithos No Exclude	res_lithos_no_exclude	Clean
4.11 Lithos Heights From Map	res_lithos_heights_from_map	Clean
4.12 Lithos Heights From Shape	res_lithos_heights_from_shape	Clean
4.13 Lithos Normal From Height	res_lithos_normal_from_height	Clean
4.14 Lithos Normal From Shape	res_lithos_normal_from_shape	Clean
4.16 Map Coverage	res_map_coverage	Clean/ImgMag)
4.17 Lithos Overlaps	res_lithos_overlaps	Clean
4.18 Lithos Build Terrain	res_lithos_build_terrain	Clean
4.19 Lithos Complex Overlap	res_lithos_complex_overlap	Clean

- Shift - These are paired in sequence

4.5 Lithos Manually Shift	res_lithos_manually_shift	Clean
4.6 Lithos Auto Correlate	res_lithos_auto_correlate	Clean
4.* Lithos Compute SCOBJ "V1"

Dawn-land360

This contains 361 maplets that tiles REFMAP. It only has the processing done for doing the batch tiling procedures. The goal for this stage is developing mature topography.

5.1 Duplicates	res_duplicates	Clean
5.2 Make_lmrklistX	res_make_lmrklistx	Clean

- Do parallel processing - LONG (1/2 day)

5.3 Make_scriptP	res_make_scriptP	Clean
5.4 LITHOSP	res_lithosP	Significant
5.5 find_nofitP	res_find_nofitP	Unknown

- Work on export/import - LONG (1/2 day)

5.7 Export	res_export
5.8 Import	res_import	Significant
5.9 make_scriptF	res_make_scriptF	<Unk>
5.10 run_script from make_scriptF	run_make_scriptF	<Unk>
5.11 find_nofit	res_find_nofit	<Unk>

- Group for doing tiles - LONG (1/2 day)

5.12 make_scriptT	res_make_scriptT	Clean/ImgMag
5.13 run_script from make_scriptT	run_make_scriptT	Clean/ImgMag
5.14 find_nofitT	res_find_nofitT	Clean/ImgMag

Dawn-Topo

This contains a full suite of tiles for REFMAP (360 maplets). It has been well processed and has fully developed topography.

- Making shape files

6.2 Dumber (yes, do this one first)	res_dumber	Clean
6.1 Densify - (Get lunch)	res_densify	Clean
6.10 DensifyA - (Get lunch)	res_densifyA	Differ
6.9 Dumber with A	res_dumber_with_A	<Unk>
6.4 Geometry (large changes)	res_geometry	Differ
6.5 Residuals	res_residuals	Clean
6.7 Shape_info	res_shape_info	Clean

== Other

6.6 Regres

res_regres

-  ⇤ ← Revision 5 as of 2016-12-14 12:29:23 → 
  Size: 5008
  Editor: EricPalmer
  Comment:
+   ← Revision 24 as of 2017-04-27 10:59:31 → ⇥
  Size: 7567
  Editor: EricPalmer
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-Dec 2016.  I'm using this to track the status of the regression for each of the modules.  Some links are not current (they are old and should be removed).  The status will be documented TBD.
+Running for version 3.0A3 -- waiting for 3.0B3.  I'm using this to track the status of the regression for each of the modules.  Some links are not current (they are old and should be removed).  The status will be documented TBD.
 Line 7:
-== General Differences ==
+== 3.1 General Differences ==
 Line 9:
-- CSPLOT.TXT and CSPLOT.ppm - Polar plots showing the position of the images for a specific maplet.  New feature autogenerated by [[LITHOS]].  Present in most LITHOS outputs and do not constitute a deviation.
- LMRK_DISPLAY0 and LMRK_DISPLAY1 are different.  It seems that the "build templates" generates a slightly different brightness for shadowed (or low sun angle) areas.  I am unsure if this is a problem or not.
+ * CSPLOT.TXT and CSPLOT.ppm - Polar plots showing the position of the images for a specific maplet.  New feature autogenerated by [[LITHOS]].  Present in most LITHOS outputs and do not constitute a deviation.
 * The default reflectance model changed from the old standard without a factor of (McEwen Abstract) to the published modified Lom/Seg (McEwen Paper).  To deal with this, I had to set the MCEWEN variable in INIT_LITHOS.TXT.  It is in the root directory and replace after sync and right before running the script.

 * fullRun.log.  when running lithos, we get an extra menu option
     5. Normal from larger map

 * TMPLIST.TXT is created with LITHOS.  It is not essential.

 * Clean from prior -- This term is defined for tests that are sequential.  Some tests require a specific order.  Because the previous test failed, the normal running on this test will (by design) also fail.  If that is the case, I reran the test, but using the state from the previously successful test (output-*.* copied over).  Then I ran the test again and report it's results.  This allows us to see if the module works correctly itself, and not a reflection of a sequence of tests.

 * ImageMagick version was changed.  It is generating bit-level differences in some non-image portion of the image.  The current and previous images (when subtracted) are the same, but a binary diff shows some trivial difference.  The source files are identical.
-Line 21:
+Line 30:
-  Must be Bennu specific.  Need MapCam, NavCam and PolyCam
+ Deprecated
-Line 24:
+Line 33:
+ Deprecated
-Line 26:
+Line 36:
+ Deprecated
-Line 43:
+Line 55:
-- 2.3 [[res_register]]

- 2.4 [[res_dynamics]] (large output)

- 2.6 [[res_coverage_p]] - (get lunch)
+|| 2.3 Register ||[[res_register]]  || Clean/ImgMag ||
|| 2.4 Dynamics  (large output) || [[res_dynamics]] || Clean ||
|| 2.6 Coverage_p (get lunch) || [[res_dynamics]] ||  Clean/ImgMag ||
|| 2.11 Blemishes || [[res_blemishes]] || Clean ||
-Line 51:
+Line 61:
- * 2.7 [[res_autoregister]] 
 * 2.5 [[res_make_list]]
+|| 2.7 Autoregister || [[res_autoregister]] || Clean ||
|| 2.5 Make_list || [[res_make_list]] || Clean ||
-Line 55:
+Line 67:
- * 2.8 [[res_make_scriptA]] 
 * 2.12 [[res_make_scriptA]]
+|| 2.8 Make_scriptA prep || [[res_make_scriptA]]  || Clean ||
|| 2.12 Make_scriptA run || [[res_do_make_scriptA]] || Clean ||
-Line 59:
+Line 71:
- * 2.9 [[res_make_scriptAP]]
 * 2.13 [[res_make_scriptAP]]
+|| 2.9 Make_scriptAP prep || [[res_make_scriptAP]] || Clean ||
|| 2.13 Make_scriptAP run || [[res_do_make_scriptAP]] || Clean ||
-Line 63:
+Line 76:
- * 2.10 [[res_make_scriptR]]
 * 2.14 [[res_make_scriptR]]  (Data do not support batch mode)
+|| 2.10 Make_scriptR prep || [[res_make_scriptR]] || Clean ||
|| 2.14 Make_scriptR run (Data do not support batch mode) || [[res_make_scriptR]] || N/A ||
-Line 66:
+Line 79:
-- 2.11 [[res_blemishes]]
-Line 72:
+Line 84:
-- 3.1 [[res_lithos_create]]

- 3.2 [[res_bigmap]] 
 
- 3.3 [[res_showmap]]

- 3.4 [[res_spheremapB]] - (Get some coffee)

- 3.5 [[res_display]]

- 3.6 [[res_make_tilefile]]

- 3.10 [[res_lithos_tuck]]

- 3.11 [[res_bigmapL]]

- 3.12 [[res_maketiles]]

- 3.13 [[res_maketilesP]]
+|| 3.1 Lithos Create || [[res_lithos_create]] || Clean ||
|| 3.2 Bigmap || [[res_bigmap]] || Clean/ImgMag ||
|| 3.3 Showmap || [[res_showmap]] || Clean/ImgMag ||
|| 3.4 SpheremapB (Get some coffee) || [[res_spheremapB]] -  || Clean/ImgMag ||
|| 3.5 Display || [[res_display]] || Clean/ImgMag ||
|| 3.6 Make_tilefile || [[res_make_tilefile]] || Clean/ImgMag ||
|| 3.10 Lithos tuck || [[res_lithos_tuck]] || Clean ||
|| 3.11 BigmapL || [[res_bigmapL]] || Clean/ImgMag ||
|| 3.12 Make_tiles || [[res_maketiles]] || Clean ||
|| 3.13 Make_tilesP || [[res_maketilesP]] || Clean ||
-Line 101:
+Line 104:
-- 4.1 [[res_lithos_delete]] - Clean
+|| 4.1 Lithos Delete || [[res_lithos_delete]]  || Clean ||
|| 4.2 Lithos Find Images || [[res_lithos_find_images]]  || Clean ||
|| 4.3 Lithos Change Resolution || [[res_lithos_change_resolution]]  || Clean ||
|| 4.4 Lithos Build Template || [[res_lithos_build_template]]  || Clean/Img ||
|| 4.7 Lithos Exclude By Correlation || [[res_lithos_exclude_by_correlation]]  || Clean ||
|| 4.8 Lithos Exclude Automatically || [[res_lithos_exclude_automatically]]  || Clean ||
|| 4.9 Lithos Manual Exclude ||  [[res_lithos_manual_exclude]]  || Clean ||
|| 4.10 Lithos No Exclude || [[res_lithos_no_exclude]]  || Clean ||
|| 4.11 Lithos Heights From Map || [[res_lithos_heights_from_map]]  || Clean ||
|| 4.12 Lithos Heights From Shape || [[res_lithos_heights_from_shape]]  || Clean ||
|| 4.13 Lithos Normal From Height || [[res_lithos_normal_from_height]]  || Clean ||
|| 4.14 Lithos Normal From Shape || [[res_lithos_normal_from_shape]]  || Clean ||
|| 4.16 Map Coverage || [[res_map_coverage]]  || Clean/ImgMag) ||
|| 4.17 Lithos Overlaps || [[res_lithos_overlaps]]  || Clean ||
|| 4.18 Lithos Build Terrain || [[res_lithos_build_terrain]] || Clean ||
|| 4.19 Lithos Complex Overlap || [[res_lithos_complex_overlap]] || Clean ||
-Line 103:
+Line 121:
-- 4.2 [[res_lithos_find_images]] - Clean

- 4.3 [[res_lithos_change_resolution]] - Clean

- 4.4 [[res_lithos_build_template]] - Minor.  landmark.jpg has a slightly different shading in the shadows.
-Line 110:
+Line 123:
-  * 4.5 [[res_lithos_manually_shift]] - Clean
  * 4.6 [[res_lithos_auto_correlate]] - Minor.  Each image has a maplet position that is different by 1/100th of a pixel.

- 4.7 [[res_lithos_exclude_by_correlation]] - Minor.  Each image has a maplet position that is different by 1/100th of a pixel.

- 4.8 [[res_lithos_exclude_automatically]] - Clean

- 4.9 [[res_lithos_manual_exclude]] - Clean

- 4.10 [[res_lithos_no_exclude]] - Clean

- 4.11 [[res_lithos_heights_from_map]] - Clean

- 4.12 [[res_lithos_heights_from_shape]] - Clean

- 4.13 [[res_lithos_normal_from_height]] - Clean

- 4.14 [[res_lithos_normal_from_shape]] - Clean

- 4.16 [[res_map_coverage]] - Minor.  coverage_m was updated to deal with maps that are too far from the level (deal with multiple surfaces that shouldn't show)

- 4.17 [[res_lithos_overlaps]] - Clean

- 4.18 [[res_lithos_build_terrain]]

- 4.19 [[res_lithos_complex_overlap]]
+|| 4.5 Lithos Manually Shift || [[res_lithos_manually_shift]]  || Clean ||
|| 4.6 Lithos Auto Correlate || [[res_lithos_auto_correlate]]  || Clean ||
|| 4.* Lithos Compute SCOBJ "V1" ||   || ||
-Line 141:
+Line 131:
-- 5.1 [[res_duplicates]]

- 5.2 [[res_make_lmrklistx]]
+|| 5.1 Duplicates || [[res_duplicates]] || Clean ||
|| 5.2 Make_lmrklistX || [[res_make_lmrklistx]]   || Clean ||
-Line 147:
+Line 135:
- * 5.3 [[res_make_scriptP]]
 * 5.4 [[res_lithosP]] 
 * 5.5 [[res_find_nofitP]]
+|| 5.3 Make_scriptP || [[res_make_scriptP]]  || Clean ||
|| 5.4 LITHOSP || [[res_lithosP]]   || Significant ||
|| 5.5 find_nofitP  || [[res_find_nofitP]]  || Unknown ||
-Line 152:
+Line 140:
- * 5.7 [[res_export]]
 * 5.8 [[res_import]]
 * 5.9 [[res_make_scriptF]]
 * 5.10 [[res_make_scriptF]]
 * 5.11 [[res_find_nofit]]
+|| 5.7 Export || [[res_export]]  || ||
|| 5.8 Import || [[res_import]]  || Significant ||
|| 5.9 make_scriptF || [[res_make_scriptF]]  || <Unk> ||
|| 5.10 run_script from make_scriptF || [[run_make_scriptF]]  || <Unk> ||
|| 5.11 find_nofit || [[res_find_nofit]]  || <Unk> ||
-Line 159:
+Line 147:
-  * 5.12 (was 3.7) [[res_make_scriptT]] 
  * 5.13 (was 3.8) [[res_make_scriptT]]
  * 5.14 (was 3.9) [[res_find_nofitT]]
+|| 5.12 make_scriptT || [[res_make_scriptT]]   || Clean/ImgMag ||
|| 5.13 run_script from make_scriptT ||  [[run_make_scriptT]]  || Clean/ImgMag ||
|| 5.14 find_nofitT || [[res_find_nofitT]]  || Clean/ImgMag ||
-Line 169:
+Line 157:
- * 6.2 [[res_dumber]]  (yes, do this one first) 
 * 6.1 [[res_densify]] - (Get lunch)
 * 6.10 [[res_densifyA]] - (Get lunch)
 * 6.9 [[res_dumber_with_A]]
+|| 6.2 Dumber (yes, do this one first)  || [[res_dumber]]  || Clean ||
|| 6.1 Densify - (Get lunch)|| [[res_densify]]   || Clean ||
|| 6.10 DensifyA - (Get lunch)|| [[res_densifyA]]  || Differ ||
|| 6.9 Dumber with A || [[res_dumber_with_A]]  || <Unk> ||
|| 6.4 Geometry (large changes)|| [[res_geometry]]   || Differ ||
|| 6.5 Residuals || [[res_residuals]]  || Clean ||
|| 6.7 Shape_info || [[res_shape_info]]  || Clean ||
-Line 174:
+Line 165:
-- 6.4 [[res_geometry]] (large change)
-Line 176:
+Line 166:
-- 6.5 [[res_residuals]]
+== Other
-Line 178:
+Line 168:
-- 6.6 [[res_regress]] 

- 6.7 [[res_shape_info]]
+|| 6.6 Regres || [[res_regres]]   ||  ||