Differences between revisions 1 and 43 (spanning 42 versions)

Spacecraft Zenith Variations

Aim and Objectives

Purpose of Test 11: To evaluate SPC's ability to represent a simplified 'boulder' which has a constant 20 degree slope.

Objective for Test 11 S, T & U, Spacecraft Zenith Variations

To investigate the effect of varying the combination of spacecraft zenith (emission angle) contained in the image suite;
To investigate the effect of the number of images and viewing conditions.

Methodology

The 'boulder' was simulated by generating a simple axi-symmetric, flat-topped cone (peak) with a constant 20 degree slope. Multiple peaks and (simplified) craters are randomly placed in an otherwise flat landscape of width approx. 22.5m.

Truth map: REGION.MAP

Bigmaps

The following TAG1 bigmaps were tiled/iterated and evaluated:

Starting topography defined from: START1.MAP at pixel/line location 49, 49 (= REGION.MAP at p/l 1125, 1125).

Step	GSD	Overlap Ratio	Q Size	Width	Center
START.MAP	20cm	-	49	20m	REGION.MAP p/l 1125, 1125 (center)
10cm-Tiling	10cm	1.3	130	20m	START1.MAP, p/l 49, 49
5cm-Tiling	5cm	1.3	250	20m	START1.MAP, p/l 49, 49
5cm-Iterations	5cm	-	-	20m	START1.MAP, p/l 49, 49
Evaluation Map	1cm	-	200	4m	REGION.MAP, p/l 996, 1005

Tiling/Iteration Parameters

Auto-Elimination Parameters:	0, 60, .25, .25, 0, 3
Reset albedo/slopes	NO
Determine Central Vector	YES
Differential Stereo	YES
Shadows	YES

Tiling seed files: t11-10.seed , t11-05.seed

Iteration seed file : Piteate2StSh-woAYY

Data

Data was generated by ??.
Image resolutions: 2cm/pixel.

Viewing Conditions

Name	Sun	S/C Az	S/C Zenith	Total Number of Images
Test11S	45, 0, -45	every 45	0, 30, 60	80
Test11T	45, 0, -45	every 45	0, 20, 40, 60	112
Test11U	45, 0, -45	every 45	0, 15, 30, 45, 60	144

Note that a larger image suite was planned and produced than was utilized during test. The images for a number of planned viewing conditions were eliminated due to image quality related to the viewing conditions being unfit for SPC. For further details are contained here:

Test11STU Unsuitable Viewing Conditions.

Test11S Viewing Conditions

Test11T Viewing Conditions

Test11U Viewing Conditions

Results

Results with Overlaps:

Test Over11STU Comparative Results

Test Over11S Results

Test Over11T Results

Test Over11U Results

Results without Overlaps:

Test11S Results

Test11T Results

Test11U Results

Discussion

Minima

From an inspection of the minimum formal uncertainty, CompMapVec RMS and CompareOBJ RMS (both the minimum value and the number of iterations at which the minimum occurs), for tests S, T and U, the following is apparent.

Within-measure range of minima
Formal Uncertainty	1.511 +/- 0.087 cm
CompMapVec RMS	0.875 +/- 0.325 cm
CompareOBJ RMS	0.938 +/- 0.097 cm
CompareOBJ with Optimal Trans & Rot	0.435 +/- 0.072 cm

All minima were below the image resolution (2cm).
Formal uncertainties display a negative trend which appears to still be decreasing after 50 iterations.
The RMSs reached minima within the first 30 iterations and then diverged. No asymptotic behavior is apparent, the RMSs appear to worsen as testing continues to 50 iterations and beyond, although RMSs remain below the image resolution in all cases except TestS's CompMapVec RMS.
Test U consistently achieves the minimum RMS values in the least number of iterations: 5 to 15 iterations sooner than Test T; and 15 to 20 iterations sooner than Test S (excluding Test S CompMapVec RMS which never improved with iteration).
Test S consistently gives the largest RMS but the smallest formal uncertainty.
Compare OBJ RMSs with and without optimal translation and rotation vary across tests by less than 0.2cm, with optimal translation and rotation giving consistently better results in fewer iterations (5 to 10 iterations sooner in every test).

-  ⇤ ← Revision 1 as of 2015-11-24 17:48:38 → 
  Size: 2968
  Editor: DianeLambert
  Comment:
+   ← Revision 43 as of 2015-11-25 15:58:27 → ⇥
  Size: 4672
  Editor: DianeLambert
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 5:
-'''Purpose of test:''' .
+'''Purpose of Test 11:''' To evaluate SPC's ability to represent a simplified 'boulder' which has a constant 20 degree slope.
 Line 7:
-'''Additional Objectives''' 
 * .
+'''Objective for Test 11 S, T & U, Spacecraft Zenith Variations''' 
 * To investigate the effect of varying the combination of spacecraft zenith (emission angle) contained in the image suite;
 * To investigate the effect of the number of images and viewing conditions.
-Line 12:
+Line 13:
-'''Data'''
 * Data was generated by .
 * Location and parameters for evaluation area.  
 * Image Suite: Image resolutions: 50cm, 20cm, 10cm, 5cm.
  * emission
    * .
  * incidence
    * .
    * .
+The 'boulder' was simulated by generating a simple axi-symmetric, flat-topped cone (peak) with a constant 20 degree slope. Multiple peaks and (simplified) craters are randomly placed in an otherwise flat landscape of width approx. 22.5m.
-Line 22:
+Line 15:
-|| Name || Sun || S/C Az || S/C Zenith ||
|| Test11S || 45, 0, -45 || every 45 || 0, 30, 60 || ||
|| Test11T || 45, 0, -45 || every 45 || 0, 20, 40, 60, 80 || ||
|| Test11U || 45, 0, -45 || every 45 || 0, 14, 30, 45, 60, 75 || ||


Spacecraft:

{{attachment:SC_perfectF2_POLARS.jpg||width=300}}

Sun:

{{attachment:SUN_perfectF2_POLARS.jpg||width=300}}
+'''Truth map:''' REGION.MAP
-Line 40:
+Line 21:
-Starting topography defined from: ?
+Starting topography defined from: START1.MAP at pixel/line location 49, 49 (= REGION.MAP at p/l 1125, 1125).
-Line 42:
+Line 23:
-||Step||GSD||Overlap Ratio||Q Size||Width||
||35cm-Tiling||
||18cm-Tiling||
||9cm-Tiling||
||5cm-Tiling||
+||Step||GSD||Overlap Ratio||Q Size||Width||Center||
||START.MAP||20cm||-||49||20m||REGION.MAP p/l 1125, 1125 (center)||
||10cm-Tiling||10cm||1.3||130||20m||START1.MAP, p/l 49, 49||
||5cm-Tiling||5cm||1.3||250||20m||START1.MAP, p/l 49, 49||
||5cm-Iterations||5cm||-||-||20m||START1.MAP, p/l 49, 49||
||Evaluation Map||1cm||-||200||4m||REGION.MAP, p/l 996, 1005||
-Line 48:
+Line 30:
+'''Tiling/Iteration Parameters'''
-Line 49:
+Line 32:
-'''Iteration Parameters'''
+||Auto-Elimination Parameters:||0, 60, .25, .25, 0, 3||
||Reset albedo/slopes||NO||
||Determine Central Vector||YES||
||Differential Stereo||YES||
||Shadows||YES||
-Line 51:
+Line 38:
-Reset albedo/slopes: ?YES
+'''Tiling seed files:'''
[[Test Over11STU t11-10.seed|t11-10.seed]] ,
[[Test Over11STU t11-05.seed|t11-05.seed]]
-Line 53:
+Line 42:
-Calculate Central Vector: ?YES
+'''Iteration seed file :'''
[[Test Over11STU Piterate2StSh-withoutayy.seed|Piteate2StSh-woAYY]]
-Line 55:
+Line 45:
-Differential Stereo: ?YES
+'''Data'''
 * Data was generated by ??.  
 * Image resolutions: 2cm/pixel.
-Line 57:
+Line 49:
-Shadows: ?NO
+'''Viewing Conditions'''
|| Name || Sun || S/C Az || S/C Zenith || Total Number of Images ||
|| Test11S || 45, 0, -45 || every 45 || 0, 30, 60 || 80 ||
|| Test11T || 45, 0, -45 || every 45 || 0, 20, 40, 60 || 112 ||
|| Test11U || 45, 0, -45 || every 45 || 0, 15, 30, 45, 60 || 144 ||

Note that a larger image suite was planned and produced than was utilized during test. The images for a number of planned viewing conditions were eliminated due to image quality related to the viewing conditions being unfit for SPC. For further details are contained here: 

[[Test11STU Unsuitable Viewing Conditions]].

'''Test11S Viewing Conditions'''

{{attachment:Over11S_EE0057_sc_plot_resized.png}}
{{attachment:Over11S_EE0057_sun_plot_resized.png}}

'''Test11T Viewing Conditions'''

{{attachment:Over11T_EE0057_sc_plot_resized.png}}
{{attachment:Over11T_EE0057_sun_plot_resized.png}}

'''Test11U Viewing Conditions'''

{{attachment:Over11U_EE0057_sc_plot_resized.png}}
{{attachment:Over11U_EE0057_sun_plot_resized.png}}
-Line 61:
+Line 77:
-[[Test11STU Comparative Results]]
+'''Results with Overlaps:'''

[[Test Over11STU Comparative Results]]

[[Test Over11S Results]]

[[Test Over11T Results]]

[[Test Over11U Results]]

'''Results without Overlaps:'''
-Line 72:
+Line 98:
-The measures of accuracy are plotted for each test in figures ?? to ?? under Tables and Figures (below).
+'''Minima'''
-Line 74:
+Line 100:
-'''Figure 1: Minima'''
+From an inspection of the minimum formal uncertainty, CompMapVec RMS and CompareOBJ RMS (both the minimum value and the number of iterations at which the minimum occurs), for tests S, T and U, the following is apparent.
-Line 76:
+Line 102:
-{{attachment:Minima-resized.png}}
+||||Within-measure range of minima||
||Formal Uncertainty||1.511 +/- 0.087 cm||
||CompMapVec RMS||0.875 +/- 0.325 cm||
||CompareOBJ RMS||0.938 +/- 0.097 cm||
||CompareOBJ with Optimal Trans & Rot||0.435 +/- 0.072 cm||
-Line 78:
+Line 108:
-Figure 1 illustrates the minimum uncertainty and RMSs for each test, and at which iteration each minimum occurs. The following patterns are apparent:
 * Test U achieves the minimum value for every measure in the least number of iterations: 5 to 15 iterations sooner than Test T; and 15 to 20 iterations sooner than Test S (excluding Test S - CompMapVec RMS).
+ * All minima were below the image resolution (2cm).
 * Formal uncertainties display a negative trend which appears to still be decreasing after 50 iterations.
 * The RMSs reached minima within the first 30 iterations and then diverged. No asymptotic behavior is apparent, the RMSs appear to worsen as testing continues to 50 iterations and beyond, although RMSs remain below the image resolution in all cases except TestS's CompMapVec RMS.
 * Test U consistently achieves the minimum RMS values in the least number of iterations: 5 to 15 iterations sooner than Test T; and 15 to 20 iterations sooner than Test S (excluding Test S CompMapVec RMS which never improved with iteration).
-Line 81:
+Line 113:
- * CompareOBJ RMS (with and without optimal translation and rotation varies across tests by less than 0.2cm, although Test U consistently archives the minimum RMS in significantly fewer iterations.
+ * Compare OBJ RMSs with and without optimal translation and rotation vary across tests by less than 0.2cm, with optimal translation and rotation giving consistently better results in fewer iterations (5 to 10 iterations sooner in every test).
-Line 83:
+Line 115:
-== Tables and Figures ==

'''Formal Uncertainty'''

{{attachment:FormalUncertainty-resized.png}}

'''CompMapVec RMS'''

{{attachment:CompMapVec-resized.png}}

'''CompareOBJ RMS'''

{{attachment:CompareOBJRMS-resized.png}}

'''CompareOBJ With Opt Tran & Rot'''

{{attachment:CompOBJwOptTranRot-resized.png}}

'''Traces Running North_South'''

{{attachment:transitIt20200.png}}
{{attachment:transitIt40200.png}}

'''Traces Running West-East'''

{{attachment:transposedTransitIt20200.png}}
{{attachment:transposedTransitIt40200.png}}

'''Heat Plots'''

{{attachment:heatPlot-T11RFS-05stepB020-1cm-4m.png}}
{{attachment:heatPlot-T11RFT-05stepB020-1cm-4m.png}}
{{attachment:heatPlot-T11RFU-05stepB020-1cm-4m.png}}

{{attachment:heatPlot-T11RFS-05stepB040-1cm-4m.png}}
{{attachment:heatPlot-T11RFT-05stepB040-1cm-4m.png}}
{{attachment:heatPlot-T11RFU-05stepB040-1cm-4m.png}}
+== Conclusion ==