Part I. Overview

How SPC Works

The Origins, Spectral Interpretation, Resource Identification, and Security–Regolith Explorer (OSIRIS-REx) mission will return the first pristine samples of carbonaceous material from the surface of a primitive asteroid. OSIRIS-REx’s target asteroid (101955) Bennu is the most exciting, accessible, volatile, and organic-rich remnant from the early solar system, as well as one of the most potentially hazardous asteroids known. After launching in September 2016, OSIRIS-REx begins a two-year cruise to Bennu that includes an Earth flyby in September of 2017. OSIRIS-REx detects Bennu 60 days in advance of rendezvous and surveys its environment for natural satellites and other hazards. OSIRIS-REx then spends the next 7 months characterizing the surface and orbital environment of Bennu. Four candidate sample sites are characterized with OSIRIS-REx’s instrument suite and the Touch-And-Go (TAG) maneuver sequence is practiced. In October 2019, OSIRIS-REx executes the TAG maneuver and collects both bulk and surface samples. After a period of quiescent drifting away from Bennu, in March of 2021, OSIRIS-REx begins its return journey to the Earth. Following a 2.5 year return cruise, the Sample Return Capsule (SRC) is released, re-entering Earth’s atmosphere and landing at the Utah Test & Training Range in September of 2023.

SPOC Overview

The Science Processing and Operations Center (SPOC) is the centralized location for all OSIRIS-REx science data processing during the operational phases of the mission.

Spacecraft telemetry, science instrument data, and tracking information are received by the SPOC. The Ingest portion of the SPOC system ingests the raw science and engineering telemetry for all instruments via the Front End Data System (FEDS) interface. The Digest portion of the SPOC server then composes complete telemetry products, reassembles data packets into complete buffers, generates L0 and L1 engineering data products for all science instruments, processes L0 un-calibrated science data products into L2 products ready for analysis, and creates FDS OpNav deliverables. The science team develops science data products for site selection as well as long-term science, and places those in the SPOC repository. All data products are available on the SPOC data repository for storage, retrieval, and delivery to the PDS.

Data and Environment Requirements for the SPC Process

Observation and Data for Optimal SPC Results

Traditional stereo requires:

• Images that are taken with similar lighting conditions
• Stereo angle between 10 and 40°
• Images have nearly identical image resolution

Stereophotoclinometry works best with:

• A minimum of three images (typically >30, this study 4)

• Two stereo images
• Emission angles 45° (acceptable 35-48°, limit 5-60°)
• Stereo angle 90° (acceptable 70-110°, limit 10-120°)
• Incidence angle 0° (acceptable 0-20°, limit 0-60°)
• Three photoclinometry images
• Emission 0° (acceptable 0-20°, limit 0-60°)
• Incidence angles 45° (acceptable 30-50°, limit 0-60°)
• Variation in illumination geometry of 90° (acceptable 40-90°, limit 10-120°). This refers to having different positions of the Sun with respect to the observed target.

In general, geometric stereo is more accurate for long scale topography, while photoclinometry is better for short scale (Kirk 2003). SPC uses both of these components to mitigate the errors that are caused by each of them. Stereo creates a position in 3D space using 3-5 pixels from an image. SPC typically sets control points (called "landmarks") with a spacing of 30 pixels. Thus, the landmarks (or point clouds) have a spacing that is a factor of 10 lower than traditional geometric results.

SPC will use photoclinometry to calculate and fill in the heights of the points between the landmarks. The horizontal ground sample distance (referred to as "resolution") is typically on the order of the resolution of the images, and we have successfully generated topography at double the image resolution. The calculations of the points between landmarks are solved in 99x99 grids (or "maplets"), so most heights are solved by multiple maplets. The iterative solution is continued until the solutions for points common to multiple maplets agree, resulting in the accuracy of all of the topographic heights being controlled by stereo but generated by photoclinometry at a higher ground sample distance.

Computing Environment and Tools for SPC Process

The programs described in this document are written in FORTRAN and compose a toolkit that have been traditionally compiled and run within a UNIX or LINUX operating system. Most of these machines have been Apple computers . Specific computers and tools used in the SPC process are listed below.

Table 00: Required Resources and Ancillary Tools

SPC Process

SPC uses a three-step iterative process to derive a shape model:

• register images
• warp the model
• update camera position/pointing

We start with an initial shape model that is very low resolution but that provides a starting point for SPC. This shape can come from limb measurements, a radar shape model, spherical harmonics or, if need be, can be derived via a mathematical representation of a tri-axial shape. In this case, it is set to a flat surface.

The following discussions explain each of these three steps in more detail.

Step 1. Register

The first step is to register the images to a reference frame. To do this, we use a large number of landmarks. For each landmark, we generate a small 99x99 pixel maplet. Each image that falls within one maplet is orthorectified and projected onto the shape model. Here is a sample:

Figure 00: Initial Shape with Maplet Overlay

Associated with each of these maplet views is the shape model with albedo, which is illuminated at the same solar geometry, as shown in the following sample:

Figure 00: Maplet with Variation in Solar Illumination

In these four images, there is significant variation in illumination conditions, resulting in a significantly different looking terrain. The bottom row are images based on the shape model, only illuminated with the space conditions as the corresponding image. By projecting all the images to the same orientation and scale, and illuminating the model accordingly, we can more precisely register images over a significantly wider range of emission angles, thus reducing topographic error. These maplets are 500 meters across.

We use both manual and automated tools to co-register the images within each maplet such that the center point of each maplet is in the same location as on all the rest. Because the images are orthorectified, we can have the same view of each of them, increasing our ability to match identical features, even if the original viewing geometry makes them hard to identify. There are minor improvements in the co-registration of images as the shape model improves because this reduces projection error and, correspondently, any mis-registration.

Step 2. Warp the Model

Once the landmarks are registered, we use that information to update the shape model. While the height of the center of the landmark is initially derived from geometric stereo, we use photoclinometry to solve for the heights of every pixel of the landmark. Simple photoclinometry is 1D and requires the albedo to be a constant so that the only variation in pixel intensity is the topography. For SPC, we have a full 3D model that includes albedo. As described previously, for each image within a maplet, we illuminate the shape model to correspond to it. Because we are fully controlling for topography and albedo, any variations in each image's pixel DN from its representative shape model DN is an error in the model. The deviations are turned into corrections for both albedo and topography. A configuration file within SPC provides weighting that is applied to the corrections for albedo and topography. For example, when working with a low relief surface with high contrast, the user puts more weight on changing the albedo rather than the topography, and vice versa. The weighting only affects how fast the model converges to a solution; it does not affect the solution itself. For example, if SPC has made an overcorrection to albedo, then when the terrain is processed again, the albedo will be corrected.

Step 3. Update Camera Position/Pointing

The next major step of SPC is to take the updated heights of the surface and use those to improve the actual position and pointing of the spacecraft. Within an image, each of these landmarks (in this context, they are working like a control point) provides the exact sample/line position of the landmark. This data, along with the angular field of view of each pixel, allows SPC to determine the position and pointing of the spacecraft. Note that a narrow field of view makes it difficult to break the degeneracy where a displacement can be either position or pointing. This is handled by weighting each of these terms based upon the calculated errors in positions and pointing. Typically, these estimates are provided by the navigation team. This correction of camera position/pointing and the assumptions made by those generating the topography account for the major differences between SPC and traditional stereogrammetry.

Additional Processing

As the shape model is processed, the steps of register/morph/update are iterated until the residuals of the solution approach a minimum. We use a variety of tools to evaluate mis-registration problems, image artifacts, or regions with insufficient image coverage (the worst of which occurs with a lack of stereo). The main tool is a program called RESIDUALS that reports deviations in distance (meters) or pixels. It calculates the position on the shape model of each landmark/image combination. For each landmark, it takes the deviation of position of each of its images to calculate the RMS error. The RMS error shows how close all of the image data is aligned to represent the surface of the object. It is a fully geometric solution based upon the registration of the landmarks (or control points) and the position of the spacecraft.

Output Products

The main output product for SPC is a shape model, a 3D set of position vectors that define the heights. This can be converted into a vector/plate model. The output from SPC for a bounded surface is called a BIGMAP. This product has a regular ground sample distance (resolution) and, for each point, it takes the average value of all the maplets that contain each point. The BIGMAP also contains a scaled albedo (or scaled average surface reflectance) for each point.