|
Size: 1562
Comment:
|
Size: 3831
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 14: | Line 14: |
| * Run [[dynamics]] | |
| Line 20: | Line 21: |
| === 1. Copy FITS images === Install a copy of the FITS images for each day into the standard location |
=== Copy FITS images === Install a copy of the FITS images for each day into the NEW_IMAGES_YYYY_DDD location. |
| Line 23: | Line 24: |
| vi lsupport/processScript.sh # Takes a list of image names and runs process_fits on them # Eric E. Palmer, 9 June 2015 file=$1 prefix="images" # symbolic link to source images list=`cat $file` for item in $list do echo "$prefix/$item" | process_fits done |
cp <files> /path/ops/OSIRIS_REx/NEW_IMAGES_YYYY_DDD |
| Line 38: | Line 29: |
| === 2. Running PROCESS_FITS to populate IMAGEFILES, PICTLIST.TXT, and make_sumfiles.in === {{{ # Create a symbolic link to the location of the images -- this is a single line ln -s <Full pathname to directory containing images> images # Build the list of images to process ls images/ > imgList # Run the script sh lsupport/processScript.sh imgList | tee output.txt # Store the results mkdir ../log/step1-1 mv output.txt imgList ../log/step1-1 rm images # get rid of the symbolic link }}} === 3. Create the SUMFILES and NOMINALS === {{{ # Run the command with option 0 echo 0 | /usr/local/bin/make_sumfiles | tee output.txt |
|
| Line 60: | Line 31: |
| # Store the results mkdir ../log/step1-2 mv output.txt ../log/step1-2 |
=== Make a list of images === SPC can ingest images one at a time via [[process_fits]], but we prefer to run it in batch. If [[newpix.txt]] exists, then [[process_fits]] will use that as input. It will search through all directories in the form of ../OSIRIS_REx/NEW_IMAGES_YYY_DDD . For tracking purposes, we will name the list of images via data shortName and put it into lsupport. The shortName is the short hand for mission name (Ap, PS, OA, DS, OB, Re) and the sequence number of the images set, i.e. the first delivery is 1, the next is 2, etc. {{{ cd /path/ops/OSIRIS_REx/NEW_IMAGES_YYYY_DD D ls > ../newpix.Ap4 cd ../Approch150B.v1 mv ../newpix.Ap4 lsupport/ relink lsupport/newpix.Ap4 newpix.txt ls -l newpix.txt |
| Line 64: | Line 43: |
=== Updated kernels === Typically, you will need to update the spacecraft (SPK or file extension bsp) and pointing (CK or file extension bc). It may be necessary to update the spacecraft leap second clock also (lsp). Finally, if you get a new POLE, the planetary constants kernel for Bennu needs to be updated (PCK or file extension tpc). * Remember that many spacecraft kernels have both a reconstructed past history and a future predicted plan. As such, if you forget to update the SPKs, you could have images that are ingested using the predicted part of an outdated kernel, which won't throw an error. * Remember that SPICE will load kernels in order and use the last loaded kernel for a given time, so the newest kernels should always be at the end of a list. 1. Edit [[make_sumfiles.txt]]. We want to use chmod to avoid mistakenly over writing such an important file. {{{ chmod u+w make_sumfiles.txt vi make_sumfiles.txt # add the new kernels chmod a-w make_sumfiles.txt }}} 1. If the PCK has changed, update [[INIT_LITHOS.TXT]] also. === Setup process_fits === Provided [[newpix.txt]] is in the working directory, then [[process_fits]] will run through all of those images. Review the following {{{ ls -l DATA/DN2TEMP.TXT ls -l DATA/FLATFILES.TXT ls -l newpix.txt }}} === Setup make_sumfiles === Review the following {{{ ls -l DATA/BIAS.TXT # seldom used ls -l DATA/SCOBJ_SHIFT.TXT ls -l DATA/TMP2FOCLEN.TXT }}} === Run process_fits, make_sumfiles === For this step, we want to log the output to ensure flat field etc are properly applied. We want to capture the output from [[make_sumfiles]] to get the list of new image name, which we put in lsupport/imageList.<shortName> {{{ PROCESS_FITS | tee ingest echo 0 | MAKE_SUMFILES | tee -a process echo 1 | MAKE_SUMFILES | tee -a out cut -c 1-12 out > lsupport/imageList.Ap\ }}} === Run dynamics === Before running [[dynamics]], you need to make sure that [[DYNAMICS.TXT]] has been updated with the new images. Take the image list (lsupport/imageList.<shortName>) and add it into [[DYNAMICS.TXT before the "END". Update the uncertainties as required (for the new images and any update for the old images if needed. Note, if an image is not listed [[DYNAMICS.TXT]], then it will not have it's uncertainties updated. {{{ vi DYNAMICS.TXT Gk:rlsupport/imageList.Ap6ZZ dynamics }}} |
|
| Line 66: | Line 108: |
| ''(Compiled by JRW)'' CategoryHowTos |
''(Compiled by EEP)'' |
Block 2 - Ingest V2
Description
This block additionally ingests images from FITS files into the SPC world.
Basic steps
- Copy FITS images
- Make a list of images
- Updated kernels
Run process_fits
Run make_sumfiles
Run dynamics
Procedure
Copy FITS images
Install a copy of the FITS images for each day into the NEW_IMAGES_YYYY_DDD location.
cp <files> /path/ops/OSIRIS_REx/NEW_IMAGES_YYYY_DDD
Make a list of images
SPC can ingest images one at a time via process_fits, but we prefer to run it in batch. If newpix.txt exists, then process_fits will use that as input. It will search through all directories in the form of ../OSIRIS_REx/NEW_IMAGES_YYY_DDD .
For tracking purposes, we will name the list of images via data shortName and put it into lsupport. The shortName is the short hand for mission name (Ap, PS, OA, DS, OB, Re) and the sequence number of the images set, i.e. the first delivery is 1, the next is 2, etc.
cd /path/ops/OSIRIS_REx/NEW_IMAGES_YYYY_DD D ls > ../newpix.Ap4 cd ../Approch150B.v1 mv ../newpix.Ap4 lsupport/ relink lsupport/newpix.Ap4 newpix.txt ls -l newpix.txt
Updated kernels
Typically, you will need to update the spacecraft (SPK or file extension bsp) and pointing (CK or file extension bc). It may be necessary to update the spacecraft leap second clock also (lsp). Finally, if you get a new POLE, the planetary constants kernel for Bennu needs to be updated (PCK or file extension tpc).
- Remember that many spacecraft kernels have both a reconstructed past history and a future predicted plan. As such, if you forget to update the SPKs, you could have images that are ingested using the predicted part of an outdated kernel, which won't throw an error.
- Remember that SPICE will load kernels in order and use the last loaded kernel for a given time, so the newest kernels should always be at the end of a list.
Edit make_sumfiles.txt. We want to use chmod to avoid mistakenly over writing such an important file.
chmod u+w make_sumfiles.txt vi make_sumfiles.txt # add the new kernels chmod a-w make_sumfiles.txt
If the PCK has changed, update INIT_LITHOS.TXT also.
Setup process_fits
Provided newpix.txt is in the working directory, then process_fits will run through all of those images.
Review the following
ls -l DATA/DN2TEMP.TXT ls -l DATA/FLATFILES.TXT ls -l newpix.txt
Setup make_sumfiles
Review the following
ls -l DATA/BIAS.TXT # seldom used ls -l DATA/SCOBJ_SHIFT.TXT ls -l DATA/TMP2FOCLEN.TXT
Run process_fits, make_sumfiles
For this step, we want to log the output to ensure flat field etc are properly applied. We want to capture the output from make_sumfiles to get the list of new image name, which we put in lsupport/imageList.<shortName>
PROCESS_FITS | tee ingest echo 0 | MAKE_SUMFILES | tee -a process echo 1 | MAKE_SUMFILES | tee -a out cut -c 1-12 out > lsupport/imageList.Ap\
Run dynamics
Before running dynamics, you need to make sure that DYNAMICS.TXT has been updated with the new images. Take the image list (lsupport/imageList.<shortName>) and add it into DYNAMICS.TXT before the "END". Update the uncertainties as required (for the new images and any update for the old images if needed. Note, if an image is not listed [[DYNAMICS.TXT, then it will not have it's uncertainties updated.
vi DYNAMICS.TXT Gk:rlsupport/imageList.Ap6ZZ dynamics
(Compiled by EEP)