Background
Future space missions will enable unprecedented monitoring of the Earth's
environment and will generate immense volumes of science data. Getting this
data to ground communications stations, through science processing, and
delivered to end users is a tremendous challenge. As an example, the
HyspIRI mission concept (in its
current design) would generate a staggering gigabit (109 bits), or
1.5 megapixels, per second. Depending on the area and type of the Earth's
surface being overflown, scientists and authorities on the ground can use
timely information from this unique remote-sensing platform to track a range
of terrestrial phenomena.
Problem
Moving the functions of event detection and product generation onboard a
spacecraft entails several significant challenges. First, instrument data
onboard the spacecraft has not yet been calibrated or corrected for instrument
or environmental effects. For example, when an instrument onboard a spacecraft
images the surface of the Earth, the signal from the surface is distorted as
it passes through the Earth's atmosphere up to the instrument. In many
applications this distortion must be corrected before the data can be used.
Although in some cases simplified versions of this correction can take place
onboard, in other cases correction steps require data not available onboard
the spacecraft (such as weather, temperature, or other atmospheric data).
However, even without such correction, less precise, rapid-delivery products
could be of significant interest.
The second challenge is that onboard computing is typically severely limited.
Ground-based computers typically are endowed with gigabytes of RAM and
gigaflops of computing capability. Typical onboard computing resources for a
current spacecraft consist of 64 Mbytes of RAM and processing power of 200
million instructions per second. For example, the Mars Reconnaissance Orbiter
(MRO) is flying a Rad 750 processor clocked at 133 MHz.
The third challenge is that current instruments produce enormous amounts of
data. A single image from the HiRise camera on MRO is 16.4 Gbits
(uncompressed). The HyspIRI TIR instrument produces 1.2 Mpixels per second at
eight bands, and the HyspIRI VSWIR produces 300 Kpixels per second at 220
bands. Keeping up with these data rates requires efficient algorithms,
streamlined data flows, and careful systems engineering.
Impact
The application areas of these products include flooding, volcanoes, and
cryosphere. These applications and many others represent key applications
areas for the proposed HyspIRI Intelligent Payload Module (IPM).
Although delivery of the highest-quality products (using standard downlink and
processing methods) might be delivered to scientists a week or two after
collection, specific applications can benefit from data and product delivery
in near real time. For example, active fire mapping can assist in fighting
forest fires—enabling better placement and use of scarce firefighting
resources.
Status
The HyspIRI Mission Concept has baselined the use of the Intelligent Payload
Module concept to bring down rapid response data.
Description
The HyspIRI operational concept uses AI techniques in both the onboard and
ground mission segments.
On the ground, the spacecraft's orbit is projected, and automated
mission-planning tools determine which onboard-processing mode the spacecraft
should use. The orbit determines the type of terrain that the spacecraft would
be overflying—land, ice, coast, or ocean, for instance. Each terrain mask
implies a set of requested modes and priorities. For example, when a
spacecraft overflies polar or mountainous regions, producing snow and ice
coverage maps can provide valuable science data. The science team can adjust
these priorities on the basis of additional information (such as external
knowledge of an active volcano, a flooded area, an active wildfire, or a
harmful algal bloom). The mission-planning tool accepts all these requests and
priorities, then determines which onboard-processing algorithms will be active
by selecting the highest-priority requests that fit within the onboard CPU
resources, band-processing limitations, and downlink bandwidth.
In the intelligent onboard processing concept, HyspIRI's onboard processing
algorithms would consist of expert-derived decision tree classifiers,
machine-learned classifiers such as SVM classifiers and regressions,
classification and regression trees (CART), Bayesian maximum-likelihood
classifiers, spectral angle mappers, and direct implementations of spectral
band indices and science products.
Publications
generated by
2017
(1)
Chien, S.; Troesch, M.; Tran, D.; Schaffer, S.; Thompson, D. R.; Green, R.; Wagstaff, K.; Altinok, A.; Rebbapragada, U.; Mandl, D.; Middleton, E.; Ungar, S.; Ong, L.; Campbell, P.; Trout, B.; and Hengemihle, J.
Results from ALI and OLI Multispectral Band Synthesis, Machine Learning Classificaion, and Salience onboard the Earth Observing One Mission.
In
Workshop on: Global Earth Imaging Spectroscopy and Thermal Infrared Measurements (HyspIRI) NASA Decadal Survey Mission Concept, Pasadena, CA, October 2017.
link
bibtex
@inproceedings{chien-hyspiri-symp-2017,
title = {Results from ALI and OLI Multispectral Band Synthesis, Machine Learning Classificaion, and Salience onboard the Earth Observing One Mission},
author = {S. Chien and M. Troesch and D. Tran and S. Schaffer and D. R. Thompson and R. Green and K. Wagstaff and A. Altinok and U. Rebbapragada and D. Mandl and E. Middleton and S. Ungar and L. Ong and P. Campbell and B. Trout and J. Hengemihle},
year = 2017,
month = {October},
booktitle = {Workshop on: Global Earth Imaging Spectroscopy and Thermal Infrared Measurements (HyspIRI) NASA Decadal Survey Mission Concept},
address = {Pasadena, CA},
clearance = {CL\#17-5314},
project = {HyspIRI}
}
2016
(1)
Chien, S.; Troesch, M.; Tran, D.; Schaffer, S.; Thompson, D. R.; Green, R.; Wagstaff, K.; Altinok, A.; Rebbapragada, U.; Mandl, D.; Middleton, E.; Ungar, S.; Ong, L.; Campbell, P.; Trout, B.; and Hengemihle, J.
Flight Validation of Instrument Processing Onboard Earth Observing One: A Status Report.
In
Workshop on: Global Earth Imaging Spectroscopy and Thermal Infrared Measurements (HyspIRI) NASA Decadal Survey Mission Concept, Pasadena, CA, October 2016.
link
bibtex
@inproceedings{chien-hyspiri-symp-2016,
title = {Flight Validation of Instrument Processing Onboard Earth Observing One: A Status Report},
author = {S. Chien and M. Troesch and D. Tran and S. Schaffer and D. R. Thompson and R. Green and K. Wagstaff and A. Altinok and U. Rebbapragada and D. Mandl and E. Middleton and S. Ungar and L. Ong and P. Campbell and B. Trout and J. Hengemihle},
year = 2016,
month = {October},
booktitle = {Workshop on: Global Earth Imaging Spectroscopy and Thermal Infrared Measurements (HyspIRI) NASA Decadal Survey Mission Concept},
address = {Pasadena, CA},
clearance = {CL\#16-4782},
project = {HyspIRI}
}
2014
(3)
Chien, S.; Doubleday, J.; Tran, D.; Thompson, D.; Wagstaff, K.; Bellardo, J.; Francis, C.; Baumgarten, E.; Williams, A.; Yee, E.; Fluitt, D.; Stanton, E.; and Piug-Suari, J.
Flight Validation of HyspIRI IPM Concepts on the Intelligent Payload Experiment (IPEX) CubeSat.
In
HyspIRI Product Symposium, Greenbelt, MD, June 2014.
Paper
link
bibtex
16 downloads
@inproceedings{chien-doubleday-tran-et-al-2014,
title = {Flight Validation of HyspIRI IPM Concepts on the Intelligent Payload Experiment (IPEX) CubeSat},
author = {S. Chien and J. Doubleday and D. Tran and D. Thompson and K. Wagstaff and J. Bellardo and C. Francis and E. Baumgarten and A. Williams and E. Yee and D. Fluitt and E. Stanton and J. Piug-Suari},
year = 2014,
month = {June},
booktitle = {HyspIRI Product Symposium},
address = {Greenbelt, MD},
url = {https://ai.jpl.nasa.gov/public/papers/chien-hyspiri2014-flight.pdf},
clearance = {CL\#14-1614},
project = {HyspIRI ipex}
}
Chien, S.; Torres, J.; Tran, D.; Thompson, D. R.; Green, R.; Mandl, D.; Middleton, E.; Ungar, S.; Ong, L.; and Campbell, P.
Generation of OLI data products Onboard Earth Observing One: A Preliminary Report.
In
HyspIRI Product Symposium, Greenbelt, MD, June 2014.
Paper
link
bibtex
6 downloads
@inproceedings{chien-torres-tran-et-al-2014,
title = {Generation of OLI data products Onboard Earth Observing One: A Preliminary Report},
author = {S. Chien and J. Torres and D. Tran and D. R. Thompson and R. Green and D. Mandl and E. Middleton and S. Ungar and L. Ong and P. Campbell},
year = 2014,
month = {June},
booktitle = {HyspIRI Product Symposium},
address = {Greenbelt, MD},
url = {https://ai.jpl.nasa.gov/public/papers/chien-hyspiri2014-generation.pdf},
clearance = {CL\#14-2252},
project = {HyspIRI}
}
Chien, S.; Doubleday, J.; Tran, D.; Thompson, D.; Wagstaff, K.; Bellardo, J.; Francis, C.; Baumgarten, E.; Williams, A.; Yee, E.; Fluitt, D.; Stanton, E.; and Piug-Suari, J.
Onboard Autonomy on the Intelligent Payload EXperiment (IPEX) Cubesat Mission as a Pathfinder for the Proposed HyspIRI Mission Intelligent Payload Module.
In
International Symposium on Artificial Intelligence, Robotics, and Automation for Space (ISAIRAS 2014), Montreal, Canada, June 2014.
Paper
link
bibtex
@inproceedings{chien-doubleday-tran-et-al-ISAIRAS-2014,
title = {Onboard Autonomy on the Intelligent Payload EXperiment (IPEX) Cubesat Mission as a Pathfinder for the Proposed HyspIRI Mission Intelligent Payload Module},
author = {S. Chien and J. Doubleday and D. Tran and D. Thompson and K. Wagstaff and J. Bellardo and C. Francis and E. Baumgarten and A. Williams and E. Yee and D. Fluitt and E. Stanton and J. Piug-Suari},
year = 2014,
month = {June},
booktitle = {International Symposium on Artificial Intelligence, Robotics, and Automation for Space (ISAIRAS 2014)},
address = {Montreal, Canada},
url = {https://ai.jpl.nasa.gov/public/papers/chien-isairas2014-onboard.pdf},
clearance = {CL\#14-1736},
project = {HyspIRI ipex}
}
2013
(1)
Chien, S.; Mclaren, D.; Tran, D.; Davies, A. G.; Doubleday, J.; and Mandl, D.
Onboard Product Generation on Earth Observing One: A Pathfinder for the Proposed HyspIRI Mission Intelligent Payload Module.
IEEE JSTARS Special Issue on the Earth Observing One (EO-1) Satellite Mission: Over a decade in space. 2013.
link
bibtex
@article{chien-mclaren-tran-et-al-2013,
title = {Onboard Product Generation on Earth Observing One: A Pathfinder for the Proposed HyspIRI Mission Intelligent Payload Module},
author = {S. Chien and D. Mclaren and D. Tran and A. G. Davies and J. Doubleday and D. Mandl},
year = 2013,
journal = {IEEE JSTARS Special Issue on the Earth Observing One (EO-1) Satellite Mission: Over a decade in space},
clearance = {CL\#12-5101},
project = {HyspIRI}
}
2012
(1)
Chien, S.
Flight and Ground Operations Concept for the HyspIRI Intelligent Payload Module.
In
HyspIRI Science Workshop, Washington, DC, October 2012.
link
bibtex
@inproceedings{chien-2012,
title = {Flight and Ground Operations Concept for the HyspIRI Intelligent Payload Module},
author = {S. Chien},
year = 2012,
month = {October},
booktitle = {HyspIRI Science Workshop},
address = {Washington, DC},
clearance = {CL\#12-5107},
project = {HyspIRI}
}
2011
(2)
Davies, A. G.; and Chien, S.
A global volcano product for Thermal Emission and Effusion Rate: EO-1/Hyperion and HyspIRI.
In
HyspIRI Symposium, Greenbelt, MD, May 2011.
Paper
link
bibtex
@inproceedings{davies-chien-2011,
title = {A global volcano product for Thermal Emission and Effusion Rate: EO-1/Hyperion and HyspIRI},
author = {A. G. Davies and S. Chien},
year = 2011,
month = {May},
booktitle = {HyspIRI Symposium},
address = {Greenbelt, MD},
url = {https://ai.jpl.nasa.gov/public/papers/davies-hyspsym2011-global.pdf},
clearance = {CL\#11-2065},
project = {HyspIRI}
}
Chien, S.; Mclaren, D.; Rabideau, G.; Mandl, D.; and Hengemihle, J.
Scheduling Onboard Processing for the Proposed HyspIRI Mission.
In
International Workshop on Planning and Scheduling for Space (IWPSS 2011), Darmstadt, Germany, June 2011.
Paper
link
bibtex
@inproceedings{chien-mclaren-rabideau-et-al-IWPSS-2011,
title = {Scheduling Onboard Processing for the Proposed HyspIRI Mission},
author = {S. Chien and D. Mclaren and G. Rabideau and D. Mandl and J. Hengemihle},
year = 2011,
month = {June},
booktitle = {International Workshop on Planning and Scheduling for Space (IWPSS 2011)},
address = {Darmstadt, Germany},
url = {https://ai.jpl.nasa.gov/public/papers/chien-iwpss2011-scheduling.pdf},
clearance = {CL\#11-1781},
project = {HyspIRI}
}
2010
(3)
Chien, S.; Silverman, D.; Rabideau, G.; Mandl, D.; and Hengemihle, J.
A Direct Broadcast Operations Concept for the HyspIRI Mission.
In
International Conference On Space Operations 2010 (SpaceOps 2010), Huntsville, AL, April 2010.
link
bibtex
@inproceedings{chien-silverman-rabideau-et-al-SpaceOps-2010,
title = {A Direct Broadcast Operations Concept for the HyspIRI Mission},
author = {S. Chien and D. Silverman and G. Rabideau and D. Mandl and J. Hengemihle},
year = 2010,
month = {April},
booktitle = {International Conference On Space Operations 2010 (SpaceOps 2010)},
address = {Huntsville, AL},
clearance = {CL\#10-0650},
project = {HyspIRI}
}
Chien, S.; Silverman, D.; Davies, A.; Mclaren, D.; Mandl, D.; and Hengemihle, J.
Onboard Instrument Processing Concepts for the HyspIRI Mission.
In
International Geoscience and Remote Sensing Symposium (IGARSS 2010), Honolulu, HI, July 2010.
Paper
link
bibtex
@inproceedings{chien-silverman-davies-et-al-2010,
title = {Onboard Instrument Processing Concepts for the HyspIRI Mission},
author = {S. Chien and D. Silverman and A. Davies and D. Mclaren and D. Mandl and J. Hengemihle},
year = 2010,
month = {July},
booktitle = {International Geoscience and Remote Sensing Symposium (IGARSS 2010)},
address = {Honolulu, HI},
url = {https://ai.jpl.nasa.gov/public/papers/chien-igarss2010-onboard.pdf},
clearance = {CL\#10-2396},
project = {HyspIRI}
}
Chien, S.; McLaren, D.; Rabideau, G.; Silverman, D.; Mandl, D.; and Hengemihle, J.
Onboard Processing for Low-latency Science for the HyspIRI Mission.
In
International Symposium on Space Artificial Intelligence, Robotics, and Automation for Space (ISAIRAS 2010), Sapporo, Japan, August 2010.
Paper
link
bibtex
@inproceedings{chien-mclaren-rabideau-et-al-ISAIRAS-2010,
title = {Onboard Processing for Low-latency Science for the HyspIRI Mission},
author = {S. Chien and D. McLaren and G. Rabideau and D. Silverman and D. Mandl and J. Hengemihle},
year = 2010,
month = {August},
booktitle = {International Symposium on Space Artificial Intelligence, Robotics, and Automation for Space (ISAIRAS 2010)},
address = {Sapporo, Japan},
url = {https://ai.jpl.nasa.gov/public/papers/chien-isairas2010-low.pdf},
clearance = {CL\#10-2396},
project = {HyspIRI}
}
2009
(1)
Chien, S.; Silverman, D.; Davies, A.; and Mandl, D.
Onboard Science Processing Concepts for the HyspIRI Mission.
IEEE Intelligent Systems, 24 (6). November/December 2009.
link
bibtex
@article{chien-silverman-davies-et-al-2009,
title = {Onboard Science Processing Concepts for the HyspIRI Mission},
author = {S. Chien and D. Silverman and A. Davies and D. Mandl},
year = 2009,
month = {November/December},
journal = {IEEE Intelligent Systems},
volume = {24 (6)},
clearance = {CL\#09-4019},
project = {HyspIRI}
}
Team
Jet Propulsion Laboratory, California Institute of Technology:
- Steve Chien
- David Mclaren
- Daniel Tran
- Ashley Gerard Davies
- Joshua Doubleday
Goddard Space Flight Center:
- Daniel Mandl
Sponsors
Earth Observing One Mission
-Daniel Mandl (GSFC), Mission Manager
-Cheryl Yuhas, NASA HQ POC
HyspIRI Concept Team
-Woody Turner, NASA HQ POC