VISTA

Background

Significant advances in computer vision and machine learning can enable unique science measurements by allowing for the pointing and reconfiguration of instruments to acquire the most valuable science data. Such techniques apply to static features and the AEGIS system on Mars rovers is an example [1]. However, even greater benefits can be achieved by targeting rare, dynamic features such as plumes, deep convective ice storms, or atmospheric events. Many such events would be hazards to human spaceflight (such as coronal mass ejections) and therefore these techniques can support human exploration as well.

This effort seeks to advance techniques to allow moving spacecraft to target dynamic science features and execute novel measurements in real-time. VISTA consists of analyzing sensor inputs in real-time to enable subsequent measurement. This analysis leverages computer vision to identify dynamic features within raw data. After identifying areas of interest, precise follow-up measurements are planned and executed. Some applications of VISTA include measuring plumes from volcanoes and wildfires, extraterrestrial plumes, and harmful algal blooms.

Problem

Autonomously plan and execute precise measurements of dynamic features for moving spacecraft based on sensor inputs. This technical problem involves synthesizing planning and perception; dynamic features are identified from raw data that then informs automated planning.

Status

VISTA is in development with current applications including dynamic targeting of volcanic plumes, wildfire plumes, extraterrestrial plumes, and harmful algal blooms.

References

[1] R. Francis, T. Estlin, G. Doran, S. Johnstone, D. Gaines, V. Verma, M. Burl, J. Frydenvang, S. Montano, and R. Wiens, “AEGIS autonomous targeting for ChemCam on Mars Science Laboratory: Deployment and results of initial science team use,” Science Robotics, June 2017.

Publications

Team

Itai Zilberstein, Jet Propulsion Laboratory, California Institute of Technology
Alberto Candela-Garza, Jet Propulsion Laboratory, California Institute of Technology
Steve Chien, Jet Propulsion Laboratory, California Institute of Technology (Principal Investigator)

Sponsors

NASA Center Innovation Funds (CIF)