Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

Abstract

In this paper, we present an end-to-end simulation framework for tracking an uncooperative Target spacecraft in Low Earth Orbit using a CubeSat-class Ego spacecraft outfitted with a camera. Currently, capturing high-fidelity realistic images in space for this scenario is difficult and exorbitantly expensive. Therefore, we developed a framework to simulate the spacecraft orbits in Basilisk software and generate high-fidelity realistic images of spacecraft in Unreal Engine, including the effects from Sun, Earth, Moon and stars.The Ego spacecraft uses cameras to capture images of the uncooperative Target and estimates its position and attitude using a CNN based 6DOF pose estimation pipeline, eliminating need for large SWAP-C(Size, Weight, Power and Cost) sensors like LI-DAR or reliance on inter-spacecraft communication, This CNN, which is motivated by ESA's Pose Estimation challenge of 2019, is trained using simulated data from our end-to-end simulation framework. We compare the performance of two distinct CNNbased algorithms for pose estimation along a nominal trajectory. In presence of non-Gaussian modeling uncertainties, the statedependent estimation error is characterized with a quadratic upper-bound. The quadratically-bounded error can be used by a robust controller to maneuver Ego spacecraft to track the uncooperative Target.

Bolstering Maritime Object Detection with Synthetic Data

“…Our primary focus is on autonomous operation at sea and, more precisely, on the predictive uncertainty for the classification of common maritime vessels and objects for the GreenHopper vessel, see Figure 1. In our previous work [1], [2], [3], we proposed an object detection network tasked with robust detection of two coarse classes, buoys and ships; given an image, a detection consisted of an object bounding box and class confidence. This work extends our efforts of creating a more reliable and robust object detection system [4], [5], by focusing on producing higher quality classification outputs, that is a more precise label (e.g.…”

Magnetic Disturbance Rejection in Spacecraft using Electromagnetic Propulsion

“…Basilisk handles the spacecraft state propagation and supports adding Python modules to handle simulation tasks specific to this research. Basilisk has been used in previous research that requires 6-DoF propagation and the addition of new modules such as control laws [64] or external torques [65]. The simulations are run on a machine using the Ubuntu 22.04 operating system with an Intel Core i7 processor.…”