Vision aided Inertial Localization for Remotely Operated Vehicle (ROV)

Thumbnail Image

Persistent link to this item

View Statistics

Journal Title

Journal ISSN

Volume Title


Vision aided Inertial Localization for Remotely Operated Vehicle (ROV)

Published Date




Thesis or Dissertation


This thesis details the implementation of a vision aided inertial localization system for a Remotely Operated Vehicle (ROV) in a controlled environment. The vision sub- system features a Raspberry-Pi equipped with the pi-camera and the inertial sub-system consists of an automotive/consumer grade MEMS-IMU operated by an Arduino board (Arduino Due). A novel PnP estimation algorithm, Linear Least Squares - Gradient SO(3) algorithm (SO(3) - PnP), is introduced for pose estimation using the vision sub-system. The position is estimated using a linear least squares approach while the ori- entation is computed iteratively using a gradient descent algorithm. The inertial sensors are used as a dead-reckoning system in between the vision measurements. The cross-talk between the vision and inertial sub-systems is established using ethernet(UDP). Sensor fusion is achieved using Kalman lters. Laboratory experiments validate the accuracy of the Vision-IMU module and enhance the possibility that they can be deployed in an un-controlled ocean environment to compute the pose of the ROV (within a target workspace) w.r.t. a given landmark.


University of Minnesota M.S.M.E. thesis. May 2016. Major: Mechanical Engineering. Advisor: Perry Li. 1 computer file (PDF); xiii, 148 pages.

Related to



Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Mangipudi, Chandra Prakash. (2016). Vision aided Inertial Localization for Remotely Operated Vehicle (ROV). Retrieved from the University Digital Conservancy,

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.