Vision-Based Computational Methods Towards Effective Underwater Multi-Human-Robot Interaction

Loading...
Thumbnail Image

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Vision-Based Computational Methods Towards Effective Underwater Multi-Human-Robot Interaction

Published Date

2024-05

Publisher

Type

Thesis or Dissertation

Abstract

Numerous important tasks, such as environmental monitoring, cable or wreckage inspection, search-and-rescue, and oil drilling or spillage monitoring, are conducted underwater. A team of human divers typically carries out these challenging and often dangerous tasks, occasionally receiving assistance from a Remotely Operated Vehicle (ROV). However, an ROV is mainly controlled by someone on the surface which leads to inefficient collaboration due to the indirect engagement among the divers and the robot. In contrast, an Autonomous Underwater Vehicle (AUV) does not require a surface operator to operate and can significantly enhance task efficiency by actively engaging with a team of human divers and other AUVs during the tasks. Thus, it is imperative for the AUVs to have robust multi-Human-Robot Interaction (mHRI) capability. In this dissertation, we present a set of vision-based computational methods for AUV perception to facilitate effective underwater mHRI to allow successful collaboration among multiple divers and AUVs. Furthermore, we provide several novel underwater datasets designed to facilitate learning about robot motion, diver identity, their pose information, and multi-human-robot collaborative scenarios. Our proposed methods allow the AUV to enable human-comprehensible interaction between multiple AUVs, identify unique divers for secure interaction and collaboration, reposition itself for interaction by determining whether their human partners are attentive, and identify the current activity of divers to make informed decisions. However, the general operation of AUVs is severely impacted by various factors, such as water turbidity, rapid currents, varying lighting conditions, and signal attenuation. AUVs also have several platform-specific constraints, such as finite battery life, limited on-board processing power, and real-time operational requirements. We have taken these challenges into consideration while designing and implementing our proposed algorithms on-board physical AUV platforms. We have elaborated on the rationale behind the specific design choices made for each system. Experimentalvalidations on proposed datasets as well as through numerous robot trials, performed in both closed- and open-water environments (e.g., swimming pools and oceans), show the efficacy of each proposed system.

Description

University of Minnesota Ph.D. dissertation. May 2024. Major: Computer Science. Advisor: Junaed Sattar. 1 computer file (PDF); xi, 135 pages.

Related to

Replaces

License

Collections

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Other identifiers

Suggested citation

Enan, Sadman Sakib. (2024). Vision-Based Computational Methods Towards Effective Underwater Multi-Human-Robot Interaction. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/264301.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.