Segmentation and Dense Keypoints Estimation of Monkeys

Loading...

View/Download File

Yu_umn_0130M_22972.pdf (10.96 MB)

Persistent link to this item

https://hdl.handle.net/11299/226331

Statistics

View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Segmentation and Dense Keypoints Estimation of Monkeys

Authors

Yu, Haozheng

Published Date

2021-12

Publisher

Type

Thesis or Dissertation

Abstract

Animal tracking and pose estimation are core topics in neuroscience. However, for monkeys, current deep learning based algorithms often fail to perform well on segmentation and dense keypoints estimation due to the lack of annotated training data. In this thesis, we address this challenge by developing transfer learning based deep learning algorithms without using fully-annotated monkey data. We develop a bootstrapping strategy to refine the pretrained segmentation model on monkey data annotated with 2D sparse landmarks. In addition, we implement a voxel-based visual hull reconstruction approach to recover the 3D monkey pose from the silhouettes. For dense keypoints estimation, we follow a similar bootstrapping strategy to refine a pretrained HRNet, which is then used to learn a dense keypoint detector by leveraging multiview consistency. Our methods outperform the baseline methods on in-the-cage and in-the-wild monkey data.

Keywords

Bootstrapping

Dense Keypoints Estimation

Monkey

Reconstruction

Segmentation

Transfer Learning

Description

University of Minnesota M.S. thesis. 2021. Major: Computer Science. Advisor: Hyun Soo Park. 1 computer file (PDF); 37 pages.

Related to

Replaces

License

Collections

Master's Theses (Plan A and Professional Engineering Design Projects)

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Yu, Haozheng. (2021). Segmentation and Dense Keypoints Estimation of Monkeys. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/226331.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.