Information Extraction from Non-Line-of-Sight Objects Using Plenoptic Data from Scattered Light

Loading...
Thumbnail Image

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Information Extraction from Non-Line-of-Sight Objects Using Plenoptic Data from Scattered Light

Published Date

2020-01

Publisher

Type

Thesis or Dissertation

Abstract

We investigate the utility of plenoptic data for extracting information from a scene where the light from unknown objects in the scene is viewable only after scattering from a diffuse surface. A primary goal of this research is to estimate the objects’ locations in the hidden scene, and to extract additional information, such as the object’s shape and brightness. In the first part, we derive a rigorous relationship between the object and the scattered light fields, which is cast in terms of a system of Fredholm integral equations of the first kind with the BRDF of the scattering surface, and the object information is reconstructed by solving these equations. Based on the Fourier transformation, we propose a simple BRDF model and analyze the reconstruction errors by introducing newly defined parameters reflecting the BRDF’s characteristic, the degree of specularity and the effective SNR. We then obtain optimal regularized solutions to the equations under a variety of conditions. Moreover, we provide a fundamental limit of retrievable information content from the scattered light. A comparison with experimental results is reported. In the second part, we investigate the use of plenoptic data for locating objects from a scattered light field by using the results obtained in the first part. The resolution limits of the transverse and longitudinal location estimates are derived from fundamental considerations on the scattering physics and measurement noise. Based on the refocusing algorithm developed in the computer vision field, we derive a simple alternative formulation of the projection slice theorem in a form directly connecting the light field and spatial frequency spectrum. Using this alternative formulation, we propose a spatial frequency filtering method that is defined on a newly introduced mixed space-frequency plane and achieves the theoretically-limited depth resolution. Moreover, we propose an improved refocusing algorithm to more accurately estimate the object’s brightness information. An experimental verification is provided.

Description

University of Minnesota Ph.D. dissertation. January 2020. Major: Scientific Computation. Advisor: James Leger. 1 computer file (PDF); x, 104 pages.

Related to

Replaces

License

Collections

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Sasaki, Takahiro. (2020). Information Extraction from Non-Line-of-Sight Objects Using Plenoptic Data from Scattered Light. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/219298.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.