Acrospire Detection in Malt Using Smartphone Images and Deep Learning

2023-04
Loading...
Thumbnail Image

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Acrospire Detection in Malt Using Smartphone Images and Deep Learning

Alternative title

Published Date

2023-04

Publisher

Type

Thesis or Dissertation

Abstract

Acrospire length is a visual indication of the degree of malt modification in the malting process, and an indicator of the uniformity of germination. Conventionally, maltsters rely on visually inspecting each malt kernel to judge the process of malt and make process decisions to deliver the in-spec malt. However, this manual inspection method, which could take up to 30 mins for one single sample, is tedious, time-consuming, and subject to human error. Our proposed method uses smartphone imaging along with deep learning models to inspect malt-acrospire lengths to replace traditional manual inspection with higher inspection throughput and accuracy. We split the task into three parts, and three novel datasets were created to train and test the deep learning models. The malt were classified according to the ratio of the length of acrospire to the seed lengths: (0~¼), (¼~½), (½~¾), (¾~1), and overgrown (>1) classes. The overgrown class, where the acrospire grows longer than the full length of the kernel, is considered undesirable in terms of both quality and economics. First, a dataset containing 70 images of malt at different phases of germination, each image containing 150~250 kernels, was used to train a Mask-RCNN model and Hybrid Task Cascade (HTC) model for instance segmentation of malt seeds. The Mask-RCNN model reached an instance segmentation average precision (AP75) value of 0.77 while the HTC model was able to achieve 0.84. After successful instance segmentation of malt, a second dataset containing 3155 images of single malt kernels was used to fine-tune a Swin Transformer and ResNet50 image classification model to filter out malt seeds with ventral side facing up. The Swin Transformer model reached an accuracy of 84% and the ResNet50 model reached an accuracy of 82%. Lastly, 1500 images of single malt kernels were used to train Mask-RCNN, Cascade Mask-RCNN, and HTC models to detect the acrospire region on a seed. The Mask R-CNN model with Swin transformer backbone had the best segmentation average precision (AP75) at 0.818 while the HTC model had the best bounding box average precision (AP75) at 0.848. The overall pipeline achieved a mean Average Precision (mAP) of 0.75, and reduces inspection time to approximately 2~3 minutes.

Keywords

Description

University of Minnesota M.S. thesis. April 2023. Major: Computer Science. Advisor: Ce Yang. 1 computer file (PDF); vii, 35 pages.

Related to

Replaces

License

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Other identifiers

Suggested citation

Liu, Duan. (2023). Acrospire Detection in Malt Using Smartphone Images and Deep Learning. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/256954.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.