Deep-learning-based defective bean inspection with GAN-structured automated labeled data augmentation in coffee industry

Yung Chien Chou, Cheng Ju Kuo, Tzu Ting Chen, Gwo Jiun Horng, Mao Yuan Pai, Mu En Wu, Yu Chuan Lin, Min Hsiung Hung, Wei Tsung Su, Yi Chung Chen, Ding Chau Wang, Chao Chun Chen

研究成果: Article同行評審

5 引文 斯高帕斯(Scopus)


In the production process from green beans to coffee bean packages, the defective bean removal (or in short, defect removal) is one of most labor-consuming stages, and many companies investigate the automation of this stage for minimizing human efforts. In this paper, we propose a deep-learning-based defective bean inspection scheme (DL-DBIS), together with a GAN (generative-adversarial network)-structured automated labeled data augmentation method (GALDAM) for enhancing the proposed scheme, so that the automation degree of bean removal with robotic arms can be further improved for coffee industries. The proposed scheme is aimed at providing an effective model to a deep-learning-based object detection module for accurately identifying defects among dense beans. The proposed GALDAM can be used to greatly reduce labor costs, since the data labeling is the most labor-intensive work in this sort of solutions. Our proposed scheme brings two main impacts to intelligent agriculture. First, our proposed scheme is can be easily adopted by industries as human effort in labeling coffee beans are minimized. The users can easily customize their own defective bean model without spending a great amount of time on labeling small and dense objects. Second, our scheme can inspect all classes of defective beans categorized by the SCAA (Specialty Coffee Association of America) at the same time and can be easily extended if more classes of defective beans are added. These two advantages increase the degree of automation in the coffee industry. The prototype of the proposed scheme was developed for studying integrated tests. Testing results of a case study reveal that the proposed scheme can efficiently and effectively generate models for identifying defective beans with accuracy and precision values up to 80%.

期刊Applied Sciences (Switzerland)
出版狀態Published - 2019 十月 1

All Science Journal Classification (ASJC) codes

  • Materials Science(all)
  • Instrumentation
  • Engineering(all)
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes

指紋 深入研究「Deep-learning-based defective bean inspection with GAN-structured automated labeled data augmentation in coffee industry」主題。共同形成了獨特的指紋。