The Smart Image Recognition Mechanism for Crop Harvesting System in Intelligent Agriculture

Gwo Jiun Horng, Min Xiang Liu, Chao Chun Chen

Research output: Contribution to journalArticle

1 Citation (Scopus)


This study proposed a harvesting system based on the Internet of Things technology and smart image recognition. Farming decisions require extensive experience; with the proposed system, crop maturity can be determined through object detection by training neural network models, and mature crops can then be harvested using robotic arms. Keras was used to construct a multilayer perceptron machine learning model and to predict multiaxial robotic arm movements and position. Following the execution of object detection on images, the pixel coordinates of the central point of the target crop in the image were used as neural network input, whereas the robotic arms were regarded as the output side. A MobileNet version 2 convolutional neural network was then used as the image feature extraction model, which was combined with a single shot multibox detector model as the posterior layer to form an object detection model. The model then performed crop detection by collecting and tagging images. Empirical evidence shows that the proposed model training had a mean average precision (mAP) of 84%, which was higher than that of other models; a mAP of 89% was observed from the arm picking results.

Original languageEnglish
Article number8906085
Pages (from-to)2766-2781
Number of pages16
JournalIEEE Sensors Journal
Issue number5
Publication statusPublished - 2020 Mar 1

All Science Journal Classification (ASJC) codes

  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'The Smart Image Recognition Mechanism for Crop Harvesting System in Intelligent Agriculture'. Together they form a unique fingerprint.

  • Cite this