The overview of grain appearance inspection.
The AV4GAInsp system includes a prototype device and an analysis framework.
Workflow of our device.
Grain Appearance Inspection (GAI) is a pre-requisite for grain quality determination, providing guidance for grain processing, storage, and trade. GAI is routinely performed by trained inspectors who are required to visually inspect cereal grains for each individual kernel. Since grain kernels (e.g., wheat, rice) are tiny with heterogeneous shapes and appearance, manually performing GAI is time-consuming and error-prone. This letter presents a machine vision-based customization of an automated system for grain appearance inspection, called AV4GAInsp, which consists of a device and an analysis framework. The device is equipped with an elaborate feeding module and a capturing module for automatically pre-processing grain kernels and efficiently acquiring high-quality images for these kernels. The framework employs deep convolutional neural networks to process these captured images to classify the kernels as normal or defective. We also built and released a large-scale dataset, named GrainDet, that includes over 140K images for three types of grains: wheat, sorghum, and rice. Comprehensive experiments are conducted to validate the efficacy and performance of our AV4GAInsp system, achieving an average F1-score of 98.4% and excelling at inspection efficiency by over 20× speedup. Kappa statistic tests are performed to confirm the consistency between our system and human experts. It is expected that AV4GAInsp will alleviate inspectors' workloads and inspire further research in smart agriculture.
The GrainDet dataset provides a comprehensive collection of high-quality images for cereal grain inspection. It includes over 140K images captured from three types of grains: wheat, sorghum, and rice. The dataset supports Object Detection, Classification tasks.
The GrainDet dataset is licensed under the Creative Commons BY-NC-SA 4.0 license. Note that All data must not be used for commercial purposes.
You can access the dataset using the figshare links below:
@article{fan2023av4gainsp,
title={AV4GAInsp: An Efficient Dual-Camera System for Identifying Defective Kernels of Cereal Grains},
author={Fan, Lei and Ding, Yiwen and Fan, Dongdong and Wu, Yong and Chu, Hongxia and Pagnucco, Maurice and Song, Yang},
journal={IEEE Robotics and Automation Letters},
year={2023},
publisher={IEEE}
}