Fruit detection in an apple orchard using a mobile terrestrial laser scanner

View/ Open
Issue date
2019-09-21Author
Guevara, Javier
Auat Cheein, Fernando A.
Morros Rubió, Josep Ramon
Ruiz Hidalgo, Javier
Vilaplana Besler, Verónica
Suggested citation
Gené Mola, Jordi;
Gregorio López, Eduard;
Guevara, Javier;
Auat Cheein, Fernando A.;
Sanz Cortiella, Ricardo;
Escolà i Agustí, Alexandre;
...
Rosell Polo, Joan Ramon.
(2019)
.
Fruit detection in an apple orchard using a mobile terrestrial laser scanner.
Biosystems Engineering, 2019, vol. 187, p. 171-184.
https://doi.org/10.1016/j.biosystemseng.2019.08.017.
Metadata
Show full item recordAbstract
The development of reliable fruit detection and localization systems provides an opportunity to improve the crop value and management by limiting fruit spoilage and optimised harvesting practices. Most proposed systems for fruit detection are based on RGB cameras and thus are affected by intrinsic constraints, such as variable lighting conditions. This work presents a new technique that uses a mobile terrestrial laser scanner (MTLS) to detect and localise Fuji apples. An experimental test focused on Fuji apple trees (Malus domestica Borkh. cv. Fuji) was carried out. A 3D point cloud of the scene was generated using an MTLS composed of a Velodyne VLP-16 LiDAR sensor synchronised with an RTK-GNSS satellite navigation receiver. A reflectance analysis of tree elements was performed, obtaining mean apparent reflectance values of 28.9%, 29.1%, and 44.3% for leaves, branches and trunks, and apples, respectively. These results suggest that the apparent reflectance parameter (at 905 nm wavelength) can be useful to detect apples. For that purpose, a fourstep fruit detection algorithm was developed. By applying this algorithm, a localization success of 87.5%, an identification success of 82.4%, and an F1-score of 0.858 were obtained in relation to the total amount of fruits. These detection rates are similar to those obtained by RGB-based systems, but with the additional advantages of providing direct 3D fruit location information, which is not affected by sunlight variations. From the experimental results, it can be concluded that LiDAR-based technology and, particularly, its reflectance information, has potential for remote apple detection and 3D location.
Is part of
Biosystems Engineering, 2019, vol. 187, p. 171-184European research projects
The following license files are associated with this item:
Except where otherwise noted, this item's license is described as cc-by-nc-nd (c) Academic Press, 2019
Related items
Showing items related by title, author, creator and subject.
-
LFuji-air dataset: annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions
Gené Mola, Jordi; Gregorio López, Eduard; Auat Cheein, Fernando A.; Guevara, Javier; Llorens Calveras, Jordi; Sanz Cortiella, Ricardo; Escolà i Agustí, Alexandre; Rosell Polo, Joan Ramon (Elsevier, 2020)This article presents the LFuji-air dataset, which contains LiDAR based point clouds of 11 Fuji apples trees and the corresponding apples location ground truth. A mobile terrestrial laser scanner (MTLS) comprised of a LiDAR ... -
Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow
Gené Mola, Jordi; Gregorio López, Eduard; Auat Cheein, Fernando A.; Guevara, Javier; Llorens Calveras, Jordi; Sanz Cortiella, Ricardo; Escolà i Agustí, Alexandre; Rosell Polo, Joan Ramon (Elsevier, 2019-11-29)Yield monitoring and geometric characterization of crops provide information about orchard variability and vigor, enabling the farmer to make faster and better decisions in tasks such as irrigation, fertilization, pruning, ... -
Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry
Gené Mola, Jordi; Sanz Cortiella, Ricardo; Rosell Polo, Joan Ramon; Morros Rubió, Josep Ramon; Ruiz Hidalgo, Javier; Vilaplana Besler, Verónica; Gregorio López, Eduard (Elsevier, 2020-01-02)The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the efficiency of agriculture management. Most of the current fruit detection systems are based on ...