Terrain classification using ToF sensors for the enhancement of agricultural machinery traversability
Yandun, Francisco J.
Auat Cheein, Fernando A.
MetadataShow full item record
Ground properties influence various aspects of mobile machinery navigation including localization, mobility status or task execution. Excessive slipping, skidding or trapping situations can compromise the vehicle itself or other elements in the workspace. Thus, detecting the soil surface characteristics is an important issue for performing different activities in an efficient, safe and satisfactory manner. In agricultural applications, this point is specially important since activities such as seeding, fertilizing, or ploughing are carried on within off-road landscapes which contain a diversity of terrains that modify the navigation behaviour of the vehicle. Thus, the machinery requires a cognitive capability to understand the surrounding terrain type or its characteristics in order to take the proper guidance or control actions. This work is focused on the soil surface classification by implementing a visual system capable to distinguish between five usual types of off-road terrains. Computer vision and machine learning techniques are applied to characterize the texture and color of images acquired with a Microsoft Kinect V2 sensor. In a first stage, development tests showed that only infra-red and RGB streams are useful to obtain satisfactory accuracy rates (above 90%). The second stage included field trials with the sensor mounted on a mobile robot driving through various agricultural landscapes. These scenarios did not present illumination restrictions nor ideal driving roads; hence, conditions can resemble real agricultural operations. In such circumstances, the proposed approach showed robustness and reliability, obtaining an average of 85.20% of successful classifications when tested along 17 trials within agricultural landscapes.
Is part ofJournal of Terramechanics, 2017, vol. 76 (2018), p. 1-13
European research projects
The following license files are associated with this item:
Showing items related by title, author, creator and subject.
Yandun, Francisco J.; Gregorio López, Eduard; Zúñiga, Marcos; Escolà i Agustí, Alexandre; Rosell Polo, Joan Ramon; Auat Cheein, Fernando A. (ElsevierIFAC (International Federation of Automatic Control), 2016)The detection of the type of soil surface where a robotic vehicle is navigating on is an important issue for performing several agricultural tasks. Satisfactory results in activities such as seeding, plowing, fertilizing, ...
Gené Mola, Jordi; Gregorio López, Eduard; Guevara, Javier; Auat Cheein, Fernando A.; Sanz Cortiella, Ricardo; Escolà i Agustí, Alexandre; Llorens Calveras, Jordi; Morros Rubió, Josep Ramon; Ruiz Hidalgo, Javier; Vilaplana Besler, Verónica; Rosell Polo, Joan Ramon (Academic Press. Published by Elsevier, 2019-09-21)The development of reliable fruit detection and localization systems provides an opportunity to improve the crop value and management by limiting fruit spoilage and optimised harvesting practices. Most proposed systems for ...
Gené Mola, Jordi; Llorens Calveras, Jordi; Rosell Polo, Joan Ramon; Gregorio López, Eduard; Arnó Satorra, Jaume; Solanelles Batlle, Francesc; Martínez Casasnovas, José Antonio; Escolà i Agustí, Alexandre (Universitat de Lleida, 2020-11)The Kinect Evaluation in Orchard conditions (KEvOr) dataset is comprised of a set of RGB-D captures carried out with the Microsoft Kinect v2 to evaluate the performance of this sensor at different lighting conditions in ...