Service robotics and machine learning for close-range remote sensing along real applications

Candidate:  Maria Angela Musci
Department: PhD in Urban and Regional Development
Supervisor: Prof. Andrea Maria Lingua | Prof. Paolo Dabove | Irene Aicardi

In the urban environment and rural area, continuous monitoring at multiple scales (global, regional and local) is crucial in terms of productivity, resilience, and sustainability. Monitoring requires the production of observations that allows environment study, inspection and understanding at different levels of details. However, the information production involves repetitive and straightforward activities, i.e. survey, localisation, object detection, that should be done multiple times in different periods. The procedure could be time-consuming, expensive and risky. Indeed, in many applications, such as Precision Agriculture (PA) or farming, these tasks are accomplished still with the involvement of experts in manual mode or by using static sensor networks (SSNs).

As proposed by the “Rural Development Program 2014-2020”, monitoring requires innovative tools and sustainable solutions. Innovation concerns the acquisition and the rapid analysis of high spatial, temporal, and spectral resolution data. This means boosting the development of service robotics as more precise and integrated acquisition platforms and machine learning techniques for improving automatic information extraction techniques. 

The research, focusing on the geomatics aspects, consists of platform definition, sensors calibration, and definition of quasi real-time machine learning algorithms for near real-real time information extraction. Aircraft inspection for de-icing operations and precision agriculture are used as applications to test technologies and methods.

 

The research aims to outline near-real-time automated information extraction techniques handling multi-scale, multitemporal and multi-sensor data for inspection and environmental monitoring. The research covers the whole process of remote sensing, from platform definition to information extraction. In detail, the present work focuses on:

  • Definition of a whole overview of the current technologies and information extraction methods used for monitoring and inspection purposes;
  • Configuration of Uncrewed Aerial Vehicle (UAV) platform to integrate innovative sensors such as a hyperspectral camera and its correlated hardware components based on applications; 
  • Definition of a geometric and radiometric calibration procedure for a light-weight hyperspectral camera and implementation of customised MATLAB routines;
  • Implementation of a suitable dimensionality reduction procedure for hyperspectral data management;
  • Application of machine learning techniques for a quasi-real-time automatic information extraction procedure using multi-scale, multi-view and multi-sensory data (RGB, multispectral, and hyperspectral sensors) in challenging applications;