Heterogeneous autonomous robotic system in viticulture and mariculture – HEKTOR is an EU-funded project coordinated by the Laboratory for Robotics and Intelligent Control Systems (LARICS) & Laboratory for Underwater Systems and Technologies (LABUST) of the University of Zagreb Faculty of Electrical Engineering and Computing (UNIZG FER).
Duration: 13/3/2020-31/3/2023
Budget: 5.794.060,14 HRK
Financed by: ESI European Region Development Fund
Coordinator: University of Zagreb Faculty of Electrical Engineering and Computing
Partners: University of Dubrovnik – Institute for Marine and Coastal Research, University of Zagreb Faculty of Agriculture
INDUSTRIAL RESEARCH
The existing vineyard cultivation process will be analysed in detail, as well as the methods use in fish cage farming to isolate one process and those processes that can be improved by introducing a heterogeneous autonomous robotic system. Such isolated procedures will be the basis for innovative solutions that will facilitate human work in difficult conditions (high slopes, large plantation areas, long dives at greater depths, adverse weather conditions, etc.).
The next step will be the upgrade/adaptation of the existing and newly acquired robotic platforms making them an integral part of a complex robotic system (innovative solutions are expected in the field of robotic manipulation). Finally, the prototypes of the robotic platforms will be tested in a laboratory environment. Once the functionality of individual platforms has been verified under laboratory conditions, the laboratory will test the entire system – checking the communication systems and coordinated actions of the platform (innovative solutions are expected in the area of coordinated and cooperative management of robotic platforms).
EXPERIMENTAL DEVELOPMENT
Experimental development will take place through demonstration activities in an environment that reflects operational real-life conditions (vineyards in Pelješac and Korčula and fish cages in the Zadar area), as described in Project Element 4: Demonstration scenarios. After each field test, the results will be analysed and the necessary modifications to the system elements will be made and the testing will be performed again in operational conditions. This iterative process will be repeated in several steps, minimizing possible system design errors.
Unmanned Aerial Vehicle (UAV) is a quadcopter equipped with RTK-GPS system, RGB and thermal cameras, LIDAR, force sensor and on-board computer for real-time data processing and storage. UAV has extended flight time and it is capable of executing autonomus take-off and landing procedures on rough terrain or on Unmanned Surface Vehicle
Vehicle applications:
• Aerial vineyard and fish farms monitoring
• Terrain mapping
• Data colecting for point colud generation
• Data acquisition for ground and underwater robots
• Flying platform for robot manipulators
Vehicle specifications:
• Size (W x L x H) 800mm x 800mm x 500mm
• Weight in air 8kg
• Carbon fiber frame
• 4 brushless motors with maximum thrust of 22 inch propellers
• Horizontal speed up to 10 m/s, vertical speed up to 5 m/s
• 40 min of flight autonomy
• Pixhawk autopilot
• Intel-NUC on-board computer
• RGB camera, thermal camera, LIDAR, force sensor
The autonomous surface platform is over-actuated with 4 thrusters forming the ”X” configuration. This configuration enables symmetrical motion in the horizontal plane under any orientation. The platform has been developed at the University of Zagreb Faculty of Electrical Engineering and Computing, Laboratory for Underwater Systems and Technologies. The platform was primarily developed for dynamic positioning and diver following and since then its application was extended to execution of multiple autonomous tasks.
Vehicle applications:
Vehicle specifications:
Sensors & Equipment:
Software architecture:
BUDDY AUV was developed specifically for the purpose of exploring human-robot interaction in the underwater environment. It is fully actuated in the horizontal plane and can independently control heave and pitch degree of freedom. The vehicle is equipped with a wide range of sensors required to achieve envisioned functionalities in the underwater environment. BUDDY is 1.27 m long, 0.7 m wide, 0.7 m high and weighs about 70 kg. The basic payload includes:
In addition, the vehicle is equipped with acoustic, stereo and mono cameras. Visual interaction with the diver is achieved through an underwater tablet, mounted in front, capable of displaying messages and alerting the diver when necessary. The vehicle is also equipped with an ARIS multibeam sonar, pointing to the front, which is used to determine diver position when in the vicinity of BUDDY.
The Laboratory for Robotics and Intelligent Control Systems – LARICS is a research laboratory within the University of Zagreb Faculty of Electrical Engineering and Computing at the Department of Control and Computer Engineering. LARICS research is focused on control, robotics and intelligence in the areas of flying, walking and driving robots, manipulation, warehousing, as well as collective and automotive systems.The mission of LARICS is to develop close connections and collaborate with leading partners from academy and industry, take care that own solutions (“know-how”) get approved in the engineering practice satisfying industry needs, take active participation in local and international technical events, and take participation in interdisciplinary and multidisciplinary projects where robotics and control can help in achieving research goals.
Within the project, LARICS will carry out activities that include defining specifications of the heteronomous autonomous robotic system, testing the functioning and efficiency of the system in real conditions, upgrading and modifying robotic platforms, planning robotic system missions, and trajectories, demonstration scenarios, and other activities related to implementation and coordination of the project.
Laboratory for Underwater Systems and Technologies – LABUST is a research laboratory within the University of Zagreb Faculty of Electrical Engineering and Computing at the Department of Control and Computer Engineering. It was established as research laboratory in December 2011. LABUST is at present the only research laboratory with R&D and innovation capabilities for underwater systems and technologies on the east coast of the Adriatic Sea. Laboratory serves as the focal point for applied research and development activities in unmanned marine systems and technology for end-users. Our vision is to advance in multidisciplinary engineering research that innovates, applies, and teaches world-class attainment in autonomous marine systems, sensor processing, and underwater acoustics for marine science, maritime archeology, maritime security, the offshore energy sector, and other applications.
As part of the project, LABUST will develop an Autonomous Surface Vehicle (ASV) that will perform fish farm cage inspection missions autonomously in cooperation with an Unmanned Aerial Vehicle (UAV) and a Remotely Operated Vehicle, ROV). The ROV will be cable-connected to the ASV and will receive control commands from the ASV, while it will send back high-resolution images of the cage. The position and orientation of the ROV will be estimated by the advanced fusion method of inertial and acoustic devices. An innovative cable winding mechanism will allow the ASV to monitor the ROV at a safe distance during cage recording. Also, a landing platform and secure UAV acceptance on the ASV will be developed during the project. Autonomous planning of the ROV mission for the purpose of recording the entire cage and management of the ROV based on computer vision will be at the top of the research goals of the LABUST team.
The activities of the Institute are basic and concern the research of natural features in the Adriatic Sea and its coastline, particularly research into the structure and processes of ecosystems, use and interpretation of scientific information for the benefit of developing and furthering the cooperation of research scientists with similar institutes and scientific groups both nationally and abroad, education and cultural activity, as well as the provision of professional services to interested users. The Institute, in accordance with scientific progress and economic opportunities, also develops other activities, such as: monitoring living marine and land resources, monitoring sea quality, experimental rearing of plant and animal species with the aim of acquiring fundamental knowledge and studying the various stages of natural processes, maintenance and popularization of aquariums, maintenance and popularization of the Botanical Garden on Lokrum, formation of scientific and expert collections, as well as the organization of courses and lectures that reflect on the Institute’s fundamental activities. The Institute has the approval of the Ministry of Environmental Protection, Physical Planning and Construction of the Republic of Croatia for carrying out environmental protection work: elaboration of environmental studies, elaboration of expert studies, and monitoring work.
Within the project, the Institute for Marine and Coastal Research of the University of Dubrovnik will participate in the implementation of activities that include defining system specifications, data analysis and population modelling in mariculture, application of technological solutions for measuring physicochemical parameters of seawater on autonomous underwater vehicles, demonstration scenarios in mariculture, and dissemination of project results.
The Faculty of Agricultureof the University of Zagreb is dedicated to the training of highly qualified experts, development and dissemination of scientific and professional knowledge and modernization, improvement, strengthening competitiveness and encouraging sustainable development in the field of agronomy and related sciences. By applying the highest academic standards, it enables students to acquire competencies based on modern scientific knowledge, for the benefit of society. The vision of the Faculty of Agriculture is to strategically position itself as a leading higher education institution in the Croatian higher education and research area and as an internationally recognized and recognized scientific and educational institution. The general objectives are to promote research and technological development in the field of agronomy, to facilitate the transfer of scientific progress and to assess one’s own technological progress. The Department of Viticulture and Enology operates within the Faculty of Agriculture. Scientific research work at the Department of Viticulture and Enology is focused on problems in the field of physiology, nutrition and ecology of the vine, valorization of various production systems (conventional, sustainable, ecological) as well as technological interventions in the vineyard, soil maintenance, fertilization, breeding systems, ampelotechnical interventions, etc.) and their influence on the yield and quality of grapes and wine. Special attention is paid to the autochthonous assortment of vines, i.e. its inventory, ampelographic and genetic determination. Furthermore, the scientific work covers the problems of nursery production, as well as wine production technology. There is a significant contribution of the Department in continuous cooperation with practice, governmental and non-governmental organizations, and scientific and professional institutions. In recent years, numerous international contacts have been established, which have resulted in very fruitful cooperation with universities and institutes from Europe and the United States.
Within the project, associates from the Faculty of Agriculture will test the effects and adjust the system in real conditions in the vineyard when performing grapevine pruning and pest control treatments, visual and analytical monitoring of system effects compared to conventional manual procedures in the vineyard, field testing of the quality and efficiency of the system, as well as visual and analytical monitoring of the effects of conventional manual procedures and appropriate processing of data collected in the vineyard.