ABOUT

Project HEKTOR

Heterogeneous autonomous robotic system in viticulture and mariculture – HEKTOR is an EU-funded project coordinated by the Laboratory for Robotics and Intelligent Control Systems (LARICS) & Laboratory for Underwater Systems and Technologies (LABUST) of the University of Zagreb Faculty of Electrical Engineering and Computing (UNIZG FER).

Duration: 13/3/2020-31/3/2023

Budget: 5.794.060,14 HRK

Financed by: ESI European Region Development Fund

Coordinator: University of Zagreb Faculty of Electrical Engineering and Computing

Partners: University of Dubrovnik – Institute for Marine and Coastal Research, University of Zagreb Faculty of Agriculture

PROJECT PHASES

INDUSTRIAL RESEARCH

The existing vineyard cultivation process will be analysed in detail, as well as the methods use in fish cage farming to isolate one process and those processes that can be improved by introducing a heterogeneous autonomous robotic system. Such isolated procedures will be the basis for innovative solutions that will facilitate human work in difficult conditions (high slopes, large plantation areas, long dives at greater depths, adverse weather conditions, etc.).

The next step will be the upgrade/adaptation of the existing and newly acquired robotic platforms making them an integral part of a complex robotic system (innovative solutions are expected in the field of robotic manipulation). Finally, the prototypes of the robotic platforms will be tested in a laboratory environment. Once the functionality of individual platforms has been verified under laboratory conditions, the laboratory will test the entire system – checking the communication systems and coordinated actions of the platform (innovative solutions are expected in the area of ​​coordinated and cooperative management of robotic platforms).

EXPERIMENTAL DEVELOPMENT

Experimental development will take place through demonstration activities in an environment that reflects operational real-life conditions (vineyards in Pelješac and Korčula and fish cages in the Zadar area), as described in Project Element 4: Demonstration scenarios. After each field test, the results will be analysed and the necessary modifications to the system elements will be made and the testing will be performed again in operational conditions. This iterative process will be repeated in several steps, minimizing possible system design errors.

RESEARCH AND DEVELOPMENT

Viticulture

Mariculture

Robotic system

ROBOTIC SYSTEM DEVELOPMENT

Mobile robot ViV

The exploratory robot VIV was designed and constructed at The Laboratory for Robotics and Intelligent Control Systems. Its purpose is to autonomously move in various challenging environments, such as ruins or steep slopes. Its well-designed drive provides it with effective mobility in challenging terrain (obstacles, stairs), as well as the ability to transport heavy loads, even of the weight of an adult human. The robot is equipped with multiple sensors, and its design allows it to function in explosive and dangerous environments.

Unmanned Aerial Vehicle (UAV)

Unmanned Aerial Vehicle (UAV) is a quadcopter equipped with RTK-GPS system, RGB and thermal cameras, LIDAR, force sensor and on-board computer for real-time data processing and storage. UAV has extended flight time and it is capable of executing autonomus take-off and landing procedures on rough terrain or on Unmanned Surface Vehicle

Vehicle applications:
• Aerial vineyard and fish farms monitoring
• Terrain mapping
• Data colecting for point colud generation
• Data acquisition for ground and underwater robots
• Flying platform for robot manipulators

Vehicle specifications:
• Size (W x L x H) 800mm x 800mm x 500mm
• Weight in air 8kg
• Carbon fiber frame
• 4 brushless motors with maximum thrust of 22 inch propellers
• Horizontal speed up to 10 m/s, vertical speed up to 5 m/s
• 40 min of flight autonomy
• Pixhawk autopilot
• Intel-NUC on-board computer
• RGB camera, thermal camera, LIDAR, force sensor

Autonomous Surface Vehicle H2Omni-X

The autonomous surface platform is over-actuated with 4 thrusters forming the ”X” configuration. This configuration enables symmetrical motion in the horizontal plane under any orientation. The platform has been developed at the University of Zagreb Faculty of Electrical Engineering and Computing, Laboratory for Underwater Systems and Technologies. The platform was primarily developed for dynamic positioning and diver following and since then its application was extended to execution of multiple autonomous tasks.

Vehicle applications:

  • Control algorithm testing
  • Multivehicle cooperative control
  • Diver tracking
  • Diver communication and navigation
  • Sensor calibration and navigation algorithm testing

Vehicle specifications:

  • Size (W x L x H) 756mm x 756mm x 385mm
  • Weight in air 25kg
  • Carbon-fibre hull
  • Speed Up to 2 knots
  • Horizontal Thrusters 4 x 100w(200w)
  • 3 to 6 hours autonomy

Sensors & Equipment:

  • IMU + GPS navigation module
  • WiFi communication with the base or other vehicles
  • Camera above water and/or underwater
  • Profiling sonar iWBMSe Norbit
  • SeaTrac USBL Blueprint
  • LinkQuest DVL
  • BlueView DF900/2250

Software architecture:

  • Robot Operating System
  • Cascade low-level control system
  • EKF navigation and target tracking
  • Path and Trajectory following
  • Neptus mission planning support

Autonomous Underwater Vehicle BUDDY

BUDDY AUV was developed specifically for the purpose of exploring human-robot interaction in the underwater environment. It is fully actuated in the horizontal plane and can independently control heave and pitch degree of freedom. The vehicle is equipped with a wide range of sensors required to achieve envisioned functionalities in the underwater environment. BUDDY is 1.27 m long, 0.7 m wide, 0.7 m high and weighs about 70 kg. The basic payload includes:

  • U-blox Neo 5M GPS
  • Microstrain GX3 intertial measurement Unit (IMU)
  • LinkQuest Navquest 600M Doppler velocity logger (DVL)
  • Ubiquiti wireless communication
  • 48 V lithium battery
  • VideoRay Pro4 brushless thrusters

In addition, the vehicle is equipped with acoustic, stereo and mono cameras. Visual interaction with the diver is achieved through an underwater tablet, mounted in front, capable of displaying messages and alerting the diver when necessary. The vehicle is also equipped with an ARIS multibeam sonar, pointing to the front, which is used to determine diver position when in the vicinity of BUDDY.

Project partners

FER LARICS

FER LABUST

Institute for Marine and Coastal Research

Faculty of Agriculture

The Laboratory for Robotics and Intelligent Control Systems – LARICS is a research laboratory within the University of Zagreb Faculty of Electrical Engineering and Computing at the Department of Control and Computer Engineering. LARICS research is focused on control, robotics and intelligence in the areas of flying, walking and driving robots, manipulation, warehousing, as well as collective and automotive systems.The mission of LARICS is to develop close connections and collaborate with leading partners from academy and industry, take care that own solutions (“know-how”) get approved in the engineering practice satisfying industry needs, take active participation in local and international technical events, and take participation in interdisciplinary and multidisciplinary projects where robotics and control can help in achieving research goals.

Within the project, LARICS will carry out activities that include defining specifications of the heteronomous autonomous robotic system, testing the functioning and efficiency of the system in real conditions, upgrading and modifying robotic platforms, planning robotic system missions, and trajectories, demonstration scenarios, and other activities related to implementation and coordination of the project.

Laboratory for Underwater Systems and Technologies – LABUST is a research laboratory within the University of Zagreb Faculty of Electrical Engineering and Computing at the Department of Control and Computer Engineering. It was established as research laboratory in December 2011. LABUST is at present the only research laboratory with R&D and innovation capabilities for underwater systems and technologies on the east coast of the Adriatic Sea. Laboratory serves as the focal point for applied research and development activities in unmanned marine systems and technology for end-users. Our vision is to advance in multidisciplinary engineering research that innovates, applies, and teaches world-class attainment in autonomous marine systems, sensor processing, and underwater acoustics for marine science, maritime archeology, maritime security, the offshore energy sector, and other applications.

As part of the project, LABUST will develop an Autonomous Surface Vehicle (ASV) that will perform fish farm cage inspection missions autonomously in cooperation with an Unmanned Aerial Vehicle (UAV) and a Remotely Operated Vehicle, ROV). The ROV will be cable-connected to the ASV and will receive control commands from the ASV, while it will send back high-resolution images of the cage. The position and orientation of the ROV will be estimated by the advanced fusion method of inertial and acoustic devices. An innovative cable winding mechanism will allow the ASV to monitor the ROV at a safe distance during cage recording. Also, a landing platform and secure UAV acceptance on the ASV will be developed during the project. Autonomous planning of the ROV mission for the purpose of recording the entire cage and management of the ROV based on computer vision will be at the top of the research goals of the LABUST team.

The activities of the Institute are basic and concern the research of natural features in the Adriatic Sea and its coastline, particularly research into the structure and processes of ecosystems, use and interpretation of scientific information for the benefit of developing and furthering the cooperation of research scientists with similar institutes and scientific groups both nationally and abroad, education and cultural activity, as well as the provision of professional services to interested users. The Institute, in accordance with scientific progress and economic opportunities, also develops other activities, such as: monitoring living marine and land resources, monitoring sea quality, experimental rearing of plant and animal species with the aim of acquiring fundamental knowledge and studying the various stages of natural processes, maintenance and popularization of aquariums, maintenance and popularization of the Botanical Garden on Lokrum, formation of scientific and expert collections, as well as the organization of courses and lectures that reflect on the Institute’s fundamental activities. The Institute has the approval of the Ministry of Environmental Protection, Physical Planning and Construction of the Republic of Croatia for carrying out environmental protection work: elaboration of environmental studies, elaboration of expert studies, and monitoring work.

Within the project, the Institute for Marine and Coastal Research of the University of Dubrovnik will participate in the implementation of activities that include defining system specifications, data analysis and population modelling in mariculture, application of technological solutions for measuring physicochemical parameters of seawater on autonomous underwater vehicles, demonstration scenarios in mariculture, and dissemination of project results.

The Faculty of Agricultureof the University of Zagreb is dedicated to the training of highly qualified experts, development and dissemination of scientific and professional knowledge and modernization, improvement, strengthening competitiveness and encouraging sustainable development in the field of agronomy and related sciences. By applying the highest academic standards, it enables students to acquire competencies based on modern scientific knowledge, for the benefit of society. The vision of the Faculty of Agriculture is to strategically position itself as a leading higher education institution in the Croatian higher education and research area and as an internationally recognized and recognized scientific and educational institution. The general objectives are to promote research and technological development in the field of agronomy, to facilitate the transfer of scientific progress and to assess one’s own technological progress. The Department of Viticulture and Enology operates within the Faculty of Agriculture. Scientific research work at the Department of Viticulture and Enology is focused on problems in the field of physiology, nutrition and ecology of the vine, valorization of various production systems (conventional, sustainable, ecological) as well as technological interventions in the vineyard, soil maintenance, fertilization, breeding systems, ampelotechnical interventions, etc.) and their influence on the yield and quality of grapes and wine. Special attention is paid to the autochthonous assortment of vines, i.e. its inventory, ampelographic and genetic determination. Furthermore, the scientific work covers the problems of nursery production, as well as wine production technology. There is a significant contribution of the Department in continuous cooperation with practice, governmental and non-governmental organizations, and scientific and professional institutions. In recent years, numerous international contacts have been established, which have resulted in very fruitful cooperation with universities and institutes from Europe and the United States.

Within the project, associates from the Faculty of Agriculture will test the effects and adjust the system in real conditions in the vineyard when performing grapevine pruning and pest control treatments, visual and analytical monitoring of system effects compared to conventional manual procedures in the vineyard, field testing of the quality and efficiency of the system, as well as visual and analytical monitoring of the effects of conventional manual procedures and appropriate processing of data collected in the vineyard.

Project team

FER - Laboratory for Robotics and Intelligent Control Systems (LARICS)

Prof. Dr. Sc. Zdenko Kovačić
Project Coordinator, Steering Committee
Prof. Dr. Sc. Stjepan Bogdan
Researcher
Assoc. Prof. Dr. Sc. Matko Orsag
Researcher
Ivo Vatavuk
Young Researcher
Ivan Hrabar
Young Researcher
Jurica Goričanec
Young Researcher
Ana Golec
Project Administrator

FER - Laboratory for Underwater Systems and Technologies (LABUST)

Prof. Dr. Sc. Nikola Mišković
Researcher
Prof. Dr. Sc. Gordan Gledec
Researcher, Steering Committee
Nadir Kapetanović
Young Researcher

University of Dubrovnik – Institute for Marine and Coastal Research

Assist. Prof. Dr. Sc. Nenad Antolović
Researcher
Dr. Sc. Jakša Bolotin
Researcher
Dr. Sc. Nikša Glavić
Researcher, Steering Committee
Dr. Sc. Valter Kožul
Researcher
Antonia Kurtela
Young Researcher

University of Zagreb Faculty of Agriculture

Prof. Dr. Sc. Bernard Kozina
Researcher, Steering Committee
Marina Anić
Researcher