VR Remote of Autonomous Mobile Robot from INESC TEC Using RICOH THETA Z1

Congratuations to @Manuel_Couto for building his project up to this state.

2024 | Industry and Innovation Laboratory @ INESC TEC

This may be the developer.

RICOH THETA Z1 in 3D printed case

Manual intervention of autonomous operation.

Pedal control

Autonomous mobile robots (AMRs) often face situations beyond their programmed capabilities, leading to downtime and the need for on-site operator intervention. For companies with large AMR fleets, this means interruptions, increased costs, and risks, especially in hazardous environments where human presence is less than ideal.

Our VR teleoperation system transforms AMR control by enabling operators to remotely take charge in real time, using a 5G network. From the comfort of an office, a single operator can now supervise and seamlessly assist multiple AMRs. With this system, downtime is significantly reduced, and workers can stay out of high-risk environments, enhancing both safety and efficiency.

Through VR, operators gain an immersive, ultra-low-latency view of the AMR’s environment with a 360º camera and two limited FoV auxiliary cameras, offering superior depth perception and an accurate sense of presence. Operators control the AMR with a steering wheel, pedals, and joysticks, achieving responsive handling with a glass-to-glass latency as low as 200 ms over 5G. This solution combines the latest in VR and 5G technology, ensuring an immersive experience that surpasses traditional remote-control methods in both depth and situational awareness.

Produtech R3 Agenda of PRR

Industry and Innovation Laboratory: https://www.inesctec.pt/pt/laboratori

PRR: https://www.recuperarportugal.gov.pt

Produtech: Agenda Mobilizadora da Fileira das Tecnologias de Produção para a Reindustrialização | PRODUTECH R3 - Recuperação-Resiliência-Reindustrialização