Visual-Haptics for Remote Robot Operation, Inspection & Physical Intervention

visualhaptics.kuqu@gmail.com
Research

Research Vision and Scientific Motivation

Building intuitive, safe, and deployment-ready teleoperation systems through visual-haptic feedback, predictive control, and immersive human-robot interaction.

Research Vision

The central vision of this project is to make remote robot operation more intuitive, reliable, and safe by tightly coupling human perception and machine intelligence. We treat teleoperation not merely as remote command transmission, but as a human-robot interaction problem in which perception, action, feedback, and safety must be jointly designed.

The proposed framework combines visual sensing, haptic feedback, immersive XR interfaces, and predictive control into a unified operational stack. This enables operators to better perceive environmental geometry, anticipate motion constraints, and execute contact-rich tasks with improved confidence and precision.

Scientific Motivation

Remote operation in underwater and agricultural settings remains difficult because operators often work with incomplete sensory information, uncertain contact dynamics, and limited situational awareness. Visual-only interfaces can mask force cues, obscure proximity information, and increase cognitive load during fine intervention.

These limitations become especially critical when the task involves inspection near infrastructure, delicate interaction with crops, or physical contact in cluttered or partially observable environments. A visual-haptic interface offers a path toward richer telepresence, improved operational safety, and more reliable robot-environment interaction.

Research Questions

Core Scientific Questions

RQ1

How can visual and haptic feedback be fused into a coherent operator interface for robotic navigation, inspection, and intervention?

RQ2

How can predictive control improve safety, maneuverability, and transparency during teleoperation under uncertain conditions?

RQ3

Which metrics best capture both robotic system performance and human operator experience in immersive teleoperation?

RQ4

How transferable is a unified visual-haptic framework across terrestrial and underwater robotic platforms?

Scientific Themes

Methodological Pillars

Multimodal Telepresence

Improving operator understanding of robot state, environmental structure, and contact events through visual-haptic perception.

Predictive Safety Control

Developing safety-aware control strategies that anticipate risk and support safer maneuvering under uncertainty.

Human Factors Evaluation

Assessing workload, usability, confidence, presence, and task efficiency in immersive operator-in-the-loop scenarios.

Cross-Domain Validation

Testing framework robustness and transferability across underwater inspection and greenhouse intervention tasks.