An autonomous dynamic camera method for effective remote teleoperation

Rakita, D., B. Mutlu, and M. Gleicher. “An Autonomous Dynamic Camera Method for Effective Remote Teleoperation”. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, ACM, 2018.


In this paper, we present a method that improves the ability of remote users to teleoperate amanipulation robot arm by continuously providing them with an effective viewpoint using a secondcamera-in-hand robot arm. The user controls the manipulation robot usinganyteleoperation interface, and the camera-in-hand robot automatically servos to provide a view of the remote environment that is estimated to best support effective manipulations. Our method avoids occlusions with the manipulation arm to improve visibility, provides context and detailed views of the environment by varying the camera-target distance, utilizes motion prediction to cover the space of the user»s next manipulation actions, and actively corrects views to avoid disorienting the user as the camera moves. Through two user studies, we show that our method improves teleoperation performance over alternative methods of providing visual support for teleoperation. We discuss the implications of our findings for real-world teleoperation and for future research.

DOI: 10.1145/3171221.3171279


	doi = {10.1145/3171221.3171279},
	url = {},
	year = 2018,
	month = {feb},
	publisher = {{ACM}},
	author = {Daniel Rakita and Bilge Mutlu and Michael Gleicher},
	title = {An Autonomous Dynamic Camera Method for Effective Remote Teleoperation},
	booktitle = {Proceedings of the 2018 {ACM}/{IEEE} International Conference on Human-Robot Interaction}