標題: Virtual Reality Control of a Robotic Camera Holder for Minimally Invasive Surgery
作者: Zinchenko, Kateryna
Komarov, Oleksii
Song, Kai-Tai
生物科技學系
電控工程研究所
電機資訊國際碩士學位學程
Department of Biological Science and Technology
Institute of Electrical and Control Engineering
EECS International Graduate Program-Master
關鍵字: Virtual reality;minimally invasive surgery;real-time image processing;robot control
公開日期: 1-Jan-2017
摘要: This paper presents a virtual reality(VR) control system for a robotic endoscope holder for minimally invasive surgery (MIS). The system features a three degree of freedom(DOF) robotic endoscope holder, virtual reality head mounted display and a control system that allows robot to follow headset movement. The headset display is aligned with endoscope camera view thus creating a full presence effect for a surgeon. The video from endoscope is streamed to the virtual reality head mounted display after image processing in a computer. During surgery, the proposed control system generates commands to the robot based on the headset's positioning data. After the desired camera motion direction is estimated, the robotic endoscope holder receives motion commands through serial interface. The proposed virtual reality robot control system is implemented in Unity. The system has been tested in the laboratory environment through a set of motion tests and achieved a response latency of 2s. The proposed system is able to restore the surgeon's perceptual capability of the operation space that is highly restricted in MIS and provide highly intuitive endoscope robot control.
URI: http://hdl.handle.net/11536/147064
期刊: 2017 11TH ASIAN CONTROL CONFERENCE (ASCC)
起始頁: 970
結束頁: 975
Appears in Collections:Conferences Paper