電腦簡報系統中以手勢替代滑鼠做操控功能

Abstract

本論文的目的是利用一套影像式手勢辨識的技術，在電腦簡報系統中，用 手勢的指揮來取代電腦滑鼠，操控電腦螢幕上的簡報畫面。影像式手勢簡 報系統的畫面控制功能包括：操控簡報畫面的手勢（簡報畫面的上移、下 移、左移、右移、放大、縮小等）；或者移動滑鼠的手勢（選點定位、握 拳）。當分析出屬於操控簡報畫面的手勢，計算滑鼠游標從目前的位置移 動到相對應的功能鍵位移量，再模擬成滑鼠一般傳出的訊號，控制滑鼠去 執行對應的功能；若是移動滑鼠游標的手勢，則我們將兩部攝影機所拍攝 下來的影像，計算出手指在世界座標的三維線方向和投影銀幕的交點，再 由這個計算出來的點去換算成實際簡報者所想要滑鼠移動的位置，如此， 便可以發展出我們所要的手勢操控簡報畫面功能。這套系統的好處在免除 演講者簡報時，需低頭去操作鍵盤、控制滑鼠，或要拿著雷射光筆、指示 棒的麻煩，而直接用自然手勢做簡報，以昇簡報效果。 The thesis is concerned with a technology of vision-based hand gestures recognition. The hand gesture commands will be used to replace mouse to control the monitor screen in a PC presentation system.The control functions in the vision-based hand gestures presentation system include the gestures to control the scrolling of the screen (i.e., screen move up, move down, move left, move right, zoom in and zoom out） and the gestures to position the mouse（i.e., pointing and holding）.If gesture is recognized to be belong to control the monitor screen the translation from the present position to the position of the corresponding function key is determined.If the gesture is for pointing the hand pointing direction is determined from the two images captured by the two camera. The mouse will move to that position. Thus we can replace the mouse functions using hand gestures.The advantage of this system is to allow the presenter not to use the keyboard or mouse or the laser pen to control the scrolling of the monitor picture for a PC presentation system. He simply uses the hand gestures.