適用於內嵌光感測器顯示器之多使用者及多點互動系統

Abstract

隨著互動技術的不斷演進，人機互動的方式已經從平面上的觸碰躍升至空間上的互動。三維互動系統不僅可以提供更加人性化的操作方式，更可令使用者與立體影像的互動更有真實感。然而，隨著可攜式電子產品在生活上的重要性不斷提升，至今卻仍未發展出適用在可攜式電子產品上的三維互動系統。為了滿足可攜式電子產品在可攜性以及互動範圍上的要求，使用結合內嵌式光感測器之顯示器以及外加光筆的互動系統會是相當不錯的選擇。 在這樣的架構下，本論文提出三種不同的三維互動系統以滿足不同的需求。 T Mark System 利用貼有T型遮罩的光筆來進行互動。藉由分析內嵌式光學感測器所捕捉到的影像，光筆的三維座標(X, Y, and Z)、旋轉與傾斜的角度(θ and φ)都可以被計算出來。為了辨識更複雜的動作，本論文提出了兩種不同的用途的三維多點互動系統。Color Filter Based 利用可見光之光筆以及顯示器既有的彩色濾光片來判別出個別光筆的三維位置。此架構在影像嚴重重疊時亦能運作，故此架構適合使用於單使用者的多點觸碰。然而使用可見光做為互動光源會降低顯示器的影像品質。為了解決這個議題，Multi-Mark Based利用紅外光取代可見光來做為互動光源。藉由在不同的光源上貼上不同的遮罩並分析所擷取到的影像，亦可以獲得不同光筆的三維位置。然而此系統在分析重疊影像的能力較不足，此系統較適合使用於多位使用者的單點互動。

In recent years, interactive systems have been evolving from 2D touch into 3D interaction. 3D interactive systems can not only provide intuitive operation but also sense of reality when users interacting with 3D images. However, little research has been done on the 3D interactive systems applied on portable devices. For satisfying the requests of portable devices, 3D interactive systems combined embedded optical sensor and additional light sources will be a better solution. In this structure, we propose three kinds of 3D interactive systems for different requirements. T Mark System uses light source pasted with T mark to detect the 3D positions (X, Y, and Z)、rotation angle (θ) and tilt angle (φ) of single user. For detecting more complex actions, two multi-interactive systems will be proposed. Color Filter Based uses visible light sources and color filters to distinguish different light sources and calculating the 3D positions of each light source. This system is still workable when the projections of light sources are seriously overlapping. However, the visible light sources will reduce the image quality of display. For solving this issue, Multi-Mark Based replaces the visible light sources by IR light sources pasted with different marks. After analyzing the projections of these light sources, the 3D positions of each light source can be obtained. However, Multi-Mark Based cannot detect certain overlapping conditions perfectly. This system is suitable for multi-user.