雲端互動視訊動態標記追蹤之研究

Abstract

遠距視訊溝通之技術已普遍應用於日常生活、商務會議、互助教學及線上直播等情境，當視訊場景中有特殊的物件需要被提示時，標記功能發揮了簡而有力的作用，然而，視訊內容會隨著時間產生動態的變化，固定式的標記可能會因為畫面的變化而失去原有的指示作用而造成誤導；為解決此問題，我們提出了一種具有物件追蹤能力的「動態標記」，可以在視訊畫面上隨著物件的移動而改變標記的位置，由於此功能實作在「交大資工類神經網路實驗室團隊」所開發的「雲端服務視訊互助平台」上，為了讓多數網路上的使用者可以使用此功能，需盡量減少客戶端在電腦運算上的負擔，故將追蹤功能的運算交與伺服器端來處理，這也有別於一般視訊擷取與物件追蹤皆在同一機器上運算之模式。

The technology of communicating through video has been widely used in daily life, such as business conferences, education and live broadcasting. When a moving objects need to be pointed and tracked in the video, the moving marking is useful. Since the content of video may change over time, the fixed mark may lose the original instruction and causes misleading because of the changes in the scene. To solve this problem, we propose “movable mark”, which has capability to track the object been marked, that means the “movable mark” can change the location to where the object moves to. Furthermore, this movable mark is implemented at the “Cloud Remote Service Platform”, which is developed by the team of NNlab in CS department, NCTU. To allow most of users at www or internet being able to use the function, the burden of computing at the client-side need to be minimized, so the computing of object tracking will be handed over to the server-side. It is different from the general mode that the video encoding and the object tracking are computing by one computer.