以立體視覺為基礎的新視訊監控技術與應用之探討

Abstract

隨著立體電腦視覺技術之進步，立體視覺裝置之應用也日新月異，而有別於傳統監 控技術以二維感測器為基礎，本計晝擬利用三年時間，以Kinect視訊感測器與環場攝影 機為基礎，嘗試各種新型立體視訊感測組態，建立新式的立體視覺監控糸統，做更精密 的環境模式建構，並探討各種更有效益的視訊監控應用，包括室内人物活動監控糸統、 車輛週遭環境監控糸統，以及監控視訊保護糸統。

更詳言之，本計晝擬以三年時間進行下列研究主題及項目。

(I)第一年研究主題一以多Kinect視訊感測器組合作室内立體環境與人物活動監控

(1)研究項目一：室内立體環境監控系統之建構

•多Kinect視訊感測器組合之佈建 •多Kinect視訊感測器之校正 •立體環境模式之建構

(2)研究項目二：人物活動之偵測

•以測距資料(range data)與影像之比對作人物之偵測 •整合多機資料建立有細緻完整面像之人體 •人物特徵之抽取

(3)研究項目三：人物活動之追蹤與瀏覽 •多攝影機組間之換手問題

•從時空上整合對人物的立體追蹤序列與展示 •人物活動之瀏覽

(II)第二年研究主題一以多元立體視訊感測器作環車景物監控

(1)研究項目一：多元立體感測系統之建構

•雙環場攝影機糸統之佈建、校正及立體資料擷取 •環車多Kinect組合之佈建、校正及立體資料擷取 •雙環場攝影機與環車多Kinect感測器資料之整合

(2)研究項目二：汽車周遭立體環車行車紀錄器之應用 •環車景物立體環境之建構

•環車景物立體環境之瀏覽 •立體環車行車紀錄器之應用

(3)研究項目三：汽車周遭立體環境監控系統之應用 •靜態汽車周遭環境監控

•動態汽車周遭環境監控 •遙控測量學

(III)第三年研究主題一以多Kinect視訊感測器組合作室内特定空間之監控快速瀏 覽、隱私消除與多元視訊保護

(1)研究項目一：室内特定空間之監控快速瀏覽

•立體視訊之結構建立與儲存 •有活動片段index之建立與隱藏 •有活動片段之快速瀏覽

(2)研究項目二：室内特定空間之隱私消除

•隱私區域劃定與取代 •隱私區域之隱藏 •隱私區域之回復

(3)研究項目三：監控視訊之多元保護

•立體監控視訊之驗證 •立體監控視訊之安全保存 •立體監控視訊之版椎保護

With the advances in 3D computer vision technology, the applications of 3D devices are widened day by day. Different from traditional video surveillance techniques which are based on the use of 2D visual sensors, this 3-year project tries to use Microsoft Kinect sensors and omni-cameras to establish various 3D visual sensing configurations and construct new-type 3D video surveillance systems for the purposes of measuring more accurate 3D environmental models and investigating more effective video surveillance applications. Specifically, the application systems for monitoring indoor human activities, watching outdoor car surrounds, and protecting surveillance videos will be investigated and constructed.

In more detail, the following research topics and items will be investigated in this 3-year project.

(I) lst-year topic — Monitoring of Indoor Environments and Human Activities Using

Multiple Kinect Sensors

(1) Construction of a 3D indoor surveillance system

• Deployment of multiple Kinect sensors

• Calibration of multiple Kinect sensors

• 3D modeling of indoor environments

(2) Detection of human activities

• Human detection by matching of range data and images

• Construction of a detailed and full human figures by integrating multiple Kinect camera information

• Extraction of human features

(3) Tracking and browsing of human activity videos

• Camera hand-off between multiple Kinect camera devices

• Integration and displays of 3D tracking sequences on space-time dimensions

• Browsing of human activities

(II) 2nd-year topic —Vehicle-Surround Video Surveillance using Multiple Stereo

Video Cameras and Kinect Sensors

(1) Construction of a multiple-stereo-video-camera system

• System construction and calibration of the multiple stereo video camera system and 3D data acquisition with the system

• System construction and calibration of multiple vehicle-surrounding Kinect sensors and 3D data acquisition using the system

• Data integration of the multiple stereo video camera system and the multiple vehicle-surrounding Kinect sensors

(2) Vehicle-Surrounding Stereo Event Data Recorder and Its Applications

• Modeling of vehicle-surrounding environments

• Browsing of vehicle-surrounding environments

• Applications of stereo event data recorders

(3) Vehicle-Surrounding Stereo Surveillance System

• Vehicle-surrounding surveillance of a static vehicle • Vehicle-surrounding surveillance of a moving vehicle

• Application for Telemetrics

(III) 3rd-year topic ~Quick browsing, privacy removal, and protection of

surveillance videos in indoor environments using multiple Kinect sensors

(1) Quick browsing of the surveillance video in indoor environments

• Creation and keeping of the 3D video structures

• Creation and hiding of the indexes of video activities

• Quick browsing of video activities

(2) Privacy removal of the surveillance video in indoor environment

• Delimitation and replacement of the privacy region

• Hiding of the privacy region

• Recovery of the privacy region

(3) Protection of the surveillance video in indoor environment

• Authentication of 3D surveillance videos

• Secure keeping of 3D surveillance videos

• Copyright protection of 3D surveillance videos