應用在雲端架構的 巨量資料匯集與散布方法研究

Abstract

為了分享來自於不同來源的網路資源，網路服務描述語言(WSDL) 在過去被提出。它提供一致性且容易閱讀的介面使得資訊/資料可以在網路上交流。此後，應用服務創造者可以聚合來自於不同來源但介面已知的網路服務，進而組成符合使用者複雜需求的新服務。 本論文將探討當運作中的資訊系統所聚合的網路服務規模及資料量變得愈來愈大時，有那些特性值得探索？ 在此前提下，有些特性將變的顯著，像是面對巨量資料的情境，如何友善地匯集及傳播資訊；如何有效率，有價值的操弄巨量資料集。是故，本研究將探索如何設計基於雲端架構的巨量資訊聚合及散布方法。 此外，影像安全監控領域對於本論文所提出的問題而言，是相當合適的例証。因為對於資料匯集來源而言，同時部署的終端裝置有時會超過數千組；另一方面，對於傳播資訊而言，特定部署在熱點的監控攝影機畫面可能會有大量的人同時進行查看。另外，在安全監控產業裡，已有組織訂定通用的網路服務協定，用來相容來自於不同廠商的裝置。但它卻缺少適用於多機管理的協定，比如在多組錄影裝置之間的抽象化的管理介面及容錯控制機制。因此，本研究也以影像安全監控領域為例，設計合適的網路服務聚合介面，提供統一的存取接口及容錯功能。本論文所提出的網路服務補足了先前研究及現有產業標準的不足之處。

In order to be able to share network resource amount via different sources, the Web Service Description Language (WSDL) was proposed. It provides an easy-to-understand interface for information exchange over Internet. Afterward, the application innovators can mash up different Web Services together to create new service models. This is the origin of Web Service composition. This dissertation will be discussing which features are worth exploring when the scale of information system who composed from Web Services got too large. Under this topic, several characteristics become significant, such as how to friendly aggregate and spread information as well as how to manipulate large scale data set; More specifically, this study will be exploring the design of cloud-based infrastructure for large scale information collection and distribution. In addition, the video surveillance field is a quite suitable example for the proposed problem. Since the use of information aggregation, the number of simultaneously deployed terminal devices might exceed thousands of units. On the other hand, for information distribution, the cameras which are deployed in hotspot area might have large number of people watching at the same time. Besides, there are commonly used device interoperability Web Service protocol in surveillance industry, but lacking large scale manage protocol such as management interface abstraction and fault-tolerance control between multi recording devices. Hence, this study also takes the video surveillance application as an example to design an appropriate Web Service aggregation interface for unified access entrance and fault-tolerance functionality. The proposed Web Service complement the shortcomings of previous research and existing industry standards