一個結合資訊檢索與影像辨識技術的行動商品評鑑平台

Abstract

近年來，隨著社會經濟的發展與成長，消費者的購買行為在近幾年發生了顯著的變化，這種變化主要表現為消費者的衝動購買(Impulse Buying)急速上升。由於網際網路的普及與便利性，國人利用網路搜尋商品評價或評論的需求越來越多，未來對於商品比價資訊與推薦的應用也將隨著行動網路的擴展而更為重要。本研究有鑑於商品評鑑與行動服務的需要，提出一套有效的決策支援系統(Decision Support System, DSS)-行動式商品評鑑平台(Mobile Merchandise Evaluation Platform, MMEP)，包含即時商品辨識子系統(Real-time Merchandise Identification Subsystem, RMIS)、商品評論建議子系統(Merchandise Evaluation Subsystem, MES)、以及商品比價推薦子系統(Merchandise Recommendation Subsystem, MRS)以提供即時之商品評鑑服務相關商品資訊的推薦。其中，即時商品辨識子系統(RMIS)利用區塊相鄰圖(Region Adjacency Graph, RAG)和自我組織映射圖網路(Self-Organizing Maps, SOM)學習各個商品影像特徵，並有效進行分類，影像辨識正確率可達81.25%。商品評論建議子系統(MES)結合多文件自動摘要技術(Multiple Document Summarization, MDS)和化妝品評論詞彙本體論(Merchandise Comment Term Ontology, MCTO)，取得商品評論摘要，並經領域專家評論摘要語句比對後，正確率可達78%，以幫助使用者於短時間判斷及取得重要購買決策參考資訊。

Consumers’ purchasing behavior has obviously changed in recent years with developments in social economics. This change has been evident in the decreased ratio of planned purchases but not in the increase of planned (or spontaneous) purchases. This act of spontaneous or otherwise unplanned purchasing is called “impulse buying”. However, buying under these conditions costs more money always comes with negative responses, such as complaints and regret. Therefore, we propose and have designed a new Merchandise Recommendation Subsystem, the Mobile Merchandise Evaluation Platform (MMEP). This is a three-tier system composed of Real-time Merchandise Identification Subsystem (RMIS), Merchandise Evaluation Subsystem (MES), and Merchandise Recommendation Subsystem (MRS). With this system, Mobile Users (MUs) take pictures of merchandise and send them to MMEP, RMIS integrates Region Adjacency Graph (RAG) and Self-Organizing Maps (SOM) to gather information on the merchandise through those photographs. MES and MRS provide Intelligence Agents (IAs) and Multiple-Document Summarization (MDS) to summarize recommendations on merchandise for MUs, all in real time.