Unsupervised query-based learning of neural networks using selective-attention and self-regulation

檔案

日期

1997-03-01

期刊名稱

IEEE TRANSACTIONS ON NEURAL NETWORKS

摘要

Query-based learning (QBL) has been introduced for training supervised network model with additional queried samples, Experiments demonstrated that the classification accuracy is further increased. Although QBL has been successfully applied to supervised neural networks, it is not suitable for unsupervised learning models without external supervisors. In this paper, an unsupervised QBL (UQBL) algorithm using selective-attention and self-regulation is proposed. Applying the selective-attention, we can ask the network to respond to its goal-directed behavior with self-focus. Since there is no supervisor to verify the self-focus, a compromise is then made to environment-focus with self-regulation. In this paper, we introduce UQBL1 and UQBL2 as two versions of UQBL; both of them can provide fast convergence. Our experiments indicate that the proposed methods are more insensitive to network initialization. They have better : generalization performance and can be a significant reduction in their training size.

所屬典藏

期刊論文
顯示完整詮釋資料 統計資料