A new hybrid learning algorithm for non-linear boundaries

Abstract

In this paper, we propose a new hybrid learning algorithm, ETNC, which incorporates the popular decision-tree learning algorithm ASSISTANT into a modified three-layer back-propagation learning method to construct an entropy-tree net classifier. The new Iearning algorithm also adopts a tree-pruning mechanism to avoid overfitting problems. The new algorithm decreases both the tree size and error rate, especially for complex classification problems. Furthermore, it is not necessary for users to lay out the structure of a tree net in advance; instead, the structure is automatically constructed in the tree-growing process. Finally, the results of experiments in diagnosing brain tumors and classifying sugar canes are described to compare the proposed algorithm with two other learning methods, the back-propagation learning algorithm and ASSISTANT, in terms of accuracy, knowledge complexity and learning speed. Experimental results show that the proposed learning algorithm can provide a good trade-off between accuracy, knowledge complexity and learning speed.