JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10]


Journal of Information Science and Engineering, Vol. 14 No. 2, pp. 305-325


A New Hybrid Learning Algorithm for Non-linear Boundaries


Ching-Hung Wang, Tzung-Pei Hong* and Shian-Shyong Tseng#
Chunghwa Telecommunication Laboratories 
Chungli, 326, Taiwan, R.O.C. 
* Department of Information Management 
I-Shou University 
Kaohsiung, 840, Taiwan, R.O.C. 
# Institute of Computer and Information Science 
National Chiao Tung University 
Hsinchu, 300, Taiwan, R.O.C.


    In this paper, we propose a new hybrid learning algorithm, ETNC, which incorporates the popular decision-tree learning algorithm ASSISTANT into a modified three-layer back-propagation learning method to construct an entropy-tree net classifier. The new learning algorithm also adopts a tree-pruning mechanism to avoid overfitting problems. The new algorithm decreases both the tree size and error rate, especially for complex classification problems. Furthermore, it is not necessary for users to lay out the structure of a tree net in advance; instead, the structure is automatically constructed in the tree-growing process. Finally, the results of experiments in diagnosing brain tumors and classifying sugar canes are described to compare the proposed algorithm with two other learning methods, the back-propagation learning algorithm and ASSISTANT, in terms of accuracy, knowledge complexity and learning speed. Experimental results show that the proposed learning algorithm can provide a good trade-off between accuracy, knowledge complexity and learning speed.


Keywords: back-propagation learning, classification tree, entropy-tree net, information theory

  Retrieve PDF document (JISE_199802_01.pdf)