JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]


Journal of Information Science and Engineering, Vol. 40 No. 3, pp. 521-538


Few Shot Multiple-Font Character Recognition for Ship Monitoring


LI-CHIEH CHANG1, JUN-WEI HSIEH1, CHUAN-WANG CHANG2,
DENG-YUAN HUANG3 AND YU-SHIUAN TSAI1
1College of Artificial Intelligence and Green Energy
National Yang Ming Chiao Tung University
Tainan, 300 Taiwan
E-mail: jwhsieh@nycu.edu.tw

2Department of Computer Science and Information Engineering
National Chin-Yi University of Technology
Taichung, 411 Taiwan
E-mail: cwchang@ncut.edu.tw

3Department of Electrical Engineering
Da-Yeh University
Changhung, 515 Taiwan
E-mail: kevin@mail.dyu.edu.tw


To effectively manage ships and maintain the safety of port and territorial waters, ship plate recognition is an essential technology. However, there are many different font styles in actual scenes because there is no unified format. Among them, the handwritten font is the most changeable. These complex and changeable font styles will cause difficul-ties in recognizing ship plates. Furthermore, handwritten ship plates are unique in data collection, which means that it is impossible to collect enough fonts of the same style or all ship plates for training. In this paper, we propose a text recognition model architecture that simulates human learning and literacy to solve the problem of few-shot multifont, which is called learning by analysis (LBA). Humans can recognize multiple types of char-acter through pre-train knowledge. Referring to this concept, LBA is a twin network com-posed of a benchmark model (BM) and an extended model (EM). BM builds a hypothesis space based on standard fonts, and then EM learns to recognize variable text based on BM through high-dimensional feature mapping and aggregation of embedded spaces. In addi-tion, we also propose a type change block without training, which increases the complexity of the data by making complex type changes to the text. Experiments show that the method achieves 96% accuracy on NIST. The accuracy of ship plate recognition in natural scenes is as high as 91%, which shows that our method has a robust generalizability.


Keywords: few-shot, multiple-font text recognition, ship plate recognition, ship monitoring, deep learning

  Retrieve PDF document (JISE_202403_06.pdf)