ERCS: An Efficient and Robust Card Recognition System for Camera-Based Image  

作　　者：Zhonghong Ou Baiqiao Xiong Fenrui Xiao Meina Song 

机构地区：[1]Beijing University of Posts and Telecommunications No.10 Xitucheng Road,Haidian District,Beijing 100876,China

出　　处：《China Communications》2020年第12期247-264,共18页中国通信（英文版）

基　　金：This work was supported by the National Natural Science Foundation of China(Grant No.61702046);National Key R&D Program of China(Grant No.2017YFB1401500 and 2017YFB1400800).

摘　　要：Cards Recognition Systems,(CRSs)are representative computer vision-based applications.They have a broad range of usage scenarios.For example,they can be used to recognize images containing business cards,personal identification cards,and bank cards etc.Even though CRSs have been studied for many years,it is still difficult to recognize cards in camera-based images taken by ordinary devices,e.g.,mobile phones.Diversity of viewpoints and complex backgrounds in the images make the recognition task challenging.Existing systems employing traditional image processing schemes are not robust to varied environment,and are inefficient in dealing with natural images,e.g.,taken by mobile phones.To tackle the problem,we propose a novel framework for card recognition by employing a Convolutional Neutral Network(CNN)based approach.The system localizes the foreground of the image by utilizing a Fully Convolutional Network(FCN).With the help of the foreground map,the system localizes the corners of the card region and employs perspective transformation to alleviate the effects from distortion.Text lines in the card region are detected and recognized by utilizing CNN and Long Short Term Memory,(LSTM).To evaluate the proposed scheme,we collect a large dataset which contains 4,065 images in a variety of shooting scenarios.Experimental results demonstrate the efficacy of the proposed scheme.Specifically,it is able to achieve an accuracy of 90.62%in the end-toend test,outperforming the state-of-the-art.

关 键 词：card localization card recognition optical character recognition CNN 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]