一种自动的唇部定位及唇轮廓提取、跟踪方法  

An Automatic Approach to Lip Localization,Contour Extraction and Tracking

作　　者：王晓平[1] 郝玉峰 付德刚[1] 袁春伟[1] 

机构地区：[1]东南大学生物电子学国家重点实验室,南京210096 [2]北京捷通华声语音技术有限公司,北京100094

出　　处：《模式识别与人工智能》2007年第4期485-491,共7页Pattern Recognition and Artificial Intelligence

基　　金：国家自然科学基金(No.60121101)

摘　　要：实现一种结合 CbCr 颜色空间、Fisher 变换及变形模板的自动唇部定位及唇轮廓提取、跟踪方法.首先在CbCr 空间建立肤色模型进行人脸检测、定位,并由人脸几何特征进行唇部粗定位.然后结合唇色模型进行 Fisher变换使肤、唇色差别明显化,提出根据亮度信息对变换结果预处理后用 Otsu 法进行图像分割,经唇色模型进一步验证后实现唇部精定位.再使用变形模板来进行嘴唇轮廓特征提取,为增强内轮廓定位的鲁棒性,本文提出对经亮度预处理和唇色模型验证得到的口腔区域边缘图进行曲线拟合来实现内轮廓定位.最后,将唇读图像序列中上一帧的唇部定位结果拓展后作为当前帧的预测区域再进行处理来实现唇动跟踪.An automatic approach to lip localization, contour extraction and tracking is presented, which combines CbCr color space, Fisher transform and deformable templates. Firstly, a skincolor model is constructed for skin detection in CbCr color space so that the approximate lip region can be obtained based on the geometry features of human face. Then, the color difference between lip and skin is enhanced by Fisher transform. Pre-processing of brightness is carried out before segmentation, and the threshold is obtained by Otsu method. Next, the lip color model is used to validate the segmentation result of accurate localization and the deformable templates are used for lip contour extraction. Based on the segmentation result, a method of curves fitting for edges of inner mouth is presented to extract the inner contour robustly. Finally, locating result of previous frame is predicted as the next lip region, in which lip localization and contour extraction are executed for lip tracking.

关 键 词：唇读 人脸检测 颜色空间 FISHER变换 定位 变形模板 轮廓提取 跟踪 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]