A Study on Enhancing the Performance of Detecting Lip Feature Points for Facial Expression Recognition Based on AAM


The KIPS Transactions:PartB , Vol. 16, No. 4, pp. 299-308, Aug. 2009
10.3745/KIPSTB.2009.16.4.299,   PDF Download:

Abstract

AAM(Active Appearance Model) is an algorithm to extract face feature points with statistical models of shape and texture information based on PCA(Principal Component Analysis). This method is widely used for face recognition, face modeling and expression recognition. However, the detection performance of AAM algorithm is sensitive to initial value and the AAM method has the problem that detection error is increased when an input image is quite different from training data. Especially, the algorithm shows high accuracy in case of closed lips but the detection error is increased in case of opened lips and deformed lips according to the facial expression of user. To solve these problems, we propose the improved AAM algorithm using lip feature points which is extracted based on a new lip detection algorithm. In this paper, we select a searching region based on the face feature points which are detected by AAM algorithm. And lip corner points are extracted by using Canny edge detection and histogram projection method in the selected searching region. Then, lip region is accurately detected by combining color and edge information of lip in the searching region which is adjusted based on the position of the detected lip corners. Based on that, the accuracy and processing speed of lip detection are improved. Experimental results showed that the RMS(Root Mean Square) error of the proposed method was reduced as much as 4.21 pixels compared to that only using AAM algorithm.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
E. J. Han, B. J. Kang, K. R. Park, "A Study on Enhancing the Performance of Detecting Lip Feature Points for Facial Expression Recognition Based on AAM," The KIPS Transactions:PartB , vol. 16, no. 4, pp. 299-308, 2009. DOI: 10.3745/KIPSTB.2009.16.4.299.

[ACM Style]
Eun Jung Han, Byung Jun Kang, and Kang Ryoung Park. 2009. A Study on Enhancing the Performance of Detecting Lip Feature Points for Facial Expression Recognition Based on AAM. The KIPS Transactions:PartB , 16, 4, (2009), 299-308. DOI: 10.3745/KIPSTB.2009.16.4.299.