Analyse de visages et d’expressions faciales par modèle actif d’apparence

Analyse de visages et d’expressions faciales par modèle actif d’apparence

Face and facial expression analysis based on an active appearance model

Franck Davoine | Bouchra Abboud  | Van Mô Dang 

HEUDIASYC, UMR 6599 CNRS, Université de Technologie de Compiègne, BP 20529, 60205 Compiègne cedex, France

Corresponding Author Email: 
prenom.nom@hds.utc.fr
Page: 
179-193
 |
Received: 
9 February 2004
| |
Accepted: 
N/A
| | Citation
ts21_3_179-193.pdf

OPEN ACCESS

Abstract: 

In this paper, methods are proposed for facial feature detection (eyes, brows, nose, mouth, chin) and for facial expression recognition. The methods are based on modified versions of the standard Active Appearance Model proposed by Cootes et al.[11] to control both the shape and the texture of a given face. The detection algorithm makes use of an active appearance model computed on hierarchical Gabor descriptions a set of training faces. In a second part, two expression models are proposed, based on the standard AAM, and used to recognize and then to cancel or modify the facial expression of a given unknown face.

Résumé

Dans cet article, nous nous intéressons à l'extraction automatique des traits de visages (yeux, sourcils, nez, bouche, menton) ainsi qu'à la reconnaissance des six expressions faciales définies par Ekman [19]. Nous exploitons pour cela des versions modifiées du modèle actif d'apparence initialement proposé par Cootes et al. [11] qui permet de représenter à la fois la forme et la texture d'un visage. L'extraction des traits faciaux est faite à l'aide d'un modèle actif d'apparence hiérarchique, calculé à partir des réponses de visages à des bancs de filtres de Gabor. Deux modèles d'expressions faciales sont ensuite proposés, calculés à patir du modèle d'apparence standard (non hiérarchique), pour reconnaître puis supprimer ou modifier l'expression d'un visage inconnu.

Keywords: 

Faces, facial features, facial expression cancellation, modification or recognition, active appearance model, PCA, Gabor filters, regression.

Mots clés

Visages, traits caractéristiques, reconnaissance, filtrage et modification d'expressions faciales, modèle actif d'apparence, ACP, filtres de Gabor, regression

1. Introduction
2. Modèle Actif D'apparence
3. Modèle D'apparence Hiérarchique
4. Reconnaissance D'expressions Faciales
5.Synthèse D'expressions Faciales
6. Conclusion
  References

[1] M.S. BARTLETT, G. LITTLEWORT, B. Braathen, T.J. Sejnowski, J.R. Movellan, An approach to automatic analysis of spontaneous facial expressions, In Proceedings of Advances in Neural Information Processing Systems, 2002.

[2] M.S. BARTLETT, G. LITTLEWORT, I. FASEL, J. R. MOVELLAN, Face Detection, Facial Expression Recognition: Development and Applications to Human Computer Interaction, In IEEE workshop on Computer Vision and Pattern Recognition for Human Computer Interaction, Madison, U.S.A., June, 2003.

[3] D. BEYMER, Vectorizing face images by interleaving shape and texture computations, MIT, U.S.A., A.I. Memo n° 1537, September 1995.

[4] M.J. BLACK,Y. YACOOB, Recognizing Facial Expressions in Image Sequences Using Local Parametrized Models of Image Motion, International Journal of Computer Vision, 25 (1), p. 23–48, 1997.

[5] V. BLANZ, T. VETTER, Face Recognition based on fitting a 3D morphable model, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9), September, 2003.

[6] E. BOYLE, A.H. ANDERSON, A. NEWLANDS, The Effects of Visibility on Dialogue in a Cooperative Problem Solving Task, Language and Speech, 37, p. 1–20, 1994.

[7] C. BREGLER, M. COVEL, M. SLANEY, Video Rewrite: Driving Visual Speech with Audio, In ACM Siggraph, p. 353–360, 1997.

[8] R. BRUYER, Le visage et l'expression faciale : approche neuropsychologique, Pierre Mardaga éditeur. Collection Psychologie et Sciences Humaines, n° 118, 1983.

[9] E.S. CHUANG, H. DESHPANDE, C. BREGLER, Facial Expression Space Learning, In IEEE Pacific conference on computer graphics and applications, october 2002.

[10] J. COHN, A. ZLOCHOWER, J.J. LIEN, T. KANADE, Feature-point Tracking by Optical Flow Discriminates Subtle Differences in Facial Expression, In International Conference on Automatic Face and Gesture Recognition, p. 396–401, Nara, Japan, 1998.

[11] T.F. COOTES, G.J. EDWARDS, C.J. TAYLOR, Active Appearance Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6), p. 681–685, June 2001.

[12] T.F. COOTES, P. KITTIPANYA-NGAM, Comparing variations on the active appearance model algorithm, In British Machine Vision Conference, p. 837–846, Cardiff University, September 2002.

[13] T.F. COOTES, K. WALKER, C.J. TAYLOR, View-Based Active Appearance Models, In International Conference on Automatic Face and Gesture Recognition, p. 227–232, Grenoble, France, March 2000.

[14] G. DONATO, M.S. BARTLETT, J.C. HAGER, P. EKMAN, T.J. SEJNOWSKI, Classifying Facial Actions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(10), p. 974–988, October 1999.

[15] B. DRAPER, K. BAEK, M.S. BARTLETT, R. BEVERIDGE, Recognizing Faces with PCA and ICA, Computer Vision and Image Understanding, 91(1/2), p. 115–137, July 2003

[16] I.L. DRYDEN, K.V. MARDIA, Statistical Shape Analysis, John Wiley, 1998

[17] S. DUBUISSON, F. DAVOINE, M. MASSON, A solution for facial expression representation and recognition, Signal Processing: Image Communication, 17(9), p. 657–673, October 2002.

[18] G.J. EDWARDS, T.F. COOTES, C.J. TAYLOR, Face Recognition Using Active Appearance Models, In European Conference of Computer Vision, p. 581–695, 1998.

[19] P. EKMAN, Emotion in the human face, Cambridge University Press, 1982.

[20] P. EKMAN, W. FRIESEN, Facial Action Coding System: A Technique for the Measurement of Facial Movement, Palo Alto, Calif.: Consulting psychologists press, 1978.

[21] I. ESSA, A. PENTLAND, Coding, Analysis, Interpretation, Recognition of Facial Expressions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7), p. 757–763, 1997.

[22] T. EZZAT, G. GEIGER, T. POGGIO, Trainable Videorealistic Speech Animation, In ACM Siggraph July, San Antonio, Texas, 2002.

[23] T. EZZAT, T. POGGIO, Facial analysis and synthesis using imagebased models, In International Conference on Automatic Face and Gesture Recognition, p. 116–121, 1996.

[24] S.B. GOKTURK, J.-Y. BOUGUET, R. GRZESZCZUK, A data-driven model for monocular face tracking, In International Conference on Computer Vision, Vancouver, Canada, July 2001.

[25] H. GUPTA, A.K. AGRAWAL, T. PRUTHI, C. SHEKHAR, R. CHELLAPPA, An experimental evaluation of linear and kernelbased methods for face recognition, In International workshop on applications of computer vision, Orlando, Floride, December 2002.

[26] B. HEISELE, P. HO, T. POGGIO, Face Recognition with Support Vector Machines: Global Versus Component-based Approach, In International Conference on Computer Vision, Vancouver, Canada, p. 688–694, July 2001.

[27] E. HJELMAS, B. LOW, Face detection: a survey, Computer Vision and Image Understanding, 83, p. 235–274, 2001.

[28] H. HONG, H. NEVEN, C. VON DER MALSBURG, Online Facial Expression Recognition based on Personalized Gallery, In Intl. Conference on Automatic Face and Gesture Recognition, p. 354–359, Nara, Japan, 1998

[29] X. HOU, S. LI, H. ZHANG, Q. CHENG, Direct appearance models, In Intl. Conference on Computer Vision and Pattern Reocognition, p. 828–833, 2001.

[30] C. HU, R. FERIS, M. TURK, Active wevelet networks for face alignment, In British machine vision conference, East Eaglia, Norwich, U.K., 2003.

[31] T. KANADE, J. COHN, Y.L. TIAN, Comprehensive database for facial expression analysis, In International Conference on Automatic Face and Gesture Recognition, p. 46–53, Grenoble, France, March 2000.

[32] H. KANG, T.F. COOTES, C.J. TAYLOR, Face Expression Detection and Synthesis using Statistical Models of Appearance, In Measuring Behavior, p. 126–128, Amsterdam, The Netherlands, August 2002.

[33] A. LANITIS, C.J. TAYLOR, T.F. COOTES, Automatic interpretation and coding of face images using flexible models, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7), p. 743–756, July 1997.

[34] C. LIU, Gabor-based Kernel PCA with Fractional Power Polynomial Models for Face Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(5), p. 572–581, May 2004.

[35] M.J. LYONS, J. BUDYNEK, S. AKAMATSU, Automatic Classification of Single Facial Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(12), p. 1357–1362, December 1999

[36] M. MALCIU, Approches orientées modèle pour la capture des mouvements du visage en vision par ordinateur, Thèse de doctorat, Université René Descartes, Paris V, INT, Unité de Projets Artemis, décembre 2001.

[37] I. MATTHEWS, S. BAKER, Active Appearance Models Revisited, Technical Report CMU-RI-TR-03-02 The Robotics Institute, Carnegie Mellon University, April 2003.

[38] A. MEHRABIAN, Communication without Words, Psychology Today, 2(4), p. 53–56, 1968.

[39] B. MOGHADDAM, Principal manifolds and probabilistic subspaces for visual recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(6), June 2002.

[40] A. NICOULIN, Analyse d'images par spectre local de phase, Presses Polytecniques et Universitaires Romandes, Collection META, 1990.

[41] C. PADGETT, G. COTTRELL, Representing face images for emotion classification, In Advances in Neural Information Processing Systems, MIT Press, volume 9, p. 894–900, Cambridge, MA., 1997.

[42] C. PADGETT, G. COTTRELL, R. ADOLPHS, Categorical Perception in Facial Emotion Classification, In ACM Siggraph, p. 75–84, 1996.

[43] I. PANDZIC, R. FORCHHEIMER, MPEG-4 Facial Animation - The standard, implementations, applications, John Wiley, 2002.

[44] M. PANTIC, L.J.M. ROTHKRANTZ, Automatic Analysis of Facial Expressions: The State of the Art, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), p. 1424–1445, December 2000

[45] P. PENEV, J. ATICK, Local Feature Analysis: A general Statistical Theory for Object Representation, Network: computation in neural systems, 7(3), p. 477–500, 1996.

[46] F. PIGHIN, J. HECKER, D. LISCHINSKI, R. SZELISKI, D.H. SALESIN, Synthesizing Realistic Facial Expressions from Photographs, In ACM International conference on computer graphics and interactive techniques, 1998.

[47] B. SCHOLKOPF, A. SMOLA, K.-R. MULLER, Kernel principal component analysis, In Proc. of Artificial Neural Networks – ICANN, Berlin, 1997.

[48] M.B. STEGMANN, Active appearance models: Theory, extensions and cases, In Master Thesis, IMM-EKS-2000-25, Technical University of Denmark, Lyngby, 2000.

[49] Y.-L. TIAN, T. KANADE, J.F. COHN, Recognizing action units for facial expression analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2), p. 97–115, February 2001.

[50] T. VETTER, N.F. TROJE, Face Recognition based on fitting a 3D morphable model, Journal of the optical society of america A, 14(9), p. 2152–2161, 1997.

[51] P. VIOLA, M. JONES, Robust real-time object detection, In International workshop on statistical computational theories of vision – modeling, learning, computing and sampling, Cancouver, Canada, July 2001.

[52] Laurenz WISKOTT, Jean-Marc FELLOUS, Norbert KRÜGER, Christoph VON DER MALSBURG, Face Recognition by Elastic Bunch Graph Matching, Intelligent Biometric Techniques in Fingerprint and Face Recognition, In L. C. Jain, U. Halici, I. Hayashi, S. B. Lee, CRC Press, 0-8493-2055-0, 11, p. 355–396 ,1999.

[53] M. H. YANG, Face Recognition Using Kernel Methods, In Advances in Neural Information Processing Systems, 14, p. 215–220, 2002.

[54] M.-H. YANG, D. KRIEGMAN, N. AHUJA, Detecting faces in images: a survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), p. 34–58, January 2002.

[55] W. ZHAO, R. CHELLAPPA, A. ROSENFELD, P.J. PHILLIPS, Face recognition: A literature survey, CVL, University of Maryland,U.S.A., October 2000.

Please sign up to receive notifications on new issues and newsletters from IIETA

Select Journal/Journals:

 

Copyright © 2024 IIETA. All Rights Reserved.