Email this article 3D Novel Face Sample Modeling for Face Recognition
Abstract
In this paper, we present a method to generate novel realistic 3D face model using a model trained from real 3D face data. 3D face samples are an important data platform for model training, algorithm design. Subject to the constraint of acquisition technology, sizes of current 3D face databases are relatively small and insufficient. The presented method is used to solve this problem. First real 3D face data are collected as training sample and a parametric global model is learned based on them. Then a local model is established based on surface quilting. We use the global model to build a novel coarse face model. Then, we condition the local model with the global model. With appropriate choices of local and global models it is possible to reliably generate novel realistic 3D face data that do not correspond to any individual in the training data. Finally we apply our model to face recognition to examine the meaning of our work
Keywords
References
[1] R. Brunell and T. Poggio, Face recognition: feature vs templates, IEEE Trans. Pattern Anal. Mach. Intell, 1993, 15(10): 1042-1053.
http://dx.doi.org/10.1109/34.254061
[2] A. M. Martinez and A. C. Kak, PCA vs LDA, IEEE Trans. Pattern Anal.Mach. Intell, 2001, 23(2): 228-233.
http://dx.doi.org/10.1109/34.908974
[3] J. Kittler, A. Hilton, M. Hamouz and J. Illingworth, 3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling, Recognition Approaches, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision, Pattern Recognition (CVPR’05), 2005: 114-121.
PMid:15629099
[4] Xiaoguang Lu and Anil K. Jain, Automatic Feature Extraction for Multiview 3D Face Recognition, 7th International Conference on Automatic Face, Gesture Recognition (FGR’06), 2006: 585-590.
[5] K. W. Bowyer, K. Chang and P. J. Flynn, An evaluation of multi-modal 2d+3d face biometrics, IEEE PAMI, 2005, 27(4): 619-624.
http://dx.doi.org/10.1109/TPAMI.2005.70
PMid:15794165
[6] G. Gordon, Face recognition based on depth maps, surface curvature, SPIE, 1991: 234-274.
[7] C. Chua, F. Han and Y. Ho, 3D human face recognition using point signature, IEEE Inetrnational Conference on Automatic Face, Gesture Recognition, 2000: 233-238
[8] C. Beumier and M. Acheroy, Face verification from 3d, grey level cues, Pattern Recognition Letters, 2001, 22: 1321-1329.
http://dx.doi.org/10.1016/S0167-8655(01)00077-0
[9] A. M. Bronstein, M. M. Bronstein and R. Kimmel, Three-dimensional face recognition, International Journal of Computer Vision, 2005, 64(1): 5-30.
http://dx.doi.org/10.1007/s11263-005-1085-y
[10] K. I. Chang, K. W. Bowyer and P. J. Flynn, An evaluation of multimodal 2d+3d face biometrics, IEEE Transactions on Pattern Analysis, Machine Intelligence, 2005, 27(4): 619-624.
http://dx.doi.org/10.1109/TPAMI.2005.70
PMid:15794165
[11] J. Yang and J. J. Yang, From image vector to matrix: a straightforward image projection technique-IMPCA vs. PCA, Pattern Recognition, 2002, 35(9): 1997-1999.
http://dx.doi.org/10.1016/S0031-3203(02)00040-7
[12] V. Blanz, P. Grother, P. J. Phillips and T. Vetter, Face Recognition Based on Frontal Views Generated from Non-Frontal Images, IEEE Computer Society Conference on Computer Vision, Pattern Recognition (CVPR’05), 2005, 2: 454-461.
[13] J. Lee, B. Moghaddam, H. Pfister and R. Machiraju, A Bilinear Illumination Model for Robust Face Recognition, Tenth IEEE International Conference on Computer Vision (ICCV’05), 2005, 2: 1171-1184.
[14] Lei Zhang and Dimitris Samaras, Face Recognition from a Single Training Image under Arbitrary Unknown Lighting Using Spherical Harmonics, IEEE Transactions on Pattern Analysis, Machine Intelligence, 2006, 29(3): 351-363.
http://dx.doi.org/10.1109/TPAMI.2006.53
PMid:16526422
[15] Blanz V., Vetter T., 1999. A morphable model for the synthesis of 3D faces, ACM Trans. SIGGRAPH’99, pp. 187-194.
[16] Goh R., Liu L., Liu X., Chen, T., 2005. The CMU Face In Action (FIA) Database, Proc. ICCV 2005 Workshop on Analysis and Modeling of Face and Gestures, 255-263.
[17] Charles B., 2004. 3D-RMA 3D face database, http://www.sic.rma.ac.be/~beumier/DB/3d_rma.html,
[18] Moreno A., Sanchez A., 2004. Gavab: A 3D Face Database, In: Second COST Workshop on Biometrics on the Internet, 72-88.
[19] UOY 3D face database, http://www-users.cs.york.ac.uk/~nep/research/3Dface/tomh/3DFaceDatabase.html
[20] Messer K., Matas J., Kittler J., Maitre G., 1999. XM2VTSDB: The Extended M2VTS Database. In Conf. on Audio and Video-based Biometric Person Authentication, 72-77.
[21] BJUT 3D face database, 2005. http://www.bjpu.edu.cn/sci/multimedia/mullab/3dface/facedatabase.htm
[22] Efron B., 1987. The Jackknife, the Bootstrap and Other Resampling Plans, Society of Industrial and Applied Mathematics.
[23] Davison A.C., Hinkley D.V., 1997. Bootstrap Methods and Their Application, Cambridge University Press.
[24] Breiman L., 1996. Bagging predictors, Machine Learning.
[25] Freund Y., Robert E.S., 1996. Experiments with a new boosting algorithm,In: Conf. on Machine Learning, 148-156.
[26] Tan X., Chen S., Zhou Z.H., Zhang F., 2006. Face recognition from a single image per person: a survey, J.Sci. Pattern Recognition. 39, 1725-1745.
http://dx.doi.org/10.1016/j.patcog.2006.03.013
[27] Lu X., Jain A.K., 2003. Resampling for face recognition, in Proc. on Audio and Video-Based Biometric Person Authentication, 869-877.
[28] Kirby M., Sirovich L.,1990. Application of the karhunen-Love procedure for the characterization of human faces, IEEE Trans. Pattern Analysis and Machine Intelligence, 12,103-108.
http://dx.doi.org/10.1109/34.41390
[29] Torre F., Gross R., Baker S., Kumar V., 2005. Representational oriented component analysis (ROCA) for face recognition with one sample image per training class, in: IEEE Conf. on Computer Vision and Pattern Recognition, 266-273.
[30] Chen J., Chen X.L., Gao W., 2004. Expand training set for face detection by GA resampling, in: IEEE Conf. on Automatic Face and Gesture Recognition, 73-79.
http://dx.doi.org/10.1109/AFGR.2004.1301511
[31] Umar M., Simon J.D.P., Jan K., 2009. Visio-lization generating novel facial images ACM Trans Graphic, 28(3).
[32] BJUT-3D Face Database, “http://www.bjpu.edu.cn/sci/multimedia/mul-lab/3dface/facedatabase.htm” 2005.
[33] J. Duchon, 1976. Splines minimizing rotation invariant seminorms in sobolev spaces, constructive theory of functions of several variables, 1, pp 85-1.
[34] LIPMAN Y.,SORKINE O.,COHEN-OR D.,LEVIN D,Differential coordinates for interactive mesh editing. In International Conference on Shape Modeling and Applications,181–190.
Full Text: PDF