Email this article 
Open Access
Subscription or Fee Access
Analysis of 3D Face Reconstruction
Abstract
3D shape reconstruction from 2D images is an inverse problem, and is therefore mathematically ill-posed. One solution to 3D shape reconstruction problem is to use a model based approach. This paper presents an analysis by synthesis method for solving 3D face reconstruction problems using anatomical landmarks and intensity from 2D frontal face images.
To improve the quality of 3D shape reconstruction we incorporate a number of steps in analysis by synthesis framework. Firstly, we approach the 3D model construction problem by using rigid and non rigid surface registration. Secondly, we simplify the shape estimation by using multidimensional amoeba optimization to optimize shape parameters while mapping texture directly using 3D-2D alignment. Thirdly, we evaluate the quality of the 3D shape reconstruction in the context of 3D shape error as well as by visual analysis.
Keywords
References
R. R. Zhang, "Shape from shading: A survey," IEEE transactions on pattern analysis and machine intelligence, vol. 21, pp. 690-706, 1999.
B. Moghaddam, J. Lee, H. Pfizer, and R. Maharaja, "Model-Based 3D Face Capture with Shape-from- Silhouettes," presented at Analysis and modeling of faces and gestures, Nice, France, 2003.
Y. Hub, D. Jiang, S. Yan, L. Zhang, and H. Zhang, “Automatic 3D Reconstruction for Face Recognition,” presented at International conference on automatic face and gesture recognition, Seoul, 2004.
F. Pidgin, J. Hacker, D. Vishinski, and R. Szeliski, "Synthesizing Realistic Facial Expressions From Photographs," presented at Computer graphics: SIGGRAPH 98; conference proceedings, Orlando; FL, 1998.
D. Jiang, Y. Hu, S. Yan, L. Zhang, H. Zhang, and W. Gao, "Efficient 3D reconstruction for face recognition," Pattern Recognition, vol. 38, pp. 787-798, 2005.
B. Volker and V. Thomas, "Face Recognition Based on Fitting a 3D Morphable Model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, pp. 1063-1074, 2003.
R. Sami and V. Thomas, "Estimating 3D Shape and Texture Using Pixel Intensity, Edges, Specular Highlights, Texture Constraints and a Prior," in Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2: IEEE Computer Society, 2005.
R. Sami, V. Blanz, and T. Vetter, "Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions," Lecture Notes in Computer Science, pp. 3-19, 2002.
V. Thomas and B. Volker, "Estimating Coloured 3D Face Models from Single Images: An Example Based Approach," in Proceedings of the 5th European Conference on Computer Vision-Volume II Springer-Verlag, 1998.
"Notredame 3D Face Database," http://www.nd.edu/~cvrl/.
K. Chang, K. Bowyer, and P. Flynn, "Multi-Modal 2D and 3D Biometrics for Face Recognition," presented at Analysis and modeling of faces and gestures, Nice, France, 2003.
T. Papatheodorou and D. Rueckert, "Evaluation of 3D Face Recognition Using Registration and PCA," presented at Audio- and video-based biometric person authentication: 5th International Conference, AVBPA, Hilton Rye Town, N.Y. USA, July 20-22 2005 : proceedings, Hilton Rye Town, N.Y., 2005.
T. Papatheodorou, "3D Face Recognition Using Rigidand Non-Rigid Surface Registration," in Department of Computing: Imperial College London, 2006.
B. Volker and V. Thomas, "A morphable model for the synthesis of 3D faces," in Proceedings of the 26th annual conference on Computer graphics and interactive techniques: ACM Press/Addison-Wesley Publishing Co., 1999.
S. Srinivasan and K. Boyer, "Head Pose Estimation Using View Based Eigenspaces," presented at Pattern recognition, Quebec, Canada, 2002.
M. J. Clarkson, D. Rueckert, D. L. G. Hill, and D. J. Hawkes, "Image Registration Using Photo- Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model," IEEE Transactions on Pattern Analysis and Machine Intelligence Pami, vol. 23, pp. 1266-1280, 2001.
W. H. Press, Numerical recipes in C++ : the art of scientific computing, 2nd ed Cambridge Cambridge University Press, 2002.
T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models—their training and application," Comput. Vis. Image Underst., vol. 61, pp. 38-59, 1995.
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution 3.0 License.