Sonification of Face

Vaishakh Patil; Mohammed Qassim Akhtar; Abhijit Parab; Aisha Fernandes; Aisha Fernandes

doi:10.36039/AA072012028

Sonification of Face

Vaishakh Patil, Mohammed Qassim Akhtar, Abhijit Parab, Aisha Fernandes, Aisha Fernandes

Abstract

In this paper, the integration of face segments detection and extraction, and facial expression recognition and Sonification are discussed. In this paper, we propose an algorithm that utilizes haar classifiers detecting face followed by dividing face into Regions of interest (ROI) to extract facial segments. Furthermore, in this project, we propose a statistical approach to process the optical flow data to obtain the overall value for the respective feature region in the face. This approach has eliminated the requirement of accurate identification of the feature boundary. Optical flow computations are utilized to identify the directions and the amount of motions in image sequences that are caused by human facial expressions. These calculated values are then compared with the values from table to estimate the expression .Furthermore after getting the expression; these are then converted to sound by mapping functions. Sounds are generated by simple MIDI tunes based on instruments assigned to each region.

Keywords

Face Detection, Denseoptical Flow, Expression Analysis, Haar Classifier Cascade, Lucas-Kanadeoptical Flow Algorithm, Sound Generation.

Full Text:

PDF

References

P. Ekman and W.V. Friesen, "Facial Action CodingSystem," Consulting Psychologist Press, Palo Alto, CA, 1978.

Mehrabian, "Communication without Words", Psychology Today, Vol. 2, No. 4, p. 53-56, 1968.

Bradski, G. Computer vision face tracking for use in a perceptual user interface.Intel Technology Journal, 2nd Quarter, 1998.

P. Viola and M. Jones, "Robust real-time face detection," presented at Second International Workshop on Statistical and Computational Theories of Vision - Modeling, Learning, Computing, and Sampling, Vancouver, Canada, pp. 1-25, 2001.

P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," presented at 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. I-511-I-518 vol.1, 2001.

B. D. Lucas and T. Kanade (1981), an iterative image registration technique with an application to stereo vision.

Bruce D. Lucas (1984) Generalized Image Matching by the Method of Differences

Vaishakh P, Mohammed Qassim A, Abhijit P, Aisha F (2012), Sonification of Facial Expression Using Dense Optical Flow on Segmented Facial Plane.

DOI: http://dx.doi.org/10.36039/AA072012028

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution 3.0 License.

Username
Password
Remember me