Open Access Open Access  Restricted Access Subscription or Fee Access

Camera-Based Assistive Text to Audio Converter for Blind Persons

Mustafa Hirani

Abstract


We provide a text reading system using camera to assist blind persons to read text on labels and product from portable objects in their day to day life. To use the object on unclear backgrounds or other objects in the camera angle, we initially propose an effective motion based method to select the region of interest (ROI) in the video by telling the user to shake the object. This system identifies moving object region by a mixture-of-Gaussians-based BGS technique. In the obtained ROI, recognition and text localization are conducted to gather text details.


Keywords


Region of Interest (ROI) Portable Devices, Distribution of Edge Pixels, Portable Objects, Optical Character Recognition (OCR), Text Reading, and Text Region Local¬ization, Background Subtraction(BGS).

Full Text:

PDF

References


. “10 facts about blindness and visual impairment”, World Health Organization: Blindness and visual impairment, 2009.www.who.int/features/factfiles/blindness/blindness_facts/en/index.html

. Advance Data Reports from the National Health Interview Survey, 2008.http://www.cdc.gov/nchs/nhis/nhis_ad.htm.

. R. Manduchi and J, Coughlan, (Computer) vision without sight. In Communications of the ACM, 55(1) pp. 96–104, 2012.

. “The Portset Reader” TVI, Technologies for the Visually Impaired Inc. http://www.tvi-web.com/products/porsetreader.html

. T. Phan, P. Shivakumara and C. L. Tan, “A Laplacian Method for Video Text Detection,” In ICDAR, pp.66-70, 2009.

. T.Phan,P.Shivakumara,and C.L.Tan,“ALaplacianmethodforvideotext detection,” in Proc. Int. Conf. Document Anal. Recognit., 2009,pp. 66–70.

. International Workshop on Camera-Based Document Analysis and Recognition (CBDAR 2005, 2007, 2009, 2011). [Online] Available: http://www.m.cs.osakafu-u.ac.jp/cbdar2011/

. D. Dakopoulos and N. G. Bourbakis, “Wearable obstacle avoidance electronic travel aids for blind: a survey,” In IEEE Transactions on systems, man, and cybernetics, Vol. 40, No. 1, pp. 25-35, 2010.

. X. Chen, J. Yang, J. Zhang and A. Waibel, “Automatic detection and recognition of signs from natural scenes,” In IEEE Transactions on image processing, Vol. 13, No. 1, pp. 87-99, 2004.

. X. Chen and A. L. Yuille, “Detecting and reading text in natural scenes,” In CVPR, Vol. 2, pp. II-366 – II-373, 2004.

. “KReader Mobile User Guide”, knfb Reading Technology Inc, http://www.knfbReading.com

. The Portset Reader, TVI Technologies for the Visually Impaired Inc., Hauppauge, NY, USA. (2012). [Online]. Available: http://www.tvi-web.com/products/porsetreader.html

. ScanTalker, Bar code scanning application to help Blind Identify over one million products, http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3-30-2006.asp

. J. Zhang and R. Kasturi, “Extraction of Text Objects in Video Documents: Recent Progress,” In IAPR Workshop on Document Analysis Systems, pp. 5-17, 2008.

. C. Yi and Y. Tian, “Text string detection from natural scenes by structure based partition and grouping,” In IEEE Transactions on Image Processing, Vol. 20, No. 9, pp.2594-2605, 2011.

. P. Viola and M. J. Jones, “Robust real-time face detection,” In IJCV 57(2), pp. 137–154, 2004.

. “Text-Image Separation in Document Images Using Boundary/Perimeter Detection “ACEEE Int. J. on Signal &Image Processing, Vol. 03, No. 01, Jan 2012.


Refbacks

  • There are currently no refbacks.