Open Access Open Access  Restricted Access Subscription or Fee Access

Stereo Matching Algorithm Based on Region Construction using Colour Segmentation

Mamta Sharma, Ajay Mittal

Abstract


A novel stereo matching algorithm for accurate disparity estimation for all the regions in digital image is proposed in this paper. Instead of using a fixed size support window for calculating matching cost, a region will be constructed for the pixel under consideration and will be adaptively used to find the correlation or matching cost. The digital image is segmented into regions that collectively define the scene structure. The two major key contributions that are made by the algorithm to segment the image into regions; first for each pixel under consideration an upright cross is adaptively constructed, with four varying length arms that collectively decide the size of the region. The length of the four arms is adaptively calculated using the colour similarity and connectivity constraint. Second, using this local cross decision result, we dynamically construct a shape adaptive region by merging the horizontal and vertical segments of the cross. After the accurate image segmentation, variance based cost computation method is used to calculate matching cost among these regions for accurate disparity estimation among all the regions of the scene or digital image. The proposed algorithm is reliable, fast and yields expected results on Middlebury data set.


Keywords


Cross Based Region Construction, Stereo Matching, Disparity Estimation, Color Based Region Segmentation, Image Processing and Computer Vision

Full Text:

PDF

References


Nalpantidis Lazaros GeorgiosChristou Sirakoulis & Antonios Gasteratos “Review of Stereo Vision Algorithms: From Software to Hardware” Int. J.Optomechatronics, 2:4, 435-462(2008)

D. Scharstein and R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. Jour. Computer Vision, 47(1/2/3):7–42, 2002.

Barnard, S. T., and Thompson, W. B, 1980. "Disparity Analysis of Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-2, No. 4 (July, 1980), pp. 333-340.

Br ady, M., 1982. "Computational Approaches to Image Understanding,” ACM Computing Surveys, Vol. 14, No.1 (March, 1982), pp. 3-7l.

Barnard, S. T., and Fischler, M. A., 1982. "Computational Stereo,” ACM Computing Surveys, Vol. 14, No.4 (December, 1982), pp. 553-572

Klaus, A., Sormann, M., Karner, K.: Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure. In: Proc. Int. Conf. Pat. Recogn. (ICPR), pp. III 15–18 III (2006)

Qingxiong Yang, Liang Wang , Ruigang Yang, Henrik Stewe´ nius , and David Niste´ r , “Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling” IEEE transactions on pattern analysis and machine intelligence, vol. 31, no. 3, march 2009

Y. Boykov, O. Veksler, and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, pp. 1222-1239, 2001.

V. Kolmogorov and R. Zabih, “Computing VisualCorrespondence with Occlusions Using Graph Cuts,” Proc. IEEE Int’l Conf. Computer Vision, vol. 1, pp. 508-515, 2001.

J. Sun, N.-N. Zheng, and H.-Y. Shum, “Stereo Matching Using Belief Propagation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 787-800, 2003.

J. Sun, Y. Li, S.B. Kang, and H.-Y. Shum, “Symmetric Stereo Matching for Occlusion Handling,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 399-406, 2005.

Stefano Mattoccia “A locally global approach to stereo correspondence” IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops 978-1-4244-4441-0/09/$25.00 ©2009 IEEE

I. Haller, C. Pantilie, F. Oniga and S. Nedevschi “Real-time semi-global dense stereo solution with improved sub-pixel accuracy” IEEE Intelligent Vehicles Symposium University of California, San Diego, CA, USA June 21-24, 2010

Roland Brockers, “Cooperative Stereo Matching with Color Based Adaptive Local Support”, CAIP 2009, LNCS 5702, pp.1019-1027, 2009. © Springer-Verlag Berlin Heidelberg 2009

Zhang, Y., Kambhamettu, C.: Stereo matching with segmentation-based cooperation. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 556–571. Springer, Heidelberg (2002)

Tombari, F.,Mattoccia, S., Di Stefano, L.: Segmentation based adaptive support for accurate stereo correspondence. In: Mery, D., Rueda, L. (eds.) PSIVT 2007. LNCS, vol. 4872, pp. 427–438. Springer, Heidelberg (2007)

Yoon, K.J., Kweon, I.S.: Adaptive support-weight approach for correspondence search. IEEE Trans. PAMI 28, 650–656 (2006)

Ivana Toˇsic´, Bruno A. Olshausen, and Benjamin J. Culpepper, “Learning Sparse Representations of Depth” , IEEE journal of selected topics in signal processing, vol. 5, no. 5, september 2011.

Ke Zhang, Jiangbo Lu, and Gauthier Lafruit “Cross-Based Local Stereo Matching Using Orthogonal Integral Images”, IEEE transactions on circuits and systems for video technology, vol. 19, no. 7, july 2009

J. Lu, G. Lafruit, and F. Catthoor, “Anisotropic local high-confidence voting for accurate stereo correspondence,” in Proc . SPIE-IS&T Electron .Imaging, vol. 6812, Jan. 2008, pp. 605822-1–605822-10.

A. Fusiello, V. Roberto, and E. Trucco, “Efficient stereo with multiple windowing,” in Proc. IEEE Conf. Comput. Vision Pattern Recognition,San Juan, PR, 1997, pp. 858–863.

O. Veksler, “Fast variable window for stereo correspondence using integralimages,” in Proc. IEEE Conf. Comput. Vision Pattern Recognition, vol. 1, 2003, pp. 556–561.

DorinComaniciu, Member IEEE, and Peter Meer, Senior Member IEEE “Mean Shift: A Robust Approach toward Feature Space Analysis.”

D. Scharstein and R. Szeliski, Middlebury Stereo Vision Page (2008). [Online].Available: http://vision.middlebury.edu/stereo/

http://vision.deis.unibo.it/fede/ds-stereo-lab.html


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.