Circle Object Recognition Based on Monocular Vision for Home Security Robot

Transcription

1 Journal of Applied Science and Engineering, Vol. 16, No. 3, pp (2013) DOI: /jase Circle Object Recognition Based on Monocular Vision for Home Security Robot Shih-An Li, Ching-Chang Wong*, Cheng-Yao Ho and Yi-Chun Lin Department of Electrical Engineering, Tamkang University, Tamsui, Taiwan 251, R.O.C. Abstract In this paper, a circle object recognition method based on monocular vision for the home security robots is proposed. This vision system is able to process image and recognize a colored ball rapidly. The proposed method consists of two sub-modules, which are the object segmentation module and the circle detection module. In the object segmentation, the color feature is applied to find out the region of the object. After the region of the object is determined, a fast randomized circle detection (RCD) method is applied to check that there are enough radius points which all points in the same circle of region. Because of the double detection process, this system can improve the precision for detecting a colored ball. The proposed method is tested on a home security robot and can find out a red ball. The experimental results illustrate the effectiveness of the proposed method. Key Words: Object Recognition, Computer Vision, Circle Detection, Image Processing 1. Introduction As the average age rising, more and more families need to face the issues of taking care of the elders and the children. It is becoming a very important issue. Besides, the house service is also a huge request when peoples are busy for working. Some of the researches about the home service in the industry area or academic area are presented recently [1]. This paper presents a circle object recognition method for a monocular vision system of home security robot. The robot with the proposed method is able to search and pick up the colored ball autonomously. The platform of home security robot is shown in Figure 1. The robot can pick up the toys or balls at home by using the propose method. A camera which installed in front of robot is used for capturing image. A roll style brush is used to pick up the colored ball. Many researches have been proposed their image pattern recognition methods. Most of them emphasize the accuracy of detecting and the speed of image processing [2 5]. Detecting circles from a digital image is very important in shape recognition [6]. Hough transform (HT) is the most well-known method for circle detection [7 10]. Using the conventional Hough transform (CHT) for detecting circles, it requires a large amount of computing time to vote on such a 3-D array [11]. Randomized Hough transform (RHT) is presented which can significantly reduce the storage requirement and the *Corresponding author. wong@ee.tku.edu.tw Figure 1. An autonomous home security robot.

2 262 Shih-An Li et al. computing time, and compared with the CHT [12,13]. Randomized Circle Detection (RCD) [14,15] is a non- HT-based randomized algorithm for detecting circles. It is based on randomly picking four edge pixels in the image and uses a distance criterion to find out a possible circle. However, it is important to the home security robot has a real-time image processing system. The proposed method of this paper without enormous algorithm but still has capability of image processing in real-time and recognizes a colored ball accurately. This paper is organized as follows: section 2 introduces the vision system architecture of robot, then the image process core is describing in section 3. The experiment results will be present in section 4, and section 5 is the conclusions. 2. Vision System Architecture The vision system architecture of the home security robot in this paper is shown in Figure 2. This vision system can be separated into two parts which the user interface part and the image processing part. The common database is a data center of the communication. The image capture module will store the image pixels to the common database. Both of color model interface and setup parameters interface will store the users input data which the ranges of color model and parameters to the common database. These parameters data can be adjusted according to the environment situation. The image processing core can use these parameters to detect the object. Once the image processing core module obtains and stores the object information, the preview image interface module will display the results on screen. There are two main modules in image processing core; one is the object segmentation module and the other is the circle detection module. The function of object segmentation module is used to determine the range of object in an image. The circle detection module is used to detect the circle object according to the radius features of the object, which is determined by the object segmentation module. The details of the image processing will be described in section Image Processing Core The flowchart of image processing is shown in Figure 3. The pixel data of image is stored to the common database by the image capture module. The color model of the object in the color space is accomplished by the step of build color model. The step of build color model will be done before starting to analyze the image. The input pixels are compared with the object color in the step of thresholding. The pixel colors which similar to the object colors will be selected and obtained the object region by object segmentation step. Once no satisfied color object is founded, the process will start to capture next image frame. The method of object segmentation will be described in section 3.1. Once the system determines the object regions by the above steps, the edges of the object in the regions will be used to calculate the radius features by randomized circle detection (RCD) method [14]. This method of obtain edge points and the randomized circle Figure 2. The visual system architecture of the home security robot. Figure 3. The flow chart of image processing.

3 Circle Object Recognition Based on Monocular Vision for Home Security Robot 263 detection will be described in section 3.2. If the RCD can t find any object, then the system starts to capture the next image frame. 3.1 Image Segmentation Module The thresholding processing is used to create a binary image. The pixel which similar to the object color will be marked as 1; others will be marked as 0. The pixels with or without the similar color can be separated in this step. After the thresholding processing, noise reducing processing is necessary. An opening algorithm [16] is chosen here. The opening algorithm includes the erosion and the dilation processing. Using the opening algorithm can reduce some noises in the image. A fast edge detection method can speed up the image processing. After the image completing the opening algorithm, each pixel has been separated to 1 or 0 value. The proposed method for the edge detection is checking that either or not exists a different value in the neighbors of processing pixel. If the pixels have a different status from its neighbors, then the edge is happening near this pixel. The Figure 4 shows an example of the processing result. In this figure, there are two groups of the object pixel and each grid is meaning a pixel. The grid has 1 value which is mean the pixel has the object color, and the others are not. According to the edge detection method, the yellow grid can be determined by comparing the pixel with its neighbor. It means the yellow grid is the edge point. This example shows that this method is able to find out the edges of the pixel group. In following, we will describe an object segmentation technology [17 19]. This method can obtain the coordinates of the color regions and detect a circle in the most probable color regions. There are two steps in the object segmentation technology. The first step is scanning the pixels of the image from left side to right side, and top side to bottom side, until the edge points have been found. These edge points are considered as a standard point. The second step is searching the near eight pixels based on the standard point. If any edge points can be found in this step, then it will be recorded and added into a queue. In the next action, the standard points will compare with the coordinates of the boundary and update the coordinates of boundary. Once the searching standard points of neighbors are completed, an edge point from the queue will be chosen as a new standard point. To repeat above steps and update the coordinates of the boundary until there are no standard points in the queue, and the coordinates of the boundary is indicating the ranges of the object. And next, the step will return to the first step and search the next edge point until the whole image frame is searched completely. Figure 5 shows a sample of object segmentation. The red grids mean a coordinates which is the upper left and the lower right of a color region. The two coordinates can represent the ranges of the object. 3.2 Circle Detection Module After obtaining the boundaries of color region from the module of object segmentation, it will conjecture that a colored ball whether or not exists in the colored regions. Therefore, this paper uses the randomized circle Figure 4. A sample after the process of obtain the edge. Figure 5. A sample of object segmentation.

4 264 Shih-An Li et al. detection (RCD) method [14,20] to detect a circular object in the color regions. The first step is separating the object colors from the background colors. Using the operation of RGB difference ratio is easier to separate the more vivid object from the duller background, and it highlights the edges of object. The equation can be expressed as follows: (1) All target pixels will be computed by equation (1). Figure 6 shows an example of some pixel values by using the operation of RGB different ratio. The target pixels can divided from others pixels easier because the difference values. To simplify the program design, the value of each pixel should be normalized 0 to 255. The image will be expressed to a normalization image by using the method. And then, a sobel operator will be used to obtain the edge points set in this normalization image [21 23]. We assume the point set is V ={(x, y)}. In a Cartesian coordinate system, the Pythagorean Theorem [24] is used to obtain the circle center coordinates (a, b) and radius r which the sets of all points (x, y). And it satisfied the follow equation: The equation can be rewritten as follows: (2) (3) Let v i =(x i, y i ), i = 1, 2, 3 are three points which is randomized selection in V. Assume v 1, v 2, v 3 are not collinear, and assure of the three points must greater than a distance of pixels. Substituting the three points into (3) will obtain (4): where r 123 is radius, (a 123, b 123 ) is the circle center coordinate. Equation (4) can be rewritten a linear system andusegaussianeliminationtoobtainequationsuchas (5): (5) It has known that v 1, v 2, v 3 are not collinear from assumption, by using Cramer s rule [25] and (6) will get the solution of circle center: (6) By using the solution of circle center and (2) will get the circle radius, as describes in (7): (7) Determining the distance from circle center to other edge points, it will be considered that the circle get a vote if the distance less than the pre-setting threshold. It will be considered a real circle if the numbers of vote large than the pre-setting threshold, else the v 1, v 2, v 3 will be deleted from the edge set, and repeat above steps. Finally, the circle center and circle radius are stored to a (4) Figure 6. Example of RGB difference ratio.

5 Circle Object Recognition Based on Monocular Vision for Home Security Robot 265 database. Otherwise, if the remaining edge points less than a setting threshold, the circle detection will be terminated. It means there is no circular object in the color region. The RCD is faster than the other HT-based methods [11]. Unlike the HT-based methods, the RCD does not need to vote in the parameter space. Hence, it indeed does not need any extra storage for representing the accumulator which is needed in the previous HT-based methods. The RCD is also faster, and demands less memory space than the RHT method [12] when the noise level is between the light level and the modest level. For a heavy noise level, the RHT could be faster than the RCD. However, the RHT also needs a huge amount of memory requirement. green circle shows the recognition results by the RCD method. The results shows that the recognize objects method only use color is affected by light sources, but the proposed method is solved the problem of inexact identification by circle detection. The Table 2 presents the executions time and success rate of the proposed method, the successful rate is performed on a compound data set of 2000 images. 4.3 Environments with Similar Objects The third experiment is the comparison of the detection accuracy between the propose method with the RCD and the method only depend on color features. In previous work of this paper, the adopted method is only base on absolute color features for object recognition. 4. Experimental Results In this Section, the experimental results about the accuracy of the detection are reported. The proposed method of circle object recognition in this paper is effective. There are three different kinds of experimental environments are performed to illustrate the efficiency of the proposed methods: (1) Complex environment, (2) Different illuminant environment, and (3) environment with similar objects. The purpose of the experiment was to find out the red ball in these environments. The experiment results were shown as follow, and performance data is presented in the table. 4.1 Complex Environments The first experimental results of object recognition method in complex environments are shown in Figure 7. In these images, the red regions will be segmented. The object with the red color is drawn with a red rectangular. The RCD method can find out the circle object correctly. The object with circle feature is determined by the proposed method. The green circle shows the results. The Table 1 presents the executions time which the proposed method. 4.2 Different Illuminant Environments The second experiment presents the recognition results in different illuminant environments. In the Figure 8, the red object is drawn with the red rectangular. The Figure 7. The experiment results at complex environment.

6 266 Shih-An Li et al. Table 1. The executions time at complex environment Executions time (times/sec) Experimental results numbers capture frame execute recognition (a) (b) (c) (d) Table 2. Executions time at different illuminant environments Executions time (times/sec) Experimental results numbers capture frame execute recognition Success rate (%) (a) % (b) % (c) %0 Figure 8. Experiment results at different illuminant environments. There are some interference with similar color near the red ball. In the Figure 9, the red object is drawn with the red rectangular. The green circle shows the recognition results. The result of propose method is shown in Figure 9(a), and the object recognition method only depend on color and it is shown in the Figure 9(b) and (c). The executions time of the object recognition method only depend on color is much less but the object recognition result is more unstable. In the Table 3, the executions time and successful rate of this method is presented, the successful rate also is performed on a compound data set of 2000 images. It was shown that this method has better recognized ability in real time processing. Therefore, it can prove the proposed circle object recognition method in this paper is effective. 5. Conclusions In this paper, a circle object recognition method Figure 9. The experiment results at environment with similar objects. Table 3. The executions time at environment with similar objects Executions time (times/sec) Experimental results numbers capture frame execute recognition Success rate (a) % (b) and (c) % based on monocular vision for the home security robots is proposed. This proposed method is able to find a colored ball rapidly. Two sub-modules are implemented in this system. The proposed method checks the objects with color and radius feature in a circle-all the radius are the same. The experimental results illustrate the effectiveness of the proposed method. It has capability of image processing in real-time and recognizes a colored ball accurately but without enormous algorithm.

7 Circle Object Recognition Based on Monocular Vision for Home Security Robot 267 Acknowledgements This research was supported in part by the National Science Council (NSC) of the Republic of China under contract NSC E References [1] Intelligent Robotics Industry: Analysis & Investment Opportunities, Department of Investment Services, Ministry of Economic Affairs, Taipei: Ministry of Economic Affairs (2008). [2] Jia, L. Q., Liu, H. M., Wang, Z. H. and Chen, H., An Effective Non-HT Circle Detection for Centers and Radii, Proc. of the 2011 International Conference on Machine Learning and Cybernetics (ICMLC), Guilin, China, Vol , pp (2011). doi: / ICMLC [3] Ceccarelli, M., Petrosino, A. and Laccetti, G., Circle Detection Based on Orientation Matching, Proc. of 11th International Conference on Image Analysis and Processing, Palermo, Italy, Vol , pp (2001). doi: /ICIAP [4] Rad, A. A., Faez, K. and Qaragozlou, N., Fast Circle Detection Using Gradient Pair Vectors, DICTA, pp (2003). [5] Ho, C. T. and Chen L. H. A Fast Ellipse/Circle Detector Using Geometric Symmetry, Pattern Recognition, Vol. 28, Issue 1, pp (1995). doi: / (94)00077-Y [6] Davies, E. R., Machine Vision: Theory, Algorithms, Practicalities, Academic Press, London (1990). doi: / (91) [7] Ballard, D. H. Generalizing the Hough Transform to Detect Arbitrary Shapes, Pattern Recognition, Vol. 13, No. 2, pp (1981). doi: / (81) [8] Brown, C. M. Inherent Bias and Noise in the Hough Transform, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 5, pp (1983). doi: /TPAMI [9] Illingworth, J. and Kittler, J., Survey: A Survey of the Hough Transform, Computer Vision, Graphics, Image Process, Vol. 44, Issue 1, pp (1988). doi: /S X(88) [10] Leavers, V. F., Survey: Which Hough Transform, CVGIP: Image Understanding, Vol. 58, pp (1993). doi: /cviu [11] Duda, R. O. and Hart, P. E., Use of the Hough Transformation to Detect Lines and Curves in Pictures, Communications of the ACM, Vol. 15, Issue 1, pp (1972). doi: / [12] Xu, L., Oja, E. and Kultanan, P., A New Curve Detection Method: Randomized Hough Transform (RHT), Pattern Recognition Letters, Vol. 11, Issue 5, pp (1990). doi: / (90) Z [13] Xu, L. and Oja, E., Randomized Hough Transform (RHT): Basic Mechanisms, Algorithms, and Computational Complexities, CVGIP: Image Understanding, Vol. 57, No. 2, pp (1993). doi: / ciun [14] Chen, T. C. and Chung, K. L., An Efficient Randomized Algorithm for Detecting Circles, Computer Vision and Image Understanding, Vol. 83, No. 2, pp (2001). doi: /cviu [15] D Orazio, T., Guaragnella, C., Leo, M. and Distante, A., A New Algorithm for Ball Recognition Using Circle Hough Transform and Neural Classifier, Pattern Recognition, Vol. 37, No. 3, pp (2004). doi: /S (03) [16] Gonzalez, R. C. and Woods, R. E., Digital Image Processing 3/e, 3rd ed., Prentice Hall, United States (2008). [17] Yu, C. J., Hardware/Software Co-Design of Real-Time Human Face Detection, Master Thesis, Department of Electrical Engineering, Tamkang University, Taiwan (2010). [18] Chiu, C. C., Ku, M. Y. and Liang, L. W., A Robust Object Segmentation System Using a Probability- Based Background Extraction Algorithm, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 20, No. 4, pp (2010). doi: /TCSVT [19] Xu, D., Liu, J., Li, X., Liu, Z. and Tang, X., Insignificant Shadow Detection for Video Segmentation, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, No. 8, pp (2005). doi: /TCSVT [20] Chung, K. L., Image Processing and Computer Vision,

8 268 Shih-An Li et al. 5th ed., Tunghua, Taiwan (2008). [21] Lindeberg, T., Edge Detection and Ridge Detection with Automatic Scale Selection, International Journal of Computer Vision, Vol. 30, No. 2, pp (1998). doi: /A: [22] Canny, J., A Computational Approach to Edge Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 6, pp (1986). doi: /TPAMI [23] Sobel operator, Information on org/wiki/sobel_operator [24] Pythagorean theorem, Information on [25] Cramer s rule, Information on wiki/cramer s_rule Manuscript Received: Feb. 20, 2013 Accepted: Jun. 28, 2013