Rentao Xiong,Zengliang Lai,Yisheng Guan*,Yufeng Yang and Chuanwu Cai

(1. School of Electromechanical Engineering,Guangdong University of Technology,Guangzhou 510006,China; 2.Foshan Biowin Robotics and Automation Technology Co.,Ltd.,Foshan 528000,Guangdong,China)

Abstract: The phenomenon of burring is common in the manufacturing of metal parts. This phenomenon directly influences the assembly accuracy and service performance of the mechanical parts. In this work,we propose a vision-based method for two-dimensional planar workpiece. The proposed technique has the ability to recognize burr contour and generate the coordinate sequence in real-time along x and y directions. The robotic deburring efficiency is improved based on the quantitative information of the burr size. First,by utilizing the local deformable template matching algorithm,we match the standard workpiece contour with the workpiece contour to be processed and compute the corresponding pixels distance between the two contours. Second,we set the distance thresholds in order to divide the burr contours into different levels. We extract the coordinates of the burr contours and map them to the standard workpiece contour. As a result,the closed-loop robotic deburring path sequence is generated. Finally,on the basis of the quantitative information of burr size,we adjust the deburring speed in real-time during the deburring process. The experiments performed in this work show that the deburring time of the proposed method is reduced by 15.45%,as compared with the conventional off-line programming deburring methods. Therefore,for industrial mass production,the deburring efficiency is greatly improved.

Keywords: robotic deburring; assembly accuracy; contour recognition; template matching; deburring efficiency

1 Introduction

The improvement in the deburring efficiency has become a crucial research topic in recent years[1]. The demand for production quality and efficiency becomes more critical as the requirements of mechanical parts in modern manufacturing industry increase[2]. The traditional deburring methodologies are unable to meet the requirements of modern production processes due to various factors,such as,high production cost,low efficiency,and poor manufacturing accuracy[3]. Therefore,it is particularly necessary to develop the technology of robotic deburring.

Industrial robots have been widely used in the field of robotic automation technology. The research community compared the robot automation technology with the traditional Computer Numerical Control (CNC) machine tools and identified the existing issues[1]. These studies also highlight the future potential,characteristics of high flexibility and reconfiguration of these robots,which is an important aspect for automatic manufacturing systems. In Ref.[2],authors generate the deburring trajectory by manual teaching method,which can be accurately tracked based on the established mathematical model and control algorithm. This method is effective for those cases where the workpiece has a large or complex shape,however,it takes a long time to obtain the deburring trajectory,thus leading to a poor deburring efficiency. In order to mitigate this issue,off-line programming method[3-4]is developed,which shortens the time of obtaining the deburring path. However,the deviation usually exists between the established Computer Aided Design (CAD) model and the actual workpiece. Furthermore,when the workpiece produces casting deformation,it not only results in a low deburring precision,but may also damage the deburring end-effector. During the deburring process,the geometric shape and the position of the workpiece may change at any time. Thus,in order to improve the flexibility and adaptability of robotic deburring,initiative control method[5]is proposed. This method is regarded as an excellent solution to cope with the problem of geometric deviation and calibration error. In order to eliminate the influence of rough blank dimension tolerance and machining chucking appliance deviation,an on-line trajectory generation method based on normal-force control[6]is proposed. However,the force sensor is sensitive to the vibration generated during the deburring process. This phenomenon results in a poor accuracy of force vector information and low deburring efficiency. The model-based fuzzy controller method[7]compensates the path deviation for adjusting the inflexibility parameters of the robot and improves the machining accuracy of robotic milling. However,this technique relies on the manual teaching method to obtain the deburring trajectory. This teaching technique is a time-consuming process and cannot improve deburring efficiency. A position-force hybrid control strategy[8-9]is widely used in the field of robotic deburring,grinding,and polishing. The core idea of hybrid strategy is to track the machining trajectory under the position control model and make the cutting force in the normal direction. This control method provides robustness and high machining accuracy,which is applied to remove the burr of complex shapes and non-spherical surfaces. However,this method requires the deburring path primarily based on manual teaching method or off-line programming. In order to improve the efficiency of robotic deburring,Princely and Selvaraj[10-11]proposed a method on the basis of machine vision. The proposed technique overcomes the shortcomings of manual teaching and off-line programming and provides effective solutions for multiple workpiece shapes and mass production. Thus,this technique saves the time during the process of obtaining the deburring trajectory. Princely and Selvaraj[10]use the shape data of workpiece and machining conditions to automatically generate deburring trajectory. In another experiment,the authors divide the workpiece edge contour into multiple straight lines and arcs[11]. It is noticeable that both of these methods are able to solve the problem induced by traditional deburring methods. However,the method proposed by Princely and Selvaraj does not have the ability to analyze the distribution of burr on the workpiece,and high deburring efficiency is not achievable. Moreover,when the workpiece produces casting deformation,it usually leads to inadequate or excessive deburring.

The authors in Refs.[12-13] present a method of reconstructing the three-dimensional image of workpiece based on the vision sensor. The proposed method analyzes the similarity between point cloud data and the actual workpiece size,which assists in automatic tracking and adjusting deburring trajectory in real-time. This method partially overcomes the weaknesses of inadequate or excessive deburring caused by casting deformation. It is noticeable that the workpiece has a complex shape,and the point cloud of this workpiece results in a data that is not easy to match. Thus,a sufficient matching precision is not guaranteed as the method is constrained by the local shape. The robustness of contour tracking can be improved by extracting the contour of the workpiece based on machine vision and using the spline interpolator[14]with S-Curve acceleration and deceleration to generate motion instructions. This method significantly enhances the deburring precision,but the machining accuracy and the efficiency of the robotic deburring is lowered at the same time. In order to monitor the speed and motion accuracy,a control algorithm of non-linear machining speed adjustment is presented in Ref.[15]. However,this technique is still theoretical and is not evaluated by experimental results. In summary,for vision-based robotic deburring method,the workpiece edge contour can be quickly extracted as the deburring trajectory. This method ensures significant computational efficiency in comparison with the conventional methods,such as manual teaching and off-line programming. In order to improve the efficiency of robotic deburring,based on the quantitative information of burr size,the initial step is to insert the position and size information of burr contour into the deburring path. Meanwhile,the coordinates sequence of the burr contour should be in the same direction as the deburring path sequence of the standard workpiece contour,as presented in Fig.1.

Fig.1 Practical closed-loop deburring path sequence

On the basis of the aforementioned discussion,we conclude that the improvements in the deburring efficiency are achievable in two steps. 1) By extracting the workpiece edge contour accurately as the deburring trajectory. 2) By ensuring the deburring precision. Keeping in view the existing issues of robotic deburring,in this work,we propose a vision-based method for burr contour coordinates to be mapped and inserted in the standard workpiece contour. Additionally,the correct deburring sequence is generated alongxandydirections. In order to improve the deburring efficiency,we adjust the deburring speed in real-time based on the quantitative information of burr size.

2 Principle of Burr Contour Coordinates Real-Time Mapping and Sequence Generation

The process of inserting burr contour coordinates and size information into the closed-loop robotic deburring path is performed in various steps. First,we match the workpiece contour to be processed to the standard workpiece contour and compute the corresponding pixel's distance between the two contours. Then,in real-time,we map the burr contour coordinates to the standard workpiece contour and generate the sequence in the same direction as the closed-loop deburring path. Finally,we adjust the deburring speed in real-time in accordance with the size information of the burr.

2.1 Contour Matching Based on Local Deformable Template Matching Algorithm

The template matching algorithm is a classical algorithm in the field of machine vision and image processing. The template matching class includes algorithms based on shape,components,correlation,and deformability. In order to adapt the tiny deviations caused by workpiece casting deformation in robotic deburring technology,local deformable template matching algorithm is applied to achieve a high matching accuracy. The algorithm is defined as

H=H0+P(x,y,θ,l)F

(1)

where,HandH0represent the deformable template contour and the standard workpiece contour,respectively. In parameter vectorP,xandyrepresent translation,θrepresents rotation,lrepresents scaling,andFdenotes the affine-transformation matrix from standard workpiece contour to deformable template contour. The translation parameters which affect the establishment of template contour in thexandydirections are set to 5 mm. The rotation factorθis set to ±5 degrees,and the scale factorlis set to 1.2. These parameters are determined on the basis of the general deformation range of the actual casting workpiece.

After establishing the deformable template contour,the matching process between the standard workpiece contour and the workpiece contour to be processed is performed. When the optimal value of the process is reached,it is ensured that the matching degree between the two contours is maximized,i.e.,the distance between the corresponding pixels of two contours is highly accurate. This optimal value is analogous to obtaining the minimum value of the following energy function

E=λ1E1+λ2E2+λ3E3

(2)

whereλ1,λ2,andλ3represent the non-negative weight parameters defined during the matching process.Ai(i= 2,3,4,...) denotes the pixel point on the deformable contour,as presented in Fig. 2.E1represents the deformation energy function,E2represents the smoothness energy function,andE3represents the external energy function. The energyE3is mainly determined by the matching degree between the template contour and the workpiece contour that is to be processed.

Fig.2 Pixel points on the deformable contour

The energy functions are defined as follows:

1) The deformation degree of the template contour is determined by the changeable parameters of pointAi(x，y，θ，l),and is defined as

(3)

In Eq. (3),the energy functionE1varies according to the degree of self contour deformation. The numerator of Eq. (3) represents the modulus of parameter vectorAi,and the denominator represents the varianceσof all the points on the deformable contour.

2) The smoothness energy function of the template contour is computed on the basis of distance deviation from the adjacent points to the centroid of the contour. The expression for smoothness energy function is

(4)

In Eq. (4),O0represents the centroid of the contour,and ||Ai-O0|-|Ai+1-O0|| denotes the distance deviation from the adjacent points to the centroid.

3) The external energy function is used to evaluate the matching degree,which represents the deformation trend from the standard contour to the workpiece contour to be processed. The mathematical expression is

(5)

In Eq. (5),E3represents the gradient magnitude of the points on the deformable template contour,|gradf(xi,yi)| denotes the gradient value of pointAi,andθrepresents the gradient direction. Please note that the pointAimaximizes its gradient value by searching one of the points on the workpiece contour that is to be processed.

The minimum value of Eq. (2) is expressed as the sum of the minimum values of the respective energy functionsE1,E2,andE3. The global minimum value is defined by the weightsλ1,λ2,andλ3. The values ofλ1,λ2,andλ3are estimated on the basis of multiple tests comprising matching process based on the method of controlling the single variable. However,we need to ensure thatλ1+λ2+λ3=1. When the minimum value of Eq. (2) is obtained,it indicates that the sum of the energy function has achieved the optimal solution. The standard workpiece contour achieves the highest matching precision with the workpiece contour that is to be processed.

2.2 Real-Time Mapping and Sequence Generation of Burr Contour Coordinates on x and y Directions

After calculating the distance between the corresponding pixels of two contours,we set the distance threshold in order to divide the burr contour in different levels. Since the coordinates of the burr contour are out of sequence,the coordinates that are mapped to the standard workpiece contour are also out of sequence. When the robot moves to the coordinates of the burr contour and we consider the standard workpiece contour as the deburring path,the coordinates sequence of the burr contour may contradict the standard closed-loop deburring path. Consequently,the robot moves in the opposite direction. This phenomenon does not allow us to achieve high deburring precision. In addition,this phenomenon also leads to a low deburring efficiency and can damage the deburring tool.

We extract the burr contour in thexdirection as presented in Fig. 3. The pointBand pointDwith pointIand pointGdenote the endpoints of the burr contour. It is noticeable that the sequence of the standard workpiece deburring path isACEandFHJ. When we map and insert the coordinates of pointBand pointDwith pointIand pointGin the standard workpiece contour,the correct closed-loop deburring path sequence should beAB'CD'EandFG'HI'J. Where,pointB' and pointD' with pointI' and pointG' denote the inserted points of burr contourBDandIG. We determine the coordinate's sequence of pointB' and pointD' with pointI' and pointG',which is similar as defining the coordinate's sequence of pointBand pointDwith pointIand pointG. This is defined as

σ1=(Bx-Dx)|(Ix-Gx)

(6)

Fig.3 Burr contour coordinates mapping and sequence generation in x direction

Ifσ1< 0,i.e.,Bx 0,i.e.,Bx>DxandIx>Gx,similar to the situation presented in Fig. 3,the coordinate's sequence of burr contour is in the same direction as the standard closed-loop deburring path. Thus,the deburring sequence isAB'CD'EandFG'HI'J. According to formula (6),in both cases,the coordinate's sequence of the burr contour that is mapped and inserted into the standard workpiece contour will always be in the same direction as the standard closed-loop deburring path sequence,as shown in Fig.4.

We extract the burr contour inydirection as presented in Fig.5. The pointLand pointNalong with pointSand pointQrepresent the endpoints of the burr contour. The sequence of the standard workpiece deburring path isKMOandPRT. When we map and insert the coordinates of pointLand pointNwith pointSand pointQin the standard workpiece contour. Thus,the correct closed-loop deburring path sequence isKL'MN'OandPQ'RS'T,where,pointL' and pointN' with pointS' and pointQ' are the inserted points of burr contourLNandSQ. We determine the coordinate's sequence of pointL' and pointN' with pointS' and pointQ'. This is analogous to defining the coordinates sequence of pointLand pointNwith pointSand pointQ. This is mathematically expressed as

σ2=(Ly-Ny) | (Sy-Qy)

(7)

Fig.4 Standard closed-loop contour deburring sequence in x direction

Ifσ2< 0,that is,Ly 0,i.e.,Ly>NyandSy>Qy,we change the deburring sequence toKN'ML'OandPS'RQ'Tby swapping the coordinates of pointLand pointNwith pointSand pointQ. Thus,according to formula (7),the sequence of the burr contour coordinates in both cases are mapped and inserted into the standard workpiece contour. This ensures the same direction as the standard closed-loop deburring path sequence,as shown in Fig. 6.

It is noticeable that for the closed-loop workpiece contour,the coordinates of the burr contour and the standard deburring path are in the same sequence in the end. These paths are generated inxandydirections on the basis of formula (6) and formula (7). The final closed-loop deburring path is presented in Fig. 7.

Fig.5 Burr contour coordinates mapping and sequence generation in y direction

Fig.6 Standard closed-loop contour deburring sequence in y direction

2.3 Deburring Speed Real-Time Adjustment

After the generation of the final closed-loop deburring path,we adjust the deburring speed in accordance with our burr size. We define the size of each burr contour on the basis of the maximum value of all the corresponding pixel distances. This is divided into three levels based on three different deburring speeds,as presented in Fig. 8. The burr size within a certain range of distance threshold processes with the same deburring speed,i.e.,large,medium,and small range of burr sizes correspond to low,medium,and high deburring speeds.

Fig.7 Final deburring path sequence for closed-loop contour

Fig.8 Levels of burr size and deburring speed division

3 Real-Time Sequence Generation of Burr Contour Coordinates and Robotic Deburring Experiment

3.1 Real-Time Mapping and Sequence Generation of Burr Contour Coordinates

In this experiment,we randomly consider 90 workpieces of same type. The shapes of the workpiece is presented in Fig. 9.

Fig.9 Real workpiece for robotic deburring experiment

Fig. 9 presents the original image of the workpiece. This image is captured by the camera which is mounted directly above the light source board,as illustrated in Fig. 10. Since we make use of a monochrome camera,when the workpiece is placed on the light source board,the image comprises two colors,i.e. black and white. In order to obtain the high-quality original images,we keep the light source board in a slightly bright state while capturing the images. This phenomenon has different effects. First,it reduces the influence of the reflected light on the quality of the captured image and also results in the reduction of noise interference. Second,it is possible that the workpiece image forms a huge color difference as compared to the background. This process ensures that the workpiece contour is captured clearly. The aforementioned measures ensure the accuracy of the subsequent contour matching and the efficient estimation of burr size is secured. In the case of actual closed-loop workpiece contour,we estimate the burr contour recognition and coordinate's sequence by performing image acquisition,contour matching,and the corresponding pixels distance calculation. This is presented in Fig. 11. Please note that the green contour represents the standard workpiece contour,the blue contour represents the workpiece contour to be processed,and the red contour represents the burr contour.

Fig.10 Experimental equipment of robotic deburring

Fig.11 Results of burr contour recognition and mapped coordinates

3.2 Robotic Deburring Experiment

The experimental equipment for robotic deburring comprises NACHI robot,deburring end-effector,image acquisition device,sensors,machining platform,and control parts. This is shown in Fig.10.

As presented in Fig.12,since the workpieces used in the experiment suffer from random casting deformation,the template contour library formed by local deformable matching algorithm can be adapted to the deformation caused due to the translation,rotation,and scaling,where a high matching degree is achieved. As compared to the methods which rely on linear deformation and shape,the method of building template contour library based on linear deformable is only able to translate the deformed workpiece contour inxandydirections. So,it is unable to adapt rotation and scaling deformations of whole closed-loop contour,and its matching degree is second. The template contour library based on shape only matches roughly with the workpiece contour with the same shape,as it is difficult to accurately match the workpiece contour considering all directions of deformation,and its matching degree is the lowest. On the basis of high matching degree of local deformable algorithm,the precision information of burr size is obtained after the workpiece contour to be processed is matched with the standard workpiece contour. This process is the preliminary preparation for the subsequent improvement in the deburring efficiency.

Fig.12 Matching degree comparison of three methods

The quantitative value of burr size is presented in Fig.13. Please note that in this work,we divide the burr size in three levels. For the large,medium,and small size of burr,the corresponding deburring speed isV1=20 mm/s,V2=60 mm/s,andV3=100 mm/s. Please note thatV2represents the conventional off-line programming deburring speed.

Fig.13 Value of the burr size and the divided deburring speed

During the experiment of robotic deburring,we record 20 groups of deburring time,both for adjustable deburring speed and for conventional off-line programming deburring speed. The corresponding results are presented in Table 1. It is noticeable that as compared to the conventional uniform deburring speed,the deburring time of the deburring speed which is adjusted in real-time based on the quantitative information of burr size is shortened.

Table 1 Comparison of the deburring time for conventional off-line programming deburring speed and adjustable deburring speed (s)

4 Conclusions and Future Work

In this work,we extract the burr contour and the burr coordinates. The extracted coordinates are mapped to the standard workpiece contour. This work is done on the premise of ensuring robotic deburring precision in case of two-dimensional planer workpiece. We also approximate the correct coordinate sequence of the burr contour in accordance with the judge formulas. The final deburring path sequence of closed-loop contour is generated. Finally,the deburring speed is adjusted in real-time on the basis of quantitative information of the burr size. The experiments performed in this work highlight the following contributions.

1) The burr contour is divided into different levels based on the distance thresholds. The coordinates of the burr contour are inserted into the standard workpiece contour with the same sequence obtained from the final closed-loop deburring path. Thus,the robot adjusts the deburring speed accurately for current deburring position.

2) The deburring speed is adjusted in real-time based on the quantitative information of burr size. As compared to the conventional off-line programming deburring speed,the technique proposed in this work reduces the average deburring time by 15.45%. Therefore,for industrial mass production,the deburring efficiency is greatly improved.

Due to anisotropy of burr shape and the random distribution,we are not completely successful to estimate the optimal method to define the burr size of various shapes. Further research is required to achieve a higher efficiency in the field of robotic deburring.