A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization

Jiahao FU; Hongdi LIU; Minqi HE; Dahu ZHU

doi:10.51393/j.jamst.2022005

Volume 2 Issue 1

Mar. 2022

Turn off MathJax

Article Contents

Article Navigation > Journal of Advanced Manufacturing Science and Technology > 2022 > 2(1): 2022005

Jiahao FU, Hongdi LIU, Minqi HE, Dahu ZHU. A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization[J]. Journal of Advanced Manufacturing Science and Technology , 2022, 2(1): 2022005. doi: 10.51393/j.jamst.2022005

Citation:

Jiahao FU, Hongdi LIU, Minqi HE, Dahu ZHU. A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization[J]. Journal of Advanced Manufacturing Science and Technology , 2022, 2(1): 2022005. doi: 10.51393/j.jamst.2022005

Citation:

PDF( 10389 KB)

A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization

doi: 10.51393/j.jamst.2022005

Jiahao FU^a,b,
Hongdi LIU^a,b,
Minqi HE^a,b,
Dahu ZHU^{a,b
,
,}

a Hubei Key Laboratory of Advanced Automotive Components Technology, Wuhan University of Technology, Wuhan 430070, China;
b Hubei Collaborative Innovation Center for Automotive Components Technology, Wuhan University of Technology, Wuhan 430070, China

Funds:

This study was co-supported by the Hubei Province Key R&D Program (No. 2020BAA025) and the National Natural Science Foundation of China (No. 51975443).

Received Date: 2022-01-12
Rev Recd Date: 2022-02-18

Available Online: 2022-03-11

Publish Date: 2022-03-11

Abstract

Abstract

The vision-guided robotic machining accuracy highly depends on the hand-eye calibration accuracy between robot and vision equipment. In order to address the problem of less parameter constraints in existing hand-eye calibration methods, in this paper a hand-eye calibration algorithm of binocular stereo vision is proposed based on multi-pixel 3D geometric centroid relocalization. The algorithm mainly includes three steps:1) the checkerboard relocalization images of multiple sets of fixed-point pose transformations are captured by the binocular stereo vision; 2) the robot tool center point (TCP) coordinates in the binocular coordinate system are obtained by an iterative reweighted least squares algorithm based on sub-pixel corner extraction, and 3) the hand-eye transformation matrix between the binocular system and the robot is obtained by the singular value decomposition (SVD). The experimental results show that both the average error and the mean square error of the proposed hand-eye calibration algorithm can reach 0.45mm and 0.21mm, respectively, which are much smaller than the existing algorithms and can meet the accuracy requirements of robotic positioning and machining.
- Hand-eye calibration,
- Binocular stereo vision,
- Relocalization,
- Iterative reweighted least squares,
- Singular value decomposition

FullText(HTML)

References(22)

References

[1]	. Zhu DH, Feng XZ, Xu XH, et al. Robotic grinding of complex components: A step towards efficient and intelligent machining-challenges, solutions, and applications. Robotics and Computer Integrated Manufacturing 2020; 65: 101908.
[2]	. Hao DX, Wang W, Wang QL, et al. Applications and development trend of robotics in composite material process. Journal of Mechanical Engineering 2019; 55(3): 1-17.
[3]	. Yu Y, Wang RQ, Wang YP, et al. Contact force controlled robotic polishing for complex PMMA parts with an active end-effector. Journal of Advanced Manufacturing Science and Technology 2021; 1(4): 2021012.
[4]	. Zhu DH, Xu XH, Li WL. Research progress in robotic grinding technology for complex blades. Acta Aeronautica et Astronautica Sinica 2021; 42(10): 8-30[Chinese].
[5]	. Zhang P, Kai Z, Li ZW, et al. High dynamic range 3D measurement based on structured light: A review. Journal of Advanced Manufacturing Science and Technology 2021; 1(2): 2021004.
[6]	. Kim J, Lee J, Chung M, et al. Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration. Multimedia Tools and Application 2021; 80(13): 9703–9719.
[7]	. Shi XJ, Liu T, Han X. Improved iterative closest point (ICP) 3D point cloud registration algorithm based on point cloud filtering and adaptive fireworks for coarse registration. International Journal of Remote Sensing 2020; 41(8): 3197-3220.
[8]	. Vlaeyen M, Haitjema H, Dewulf W. Error compensation for laser line scanners. Measurement 2021; 175:109085.
[9]	. Yin XQ, Tao W, Feng Y, et al. A robust and accurate breakpoint detection method for line-structured laser scanner. Optics & Laser Technology 2019; 118: 52-61.
[10]	. Zhong L, Qin J, Yang X, et al. An accurate linear method for 3D line reconstruction for binocular or multiple view stereo vision. Sensors 2021; 21(2):658.
[11]	. Gao ZW, Tan XD, Liu K. Object recognition and capture based on binocular vision ． Science Technology and Engineering 2020; 20(20): 8285-8291.
[12]	. Lv R, Liu HD, Wang ZJ, et al. WPMAVM: weighted plus-and-minus allowance variance minimization algorithm for solving matching distortion. Robotics and Computer-Integrated Manufacturing 2022; 76: 102320.
[13]	. Luo Z, Zhang K, Wang Z, et al. 3D pose estimation of large and complicated workpieces based on binocular stereo vision. Applied Optics 2017; 56(24): 6822-6836.
[14]	. Dong JT. Line-scanning laser scattering system for fast defect inspection of a large aperture surface. Applied Optics 2017; 56: 7089-7098.
[15]	. Shiu YC, Ahmad S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB. IEEE Transactions on Robotics and Automation 1989, 5(1): 16-29.
[16]	. Tsai RY, Lenz RK. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation 1989; 5(3): 345-358.
[17]	. Liang R, Mao J. Hand-eye calibration with a new linear decomposition algorithm. Journal of Zhejiang University – SCIENCE A 2008; 9(10): 1363-1368.
[18]	. Zeng J, Cao G, Li W, et al. An algorithm of hand-eye calibration for arc welding robot. 16th International Conference on Ubiquitous Robots, 2019.
[19]	. Wang LF, Wang TM, Tang PF, et al. A new hand-eye calibration approach for fracture reduction robot. Computer Assisted Surgery 2019; 22(1): 113-119.
[20]	. Cao CT, Do VP, Lee BR. A novel indirect calibration approach for robot positioning error compensation based on neural network and hand-eye vision. Applied Sciences 2019; 9:1940.
[21]	. Wang LQ, Qian L. Study on hand-eye calibration of robot and 3D camera based on 3D calibration block. Laser & Optoelectronics Progress 2021; 58(24):2433001.
[22]	. Ren JX, Zhang X, Liu SL, et al. A high-precision robot hand-eye calibration method. Modern Manufacturing Engineering 2020; 4:44-51.