Modern Manufacturing Engineering ›› 2024, Vol. 529 ›› Issue (10): 130-137.doi: 10.16731/j.cnki.1671-3133.2024.10.017

Previous Articles     Next Articles

Improved ViT-based method for molten pool recognition and online detection of welding deviation

JIANG Yuxuan1, LIN Kai1, WANG Yaoqi1, ZHANG Yue1, HONG Yuxiang1,2   

  1. 1 College of Mechanical and Electrical Engineering,China Jiliang University,Hangzhou 310018,China;
    2 Key Laboratory of Intelligent Manufacturing Quality Big Data Tracing and Analysis of Zhejiang Province, China Jiliang University,Hangzhou 310018,China
  • Received:2024-02-02 Online:2024-10-18 Published:2024-10-29

Abstract: Accurate detection of welding deviations is a prerequisite for automatic seam tracking and intelligent welding by welding robots.An improved ViT-based method for molten pool recognition and online detection of welding deviation was proposed. Firstly,the lightweight ViT model Segformer was used as the baseline model. The Shuffle Attention (SA) was embedded before mask segmentation to better capture the dependencies of feature information in both spatial and channel dimensions. Thus,the model's segmentation accuracy was enhanced.Secondly,a Context Broadcasting (CB) module was added to the Multilayer Perceptron (MLP) to improve the generalization capability while ensuring low parameters of model. Finally,based on the model segmentation results,a welding deviation calculation method was proposed to quantitatively describe the deviation detection accuracy. The experimental results show that,compared with the baseline model,the mean intersection over union and mean pixel accuracy of proposed model were increased by 2.67 % and 2.12 %,respectively,and it has good generalization for different preset torch offsets. The welding deviation accuracy was controlled between ±0.021 mm,which provided a basis for seam tracking in precision welding.

Key words: welding deviation, seam tracking, molten pool recognition, Vision Transformer (ViT), attention mechanism

CLC Number: 

Copyright © Modern Manufacturing Engineering, All Rights Reserved.
Tel: 010-67126028 E-mail: 2645173083@qq.com
Powered by Beijing Magtech Co. Ltd