Academic Journal
Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks
| العنوان: | Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks |
|---|---|
| المؤلفون: | Shengbo Wang, Zengxu Li, Guodong Chen, Yaobin Yue |
| المصدر: | Scientific Reports, Vol 14, Iss 1, Pp 1-13 (2024) |
| بيانات النشر: | Nature Portfolio, 2024. |
| سنة النشر: | 2024 |
| المجموعة: | LCC:Medicine LCC:Science |
| مصطلحات موضوعية: | Medicine, Science |
| الوصف: | Abstract This study introduces a novel approach that addresses the limitations of existing methods by integrating 2D image processing with 3D point cloud analysis, enhanced by interpretable neural networks. Unlike traditional methods that rely on either 2D or 3D data alone, our approach leverages the complementary strengths of both data types to improve detection accuracy in environments adversely affected by welding spatter and smoke. Our system employs an improved Faster R-CNN model with a ResNet50 backbone for 2D image analysis, coupled with an innovative orthogonal plane intersection line extraction algorithm for 3D point cloud processing. By incorporating explainable components such as visualizable feature maps and a transparent region proposal network, we address the “black box” issue common in deep learning models.This architecture enables a more transparent decision-making process, providing technicians with necessary insights to understand and trust the system’s outputs. The Faster-RCNN structure is designed to break down the object detection process into distinct, understandable steps, from initial feature extraction to final bounding box refinement. This fusion of 2D-3D data analysis and interpretability not only improves detection performance but also sets a new standard for transparency and reliability in automated welding systems, facilitating wider adoption in industrial applications. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2045-2322 |
| Relation: | https://doaj.org/toc/2045-2322 |
| DOI: | 10.1038/s41598-024-71989-w |
| URL الوصول: | https://doaj.org/article/7110c2aa47f44d508dfc15252f3e5efe |
| رقم الانضمام: | edsdoj.7110c2aa47f44d508dfc15252f3e5efe |
| قاعدة البيانات: | Directory of Open Access Journals |
Full Text Finder | ResultId |
1 |
|---|---|
| Header |
edsdoj Directory of Open Access Journals edsdoj.7110c2aa47f44d508dfc15252f3e5efe 1063 3 Academic Journal academicJournal 1063.00329589844 |
| PLink |
https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsdoj&AN=edsdoj.7110c2aa47f44d508dfc15252f3e5efe&custid=s6537998&authtype=sso |
| FullText |
Array
(
[Availability] => 0
)
Array ( [0] => Array ( [Url] => https://doaj.org/article/7110c2aa47f44d508dfc15252f3e5efe [Name] => EDS - DOAJ [Category] => fullText [Text] => View record in DOAJ [MouseOverText] => View record in DOAJ ) [1] => Array ( [Url] => https://resolver.ebscohost.com/openurl?custid=s6537998&groupid=main&authtype=ip,guest&sid=EBSCO:edsdoj&genre=article&issn=20452322&ISBN=&volume=14&issue=1&date=20240901&spage=1&pages=1-13&title=Scientific Reports&atitle=Weld%20seam%20object%20detection%20system%20based%20on%20the%20fusion%20of%202D%20images%20and%203D%20point%20clouds%20using%20interpretable%20neural%20networks&id=DOI:10.1038/s41598-024-71989-w [Name] => Full Text Finder (s6537998api) [Category] => fullText [Text] => Full Text Finder [Icon] => https://imageserver.ebscohost.com/branding/images/FTF.gif [MouseOverText] => Full Text Finder ) ) |
| Items |
Array
(
[Name] => Title
[Label] => Title
[Group] => Ti
[Data] => Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks
)
Array ( [Name] => Author [Label] => Authors [Group] => Au [Data] => <searchLink fieldCode="AR" term="%22Shengbo+Wang%22">Shengbo Wang</searchLink><br /><searchLink fieldCode="AR" term="%22Zengxu+Li%22">Zengxu Li</searchLink><br /><searchLink fieldCode="AR" term="%22Guodong+Chen%22">Guodong Chen</searchLink><br /><searchLink fieldCode="AR" term="%22Yaobin+Yue%22">Yaobin Yue</searchLink> ) Array ( [Name] => TitleSource [Label] => Source [Group] => Src [Data] => Scientific Reports, Vol 14, Iss 1, Pp 1-13 (2024) ) Array ( [Name] => Publisher [Label] => Publisher Information [Group] => PubInfo [Data] => Nature Portfolio, 2024. ) Array ( [Name] => DatePubCY [Label] => Publication Year [Group] => Date [Data] => 2024 ) Array ( [Name] => Subset [Label] => Collection [Group] => HoldingsInfo [Data] => LCC:Medicine<br />LCC:Science ) Array ( [Name] => Subject [Label] => Subject Terms [Group] => Su [Data] => <searchLink fieldCode="DE" term="%22Medicine%22">Medicine</searchLink><br /><searchLink fieldCode="DE" term="%22Science%22">Science</searchLink> ) Array ( [Name] => Abstract [Label] => Description [Group] => Ab [Data] => Abstract This study introduces a novel approach that addresses the limitations of existing methods by integrating 2D image processing with 3D point cloud analysis, enhanced by interpretable neural networks. Unlike traditional methods that rely on either 2D or 3D data alone, our approach leverages the complementary strengths of both data types to improve detection accuracy in environments adversely affected by welding spatter and smoke. Our system employs an improved Faster R-CNN model with a ResNet50 backbone for 2D image analysis, coupled with an innovative orthogonal plane intersection line extraction algorithm for 3D point cloud processing. By incorporating explainable components such as visualizable feature maps and a transparent region proposal network, we address the “black box” issue common in deep learning models.This architecture enables a more transparent decision-making process, providing technicians with necessary insights to understand and trust the system’s outputs. The Faster-RCNN structure is designed to break down the object detection process into distinct, understandable steps, from initial feature extraction to final bounding box refinement. This fusion of 2D-3D data analysis and interpretability not only improves detection performance but also sets a new standard for transparency and reliability in automated welding systems, facilitating wider adoption in industrial applications. ) Array ( [Name] => TypeDocument [Label] => Document Type [Group] => TypDoc [Data] => article ) Array ( [Name] => Format [Label] => File Description [Group] => SrcInfo [Data] => electronic resource ) Array ( [Name] => Language [Label] => Language [Group] => Lang [Data] => English ) Array ( [Name] => ISSN [Label] => ISSN [Group] => ISSN [Data] => 2045-2322 ) Array ( [Name] => NoteTitleSource [Label] => Relation [Group] => SrcInfo [Data] => https://doaj.org/toc/2045-2322 ) Array ( [Name] => DOI [Label] => DOI [Group] => ID [Data] => 10.1038/s41598-024-71989-w ) Array ( [Name] => URL [Label] => Access URL [Group] => URL [Data] => <link linkTarget="URL" linkTerm="https://doaj.org/article/7110c2aa47f44d508dfc15252f3e5efe" linkWindow="_blank">https://doaj.org/article/7110c2aa47f44d508dfc15252f3e5efe</link> ) Array ( [Name] => AN [Label] => Accession Number [Group] => ID [Data] => edsdoj.7110c2aa47f44d508dfc15252f3e5efe ) |
| RecordInfo |
Array
(
[BibEntity] => Array
(
[Identifiers] => Array
(
[0] => Array
(
[Type] => doi
[Value] => 10.1038/s41598-024-71989-w
)
)
[Languages] => Array
(
[0] => Array
(
[Text] => English
)
)
[PhysicalDescription] => Array
(
[Pagination] => Array
(
[PageCount] => 13
[StartPage] => 1
)
)
[Subjects] => Array
(
[0] => Array
(
[SubjectFull] => Medicine
[Type] => general
)
[1] => Array
(
[SubjectFull] => Science
[Type] => general
)
)
[Titles] => Array
(
[0] => Array
(
[TitleFull] => Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks
[Type] => main
)
)
)
[BibRelationships] => Array
(
[HasContributorRelationships] => Array
(
[0] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Shengbo Wang
)
)
)
[1] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Zengxu Li
)
)
)
[2] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Guodong Chen
)
)
)
[3] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Yaobin Yue
)
)
)
)
[IsPartOfRelationships] => Array
(
[0] => Array
(
[BibEntity] => Array
(
[Dates] => Array
(
[0] => Array
(
[D] => 01
[M] => 09
[Type] => published
[Y] => 2024
)
)
[Identifiers] => Array
(
[0] => Array
(
[Type] => issn-print
[Value] => 20452322
)
)
[Numbering] => Array
(
[0] => Array
(
[Type] => volume
[Value] => 14
)
[1] => Array
(
[Type] => issue
[Value] => 1
)
)
[Titles] => Array
(
[0] => Array
(
[TitleFull] => Scientific Reports
[Type] => main
)
)
)
)
)
)
)
|
| IllustrationInfo |