Multisensory data fusion-based deep learning approach for fault diagnosis of an industrial autonomous transfer vehicle


Expert Systems with Applications, vol.200, 2022 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 200
  • Publication Date: 2022
  • Doi Number: 10.1016/j.eswa.2022.117055
  • Journal Name: Expert Systems with Applications
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, Metadex, Public Affairs Index, Civil Engineering Abstracts
  • Keywords: Autonomous Transfer Vehicle, Condition Monitoring, Deep Learning, Sensor Fusion, Short Time Fourier Transform
  • Eskisehir Osmangazi University Affiliated: Yes


© 2022 Elsevier LtdThe integration of Industry 4.0 concepts into today's manufacturing settings has introduced new technology tools that have already started providing companies an increased level of efficiency in certain operations. Autonomous Transfer Vehicles (ATV) are one of these new tools that are popular in today's manufacturing settings. As these tools become an integral part of the manufacturing ecosystem, accurate diagnosis of ATV faults and anomalies will also be crucial in manufacturing settings. Similar to any other intelligent detection of machinery faults, analyzing and utilizing signals measured from attached ATV sensors may reveal any uncovered operational faults or critical operational/safety concerns. In this context, this paper focuses on an intelligent fault detection of an ATV tool utilizing signals measured from multiple attached sensors. A novel Convolutional Neural Network-based data fusion approach, utilizing short time Fourier Transform, is proposed for the detection and identification of operational faults occurring in an ATV. The approach is tested on an experimental dataset, consisting of two motors’ sound and vibration signals, collected as an ATV operates for a specific task under three different conditions. The diagnosis results indicate that the proposed deep learning-based multisensory fault diagnosis approach is able to diagnose operational conditions with significantly high accuracy compared to single or dual sensor approaches.