Title: Video event detection for fault monitoring in assembly automation

Authors: Kevin Hughes; Heshan Fernando; Greg Szkilnyk; Brian Surgenor; Michael Greenspan

Addresses: Department of Electrical and Computer Engineering, Queen's University, Kingston, ON K7L 3N6, Canada ' Department of Mechanical and Materials Engineering, Queen's University, Kingston, ON K7L 3N6, Canada ' Department of Mechanical and Materials Engineering, Queen's University, Kingston, ON K7L 3N6, Canada ' Department of Mechanical and Materials Engineering, Queen's University, Kingston, ON K7L 3N6, Canada ' Department of Electrical and Computer Engineering, Queen's University, Kingston, ON K7L 3N6, Canada

Abstract: A major goal of many manufacturers is to minimise production downtime caused by machine faults and equipment breakdowns. This goal is typically achieved using sensor-based systems that can quickly detect and diagnose machine faults of various types. This paper proposes the use of a video event detection method based on spatiotemporal volumes (STVs) in a fault monitoring application to complement and improve upon existing systems. To detect faults, images are captured using a single camera from several different regions of an assembly machine testbed. The motion is segmented in each image creating binary frames which are stacked to build a STV. Normal operation of the machine is modelled by building a STV from several training sequences. New STVs are compared to the model and classified as either normal or faulty behaviour based on a calculated similarity measure. Test results show that the system is very effective on the data sets collected.

Keywords: machine fault monitoring; intelligent systems; computer vision; event detection.

DOI: 10.1504/IJISTA.2014.059302

International Journal of Intelligent Systems Technologies and Applications, 2014 Vol.13 No.1/2, pp.103 - 116

Published online: 13 Jul 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article