Vaibhav Sharma

Design Space Explorer

Motion failure detection using computer vision

Screen capture to test and build the algorithm

Final test using rendered animation

Project Description

Problem statement: Is it possible to monitor the motion of a system using computer vision and alert the user when the motion system fails?

Application: Monitoring a robotic system without having access to its firmware.

Innovation: I had to find a video that I could use for developing my solution. Instead of searching an appropriate video, I animated my robotic system in Blender. By animating my own robotic system I could scale my solution and simulate edge cases.

Solution: By using OpenCV in Python, I was able develop an algorithm that would track the region of interest and then identify a stopped (failed) motion system.

Skills

  • Computer vision
  • Python
  • OpenCV
  • 3D Modeling - Blender