Search Results for: optical flow

The image Jacobian depends not only on the image plane coordinates but also the distance from the camera to the points of interest. If this distance is not known, what can we do? Let’s look at how we can determine this distance, and how the optical flow equation can be rearranged to convert from observed […]

When a camera moves in the world, points in the image move in a very specific way. The image plane or pixel velocity is a function of the camera’s motion and the position of the points in the world. This is known as optical flow. Let’s explore the link between camera and image motion.

The relationship between world coordinates, image coordinates and camera spatial velocity has some interesting ramifications. Some very different camera motions cause identical motion of points in the image, and some camera motions leads to no change in the image at all in some parts of the image. Let’s explore at these phenomena and how we […]

Let’s recap the important points from the topics we have covered in our discussion of optical flow and visual servoing.

A robot joint controller is a type of feedback control system which is an old and well understood technique. We will learn how to assemble the various mechatronic components such as motors, gearboxes, sensors, electronics and embedded computing in a feedback configuration to implement a robot joint controller.

An image contains a huge amount of pixel data, and a video stream is a massive flow of pixel data. Typically a robot has only a few inputs, the position or velocity of its joints. How do we go from all that camera data to the small amount of data the robot really needs?

Light entering our eyes stimulates the photoreceptor cells in the retina of our eye: color sensitive cone cells that we use in normal lighting conditions and monochromatic rod cells we use in low light. The density of these cells varies across the retina, it is high in the fovea, low in the peripheral vision region […]

The human eye is quite amazing, let’s look at its various components including the light sensitive rod and cone cells.

We previously learnt how to derive a Jacobian which relates the velocity of a point, defined relative to one coordinate frame, to the velocity relative to a different coordinate frame. Now we extend that to the 3D case.