We use MATLAB and some Toolbox functions to create a robot controller that moves a camera so the image matches what we want it to look like. We call this an image-based visual servoing system.
Search Results for: image Jacobian
The relationship between world coordinates, image coordinates and camera spatial velocity is elegantly summed up by a single matrix equation that involves what we call the image Jacobian.
The relationship between world coordinates, image coordinates and camera spatial velocity has some interesting ramifications. Some very different camera motions cause identical motion of points in the image, and some camera motions leads to no change in the image at all in some parts of the image. Let’s explore at these phenomena and how we […]
The image Jacobian depends not only on the image plane coordinates but also the distance from the camera to the points of interest. If this distance is not known, what can we do? Let’s look at how we can determine this distance, and how the optical flow equation can be rearranged to convert from observed […]
We previously learnt how to derive a Jacobian which relates the velocity of a point, defined relative to one coordinate frame, to the velocity relative to a different coordinate frame. Now we extend that to the 3D case.
Let’s recap the important points from the topics we have covered in our discussion of optical flow and visual servoing.
A critical part of a visual servoing system is establishing correspondence between points in the scene observed by the camera, and points in our desired image of the scene.