8 – Multidimensional fusion by image mosaics

Image mosaicing creates a wide field of view image of a scene by fusing data from narrow field images. As a camera moves, each scene point is typically sensed multiple times during frame acquisition. Here we describe generalised mosaicing, which is an approach that enhances this process. An optical component with spatially varying properties is rigidly attached to the camera. This way, the multiple measurements corresponding to any scene point are made under different optical settings. Fusing the data captured by the multiple frames yields an image mosaic that includes additional information about the scene. This information can come in the form of extended dynamic range, high spectral quality, polarisation sensitivity or extended depth of field (focus). For instance, suppose the state of best focus in the camera is spatially varying. This can be achieved by placing a transparent dielectric on the detector array. As the camera rigidly moves to enlarge the field of view, it senses each scene point multiple times, each time in a different focus setting. This yields a wide depth of field, wide field of view image, and a rough depth map of the scene.