IMAGE: A smashed image reduced to glitter can be reassembled using the MIT SparkleVision algorithm. (Image credit: MIT)
Researchers at the Massachusetts Institute of Technology (MIT; Cambridge, MA) have unveiled an algorithm that reconstructs an image comprised of tiny fractured pieces of its original form. If you take a hammer to a mirror you will fracture the image it produces as well as the glass. Keep smashing and the image becomes more broken. When the pieces of glass are the size of glitter, the reflections will be random and the image unrecognizable. Zhengdong Zhang and MIT colleagues call the technique SparkleVision (http://arxiv.org/abs/1412.7884), an image processing algorithm that reassembles the smashed imaged.
RELATED ARTICLE: All-optical image delay uses slow-light medium
The problem that Zhang and co attack is to work out the contents of a picture reflected off a screen covered in glitter. The approach is to photograph the glitter and then process the resulting image in a way that unscrambles the picture. It turns out that there is a straightforward way to approach this. Zhang and colleagues consider each piece of glitter to be a randomly oriented micromirror. So light from the picture hits a micromirror and is reflected to a sensor inside the camera.
That means there is a simple mapping from each pixel in the original picture to a sensor in the camera. The task is to determine that mapping for every pixel. “There exists a forward scrambling matrix, and in principle we can find its inverse and unscramble the image,” they say. To find this unscrambling matrix, Zhang and co shine a set of test images at the glitter screen and record where the pixels in the original image end up in the camera.
From this, they can create an algorithm that unscrambles any other image placed in exactly the same spot as the test images. They call this algorithm SparkleVision. This software could have interesting applications in retrieving images reflected off glitter-like surfaces such as certain types of foliage, wet surfaces, metals, and so on.
And Zhang and co hope to make the software more useful. In its current incarnation, the software can only unscramble images placed in the exact location of the test images. But in theory, the test images should provide enough data to unscramble images from any part of the light field. "Thus, our system could be naturally extended to work as a lightfield camera," they say. These so-called "random cameras" are dramatically widening the capability of optics specialists. And SparkleVision looks set to take its place among them.