Low-power gesture-recognition camera is always on

Aug. 16, 2016
Always-running image-processing algorithm wakes the camera upon seeing specific gestures. 

Researchers at Georgia Institute of Technology (Georgia Tech; Atlanta, GA) have created an "always-on" camera that "wakes up" when it recognizes a specific human gesture—for example someone writing a "Z" in the air. Designed with a combination of low-power hardware and energy efficient image processing software, the always-on camera, which was primarily designed as a way to wake up other devices, is capable of watching for movement without draining batteries.

"Right now cameras are very hard to run on passive power just because they burn so much power themselves," says Justin Romberg, a professor in Georgia Tech’s School of Electrical and Computer Engineering. "This combination of efficient signal processing and a novel hardware design lowers the power requirement and means that some of these other options to power it might be open."

The research, which was highlighted at the International Symposium on Low Power Electronics and Design (Aug. 8-10, 2016; San Francisco, CA) was sponsored by Intel Corp. and the National Science Foundation.1

While reducing the frame rate of a camera plays a role in lowering power demands, to achieve the power savings needed for this project, the researchers programmed the camera to track motion in a more generalized way that still preserved crucial details about what was being tracked. That requires much less power to process than tracking individual pixels throughout the entire field of view.

Pixel-adding algorithm

"What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in a standard mode," Romberg says.

"Simple motion detection is a well-studied area of research, and there are commercial products that support motion detection," says Arijit Raychowdhury, an associate professor in the School of Electrical and Computer Engineering. "But the problem is that a camera that can just detect motion—and not specific patterns in motion or gestures—is going to wake up more often, even when it doesn’t need to."

Such a low-power camera could be useful in a range of applications, especially for camera systems in remote locations where efficiency is crucial. Other applications include specialized surveillance, robotics and consumer electronics with hands-free operation, and the researchers are already working on adding wireless functionality to transmit images and data with an antenna.

Source: https://research.gatech.edu/researchers-develop-low-power-always-camera-gesture-recognition


Anvesha A. et al., "A Light-powered, 'Always-On', Smart Camera with Compressed Domain Gesture Detection," International Symposium on Low Power Electronics and Design 2016.

About the Author

John Wallace | Senior Technical Editor (1998-2022)

John Wallace was with Laser Focus World for nearly 25 years, retiring in late June 2022. He obtained a bachelor's degree in mechanical engineering and physics at Rutgers University and a master's in optical engineering at the University of Rochester. Before becoming an editor, John worked as an engineer at RCA, Exxon, Eastman Kodak, and GCA Corporation.

Sponsored Recommendations

Request a quote: Micro 3D Printed Part or microArch micro-precision 3D printers

April 11, 2024
See the results for yourself! We'll print a benchmark part so that you can assess our quality. Just send us your file and we'll get to work.

Request a Micro 3D Printed Benchmark Part: Send us your file.

April 11, 2024
See the results for yourself! We'll print a benchmark part so that you can assess our quality. Just send us your file and we'll get to work.

Request a free Micro 3D Printed sample part

April 11, 2024
The best way to understand the part quality we can achieve is by seeing it first-hand. Request a free 3D printed high-precision sample part.

How to Tune Servo Systems: The Basics

April 10, 2024
Learn how to tune a servo system using frequency-based tools to meet system specifications by watching our webinar!

Voice your opinion!

To join the conversation, and become an exclusive member of Laser Focus World, create an account today!