Low-power gesture-recognition camera is always on

Aug. 16, 2016
Always-running image-processing algorithm wakes the camera upon seeing specific gestures. 

Researchers at Georgia Institute of Technology (Georgia Tech; Atlanta, GA) have created an "always-on" camera that "wakes up" when it recognizes a specific human gesture—for example someone writing a "Z" in the air. Designed with a combination of low-power hardware and energy efficient image processing software, the always-on camera, which was primarily designed as a way to wake up other devices, is capable of watching for movement without draining batteries.

"Right now cameras are very hard to run on passive power just because they burn so much power themselves," says Justin Romberg, a professor in Georgia Tech’s School of Electrical and Computer Engineering. "This combination of efficient signal processing and a novel hardware design lowers the power requirement and means that some of these other options to power it might be open."

The research, which was highlighted at the International Symposium on Low Power Electronics and Design (Aug. 8-10, 2016; San Francisco, CA) was sponsored by Intel Corp. and the National Science Foundation.1

While reducing the frame rate of a camera plays a role in lowering power demands, to achieve the power savings needed for this project, the researchers programmed the camera to track motion in a more generalized way that still preserved crucial details about what was being tracked. That requires much less power to process than tracking individual pixels throughout the entire field of view.

Pixel-adding algorithm

"What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in a standard mode," Romberg says.

"Simple motion detection is a well-studied area of research, and there are commercial products that support motion detection," says Arijit Raychowdhury, an associate professor in the School of Electrical and Computer Engineering. "But the problem is that a camera that can just detect motion—and not specific patterns in motion or gestures—is going to wake up more often, even when it doesn’t need to."

Such a low-power camera could be useful in a range of applications, especially for camera systems in remote locations where efficiency is crucial. Other applications include specialized surveillance, robotics and consumer electronics with hands-free operation, and the researchers are already working on adding wireless functionality to transmit images and data with an antenna.

Source: https://research.gatech.edu/researchers-develop-low-power-always-camera-gesture-recognition

REFERENCE:

Anvesha A. et al., "A Light-powered, 'Always-On', Smart Camera with Compressed Domain Gesture Detection," International Symposium on Low Power Electronics and Design 2016.

About the Author

John Wallace | Senior Technical Editor (1998-2022)

John Wallace was with Laser Focus World for nearly 25 years, retiring in late June 2022. He obtained a bachelor's degree in mechanical engineering and physics at Rutgers University and a master's in optical engineering at the University of Rochester. Before becoming an editor, John worked as an engineer at RCA, Exxon, Eastman Kodak, and GCA Corporation.

Sponsored Recommendations

How to Tune Servo Systems: The Basics

April 10, 2024
Learn how to tune a servo system using frequency-based tools to meet system specifications by watching our webinar!

Precision Motion Control for Sample Manipulation in Ultra-High Resolution Tomography

April 10, 2024
Learn the critical items that designers and engineers must consider when attempting to achieve reliable ultra-high resolution tomography results here!

Motion Scan and Data Collection Methods for Electro-Optic System Testing

April 10, 2024
Learn how different scanning patterns and approaches can be used in measuring an electro-optic sensor performance, by reading our whitepaper here!

How Precision Motion Systems are Shaping the Future of Semiconductor Manufacturing

March 28, 2024
This article highlights the pivotal role precision motion systems play in supporting the latest semiconductor manufacturing trends.

Voice your opinion!

To join the conversation, and become an exclusive member of Laser Focus World, create an account today!