Flat microscope in development aims to restore sight and sound to the disabled

Aug. 4, 2017
Called FlatScope, the project is part of a $65 million effort by DARPA to develop a high-resolution neural interface. 

As part of a new government initiative, Rice University (Houston, TX) engineers and their collaborators are building a flat microscope and developing software that can decode and trigger neurons on the surface of the brain. Their goal is to provide an alternate path for sight and sound to be delivered directly to the brain.

Related: New intraocular lens has ability to restore sight accommodation

Called FlatScope, the project is part of a $65 million effort by the federal Defense Advanced Research Projects Agency (DARPA; Arlington, VA) to develop a high-resolution neural interface. Among many long-term goals, the Neural Engineering System Design (NESD) program hopes to compensate for a person's loss of vision or hearing by delivering digital information directly to parts of the brain that can process it.

Rice University engineers have built a lab prototype of a flat microscope they are developing as part of DARPA's Neural Engineering System Design project. The microscope will sit on the surface of the brain, where it will detect optical signals from neurons in the cortex. The goal is to provide an alternate path for sight and sound to be delivered directly to the brain. (Image credit: Rice University)

Members of Rice's Electrical and Computer Engineering Department will focus first on vision. They will receive $4 million over four years to develop an optical hardware and software interface. The optical interface will detect signals from modified neurons that generate light when they are active. The project is a collaboration with the Yale University-affiliated John B. Pierce Laboratory (New Haven, CT) led by neuroscientist Vincent Pieribone.

Current probes that monitor and deliver signals to neurons—for instance, to treat Parkinson's disease or epilepsy—are extremely limited, according to the Rice University team. "State-of-the-art systems have only 16 electrodes, and that creates a real practical limit on how well we can capture and represent information from the brain," explains Rice University engineer Jacob Robinson.

Robinson and Rice University colleagues Richard Baraniuk, Ashok Veeraraghavan, and Caleb Kemere are developing a thin interface that can monitor and stimulate hundreds of thousands and perhaps millions of neurons in the cortex, the outermost layer of the brain.

Rice University engineering professors (from left) Ashok Veeraraghavan, Jacob Robinson and Caleb Kemere are part of a DARPA program to create a high-resolution, wireless neural interface that can be implanted on the cortex. (Image credit: Rice University)

Kemere says that some teams participating in the multi-institution project are investigating devices with thousands of electrodes to address individual neurons. "We're taking an all-optical approach where the microscope might be able to visualize a million neurons," he says.

To do this, the Pierce Lab is gathering expertise in bioluminescence, with the goal of programming neurons with proteins that release a photon when triggered. "The idea of manipulating cells to create light when there's an electrical impulse is not extremely far-fetched in the sense that we are already using fluorescence to measure electrical activity," Robinson says.

FlatScope is a cousin to Rice University's FlatCam, which was developed by Baraniuk and Veeraraghavan to eliminate the need for bulky lenses in cameras. The new project would make FlatCam even flatter, small enough to sit between the skull and cortex without putting additional pressure on the brain, and with enough capacity to sense and deliver signals from perhaps millions of neurons to a computer.

Alongside the hardware, Rice is modifying FlatCam algorithms to handle data from the brain interface. "The microscope we're building captures three-dimensional images, so we'll be able to see not only the surface but also to a certain depth below," Veeraraghavan says. "At the moment we don't know the limit, but we hope we can see 500 µm deep in tissue."

"That should get us to the dense layers of cortex where we think most of the computations are actually happening, where the neurons connect to each other," Kemere adds.

Collaborators at Columbia University (New York, NY) are tackling another major challenge: The ability to wirelessly power and gather data from the interface.

"Part of the fundamental research challenge will be developing a deep understanding of how the brain processes hearing, speech, and vision simultaneously with individual neuron-level precision and at a scale sufficient to represent detailed imagery and sound," according to DARPA. "The selected teams will apply insights into those biological processes to the development of strategies for interpreting neuronal activity quickly and with minimal power and computational resources."

For more information, please visit www.darpa.mil.

Sponsored Recommendations

March 31, 2025
Enhance your remote sensing capabilities with Chroma's precision-engineered optical filters, designed for applications such as environmental monitoring, geospatial mapping, and...
March 31, 2025
Designed for compatibility with a wide range of systems, Chroma's UV filters are engineered to feature high transmission, superior out-of-band blocking, steep edge transitions...
March 31, 2025
Discover strategies to balance component performance and system design, reducing development time and costs while maximizing efficiency.
March 31, 2025
Explore the essential role of optical filters in enhancing Raman spectroscopy measurements including the various filter types and their applications in improving signal-to-noise...

Voice your opinion!

To join the conversation, and become an exclusive member of Laser Focus World, create an account today!