Making the case for hyperspectral imaging in surgical practices

Feb. 3, 2023
Hyperspectral cameras provide much more information about an object’s physical properties than can be discerned with the naked eye—making it ideal for use during surgeries.

Hyperspectral cameras truly “make the invisible visible” by illuminating an object and then capturing its reflected light in many narrow spectral bands.

The technology has already found use in applications ranging from precision agriculture (think weed control and pest surveillance) to industrial machine vision for corrosion detection or quality inspection and environmental monitoring (e.g., spotting oil spills or plastic waste).

Hyperspectral cameras are now poised to revolutionize the medical realm. Imagine surgeons being able to make decisions based on real-time information about tissues’ chemical composition at a molecular level, seeing the oxygenation of blood flowing through arteries and vessels, or distinguishing in vivo between healthy and anomalous tissue, such as tumor cells.

This glimpse into the future is much closer than you might expect. But while hyperspectral sensors and cameras have evolved tremendously during the past few years, several limitations continue to prevent the technology from straightforwardly being used in surgical practice. For one, devices are typically quite bulky and incompatible with an operating room’s already-crammed sterile field. And integrating them into hospitals’ stringent clinical workflows is no easy feat, either.

A recent research project took these challenges to heart. It explored whether hyperspectral imaging technology can support the in vivo detection of low-grade gliomas (a diverse group of brain tumors), which is an arduous task, even for well-trained and highly experienced surgeons.

Exploring in vivo detection of low-grade gliomas

Low-grade gliomas arise directly within the brain. They often develop in young, otherwise healthy patients. While typically considered benign in origin, studies have shown that these cancer cells can expand at a rate of 4 to 5 mm annually and come with the risk of malignant transformation. Their early surgical resection has become a much-favored treatment option, despite in vivo detection of low-grade gliomas and retrieving their exact demarcations being notoriously difficult, even with the aid of surgical microscopes.

This is partly because low-grade gliomas do not lend themselves to detection through commonly used fluorescence methods. Instead, a magnetic resonance imaging (MRI) or computed tomography (CT) scan needs to be performed before the tumor’s resection; this merely allows surgeons to identify a general region of interest (instead of the tumor’s exact boundaries).

Giving surgeons the proper tools to detect intrinsic brain tumors in vivo would be a gigantic step forward. And hyperspectral imaging technology shows great potential to do this. It is a breakthrough achieved by mounting imec’s snapscan VNIR 150 hyperspectral camera onto a standard surgical microscope. This proved a compact setup generating hyperspectral data has the potential to help detect low-grade gliomas in vivo. As a next step, these data can be fed into a deep-learning neural network, providing valuable insights on healthy vs. anomalous tissue.

Small form factor meets high accuracy

Thanks to its small form factor (10 ×× 6.5 cm), weight (645 g), and compatibility with standard C-mount optics, imec’s snapscan VNIR camera (see Fig. 1) can easily be mounted onto a surgical microscope. This compact setup can be incorporated into hospitals’ stringent clinical workflows, contrary to the bulky systems used in previous studies (see Fig. 2). 

Imec researchers focused on acquiring relevant data within a (sterile) intraoperative environment with minimal adaptations to both the system and data pre-processing methods. To do so, they had to rethink the camera’s existing spatial and spectral calibration methods and interface the device directly with the surgical microscope’s optics and light source.

Lighting was one of the key parameters explored. To avoid excessive noise, the researchers adapted the spectral range of the snapscan camera to match that of the microscope’s internal light source. They also looked at the system’s integration time modalities to find the right balance between saturation and noise—while optimizing the system’s imaging parameters.

Video-rate hyperspectral imaging for real-time tumor classification

This project allowed imec researchers to specify which hyperspectral bands are critical when interfacing with high-end surgical microscopes for an in vivo classification of low-grade gliomas. The underlying algorithms can detect the presence of low-grade gliomas on unseen data with 80% accuracy, which is a major step forward.

Admittedly, the setup’s intraoperative use is premature. So far, the approach has been successfully tested using a clinical dataset of six patients at Belgium’s Leuven University Hospital. These promising results lay the groundwork for moving to video-rate hyperspectral imaging, which will allow researchers to explore the real-time detection of low-grade gliomas.

This study was conducted in collaboration with Carl Zeiss Meditec AG and Belgium’s Leuven University Hospital, and the results were presented at SPIE BiOS 2023 in the following papers:

About the Author

Wouter Charle | Program Manager for Hyperspectral Imaging, imec

Wouter Charle is program manager for hyperspectral imaging at imec (Leuven, Belgium), leading off-the-shelf and evaluation system activities.

About the Author

Siri Luthman | R&D Engineer, imec

Siri Luthman is an R&D engineer at imec (Leuven, Belgium). She is also involved in several biomedical imaging projects.

About the Author

Roeland Vandebriel | Field Application Engineer, imec

Roeland Vandebriel is a field application engineer at imec (Leuven, Belgium). There, he works with rapid prototyping, digital signal processing for wireless systems, digital data processing, controllers for imager sensors, and digital enabling systems for analog R&D.

Sponsored Recommendations

How Precision Motion Systems are Shaping the Future of Semiconductor Manufacturing

March 28, 2024
This article highlights the pivotal role precision motion systems play in supporting the latest semiconductor manufacturing trends.

Understanding 3D Printing Tolerances: A Guide to Achieving Precision in Additive Manufacturing

March 28, 2024
In the world of additive manufacturing, precision is paramount. One crucial aspect of ensuring precision in 3D printing is understanding tolerances. In this article, we’ll explore...

Automation Technologies to Scale PIC Testing from Lab to Fab

March 28, 2024
This webinar will cover the basics of precision motion systems for PIC testing and discuss the ways motion solutions can be specifically designed to address the production-scale...

Case Study: Medical Tube Laser Processing

March 28, 2024
To enhance their cardiovascular stent’s precision, optimize throughput and elevate part quality, a renowned manufacturer of medical products embarked on a mission to fabricate...

Voice your opinion!

To join the conversation, and become an exclusive member of Laser Focus World, create an account today!