• No results found

Setup for testing cameras for image guided surgery using a controlled NIR fluorescence mimicking light source and tissue phantom

N/A
N/A
Protected

Academic year: 2021

Share "Setup for testing cameras for image guided surgery using a controlled NIR fluorescence mimicking light source and tissue phantom"

Copied!
12
0
0

Bezig met laden.... (Bekijk nu de volledige tekst)

Hele tekst

(1)

PROCEEDINGS OF SPIE

SPIEDigitalLibrary.org/conference-proceedings-of-spie

Setup for testing cameras for image

guided surgery using a controlled

NIR fluorescence mimicking light

source and tissue phantom

Georgiou, Giota, Verdaasdonk, Rudolf, van der Veen,

Albert, Klaessens, John

Giota Georgiou, Rudolf M. Verdaasdonk, Albert van der Veen, John H.

Klaessens, "Setup for testing cameras for image guided surgery using a

controlled NIR fluorescence mimicking light source and tissue phantom,"

Proc. SPIE 10049, Molecular-Guided Surgery: Molecules, Devices, and

Applications III, 100490E (8 February 2017); doi: 10.1117/12.2253267

Event: SPIE BiOS, 2017, San Francisco, California, United States

(2)

Setup for testing cameras for image guided surgery using an controlled

NIR fluorescence mimicking light source and tissue phantom

Giota Georgiou, Rudolf M. Verdaasdonk, , Albert van der Veen, John H. Klaessens

Dept. Physics & Medical Technology, VU University Medical Center,

De Boelelaan 1118 1081 HZ, Amsterdam, The Netherlands

Contact: r.verdaasdonk@vumc.nl.

ABSTRACT

In the development of new near-infrared (NIR) fluorescence dyes for image guided surgery, there is a need for new NIR sensitive camera systems that can easily be adjusted to specific wavelength ranges in contrast the present clinical systems that are only optimized for ICG. To test alternative camera systems, a setup was developed to mimic the fluorescence light in a tissue phantom to measure the sensitivity and resolution. Selected narrow band NIR LED’s were used to illuminate a 6mm diameter circular diffuse plate to create uniform intensity controllable light spot (µW-mW) as target/source for NIR camera’s. Layers of (artificial) tissue with controlled thickness could be placed on the spot to mimic a fluorescent ‘cancer’ embedded in tissue. This setup was used to compare a range of NIR sensitive consumer’s cameras for potential use in image guided surgery. The image of the spot obtained with the cameras was captured and analyzed using ImageJ software. Enhanced CCD night vision cameras were the most sensitive capable of showing intensities < 1 µW through 5 mm of tissue. However, there was no control over the automatic gain and hence noise level. NIR sensitive DSLR cameras proved relative less sensitive but could be fully manually controlled as to gain (ISO 25600) and exposure time and are therefore preferred for a clinical setting in combination with Wi-Fi remote control. The NIR fluorescence testing setup proved to be useful for camera testing and can be used for development and quality control of new NIR fluorescence guided surgery equipment.

Keywords: Phantom, Fluorescence, Image guided surgery, Quality, Sensitivity

1. INTRODUCTION

Surgical removal of tumors plays a vital role in the curative treatment for the majority of cancer patients. The goal of surgical oncologists is to remove the tumor tissue completely and to prevent or eliminate the resection of healthy tissues [1,2]. For this reason, a reliable and distinguishable difference between tumor and healthy tissue is needed. New intra-operative imaging modalities are under development to provide a real-time estimation of tumor margins and to reduce the risk of loco-regional recurrence. Tumor tracers labeled with optical markers instead of the existing nuclear markers can be used to trace the cancer tissue by providing the similar sensitivity but without radioactivity and related adverse effects [3]. A fluorescence marker that is excited and emits in Near-Infrared (NIR) range (650nm-1000nm) could enable tumor detection up to centimeters deep in tissue and is preferred to fluorescence in the visible range which has only a shallow penetration. Dedicated imaging systems are required to detect the fluorescence emission of these targets because the human eye is not sensitive in the NIR region [2]. The sensitivity of such an imaging system plays an important role as to the tissue depth, the concentration and the dose at which an imaging target can be detected in the tissue [3].

1.1 NIR fluorophores: ICG

To date, Indocyanine Green (ICG) is the only NIR-excited fluorophore approved for clinically use since 1956 by the US Food and Drug Administration (FDA) for intravenous administration [1,3]. It has been used in clinical applications mostly as a dark green optical contrast agent for vascular and tissue perfusion studies e.g. determining the cardiac output, hepatic function and ophthalmic angiography. Although, in principle, NIR-dyes are not optimally suitable for the determination of tumor-free margin, previous studies have shown that ICG is safe and useful for the identification of different tumors due to its NIR fluorescence properties [4,5]. After ICG is injected into the human body, it rapidly bounds to plasma protein. It generates fluorescence in NIR in the 800-830 range when is excited by a light source between 750nm and 800nm [1,3,4,6,7]. The fluorescence spectrum of ICG depends on its concentration, the temperature and the chemical environment [1]. Various clinical studies are ongoing using ICG as a fluorescence marker tracer for image guided surgery either solely

Molecular-Guided Surgery: Molecules, Devices, and Applications III, edited by Brian W. Pogue, Sylvain Gioux, Proc. of SPIE Vol. 10049, 100490E · © 2017 SPIE · CCC code: 1605-7422/17/$18 · doi: 10.1117/12.2253267

Proc. of SPIE Vol. 10049 100490E-1

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(3)

Light Source Camera Filter working Distance phantom Plate

or labeled to a specific tumor marker. In photodynamic therapy, ICG is being considered for treatment for superficial cancer, such as the topical therapy of melanoma [1,4].

1.2 NIR fluorescence imaging systems

Several dedicated fluorescence imaging devices are on the market. Examples are: the SPY Elite (Novadaq Technologies Inc., Toronto, ON, Canada), the Photodynamic Eye (PDE; Hamamatsu Photonics Co., Hamamatsu, Japan), the HyperEye Medical system (Mizuho Medical Co., Ltd, Tokyo, Japan), the FLUOBEAM (Fluoptics, Grenoble, France), the Leica FL800 (Leica Microsystems Inc., Buffalo Grove, IL), the FIREFLY (da Vinci; Novadaq Technologies Inc., Toronto, ON, Canada) and the Laparoscopic near-infrared fluorescence system (Olympus, Tokyo, Japan). These relative expensive systems (~100 k$) are optimized for a specific fluorescence dye, for now ICG, since it is the only one with FDA approval. The core components of such devices are the light source used for exciting the fluorescence dye, optics that allow the collection of the emitted fluorescence signal and reject the ambient and the backscattered incident light and an area detector for sensing the emitted fluorescence signal.

However, there are many new markers under development with some already in clinical testing. The wavelengths of excitation (light sources) and fluorescence are (slightly) different from ICG so the commercial systems are not optimized for these new markers. There is a need for the development of a low cost and more versatile NIR fluorescence imaging system that can be used for testing new fluorescence markers and, later on, be optimized for use in a clinical setting. 1.3 Aim of study

In this study, a setup was developed for testing NIR sensitive camera's commercially available to be used as a low cost alternative compared to dedicated clinical NIR imaging systems. A fully controllable NIR phantom mimicking the fluorescence light remittance from tissue was applied to compare 5 commercial camera's as to sensitivity, ease of use and adjustability in view of clinical application. The further improvement and perfection of the system would make an important contribution to the field of image guided surgery.

2. DEVELOPMENT OF A NIR FLUORESCENCE IMAGING TEST SETUP

For the development of a NIR fluorescence test setup the optimal of components needed to be selected. The basic components are shown in Figure 1: a NIR sensitive camera in combination with an optical filter and light source for excitation and illumination of the ICG test target/phantom. 2.1 Cameras

Five NIR sensitive commercial cameras from different application areas were used for testing. An overview of their characteristics is presented in figure 2 and table 1. The Pulsar Recon 750R and Maginon NV 400D are intensified CCD night vision camera's with built-in NIR illumination source which however were shut off for this study. The Sony NEX-5T camera is a high-end photo camera with a large sensor and was modified for full-spectral sensitivity (340-1000 nm) by removing visual band-pass filter that is installed in most DLSR camera from the CCD sensor. The Dynolyte IR microscope and Pulnix TM-300NIR are being used in laboratory settings. To reduce the minimal working distance to the fluorescence phantom, a close-up lens was placed in front of the Pulsar Recon 750R and the Maginon 400D NV cameras.

Figure 1: Scheme of the basic components of the fluorescence test setup

Proc. of SPIE Vol. 10049 100490E-2

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(4)

2.2 Excitation light source

A NIR light source was used to excite the ICG and so the fluorescence light can be captured by the camera. Previous studies have used different light sources for illumination, most frequently LEDs, halogen lamps and lasers, which all have spectra in the range of the excitation of ICG. For this study, a 150 mW Pulsar L-808S Laser IR Flashlight with a peak wavelength at 785nm was used as light source. The beam was expanded and the Gaussian spot was made uniform using a diffuser. This laser flashlight was selected since it has a narrow spectrum and hence the backscattered excitation light can be rejection more easily using an optical filter. LEDs, on the other hand, might be less expensive but have a board spectrum with relatively lower power output so tens of LEDs are required for sufficient power. Since the excitation and fluorescence wavelengths of ICG are close together it easier to cut-off the excitation wavelength of the laser using the right optical filter rather than the wide spectrum of a LED.

2.3 Illumination light source

When the NIR excitation light is excluded by a filter from the image only the fluorescence light is visible but the object and environment is not. The advanced clinical systems use 2 camera systems, visual and NIR, and digitally mix and superpose the images. Therefore, these systems are more expensive. As an alternative, a NIR light source of wavelength above the fluorescence wavelength (>840 nm) with tunable intensity can be used for background illumination. In this study a 850 nm LED flashlight (NiteCore Cameleon CI6) was used.

Table 1: Characteristics of five camera’s used to develop an imaging test setup Pulsar Recon

750R Maginon 400D Sony NEX-5T microscopeDynolyte IR Pulnix TM-300NIR Type Vision cameraDigital Night Night Vision camera

full spectral camera with remote control via mobile devices Handheld microscope camera NIR sensitive camera

Sensor type CCD CCD APS-C CMOS CMOS CCD

Magnification 4x 4x 4x 10x - 50x, 220x Viewing angle 6 16 83 Resolution (pixels) 640x480 640x480 1920x1080 1280x1024 1280x1024 IR illuminator wavelength 780nm 850nm - - -IR illuminator rating 150mW 0.5mW - -

-Use surveillance Hunting, surveillanceHunting, Commercial use Fluorescence, biomedical or machine vision

laboratory, surveillance,

microscope

Specifications Camera

Figure 2: Overview camera’s from left to right:

Pulsar Recon 750R, Maginon NV 400D, SONY NEX, Pulnix TM-300NIR and Dynolyte IR

Proc. of SPIE Vol. 10049 100490E-3

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(5)

6.7cm

d=6mm

Mask Diffuser

ion spectrum of the LED

LED power control

2.4 Filters

To exclude the excitation light from the fluorescence light coming from the object/target 4 long-pass filters were tested with a different cut-off wavelengths in the NIR range: the Thorlabs FEL0800 and FELO850, the A&R dHD850 and the B+W 093 infrared 830 F PRO. The transmission curves of filters are shown Figure 3.

3. DEVELOPMENT NIR FLUORESCENCE

4.

5.

6.

7. TESTING PHANTOM

For comparison of the sensitivity of the NIR cameras, a NIR dye-sample like ICG cannot be used since the fluorescence light is not constant and depends on many factors that are difficult to control like: dye concentration, excitation intensity, decay, thickness layer etc. Therefore, a controllable NIR fluorescence mimicking light source and tissue phantom was developed for this study (figure 4). The phantom consists of a 6mm diameter diffuser disk that is illuminated by a LED with a wavelength representative for the fluorescence light of a specific NIR dye like for ICG 810nm. To assure uniform illumination of the target disk, the LED was positioned 6.7cm below the diffuser and a mask limited the view on the diffuser of only the 'flat' top intensity of the LED. The intensity of the LED could be controlled with high accuracy by varying the current at a constant voltage in the range from micro-Watts to milli-watt. The LED can be exchanged to another NIR LED of a particular NIR wavelength when testing for another NIR dye.

7.1 Camera sensitivity testing

The setup for comparing the sensitivity of the cameras is shown in figure 5. Each camera was placed at fixed distance from the fluorescence phantom. The camera image stream was digitized with a video capture box and displayed and stored on a laptop for. The excitation light and filter are not needed for the testing of the cameras in this setting. The experiments were performed in a dark room also blocking NIR light.

Figure 3: Transmission curve of the four filters used including the spectrum of the excitation light source and the maximum emission spectrum of ICG.

0 1 2 3 4 5 6 7 8 9 10 780 800 820 840 Tr an sm iss io n( % ) wavelength(nm) Transmission Curve FEL0800 FEL0850 dHD850 B+W 830 maximum emission Laser

Figure 4: Scheme of the NIR fluorescence mimicking light and tissue phantom.

Proc. of SPIE Vol. 10049 100490E-4

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(6)

AM

Fixed Distance

Camera

Video Capture Device

7

NIR dye -phantom

Laptop

The lowest intensity for imaging

The first test was to determine the lowest intensity of the target phantom at which each camera was still able to produce an image. The power controller allowed adjusting the power of the LED down to levels of micro-Watts. This lowest value was set as the starting point for further measurements.

Camera sensitivity curve

The second test was to increase the power of the LED in steps and at each step to record a video over ten seconds. Five snapshot pictures were taken at different times within this 10 second video clip for analysis at a series of increasing intensity of the phantom spot

Fluorescence through a homogeneous tissue phantom with controlled thickness

A layer of liquid intralipid 20% was placed on the fluorescence target to mimic a tissue layer. Intralipid is biologically similar to the lipid bilayer of cells and organelles, which are the major components causing optical scattering in tissue. Three well plates were filled with different amounts of intralipid, 0.2ml, 0.4ml and 0.6ml and every well plate was used to take images of every camera at different powers of the LED.

Fluorescence through biological tissue layers with controlled thickness

To measure the performance of the camera's in an in-vitro setting, layers of biological tissue with controlled thickness were placed on the target to mimic a fluorescence 'cancer' spot embedded in the tissue. Up to 5 layers of porcine ham of 1.2 mm thickness were placed on the phantom and again five snapshot pictures were taken at different times within this 10 second video clip for analysis at a series of increasing intensity of the phantom spot.

7.2 Analysis of data

Due to differences of the angle of view/magnification of each camera the size of the 'fluorescence' spot of the target was different on the images captured and hence the intensity for direct comparison between the cameras.

Therefore, a correction factor was determined for normalizing the distance between the camera and the target all to the largest distance used (for Pulsar Recon 750R). The correction factor is defined as the square of the ratio of (distance of the camera X) / (distance of the Pulsar Recon 750R NV camera) and applied to the power of the LED ( ‘corrected power’). To determine the relative intensity, the snapshot pictures were processed using the ImageJ software. Intensity values along a line through the center of the spot were plotted in a graphs as shown in Figure 6. The intensity in 8 bit gray values (0-256) is plotted on y-axis and the diameter of the spot is represented on the x-axis number of pixels. The data from the graph were collected and analyzed in Microsoft Excel. For reproducibility of the measurements, five pictures were analyzed for every value of the intensity. The intensity value was determined calculating the average of the half width on the middle of the spot as depicted in Figure 5.

Figure 5: Schematic of setup for camera testing which consists of the camera and the NIR dye-phantom.

Proc. of SPIE Vol. 10049 100490E-5

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(7)

Maginon NV 400D Sony NEX -5T Pulnix TM-300NIR Dynolyte IR microscope Pulsar Recon 750R 250 200 k 150 é

I 100

Plot Profile

calculation of average intensity

r

1-I 1 50 --1

i half wiom in the

¡middle of the spot 1

0 1,

0 20 40 60 80 100 120 140 160

distance( pixels)

8. RESULTS

8.1 Comparison sensitivity of camera's

In Figures 7 example pictures are given for each camera at the same intensity of the 'fluorescence' spot.

To compare the sensitivity between the cameras, the average intensity at the middle of the 50% of the spot size was plotted in relation to the power of the LED as shown in Figures 8. The intensified CCD night vision camera's perform best in sensitivity. The spot becomes even saturated above a particular power level. These cameras have an automatic gain that cannot be controlled manually. The Sony NEX can be controlled manually and was set to the highest ISO setting of 25600 and longer exposure times (0.1 sec) at which level it comes close to the Maginon camera.

Figure 6: Scheme of the analysis of the pictures.

Left: example picture of the fluorescence spot. Right: Intensity profile from grey values of the center line through the spot using the ImageJ software. The intensity value was calculated from the average over the half width in the middle of the spot.

Figure 7: Example images from the different cameras at the same intensity of the 'fluorescence' spot.

Proc. of SPIE Vol. 10049 100490E-6

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(8)

200 1S0 100 SO o I.. 0 SOO 1000 1500 3500 4000 4500 corrected Power/nW I

w

- Maginon NV 4000 -Dynolyto IR mlcro1copc -Pulni TM-300NIR - SON YNCX St - Pulsar D.gnal NV C 200 100 {h0 140 i>u 100 Ñ 00 (.0 10 20 0 0 10 :0 13 10 50 60 70 00 90 100 a To E ó c 50 45 40 35 30 25 20 15 10 5 o 0 50 100 150 200 distance( pixels) -thickness of 1.05mm -thickness of 2.09mm -thickness of 3.14mm

The Dynolyte IR microscope and the Pulnix TM-300NIR cameras have far less sensitivity but can create pictures at higher magnification. Because of this overall result, for this paper, the comparison will continue for the Pulsar and the Sony NEX cameras

Fluorescence through a homogeneous tissue phantom with controlled thickness

Images of the fluorescence spot where obtained through layers of intralipid representing an homogeneous scattering tissue with thicknesses of 1.05, 2.09 and 3.14 mm. Figure 9 shows an example of the intensity profile diagonal through the spot for these three thicknesses. Figure 10 shows the 'visibility' of the fluorescence through the intralipid in relation of layer thickness and increasing intensity for the Pulsar and Sony NEX cameras .

Figure 8: Average intensity at the middle 50% of the spot size as a function of the corrected power of the LED for the 5 cameras tested. The upper inset graph some a close up of the red

rectangular region for the highest sensitivity cameras

Figure 9: example if the intensity profiles diagonal through the spot for three thicknesses of intralipid

Proc. of SPIE Vol. 10049 100490E-7

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(9)

250 200 f 100 SD 0

Sony NEX -5T camera

0 500 1000 1500 2000 2500 3003 3500 camctedPanrlMVl -no ham -1 laann of ham -2 WM of ham -3 layers of ham --41,m, of ham

Pulsar Recon 750R Digital NV camera 250 -r--190 0 200 400 600 800 1000 1200 1400 1600 aCn/ceedlaMerplNq - no nam -llayeno ham -21a of ham -31a,enso ham -4 laws of ham 250 0

Pulsar Recon 750R Digital NV camera lib

0 500 1000 1500 2000 2500 correctedPOwer(nW) - rw mtrahgd -thuknessof 1.05mm -thickness of 2.09mm -thicknessof 3.13mm ó IA

Sony NEX -5T camera 250 200! 150 -no intralipid c 100 -thickness oF 1.05mm v - thickness of 2.09mm g 50 -thickness of 3.14mm

1141

0 2000 4000 6000 8000 10000 corrected Power(nW)

1 layer of tissue 2 layers of tissue 3 layers of tissue 4 layers of tissue

e

250 200 150 = 100 0 50 100 150 200 distance(pixels) 250 300

Fluorescence through biological tissue layers with controlled thickness

To test the cameras on biological tissue (representing a more clinical setting), images of the fluorescence spot where obtained through 1.2 mm thick slices of porcine ham increasing the layer thickness from 0, 1.2, 2.4, 3.6 and 4.8 mm. Figure 11 shows images of the 'fluorescence' spot through increasing number of slices. Figure 12 shows the 'visibility' of the fluorescence through the tissue in relation of layer thickness and increasing intensity for the Pulsar and Sony NEX cameras The pulsar camera is clearly more sensitive in observing lower intensities of fluorescence light through thicker layers of tissue.

Figure11: (Left) Example images of the fluorescence spot through a increasing number of tissue slices. (right) intensity distribution along the line through the center of the spot for an increasing number of tissue slices

Figure 12: Average intensity as a function of LED power when adding layers of tissue. Left: Pulsar Recon 750R camera. Right Sony NEX-5T camera

Figure 10 (below): the intensity of the fluorescence spot through intralipid in relation of layer thickness and increasing intensity for the Pulsar (left) and Sony NEX (right) cameras

Proc. of SPIE Vol. 10049 100490E-8

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(10)

loo 90 80 70 60 50 40 30 20 10 o

LED 850nm

-49

MaginonNV DynolytelR Pulnix TM- SonyNEX-ST PulsarRecon

4000 microscope 300NIR

camera systems

9. DISCUSSION

The initial objective of this study was the development of a low cost NIR fluorescence imaging system. For this the optimal combination of camera, a light source for the excitation of the NIR dye, a light source for background illumination and optical filter was needed. However, the sensitivity of the camera was the most critical part that needed to be tested first using a NIR fluorescence phantom special developed for this study.

NIR fluorescence phantom developed

The NIR fluorescence mimicking light source and tissue phantom proved to be useful and versatile. The light levels can be electronically controlled for a large range of intensities illuminating a diffuse disk of 6 mm diameter with a flat intensity distribution. Any visible and NIR narrow wavelength band can be emulated by installing an LED of that range.

On top of the diffusing disk, either a small container with liquid or layers of tissue of controlled thickness can be positioned to simulate the source of fluorescence positioned inside tissue with representative optical properties.

This phantom is relative small and could even be used in the clinic for testing and calibration of clinical fluorescence imaging systems.

Sensitivity testing of camera’s

The phantom was used to test the sensitivity of five commercial cameras in various conditions. First, the lower detectable intensity of the fluorescence spot was determined. From that level the intensity of the spot was increased in steps to show the response of the camera. Of each test setting 3 images were used for analysis to determine the intensity profile of the spot. These profiles were 'flat head' over 80 % of the spot and reproducible with accuracy within 5%.

In Figure 13 the overall results are presented showing that the Dynolyte IR microscope camera and the Pulnix TM-300NIR are the less sensitive. Besides the characteristics of the sensor of these cameras, this could be ascribed a smaller sensor size and diameter of the lens.

The two intensified CCD night vision cameras are already developed for low level intensities in the near IR. These cameras are being used for in hunting, outdoor observation, security and the military. It is not surprising that they perform better. The Maginon can be considered the low end camera (price $100) compared to the Pulsar (price $500) which can be seen in the performance as to sensitivity. However, these camera have some drawbacks for practical use in the clinic. The lenses and designed and optimized for longer distances (>5 meters) and have a narrow angle of view and high magnification. The lenses have to be replaced to make them useful for focusing at short distances (20 - 50 cm)

These cameras have an automatic gain control, which means that the images are amplified automatically depending on the intensity of a light source in relation to the background light and is instantly adjusting to changes. This is not handy in clinical conditions. The Pulsar Recon 750R camera seems to have a better gain control and is more sensitive compared to the Maginon NV 400D camera. The drawback of the high sensitivity is that the camera images goes into saturation quickly, blanking the image. The relative sensitivity of the cameras is summarized in figure 13.

Figure 13:

Overview of the relative sensitivity of the cameras

Proc. of SPIE Vol. 10049 100490E-9

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(11)

l%

..

Wi-Fi Camera Filter Working Distance Light Source Mouse

,W i-Fi

..

Tablet

Camera most practical for use in clinical setting

The Sony NEX-5T camera being a high-end DSLR (Digital Single Lens Reflex) photo camera does not have the highest sensitivity in this test. However, it has the ability for full manual control as to sensitivity and image exposure time providing adaption to a wide ranges of lighting conditions. Lenses can be interchanged enabling focusing at short distances, changing the viewing angle and improving light collection. This camera is normally not sensitive for near IR light and the standard IR-blocking filter on the camera sensor has to be removed by a professional becoming a 'full spectral camera' sensitive for wavelengths from 340 to 1000 nm. In addition, this camera can be fully remote controlled through a Wi-Fi connection with a tablet or smartphone. So, the camera can be positioned near the operating field in a sterile enclosure and still being controlled. This Sony camera in principle represents other DSLR cameras with similar features that could be used for NIR fluorescence imaging. Due to recent developments, these camera’s become more sensitive (higher ISO grades > 25600) with relative low image noise.

NIR fluorescence imaging setup

The original motivation of this research project was the development of a relative low cost and flexible NIR fluorescence imaging system. The first phase of this project has resulted in a NIR fluorescence mimicking phantom for testing and calibrating cameras. With the outcome that the Sony NEX camera is the most practical and relative sensitive camera to use, a NIR fluorescent image setup was put to practice using the components discussed is the methods paragraph: a handheld 785 nm laser source for dye excitation, a FEL800 long-pass filter for blocking the excitation light and an 850 nm flashlight for background illumination.

The proposed imaging system was used as a part of on-going study in order to visualize the tumor in mice using IRDye 800CW as a promising next-generation NIR fluorophore. 800CW is intended only for investigational use in clinical trials and it has similar optical properties as the ICG. The peak wavelength of excitation is around 772nm and the peak fluorescence is around 793nm. The imaging setup is shown in figure 14.

The imaging setup proved to be working well as is illustrated in figure 15. The illumination with the 850nm LED is essential for orientation and tumor localization. This way it is not necessary to mix the fluorescence image with a visual camera. The proposed imaging system can be easily adjusted to other fluorescence dyes using another combination of filters and light sources.

Figure 14: Experimental set up for the visualization of tumor in the mouse.

Figure 15: Left: fluorescence image of a CW800 labeled tumor grown in the belly of a mouse. Right: Using a 850nm LED flashlight, the mouse itself and environment becomes also visible which is necessary for orientation.

Proc. of SPIE Vol. 10049 100490E-10

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

(12)

Future Research

A limitation of this study is that there has not been a direct comparison with the existing fluorescence systems used in the clinic. When these systems would be available, the performance and sensitivity could be compared with the cameras investigated in this study. It would also be of interest to compare the performance between the clinical systems using the NIR fluorescence mimicking phantom developed in this study. In addition, the phantom could be useful as test and calibration tool for (new) fluorescence systems.

10. CONCLUSION

The NIR fluorescence mimicking light source and tissue phantom is functional for testing the performance of camera systems and can be used for development and quality control of (new) NIR fluorescence guided surgery equipment. Commercial night vision cameras have the highest sensitivity. However, they are not practical for clinical use due to the automatic gain, the small viewing angle and lack of focus at short distance.

NIR sensitive DSLR cameras proved relative less sensitive but could be fully manually controlled as to gain (high ISO settings up to 25600) and exposure time and are therefore preferred for a clinical setting in combination with Wi-Fi remote control.

REFERENCES

[1] Alander, J. T., Kaartinen, I., Laakso, A., Pätilä, T., Spillmann, T., Tuchin, V. V. and Välisuo, P., "A Review of Indocyanine Green Fluorescent Imaging in Surgery", International Journal of Biomedical Imaging, 1–26 (2012). [2] Ishizawa, T., Fukushima, N., Shibahara, J., Masuda, K., Tamura, S., Aoki, T., Hasegawa, K., Beck, Y., Fukayama,

M. and Kokudo, N., "Real-Time Identification of Liver Cancers by Using Indocyanine Green Fluorescent Imaging", Cancer, 115(11), 2491-2504 (2009).

[3] Zhu, B. and Sevick-Muraca, E. M., "A review of performance of near-infrared fluorescence imaging devices used in clinical studies", The British Journal of Radiology, 88(1045), 20140547 (2015).

[4] Gerega, A., Zolek, N., Soltysinski, T., Milej, D., Sawosz, P., Toczylowska, B. and Liebert, A., "Wavelength-resolved measurements of fluorescence lifetime of indocyanine green", Journal of Bioml Optics, 16(6), (2011). [5] Hilderbrand, S. A. and Weissleder, R., "Near-infrared fluorescence: application to in vivo molecular imaging",

Current Opinion in Chemical Biology, 14(1), 71–79 (2010).

[6] Namikawa, T., Sato, T. and Hanazaki, K., "Recent advances in near-infrared fluorescence-guided imaging surgery using indocyanine green". SurgToday, 45(12), 1467-1474 (2015).

[7] Schaafsma, BE, Mieog, JSD., Hutteman, M., van der Vorst, J. R., Kuppen, P. J. K., Löwik, CWGM, Frangioni, J. V., van de Velde, C. J. H. and Vahrmeijer, A. L., "The clinical use of indocyanine green as a near-infrared fluorescent contrast agent for image-guided oncologic surgery", J Surg Oncology, 104(3),323–332 (2011).

Proc. of SPIE Vol. 10049 100490E-11

Downloaded From: https://www.spiedigitallibrary.org/conference-proceedings-of-spie on 22 Jan 2020 Terms of Use: https://www.spiedigitallibrary.org/terms-of-use

Referenties

GERELATEERDE DOCUMENTEN

Part I, chapter 2 describes the intraoperative identification of colorectal liver metastases using NIR fluorescence and a novel integrin α v β 3 targeted probe in an experimental

Image-guided surgery using invisible near-infrared fluorescent light : from pre-clinical studies to clinical validation..

9 Therefore, the aim of this study was to investigate the biodistribution and the ability to clearly demarcate liver and peritoneal metastases during surgery in a syngeneic rat

To determine the accuracy of real-time NIR fluorescence imaging in obtaining tumor-free resection margins, a protease-activatable NIR fluorescence probe and an intraoperative camera

This study demonstrates that colorectal cancer liver metastases can be clearly identified during surgery using ICG and the Mini-FLARE TM imaging system, with optimal timing of 72

randomized, double-blind comparison of indocyanine green with or without albumin premixing for near-infrared fluorescence imaging of sentinel lymph nodes in breast cancer

The FLare™ intraoperative near-infrared fluorescence imaging system: a first-in- human clinical trial in perforator flap breast reconstruction.. Lee BT, Hutteman M, Gioux S,

The FLARE intraoperative near-infrared fluorescence imaging system: a first-in-human clinical trial in breast cancer sentinel lymph node mapping.. Ishizawa T, Bandai Y, Ijichi M,