Добавил:
kiopkiopkiop18@yandex.ru t.me/Prokururor I Вовсе не секретарь, но почту проверяю Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз: Предмет: Файл:

Ординатура / Офтальмология / Английские материалы / Artificial Sight Basic Research, Biomedical Engineering, and Clinical Advances_Humayun, Weiland, Chader_2007

.pdf
Скачиваний:
0
Добавлен:
28.03.2026
Размер:
11.17 Mб
Скачать

200 Ren et al.

G = GxGy

 

Gm =

Gx2 + Gy2

 

 

= tan−1 Gx

(1)

 

 

G

 

y

There are several well-known gradient filters. In our experiment we use the Sobel gradients, which are obtained by convolving the image with the following kernels:

2

0

2

 

0

0

0

 

(2)

 

1

0

1

 

1

2

1

 

 

 

 

1

 

 

1

 

−1

0

1

2

 

Edge Following

If an object in an image has a discrete edge all around it, and also a beginning position on the edge has been found, it is possible to follow the edge of the object and back to the beginning position. Edge following is a very useful operation, particularly as a stepping stone to making decisions by discovering region positions in images. This is effectively the dual of segmentation by region detection.

Edge detectors yield pixels in an image lying on edges. The next step is to collect these pixels together into a set of edges. Thus, the whole object can be present simply by a few edges around it.

Binary Morphological Operations

Binary morphological operations are defined on bi-level images, which consist of either black or white pixels only. Dilation and erosion are popular binary morphological operations. If dilation can be said to add pixels to an object or to make it bigger, then erosion will make an object smaller.

Erosion can be used to eliminate unwanted white noise pixels from another black area. The only condition in which a white pixel will remain white in the output image is that all of its neighbors are white. The effect of erosion on a binary image is to diminish the edges of a white area of pixels and make the object look smaller than ever. The same rules applied to erosion can also be applied to dilation. But the logic must be inverted – using the NAND rather than the AND logical operation. Compared to erosion, dilation will allow a black pixel to remain black only when all of its neighbors are black. This operator is useful for removing isolated black pixels from an image.

10. Visual Prosthesis Based on Optic Nerve Stimulation with Penetrating Electrode Array

201

Some Preliminary Result of Image Processing Strategies

The goal of our research group is to develop an image-processing system based on DSP for the optic nerve stimulation. In the first step, we test image-processing strategies by computer simulation and then transfer them to DSP.

Figure 10.12 shows the effect of histogram equalization. It is obvious that histogram equalization can improve the contrast of the original image without affecting the structure of the object.

Figure 10.13 shows the process of visual information extraction. It was found that both edge following and edge detection arithmetic operators can gain the border of the object. Based on the edge image, dilation operation can enhance the visual information of the object.

Figure 10.14 shows the unprocessed image captured by the micro-camera OV6650FS, and the processed image with edge detection algorithm by high performance DSP. As shown in the edge image, the detail of source image is not lost, and especially the numbers can still be recognized. It is very easy

2500

 

 

 

 

 

2000

 

 

 

 

 

1500

 

 

 

 

 

1000

 

 

 

 

 

500

 

 

 

 

 

0

 

 

 

 

 

0

50

100

150

200

250

(a)

3000

2500

2000

1500

1000

500

0

0

50

100

150

200

250

(b)

Figure 10.12. The effect of histogram equalization: (a) original image; (b) output image.

202 Ren et al.

Figure 10.13. The process of visual information extraction: (a) original image, (b) the image after edge following, (c) the image after edge detection, and (d) the image after dilation based on edge image.

to implement other algorithms by our DSP image processing platform. Once more advanced algorithms are fulfilled, the basic function of visual information extraction of retina can be replaced by our optic nerve prosthesis.

Neural Electrical Stimulator

According to the experiment results of Claude Veraart et al., the stimulation based on optic nerve needs biphasic current pulses with variable amplitudes (from several microamperes up to several milliamperes), pulse duration (from several microseconds up to hundreds of microseconds) and pulse frequency. Then multiple biphasic current pulses make up one pulse train.

Figure 10.14. The visual information extraction by DSP: (a) original image captured by micro-camera, (b) the image after edge detection by DSP.

10. Visual Prosthesis Based on Optic Nerve Stimulation with Penetrating Electrode Array

203

skin

Implantable Neural Stimulator

communication

power

Filter and

commutate

Info

data

Processing and

Stimulus

control

 

driver

Power

 

 

management

 

 

Coding,

 

Electrode

decoding,

D/A

driver

transmission

 

 

 

and control

 

 

Electrodes

 

 

monitor

 

 

array

Electrodes

Figure 10.15. Schematic of the architecture of the micro-stimulator.

After the important characteristics of a visual object, such as position, dimension, colour, etc., are extracted from the original image, we can encode these information into special stimulation patterns.

The implantable micro-stimulator in our project consists of three parts: communication unit, processing and control unit, and stimulus driver unit. Figure 10.15 reveals the architecture of the micro-stimulator. The external part collects the visual information and encodes the information into electrical stimulation patterns. And then it modulates and transmits the patterns by radio frequency (RF) telemetry with other important control signals. The implantable parts exchange information by RF telemetry too. The transmission of power is also realized by RF telemetry. Once the power and data information are received, these information will be demodulated and decoded by the processing and control unit, which also monitors and records the state of electrode arrays.

The Stimulus Driver Unit converts digital signals of stimulation patterns into analog signals by DAC. The output of DAC is converted to biphasic current pulses by stimulus driver circuitry and delivered to the penetrating electrode array.

Implantable Micro-Camera in Model Eye

Design of Implantable Micro-Camera

This micro-camera which will be implanted in the position of the lens of the blind eye consists of the micro-lens, CMOS and the cable. The raw data of the image acquired by the micro-camera is then transmitted to the next processing unit out of the eye through the cable.

According to the dimension of the normal human eye, the distance between posterior cornea and crystalline lens is about 6 mm, and the pupil size in

204 Ren et al.

a normally illuminated room condition is about 3 to 4 mm; we chose the dimension of the micro-camera as 5 mm long and 4 mm wide as demonstrated in Figure 10.16. The micro-lens should be of wide angle and short focal length, such that the visual field could be extended.

The necessary highest resolution of the CMOS could be calculated based on visual discrimination. For example, for a given focal length of 4 mm of the micro-lens, if the best discrimination ability was described with visual angle of 10 minutes of arc or more, the maximum single pixel should not be larger than 5 m. Much higher resolution could consume more power, hence more heat would be created, which was a considerable problem since it was to be implanted into the eye. In addition, more time was needed for the data processing which also should be taken into account with real time visual purpose.

Evaluation of the Micro-Camera in the Model Eye

In order to evaluate the imaging quality of the micro-camera in different environments, we put the micro-camera in the position of the crystalline lens of a model test eye (Figure 10.17). The model test eye was full of 0.9 % NaCl fluid when the pictures were to be taken in order to simulate the internal circumstance of the anterior chamber of the eye. The images were recorded with the target at different distances from the model test eye. It was demonstrated that the images became only a little blurred when recorded with the micro-camera in 0.9 % NaCl fluid (Figure 10.18). It also could be seen that the depth of field was large enough for the visual prosthesis to “see” clearly in the near and middle distance. In addition, it might have enough resolution for the image information extraction to correctly stimulate the optic nerve or neurons.

Figure 10.16. The implantable micro-camera including micro-lens, CMOS and cable (Top). The sketches of the implantable micro-camera (Bottom).

10. Visual Prosthesis Based on Optic Nerve Stimulation with Penetrating Electrode Array

205

Figure 10.17. The setup of the model test eye with the micro-camera position in the pupil. Side view (left) and front view (right).

Discussion

Through the comparison of the images acquired by micro-camera in the 0.9 % NaCl fluid and in the air, it can be seen that this micro-camera seems suitable for behaving as an imaging system for the visual prosthesis if it was packaged with

Figure 10.18. The comparison of images taken in 40 cm (top), 200 cm (middle) and 300 cm (bottom) from the model test eye with the micro-camera in the air (left column) and in the 0.9 % NaCl fluid (right column).

206 Ren et al.

biocompatible material. However, these are very preliminary results. Further studies need to be carried out to implant the micro-camera into a cat’s eye to evaluate the long-term biocompatibility and imaging function.

Conclusion

A type of visual prosthesis with stimulating electrode penetrating into optic nerve is introduced in this chapter. The feasibility of this visual prosthesis has been validated using some animal experiments. Many more animal experiments will be carried out to find out the rules of visual perception elicited by electrical stimulation in our project. To some degree, the hardware design of visual prosthesis depends much on the development of MOEMS technology. But a number of effective image-processing strategies can be explored and evaluated to enhance the performance of visual prosthesis and even decrease the difficulty of complex hardware design. In this chapter, we presented some tests of image-processing strategies by computer simulation and DSP implementation in real time. A high precision neural stimulator is also under study. An implantable CMOS microcamera with special design is also evaluated. Although much more tests for its long-term biocompatibility must be carried out, the preliminary results showed that the micro-camera was suitable for our visual prosthesis with minimal loss of image quality in the simulation physiological circumstance.

References

1.Brindley GS, Lewin WS, The sensations produced by electrical stimulation of the visual cortex, J. Physiol. (Lond), 1968, 196:479–493.

2.Dobelle WH, Mladejowsky MG, Artificial vision for the blind: electrical stimulation of visual cortex offers hope for a functional prosthesis, Science, 1974, 183:40–44.

3.Schmidt EM, Bak MJ, Hambrecht FT, Kufta CV, O’Rourke NA, Vallabhanath P, Feasibility of a visual prosthesis for the blind based on intracortical microstimulation of the visual cortex, Brain, 1996, 119:507–522.

4.Zrenner E, Miliczek KD, Gabel VP, Graf HG, Guenther E, Haemmerle H, Hoefflinger B, Kohler K, Nisch W, Schubert M, Stett A, Weiss S, The development of subretinal micro-photodiodes for replacement of degenerated photoreceptors, Ophthalmic Res., 1997, 29:269–280.

5.Humayun MS, de Juan Jr E, Weiland JD, Dagnelie G, Katona S, Greenberg R, Suzuki S, Pattern electrical stimulation of the human retina, Vision Res., 1999, 39:2569–2576.

6.Chow AY, Pardue MT, Chow VY, Peyman GA, Liang C, Perlman JI, Peachy NS, Implantation of silicon chip microphotodiode arrays into the cat subretinal space. IEEE Trans. Neural Sys. Rehabilitation Eng., 2001, 9:86–95.

7.Veraart C, Raftopoulos C, Mortimer JT, Delbeke J, Pins D, Michaux G, Vanlierde A, Parrini Sand Wanet-Defalque MC, Visual sensations produced by optic nerve stimulation using an implanted self-sizing spiral cuff electrode, Brain Research, 1998, 813:181–186.

10. Visual Prosthesis Based on Optic Nerve Stimulation with Penetrating Electrode Array

207

8.Veraart C, Wanet-Defalque MC, Gerard B, Vanlierde A and Delbeke J, Pattern recognition with the optic nerve visual prosthesis, Artif. Organs, 2003, 27:996–1004.

9.Brelén ME, Duret F, Gérard B, Delbeke J and Veraart C, Creating a meaningful visual perception in blind volunteers by optic nerve stimulation, J. Neural Eng., 2005, 2:22–28.

10.Noelle R Stiles, Intraocular camera for retinal prostheses: Restoring vision to the blind, 2004.

11.Parikh NJ, Weiland1 JD, Humayun1 MS, Shah SS, Mohile GS, DSP based image processing for retinal prosthesis, Proceedings of the 26th Annual International Conference of the IEEE EMBS, 2004, pp. 1475–1478.

12.Pratt WK, Digital Image Processing, John Wiley & Sons, 2001.

13.Gonzalez RC and Woods RE, Digital Image Processing, Addison-Wesley Publishing Company, 1992.

This page intentionally blank

11

Dynamic Interactions of Retinal Prosthesis Electrodes with Neural Tissue and Materials Science

in Electrode Design

Charlene A. Sanders1, Evan J. Nagler1, David M. Zhou2

and Elias Greenbaum1

1Oak Ridge National Laboratory

2Second Sight Medical Products, Inc.

Introduction

Visual sensation communicates greater information about the environment than any other sense. It is a carefully integrated neural interpretation of chemical and electrical signals that are initiated by photons of light and culminate in cerebral processes that create and map a complex range of visual percepts. Useful visual sensation is dependent upon the efficient functioning of all the links in the visual pathway and the transfer of the signal from image to visual cortex without interruption. Artificial sight refers to a number of experimental photochemical and photoelectrical devices that mimic the function of specialized cells in the optical neuronal network and assume their role if they become impaired by injury or degenerative disease. One such device, presently under development, is a microelectrode array retinal prosthesis for the treatment of people who are blind from retinitis pigmentosa (RP) or age-related macular degeneration (AMD). In both diseases, the photoreceptor cells (rods and cones) are gradually destroyed. Patients affected by photoreceptor degeneration slowly lose visual acuity and eventually become blind. Without viable photoreceptor cells, there are few options for regaining vision. Defective cells may be replaced by removing the retina and transplanting a new retina from a compatible donor. Clinical studies of transplant procedures and immunological studies of transplant survival and rejection are presently under way [1]. The only other viable option is an electronic visual prosthesis. The retinal prosthesis (Figure 11.1) is an intraocular electronic device that can be permanently implanted on the inner retinal surface

209