- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
264 |
P. Walter and G. Roessler |
Fig. 13.3 Examples of probes for acute retinal stimulation experiments in human. (a) Polyimide stimulator used by Hornig et al. [10]. The thin and flexible polyimide device has a width of 1.6 mm. Active electrodes with diameters between 50 and 360 mm are placed at the tip of the device, the return electrodes are at the base of the device adjacent to the metal housing. (b) 17.5 Gauge steel cannula with several stimulation electrodes at the tip as used by Humayun and coauthors [12]. (c) 125 mm thin curved platinum wires for direct electrical stimulation of the retinal surface as used by Humayun and co-authors [12]
13.4 Threshold Measurements
The first approach in such settings is always the determination of thresholds at which a stimulation pulse or pulse series yields a phosphene. A two alternative forced choice method is usually applied. In such experiments threshold is commonly defined as the lowest stimulus intensity at which on 75% or more of the test repetitions the patient correctly reports a visual percept.
Also catch trials are usually employed in acute retinal stimulation testing, i.e. a stimulus is indicated, e.g., by a warning tone, but no electric pulse is given. If the subject gives a positive answer the answer is classified as false positive. Such catch trials are needed to test the reliability of a subject in this very demanding situation. Only those experiments should be analyzed in which patients do not give too many false positive responses. The criterion at which tests should not be used because of too many false positive responses should be defined for each experiment [10].
Threshold measurements were reported by Rizzo [14, 15]. In his series visual responses in patients with advanced RP could not be obtained with needle type electrodes because the charge density would exceed toxicity limits. They used
13 Findings from Acute Retinal Stimulation in Blind Patients |
265 |
oxidized iridium as electrode material based on a polyimide substrate. With 250 ms per phase stimulus duration threshold currents were around 1.5 mA for 400 mm electrodes in diameter. For 1 ms per phase stimulus duration the stimulus current at threshold was between 0.8 and 0.4 mA and for 16 ms per pulse phase stimulus currents at threshold were around 200 mA. Based on these experiments the rheobase was calculated as 125 mA with a chronaxie of 2.3 ms per pulse phase. When charge densities were calculated they found that for 100 mm electrodes the charge densities at threshold were between 4 and 10 mC/cm2, for 400 mm between 0.28 and 2.8 mC/cm2 which was larger than their own safety limit (1 and 0.252 mC/cm2, resp.).
In Humayun’s series nine blind RP patients were acutely stimulated with either platinum wires (25–125 mm diameter) used as electrodes or disc electrodes each 400 mm in diameter. Charges et threshold were reported between 0.2 and 2.4 mC which gives charge densities between 1 and 96 mC/cm2. The higher values were obtained for needle type electrodes [13].
13.5 Spatial Resolution and Pattern Perception
The main prerequisite for the recognition of forms and patterns is a correct retinotopical representation of the stimulus within the visual field. Humayun was able to show in his series, that stimuli were correctly identified in terms of their location within the retina resp. within the visual field. This was also confirmed by animal experiments. Spatial resolution can only be tested with electrode arrays when two electrodes or electrode clusters are stimulated simultaneously. The patient has to be asked if he sees two spots of light or two distinct patterns. In Humayun’s series he calculated a spatial resolution of 1.75° which could be achieved with epiretinal stimulation [11, 12]. These authors calculated based on simulations by Cha et al. [2] that placing a 32 × 32 array over a central field of 0.5 × 0.5 mm onto the macula surface would result in a 20/26 Snellen visual acuity. A spacing of 90 mm between each electrode would then reduce the visual acuity to 20/200. However, such electrode arrays are currently not available. Such devices are desirable when AMD treatment is supposed to be performed with such implants.
In a series of experiments in four blind subjects Rizzo and coworkers answered the question if blind patients are able to identify a stimulus pattern [15]. Only in one out of three patients more than 50% of the given patterns could be identified. Two-point discrimination was also tested in this series and only in very few experiments Rizzo’s group was able to find patient responses suggesting the perception of two separate objects. In these experiments the electrodes were 1,860 mm apart.
Acute stimulation experiments were not performed with any camera picture input. However, electrodes can be activated as if a certain pattern should be seen such as a large letter H. Humayun did such experiments in his series and he found that patients were able to detect patterned phosphenes. They used a 25 electrode array with a pattern “U” and patient reported a “H” type pattern which the authors thought to be the result of a blurring effect due to unstable positioning [13].
266 |
P. Walter and G. Roessler |
13.6 Temporal Resolution
Experiments to systematically determine temporal resolution in acute tests for retinal stimulation have not been reported in detail so far for human subjects. Early results indicated that the flicker fusion frequency may be similar for electrical stimulation and for normal vision [12]. From animal experiments it should be expected that 25 frames per second could be transferred with a retinal implant [6]. It can be expected that data on temporal resolution will be extracted from the clinical trials on retinal prostheses, which are now being performed. This information is important, because useful vision elicited with prosthetic devices does not only depend on spatial characteristics but also on the time necessary to transmit a pattern from the implant to the primary visual cortex and to identify it. The type of visual sensations that can be obtained.
If patients are asked after the procedure what they have seen, the descriptions vary considerably between individuals. However, a few aspects are common. Usually the patients did not experience any unpleasant sensations. With suprathreshold stimulation patients reported dots, arcs, circles and lines of different intensity, color, and orientation. Stimulation by one electrode may not necessarily result in the perception of one single percept or phosphene but also in multiple phosphenes as reported in one volunteer by Rizzo [15]. The size of the objects does also vary with respect to the electrode size, the stimulus intensity, and duration. The characteristics of the phosphenes were reproducible; i.e. the stimulus pattern X elicits the same phosphene when it was repeated at the same retinal area. Weiland and colleagues tested two subjects before removal of the eye due to cancer. In these patients they destroyed part of the outer retina with argon green and krypton red laser photocoagulation. They stimulated normal retina and the laser treated areas with a 125 mm platinum wire electrode. The percept after stimulation of the normal retina was a dark oval shaped phosphene whereas stimulation in the krypton red treated area revealed a small white spot. Stimulation of the argon green treated area resulted in a line type of percept. Stimulus threshold at the normal retinal area in their experiments were 0.8 and 4.8 mC/cm2 respectively. The percepts being described by blind RP patients were similar to those obtained over the krypton red treated normal retinas. From a histological work-up of the stimulated retina Weiland concluded that the target for electrical stimulation with an epiretinal electrode is not the ganglion cell layer but the inner nuclear layer [19].
The shape of the percepts varied significantly with the stimulus pattern or with the orientation of the activated electrodes of the array. In Rizzo’s series circles were seen when columnar electrodes along the axon orientation were activated but also curved lines [15].
13.7 Subretinal Versus Epiretinal Stimulation
Acute retinal stimulation experiments in blind humans were only reported for epiretinal stimulation, not for subretinal stimulation. Acute tests on subretinal stimulation so far have only been reported for rabbits and pigs but not for blind
13 Findings from Acute Retinal Stimulation in Blind Patients |
267 |
humans [7, 16]. Therefore major assumptions as confirmed for epiretinal stimulation were so far not confirmed for subretinal stimulation scenarios.
13.8 Less Invasive Stimulation Procedures
Electrical retinal stimulation can also be performed placing electrodes outside the eye. It has been shown that even by using corneal electrodes or electrodes placed onto the scleral surface it is possible to elicit visual phosphenes. Gekeler and colleagues investigated phosphenes upon electrical stimulation via DTL electrodes placed in the fornix. They found that in some RP patients such phosphenes could not be elicited. The rheobase for RP patients was 0.69 + 0.10 mA which is 18 times higher than for normal individuals [8]. Similar experiments were performed by Delbeke and colleagues. They used corneal surface electrodes with large periorbital reference electrodes. Their estimation for rheobase varied between 2.14 and 8.16 mA and for chronaxie they found values between 0.45 and 0.87 ms whereas for healthy volunteers rheobase was 0.28 mA and the mean chronaxie was 3.07 ms [4]. In our own experience in patients with advanced stages of retinitis pigmentosa the currents necessary to obtain visual percepts with such approaches are very high and close to current with which other subjective sensations such as pain or muscle tics were evoked. Such approaches are proposed to identify patients prior to surgery who may benefit from a chronic implant. Only those patients would be selected in which phosphenes can be obtained with such non-invasive techniques. However, we learned that in RP patients even when they do not respond to external stimulation or the stimulation has to be stopped because of unpleasant somatosensory sensations the same patient may have visual sensations with a chronic implant.1 Therefore, we feel that such a test is not useful to identify good candidates for retinal implants.
13.9 Conclusions and Outlook
The available data from acute trials in electrical retinal stimulation showed that at least with epiretinal stimulation visual responses can be obtained and that the energies necessary to achieve such responses are dependent on the material of the electrodes and on their sizes and shapes. A close contact between the electrode and the retina is desirable to elicit visual responses with low stimulus intensities. A deeper knowledge of the mechanisms of retinal stimulation as well as of the phosphenes which are elicited and their role in providing vision for a blind patient is necessary. Such information can only be obtained by chronic stimulation experiments in which enough time is available to study more stimulus parameters, more electrode positions over a longer time period and to allow the patients to learn how to interpret the percepts
1Walter (2005) unpublished observation.
