- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
278 |
A. Horsager and I. Fine |
Table 14.1 A16 subjects’ age at implantation, eye of implantation, preoperative acuity in the implanted and non-implanted eyes, and electrode sizes
|
Age |
Eye |
VA (implanted) |
VA (non-implanted) |
Electrode size (mm) |
|
|
|
|
|
|
S01 |
76 |
R |
NLP |
LP |
520 |
S02 |
56 |
L |
LP |
LP |
520 |
S03 |
74 |
R |
NLP |
NLP |
260 |
S04 |
60 |
L |
LP |
LP |
260/520 |
S05 |
59 |
R |
LP |
LP |
260/520 |
S06 |
55 |
R |
NLP |
NLP |
260/520 |
Where there was a difference in pre-operative vision between the two eyes, implantation was carried out in the eye with worse vision. One subject (S02) had two operations in the same eye since her electrode array detached from the retina after 11 months due to the subject falling and bumping her head (no retinal detachment occurred). In the second surgery, the electrode array was reattached in a nearby macular area no more than 500 mm distant from the position of the original implant. Testing for S01 was limited in duration due to geographical constraints. Testing for S03 ended due to medical reasons unrelated to the implant. Testing in S04 was ended after microperforation of her conjunctiva which led to cable exposure. Because her cardiac status had deteriorated since the initial implantation she could not undergo anesthesia. This prevented the use of a scleral patch graft to repair the microperforation. To minimize the risk of possible infection, the multi-wire cable connecting the electrode array to the extraocular stimulator was cut and the electrode array was left in place
specified that optical coherence tomography (OCT) measurements were only carried out on the subjects for clinical reasons, and as a result OCT data were only collected at irregular intervals.
The bulk of the data described in this chapter were collected using this epiretinal device. As a result more detailed information is given about the patients implanted with this device (Sects. 14.3, 14.4.3, and 14.5.3).
14.3 Thresholds on Individual Electrodes
One major concern in the field of retinal prostheses is that the current amplitude required to elicit percepts may fluctuate unpredictably over time, due to neurophysiological changes of the retina due to reorganization [40], electrochemical changes on the electrode surface, or instability of position of the electrode array on the retinal surface [21, 77]. Previous acute studies found that localized retinal electrical stimulation of blind subjects resulted in discrete visual percepts; however, the amount of electrical current required to elicit visual responses was relatively large compared to animal in vitro retinal studies examining responses to electrical stimulation [36, 61].
The most exhaustive examination of thresholds and brightness reported to date has been within the six subjects implanted with the A16 epiretinal prosthesis (Second Sight Medical Products, Inc.). Over the course of several years, we measured the distance of the electrodes from the retinal surface (using Optical Coherence
14 The Perceptual Effects of Chronic Retinal Stimulation |
279 |
Tomography, OCT), retinal thickness, electrode impedance, and perceptual thresholds for both single pulse and pulse train stimuli [21, 33]. These data allowed us to examine the relationship of perceptual threshold to electrode size, electrode impedance, distance of the electrodes from the retinal surface, and retinal thickness.
14.3.1 Single Pulse Thresholds Using the SSMP System
Thresholds were measured on single electrodes using a single interval, yes-no procedure. On each trial, subjects were asked to judge whether or not a stimulus was present. This reporting procedure meant that subjects were likely to report stimulation for either a light or dark spot; subjects were explicitly instructed to include either type of percept in making their decision. Half of the trials were stimulus-absent catch trials. Current amplitude was varied using a three-up-one- down staircase procedure to find the threshold current amplitude needed for the subjects to see the stimulus on 50% of stimulus-present trials, corrected for the false alarm rate. During each staircase, only amplitude varied. All other parameters (frequency, pulse width, pulse train duration, and the number of pulses) were held constant. Thresholds were measured for each of the 16 electrodes using a single “standard pulse” consisting of a 0.975 ms cathodic pulse followed by a 0.975 ms anodic pulse.
Thresholds measurements for each subject are shown in Fig. 14.5. Differences in threshold did not change systematically as a function of patient age or pre-operative vision [76]. However, thresholds did appear to decrease as a function of successive surgeries. Generally, thresholds decreased across subject implantations. Indeed, subject S01 had the highest threshold overall. This improvement across surgeries was perhaps due to the overall improvement of the surgical procedure, leading to the electrode array lying successively closer to the retinal surface. For subjects S05 and S06, most of the measured single pulse thresholds were well below 100 mA and charge density limits of 0.35 mC/cm2. It should also be noted that these thresholds are for a single pulse, whereas functional electrical stimulation is likely to be mediated by pulse trains, which generally require lower stimulation thresholds (see Sect. 14.3.2).
Mean thresholds for subjects S04–S06 across the 260 and 520 mm electrodes were compared to determine if electrode size had any effect on the measured values. Interestingly, there was no noticeable difference in threshold between 260 and 520 mm electrodes, either within or across subjects (two-factor, subject × electrode size, ANOVA, p > 0.05 F = 0.367), see Fig. 14.6. This was in direct contrast to a recent literature review by Sekirnjak et al. who found, across a wide range of in vitro and in vivo studies, that log thresholds increase linearly with log electrode area [64]. However, only two electrode sizes are evaluated here, and it is possible that a wider range of sizes would make threshold differences, as a function of electrode size, more apparent.
280 |
A. Horsager and I. Fine |
Fig. 14.5 Mean thresholds across the entire time period of implantation (mA) for all 16 electrodes for each subject. The upper panels show the labeling scheme used to identify electrodes, as viewed through the pupil. For each subject, electrodes are ordered from most to least sensitive along the x-axis. White and black bars represent electrode diameters of 260 and 520 mm respectively. Threshold current is shown along the y-axis. Note the dramatic change of scale along the y-axis across subjects. Error bars are +/− one standard error of the mean. Reprinted from [21], with permission
Fig. 14.6 In both (a) and (b), the x-axis represents electrode diameter and the y-axis represents the current needed to reach perceptual threshold. (a) is the data are taken from subjects S04–S06. The large symbols connected by lines represent the mean threshold across each of the eight electrodes of a given diameter for each subject. Error bars are +/− one standard error of the mean. In many cases error bars are smaller than the symbols. Individual electrodes are shown with small symbols. (b) compares our measured thresholds in S04-06 (large open shapes) and those reported in the literature [64]. Reprinted from [21], with permission
14 The Perceptual Effects of Chronic Retinal Stimulation |
281 |
Fig. 14.7 OCT imaging of the array. (a) Fundus photograph of an intraocular electrode array viewed through a dilated pupil, imaged by the OCT machine (OCT, STRATUSOCT™; Carl Zeiss Meditec AG) just previous to the cross-sectional OCT image shown in (b). (b) Cross-sectional OCT image. Location of electrodes that were imaged are denoted by the letters A, B, C, and D. Reprinted from [21], with permission
The distance from the top of each electrode to the internal limiting membrane of the retina varied both within and across subjects, as measured using optical coherence tomography (OCT) (Fig. 14.7). Electrode thickness varied between 80 and 120 mm depending on the exact cross-section, so 100 mm was subtracted from the measurement of the distance of the electrode to the internal limiting membrane. The thickness of the retina was defined as the distance from the inner surface of the retinal pigment epithelium to the internal limiting membrane.
Impedance was measured using Second Sight Medical Products (Inc.) proprietary software. Impedance measurements were taken at the beginning and end of each stimulating session.
Data suggests that distance from the retinal surface is a critical factor in determining both threshold and impedance. For a given electrode size, electrodes that are close to the retinal surface have lower thresholds and higher impedances. As shown in Fig. 14.8b, we see a positive correlation between threshold current and electrode distance from the retina. These psychophysical data are consistent with retinal electrophysiology data, suggesting that the distance of the electrodes from the retina is a significant concern [31, 38]. Stimulus current requirements are likely to be minimized when the array is in close position to the retina, minimizing power consumption by the stimulator and allowing for smaller electrodes to generate phosphenes within safe charge density limits.
On the whole, subject impedances tended to decrease postoperatively over time. However, impedances are also negatively correlated with the distance of the electrode from the retinal surface, as shown in Fig. 14.8c. These data are consistent with the notion that electrodes that are close to the surface of the retina have higher impedances (due to the adjacent retinal tissue) than electrodes that have lifted from the retina (where fluid with higher conductivity intervenes between the electrode and the retinal surface) [32, 65]. Indeed, consistent with this hypothesis, threshold is negatively correlated with the impedance (Fig. 14.8a).
