- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
3 Retinal Remodeling and Visual Prosthetics |
65 |
3.5 Retinal Circuitry
Though analysis of the neural retina and its circuitry goes back over 100 years ago to Ramón y Cajal’s work, most work examining the anatomy of circuitry in retinal disease is more recent, encompassing efforts in the last three decades to understand the components and their function. This work has revealed the retina to be a bilaminar device with sensory and computational layers.
The sensory retina is composed of photoreceptors and is the photon transduction layer, while the neural retina is composed of the remaining neuron classes that comprise the image-processing layer. Even in a simple retina like the mammalian, the retinal circuitry is complex, comprising approximately 14 patterned outflow channels, realized as ganglion cells. The number of cell classes in the mammalian retina includes one rod class, one rod horizontal cell, one rod bipolar cell, two to three cone classes, one to three cone horizontal cells, 9+ cone bipolar cells, 27 amacrine cells, and about 15–20 ganglion cells. Thus, about 60–70 cellular devices form the outflow channels [66, 73, 99]. These outflow channels involve the flow of information through a set of stereotypical circuits from photoreceptors to bipolar cells to ganglion and amacrine cells with amacrine cells providing both feedback and feedforward control [65, 72, 73, 99]. It should be noted however that even two bipolar cells providing input to two separate ganglion cells, interconnected by a single amacrine cell provides a combinatorial 90 distinct and separate motifs assuming lumped-parameter circuitry. Assuming distributed parameter circuitry [100] expands the number of combinatorials to over 2,000 potential motifs. This approximation of a circuit diagram does not include any weightings for differential synaptic strength, cell class diversity, and coupling by gap junctions. Nor does this approximation include the most common form of synaptic connection in the retina between cells, the amacrine–amacrine cell serial synaptic chain. However, we know that the outflow of signals from the mammalian retina is represented by only 15–20 ganglion cell classes [67, 82], greatly simplifying the number of possible outputs, though we do not know what the total network topology is.
Even rich models [42] that mimic physiologic data acquired over limited spatiotemporal domains predict little about network topology or emergent features. Despite a broad view of the bounds of biophysical performance provided by physiology, models derived from physiology are essentially degenerate: not unique to any one network topology. In addition, remodeling and reprogramming of neural networks in retinal disease strongly argues that network scrambling is a key pathology [69]. Network motif diversity is analogous to genetic diversity: many connective motifs (gene sequences) are
Fig. 3.2 (continued) GABAergic amacrine cells along with contributions from bipolar cells and ganglion cells forming complex tangles of processes called microneuromas (9, 10) that form outside the normal lamination of the inner plexiform layer, sometimes merging with the inner plexiform layer. These microneuromas possess active synaptic elements corruptive of normal signaling. By late phase 3, retinal degeneration is advanced with neuronal migration or translocation events occurring in a bi-directional fashion (11) along with neuronal death of many cell classes (12). IPL rewiring and laminar deformation of the plexiform layers can also be observed
66 |
B.W. Jones et al. |
possible, but only a subset form good filters (proteins), and mutating motifs generates neural malfunction (genetic disease).
In theory, subretinal implants drive remnant circuits with cone-like inputs and epiretinal implants drive ganglion cell channels by mimicking bipolar-amacrine cell networks. Both schemes require survival of retinal neurons to drive perceptual and oculomotor systems, and presume no alterations in cell patterning or connectivity, nor any corruptive signal invasion into retinal networks. Subretinal strategies uniquely require positioning within the subretinal space. These presumptions (preservation of topology, cell numbers and wiring) are false for most retinal degenerations.
3.6 Retinal Circuitry Revision
Neuronal translocations in the remodeling retina are complex and do not just involve migrations of cell somata that leave their dendrites and axons in the original locations, preserving connectivity. The reality is far more insidious as the elaboration of new neurite, axonal, and synaptic structures occurs before gross cellular migration ensues (Figs. 3.3 and 3.4). These structures occur individually and may assemble into fascicles and microneuromas that may run for many microns underneath the Müller cell seal, forever changing and corrupting completely the neuronal circuitry of the retina [49–52, 68–71]. Modeling of new circuits demonstrates that all observed circuits are corruptive and many form resonant circuits, rendering the remnant neural retina no longer effective as an image processor [49, 51, 69].
While most analyses of retinal degeneration have focused on events surrounding phase 2 and photoreceptor death, rewiring of the neural retina occurs in all phases of retinal degeneration, and likely begins prior to photoreceptor death during the stress phase [69, 70]. Early in phase 2, ganglion cell light responses are altered, resulting in the loss of ON responses with the simultaneous preservation of OFF responses [80]. Once the photoreceptors are completely lost, ganglion cells spike throughout the retina of the Pde6brd1 mouse retina [86], possibly providing a mechanism behind the scintillating scotomas reported by many patients with RP [22].
Therefore, passive anatomy alone does not reveal the scope of neural change in response to retinal degenerative disease. The growing evidence supports retinal rewiring as a common feature in retinal degenerations that involve photoreceptor loss and recent work [69] indicates profound changes in physiology through the use of excitation mapping [63, 64] and mapping cellular identity across disease states with single-cell resolution [67] along with in vivo and in vitro ligand activation in wild-type mice and rdcl and hrhoG mutant mice exhibiting rapid photoreceptor degeneration. In addition, the Marc 2007 study included in vitro excitation mapping in a sample of human RP retina revealing reprogramming events in bipolar cells that likely impact all forms of proposed retinal rescue strategies as the remodeling goes beyond rewiring and morphological change to include molecular reprogramming.
These findings are perhaps not surprising in that changes in circuitry have been documented in the literature for years. Other than the previously noted 1974 study
3 Retinal Remodeling and Visual Prosthetics |
67 |
Fig. 3.3 EM image of a microneuroma underneath a distal retinal Müller cell seal on the left with a blood vessel and portion of an erythrocyte on the right. One hundred to four hundred nanometer diameter processes are running parallel together, perpendicularly through this plane of section comprised of five transmission electron microscopy (TEM) images mosaiced together. Synaptic profiles are present in this microneuroma with apparent bipolar cell (BC) like synapses with dyads, yet bereft of ribbons as well as conventional synapses from amacrine cells (AC) shown in the inset indicating that microneuromas are potentially not passive structures with respect to circuitry. Efforts to reconstruct microneuromas are underway to define the pathology of circuitry in these retinas. Scale bars = 1 mm
by Kolb, some of the earliest indications of retinal rewiring or connectivity defects can be seen in a paper by Li et al. in 1995 [58] where the authors documented aberrantly sprouting rod photoreceptors. Fei in 2002 [32] documented sprouting cones, Machida et al. [60] found abnormal sprouting of photoreceptors and horizontal cells in the degenerating retinas of the P23H transgenic rat and Fariss et al. [31] documented anomalous extension of rod, horizontal and amacrine cell neurites throughout the neural retina while Gregory-Evans et al. identified abnormal cone synapses in human cone-rod dystrophy [38]. Peng et al. identified ectopic synapses in the RCS rat [78] while other investigators working concurrently in mouse models of RP identified some of the earliest changes in the second order neurons, with dendritic retraction of rod bipolar and horizontal cells after photoreceptor cell loss [88, 90, 95]. Documentation of neuronal migration [49, 51, 52, 70], the identification of corruptive synaptic machinery in rod and cone bipolar cells as well as
68 |
B.W. Jones et al. |
Fig. 3.4 Additional synaptic structures often present in microneuromas, though with immature forms. This example shows a aberrant presynaptic multi-projection amacrine cell (AC) making synaptic contact onto a bipolar cell in parallel with another bipolar cell (BC) profile making a simultaneous synapse complete with synaptic ribbon, onto the same bipolar cell profile. Scale bar = 200 nm
horizontal cells [18, 19] and most significantly, formation of new neuronal connectivities and reprogramming [69] have made for a compelling literature that will absolutely impact the implementation and success of rescues designed to preserve or restore vision.
3.7 Implications for Bionic Rescue
Because of the vast diversity of potential insults in both RP and AMD, any one, targeted intervention is likely to be useful for only a small percentage of potential individuals. Therefore, approaches designed to replace entire systems with bionic and biological solutions may appear attractive. However, as noted all retinal degenerations lead to problems of access and alterations to the fundamental image processing circuitry. The problem of how to rescue vision is further compounded by the issue of when to intervene. Current therapies or interventions are limited to those patients who have lost a considerable portion of their vision and are legally blind. These patients often present at late stage with advanced retinal degeneration (Fig. 3.1) and already likely exhibit profound alterations to the retinal circuitry that corrupt any surrogate inputs.
