- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
78 |
E. Fernández and L.B. Merabet |
SPECT |
Single photon emission computerized tomography |
tDCS |
Transcranial direct current stimulation |
TMS |
Transcranial magnetic stimulation |
4.1 Introduction
The question of what happens to the brain following the loss of sight is of seminal importance for any rehabilitative strategy for the blind. In order to interact effectively with their environment, blind individuals have to make striking adjustments to their loss of sight. Growing experimental evidence now suggests that these behavioral adaptations are reflected by dramatic neurophysiological changes at the level of the brain and specifically, with regions of the brain responsible for processing vision itself. These changes may represent the exploitation of spatial and temporal processing inherent within occipital visual cortex that allow a blind individual to adapt to the loss of sight and remain integrated in highly visually-dependent society.
Over the past 25 years, great strides have been made in understanding the neurophysiological mechanisms underlying visual perception. What is less known are the changes associated with how the brain adapts to the loss of sight. For example, what is the physiological and functional fate of cortical areas normally associated with the processing of visual information once vision is lost (e.g. from ocular disease or trauma)? Would this have an impact on the success of implementing a rehabilitative strategy such as a visual based neuroprosthesis in the hope of restoring functional vision? As research and development continues, we should be aware that some of the impediments to future progress in implementing a visual neuroprosthesis approach are not only technical, engineering and surgical issues, but are also related to the development and implementation of strategies designed to interface with the visually deprived brain.
In this chapter, we will review recent advances in the knowledge about brain plasticity and emphasize its importance in order to achieve optimal and desired behavioral outcomes with respect to neuroprosthesis development. Other important questions that will be reviewed relate to the time course of the plastic changes and whether cortical areas deprived of their normal sensory input can still process the lost sensory modality.
4.2 Current Concepts on Brain Plasticity and Implications for Visual Rehabilitation
Classical thought has held the view that the bulk of brain development occurred during childhood and that thereafter there was little opportunity for dramatic adaptive change. It was understood however, that adult brains must display some form of adaptation or “plasticity” since we are capable of sensory and motor learning
4 Cortical Plasticity and Reorganization in Severe Vision Loss |
79 |
throughout life. Furthermore, it has been postulated that the site of these ongoing changes was limited to “higher order” perceptual processing areas as opposed to primary sensory and motor cortices. Thus, primary visual, auditory and somatosensory cortical areas were strictly implicated with seeing, hearing and touch respectively. Currently, these concepts can now be viewed as an oversimplification as research in the field of neuroplasticity has expanded rapidly to suggest that sensory modalities are not as inherently distinct and independent as was previously believed and that the adult brain has a remarkable capacity to change and adapt throughout a developmental lifetime [3, 7, 28, 34, 37, 42, 61, 63, 72, 76].
With respect to the discussion here, there is also considerable evidence that adaptive and compensatory changes occur within the brain following the loss of sight [12, 24, 33, 60, 61, 73, 76, 82, 83]. Current evidence suggests that in response to the loss of sight, regions of the occipital cortex (areas normally ascribed to the processing of visual information) are functionally recruited to process tactile and auditory stimuli and even higher order cognitive functions such as verbal memory (Fig. 4.1).
One important question to address would be to uncover the underlying nature of this functional recruitment of occipital cortex to process other sensory modalities. Is it possible that this recruitment is related to the ability of blind subjects to extract greater information from the remaining sensory modalities for which they are so highly dependent? In this context, plasticity can be viewed as an active component of sensory processing capable of altering processing patterns and cortical topography. However, it is important to note that not all neuroplastic changes following sensory
Fig. 4.1 Recruitment of occipital cortical areas in the blind in response to different tasks. (a) Braille reading. (b) Sound localization. (c) A verbal memory task. See text for references and more details
80 |
E. Fernández and L.B. Merabet |
loss should be assumed to be beneficial or necessarily lead to functional recovery. In reality, neuroplasticity can be viewed as both a positive and negative response. On one hand, it can contribute to changes that are functionally adaptive when a sensory modality is lost. On the other, neuroplasticity can also constrain the degree of adaptation. Therefore, the consequences of neuroplastic change need to be considered not only as a consequence of sensory loss, but also with respect to an individual’s own experiences.
Plasticity is not only essential to allow the brain to adjust to its ever-changing sensory environment and experiences and improving perceptual skills, but also plays a crucial role in the recovery from damage and insult. This is also true with regard to the visual system, the adaptation to blindness and ultimately, the restoration of sight. In the case of restoring sight through neuroprosthetic means, it would be a great over-simplification to believe that re-introduction of the lost sensory input by itself will immediately restore the lost sense. Specific strategies have to be developed to modulate information processing by the brain and to extract relevant and functionally meaningful information from neuroprosthetic inputs.
4.3 Clinical Evidence for Reorganization of Cortical Networks in the Blind and Visually Impaired
It would seem reasonable to presume that in the setting of visual deprivation, the brain would reorganize itself to exploit the sensory inputs at its disposal [5, 17, 38, 40, 54, 61] and in fact, the loss of sight has been associated with superior non-visual perception in the blind, such as auditory and tactile abilities, and even in higher cognitive functions such as linguistic processing and verbal memory [4, 5, 12, 60, 79, 81, 92]. These adjustments not only implicate changes in the remaining sensory modalities (for example, touch and hearing) but also involve those parts of the brain once dedicated to the task of vision itself.
For example, the ability to read Braille is associated with an enlargement of the somatosensory cortical representation of the reading index finger (but not the corresponding non-reading finger) in association with the recruitment of the occipital visual cortex for the processing of tactile information. The functional significance of this cross-modal plasticity is supported by a variety of additional converging data. For example, Uhl et al. using event-related electroencephalography and single photon emission computerized tomography (SPECT) [90, 91] demonstrated that the primary visual areas are activated in early-blind subjects while performing a Braille reading task. Pascual-Leone and Hamilton had the opportunity of studying a congenitally blind woman who was an extremely proficient Braille reader (working as an editor for a Braille newsletter) who became suddenly Braille alexic while otherwise remaining neurologically intact, following a bilateral occipital stroke [40]. The interesting finding was contrary to expectations as the lesion did not affect the somatosensory cortex, but rather damaged the occipital pole bilaterally. Although she was well aware of the presence of the dot elements contained in the
4 Cortical Plasticity and Reorganization in Severe Vision Loss |
81 |
Braille text, she was unable to extract enough information to determine the meaning contained in the dot patterns. Further support demonstrating the functional role of occipital cortex comes from the fact that reversible disruption of occipital cortex function, for example by transcranial magnetic stimulation (TMS), impairs Braille reading ability in the blind [24].
While initial work focused on the task of Braille reading [82, 83], increasing evidence has also demonstrated activation of occipital cortical areas in congenitally blind subjects during tasks of auditory localization [51, 93]. This issue was further addressed by assessing language-related brain activity implicated in speech processing and auditory verb-generation. It has been shown that speech comprehension activates not only parts of the brain associated with language (as with sighted adult controls) [80], but also striate and extra-striate regions of the visual cortex [5]. As with tactile processing, reversible functional disruption of the occipital cortex by TMS impairs verb-general performance only in blind subjects [4] providing further evidence that the recruitment of the occipital cortex in high-level cognitive processing is functionally relevant.
The work demonstrating the functional recruitment of occipital cortex for the processing of non-visual information may reveal only the “tip of the iceberg” in terms of the brain reorganization that follows visual deprivation. Nevertheless these neuroplastic changes define a specific time window for the success of any visual neuroprosthesis (before full cross-modal adaptation) that probably is influenced by factors such as the onset and duration of visual deprivation and the mechanisms and profile of the visual loss (Fig. 4.2).
Fig. 4.2 Adaptive and compensatory changes at the occipital cortex after visual deprivation. (a) Following visual deafferentation, inputs from other sensory processing areas reach the occipital cortex via connections through multisensory cortical areas (and possible through direct connections). These adaptive changes include the functional recruitment of visual cortical areas for the processing of non-visual information such as tactile information, auditory information and higher-order cognitive functions (e.g. verbal memory). (b) Over time, these neuroplastic changes may eventually lead to the establishment of new connections and functional roles with clear implications on the right time of implantation and the likelihood of success in recreating functional vision with a visual neuroprosthetic device
