- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
274 |
A. Horsager and I. Fine |
patients (more than 5 years as of this writing), (2) stimulation via these electrodes consistently produces visual percepts, (3) provided the array is stable on the retinal surface, the current-brightness relationship is stable, repeatable, and monotonic,
(4) the brightness of the percept can be controlled through both amplitude and frequency modulation, and (5) signal integration during single or multi-electrode stimulation can be approximated using very simple models. In the last part of the chapter we discuss the use of these implants during “real world” and mobility tasks. While findings are promising, it is still not demonstrated that the devices that are currently available can provide useful function vision outside of the laboratory setting.
14.2 Overview of Chronic Retinal Implant Technologies
The earliest documented electrically generated percept in a blind human patient was in 1755, when Charles LeRoy, a French chemist and physician, discharged a Layden jar and supplied electrical current to a brass coil that wrapped around the head of a blind man [42]. In addition to “provoking terrible cries [47]”, the young patient perceived a flame that rapidly descended before his eyes. This is, more than likely, the first documented visual phosphene perceived by a blind subject via electrical stimulation.
Despite this somewhat unpromising beginning, restoring functional vision using electrical stimulation has been a goal of ophthalmologists and vision scientists for more than a century. The inspiration for these studies comes from very early (and probably inadvertent) electrical activation of visual cortex during neurosurgery. However, it wasn’t until the middle of the twentieth century that scientists and clinicians began to investigate, more deliberately and rigorously, the relationship between electrical stimulation of neural tissue and visual perception.
In recent years much of the effort in developing a visual prosthesis for the blind has focused on electrical stimulation of the retina. There is a substantial amount of neural processing within the LGN [5, 20, 73] and V1 [34] that transforms the visual signal in ways that are complex, nonlinear, and poorly understood. Targeting stimulation as early as possible in the visual pathway allows one to maximize the use of the innate computational processing of the visual system.
Even within the retina, a variety of approaches have received attention. Retinal stimulation devices have been developed for both subretinal (between outer retinal layers and the choroid) and epiretinal (between inner retinal layers and the vitreous humor) activation. Here, we provide a brief overview of the basic technology and the types of psychophysical and behavioral studies that have been conducted with subretinal and epiretinal devices.
14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
The Retinal Implant AG device has two subretinally implanted components. The first is a wire-bound microphotodiode array (MPDA), consisting of approximately
14 The Perceptual Effects of Chronic Retinal Stimulation |
275 |
Fig. 14.2 (a) General schematic of Retinal Implant AG device. Note the placement of the device in the subretinal space. (b) Close-up of the microphotodiode array (MPDA). Permission for reproduction provided by Retina Implant AG
1,500 photosensitive cells on a 3 mm2 surface (Fig. 14.2). Each cell unit contains an amplifier and electrode, spaced 70 mm apart. The amplitude of the electrical signal across each electrode is proportional to the overall illumination of the specific photosensitive cell. The second implanted component consists of a 4 × 4 array of 50 mm electrodes (with 280 mm spacing) that can be used for direct stimulation (DS). The stimulation presented on the electrodes of the DS array can also be independently controlled, and each of the parameters (e.g., pulse width and amplitude) can be independently modulated. The MPDA and DS arrays are positioned on a small polyimide foil surface and are powered via a transchoroidal, transdermal line.
This MPDA device was implanted in the fovea of one eye of seven patients blind from RP (all seven patients had the MPDA array and six had, in addition, the DS array). Devices were chronically implanted for a total of 4 weeks [78]. With the exception of one, patients were explanted at the end of this time. Visual perception and performance was evaluated in the following ways using DS: (1) the brightness of a biphasic pulse (1–2.5 Volts (V), 3 milliseconds (ms) per phase) was assessed using a rating scale from 5 (very bright) to 0 (no perception), (2) subjects were asked to discriminate stimulation of rows and columns of electrodes in a vertical vs. horizontal discrimination task, (3) motion discrimination for sequential stimulation of electrodes, (4) and subjective reporting of the apparent size of percepts. Three additional patients were implanted at a later date with a similar device (for this device the stimulating electrodes were 100 mm). With these three patients, the researchers conducted more complex visual perception tasks such as letter recognition and orientation discrimination [81]. Data collected on all ten patients using this device are described in Sects. 14.4.1 and 14.5.1.
14.2.2 The Intelligent Retinal Implant System
The Intelligent Retinal Implant System™ has two external components (a Visual Interface and the Pocket Processor), and a subretinally-implanted Retinal Stimulator
276 |
A. Horsager and I. Fine |
Fig. 14.3 Schematic of the Intelligent Retinal Implant System. Illustration kindly provided by IMI
(Fig. 14.3) designed by IMI Intelligent Medical Implants. The Visual Interface consists of a pair of glasses with a camera to capture the visual image and other components for data communication with the Pocket Processor and Retinal Stimulator. Communication with the Retinal Stimulator is conducted via wireless transmission. The Pocket Processor supplies power to the entire system and contains a microcomputer that translates the image data into the stimulation protocol for the Retinal Stimulator. The internal flexible Retinal Stimulator consists of a 49 electrode array and is attached using a silicon ring to a titanium tack which had been placed in the sclera.
Four patients (56–66 years old) with visual acuity ranging from no light perception (NLP) to hand movement were implanted. Approximately 20 different testing sessions were conducted with the patients over a 12 month period. Each testing session consisted of single or multi-electrode pulse train stimulation. In these patients, performance on absolute threshold, point discrimination, and pattern recognition tasks was measured. See Sects. 14.4.2 and 14.5.2 for details regarding psychophysical data collected using this system.
14.2.3 Second Sight Medical Products, Inc. A16 System
The Second Sight Medical Products, Inc. (SSMP) A16 epiretinal prosthesis contains similar intraocular (electrode array) and extraocular (e.g., glasses, Visual Processing Unit) components as the Intelligent Retinal Implant System™. The intraocular array consists of 16 platinum electrodes in a 4 × 4 arrangement, held in
14 The Perceptual Effects of Chronic Retinal Stimulation |
277 |
place within a clear silicone rubber platform [37, 45]. The electrode array is implanted epiretinally in the macular region and held in place using a retinal tack. Electrodes are either 260 or 520 mm in diameter (subtending 0.9° and 1.8° of visual angle, respectively). Electrodes are spaced 800 mm apart, center to center.
Pulse train signals are generated and sent to an external Visual Processing Unit (VPU) using custom software run on a PC laptop. Power and signal information are sent from this processor through a wire to an external transmitter coil that attaches magnetically, and communicates inductively, to a secondary coil that is implanted subdermally in the patient’s temporal skull. From this secondary coil, power and signal information are sent through a subdermally implanted wire that traverses the sclera to the array of electrodes (Fig. 14.4). Stimulation can be presented using two different protocols: (1) camera mode – real-time video captured by a miniature video camera mounted on the subject’s glasses is continuously sampled by the VPU and a monotonic transform determines the stimulation current amplitude in each electrode based on the (normalized) luminance at the corresponding area of the scene and (2) direct stimulation mode – the stimulation signal sent to each electrode is independently controlled by the VPU or an external computer.
Six patients have been examined that were chronically implanted with the A16 retinal prosthesis. See Table 14.1 for details regarding these subjects. Testing sessions lasted a maximum of 4 h with frequent rest periods. Testing sessions included threshold and impedance measurements as well as other measures of visual performance reported elsewhere [77]. When performed, threshold measurements were usually carried out at the beginning of a given testing session. The frequency of testing sessions was limited by the subjects’ availability and the clinical trial protocol. In general, testing was carried out 1–2 sessions/week for each subject. The protocol
Fig. 14.4 (a) Electrode array. The electrode array consisted of 260 or 520 micrometers (mm) electrodes arranged in a checkerboard pattern, with center-to-center separation of 800 mm. The entire array covered ~2.9 mm by 2.9 mm of retinal space, subtending ~10° of visual angle. (b) Prosthesis system schematic. The stimulus sets are programmed using Matlab® on a PC, which then communicated the stimulus parameters to an external Visual Processing Unit (not shown). Signal and power information was then passed through an external inductive coupling device (not shown) that attaches magnetically to a subdermal coil implanted in the patient’s temporal skull. This signal is then sent through a parallel system of wires to the epiretinally implanted electrode array. Note that the power and signal information can be independently controlled for each electrode. Reprinted from [33], with permission
