- •Visual Prosthetics
- •Preface
- •Acknowledgments
- •Contents
- •Contributors
- •1.1 The Visual System as an Engineering Compromise
- •1.2 An Overview of Human Visual System Architecture
- •1.2.1 Architecture and Basic Function of the Eye
- •1.2.2 Layout of the Retino-Cortical Pathway
- •1.2.3 Layout of the Subcortical Pathways
- •1.3 An Overview of Human Visual Function
- •1.3.1 Roles of Central (Foveal) Vision
- •1.3.2 Roles of Peripheral Vision
- •1.3.3 Roles of Dark-Adapted Vision
- •1.3.4 A Few Remarks Regarding Visual Development
- •1.4 Prospects for Prosthetic Vision Restoration
- •References
- •2.1 Introduction
- •2.2 Retina
- •2.2.1 Anatomy
- •2.2.2 Physiology and Receptive Fields
- •2.4.1 Anatomy
- •2.4.2 Physiology and Receptive Fields
- •2.6 The Role of Spatiotemporal Edges in Early Vision
- •2.7 The Role of Corners in Early Vision
- •2.7.1 Overview
- •2.8 Effects of Fixational Eye Movements in Early Visual Physiology and Perception
- •2.8.1 Overview
- •2.8.2 Neural Adaptation and Visual Fading
- •2.8.3 Microsaccades in Visual Physiology and Perception
- •References
- •3.1 Introduction
- •3.2 Background
- •3.3 Retinal Disease and Its Diversity
- •3.4 Retinal Remodeling
- •3.5 Retinal Circuitry
- •3.6 Retinal Circuitry Revision
- •3.7 Implications for Bionic Rescue
- •3.8 Implications for Biological Rescue
- •3.9 Final Remarks
- •References
- •4.1 Introduction
- •4.4 What Are the Limits to This Cortical Plasticity?
- •4.5 Possible Mechanisms Behind Brain Plasticity
- •4.6 Modulation of Brain Plasticity: Recent Developments
- •4.7 Neuroplasticity and Other Neuroprostheses Efforts
- •4.8 A Look at What Is Ahead
- •References
- •5.1 Introduction
- •5.2 Vision Changes Experienced by RP Patients
- •5.2.1 Overview
- •5.2.2 Visual Field Loss in RP
- •5.2.3 Changes in Color Vision and Glare Sensitivity in RP
- •5.2.4 Vision Fluctuations in RP
- •5.3 Visual Changes in Patients with Advanced Macular Degeneration
- •5.3.1 Changes Due to Wet AMD or Choroidal Neovascularization
- •5.3.2 Changes Due to Dry AMD or Geographic Atrophy
- •5.4 Charles Bonnet Syndrome
- •5.4.1 Overview
- •5.4.2 Complexity of Visual Hallucinations in CBS
- •5.4.3 Predictors and Alleviating Factors for CBS
- •5.5 Filling-In Phenomena (Perceptual Completion)
- •5.6 Remapping of Primary Visual Cortex in Patients with Central Scotomas from Macular Disease
- •5.7 The Preferred Retinal Locus for Fixation
- •5.8 Photopsias
- •5.8.1 Photopsias in RP
- •5.8.2 Photopsias in AMD and Other Ocular Diseases
- •5.9 Concluding Remarks
- •References
- •6.1 Introduction
- •6.2 Electrode–Electrolyte Interface
- •6.3 Electrode Material
- •6.3.1 Electrode Characterization
- •6.4 Overview of Electrode Materials for Neural Stimulation
- •6.5 Overview of Extracellular Stimulation
- •6.6 Safe Stimulation of Tissue
- •6.6.1 Mechanisms of Neural Injury
- •6.6.2 Parameters for Safe Stimulation
- •6.6.3 Stimulation Induced Injury in the Retina
- •References
- •7.1 Introduction
- •7.2 Power and Data Transmission
- •7.2.1 Wireline Connection
- •7.2.2 Inductive Coils
- •7.2.3 Serial Optical Telemetry
- •7.2.4 Photodiode Array-Based Prostheses
- •7.2.5 Thermal Safety Considerations
- •7.2.6 Conclusions: Comparing the Different Approaches
- •7.3 Tissue Response to a Subretinal Implant
- •7.3.1 Flat Implants
- •7.3.2 Chamber Implants
- •7.3.3 Pillar Arrays
- •7.4 Damage to Retinal Tissue from Electrical Stimulation
- •7.4.1 Effect of Pulse Duration
- •7.4.2 Electrode Size
- •7.5 Concluding Remarks
- •References
- •8.1 Introduction
- •8.2 Quasistatic Numerical Methods: The Admittance Method
- •8.2.1 Layered Retinal Model
- •8.2.2 Equivalent Electric Circuit
- •8.3 Three-Dimensional Activation Function Calculation
- •8.4 Safety of Implant
- •8.5 Conclusion
- •References
- •9.1 Pathophysiology of Retinal Degeneration
- •9.2.1 Outer Plexiform Layer
- •9.2.2 Inner Plexiform Layer
- •9.2.2.1 Bipolar Cell Excitation of Retinal Ganglion Cells
- •9.2.2.2 Amacrine Cell Modulation of Signal Processing
- •9.2.2.3 Inhibitory Transmitters
- •9.2.2.4 Acetylcholine and Dopamine
- •9.2.2.5 Neuropeptides
- •9.2.2.6 Putative neurotransmitters for retinal prosthesis
- •9.3 Neurophysiological Changes in Retinal Degeneration
- •9.4 Rationale for a Neurotransmitter-Based Retinal Prosthesis
- •9.4.1 Limitations of Electrical Stimulation
- •9.5 Technical Considerations and Design Approaches
- •9.5.1 Operating Principles for a Neurotransmitter-Based Retinal Prosthesis
- •9.5.2 Establishing a Retinal Prosthesis/Synaptic Interface
- •9.5.2.1 The Proximity Requirement
- •9.5.2.2 Convective Delivery of Neurotransmitters Via Microfluidics
- •9.5.2.3 Functionalized Surfaces for Neurotransmitter Stimulation
- •9.5.2.4 Synaptic Requirements for l-Glutamate Mediated Neuronal Stimulation
- •9.6 Summary
- •References
- •10.1 Introduction
- •10.2 Pioneering Experiments
- •10.2.1 Stimulation with No Chromophores
- •10.2.2 Azo Chromophores
- •10.3 Current Research
- •10.3.1 Caged Neurotransmitters
- •10.3.2 Pore Blocker and Photoisomerization
- •10.3.3 The Channelrhodopsins
- •10.3.4 Melanopsin
- •10.4 Synthetic Chromophores and Artificial Sight
- •References
- •11.1 Background
- •11.2 Physical Structure of Intracortical Electrodes
- •11.3 Charge Injection Using Intracortical Electrodes
- •11.3.1 The Intracortical Electrode as a Transducer
- •11.3.2 Charge Injection Limits
- •11.4 Intracortical Electrode Coatings
- •11.5 Characterization of Intracortical Electrodes
- •11.5.1 Cyclic Voltammetry
- •11.5.2 Electrode Stimulation Voltage Waveforms
- •11.5.3 Non-ideal Access Resistance Behavior
- •11.5.4 Non-linear Electrode Polarization
- •11.5.5 Determining Electrode Safety
- •11.6 Contrasts of In Vitro and In Vivo Behavior
- •11.7 Alternative Coatings for Improving Intracortical Electrodes
- •11.7.1 SIROF
- •11.7.2 PEDOT
- •11.7.3 Carbon Nanotube Coatings
- •11.8 Conclusion
- •References
- •12.1 Introduction
- •12.2 Responses of RGCs to Electrical Stimulation in Normal Retina
- •12.2.1 Epiretinal Stimulation
- •12.2.1.1 Target of Stimulation
- •12.2.1.2 The Site of Spike Initiation in RGCs
- •12.2.1.3 Threshold vs. Stimulating Electrode Diameter
- •12.2.1.4 Spatial Extent of Activation
- •12.2.1.5 Selective Activation
- •12.2.1.6 Temporal Response Properties
- •12.2.2 Subretinal Stimulation
- •12.2.2.1 Target of Stimulation
- •12.2.2.2 Threshold vs. Polarity of Stimulation Pulse
- •12.2.2.3 Spatial Extent of Activation
- •12.2.2.4 Temporal Response Properties
- •12.2.2.5 Dynamics of the Retinal Response
- •12.4 Responses of RGCs to Electrical Stimulation in Degenerate Retina
- •12.4.1 Epiretinal Stimulation
- •12.4.2 Subretinal Stimulation
- •12.4.2.1 Response Properties of RGCs
- •12.4.2.2 Activation Thresholds of RGCs
- •12.5 Cortical Responses to Retinal Stimulation
- •12.5.1 Spatial Properties Revealed by Cortical Measurements
- •12.5.2 Local Field Potentials
- •12.5.3 Elicited Responses Are Focal
- •12.5.4 Cortical Measurements Reveal Electrode Interactions
- •12.5.5 Temporal Responsiveness in Cortex
- •12.6 Suggestions for Future Studies
- •References
- •13.1 Introduction
- •13.2 General Considerations for Acute Retinal Stimulation Experiments
- •13.3 Surgical Technique
- •13.4 Threshold Measurements
- •13.5 Spatial Resolution and Pattern Perception
- •13.6 Temporal Resolution
- •13.7 Subretinal Versus Epiretinal Stimulation
- •13.8 Less Invasive Stimulation Procedures
- •13.9 Conclusions and Outlook
- •References
- •14.1 Introduction
- •14.2 Overview of Chronic Retinal Implant Technologies
- •14.2.1 The Retinal Implant AG Microphotodiode Prosthesis
- •14.2.2 The Intelligent Retinal Implant System
- •14.2.3 Second Sight Medical Products, Inc. A16 System
- •14.3 Thresholds on Individual Electrodes
- •14.3.1 Single Pulse Thresholds Using the SSMP System
- •14.3.2 Pulse Train Integration and Temporal Sensitivity
- •14.4 Suprathreshold Brightness
- •14.4.1 Brightness Using the Retinal Implant AG System
- •14.4.2 Brightness Using the Intelligent Medical Implant System
- •14.4.3 Brightness Using the SSMP A16 System
- •14.5 Spatial Vision
- •14.5.1 Spatial Vision with the Retinal Implant AG System
- •14.5.2 Spatial Vision with the Intelligent Medical Implant System
- •14.5.3 Spatial Vision with the SSMP A16 System
- •14.6 Models to Guide Electrical Stimulation Protocols
- •14.7 Conclusions
- •References
- •15.1 Background
- •15.2 Cortical Surface Stimulation
- •15.3 Intracortical Microstimulation
- •15.4 Optic Nerve Stimulation
- •15.5 What Is Known and What Needs to Be Done
- •15.6 Current Research Efforts
- •15.6.1 Optic Nerve Stimulation
- •15.6.2 Cortical Surface Stimulation
- •15.6.3 Intracortical Stimulation of Visual Cortex
- •15.6.4 CORTIVIS Program
- •15.6.5 Lateral Geniculate Stimulation
- •15.7 Microelectrode Arrays and Stimulation Hardware
- •15.7.1 Miniature Cameras
- •15.7.2 Animal Models
- •15.7.3 Image Processing and Phosphene Mapping
- •15.8 Conclusion
- •References
- •16.1 Introduction
- •16.2 Simulation Techniques and Basic Parameters
- •16.2.1 Gaze Tracking and Image Stabilization
- •16.2.2 Filter Engine Parameters
- •16.2.2.1 Raster Spatial Properties
- •16.2.2.2 Dot Spatial Properties
- •16.2.2.3 Temporal Properties
- •16.2.2.4 Dynamic Background Noise
- •16.2.2.5 Input Filtering/Windowing, Image Enhancement
- •16.3 Optotype Resolution and Reading
- •16.3.1 Visual Acuity
- •16.3.2 Reading
- •16.4 Face and Object Recognition
- •16.5 Visually Guided Behavior
- •16.5.1 Hand–Eye Coordination
- •16.5.2 Wayfinding
- •16.6 Visual Tracking
- •16.7 Computational Simulations
- •16.8 Conclusion
- •References
- •17.1 Introduction
- •17.2 Situating Image Analysis
- •17.3 The Experimental Framework
- •17.4 Tracking a Low-Resolution Target
- •17.5 Discussion
- •17.6 Conclusion
- •References
- •18.1 Introduction
- •18.2 Representation of Visual Space on the Visual Cortex
- •18.3 Cortical Stimulation Studies
- •18.4 Variability in Occipital Cortex
- •18.5 Phosphene Map Estimation
- •18.6 Psychophysical Studies with the Estimated Maps
- •References
- •19.1 Importance of Mapping
- •19.3 The Computer Era: Refining the Pointing Method of Phosphene Mapping
- •19.4 Verbal Mapping
- •19.5 Mapping Studies Using Subject Drawings
- •19.6 Recent Simulation Studies Using Phosphene Mapping
- •19.6.1 Tactile Simulations at Shanghai Jiao Tong University
- •19.6.2 Simulations in Our Laboratory
- •19.7 Concluding Remarks on Phosphene Mapping Techniques
- •References
- •20.1 Introduction
- •20.2 Principles for Assessment of Prosthetic Vision
- •20.2.1 Experimental Design
- •20.2.2 The Importance of Pre-operative Testing
- •20.2.3 Post-operative Assessment
- •20.2.4.1 Potential Approaches
- •20.2.4.2 Avoidance of Bias
- •20.2.4.3 Criteria for Sound Testing
- •20.2.4.4 Forced Choice Procedures
- •20.2.4.5 Response Time
- •20.2.4.6 Task (Perceptual) Learning
- •20.2.4.7 Establishing Criteria for Meaningful Change
- •20.2.4.8 Light Level
- •20.3 Vision Assessment in Prosthesis Recipients: Overview
- •20.3.1 Visual Function Assessment: Overview
- •20.3.2 Visual Performance Assessment: Overview
- •20.3.2.1 Measured Visual Performance
- •20.3.2.2 Self-Reported Visual Performance
- •20.4 Visual Function Assessment
- •20.4.1 Candidate Measures
- •20.4.1.1 Contrast Sensitivity (Contrast Detection)
- •20.4.1.2 Contrast Discrimination
- •20.4.1.3 Motion Perception
- •20.4.1.4 Depth Perception
- •20.4.2 Tests Used in Prosthesis Trials
- •20.4.3 Tests that Have Been Designed for Use with Prostheses
- •20.4.4 Vision Tests for Very Low Vision
- •20.5 Visual Performance Assessment
- •20.5.1 Measured Performance
- •20.5.2 Self-Reported Performance (Questionnaires)
- •20.6 Summary
- •References
- •21.1 Concepts of Functional Vision and Rehabilitation
- •21.1.1 Application to Orientation and Mobility
- •21.1.2 Application for Activities of Daily Living
- •21.1.3 Patient Lifestyle and Expectations
- •21.1.4 Congenital and Adventitious Vision Loss
- •21.2 Evaluation and Intervention with Prosthetic Vision
- •21.2.1 Evaluation
- •21.2.2 Intervention
- •21.3 Measuring Functional Outcomes
- •21.4 The Future
- •References
- •Author Index
- •Subject Index
414 |
D.R. Geruschat and J. Deremeik |
21.1 Concepts of Functional Vision and Rehabilitation
21.1.1 Application to Orientation and Mobility
Ultra-low vision is at the lower end of the clinical visual acuity continuum, which includes light perception, light projection, and form perception; it can have a functional impact on individuals with visual impairments by enhancing or improving their orientation and mobility (O&M) skills. For example, when walking the halls of a residential school for students who are blind it is not uncommon to see two to three totally blind students holding the arm of and following behind the one student who has form perception. The lead student, using form perception, can see the lights in the ceiling and visually trails the lights to maintain a straight line of travel down the corridor. Another utility of ultra-low vision is demonstrated by the fully sighted person who wakes in a hotel room in the night and uses the moonlight shining through a gap in the curtain or the ambient light from the alarm clock to orient himself and locate the entry to the bathroom without turning on a light that might disturb his spouse.
The ability of a person with ultra-low vision to visually detect contrast can enhance her awareness of her location in a room. The left panel of Fig. 21.1 shows a white door in a white room (low contrast); the right panel shows the same door but with a dark-colored robe on the door’s hook (high contrast), which makes the door easier to identify visually. In this example, a simple environmental feature (the placement of a robe) can enhance movement through the room for a person with ultra-low vision. The benefits afforded by the ability to perceive light or see contrasting colors illustrates why we believe that prosthetic vision can be useful for orientation and mobility (O&M).
Fig. 21.1 Effect of contrast on visibility: a dark robe on a light door
21 Activities of Daily Living and Rehabilitation with Prosthetic Vision |
415 |
Although there are a variety of technological approaches to providing an individual with prosthetic vision, when the technology allows the individual to reverse contrast, this feature may enhance the individual’s ability to detect objects and the like. Many patients who utilize a closed circuit television (CCTV), for example, prefer to do so by making the letters white and the background black (that is, by reversing the contrast of the monitor). This technique could be applied to mobility, for finding a doorway out of a well-lit room, if the individual using prosthetic vision reversed contrast to show a bright door opening in a dark wall.
The foregoing examples described potential enhancements to orientation with no descriptions of benefits to mobility, because the current prosthetic vision technology is not sufficient to replace or eliminate the need for a long cane or a guide dog for independent travel in unfamiliar environments. The point is that ultra-low vision can have a positive impact on functional orientation but not on mobility in novel environments.
Today’s prosthetic vision may be potentially safe enough for an individual to use it as their primary source of mobility information (no cane or guide dog) indoors in a controlled and familiar space or when locating furniture or objects with high contrast. A “controlled space” is an indoor environment in which changes in elevation (stairs) are not present or their location is known, and in which furniture and other room elements maintain the same location over time. Travel in unknown and/or complex environments (crossing the street or walking in a shopping mall) requires the use of a long cane or guide dog. In such a situation, prosthetic vision can be used as a supplementary source of information to enhance the individual’s orientation while other sensory information (audition, tactual) is combined with primary sources of information for mobility: the long cane or guide dog.
21.1.2 Application for Activities of Daily Living
Because prosthetic vision provides very low levels of visual acuity, activities of daily living (ADLs) that require detailed vision (sewing, reading, or the recognition of facial features) are not envisioned as being amenable to prosthetic visual rehabilitation until the level of resolution the technology provides has been substantially improved. The opportunity presented by the current technology, which allows users to perceive high contrast can be of benefit with a variety of ADLs, including personal care and personal management. For example, in the area of personal care, the ability to identify toothpaste on a toothbrush might be accomplished with the use of high contrast (green toothpaste on a white-bristled toothbrush). Visually locating soap or a shampoo bottle in a bathtub may be possible with high contrast. The ability to apply lipstick may be enhanced with ultra-low vision. The ability to visually sort darkand light-colored socks, to identify a white shirt from a dark-colored shirt may be possible with prosthetic vision. The use of contrasting colors in the kitchen could prove to be beneficial for people with prosthetic vision, who may be able to
416 |
D.R. Geruschat and J. Deremeik |
Fig. 21.2 Effect of contrast on visibility: a dark placemat and a light dish
differentiate milk from juice or mayonnaise from ketchup in the refrigerator. The use of high contrast between a dark placemat and a light-colored dish can enhance a client’s ability to locate the dish, as illustrated in Fig. 21.2.
21.1.3 Patient Lifestyle and Expectations
Early chapters of this book concentrated on the visual system to the exclusion of personal history. As rehabilitation specialists, we think of vision in the context of the person, their history, lifestyle, expectations, and acknowledge that these personal elements influence the way vision is used. Consider two patients who have the same clinical vision status (visual acuity, contrast sensitivity, visual field); one patient uses a cane and minimizes the use of their remaining vision, and the other travels without a cane, and utilizes optical equipment to read street signs and view traffic lights. Individuals who maximize the use of their remaining vision (light perception) prior to implant tend to have the best prognosis for integrating prosthetic vision into their lifestyle and to experience more benefits after implantation.
The management of patient expectations is a key element to successful functional outcomes with prosthetic vision and must be considered part of the rehabilitation process. Patients want to know how their life will change or improve with prosthetic vision. Will prosthetic vision resolve their functional problems? Research on the most common functional problems in mobility clearly shows that managing illumination (light adaptation, low-light environments), detecting changes in elevation such as drop-offs (curbs, stairs), and crossing the street are three of the most common problems for patients with low vision [4]. Our experience with prosthetic vision suggests that these leading low vision mobility
21 Activities of Daily Living and Rehabilitation with Prosthetic Vision |
417 |
problems may not be addressed by the current technologies. The implant wearers we have seen at the time this chapter is being written are, in the context of O&M, quite similar. They are all independent travelers who use some combination of long cane, guide dog, and/or remaining vision. They travel in familiar and unfamiliar areas, ride public transportation, and do not report a serious limitation to their independent travel because of the loss of vision. Because the prosthetic vision systems we have worked with provide ultra-low vision, we have not identified anyone for whom prosthetic vision has been sufficient to replace the long cane or the guide dog when walking in unfamiliar areas. Until the technology improves visual acuity and visual field, prosthetic vision is viewed as an additional travel aid, an enhancement to travel, specifically orientation, rather than a substitution system that would supplant the primary travel aid. Therefore, specialized instruction from properly trained rehabilitation professionals will benefit a prosthetic vision program.
21.1.4 Congenital and Adventitious Vision Loss
We assume there is an interest in offering prosthetic vision to those with congenital blindness. There is a significant difference between the visual abilities and the psychological adjustment process of someone with adventitious vision loss who has had his sight restored (cataract extraction, corneal transplant) and an adult with congenital vision loss who has been provided sight for the first time as an adult. Personal accounts such as the experience of Mike May, described in the book Crashing Through [7], show that clearing the optical pathway does not result in an immediate improvement in functional vision for someone who is congenitally blind. In fact, the more common experience involves a sense of being overwhelmed and confused [6]. It is important to recognize that an individual who has lived as a blind person does not suddenly benefit from visual input. If the patient has a congenital vision loss, a significant period of adaptation, learning to interpret this novel sensory input and time to develop a visual memory, will be required. If the patient lost vision later in life, the age when it was lost, their ability to use low levels of vision as their vision gradually decreased, the primary learning modality for gathering information from the environment (visual, tactual, auditory), and the amount of remaining visual memory are a few of the issues to consider before implantation. These issues may also become a part of the screening and selection process for those who will participate in any type of prosthetic vision rehabilitation program because different strategies may be needed when providing rehabilitation training to these individuals.
Another often repeated description from those who gained sight as adults involves the amount of effort required to process visual input. Mike May describes the need to close his eyes to process information and to feel calm [7]. As revealed in May’s experiences, there are unknown challenges that await the patient who gains sight after leading the life of someone who is congenitally blind.
