- •Contents
- •1.1. Introduction to the Eye
- •1.2. The Anatomy of the Human Visual System
- •1.3. Neurons
- •1.4. Synapses
- •1.5. Vision — Sensory Transduction
- •1.6. Retinal Processing
- •1.7. Visual Processing in the Brain
- •1.8. Biological Vision and Computer Vision Algorithms
- •References
- •2.1. Introduction to Computational Methods for Feature Detection
- •2.2. Preprocessing Methods for Retinal Images
- •2.2.1. Illumination Effect Reduction
- •2.2.1.1. Non-linear brightness transform
- •2.2.2. Image Normalization and Enhancement
- •2.2.2.1. Color channel transformations
- •2.2.2.3. Local adaptive contrast enhancement
- •2.2.2.4. Histogram transformations
- •2.3. Segmentation Methods for Retinal Anatomy Detection and Localization
- •2.3.1. A Boundary Detection Methods
- •2.3.1.1. First-order difference operators
- •2.3.1.2. Second-order boundary detection
- •2.3.1.3. Canny edge detection
- •2.3.2. Edge Linkage Methods for Boundary Detection
- •2.3.2.1. Local neighborhood gradient thresholding
- •2.3.2.2. Morphological operations for edge link enhancement
- •2.3.2.3. Hough transform for edge linking
- •2.3.3. Thresholding for Image Segmentation
- •2.3.3.1. Segmentation with a single threshold
- •2.3.3.2. Multi-level thresholding
- •2.3.3.3. Windowed thresholding
- •2.3.4. Region-Based Methods for Image Segmentation
- •2.3.4.1. Region growing
- •2.3.4.2. Watershed segmentation
- •2.4.1. Statistical Features
- •2.4.1.1. Geometric descriptors
- •2.4.1.2. Texture features
- •2.4.1.3. Invariant moments
- •2.4.2. Data Transformations
- •2.4.2.1. Fourier descriptors
- •2.4.2.2. Principal component analysis (PCA)
- •2.4.3. Multiscale Features
- •2.4.3.1. Wavelet transform
- •2.4.3.2. Scale-space methods for feature extraction
- •2.5. Summary
- •References
- •3.1.1. EBM Process
- •3.1.2. Evidence-Based Medical Issues
- •3.1.3. Value-Based Evidence
- •3.2.1. Economic Evaluation
- •3.2.2. Decision Analysis Method
- •3.2.3. Advantages of Decision Analysis
- •3.2.4. Perspective in Decision Analysis
- •3.2.5. Decision Tree in Decision Analysis
- •3.3. Use of Information Technologies for Diagnosis in Ophthalmology
- •3.3.1. Data Mining in Ophthalmology
- •3.3.2. Graphical User Interface
- •3.4. Role of Computational System in Curing Disease of an Eye
- •3.4.1. Computational Decision Support System: Diabetic Retinopathy
- •3.4.1.1. Wavelet-based neural network23
- •3.4.1.2. Content-based image retrieval
- •3.4.2. Computational Decision Support System: Cataracts
- •3.4.2.2. K nearest neighbors
- •3.4.2.3. GUI of the system
- •3.4.3. Computational Decision Support System: Glaucoma
- •3.4.3.1. Using fuzzy logic
- •3.4.4. Computational Decision Support System: Blepharitis, Rosacea, Sjögren, and Dry Eyes
- •3.4.4.1. Utility of bleb imaging with anterior segment OCT in clinical decision making
- •3.4.4.2. Computational decision support system: RD
- •3.4.4.3. Role of computational system
- •3.4.5. Computational Decision Support System: Amblyopia
- •3.4.5.1. Role of computational decision support system in amblyopia
- •3.5. Conclusion
- •References
- •4.1. Introduction to Oxygen in the Retina
- •4.1.1. Microelectrode Methods
- •4.1.2. Phosphorescence Dye Method
- •4.1.3. Spectrographic Method
- •4.1.6. HSI Method
- •4.2. Experiment One
- •4.2.1. Methods and Materials
- •4.2.1.1. Animals
- •4.2.1.2. Systemic oxygen saturation
- •4.2.1.3. Intraocular pressure
- •4.2.1.4. Fundus camera
- •4.2.1.5. Hyperspectral imaging
- •4.2.1.6. Extraction of spectral curves
- •4.2.1.7. Mapping relative oxygen saturation
- •4.2.1.8. Relative saturation indices (RSIs)
- •4.2.2. Results
- •4.2.2.1. Spectral signatures
- •4.2.2.2. Oxygen breathing
- •4.2.2.3. Intraocular pressure
- •4.2.2.4. Responses to oxygen breathing
- •4.2.2.5. Responses to high IOP
- •4.2.3. Discussion
- •4.2.3.1. Pure oxygen breathing experiment
- •4.2.3.2. IOP perturbation experiment
- •4.2.3.3. Hyperspectral imaging
- •4.3. Experiment Two
- •4.3.1. Methods and Materials
- •4.3.1.1. Animals, anesthesia, blood pressure, and IOP perturbation
- •4.3.1.3. Spectral determinant of percentage oxygen saturation
- •4.3.1.5. Preparation and calibration of red blood cell suspensions
- •4.3.2. Results
- •4.3.2.2. Oxygen saturation of the ONH
- •4.3.3. Discussion
- •4.3.4. Conclusions
- •4.4. Experiment Three
- •4.4.1. Methods and Materials
- •4.4.1.1. Compliance testing
- •4.4.1.2. Hyperspectral imaging
- •4.4.1.3. Selection of ONH structures
- •4.4.1.4. Statistical methods
- •4.4.2. Results
- •4.4.2.1. Compliance testing
- •4.4.2.2. Blood spectra from ONH structures
- •4.4.2.3. Oxygen saturation of ONH structures
- •4.4.2.4. Oxygen saturation maps
- •4.4.3. Discussion
- •4.5. Experiment Four
- •4.5.1. Methods and Materials
- •4.5.2. Results
- •4.5.3. Discussion
- •4.6. Experiment Five
- •4.6.1. Methods and Materials
- •4.6.1.3. Automatic control point detection
- •4.6.1.4. Fused image optimization
- •4.7. Conclusion
- •References
- •5.1. Introduction to Thermography
- •5.2. Data Acquisition
- •5.3. Methods
- •5.3.1. Snake and GVF
- •5.3.2. Target Tracing Function and Genetic Algorithm
- •5.3.3. Locating Cornea
- •5.4. Results
- •5.5. Discussion
- •5.6. Conclusion
- •References
- •6.1. Introduction to Glaucoma
- •6.1.1. Glaucoma Types
- •6.1.1.1. Primary open-angle glaucoma
- •6.1.1.2. Angle-closure glaucoma
- •6.1.2. Diagnosis of Glaucoma
- •6.2. Materials and Methods
- •6.2.1. c/d Ratio
- •6.2.2. Measuring the Area of Blood Vessels
- •6.2.3. Measuring the ISNT Ratio
- •6.3. Results
- •6.4. Discussion
- •6.5. Conclusion
- •References
- •7.1. Introduction to Temperature Distribution
- •7.3. Mathematical Model
- •7.3.1. The Human Eye
- •7.3.2. The Eye Tumor
- •7.3.3. Governing Equations
- •7.3.4. Boundary Conditions
- •7.4. Material Properties
- •7.5. Numerical Scheme
- •7.5.1. Integro-Differential Equations
- •7.6. Results
- •7.6.1. Numerical Model
- •7.6.2. Case 1
- •7.6.3. Case 2
- •7.6.4. Discussion
- •7.7. Parametric Optimization
- •7.7.1. Analysis of Variance
- •7.7.2. Taguchi Method
- •7.7.3. Discussion
- •7.8. Concluding Remarks
- •References
- •8.1. Introduction to IR Thermography
- •8.2. Infrared Thermography and the Measured OST
- •8.3. The Acquisition of OST
- •8.3.1. Manual Measures
- •8.3.2. Semi-Automated and Fully Automated
- •8.4. Applications to Ocular Studies
- •8.4.1. On Ocular Physiologies
- •8.4.2. On Ocular Diseases and Surgery
- •8.5. Discussion
- •References
- •9.1. Introduction
- •9.1.1. Preprocessing
- •9.1.1.1. Shade correction
- •9.1.1.2. Hough transform
- •9.1.1.3. Top-hat transform
- •9.1.2. Image Segmentation
- •9.1.2.1. The region approach
- •9.1.2.2. The gradient-based method
- •9.1.2.3. Edge detection
- •9.1.2.3.2. The second-order derivative methods
- •9.1.2.3.3. The optimal edge detector
- •9.2. Image Registration
- •9.4. Automated, Integrated Image Analysis Systems
- •9.5. Conclusion
- •References
- •10.1. Introduction to Diabetic Retinopathy
- •10.2. Data Acquisition
- •10.3. Feature Extraction
- •10.3.1. Blood Vessel Detection
- •10.3.2. Exudates Detection
- •10.3.3. Hemorrhages Detection
- •10.3.4. Contrast
- •10.4.1. Backpropagation Algorithm
- •10.5. Results
- •10.6. Discussion
- •10.7. Conclusion
- •References
- •11.1. Related Studies
- •11.2.1. Encryption
- •11.3. Compression Technique
- •11.3.1. Huffman Coding
- •11.4. Error Control Coding
- •11.4.1. Hamming Codes
- •11.4.2. BCH Codes
- •11.4.3. Convolutional Codes
- •11.4.4. RS Codes14
- •11.4.5. Turbo Codes14
- •11.5. Results
- •11.5.1. Using Turbo Codes for Transmission of Retinal Fundus Image
- •11.6. Discussion
- •11.7. Conclusion
- •References
- •12.1. Introduction to Laser-Thermokeratoplasty (LTKP)
- •12.2. Characteristics of LTKP
- •12.3. Pulsed Laser
- •12.4. Continuous-Wave Laser
- •12.5. Mathematical Model
- •12.5.1. Model Description
- •12.5.2. Governing Equations
- •12.5.3. Initial-Boundary Conditions
- •12.6. Numerical Scheme
- •12.6.1. Integro-Differential Equation
- •12.7. Results
- •12.7.1. Pulsed Laser
- •12.7.2. Continuous-Wave Laser
- •12.7.3. Thermal Damage Assessment
- •12.8. Discussion
- •12.9. Concluding Remarks
- •References
- •13.1. Introduction to Optical Eye Modeling
- •13.1.1. Ocular Measurements for Optical Eye Modeling
- •13.1.1.1. Curvature, dimension, thickness, or distance parameters of ocular elements
- •13.1.1.2. Three-dimensional (3D) corneal topography
- •13.1.1.3. Crystalline lens parameters
- •13.1.1.4. Refractive index
- •13.1.1.5. Wavefront aberration
- •13.1.2. Eye Modeling Using Contemporary Optical Design Software
- •13.1.3. Optical Optimization and Merit Function
- •13.2. Personalized and Population-Based Eye Modeling
- •13.2.1. Customized Eye Modeling
- •13.2.1.1. Optimization to the refractive error
- •13.2.1.2. Optimization to the wavefront measurement
- •13.2.1.3. Tolerance analysis
- •13.2.2. Population-Based Eye Modeling
- •13.2.2.1. Accommodative eye modeling
- •13.2.2.2. Ametropic eye modeling
- •13.2.2.3. Modeling with consideration of ocular growth and aging
- •13.2.2.4. Modeling for disease development
- •13.2.3. Validation of Eye Models
- •13.2.3.1. Point spread function and modulation transfer function
- •13.2.3.2. Letter chart simulation
- •13.2.3.3. Night/day vision simulation
- •13.3. Other Modeling Considerations
- •13.3.1. Stiles Crawford Effect (SCE)
- •13.3.1.2. Other retinal properties
- •13.3.1.4. Optical opacity
- •13.4. Examples of Ophthalmic Simulations
- •13.4.1. Simulation of Retinoscopy Measurements with Eye Models
- •13.4.2. Simulation of PR
- •13.5. Conclusion
- •References
- •14.1. Network Infrastructure
- •14.1.1. System Requirements
- •14.1.2. Network Architecture Design
- •14.1.4. GUI Design
- •14.1.5. Performance Evaluation of the Network
- •14.2. Image Analysis
- •14.2.1. Vascular Tree Segmentation
- •14.2.2. Quality Assessment
- •14.2.3. ON Detection
- •14.2.4. Macula Localization
- •14.2.5. Lesion Segmentation
- •14.2.7. Patient Demographics and Statistical Outcomes
- •14.2.8. Disease State Assessment
- •14.2.9. Image QA
- •Acknowledgments
- •References
- •Index
The Biological and Computational Bases of Vision
of feature abstraction from visual stimuli stored in higher cortical areas would make accurate classification of lower visual processing information possible, if the computational machinery of hierarchical Bayesian inference were realized in neuronal circuits.58 The store of prior distributions of abstracted parameters of visual targets could be learned from experience and stored in relatively compact form in memory.
The possibility of hierarchical Bayesian methods being realized in the function of neuronal circuits has been argued convincingly by several authors.55,56,58 Furthermore, the concept of hierarchical processing across levels of the visual system and higher cortical centers suggests a number of testable hypotheses, some of which have been evaluated by fMRI and behavioral experiments.57 Overall, the most compelling conclusion of this line of research is that the brain is apparently using algorithms as sophisticated (and perhaps identical to) the most advanced methods used in current image analysis and computational science. A further exciting aspect is that the brain is likely using methods we have yet to learn that are even more intricate and efficient than the best of our current computational methods.58
In conclusion, the visual system is the best-studied sensory system. It has incredible facility for rapid recognition of objects in the visual field and evocation of appropriate responses. As our understanding of higher processing in the visual system advances, we have great opportunity for learning and profiting from the methods used by the optimized biological image processors that have resulted from eons of natural selection.
References
1.Horridge, G.A. The evolution of visual processing and the construction of seeing systems. Proc R Soc Lond Biol Sic 230:279–292, 1987.
2.Barton, R.A. Binocularity and brain evolution in primates. Proc Natl Acad Sci USA 101(27):10113–10115, 2004.
3.Steering Committee on Science and Creationism, National Academy of Sciences. Science and Creationism: A View from the National Academy of Sciences, Second edition, ISBN: 0-309-53224-8, 48 pages, National Academy Press, Washington, DC, 1999. Free PDF can be downloaded from: http://www.nap.edu/catalog/6024.html.
4.Berson, D.M. Strange vision: ganglion cells as circadian photoreceptors. Trends Neurosci 26:314–320, 2003.
35
Hilary W. Thompson
5.Hattar, S., Liao, H.W., Takao, M., Berson, D.M., and Yau, K.W. Mealnopsin containing retinal ganglion cells: architecture, projections, and intrinsic photosensitivity. Science 295:1065–1070, 2002.
6.DeYoe, E.A. and Van Essen, D.C. Concurrent processing streams in monkey visual cortex. Trends Neurosci 11:219–226, 1988.
7.Van Essen, D.C. and DeYoe, E.A. Concurrent processing in the primate visual cortex. In: Gazzaniga, M.S. (ed.), The Cognitive Neurosciences, pp. 383–400, MIT Press, Cambridge, MA, 1995.
8.Kandel, E.R., Schwartz, J.H., and Jessel, T.M. Principles of Neural Science. Fourth edition, 1414 pp. McGraw-Hill, New York, NY, 2000.
9.Guillery, R.W. Observations of synaptic structures: origins of the neuron doctrine and its current status. Phil Trans R Soc B 360:1281–1307, 2005.
10.Hodgkin, A.L. and Huxley, A.F. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol (Lond) 117:500–544, 1952.
11.Hodgkin, A.L. and Ruston, W.A.H. The electrical constants of a crustacean nerve fibre.
Proc R Soc Lond Biol Sci 133:444–479, 1946.
12.Armstrong, C.M. Voltage-dependent ion channels and their gating. Physiol Rev 72:S5– S13, 1992.
13.Armstrong, C.M. and Hille, B. Voltage-gated ion channels and electrical excitability. Neuron 20:371–380, 1998.
14.Hodgkin, A.L. and Katz, B. The effect of sodium ions on the electrical activity of the giant axon of the squid. J Physiol (Lond) 108:37–77, 1949.
15.Huxley, A.F. and Stampfli, R. Evidence for saltatory conduction in peripheral myelinated nerve fibres. J Physiol 108:315–339, 1949.
16.Furshpan, E.J. and Potter, D.D. Mechanism of nerve-impulse transmission at a crayfish synapse. Nature 180:342–343, 1957.
17.Goodenough, D.A., Goliger, J.A., and Paul, D.L. Connexins, connexons and intracellular communication. Ann Rev Biochem 65:475–502, 1996.
18.Gordon, W.C. and Bazan, N.G. Retina. In: John J. Harding (ed.), Biochemistry of the Eye, Chapman and Hall, London, 1997.
19.Schnapf, J.L. and Baylor, D.A. How photoreceptor cells respond to light. Sci Amer 256:40–47, 1987.
20.Stryer, L. Cyclic GMP cascade of vision. Ann Rev Neurosci 9:87–119, 1986.
21.Hecht, S., Shlaer, S., and Pirenne, M.H. Energy at the threshold of vision. Science 93:585–587, 1941.
22.Kuffler, S.W. Discharge patterns and functional organization of mammalian retina.
J Neurophysiol 16:37–68, 1953.
23.Schiller, P.H., Sanall, J.H., and Maunsell, J.H.R. Functions of the on and off channels of the visual system. Nature 322:824–825, 1986.
24.Schnapf, J.L., Kraft, T.W., and Baylor, D.A. Spectral sensitivity of human cone receptors. Nature 352:439–441, 1987.
25.De Valois, R.L. and De Valois, K.K. A multi-stage color model. Vision Res 33:1053– 1065, 1993.
26.Dacey, D.M. Circuitry for color coding in the primate retina. Proc Natl Acad Sci USA 93:582–588, 1996.
36
The Biological and Computational Bases of Vision
27.Shapley, R. and Perry, V.H. Cat and monkey retinal ganglion cells and their visual functional roles. Trends Neurosci 9:229–235, 1986.
28.Merigan, W.H. and Maunsell, J.H.R. Macaque vision after magnocellular lateral geniculate lesions. Vis Neurosci 5:347–352, 1993.
29.Livingstone, M.S. and Hubel, D.H. Segregation of form, color, movement, and depth: anatomy, physiology, and perception. Science 240:740–749, 1988.
30.Hubel, D.H. and Wiesel, T.N. Receptive fields of single neurons in the cat’s striate cortex. J Physiol (London) 148:574–591, 1959.
31.de Angelis, G.D., Ohzawa, I., and Freeman, R.D. Receptive field dynamics in the central visual pathways. Trends Neurosci 18:451–458, 1995.
32.Kuffler, S.W. and Nichols, J.G. From Neuron to Brain: A Cellular Approach to the Function of the Nervous System, Sinauer Associates, Sunderland, MA, 1976.
33.Michael, C.R. Color vision mechanisms in monkey striate cortex: dual-opponent cells with concentric receptive fields. J Neurophysiol 41:572–588, 1978.
34.Tootel, R.B.H., Silverman, M.S., Switkes, E., and DeValois, R.L. Deoxyglucose analysis of retinotopic organization of the second visual are in primates. Science 220:737– 739, 1982.
35.LeVay, S., Hubel, D.H., and Wiesel, T.N. The pattern of ocular dominance columns in macaque visual cortex revealed by a reduced silver stain. J Comp Neurol 159:559–575, 1975.
36.Horton, J.C. and Adams, D.L. The cortical column: a structure without a function. Phil Trans Biol Sci 360:837–862, 2005.
37.Hubel, D.H. and Wiesel, T.N. Receptive Fields of cells in striate cortex of very young, visually inexperienced kittens. J Neurophysiol 26:994–1002, 1963.
38.Hubel, D.H. and Wiesel, T.N. The period of susceptibility to the physiological effects of unilateral eye closure in kittens. J Physiol 206:419–436, 1970.
39.Shomstein, S. and Behrmann, M. Cortical systems mediating visual attention to both objects and spatial locations. Proc Natl Acad Sci USA 103:11387–11392, 2006.
40.Le Bihan, D., Urayama, S., Aso, T., Hanakawa, T., and Fukuyama, H. Direct and fast detection of neuronal activation in the human brain with diffusion MRI. Proc Natl Acad Sci USA 103:8263–8268, 2006.
41.Gattass, R., Nascimento-Silva, S., Soares, J.G.M., Lima, B., Jansen, A.K., Diogo, A.C.M., Farins, M.F., Marcondes, M., Bothelho, E.P., Mariani, O.S., Azzi, J., and Fiorani, M. Cortical visual areas in monkeys: location, topography, connections, columns, plasticity and cortical dynamics. Philosophical Transactions of the Royal Society (London) B 709–731. Online publication 29 April, 2005.
42.Marr, D. Vision. Freeman and Co., New York, 1982.
43.Roberts, L.G. Machine perception of three-dimensional solids. In: Tippett, J.T., Berkowitz, D.A., Clapp, L.C., et al. (eds.) Optical and Electro-optical Information Processing, MIT Press, Cambridge, MA, 1965.
44.Marr, D. and Hildreth, E.C. Theory of edge detection. Proc R Soc Lond Biol Sci 207:187–217, 1980.
45.Canny, J.F. A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8:769–798, 1986.
46.Deriche, R. Using Canny’s criteria to derive an optimum edge detector recursively implemented. Int J Comput Vis 2:167–187, 1987.
37
Hilary W. Thompson
47.DeValois, R.L. and DeValois, K.K. Spatial Vision, Oxford University Press, New York, 1988.
48.Campbell, F.W. and Robson, J.G. Application of Fourier analysis to the visibility of gratings. J Physiol 197:551–556, 1968.
49.Blakemore, C. and Campbell, F.W. On the existence of neurons in the human visual system selectively sensitivity to the orientation and size of retinal images. J Physiol 203:237–260, 1969.
50.Marcelja, S. Mathematical description of the responses of simple cortical cells. J Opt Soc Am 70:1297–1300, 1980.
51.Jones, J. and Palmer, L. An evaluation of the two-dimensional Gabor filter model of simple receptive in cat striate cortex. J Neurophysiol 58:1233–1258, 1987.
52.Stork, D.G. and Wilson, H.R. Do Gabor functions provide appropriate descriptions of the visual cortical receptive fields? J Opt Soc Am A7:1362–1373, 1990.
53.Field, D.J. Wavelets, vision and the statistics of natural scenes. Philosophical Trans R Soc Lond A 357:2527–2542, 1999.
54.Field, D.J. What is the goal of sensory coding? Neural Comput 6:559–601, 1994.
55.Lee, T.S. and Mumford, D. Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am Opt Image Sci Vis 20:1434–1448, 2003.
56.Friston, K. A theory of cortical responses. Philosophical Trans Biolo Sci 360:815–836, 2005.
57.Kourtze, Z. and DiCarlo, J.J. Learning and neural plasticity in visual object recognition.
Curr Opinion Neurobiol 16:152–158, 2006.
58.Friston, K. Hierarchical models in the brain. PLoS Comput Biol 4:1–24, 2008.
38
