- •Contents
- •1.1. Introduction to the Eye
- •1.2. The Anatomy of the Human Visual System
- •1.3. Neurons
- •1.4. Synapses
- •1.5. Vision — Sensory Transduction
- •1.6. Retinal Processing
- •1.7. Visual Processing in the Brain
- •1.8. Biological Vision and Computer Vision Algorithms
- •References
- •2.1. Introduction to Computational Methods for Feature Detection
- •2.2. Preprocessing Methods for Retinal Images
- •2.2.1. Illumination Effect Reduction
- •2.2.1.1. Non-linear brightness transform
- •2.2.2. Image Normalization and Enhancement
- •2.2.2.1. Color channel transformations
- •2.2.2.3. Local adaptive contrast enhancement
- •2.2.2.4. Histogram transformations
- •2.3. Segmentation Methods for Retinal Anatomy Detection and Localization
- •2.3.1. A Boundary Detection Methods
- •2.3.1.1. First-order difference operators
- •2.3.1.2. Second-order boundary detection
- •2.3.1.3. Canny edge detection
- •2.3.2. Edge Linkage Methods for Boundary Detection
- •2.3.2.1. Local neighborhood gradient thresholding
- •2.3.2.2. Morphological operations for edge link enhancement
- •2.3.2.3. Hough transform for edge linking
- •2.3.3. Thresholding for Image Segmentation
- •2.3.3.1. Segmentation with a single threshold
- •2.3.3.2. Multi-level thresholding
- •2.3.3.3. Windowed thresholding
- •2.3.4. Region-Based Methods for Image Segmentation
- •2.3.4.1. Region growing
- •2.3.4.2. Watershed segmentation
- •2.4.1. Statistical Features
- •2.4.1.1. Geometric descriptors
- •2.4.1.2. Texture features
- •2.4.1.3. Invariant moments
- •2.4.2. Data Transformations
- •2.4.2.1. Fourier descriptors
- •2.4.2.2. Principal component analysis (PCA)
- •2.4.3. Multiscale Features
- •2.4.3.1. Wavelet transform
- •2.4.3.2. Scale-space methods for feature extraction
- •2.5. Summary
- •References
- •3.1.1. EBM Process
- •3.1.2. Evidence-Based Medical Issues
- •3.1.3. Value-Based Evidence
- •3.2.1. Economic Evaluation
- •3.2.2. Decision Analysis Method
- •3.2.3. Advantages of Decision Analysis
- •3.2.4. Perspective in Decision Analysis
- •3.2.5. Decision Tree in Decision Analysis
- •3.3. Use of Information Technologies for Diagnosis in Ophthalmology
- •3.3.1. Data Mining in Ophthalmology
- •3.3.2. Graphical User Interface
- •3.4. Role of Computational System in Curing Disease of an Eye
- •3.4.1. Computational Decision Support System: Diabetic Retinopathy
- •3.4.1.1. Wavelet-based neural network23
- •3.4.1.2. Content-based image retrieval
- •3.4.2. Computational Decision Support System: Cataracts
- •3.4.2.2. K nearest neighbors
- •3.4.2.3. GUI of the system
- •3.4.3. Computational Decision Support System: Glaucoma
- •3.4.3.1. Using fuzzy logic
- •3.4.4. Computational Decision Support System: Blepharitis, Rosacea, Sjögren, and Dry Eyes
- •3.4.4.1. Utility of bleb imaging with anterior segment OCT in clinical decision making
- •3.4.4.2. Computational decision support system: RD
- •3.4.4.3. Role of computational system
- •3.4.5. Computational Decision Support System: Amblyopia
- •3.4.5.1. Role of computational decision support system in amblyopia
- •3.5. Conclusion
- •References
- •4.1. Introduction to Oxygen in the Retina
- •4.1.1. Microelectrode Methods
- •4.1.2. Phosphorescence Dye Method
- •4.1.3. Spectrographic Method
- •4.1.6. HSI Method
- •4.2. Experiment One
- •4.2.1. Methods and Materials
- •4.2.1.1. Animals
- •4.2.1.2. Systemic oxygen saturation
- •4.2.1.3. Intraocular pressure
- •4.2.1.4. Fundus camera
- •4.2.1.5. Hyperspectral imaging
- •4.2.1.6. Extraction of spectral curves
- •4.2.1.7. Mapping relative oxygen saturation
- •4.2.1.8. Relative saturation indices (RSIs)
- •4.2.2. Results
- •4.2.2.1. Spectral signatures
- •4.2.2.2. Oxygen breathing
- •4.2.2.3. Intraocular pressure
- •4.2.2.4. Responses to oxygen breathing
- •4.2.2.5. Responses to high IOP
- •4.2.3. Discussion
- •4.2.3.1. Pure oxygen breathing experiment
- •4.2.3.2. IOP perturbation experiment
- •4.2.3.3. Hyperspectral imaging
- •4.3. Experiment Two
- •4.3.1. Methods and Materials
- •4.3.1.1. Animals, anesthesia, blood pressure, and IOP perturbation
- •4.3.1.3. Spectral determinant of percentage oxygen saturation
- •4.3.1.5. Preparation and calibration of red blood cell suspensions
- •4.3.2. Results
- •4.3.2.2. Oxygen saturation of the ONH
- •4.3.3. Discussion
- •4.3.4. Conclusions
- •4.4. Experiment Three
- •4.4.1. Methods and Materials
- •4.4.1.1. Compliance testing
- •4.4.1.2. Hyperspectral imaging
- •4.4.1.3. Selection of ONH structures
- •4.4.1.4. Statistical methods
- •4.4.2. Results
- •4.4.2.1. Compliance testing
- •4.4.2.2. Blood spectra from ONH structures
- •4.4.2.3. Oxygen saturation of ONH structures
- •4.4.2.4. Oxygen saturation maps
- •4.4.3. Discussion
- •4.5. Experiment Four
- •4.5.1. Methods and Materials
- •4.5.2. Results
- •4.5.3. Discussion
- •4.6. Experiment Five
- •4.6.1. Methods and Materials
- •4.6.1.3. Automatic control point detection
- •4.6.1.4. Fused image optimization
- •4.7. Conclusion
- •References
- •5.1. Introduction to Thermography
- •5.2. Data Acquisition
- •5.3. Methods
- •5.3.1. Snake and GVF
- •5.3.2. Target Tracing Function and Genetic Algorithm
- •5.3.3. Locating Cornea
- •5.4. Results
- •5.5. Discussion
- •5.6. Conclusion
- •References
- •6.1. Introduction to Glaucoma
- •6.1.1. Glaucoma Types
- •6.1.1.1. Primary open-angle glaucoma
- •6.1.1.2. Angle-closure glaucoma
- •6.1.2. Diagnosis of Glaucoma
- •6.2. Materials and Methods
- •6.2.1. c/d Ratio
- •6.2.2. Measuring the Area of Blood Vessels
- •6.2.3. Measuring the ISNT Ratio
- •6.3. Results
- •6.4. Discussion
- •6.5. Conclusion
- •References
- •7.1. Introduction to Temperature Distribution
- •7.3. Mathematical Model
- •7.3.1. The Human Eye
- •7.3.2. The Eye Tumor
- •7.3.3. Governing Equations
- •7.3.4. Boundary Conditions
- •7.4. Material Properties
- •7.5. Numerical Scheme
- •7.5.1. Integro-Differential Equations
- •7.6. Results
- •7.6.1. Numerical Model
- •7.6.2. Case 1
- •7.6.3. Case 2
- •7.6.4. Discussion
- •7.7. Parametric Optimization
- •7.7.1. Analysis of Variance
- •7.7.2. Taguchi Method
- •7.7.3. Discussion
- •7.8. Concluding Remarks
- •References
- •8.1. Introduction to IR Thermography
- •8.2. Infrared Thermography and the Measured OST
- •8.3. The Acquisition of OST
- •8.3.1. Manual Measures
- •8.3.2. Semi-Automated and Fully Automated
- •8.4. Applications to Ocular Studies
- •8.4.1. On Ocular Physiologies
- •8.4.2. On Ocular Diseases and Surgery
- •8.5. Discussion
- •References
- •9.1. Introduction
- •9.1.1. Preprocessing
- •9.1.1.1. Shade correction
- •9.1.1.2. Hough transform
- •9.1.1.3. Top-hat transform
- •9.1.2. Image Segmentation
- •9.1.2.1. The region approach
- •9.1.2.2. The gradient-based method
- •9.1.2.3. Edge detection
- •9.1.2.3.2. The second-order derivative methods
- •9.1.2.3.3. The optimal edge detector
- •9.2. Image Registration
- •9.4. Automated, Integrated Image Analysis Systems
- •9.5. Conclusion
- •References
- •10.1. Introduction to Diabetic Retinopathy
- •10.2. Data Acquisition
- •10.3. Feature Extraction
- •10.3.1. Blood Vessel Detection
- •10.3.2. Exudates Detection
- •10.3.3. Hemorrhages Detection
- •10.3.4. Contrast
- •10.4.1. Backpropagation Algorithm
- •10.5. Results
- •10.6. Discussion
- •10.7. Conclusion
- •References
- •11.1. Related Studies
- •11.2.1. Encryption
- •11.3. Compression Technique
- •11.3.1. Huffman Coding
- •11.4. Error Control Coding
- •11.4.1. Hamming Codes
- •11.4.2. BCH Codes
- •11.4.3. Convolutional Codes
- •11.4.4. RS Codes14
- •11.4.5. Turbo Codes14
- •11.5. Results
- •11.5.1. Using Turbo Codes for Transmission of Retinal Fundus Image
- •11.6. Discussion
- •11.7. Conclusion
- •References
- •12.1. Introduction to Laser-Thermokeratoplasty (LTKP)
- •12.2. Characteristics of LTKP
- •12.3. Pulsed Laser
- •12.4. Continuous-Wave Laser
- •12.5. Mathematical Model
- •12.5.1. Model Description
- •12.5.2. Governing Equations
- •12.5.3. Initial-Boundary Conditions
- •12.6. Numerical Scheme
- •12.6.1. Integro-Differential Equation
- •12.7. Results
- •12.7.1. Pulsed Laser
- •12.7.2. Continuous-Wave Laser
- •12.7.3. Thermal Damage Assessment
- •12.8. Discussion
- •12.9. Concluding Remarks
- •References
- •13.1. Introduction to Optical Eye Modeling
- •13.1.1. Ocular Measurements for Optical Eye Modeling
- •13.1.1.1. Curvature, dimension, thickness, or distance parameters of ocular elements
- •13.1.1.2. Three-dimensional (3D) corneal topography
- •13.1.1.3. Crystalline lens parameters
- •13.1.1.4. Refractive index
- •13.1.1.5. Wavefront aberration
- •13.1.2. Eye Modeling Using Contemporary Optical Design Software
- •13.1.3. Optical Optimization and Merit Function
- •13.2. Personalized and Population-Based Eye Modeling
- •13.2.1. Customized Eye Modeling
- •13.2.1.1. Optimization to the refractive error
- •13.2.1.2. Optimization to the wavefront measurement
- •13.2.1.3. Tolerance analysis
- •13.2.2. Population-Based Eye Modeling
- •13.2.2.1. Accommodative eye modeling
- •13.2.2.2. Ametropic eye modeling
- •13.2.2.3. Modeling with consideration of ocular growth and aging
- •13.2.2.4. Modeling for disease development
- •13.2.3. Validation of Eye Models
- •13.2.3.1. Point spread function and modulation transfer function
- •13.2.3.2. Letter chart simulation
- •13.2.3.3. Night/day vision simulation
- •13.3. Other Modeling Considerations
- •13.3.1. Stiles Crawford Effect (SCE)
- •13.3.1.2. Other retinal properties
- •13.3.1.4. Optical opacity
- •13.4. Examples of Ophthalmic Simulations
- •13.4.1. Simulation of Retinoscopy Measurements with Eye Models
- •13.4.2. Simulation of PR
- •13.5. Conclusion
- •References
- •14.1. Network Infrastructure
- •14.1.1. System Requirements
- •14.1.2. Network Architecture Design
- •14.1.4. GUI Design
- •14.1.5. Performance Evaluation of the Network
- •14.2. Image Analysis
- •14.2.1. Vascular Tree Segmentation
- •14.2.2. Quality Assessment
- •14.2.3. ON Detection
- •14.2.4. Macula Localization
- •14.2.5. Lesion Segmentation
- •14.2.7. Patient Demographics and Statistical Outcomes
- •14.2.8. Disease State Assessment
- •14.2.9. Image QA
- •Acknowledgments
- •References
- •Index
Michael Dessauer and Sumeet Dua
matrix of second-order derivatives of L(x, y; t). For each scale t and location (x, y), we find:
H(x, y, t) = |
|
Lxx(x, y, t) |
Lxy(x, y, t) |
|
(2.66) |
Lxy(x, y, t) |
Lyy(x, y, t) . |
||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
We then use these values to calculate the determinant of the Hessian using
det HL(x, y; t) = LxxLyy − Lxy2 , |
(2.67) |
which can then be searched using a nonmaximal suppression algorithm to find scale-space localized, rotationally invariant features.31 These locations in scale-space represents locations that have “corners,” or large gradients in both x and y directions.
Retinal mosaicing, using the above methods to find location and scale, extracts a feature vector of binned gradients from the 2D Haar wavelet responses that are then used to match images for registration (Fig. 2.28).32 Scale space provides a unique multi-level view of images, which exploit scale-specific features.
2.5. Summary
We have presented many of the most popular methods of retinal image preprocessing, segmentation/localization, and feature extraction for automated clinical decision support. Methods that are more complex have been introduced and can provide further guidance of how advanced methods, such as steerable filters,33 active contours,34 and neural networks,35 are constructed. A retinal image classification algorithm can be assessed and observed as a series of steps consisting of many of the methods described in this chapter. It is important for the researcher/scientist to attempt multiple methods at each stage in the algorithm to best assess how the method affects the overall performance of the algorithm. Although the ultimate goal of a fully automated decision support system for retinal pathology detection has not been fully realized, there continue to be great strides toward reaching this challenge through computational methods.
84
Computational Methods for Feature Detection in Optical Images
References
1.Winder, R.J., Morrow, P.J., McRitchie, I.N., Bailie, J.R., and Hart, P.M. Algorithms for digital image processing in diabetic retinopathy. Comput Med Imaging Graph 33:608– 622, 2009.
2.Frame, A.J., Undrill, P.E., Cree, M.J., Olson, J.A., McHardy, K.C., Sharp, P.F., and Forrester, J.V. A comparison of computer based classification methods applied to the detection of microaneurysms in ophthalmic fluorescein angiograms. Comput Biol Med 28:225–238, 1998.
3.Joshi, G.D. and Sivaswamy, J. Colour retinal image enhancement based on domain knowledge. ICVGIP’08: Proceedings of the 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing. Washington, DC, USA: IEEE Computer Society,
pp.591–598, 2008.
4.Hoover, A. and Goldbaum, M. Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels. IEEE Trans Med Imaging 22:951–958, 2003.
5.Wang, H., Hsu, W., Goh, K.G., and Lee, M.L. An effective approach to detect lesions in color retinal images. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit,
pp.1–6, 2000.
6.Spencer, T., Olson, J.A., McHardy, K.C., Sharp, P.F., and Forrester, J.V. An imageprocessing strategy for the segmentation and quantification of microaneurysms in fluorescein angiograms of the ocular fundus. Comp Biomed Res 29:284–302, 1996.
7.Foracchia, M., Grisan, E., and Ruggeri, A. Luminosity and contrast normalization in retinal images. Med Image Anal 9:179–190, 2005.
8.Gonzalez, R.C. and Woods, R.E. Digital Image Processing, Prentice Hall, 2002.
9.Sinthanayothin, C., Boyce, J.F., Cook, H.L., and Williamson, T.H. Automated localization of the optic disc, fovea, and retinal blood vessels from digital color fundus images. Br J Ophthalmol 83:902–910, 1999.
10.Shapiro, L.G. and Stockman, G.C. Computer Vision, pp. 137–150, Prentice Hall, 2001.
11.Newsom, R.S.B., Sinthanayothin, C., and Boyce, J. Contrast enhancement for oral fluorescein angiograms. BJOP 1:29–32, 1998.
12.Goatman, K.A., Whitwam, A.D., Manivannan, A., Olson, J.A., and Sharp, P.F. Color normalization of retinal images. Proceedings Medical Image Understanding and Analysis, pp. 49–52, 2003.
13.Rapantzikos, K. Detection and segmentation of drusen deposits on human retina: potential in the diagnosis of age-related macular degeneration. Med Image Anal 7:95–108, 2003.
14.Yulong, M. and Dingru, X. Recognizing the glaucoma from ocular fundus image by image analysts. Engineering in Medicine and Biology Society, Proceedings of the Twelfth Annual International Conference of the IEEE, pp. 178–179, 1990.
15.Gregson, P., Shen, Z., Scott, R., Kozousek, V. Automated grading of venous beading.
Comput Biomed Res 28:291–304, 1995.
16.Spencer, T., Olson, J.A., McHardy, K.C., Sharp, P.F., and Forrester, J.V. An imageprocessing strategy for the segmentation and quantification of microaneurysms in fluorescein angiograms of the ocular fundus. Comp Biomed Res 29:284–302, 1996.
85
Michael Dessauer and Sumeet Dua
17.Pinz, A., Bernogger, S., Datlinger, P., and Kruger, A. Mapping the human retina. IEEE Trans Med Imag 17:606–619, 2002.
18.Yulong, M. and Dingru, X. Recognizing the glaucoma from ocular fundus image by image analysts. Engineering in Medicine and Biology Society Proceedings of the Twelfth Annual International Conference of the IEEE pp. 178–179, 1990.
19.Sinthanayothin, C., Boyce, J.F., Williamson, T.H., Cook, H.L., Mensah, E., Lal, S., and Usher, D. Automated detection of diabetic retinopathy on digital fundus images. Diabetic Med 19:105–112, 2002.
20.Meyer, F. Topographic distance and watershed lines. Signal Processing 38:113–125, 1994.
21.Walter, T. and Klein, J.-C. Segmentation of color fundus images of the human retina: detection of the optic disc and the vascular tree using morphological techniques. Medical Data Analysis. Crespo, J., Maojo,V., and Martin, F. (Ed.), Lecture Notes in Computer Science 2199:282–287, 2001.
22.Chaudhuri, S., Chatterjee, S., Katz, N., Nelson, M., and Goldbaum, M. Detection of blood vessels in retinal images using two-dimensional matched filters. IEEE Trans Med Imag 8:263–269, 1989.
23.Hipwell, J.H., Strachan, F., Olson, J.A., McHardy, K.C., Sharp, P.F., and Forrester, J.V. Automated detection of microaneurysms in digital red-free photographs: a diabetic retinopathy screening tool. Diabetic Med 17:588–594, 2000.
24.Haralick, R.M., Shanmugan, K., and Dinstein, I. Textural features for image classification. IEEE Trans Syst Man Cybern SMC-3:610–621, 1973.
25.Hu, M.K. Visual pattern recognition by moment invariants. IRE Trans Info Theory IT-8:179–187, 1962.
26.Cooley, J.W. and Tukey, J.W. An algorithm for the machine computation of the complex Fourier series. Math Comput 19:297–301, 1965.
27.Tan, W., Wang, Y., and Lee, S. Retinal blood vessel detection using frequency analysis and local-mean-interpolation filters. Proceedings of SPIE Med Imaging: Image Processing 4322:1373–1384, 2001.
28.Pearson, K. On lines and planes of closest fit to systems of points in space. Philosophical Magazine 2(6):559–572, 1901.
29.Mallat, S. A Wavelet Tour of Signal Processing, Academic Press, New York, 1999.
30.Lalonde, M., Beaulieu, M., and Gagnon, L. Fast and robust optic disc detection using pyramidal decomposition and Hausdorff-based template matching. IEEE Trans Med Imag 20:1193–1200, 2001.
31.Bay, H., Ess, A., Tuytelaars, T., and Vangool, L. Speeded-up robust features (SURF).
Computer Vision and Image Understanding 110:346–359, 2008.
32.Cattin, P., Bay, H., Van Gool, L., and Székely, G. Retina mosaicing using local features. Medical Image Computing and Computer-Assisted Intervention — MICCAI 2006. Larsen, R., Nielsen, M., and Sporring, J. (Ed.), Lecture Notes in Computer Science 4191:185–192, 2006.
33.Kochner, B., Schuhmann, D., Michaelis, M., Mann, G., and Englmeier, K.-H. Course tracking and contour extraction of retinal vessels from color fundus photographs: most efficient use of steerable filters for model-based image analysis. Society of
86
Computational Methods for Feature Detection in Optical Images
Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Hanson, K.M. (Ed.), pp. 755–761, 1998.
34.Saradhi, G.V., Balasubramanian, S., and Chandrasekaran, V. Performance enhancement of optic disc boundary detection using active contours via improved homogenization of optic disc region. International Conference on Information and Automation pp. 264– 269, 2006.
35.Gardner, G., Keating, D., Williamson, T.H., and Ell, A.T. Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool. Br J Ophthalmol 80:940–944, 1996.
87
This page intentionally left blank
Chapter 3
Computational Decision
Support Systems and Diagnostic
Tools in Ophthalmology:
A Schematic Survey
Sumeet Dua and Mohit Jain
Computer decision support systems are computer applications that can help clinicians make diagnostic decisions for patient treatment. Computer decision support systems provide easy access to patient file repositories. By accessing the data from the computational system, clinicians can decide whether to opt for surgery, therapy, or another form of treatment. Moreover, the system can alert clinicians to new patterns in patient data. Because of these benefits, a computer decision support system can save a clinician’s time and can be more effective than the clinician can in making treatment decisions. Designing a computational system is not easy because the software and hardware infrastructure requirements are complicated and may negatively affect the computer’s user friendliness. Additionally, training clinicians for this computational system can be costly. Despite these difficulties, the benefit and convenience that this system provides surpasses those offered by the old methods. This automatic and interactive system can help clinicians make better clinical decisions, which will help them to treat patients more effectively by helping clinicians avoid risks.
Department of Computer Science, College of Engineering and Science, Louisiana Tech University, Ruston, LA, U.S.A.
89
