
- •Biological and Medical Physics, Biomedical Engineering
- •Medical Image Processing
- •Preface
- •Contents
- •Contributors
- •1.1 Medical Image Processing
- •1.2 Techniques
- •1.3 Applications
- •1.4 The Contribution of This Book
- •References
- •2.1 Introduction
- •2.2 MATLAB and DIPimage
- •2.2.1 The Basics
- •2.2.2 Interactive Examination of an Image
- •2.2.3 Filtering and Measuring
- •2.2.4 Scripting
- •2.3 Cervical Cancer and the Pap Smear
- •2.4 An Interactive, Partial History of Automated Cervical Cytology
- •2.5 The Future of Automated Cytology
- •2.6 Conclusions
- •References
- •3.1 The Need for Seed-Driven Segmentation
- •3.1.1 Image Analysis and Computer Vision
- •3.1.2 Objects Are Semantically Consistent
- •3.1.3 A Separation of Powers
- •3.1.4 Desirable Properties of Seeded Segmentation Methods
- •3.2 A Review of Segmentation Techniques
- •3.2.1 Pixel Selection
- •3.2.2 Contour Tracking
- •3.2.3 Statistical Methods
- •3.2.4 Continuous Optimization Methods
- •3.2.4.1 Active Contours
- •3.2.4.2 Level Sets
- •3.2.4.3 Geodesic Active Contours
- •3.2.5 Graph-Based Methods
- •3.2.5.1 Graph Cuts
- •3.2.5.2 Random Walkers
- •3.2.5.3 Watershed
- •3.2.6 Generic Models for Segmentation
- •3.2.6.1 Continuous Models
- •3.2.6.2 Hierarchical Models
- •3.2.6.3 Combinations
- •3.3 A Unifying Framework for Discrete Seeded Segmentation
- •3.3.1 Discrete Optimization
- •3.3.2 A Unifying Framework
- •3.3.3 Power Watershed
- •3.4 Globally Optimum Continuous Segmentation Methods
- •3.4.1 Dealing with Noise and Artifacts
- •3.4.2 Globally Optimal Geodesic Active Contour
- •3.4.3 Maximal Continuous Flows and Total Variation
- •3.5 Comparison and Discussion
- •3.6 Conclusion and Future Work
- •References
- •4.1 Introduction
- •4.2 Deformable Models
- •4.2.1 Point-Based Snake
- •4.2.1.1 User Constraint Energy
- •4.2.1.2 Snake Optimization Method
- •4.2.2 Parametric Deformable Models
- •4.2.3 Geometric Deformable Models (Active Contours)
- •4.2.3.1 Curve Evolution
- •4.2.3.2 Level Set Concept
- •4.2.3.3 Geodesic Active Contour
- •4.2.3.4 Chan–Vese Deformable Model
- •4.3 Comparison of Deformable Models
- •4.4 Applications
- •4.4.1 Bone Surface Extraction from Ultrasound
- •4.4.2 Spinal Cord Segmentation
- •4.4.2.1 Spinal Cord Measurements
- •4.4.2.2 Segmentation Using Geodesic Active Contour
- •4.5 Conclusion
- •References
- •5.1 Introduction
- •5.2 Imaging Body Fat
- •5.3 Image Artifacts and Their Impact on Segmentation
- •5.3.1 Partial Volume Effect
- •5.3.2 Intensity Inhomogeneities
- •5.4 Overview of Segmentation Techniques Used to Isolate Fat
- •5.4.1 Thresholding
- •5.4.2 Selecting the Optimum Threshold
- •5.4.3 Gaussian Mixture Model
- •5.4.4 Region Growing
- •5.4.5 Adaptive Thresholding
- •5.4.6 Segmentation Using Overlapping Mosaics
- •5.6 Conclusions
- •References
- •6.1 Introduction
- •6.2 Clinical Context
- •6.3 Vessel Segmentation
- •6.3.1 Survey of Vessel Segmentation Methods
- •6.3.1.1 General Overview
- •6.3.1.2 Region-Growing Methods
- •6.3.1.3 Differential Analysis
- •6.3.1.4 Model-Based Filtering
- •6.3.1.5 Deformable Models
- •6.3.1.6 Statistical Approaches
- •6.3.1.7 Path Finding
- •6.3.1.8 Tracking Methods
- •6.3.1.9 Mathematical Morphology Methods
- •6.3.1.10 Hybrid Methods
- •6.4 Vessel Modeling
- •6.4.1 Motivation
- •6.4.1.1 Context
- •6.4.1.2 Usefulness
- •6.4.2 Deterministic Atlases
- •6.4.2.1 Pioneering Works
- •6.4.2.2 Graph-Based and Geometric Atlases
- •6.4.3 Statistical Atlases
- •6.4.3.1 Anatomical Variability Handling
- •6.4.3.2 Recent Works
- •References
- •7.1 Introduction
- •7.2 Linear Structure Detection Methods
- •7.3.1 CCM for Imaging Diabetic Peripheral Neuropathy
- •7.3.2 CCM Image Characteristics and Noise Artifacts
- •7.4.1 Foreground and Background Adaptive Models
- •7.4.2 Local Orientation and Parameter Estimation
- •7.4.3 Separation of Nerve Fiber and Background Responses
- •7.4.4 Postprocessing the Enhanced-Contrast Image
- •7.5 Quantitative Analysis and Evaluation of Linear Structure Detection Methods
- •7.5.1 Methodology of Evaluation
- •7.5.2 Database and Experiment Setup
- •7.5.3 Nerve Fiber Detection Comparison Results
- •7.5.4 Evaluation of Clinical Utility
- •7.6 Conclusion
- •References
- •8.1 Introduction
- •8.2 Methods
- •8.2.1 Linear Feature Detection by MDNMS
- •8.2.2 Check Intensities Within 1D Window
- •8.2.3 Finding Features Next to Each Other
- •8.2.4 Gap Linking for Linear Features
- •8.2.5 Quantifying Branching Structures
- •8.3 Linear Feature Detection on GPUs
- •8.3.1 Overview of GPUs and Execution Models
- •8.3.2 Linear Feature Detection Performance Analysis
- •8.3.3 Parallel MDNMS on GPUs
- •8.3.5 Results for GPU Linear Feature Detection
- •8.4.1 Architecture and Implementation
- •8.4.2 HCA-Vision Features
- •8.4.3 Linear Feature Detection and Analysis Results
- •8.5 Selected Applications
- •8.5.1 Neurite Tracing for Drug Discovery and Functional Genomics
- •8.5.2 Using Linear Features to Quantify Astrocyte Morphology
- •8.5.3 Separating Adjacent Bacteria Under Phase Contrast Microscopy
- •8.6 Perspectives and Conclusions
- •References
- •9.1 Introduction
- •9.2 Bone Imaging Modalities
- •9.2.1 X-Ray Projection Imaging
- •9.2.2 Computed Tomography
- •9.2.3 Magnetic Resonance Imaging
- •9.2.4 Ultrasound Imaging
- •9.3 Quantifying the Microarchitecture of Trabecular Bone
- •9.3.1 Bone Morphometric Quantities
- •9.3.2 Texture Analysis
- •9.3.3 Frequency-Domain Methods
- •9.3.4 Use of Fractal Dimension Estimators for Texture Analysis
- •9.3.4.1 Frequency-Domain Estimation of the Fractal Dimension
- •9.3.4.2 Lacunarity
- •9.3.4.3 Lacunarity Parameters
- •9.3.5 Computer Modeling of Biomechanical Properties
- •9.4 Trends in Imaging of Bone
- •References
- •10.1 Introduction
- •10.1.1 Adolescent Idiopathic Scoliosis
- •10.2 Imaging Modalities Used for Spinal Deformity Assessment
- •10.2.1 Current Clinical Practice: The Cobb Angle
- •10.2.2 An Alternative: The Ferguson Angle
- •10.3 Image Processing Methods
- •10.3.1 Previous Studies
- •10.3.2 Discrete and Continuum Functions for Spinal Curvature
- •10.3.3 Tortuosity
- •10.4 Assessment of Image Processing Methods
- •10.4.1 Patient Dataset and Image Processing
- •10.4.2 Results and Discussion
- •10.5 Summary
- •References
- •11.1 Introduction
- •11.2 Retinal Imaging
- •11.2.1 Features of a Retinal Image
- •11.2.2 The Reason for Automated Retinal Analysis
- •11.2.3 Acquisition of Retinal Images
- •11.3 Preprocessing of Retinal Images
- •11.4 Lesion Based Detection
- •11.4.1 Matched Filtering for Blood Vessel Segmentation
- •11.4.2 Morphological Operators in Retinal Imaging
- •11.5 Global Analysis of Retinal Vessel Patterns
- •11.6 Conclusion
- •References
- •12.1 Introduction
- •12.1.1 The Progression of Diabetic Retinopathy
- •12.2 Automated Detection of Diabetic Retinopathy
- •12.2.1 Automated Detection of Microaneurysms
- •12.3 Image Databases
- •12.4 Tortuosity
- •12.4.1 Tortuosity Metrics
- •12.5 Tracing Retinal Vessels
- •12.5.1 NeuronJ
- •12.5.2 Other Software Packages
- •12.6 Experimental Results and Discussion
- •12.7 Summary and Future Work
- •References
- •13.1 Introduction
- •13.2 Volumetric Image Visualization Methods
- •13.2.1 Multiplanar Reformation (2D slicing)
- •13.2.2 Surface-Based Rendering
- •13.2.3 Volumetric Rendering
- •13.3 Volume Rendering Principles
- •13.3.1 Optical Models
- •13.3.2 Color and Opacity Mapping
- •13.3.2.2 Transfer Function
- •13.3.3 Composition
- •13.3.4 Volume Illumination and Illustration
- •13.4 Software-Based Raycasting
- •13.4.1 Applications and Improvements
- •13.5 Splatting Algorithms
- •13.5.1 Performance Analysis
- •13.5.2 Applications and Improvements
- •13.6 Shell Rendering
- •13.6.1 Application and Improvements
- •13.7 Texture Mapping
- •13.7.1 Performance Analysis
- •13.7.2 Applications
- •13.7.3 Improvements
- •13.7.3.1 Shading Inclusion
- •13.7.3.2 Empty Space Skipping
- •13.8 Discussion and Outlook
- •References
- •14.1 Introduction
- •14.1.1 Magnetic Resonance Imaging
- •14.1.2 Compressed Sensing
- •14.1.3 The Role of Prior Knowledge
- •14.2 Sparsity in MRI Images
- •14.2.1 Characteristics of MR Images (Prior Knowledge)
- •14.2.2 Choice of Transform
- •14.2.3 Use of Data Ordering
- •14.3 Theory of Compressed Sensing
- •14.3.1 Data Acquisition
- •14.3.2 Signal Recovery
- •14.4 Progress in Sparse Sampling for MRI
- •14.4.1 Review of Results from the Literature
- •14.4.2 Results from Our Work
- •14.4.2.1 PECS
- •14.4.2.2 SENSECS
- •14.4.2.3 PECS Applied to CE-MRA
- •14.5 Prospects for Future Developments
- •References
- •15.1 Introduction
- •15.2 Acquisition of DT Images
- •15.2.1 Fundamentals of DTI
- •15.2.2 The Pulsed Field Gradient Spin Echo (PFGSE) Method
- •15.2.3 Diffusion Imaging Sequences
- •15.2.4 Example: Anisotropic Diffusion of Water in the Eye Lens
- •15.2.5 Data Acquisition
- •15.3 Digital Processing of DT Images
- •15.3.2 Diagonalization of the DT
- •15.3.3 Gradient Calibration Factors
- •15.3.4 Sorting Bias
- •15.3.5 Fractional Anisotropy
- •15.3.6 Other Anisotropy Metrics
- •15.4 Applications of DTI to Articular Cartilage
- •15.4.1 Bovine AC
- •15.4.2 Human AC
- •References
- •Index
130 |
O. Tankyevych et al. |
family of atlases is proposed in Sect. 6.4.3. One of the main uses of such statistical atlases is the guidance of automated vessel segmentation procedures [68], which is a crucial step for several medical image analysis applications.
6.4.2 Deterministic Atlases
The first works on vascular atlases have consisted in developing deterministic models of the vessels. By deterministic, we mean that a model is a (representative) example of what can be considered a vascular network. Although being a good (and actually useful) representation of the anatomical truth, such a deterministic atlas is however not necessarily able to take in consideration in an accurate way the interindividual variability. Broadly speaking, these atlases can be seen as a direct transcription of the models described (both textually and visually) in the anatomy literature. The pioneering works related to this topic were actually based on this approach.
6.4.2.1 Pioneering Works
To the best of our knowledge, the first vascular atlas generated from angiographic data was developed for the modeling of coronary arteries [26]. This “hand-made” atlas consists of a (piecewise linear) skeleton modeling the main coronary artery segments and branches, and providing information on topology (e.g., position of the bifurcations), position and trajectory of vessels. Starting from 2D arteriographies of 37 patients, vessels were manually segmented from two orthogonal views, from the origin of the coronaries to the most distal visible point on each considered branch. A total set of approximately 100 points was then regularly sampled on each segmented tree, leading to a 3D mean positioning of each point. An interactive choice of the structures to be visualized, and the visualization angle allowed the generation of 2D projections of the atlas. In the same period, a second approach was proposed in [36], relying on a model composed of two orthogonal planes embedding a structural and spatial representation of each one of the left and right coronary trees. Based on this pseudo-3D reference, a symbolic description of the arteries was proposed, providing in particular information on branch names and hierarchy, position, (qualitative) orientation, or vascular territories. This description was made by use of declarative programming with each predicate formalizing a given information related to a vessel, while some more general rules modeled heuristic information, such as continuity or angular limits at bifurcations.
In contrast to methods such as [36], which rely on bases of semantic knowledge, those which took advantage of the emerging technologies offered by computer graphics at the end of the 1980s (such as [26]), gave rise to related strategies, essentially based on graph modeling and geometric information.
6 Angiographic Image Analysis |
131 |
6.4.2.2 Graph-Based and Geometric Atlases
Among the methods aiming at generating deterministic atlases, one can distinguish those based on graphs, and those based on geometry. The first ones essentially focus on a symbolic description of the vascular structures (independently from their embedding in the 3D space, i.e., from their anatomical reality), while the second ones especially aim at defining such models as objects which “match at best” a spatial reality.
One of the main uses of such atlases, is the labeling of coronary branches, i.e., the automatic naming of vessels, in order to assist radiological analysis. The extraction of reliable vascular information from cardiovascular data (generally 2D or 3D CT angiography) is of precious use for coronary disease assessment. In this context, it is not only required to segment these vessels (which is a non-trivial task, subject to strong research efforts by the medical image analysis community [67]), but also to be able to name each branch of the coronary tree, in order to facilitate the radiological analysis. Such a highly semantic task can not, of course, be carried out without using high-level a priori anatomical knowledge. Based on these considerations, several vascular atlases have been involved in –and sometimes specifically designed for– this labeling task [14, 30, 36, 41, 42].
Graph-Based Atlases
The extraction of a graph modeling the structure of a vascular network (i.e., assigning an edge to each vessel branch, and a node to each junction/bifurcation) has been a purpose frequently considered by the first vessel segmentation methods devoted to 3D angiographic data [37, 115]. Note that the main weakness of these first approaches was propagation of segmentation errors in the obtained model.
A solution proposed in [30] relies on the data collected, and validated, in [26]. It proposed to define both a symbolic graph-based atlas, which models the tree structure of the coronary arteries, and to couple it with a geometric 3D atlas which models spatial and geometric relationships. Unclassically, the nodes of the graph represent vessel segments while the edges model their bifurcations. Each node of the graph is then associated with a vessel name, a width, but also a list of points located on the vessel medial axis. This information then intrinsically provides a geometric model of the vessels.
In order to automatically build a graph-model of a vascular tree without depending on possible errors inherited from the segmentation process of real images, an alternative consists of generating such a graph from a realistic anatomical phantom. This is the approach proposed in [14] for generating a graph-based atlas of the coronary arteries. The use of a phantom enables to easily obtain a segmentation (which can be validated a posteriori) and to derive, by a topological post-processing, curvilinear structures enabling to define a graph structure. In [14], such an atlas can be achieved by storing at each edge/vessel segment information attributes such as its name, length, orientation and diameter.

132 |
O. Tankyevych et al. |
Fig. 6.2 Geometry-based atlases. (a) Atlas of the cerebral vascular (arterial and venous) networks. (b) Atlas of the whole heart and of the coronary arteries. Illustrations from (a) [74] and (b) [58]
Geometry-Based Atlases
The works described above have focused on vascular structures presenting simple properties, namely the coronary arteries, out of their anatomical neighboring context. In recent works, efforts have been conducted to design vascular atlases related to more complex structures. These contributions rely, in particular, on the use of geometric models, and specifically surfacic meshes.
In [74], a geometric atlas of the whole cerebral vascular network was proposed (see Fig. 6.2a). This network was quite complex, being composed of veins and arteries of varying sizes (at the resolutions available in 3D CT and MR angiographic data, namely 0.5 mm), organized in a non-arborescent fashion. The generation process, based on the TOF MRA of a healthy patient, was composed of several iterative steps, the most crucial of which was segmentation (performed manually, for the sake of correctness), medial axes determination and topology correction (also performed interactively), vessel surface generation, quantitative knowledge extraction and vessel labeling. It led to a quite accurate vascular atlas providing information on the type of vessels (arteries or veins), their position in the intracranial volume, their name, size and topology. Such an atlas, essentially designed with highlevel image processing tools, but in a basically manual fashion, however, remains strongly related to the only patient involved in the image acquisition process.
In [58], a geometric atlas of the whole heart, made of surfacic meshes corresponding to different anatomical structures, was proposed (see Fig. 6.2b). In addition to the coronary arteries, it also modeled several anatomical structures such as the heart chambers and the trunks of the connected vasculature (the model generation of which is beyond the scope of this chapter). The information used for generating this vascular atlas consisted of measurements from [26], which