Добавил:
Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз: Предмет: Файл:

Kluwer - Handbook of Biomedical Image Analysis Vol

.2.pdf
Скачиваний:
102
Добавлен:
10.08.2013
Размер:
25.84 Mб
Скачать

552

Sato

 

10

 

 

 

 

9

 

 

 

 

8

 

 

 

 

7

 

 

 

 

6

 

 

 

y

5

 

 

 

σ

 

 

 

 

4

 

 

 

 

3

 

 

 

 

2

 

 

.9

 

 

 

 

 

 

 

 

0

 

1

 

 

 

 

0

1

2

3

 

0

0.8

4

 

10

 

 

 

 

 

 

 

 

 

 

 

9

 

 

 

 

 

 

 

 

 

 

 

8

 

 

 

 

 

 

 

 

 

 

 

7

 

 

 

 

 

 

 

 

 

 

 

6

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

0.

 

 

 

 

σ y

5

 

 

 

 

 

4

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

4

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

0.6

 

 

 

 

 

 

3

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

0.

0.8

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

2

 

 

 

9

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

1

 

 

 

 

 

 

 

 

 

 

 

0

1

2

3

4

5

6

7

8

9

10

 

0

 

 

 

 

 

 

σx

 

 

 

 

 

 

 

 

 

 

 

(a)

 

 

 

 

 

 

 

 

 

 

 

 

 

10

 

 

 

 

 

 

 

 

 

 

 

9

 

 

 

 

 

 

 

 

 

 

 

8

 

 

 

 

 

 

 

 

 

 

 

7

 

 

 

 

 

 

 

 

 

 

 

6

 

 

 

 

 

 

 

 

 

 

σ y

5

 

 

4

 

 

 

 

 

 

3

 

 

 

 

 

 

 

 

2

 

.9

 

 

 

 

 

 

 

0

 

6

 

 

 

 

 

 

 

 

.

 

 

0.4

 

 

 

 

 

0

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

1

 

 

5

6

7

8

9

10

0

1

2

0

σx

 

 

 

 

 

 

 

 

0

.8

 

3

0

. 6

 

4

0

.

4

 

 

5

6

7

8

9

10

σx

 

 

 

 

 

(b)

(c)

Figure 10.9: Responses of 3-D line filters to elliptic(x" ; σx, σy) at x = y = 0 with variable σx and σy at the center of the line. The responses are normalized so that |λ2| and |λ3| are one at x = y = 0 when σx = σy = σ f = 2. (a) λamean23 .

(b) λgmean23 . (c) λmin23 .

10.3.2Multiscale Responses of Continuous Scale Integration

In order to analyze multiscale filter responses and develop design criteria for the multiscale integration, we observe the variations in the height and width of the original line image line(x" ; σr ) in Eq. (10.13) and its filter responses. The

Hessian-Based Multiscale Enhancement and Segmentation

553

multiscale response for line(x" ; σr ) is given by

 

 

 

 

 

 

 

Mline{ line

(

x"

;

σr )} =

max

Sline{ line

(

x"

;

σr

);

σ f },

(10.22)

 

 

σ f

 

 

 

 

We define the height measure of the multiscale filter response as the peak response hM(σr ) = Mline{ line(0, 0, z ; σr )}. Since the filter response is normalized, hM(σr ) is constant regardless of σr . That is,

hM(σr ) = hMc ,

(10.23)

where hMc = 0.25 (see the “Brain Storming Question” at the end of this chapter

for the derivation). We define the width measure wM(σr ) of the multiscale filter

response as the distance x02 + y02 from the z-axis to the circular locus where

Mline{ line(x0, y0, z ; σr )} gives half of the peak response, that is, hM2 c . Let wM(σr ) be the ratio of the observed width wM(σr ) to σr . The width ratio wM(σr ) is constant regardless of σr , that is,

w

(σ )

=

wM(σr )

=

w ,

(10.24)

 

M

r

σr

Mc

 

where wMc ≈ 1.0 when γ 23 = 1 in the formulation of Eq. (10.2). Similarly, we define the height measure hR(σr ; σ f ) of the single-scale filter response as the

peak response hR(σr ; σ f ) = Sline{ line(0, 0, z ; σr ); σ f } and the width measure

wR(σr , σ f ) as the distance x02 + y02 from the z-axis to the circular locus where

Sline{ line(x0, y0, z ; σr ); σ f } gives the half of the maximum response, hM2 c . To compare the widths of the filter response and the original profile, we also in-

troduce the width measure wL(σr ) of the original line image as the distance

x02 + y02 from the z-axis to the circular locus where line(x0, y0, z; σr ) gives half of line(0, 0, z ; σr ). While σr is introduced for the convenience of generating line profiles, wL(σr ) is for the convenience of comparing the widths of various profile shapes.

Figure 10.10(a) and 10.10(b) show the variations in the height and width measures. Figure 10.10(a) gives the plots of hR(σr ; σ f ) at three values of σ f and hM(σr ), and Fig. 10.10(b) shows the plots of wR(σr ; σ f ) at three values of σ f , wM(σr ), and wL(σr ). The width measure of the multiscale response is proportional to that of the original line image. In the case of the line image line(x" ; σr ) with a Gaussian cross section, wL(σr ) ≈ 0.9wM(σr ). Although the filter responses make the lines a little thinner than the original lines, the multiscale line-filter can be designed so that the width of its responses becomes approximately proportional to the original one.

554

Sato

Figure 10.10: Height and width measures of filter responses in multiscale integration with σi = si−1σ1 (σ1 = 1.5, s = 1.5, i = 1, 2, 3). The height measure is normalized so that hMc is one. (a) Height measures hM(σr ) = hMc and hR(σr ; σi) for line(x" ; σr ). (b) Width measures wM(σr ) = wMc , wL(σr ), and wR(σr ; σi) forline(x" ; σr ) with γ 23 = 1. (c) Height measures for elliptic(x" ; σx, σy) with γ 23 = 1. Solid lines denote the height measures for the discrete scales. Dashed lines denote the height measures for the continuous scales from σ1 to σ3. (d) Height measures for elliptic(x" ; σx, σy) with γ 23 = 0.5.

10.3.3Multiscale Responses of Discrete Scale Integration

We assumed continuous scales for multiscale integration in the previous subsection. The response at each scale, however, has to be computed at discrete

Hessian-Based Multiscale Enhancement and Segmentation

555

values of σ f . In 3-D image filtering, a large amount of computation is necessary to obtain the filter response at each value of σ f . The maximum and minimum values of σ f can be essentially determined on the basis of the width range of the anatomical structure of interest. The interval of σ f should be sufficiently small for the filter response to work uniformly for every line width within the width range, while it is desirable that it should be large enough to minimize the amount of computation required. Thus, we need to determine the minimum number of discrete samples of σ f which satisfy the following conditions:

1.The height measure of the response should be approximately constant within the width range.

2.The width measure of the response should be approximately proportional to the original one within the width range.

Given the discrete samples of σ f and the assumption of the cross-section shape (here, we use the Gaussian cross section), the accuracy of the approximation can be estimated. Let σi = si−1σ1 (i = 1, 2, . . . , n) be discrete samples of σ f , where σ1 is the minimum scale and s is the scale factor determining the sampling interval of σ f . The multiscale filter response using the discrete samples of σ f is given by

max

;

σi}.

 

 

(10.25)

Mline{ f } = 1 i n Sline{ f

 

 

 

 

≤ ≤

 

 

 

 

 

 

 

Similarly, the multiscale filter response using the discrete samples of σ f

for the

line image line(x", σr ) is given by

 

 

 

 

 

 

 

max

 

 

(

x", σr

);

σi}.

(10.26)

Mline{ line(x", σr )} = 1 i n Sline{ line

 

 

 

≤ ≤

 

 

 

 

 

 

 

Given the scale factor s, we can determine hMmin and kp satisfying

 

hMmin = hR(kpσi; σi) = hR(kpi; σi),

 

(10.27)

where σi = si−1σ1 (i = 1, 2, . . . , n), hMmin is the minimum of the height measure of the multiscale response Mline{ line(x", σr )} within the range kpσ1 σr kpsnσ1, and the minimum is taken at σr = kpsiσ1 (i = 0, 1, 2, . . . n) (Fig. 10.10(a)). hMmin can be regarded as a function of the scale factor s. The height measure of the multiscale response should be sufficiently close to hMc within the width range of interest. The values of hMmin and kp at typical scale factors are summarized in

wMmin

556

Sato

Table 10.2: Height measure hM(σr ) and width ratio wM(σr) minima in multi-scale integration at discrete scales using typical scale factors, and σr

where the minima are taken

Scale factor s

Min. height hM

min

at σr

=

kpσi

Min. width ratio w

at σr

=

kw σi

 

 

 

 

Mmin

 

 

s → 1

s = 1.2

s = 2 s = 1.5 s = 2.0

hMmin

hMmin

hMmin

hMmin

hMmin

hMc

0.99hMc

0.97hMc

0.96hMc

0.89hMc

kp

1

w

 

 

Mmin

kp

0.92

w

 

 

 

Mmin

kp

0.84

w

 

 

 

Mmin

kp

0.82

w

 

 

 

Mmin

kp

0.71

w

 

 

 

Mmin

wMc

0.99wMc

0.97wMc

0.96wMc

0.88wMc

kw → 0.65 kw ≈ 0.59 kw ≈ 0.56 kw ≈ 0.55 kw ≈ 0.50

Table 10.2. When s = 1.5, hMmin ≈ 0.96hMc , which means that the deviation from the continuous case is less than 4%.

With regard to the width measure of the filter response, given the discrete samples of σ f and the assumption of the profile shape, the accuracy of this approximation can also be estimated. Given the scale factor s, we can determine

and kw satisfying

w

=

wR(kw σi; σi)

=

wR(kw i; σi)

,

(10.28)

Mmin

kw σi

 

kw i

 

 

where σi = si−1σ1 (i = 1, 2, . . . , n), wMmin is the minimum of the ratio of wM(σr ) to σr within the range kw σ1 σr kw snσ1, and the minimum is taken at σr = kw siσ1

(i = 0, 1, 2, . . . , n) (Fig. 10.10(b)). wMmin can be regarded as a function of the scale factor s. wM(σr ) should be sufficiently close to wMc within the width range of

interest. The values of wMmin and kw at typical scale factors are summarized in

Table 10.2. When s = 1.5, wMmin ≈ 0.96wMc . When the parameters for the discrete scales of σ f are s = 1.5 and n = 3, the ranges of deviation within 4% for the height

and the width measures are 0.55σ1 σr ≤ 1.86σ1 and 0.82σ1 σr ≤ 2.77σ1, respectively. The range of deviation within 4% for the width measure is shifted to a smaller σr than that for the height measure. As a result, the range of deviation of less than 4% for both the height and the width measures is 0.82σ1 σr ≤ 1.86σ1.

We now extend the experimental analysis of the multiscale integration to the response to elliptic(x" ; σx, σy) shown in Eq. (10.21). We define the hight mea-

sure of elliptic(x" ; σx, σy) as hRelliptic (σx, σy; σ f ) = Sline{ elliptic(0, 0, z ; σx, σy); σ f }.

Fig. 10.10(c) and 10.10(d) show the multiscale integration of the responses at continuous and discrete scales with σ1 = 1.5, s = 1.5 and n = 3 for γ 23 = 1 and

Hessian-Based Multiscale Enhancement and Segmentation

557

γ 23 = 0.5, respectively. The multiscale integration of these discrete scales gives a good approximation of that of the continuous scales.

10.4 Description and Quantification

In the previous sections, the enhancement of the local structures based on the eigenvalues of the Hessian matrix was discussed. In this section, we further combine the gradient vector with the Hessian matrix to perform explicit detection, localization, and description of the local structures. Especially, we focus on the line and sheet structures. The methods are formulated as a 3-D extension of 2-D line description presented in [36]. The 3-D line model consists of the medial axes of lines and the cross-sectional shape associated with each point on these axes, while the 3-D sheet model consists of the medial surfaces of sheets and the width associated with each point on these surfaces. The medial axes and medial surfaces are detected and localized by fully utilizing formal analyses of 3-D second-order local intensity structures based on the gradient vector and the Hessian matrix.

The following is an overview of the method:

Step 1: Existing filtering techniques for line and sheet enhancement are used to extract the initial regions, which should include all potential medial axes and surfaces [7, 11]. These are then used as initial values for the subsequent subvoxel edge localization. The candidate regions, which should include all potential line and sheet regions, are also extracted.

Step 2: The medial axes and surfaces are extracted using local secondorder approximation given by the gradient vector and Hessian matrix. The eigenvectors of the Hessian matrix define the moving frames on medial axes/surfaces. After this, the moving frames are embedded in a 3-D image such that each point within the candidate regions is directly related to its corresponding moving frame.

Step 3: Subvoxel edge localization of the region boundaries is carried out using adaptive 3-D directional derivatives, whose directions are adaptively changed depending on the moving frame, to accomplish accurate segmentation, model recovery, and quantification.

558

Sato

In the following, we begin with a description of Step 2 of the method since Step 1 has been already described in the previous sections.

10.4.1 Medial Axis and Surface Detection

Let f (x") be an intensity function of a volume, where x" = (x, y, z), and f (x" ; σ ) be its Gaussian smoothed volume with standard deviation σ . The second-order

approximation of f (x" ; σ ) around x"0 is given by

 

 

 

 

 

 

 

 

 

f

(x ; σ )

=

f

0 +

(x x

)$

 

f

 

+

1

(x x

 

)$

 

2

f

 

(x x

),

(10.29)

 

 

 

 

 

 

2

 

 

 

II

"

 

" − "0

 

 

0

" − "

0

 

 

 

0

" − "0

 

 

where f0 = f (x"0), f 0 = f (x"0), and 2 f 0 = 2 f (x"0). Thus, the second-order structures of local intensity variations around each point of a volume can be described by the original intensity, the gradient vector, and the Hessian matrix.

The gradient vector of Gaussian smoothed volume f (x" ; σ ) is defined as

 

 

 

 

f (x ; σ )

=

( f

x

(x ; σ ), f

y

(x ; σ ), f (x ; σ ))$,

 

(10.30)

 

 

 

 

"

 

 

 

"

 

"

z

"

 

 

 

where partial derivatives of

f (x" ; σ ) are represented as

fx(x" ; σ ) =

f (x" ; σ ),

∂ x

fy(x" ; σ ) =

f (x" ; σ ), and

fz(x" ; σ ) =

f (x" ; σ ).

 

 

 

 

∂ y

∂ z

 

 

 

 

The Hessian matrix of Gaussian smoothed volume f (x" ; σ ) is given by

 

2

f (x ; σ )

 

 

fxx(x" ; σ )

fxy(x" ; σ )

 

fxz(x" ; σ )

,

(10.31)

 

=

fyx(x ; σ )

fyy(x ; σ )

 

fyz(x ; σ )

 

 

 

"

 

 

 

 

 

"

 

 

 

"

 

"

 

 

 

 

 

 

 

 

 

 

fzx(x ; σ )

fzy(x ; σ )

 

fzz(x ; σ )

 

 

 

 

 

 

 

 

 

 

 

 

 

"

 

 

 

"

 

"

 

 

 

where partial second derivatives of

f

(

x"

;

σ

) are represented as

fxx

(

x"

;

σ

)

=

 

2

 

 

2

 

 

 

 

 

 

 

 

 

f (x" ; σ ),

fyz(x" ; σ ) =

 

 

f (x" ; σ ), and so on.

 

 

 

 

 

 

 

∂ x 2

∂ y∂ z

 

 

 

 

 

 

 

Let the eigenvalues of 2 f (x" ; σ ) be λ1, λ2, λ3 (λ1 λ2 λ3) and their corresponding eigenvectors be e"1, e"2, e"3 (|"e1| = |"e2| = |"e3| = 1), respectively. For the ideal line, e"1 is expected to give its tangential direction and both |λ2| and |λ3|, directional second derivatives orthogonal to e"1, should be large on its medial axis, while e"3 is expected to give the orthogonal direction of a sheet and only |λ3| should be large on its medial surface (Fig. 10.11). Here, structures of interest are assumed to be brighter than surrounding regions.

The initial regions obtained in Step 1 are searched for medial axes and surfaces, which are detected based on the second-order approximation of f (x" ; σ ) The medial axis and surface extraction is based on a formal analysis of the second-order 3D local intensity structure. Here, σ f is the filter scale used in

Hessian-Based Multiscale Enhancement and Segmentation

559

e1

e1

e

e3

3

 

e2

e2

 

(a)

(b)

Figure 10.11: Line and sheet models with the eigenvectors of the Hessian matrix. (a) Line. (b) Sheet.

medial axis/surface detection, and we assume that the width range of structures of interest is around the width at which the filter with σ f gives the peak response (see [7] and [11] for detailed discussions).

10.4.1.1 Line Case—Medial Axis Detection

We assume that the tangential direction is given by e"1 at the voxel around the medial axis. The 2-D intensity function, c(u") (u" = (u, v)$), on the cross-sectional plane of f (x" ; σ f ) orthogonal to e"1, should have its peak on the medial axis. The second-order approximation of c(u") is given by

 

 

 

c(u)

=

f (x

; σ

 

)

 

u$

 

c

 

 

1

u$

 

2c u,

(10.32)

 

 

 

 

 

 

 

 

 

"

+

 

"

 

"0

 

 

f

 

+ "

 

0 + 2 "

 

0 "

 

" = " − "

 

c0

=

(

 

f

· "

 

 

f

· "

 

 

 

f is the gradient vector,

where ue2

 

ve3

x x0,

 

 

 

 

 

e2,

 

e3)$ (

 

 

that is, f (x"0; σ f )), and

2c0 =

λ2

0

(10.33)

0

λ3 .

c(u") should have its peak on the medial axis of the line. The peak is located at the position satisfying

 

 

 

 

 

 

c(u") = 0 and

 

c(u")

= 0.

(10.34)

∂u

∂v

 

 

 

" =

( px, py, pz)$, of the peak

By solving Eq. (10.34), we have the offset vector, p

 

position from x"0 given by

 

 

 

 

 

 

 

p" = se"2 + te"3,

 

 

(10.35)

560

 

 

 

Sato

where

s = −

λ2

t = −

λ3

 

f · e"2 and

 

f · e"3 . For the medial axis to exist at the voxel

x"0, the peak of c(u") needs to be located in the territory of voxel x"0. Thus, the medial axis is detected only if | px| ≤ 12 , | py| ≤ 12 , and | pz| ≤ 12 . By combining the voxel position x"0 and offset vector p", the medial axis is localized at subvoxel resolution.

10.4.1.2 Sheet Case—Medial Surface Detection

We assume that the direction of the surface normal is given by e"1 at the voxel around the medial surface. The 1-D intensity function, c(v), which is the profile of f (x" ; σ f ) along e"3, should have its peak on the medial surface. The second-order approximation of c(v) is given by

 

 

 

c(v)

=

f (x ; σ

 

)

+

vc

1

v2c ,

(10.36)

 

 

 

 

2

 

 

 

 

 

"0

 

f

 

0 +

0

 

where ve3

x x0

, c

=

 

f

 

e3, and c

=

λ3. c(v) should have its peak on the

"

= " − "

0

 

 

· "

 

 

 

0

 

 

 

 

medial surface of the sheet. The peak is located at the position satisfying

 

 

 

 

 

 

 

 

d

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

c(v) = 0.

 

 

(10.37)

 

 

 

 

 

 

 

dv

 

 

By solving Eq. (10.37), we have the offset vector, p", of the peak position from x"0 given by

p" = te"3,

where t = − f · e"3 . The medial surface is detected only if | px| ≤

λ3

| pz| ≤ 12 .

(10.38)

12 , | py| ≤ 12 , and

10.4.1.3 Embedding Moving Frames

The moving frame is defined by the voxel position x"0, the offset vectors p", and the eigenvectors e"1, e"2, e"3 at each detected point of a medial axis or surface. In order to perform the subsequent processes based on moving frames, each voxel within the candidate regions obtained in Step 1 needs to be related to the moving frame. First, we find the correspondences between each voxel and one of the detected points of a medial axis or surface. Once these correspondences are found, each voxel is directly related to its corresponding moving frame. To find the correspondences, we use the Voronoi tessellation of the detected points.

Hessian-Based Multiscale Enhancement and Segmentation

561

The territory of the detected point in the Voronoi tessellation can be regarded as the set of voxels to which each discrete moving frame is applied. This process is identical in both the line and sheet cases.

10.4.2Subvoxel Edge Localization and Width Measurement

An adaptive directional second derivative is applied at each voxel based on its corresponding moving frame. The directional derivative is taken along the perpendicular from the voxel to the medial axis or surface. The zero-crossing points of the directional second derivatives are localized at subvoxel resolution to determine the precise region boundaries and quantitate the widths.

At every voxel within the candidate regions, the directional second derivative is calculated depending on its corresponding moving frame. This spatially variable directional derivative is written as

f

(x ; σ )

r(x)$

 

2 f (x ; σ

)r(x),

(10.39)

line

"

e

= " "

"

e

" "

 

where r"(x") is the unit vector whose direction is parallel to the perpendicular from the voxel position x" to the straight line defined by the origin and the medial axis direction of the moving frame. The foot of the perpendicular can be regarded as the corresponding axis position. The origin is given by the voxel position of the medial axis point and the offset vector p". σe is the filter scale used in the edge localization; it is desirable that σe be small compared to the line width for accurate edge localization.

After the adaptive derivatives have been calculated at all the voxels, subvoxel edge localization is carried out at every voxel in the candidate regions. Let o"a be the foot of the perpendicular on the axis. Let r"a be the direction from o"a to the voxel position x"a. For each voxel, we reconstruct the profiles originating from o"a in the directions r"a and −r"a for fline(x" ; σe) and the initial regions (which we specify as bline(x")) obtained in Step 1. The edges are then localized in both directions and the width is calculated as the distance between the two edge locations. The profile is reconstructed at subvoxel resolution by using a trilinear interpolation for fline(x" ; σe) and a nearest-neighbor interpolation for bline(x").

Let f (s) be the profiles of fline(x" ; σe) along the directions r"a from o"a. Let b(s) be the profiles of bline(x"). Here, r denotes the position from the foot of