Добавил:
Upload Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз: Предмет: Файл:

Diss / 10

.pdf
Скачиваний:
143
Добавлен:
27.03.2016
Размер:
18.05 Mб
Скачать

Estimation of Mathematical Expectation

 

 

403

 

 

χ

 

 

 

 

0.100

 

 

 

N= 20

N= 50

0.075

 

 

 

 

N= 100

 

 

 

N= 10

 

 

 

 

 

 

 

0.050

 

 

 

 

N= 200

 

 

 

 

 

0.025

 

N= 5

 

 

N= 500

 

 

 

 

 

 

 

 

 

 

 

N= 1000

 

 

 

 

 

 

ψ

0

0.25

0.50

0.75

1.00

 

FIGURE 12.10  Relative increase in the variance of equidistributed estimate of mathematical expectation as a function of the normalized correlation function between samples.

as a function of values of the normalized correlation function between the samples ψ for various numbers of samples. Naturally, if the relative increase in the variance is low, then the magnitude of the normalized correlation function between samples will be low as well. Similar to the mathematical expectation estimate by the continuous realization of stochastic process, the presence of maxima is explained by the fact that in the case of small numbers of samples N and sufficiently large magnitude ψ, the variance of the optimal estimate decreases rapidly in comparison with the variance of the equidistributed estimate of mathematical expectation. As we can see from Figure 12.10, the magnitude of the normalized correlation function between samples is less than ψ = 0.5, then the optimal and equidistributed estimates coincide practically.

As applied to the normalized correlation function (12.146), the normalized variance of estimate is defined as

Var(E*)

σ2

= N(1−ψ 2 )[1 + ψ 2 − 2ψ cos( ϖ)]+ 2ψ(2 N +1){cos[(N + 1)

ϖ] − 2ψ cos(N ϖ) + ψ 2 cos[(N − 1) ϖ]}

 

 

 

 

N2[1 + ψ 2 − 2ψ cos(

ϖ)]2

 

2[(1 + ψ 2 )cos(

ϖ) − 2ψ]

,

(12.198)

 

N2[1 + ψ 2 − 2ψ cos( ϖ)]2

 

 

 

 

where, as before, ψ = exp{−αΔ}. At ϖ = 0, we obtain the formula (12.195). In the case of large numbers of samples, the formula (12.198) is simplified

Var(E*)

(1

− ψ 2 )

 

, N

α 1.

(12.199)

σ2

N[1 + ψ 2 − 2ψ cos( ϖ)]

 

 

 

 

404

Signal Processing in Radar Systems

As we can see from (12.199), in the case of stochastic process with the correlation function given by (12.146) the equidistributed estimate may possess the estimate variance that is less than the variance of estimate by the same number of the uncorrelated samples. Actually, if the samples are taken over the interval

=

π + 2πk

, k = 0,1,…,

(12.200)

 

ϖ

 

 

then the minimal magnitude of the normalized variance of estimate can be presented in the following form:

Var(E*)

1

×

1

− ψ

, N

α 1.

(12.201)

σ2

N

1

+ ψ

 

min

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Otherwise, if the interval between samples is chosen such that

=

k

, k = 0,1,….

(12.202)

 

ϖ

 

 

then the maximum value of the normalized variance of estimate takes the following form:

Var(E*)

1

×

1+ ψ

.

(12.203)

σ2

N

1 − ψ

max

 

 

 

 

 

 

 

 

 

Thus, for some types of correlation functions, the variance of the equidistributed estimate of mathematical expectation by the correlated samples can be lesser than the variance of estimate by the same numbers of uncorrelated samples.

If the interval between samples is taken without paying attention to the conditions discussed previously, then the value Δϖ = φ can be considered as the random variable with the uniform distribution within the limits of the interval [0, 2π]. Averaging (12.199) with respect to the random variable φ uniformly distributed within the limits of the interval [0, 2π], we obtain the variance of the mathematical expectation estimate of stochastic process by N uncorrelated samples

Var(E*)

 

1 − ψ 2

dϕ

 

1

 

 

σ2

=

 

 

=

 

.

(12.204)

N

1 + ψ 2 − 2ψ cos ϕ

N

ϕ

 

 

0

 

 

 

 

 

Of definite interest for the definition of the mathematical expectation estimate is the method to measure the stochastic process parameters by additional signals [13,14]. In this case, the realization x(ti) = xi of the observed stochastic process ξ(ti) = ξi is compared with the realization v(ti) = vi of the additional stochastic process ζ(ti) = ζi. A distinct feature of this measurement method is that the values xi of the observed stochastic process realization must be with the high probability within the limits of the interval of possible values of the additional stochastic process. Usually, it is assumed that the values of the additional stochastic process are independent from each other and from the values of the observed stochastic process.

Estimation of Mathematical Expectation

405

To further simplify an analysis of the stochastic process parameters and the definition of the mathematical expectation, we believe that the values xi are independent of each other and the random variables ζi are uniformly distributed within the limits of the interval [−A, A], that is,

f (v) =

1

, − A v A.

(12.205)

2 A

 

 

 

As applied to the pdf given by (12.203), the following condition must be satisfied

P[− A ≤ ξ ≤ A] ≈ 1

(12.206)

in the case of the considered method to measure the stochastic process parameters. As a result of comparison, a new independent random variable sequence ςi is formed:

ςi = xi vi .

(12.207)

The random variable sequence ςi can sequence ηi by the nonlinear inertialess

be transformed to the new independent random variable transformation g(ε)

1,

ξi ≥ ζi ,

 

(12.208)

ηi = gi ) = sgn[ςi = ξi − ζi ] =

−1,

ξ < ζi .

 

 

Determine the mathematical expectation of random variable ηi under the condition that the random variable ξi takes the fixed value x and the following condition |x| A is satisfied:

i | x) = 1 × P(v < x) − 1 × P(v > x) = 2 × P(v < x) − 1 =

x

(12.209)

A .

 

 

 

The unconditional mathematical expectation of the random variable ηi can be presented in the following form:

A

 

 

 

1

E0

(12.210)

 

 

 

 

 

 

 

 

ηi = i | x) p(x)dx A xp(x)dx =

A .

 

A

 

 

 

 

−∞

 

 

 

Based on the obtained representation, we can consider the following value

 

 

 

A

N

 

 

 

 

=

 

yi ,

 

 

(12.211)

E

N

 

 

 

 

i=1

 

 

 

 

 

 

 

 

 

as the mathematical expectation estimate of random variable, where yi is the sample of random sequence ηi. At that point, it is not difficult to see that the considered mathematical expectation estimate is unbiased for the accepted conditions. The structural diagram of device measuring the mathematical expectation using the additional signals is shown in Figure 12.11. The counter defines a difference between the positive and negative pulses forming at the transformer output g(ε). The functional purpose of other elements is clear from the diagram.

406

 

 

 

 

 

 

 

 

 

 

 

Signal Processing in Radar Systems

 

 

 

 

 

 

 

 

 

 

 

 

 

 

A

 

 

 

 

 

 

 

 

 

 

 

 

 

 

N

 

 

 

 

xi

 

 

 

 

 

ζi

 

g(ε)

yi

 

Counter

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

+

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

vi

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

E

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

FIGURE 12.11  Measurer of mathematical expectation.

 

 

 

 

 

 

 

 

If we take into consideration the condition that P(x < −A) 0 and P(x > A) 0, then the mathematical expectation estimate given by (12.211) has a bias defined as

 

A

 

 

 

 

xp(x)dx +

 

(12.212)

 

 

 

b(E) = E E0 = −

 

 

xp(x)dx .

 

−∞

 

A

 

 

The variance of the mathematical expectation given by (12.211) can be presented in the following form:

 

A2

N

 

2

Var(E) =

 

yi yj E0 .

N 2

 

 

i=1, j=1

 

Taking into consideration the statistical independence of the samples yi, we have

 

yi2

,

i = j,

 

 

 

 

yi y j =

 

 

 

 

 

 

i j.

yi y j ,

According to (12.208),

ηi2 = (ηi | x)2 = ηi2 = yi2 = 1.

(12.213)

(12.214)

(12.215)

Consequently, the variance of the mathematical expectation estimate is simplified and takes the following form:

 

A2

 

 

 

E02

 

 

Var(E) =

N

 

1

A

2

.

(12.216)

 

 

 

 

 

 

 

As we can see from (12.216), since E02 < A2, the variance of the mathematical expectation of stochastic process is defined completely by half-interval of possible values of the additional random sequence.

Comparing the variance of the mathematical expectation estimate given by (12.216) with the variance of the mathematical expectation estimate by N independent samples given by (12.183)

 

 

A

2

 

 

 

 

2

 

 

 

Var(E)

=

 

1

E0

,

(12.217)

 

 

 

 

 

 

 

Var(E*)

σ

2

A

2

 

 

 

 

 

 

 

 

 

we see that the considered procedure to estimate the mathematical expectation possesses the high variance since A2 > σ2 and E02 < A2.

Estimation of Mathematical Expectation

407

If we know a priori that the observed stochastic sequence v(ti) = vi is a positive value, then we can use the following pdf:

p(v) =

1

, 0 ≤ v A,

(12.218)

A

 

 

 

 

and the following function:

 

 

 

 

 

 

1,

ξi ≥ ζi ,

 

 

 

 

 

(12.219)

ηi = gi ) =

ξ < ζi

 

 

0,

 

 

 

 

 

 

as the nonlinear transformation η = g(ε). In doing so, the following condition must be satisfied:

P[0 ≤ ξ ≤ A] ≈ 1.

(12.220)

As we can see from (12.220), this condition is analogous to the condition given by (12.206).

The conditional mathematical expectation of random variable ηi at ξi = x takes the following form:

 

 

 

x

x

 

(ηi

 

| x |)

= 1 × P(v < x) + 0 × P(v > x) = p(v)dv =

 

 

 

.

(12.221)

 

A

 

 

 

 

 

 

 

0

 

 

 

In doing so, the unconditional mathematical expectation of the random variable ηi is defined in the following form:

 

1

E0

 

ηi

 

xp(x)dx =

 

.

(12.222)

A

A

 

0

 

 

 

For this reason, if the mathematical expectation estimate of the random sequence ξi is defined by (12.211) it will be unbiased at the first approximation.

The variance of the mathematical expectation estimate, as we discussed previously, is given by (12.213). In doing so, the conditional second moment of the random variable ηi is determined analogously as shown in (12.221):

 

 

 

 

x

 

 

x

 

 

 

 

 

 

(ηi | x)2

= p(v)dv =

 

 

 

 

 

 

 

.

 

 

 

(12.223)

 

 

A

 

 

 

 

 

 

 

0

 

 

 

 

 

 

 

 

The unconditional moment is given by

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

E0

 

2

 

2

=

(ηi | x)

2

 

 

 

 

 

ηi

=

yi

 

p(x)dx

=

 

.

(12.224)

 

A

 

 

 

0

 

 

 

 

 

 

 

 

 

Taking into consideration (12.223) and (12.224) under definition of the variance of the mathematical expectation estimate, we have

 

AE0

 

 

 

E0

 

 

Var(E) =

N

 

1

 

.

(12.225)

 

 

 

 

 

A

 

408

Signal Processing in Radar Systems

Thus, in the considered case, the variance of the mathematical expectation estimate is defined by the interval of possible values of the additional stochastic sequence and is independent of the variance of the observed stochastic process and is forever more than the variance of the equidistributed estimate of the mathematical expectation by independent samples. For example, if the observed stochastic sequence subjected to the uniform pdf coinciding in the limiting case with (12.218), then the variance of the mathematical expectation for the considered procedure is defined as

 

A2

 

Var(E) =

4N

(12.226)

and the variance of the mathematical expectation in the case of equidistributed estimate of the mathematical expectation is given by

Var(E*) =

A2

;

(12.227)

12N

 

 

 

that is, the variance of the mathematical expectation estimate is three times more than the variance of the mathematical expectation in the case of equidistributed estimate of the mathematical expectation under the use of additional stochastic signals in the considered limiting case when the observed and additional random sequences are subjected to the uniform pdf. At other conditions, a difference in variances of the mathematical expectation estimate is higher.

As applied to (12.219), the flowchart of the mathematical expectation measurer using additional stochastic signals shown in Figure 12.11 is the same, but the counter defines the positive pulses only in accordance with (12.219).

12.6  MATHEMATICAL EXPECTATION ESTIMATE UNDER STOCHASTIC PROCESS AMPLITUDE QUANTIZATION

Define an effect of stochastic process quantization by amplitude on the estimate of its mathematical expectation. With all this going on, we assume that a quantization can be considered as the inertialess nonlinear transformation with the constant quantization step and the number of quantization levels is so high that the quantized stochastic process cannot be outside the limits of staircase characteristic of the transform g(x), the approximate form of which is shown in Figure 12.12. The pdf p(x) of observed stochastic process possessing the mathematical expectation that does not match with the middle between the quantization thresholds xi and xi+1 is presented in Figure 12.12.

Transformation or quantization characteristic y = g(x) can be presented in the form of summation of the rectangular functions shown in Figure 12.13, the width and height of which are equal to the quantization step:

g( x) = k a( x k ),

k = −∞

where a(z) is the rectangular function with unit height and the width equal to the following mathematical expectation estimate

 

 

E =

k Tk

,

 

k= −∞

T

 

 

(12.228)

. Hence, we can use

(12.229)

Estimation of Mathematical Expectation

409

 

y = g(x)

 

 

 

y3

 

g(x)

 

 

 

 

f (x)

 

 

 

y2

 

 

 

y1

 

 

x–2

x–1

x2

x

 

x1

x3

 

y–1

 

 

 

ζΔ

 

 

 

y–2

 

 

FIGURE 12.12  Staircase characteristic of quantization.

f (z)

1

z

–0.5

0.5

FIGURE 12.13  Rectangular function.

where Tk = Σiτi is the total time when the observed realization is within the limits of the interval (k ± 0.5) during its observation within the limits of the interval [0, T]. In doing so, lim Tk is the probability that the stochastic process is within the limits of the interval (k ± 0.5) . T →∞ T

The mathematical expectation of the realization y(t) forming at the output of inertialess element (transducer) with the transform characteristic given by (12.228) when the realization x(t) of the stochastic process ξ(t) excites the input of inertialess element is equal to the mathematical expectation of the mathematical expectation estimate given by (12.229) and is defined as

(k + 0.5)

 

E = g(x) p(x)dx =

k

p(x)dx,

(12.230)

−∞

k = −∞

(k − 0.5)

 

where p(x) is the one-dimensional pdf of the observed stochastic process. In general, the mathematical expectation of estimate Ediffers from the true value E0; that is, as a result of quantization we obtain the bias of the mathematical expectation of the mathematical expectation estimate defined as

b(E) = E E0 .

(12.231)

410

Signal Processing in Radar Systems

To determine the variance of the mathematical expectation estimate according to (12.116), there is a need to define the correlation function of process forming at the transducer output, that is,

Ry (τ) = g(x1 )g(x2 ) p2 (x1, x2; τ)dx1dx2 E 2 ,

(12.232)

−∞ −∞

 

where p2(x1, x2; τ) is the two-dimensional pdf of the observed stochastic process.

Since the mathematical expectation and the correlation function of process forming at the transducer output depend on the observed stochastic process pdf, the characteristics of the mathematical expectation estimate of stochastic process quantized by amplitude depend both on the correlation function and on the pdf of observed stochastic process.

Apply the obtained results to the Gaussian stochastic process with the one-dimensional pdf given by (12.153) and the two-dimensional pdf takes the following form:

 

 

 

1

 

(x1 E0 )2 + (x2 E0 )2 − 2R(τ)(x1 E0 )(x2

E0 )

 

p2

(x1, x2

; τ) =

 

exp −

 

 

 

 

 

 

. (12.233)

2πσ2 1 − R2 (τ)

2

[1 − R

2

(τ)]

 

 

 

 

 

 

 

 

 

Define the mathematical expectation E0 using the quantization step :

 

 

 

 

 

 

 

 

E0 = (c + d) ,

 

 

 

 

 

(12.234)

where c is the integer; −0.5 d 0.5. The value d is equal to the deviation of the mathematical expectation from the middle of quantization interval (step). Further, we will take into consideration that for the considered staircase characteristic of transducer (transformer) the following relation is true:

g( x + w ) = g( x) + w ,

(12.235)

where w = 0, ±1, ±2,… is the integer. Substituting (12.153) into (12.230) and taking into consideration (12.234) and (12.235), we can define the conditional mathematical expectation in the following form:

 

1

 

 

 

[(x c ) − d ]2

 

E | d =

 

 

 

 

g(x) exp

2

dx

 

2πσ2

 

 

 

 

 

 

 

 

 

 

 

 

−∞

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

= k

{Q[(k − 0.5 − d)λ] − Q[(k + 0.5 − d)λ]} + c ,

(12.236)

k= −∞

where

λ =

 

(12.237)

σ

is the ratio between the quantization step and root-mean-square deviation of stochastic process; Q(x) is the Gaussian Q function given by (12.68).

The conditional bias of the mathematical expectation estimate can be presented in the following form:

 

b(E | d) = k{Q[(k − 0.5 − d)λ] − Q[(k + 0.5 − d)λ]} − d .

(12.238)

k= −∞

Estimation of Mathematical Expectation

411

It is easy to see that the conditional bias is the odd function d, that is,

 

b(E | d) = −b(E | − d),

(12.239)

and at that, if d = 0 and d = practice at λ ≥ 5, (12.238) is

±0.5, the mathematical expectation estimate is unbiased. If λ 1, in simplified and takes the following form:

b(E | d) ≈ {Q[0.5λ(1 − 2d)] Q[0.5λ(1 + 2d)] d} .

(12.240)

At λ < 1, the conditional bias can be simplified. For this braces in (12.238) into the Taylor series about the point (k expansion. As a result, we obtain

purpose, we can expand the function in − d)λ, but limit to the first three terms of

 

λ

 

b(E | d) =

k exp{−0.5(k d)2 λ2}d .

(12.241)

 

k= −∞

 

 

 

 

If λ 1, the sum in (12.241) can be changed by the integral. Denoting x = λk and dx = λ, we obtain

 

λ }

 

 

kλ exp{−0.5(k d)

 

λ x exp{−0.5(x dλ) }dx = 2πd.

 

 

2

2

1

2

(12.242)

k = −∞

 

 

 

−∞

 

 

 

 

As we can see from (12.241) and (12.242), at λ 1, that is, the quantization step is much lower than the root-mean-square deviation of stochastic process, the mathematical expectation estimate is unbiased for all practical training.

To obtain the unconditional bias we assume that d is the random variable uniformly distributed within the limits of the interval [−0.5; 0.5]. Let us take into consideration that

 

 

 

Q( x)dx = xQ( x) − xQ′( x)dx.

 

 

(12.243)

 

 

 

 

 

 

Averaging (12.238) by all possible values of d we obtain

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

b(E) = λ k {2kQ(kλ) − (k + 1)Q[(k + 1)λ] − (k − 1)Q[(k − 1)λ]

 

 

 

 

k= −∞

 

 

 

 

 

 

 

 

 

 

 

 

 

1

 

2

2

 

2

 

 

2

 

2

 

2

+

 

 

−2 exp{−0.5λ

k

} + exp{−0.5λ

 

(k

+ 1)

 

} + exp{−0.5λ

 

(k − 1)

} }. (12.244)

2πλ

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

The terms of expansion in series at k = p and k = −p are equal by module and are inverse by sign. Because of this, b(E) = 0; that is, the mathematical expectation estimate of stochastic process quantized by amplitude is unconditionally unbiased. Substituting (12.233) into (12.232), introducing new variables

z1 = x1 c

,

 

= x2 c

(12.245)

z2

,

 

 

 

412 Signal Processing in Radar Systems

and taking into consideration (12.235), we obtain

 

Ry (τ) = g(z1)g(z2 ) p2 (z1, z2; τ)dz1dz2 ,

(12.246)

−∞ −∞

 

where p2(z1, z2; τ) is the two-dimensional pdf of Gaussian stochastic process with zero mathematical expectation. To determine (12.246) we can present the two-dimensional pdf as expansion in series by derivatives of the Gaussian Q function (12.156) assuming that x = z and E0 = 0 for the last formula. Substituting (12.156) and (12.228) into (12.246) and taking into consideration a parity of the function Q(1)(z/σ) and oddness of the function g(z), we obtain

 

1

ν

 

Ry (τ) =

R

(τ)

 

 

 

 

 

σ

2

ν!

 

 

ν=1

 

 

 

 

 

 

 

−∞

 

 

z

2

 

g(z)Q(ν+1)

 

(12.247)

 

 

dz .

 

 

 

σ

 

 

 

 

 

 

 

 

Taking the integral in the braces by parts and taking into consideration that Q(ν)(±∞) = 0 at ν ≥ 1, we obtain

−∞

 

 

z

 

g(z)Q( ν+1)

g(z)Q( ν)

 

 

dz = −σ

 

 

 

σ

 

 

 

 

 

−∞

 

 

z

 

 

 

dz.

(12.248)

 

 

σ

 

According to (12.228),

 

 

−1

 

g′(z) =

dg(z)

=

δ[z − (k − 0.5) ] + δ[z − (k + 0.5) ],

(12.249)

 

dz

k =1

k = −∞

 

 

 

 

where δ(z) is the Dirac delta function. Then the correlation function given by (12.247) takes the following form:

 

 

 

 

aν2 R

ν (τ)

 

 

 

 

 

Ry (τ) =

2

,

 

(12.250)

 

 

ν!

 

 

 

 

 

ν=1

 

 

 

 

 

 

 

 

 

 

 

 

where

 

 

 

 

 

 

 

 

 

 

 

 

 

−1

 

 

 

 

aν = Q(ν)[(k − 0.5)λ] + Q(ν)[(k + 0.5)λ],

(12.251)

k=1

 

 

 

k= −∞

 

 

 

 

and at that the coefficients aν are equal to zero at even ν; that is, we can write

 

 

 

 

 

 

 

 

 

 

 

 

Q(ν)[(k 0.5)λ]

at

 

odd ν,

 

aν =

2

 

 

(12.252)

 

k=1

 

 

 

 

 

 

 

 

 

 

 

 

 

 

even ν.

 

 

0

 

 

 

 

at

 

 

 

 

 

 

 

 

 

 

 

 

Соседние файлы в папке Diss