- •Lecture 1 (part1)
- •Short Preambular to my course
- •Физ. Величина
- •1.1. Classical approaches. Traditional formulation of the one-dimensional regression problem
- •Regression model. Usually, it is supposed the measured values of the response are
- •Usually we suppose that:
- •These components should minimize the values of the error dispersion. Mathematically, this requirement
- •This procedure is very useful and can be considered as obligatory because it
- •Table 1. Simple functions that admit presentation in the form of the straight
- •Definitely, the list of the functions presented in Table 1 can be continued.
- •a.The elimination of the outliers;
- •ksmooth(x, y, w) in MathCad-15
- •Figure 2b. Here we demonstrate the effect of creation a trend by means
- •This procedure automatically decreases the value of the initial fluctuations by means of
- •Figure 3a. Here we show the results of application of the POLS to
- •The minimal values of the functions RelErr(w) for our model example are shown
- •If in the same time we integrate the optimal trend (6) then one
- •1.3. The description of the Eigen-Coordinates (ECs) method
- •If we compare the structure of Eqn.(15) with (5) one can see the
- •Here and below the symbol (A B) defines the scalar product in the
- •The unknown constants A1,2 are found from (22) by the LLSM, because other
- •It is easy to notice from (31) that new set of the functions
- •Questions for self-testing:
- •Questions, Comments or Remarks?
Here and below the symbol (A B) defines the scalar product in the discrete space of the given number of the measured points
(20)
Therefore, one can conclude that many functions containing initially the unknown set of the fitting parameters satisfy to differential equations where the initial set of nonlinear parameters forms the desired linear combination. In this case the ECs method reduces the problem of the nonlinear fitting to the well known LLSM. It opens a quite new possibility of the calculation of the fitting parameters of many statistical distributions by means of simple and well-developed method. Another possibility is opened in the fitting of many special
functions, which normally is expressed by means of infinite series, and their fitting to actual data presents a
specific and difficult problem. For example, let us consider the differential equation of the second order
(21)
At a = + +1, b = - , c = , this differential equation describes the solution presented in the form of
linear combination of two degenerated hypergeometric functions [8] ( accepts non-integer values)
22
(22)
(23)
As it is known, the hypergeometric function is widely used in the mathematical physics for description of
different natural phenomena. If the fitting parameters , , are not known then the fitting by means of the function y(x) (22) of some actual data presents itself a nontrivial problem. The problem can be solved easily by means of differential equation (21). If one integrates this differential equation two times then we obtain the BLR of the type
(24)
23
(25)
Here the constant C4 including the unknown value of the first derivative in the initial point x0 is not essential for
the calculations and so it is omitted. The function y(u) determines the actual data that pretends on description by
the hypothesis (22). From equations (24) and (25) the unknown constants C1,2,3 can be found by means of the conventional LLSM. From the calculated values of the constants Ck (k=1,2,3) one can find the desired values of
the unknown parameters , , from equations
(26)
24
The unknown constants A1,2 are found from (22) by the LLSM, because other fitting constants entering in it are known. Other examples of application of the ECs method will be considered below.
2. The usage of the orthogonal variables
As it is known that in practical applications of the LLSM the determinant might have the value close to zero.
When it can be happened? Any researcher should know that all fitting constants Ck entering into BLR (5) should
be independent from each other. Possible errors can distort also the initial BLR and create a situation when determinant is becoming close to zero. In these uncomfortable cases the values of the fitting parameters Ck found
from (5) contains large errors and sometimes cannot be calculated. For these cases one suggests the transformation of initial variables Xk(x) to another set of variables that orthogonal each other. It makes the
functions statistically independent to each other and helps to avoid the zeros in the corresponding determinants, which are appeared in calculation of the fitting coefficients Cp. We present some BLR in the form
(27)
having in mind any BLR (Eqn.(5)) considered above. |
|
|
The relationship (27) reminds the decomposition of a wave function Y(xj) over the finite set of eigenfunctions |
|
|
{X(xj )}k=1,2,…,s. Using the process of orthogonalizaiton one can choose the set of orthogonal functions { (xj )}k=1,2, |
|
|
…,s and present the initial function Y(xj) in the form of linear combination of { (xj )}k. This transformation is |
25 |
|
realized with the help of the following formulae |
||
|
(28)
(29)
k=1,2,…, s. As before, the parentheses in (29) determine the value of scalar product in the discrete space of
dimension N, where N is determined by the number of measured points.
(30)
It is instructive to write down the first four functions
(31)
26
It is easy to notice from (31) that new set of the functions { (xj )}s is orthogonal, i.e.
(32)
The initial set of constants Ck is found from the linear system of equations
(33)
The transformation matrix from (33) has a triangle form |
|
|
with determinant equaled the unit value |
|
|
(det(T) = 1). The usage of the orthogonal set |
|
|
of functions { (xj )}k helps to reduce the |
(34) |
|
correlation matrix to the set of matrix |
||
|
||
elements located on the main diagonal and |
|
|
makes the whole procedure more stable to |
|
|
the influence of the initial error. |
|
27
Questions for self-testing:
1.What is regression as a procedure?
2.Why this procedure is important? (Reduction and prediction)
3.Smoothing of data. In what cases this procedure is important?
4.Why POLS is more preferable in comparison with other approaches?
5.The conditions of applicability of the ECs method?
6.In what cases the orthogonalizaiton procedure is important?
28
Questions, Comments or Remarks?
Thank for your patience!
29
|
|
Logical scheme of Lecture 1.1 |
||
|
|
|
Introduction to |
Without 2 types |
|
Parameters? |
|
the second part of |
|
Flct |
|
of errors – |
||
|
|
the SPC |
||
ons |
|
|
treatment,model |
|
|
|
|
||
Nature of error |
|
|
Table of |
|
Nature of C |
Regress |
|
linearization |
|
|
|
|
|
|
|
|
model |
|
|
|
Integral curves |
|
Smoothing of data |
Two examples |
|
and minimization |
POLS, |
|
|
|
of the RelErr |
|
ksmooth (x,y,w) |
|
|
Hypo-geom. |
|
ECs method |
Usage of the |
|
|
orthogonal |
||
|
function |
|
||
|
|
|
variables |
|
LLSM
30
