- •Lecture 5 – part 1
- •Plan of the lecture 5 (part 1 and part 2)
- •How to extract the logic and compress the text material? The secrets of
- •Mnemonic symbols that help to
- •The basic message for the audience
- •Introductory part
- •Introductory part
- •Some important details of the problem
- •The description of the algorithm
- •Compression program (reduction to 3 IP)
- •Algorithm- Step 1
- •Algorithm-Step 2
- •Algorithm-Step 2
- •Application of the ECs method for evaluation of the constants and the desired
- •Step-2. More complex case
- •Step 2. More complex case
- •Algorithm-Step 3
- •Optimization programs
- •Algorithm-Step 4
- •Mini-programs for the final fitting
- •Example 1-Economical data
- •Example 1. Economical Data
- •Economical Data
- •Economical Data
- •Economical Data
- •Economical Data
- •Economical Data
- •Economical Data
- •Meteo-Data (part 2)
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Meteo-Data
- •Results and Discussions
- •Mathematical Appendix
- •Mathematical Appendix
- •Mathematical Appendix
- •Mathematical Appendix
- •Logic scheme for L5 (part 1)
- •Some References
- •Some References
- •Thank you for your patience and attention !
Example 1-Economical data
For the first example we take the monthly distribution of prices on gold (Au) as important strategic material. These data are taken from the site: http://www.indexmundi.com/commodities/, where the random behavior of monthly prices on different commodities is presented. The given data contain 360 measured points (starting from 09/1983 year and finishing 09/ 2012 year) and cover the thirty years monitoring period (1982-2012). The plots presented by the figures 1-4 demonstrate the variation of the price (that is given in kilo-US dollars) of gold for one Troy Ounce. As it follows from analysis of these figures the realization of the procedure described in Section 2.1 leaves these curves similar to each other.
|
|
|
mean price |
|
|
|
|
|
|
||
fit |
2.0 |
|
fit _H0(t) |
|
|
|
|
|
H12(t) |
||
its |
|
|
fit_H1(t) |
|
|
|
|
|
|||
and |
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
||
distribution |
1.5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
mean price |
1.0 |
|
|
|
|
|
|
|
|
|
|
0.5 |
|
|
|
|
|
|
|
|
|
||
monthly |
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
||
The |
0.0 |
|
|
|
|
|
|
|
|
|
|
-50 |
0 |
50 |
100 |
150 |
200 |
250 |
300 |
350 |
400 |
||
|
|||||||||||
|
|
|
|
|
1 < months < 360 |
|
|
|
|
||
Fig.5. Here we show the realization of the Step 2 described in Section 2.2. The initial fit was realized with the help of the ECs method and initial hypothesis H0(t) and hypothesis H1(t)
are shown by green and red solid |
|
lines, respectively. As one can notice |
|
from this plot the influence of more |
|
complicated hypothesis is not |
|
essential and so it is sufficient to use |
|
the initial hypothesis H0(t) |
|
corresponding to the case 1. |
21 |
Example 1. Economical Data
|
|
|
mean price |
|
|
|
|
|
|
|
final fits |
2.0 |
|
optimal fit |
|
|
|
|
|
|
|
|
|
final fit |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
optimal and |
1.5 |
|
|
|
|
|
|
|
|
|
1.0 |
|
|
|
|
|
|
|
|
|
|
and its |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
priceMean |
0.5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0 |
|
|
|
|
|
|
|
|
|
|
-50 |
0 |
50 |
100 |
150 |
200 |
250 |
300 |
350 |
400 |
1 < months < 360
Ack
periodic function |
|
|
Ask |
|
|
|
|
|
0.0001 |
|
|
|
|
|
|
prices. |
|
|
|
|
|
|
|
of log - |
onthly |
0.0000 |
|
|
|
|
|
|
|
|
|
|
|
||
plitudes |
for m |
-0.0001 |
|
|
|
|
|
A m |
|
|
|
|
|
|
|
|
|
0 |
10 |
20 |
30 |
40 |
50 |
|
|
|
|
1< k < 50 |
|
|
|
Fig.6. Here we show the optimal fit (the solid red line) that is realized with the help
of the function H(t,vopt). It minimizes the value of the relative error (9.291%) and
helps to obtain the optimal values of the power-law exponent < > = 3.07938 and < >=1.89072. The final fit (solid green line) is realized with the help of the function Hf(t). All fitting parameters are
collected in Table 1.
Fig.7. Besides the parameters that restore the structure of the scaling equation (2) we show here the distribution of the amplitudes Ack, Ask that define the
unknown log-periodic function in expression (19). In order to decrease the number of the fitting parameters and in the same time to keep the acceptable accuracy for the final fitting function in the interval (3-5%) we choose the value of the final mode (K) from the condition (2K+4)=104 < N=360.
22
Economical Data
The fitting curves from the previous expressions are invariant relatively to the scaling transformation t ut. At this transformation the corresponding curves are remained invariant and only the linear parameters A0, A1, together with the amplitudes of log-periodic functions,
are changed. In particular the amplitudes are transformed as:
|
|
|
|
|
|
|
|
K |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
H f (tu) A0 A1u t |
|
|
Ack (u)yck (t) Ask (u) ysk (t) , |
|||||||||||||||||||||||
k |
1 |
|
|
|
|
k |
k 1 |
|
k |
|
|
|
|
|
|
k |
|
|
|
|
k |
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||||||||||||
Ac |
(u) A u |
sin |
|
|
|
|
(u) |
|
|
As |
|
|
cos |
|
|
|
(u) |
|
Ac |
|
, |
|||||
k |
1 |
|
|
|
|
k |
|
|
|
|
k |
|
|
|
|
k |
|
|
k |
|
||||||
As |
(u) A u |
cos |
|
|
|
(u) |
|
As |
|
|
sin |
|
|
|
|
(u) |
|
Ac |
|
|
, |
|||||
|
|
|
2 k a 2 |
|
ln u |
|
, |
|
|
|
|
|
||||||||||||||
sin k (u) sin |
|
|
|
|
|
|
|
|
|
|||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ln |
|
|
|
|
|
|
|
|
||
cos k (u) cos |
|
|
|
|
|
|
|
|
|
|
|
|
ln u |
, |
|
|
|
|
|
|||||||
2 k a 2 |
ln |
|
|
|
|
|
|
|
||||||||||||||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||||
a 2, 1 0, a 1, 1 0.
|
K |
|
|
|
|
H f (t) A0 A1t |
Ack yck (t) Ask ysk (t) , |
||||
|
k 1 |
|
|
|
|
|
|
|
ln t |
|
|
yck (t) exp ln t cos |
2 k |
|
|
, |
|
|
|||||
|
|
|
ln |
|
|
|
|
|
ln t |
|
ysk (t) exp |
ln t sin |
2 k |
|
. |
|
||||
|
|
|
ln |
|
Thanks to this invariance one can decrease the uncertainty in the calculation of ln( ) and carry- over a possible error in calculation of to the unknown values of amplitudes. So, one can realize the fitting procedure described in Section 2 and fit the rest curves describing the distribution of prices for the quarter, half-year and one year periods.
23
Economical Data
|
|
MnPr |
distribution) |
2.0 |
Fitopt |
|
Ffinal |
|
1.5 |
|
|
|
|
|
prices (quarters |
1.0 |
|
|
|
|
Fit of mean |
0.5 |
|
0.0 |
|
|
|
|
|
|
-10 |
0 |
10 |
20 |
30 |
40 |
50 |
60 |
70 |
80 |
90 |
100 |
110 |
120 |
130 |
|
|
|
|
|
|
|
1 < quarters < 120 |
|
|
|
|
|
||||
|
prices |
0.04 |
|
Ack |
|
|
|
|
|
|
|
|
|
|
|
|
|
for quarter |
|
Ask |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||
k |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
andAc As |
0.02 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
k |
periodicfunction |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
of am plitudes |
0.00 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-0.02 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
D istribution |
restoring the log- |
-0.04 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0 |
|
|
|
10 |
|
|
|
20 |
|
|
|
30 |
||
|
|
|
|
|
|
1< k < 25 |
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||
Fig.8. The final fit of the distribution of the quarter prices. The corresponding parameters are collected in Table 1. Other two curves (shown on Fig.2) are very close to each other and so their fit is not shown.
Fig.9. In comparison with Fig.7 we decrease in two times the number of corresponding amplitudes in order to keep the value of the relative error in the same limits (3-5%) and satisfy to the requirement (2K+4=54 < N=120).
24
Economical Data
pricesyear |
|
functionperiodic-log |
Ack(mean price) |
|
|
|
|
|
Ask(mean price) |
|
|
|
2.0 |
|
0.0010 |
|
|
|
|
|
|
|
|
halftobelonging- |
|
plitudesamofDistributionof |
0.0005 |
|
|
|
0.0000 |
|
|
||
|
1.5 |
|
|
|
|
|
|
|
-0.0005 |
|
|
|
|
|
-0.0010 |
|
|
|
1.0 |
|
-0.0015 |
10 |
20 |
|
|
|
0 |
||
|
|
|
|
1 < k < 15 |
|
distributions |
|
|
|
|
|
|
Fit_prup |
|
|
|
|
|
|
|
|
mean Prices |
|
|
0.5 |
|
|
|
|
|
Fit_prmn |
|
|
|
|
|
|
|
prices up |
||
|
|
|
|
|
|
|
prices dn |
|
of |
|
|
|
|
|
|
Fit_prdn |
|
Fit |
0.0 |
|
|
|
|
|
|
|
0 |
10 |
20 |
30 |
40 |
50 |
60 |
||
|
||||||||
|
|
|
1 < half year < 60 |
|
|
|||
periods |
|
MnPr |
|
|
|
|
|
|
annual |
|
|
|
|
|
|
||
2.0 |
UpPr |
|
|
|
|
|
||
MnPrFitfn |
|
|
|
|
|
|||
|
|
dnPr |
|
|
|
|
|
|
to |
|
upPrFitfn |
|
|
|
|
|
|
correspondingprices |
1.5 |
dnPrFitfn |
|
|
|
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
||
|
1.0 |
|
|
|
|
|
|
|
final fit of |
0.5 |
|
|
|
|
|
|
|
0.0 |
|
|
|
|
|
|
||
The |
|
|
|
|
|
|
||
|
0 |
10 |
|
20 |
|
30 |
||
|
|
|
|
|||||
1 < years < 30
Fig.10. The final fit of the distribution of the half-year prices. The corresponding parameters are collected in Table 1. Other two curves (shown on Fig.2) (the upper and down distribution of prices) are given also. The distribution of the amplitudes for the fitting curve corresponding to mean price is given in the small frame above. Other two distributions of amplitudes for upper and down fitting curves are similar and they are not shown.
Fig.11. The final fit of the distribution of the year prices. The corresponding parameters are collected in Table 1.
The distributions of amplitudes are shown below. For this compressed curve only 5 amplitudes are necessary.
25
Economical Data
nctio n . |
|
|
|
Ack(mean prices) |
fu |
0.0015 |
|
|
Ask(mean prices) |
dic |
|
|
||
|
|
|
Ack (up prices) |
|
rio |
0.0010 |
|
|
Ask(up prices) |
-pe |
0.0005 |
|
|
Ack (down prices) |
lo g |
|
|
Ask(down prices) |
|
|
|
|
||
des o f prices |
0.0000 |
|
|
|
map litu nunA al |
-0.0010 |
|
|
|
|
-0.0005 |
|
|
|
n o f |
-0.0015 |
|
|
|
tio |
|
|
|
|
|
|
|
|
|
istribu |
-0.0020 |
|
|
|
|
|
|
|
|
D |
0 |
2 |
4 |
6 |
|
|
1 < k <5 |
|
|
|
|
|
|
Fig.12. In comparison with Figs.7 and 9 we keep the number of modes equaled K=5. This number is sufficient for keeping the value of the relative error in the limits (3-5%) and for satisfaction of the requirement (2K+4=14 < N=60).
Possible predictions for the next 5 months
meanPr_(1-360)
2.0predPr_(5-365)
|
|
|
|
Function (half year) |
|
|
|
|
|
|
||
|
|
|
|
Prediction (half year) |
|
|
|
|
|
|
||
|
|
|
2.0 |
|
|
|
|
|
|
|
|
|
|
|
|
1.5 |
|
|
|
|
|
|
|
|
|
1.5 |
predictionsof distribution |
nearestthefor 2.5 year. |
1.0 |
|
|
|
|
|
|
|
|
|
-2.0 |
|
|
|
|
|
|
|
forecast for |
||||
1.0 |
|
|
|
|
|
|
|
|||||
|
|
|
0.5 |
|
|
|
|
|
|
|
|
|
|
|
|
0.0 |
|
|
|
|
|
|
|
|
|
|
|
|
-0.5 |
|
|
|
horizon of forecast |
|
|
|
|
|
|
|
|
-1.0 |
|
|
|
for 2.5 year |
|
|
|
|
|
|
Possible |
pricesof |
-1.5 |
|
|
|
|
|
|
|
|
|
|
-2.5 |
|
|
|
|
|
|
|
the nearest 5 month |
|||
|
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-3.0 |
|
|
|
|
|
|
|
|
|
|
|
|
-3.5 |
|
|
|
|
|
|
|
|
|
|
|
|
0 |
10 |
20 |
30 |
40 |
50 |
60 |
70 |
|
|
0.5 |
|
|
|
|
1 < half year < 65 |
|
|
|
|
|
||
0.0 |
|
|
|
|
|
|
|
|
|
|
|
|
|
-50 |
|
0 |
50 |
100 |
150 |
200 |
250 |
300 |
350 |
400 |
|
|
|
|
|
|
|
1 < months < 365 |
|
|
|
|||
Fig.13. What is happened if we continue the fitting functions calculated for 1 month and half-year (given in the small frame) for the 5 points up?
It is interesting to note that these curves demonstrate the essential decreasing of prices on gold in the nearest future.
26
Economical Data
5 years |
|
annual prices |
|
Bend again! |
2.5 |
prediction for 5 years |
|
||
|
|
|
|
|
for the next |
2.0 |
|
|
|
1.5 |
|
|
|
|
of distribution |
|
|
|
|
1.0 |
|
|
|
|
|
|
|
|
|
Prediction |
0.5 |
|
|
|
0.0 |
|
|
|
|
|
0 |
10 |
20 |
30 |
|
|
1(1982) <years < 35(2017) |
|
|
Fig.14. It is instructive to see that the distribution of the annual prices also has a tendency to decrease these prices on the nearest 5 years. For the first two curves depicted on the previous figure one can explain the "decreasing" tendency by existence of a specific bend that is clearly seen on the right-hand of these curves. But the natural bend for the curve depicted here is clearly absent, however, the tendency to decreasing of the prices for the nearest 5 years is conserved.
From a general point of view any reliable fitting of a random curve with high accuracy (especially economic data) has a temptation to continue these data to the nearest future for its possible prediction. Here we should specify the term "prediction".
Under prediction procedure we understand a possible prolongation of the fitting function calculated for the known optimal trend. This fitting function is "recognized" for the segment of a temporal interval that is supposed to be known. This type of prediction is possible if we simply continue tendencies collected in the past for the future temporal interval. Naturally, the boundaries of the sequential future interval are limited by future events that can change the tendencies "stretched out" from the known past to the future. The self-similarity principle based on the "recognized" fitting function (20) helps to continue this function into the nearest future.
27
Economical Data
Table 1. The table of additional and scaling parameters that describe the economic data.
Number of |
< > |
ln( ) |
1 |
A1 |
s0 |
RelErr(%) |
K/2 |
file |
|
|
|
|
|
|
|
Price |
3.07938 |
3.32317 |
27814.4 |
-1.78581E-6 |
-11985.5 |
3.15845 |
50 |
(1month, |
|
|
|
|
|
|
|
360) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Mn |
3.10159 |
3.31473 |
29170.7 |
7.08994E-4 |
-12564.1 |
3.68348 |
25 |
(0.25 year, |
|
|
|
|
|
|
|
120) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Up |
3.10159 |
3.31473 |
29170.7 |
0.00101 |
-13025.6 |
4.65095 |
25 |
(0.25 year, |
|
|
|
|
|
|
|
120) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price |
3.16822 |
3.28965 |
33601 |
1.27295E-4 |
-13738.7 |
3.40283 |
25 |
Down |
|
|
|
|
|
|
|
(0.25 year, |
|
|
|
|
|
|
|
120) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Mn |
3.14601 |
3.29796 |
32061.8 |
-3.5195E-4 |
-13845.8 |
3.11844 |
15 |
(0.5 year, |
|
|
|
|
|
|
|
60) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Up |
3.16822 |
3.28965 |
33601 |
-6.87652E-4 |
-15595.1 |
4.63207 |
15 |
(0.5 year, |
|
|
|
|
|
|
|
60) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Dn |
3.39031 |
3.20872 |
53026.3 |
-2.89714E-4 |
-21883.4 |
2.92961 |
15 |
(0.5 year, |
|
|
|
|
|
|
|
60) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Mn |
3.21263 |
3.27314 |
36878.7 |
-9.89242E-4 |
-17427.7 |
4.87768 |
5 |
(1 year, 30) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Up |
3.52356 |
3.16205 |
68986.5 |
-1.91479E-4 |
-25360.2 |
4.16153 |
5 |
(1 year, 30) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Price Dn |
3.52356 |
3.16205 |
68986.5 |
1.91479E-4 |
-25360.3 |
4.16153 |
5 |
(1 year, 30) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Comments to Table 1. The fitting parameters collected in this table reflect the basic parameters of the final fitting function and the parameters that figuring in the scaling equation (2) and its solution
(3). Strictly speaking it is necessary to take the mean values of the columns 2,3,4,6 but we keep them as they are in order to see the variations of these values with respect to compression procedure. The last column shows the number of modes that can restore the unknown log-periodic function with accuracy given in column 7.
28
Meteo-Data (part 2)
Another interesting set of data tightly associated with the self-similarity principle is related with increasing of the mean temperature measured for the both Earth's hemispheres (the so-called global warming phenomenon). These data were taken from the site http://data.giss.nasa.gov/gistemp/. The curves depicted on figure 15 include in themselves 130 years of mean temperature monitoring covering the period 1881-2011. Being compressed in three times it is easy to see that these curves are self-similar.
|
|
|
|
T in C0 NH_(1881-2011) |
|
|
|
||||||
over |
|
1.0 |
|
T in C0 SH_(1881-2011) |
|
|
|
||||||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
average annual temperature |
|
|
|
|
|
|
|
|
|
|
|
|
2011 |
Earth's hemispheres |
0.5 |
|
|
|
|
|
|
|
|
|
|
|
|
0.0 |
1881 |
|
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
||||
|
|
|
|
|
|
|
|
|
|
|
|
||
of the both |
-0.5 |
|
|
|
|
|
|
|
|
|
|
|
|
Distribution |
|
-10 |
0 |
10 |
20 |
30 |
40 |
50 |
60 |
70 |
80 |
90 |
100 110 120 130 140 |
|
|
|
|
|
1(1881)< years < 131(2011) |
||||||||
|
|
|
|
|
|
||||||||
Fig.15. The distribution of mean temperature (measured in C0) for both Earth's Hemispheres. The data cover 130 year period of registration of mean temperature.
The key parameters shown on the previous table
ln
2
, 1 exp 
ln , ( 1 0), s0 A0 1 1 , ln 
, 1 exp 
ln , ( 1 0).
2 k 2k 1 .
29
Meteo-Data
|
|
|
|
mean T in C0(NH) |
|
|
|
|
|
|
1.0 |
|
up T |
|
|
|
|
|
avaraged over 3 years |
|
|
down T |
|
|
|
|
mean tempearture |
0.5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
The distribution of the |
the North hemisphere |
0.0 |
|
|
|
|
|
|
-0.5 |
|
|
|
|
|
|
||
|
0 |
10 |
20 |
30 |
40 |
50 |
||
|
in |
|
||||||
|
|
|
|
|
1< 3 years to 1 year <43 |
|
|
|
|
|
|
mean T in C0(SH) |
|
|
|
|
|
|
|
up T |
|
|
|
|
|
avearged over 3 years |
0.6 |
down T |
|
|
|
|
|
|
|
|
|
|
||
mean temperature |
0.4 |
|
|
|
|
|
|
0.2 |
|
|
|
|
|
||
0.0 |
|
|
|
|
|
||
Distribution of the |
South Hemisphere |
|
|
|
|
|
|
-0.2 |
|
|
|
|
|
||
-0.4 |
|
|
|
|
|
||
|
|
|
|
|
|
||
|
in |
0 |
10 |
20 |
30 |
40 |
50 |
|
|
||||||
|
|
|
|
1 < 3years to 1 year < 43 |
|
|
|
Fig.16. If one can realize the reduction to three incident points then we obtain the curve similar to the curve depicted on the previous figure. This reduction is realized for the mean temperature belonging to the North hemisphere (NH). The temperatures Tup and Tdn show the limits of deviation of the central curve from its mean position.
Fig.17. These plots demonstrate the reduction to three points for the mean temperature belonging to the South Hemisphere (SH). As before the temperatures the curves Tup and Tdn demonstrate the limits of deviation of the central curve from its mean position.
30
