- •Distribution Overview
- •Discrete Distributions
- •Continuous Distributions
- •Probability Theory
- •Random Variables
- •Transformations
- •Expectation
- •Variance
- •Inequalities
- •Distribution Relationships
- •Probability and Moment Generating Functions
- •Multivariate Distributions
- •Standard Bivariate Normal
- •Bivariate Normal
- •Multivariate Normal
- •Convergence
- •Statistical Inference
- •Point Estimation
- •Empirical distribution
- •Statistical Functionals
- •Parametric Inference
- •Method of Moments
- •Maximum Likelihood
- •Delta Method
- •Multiparameter Models
- •Multiparameter delta method
- •Parametric Bootstrap
- •Hypothesis Testing
- •Bayesian Inference
- •Credible Intervals
- •Function of parameters
- •Priors
- •Conjugate Priors
- •Bayesian Testing
- •Exponential Family
- •Sampling Methods
- •The Bootstrap
- •Rejection Sampling
- •Importance Sampling
- •Decision Theory
- •Risk
- •Admissibility
- •Bayes Rule
- •Minimax Rules
- •Linear Regression
- •Simple Linear Regression
- •Prediction
- •Multiple Regression
- •Model Selection
- •Non-parametric Function Estimation
- •Density Estimation
- •Histograms
- •Kernel Density Estimator (KDE)
- •Smoothing Using Orthogonal Functions
- •Stochastic Processes
- •Markov Chains
- •Poisson Processes
- •Time Series
- •Stationary Time Series
- •Estimation of Correlation
- •Detrending
- •ARIMA models
- •Causality and Invertibility
- •Spectral Analysis
- •Math
- •Gamma Function
- •Beta Function
- •Series
- •Combinatorics
21 Time Series
Mean function
Z 1
xt = E [xt] = |
xft(x) dx |
|
1 |
Autocovariance function
x(s; t) = E [(xs s)(xt t)] = E [xsxt] s t
x(t; t) = E (xt t)2 = V [xt]
Autocorrelation function (ACF)
(s; t) = |
Cov [xs; xt] |
= |
|
(s; t) |
|||
p |
V [xs] V [xt] |
|
p |
(s; s) (t; t) |
|
||
Cross-covariance function (CCV) |
|
|
|
|
xy(s; t) = E [(xs xs )(yt yt )]
Cross-correlation function (CCF)
xy(s; t) = p
xy(s; t)
x(s; s) y(t; t)
Backshift operator
Bk(xt) = xt k
Di erence operator
rd = (1 B)d
White noise
wt wn(0; w2 )
|
Gaussian: wt |
iid |
|
0; 2 |
|
E [wt] = 0 t |
TN |
w |
|||
|
|
2 |
|
|
|
V [wt] = 2 t 2 T
w(s; t) = 0 s 6= t ^ s; t 2 T
Random walk |
|
|
Drift |
t |
j |
Et[xt] = tPj=1 |
||
x = t + |
|
w |
Symmetric moving average
|
k |
k |
|
X |
X |
mt = |
ajxt j where aj = a j 0 and |
aj = 1 |
|
j= k |
j= k |
21.1Stationary Time Series
Strictly stationary
P [xt1 c1; : : : ; xtk ck] = P [xt1+h c1; : : : ; xtk+h ck]
8k 2 N; tk; ck; h 2 Z
Weakly stationary
|
E |
xt2 |
= m |
t 2 Z |
|
|
|
|
E |
xt2 |
< 1 8t 2 Z |
|
|
|
|
||
|
x(s; |
t) = x(s +8r; t + r) |
8 |
r; s; t |
2 |
Z |
||
|
|
|
|
|
|
|
Autocovariance function
(h) = E [(xt+h )(xt )] |
|
8h 2 Z |
|
|
|
||||||||
(0) |
= E (xt |
|
)2 |
|
|
|
|
|
|
|
|||
(0) |
|
0 |
|
|
|
|
|
|
|
|
|||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
(0) |
j (h)j |
|
|
|
|
|
|
|
|
|
|
|
|
(h) = ( h) |
|
|
|
|
|
|
|
|
|
|
|
||
Autocorrelation function (ACF) |
|
|
|
|
|
|
|||||||
|
x(h) = |
|
|
Cov [xt+h; xt] |
= |
|
(t + h; t) |
= |
(h) |
||||
|
|
p |
|
p |
|
|
(0) |
||||||
|
|
V [xt+h] V [xt] |
(t + h; t + h) (t; t) |
|
Jointly stationary time series
xy(h) = E [(xt+h x)(yt y)]
xy(h) = p
xy(h)
x(0) y(h)
Linear process
|
1 |
1 |
|
|
X |
X |
j jj < 1 |
xt = + |
jwt j |
where |
|
|
j=1 |
j=1 |
|
|
|
1 |
|
|
(h) = w2 |
X |
|
|
j+h j |
|
|
|
|
j=1 |
|
23