Stochastic time series.

1
Stochastic time series.
Random process. an infinite collection of
consistent distributions probabilities
exist Random function. a family of random
variables, e.g. Y(t), t in Z
2
Specified if given F(y1,...,ynt1 ,...,tn )
ProbY(t1)?y1,...,Y(tn )?yn that are
symmetric F(?y?t) F(yt), ? a
permutation compatible F(y1 ,...,ym
,?,...,?t1,...,tm,tm1,...,tn
F(y1,...,ymt1,...,tm)
3
Finite dimensional distributions
First-order F(yt) ProbY(t) ? t
Second-order F(y1,y2t1,t2)
ProbY(t1) ? y1 and Y(t2) ? y2 and so on
4
Other methods i) Y(t?), ? random
variable ii) urn model iii) probability on
function space iv) analytic formula
Y(t) ? cos(?t ?) ? fixed
? uniform on (-?,?
5
There may be densities The Y(t) may be discrete,
angles, proportions, ... Kolmogorov extension
theorem. To specify a stochastic process give the
distribution of any finite subset
Y(?1),...,Y(?n) in a consistent way, ? in A
6
Moment functions.
Mean function cY(t) EY(t) ? y dF(yt)
? y f(yt) dy
if continuous ?
yjf(yj t) if discrete E?1Y1(t)
?2Y2(t) ?1c1(t) ?2c2(t) vector-valued
case mean level - signal plus noise S(t) ?(t)
S(.) fixed
7
Second-moments.
autocovariance function cYY(s,t)
covY(s),Y(t) EY(s)Y(t) - EY(s)EY(t)
non-negative definite ?? ?j?kcYY(tj ,
tk ) ? 0 scalars ? crosscovariance
function c12(s,t) covY1(s),Y2(t)
8
Stationarity.
Joint distributions, Y(tu1),...,Y(tuk-1),Y
(t), do not depend on t for k1,2,... Often
reasonable in practice - for some time
stretches Replaces "identically distributed"
9
mean EY(t) cY for t in
Z autocovariance function covY(tu),Y(t)
cYY(u) t,u in Z u lag
EY(tu)Y(t) if mean
0 autocorrelation function ?(u)
corrY(tu),Y(t), ?(u) ? 1 crosscovariance
function covX(tu),Y(t) cXY(u)
10
Higher order moments and cumulants.
multilinear functional 0 if some subset of
variantes independent of rest 0 of order gt
2 for normal normal is determined by its
moments
11
Product moment functions. mY...Y (t1
,...,tk ) EY(t1 )...Y(tk ) Cumulant
functions. cY...Y (t1 ,...,tk ) cumY(t1
),...,Y(tk )