Introduction to Models Stochastic Models

1
Introduction to Models- Stochastic Models

• Shane Whelan
• L527

2
Increments

• Consider Xtm Xt . This is known as an
  m-increment of the process.
• Xt1 Xt is simply known as an increment.
• Often defining how the process evolves through
  time is easier to get a handle onand a more
  natural description of the process (e.g.,
  evolution, many games, etc.)
• A process is said to have independent increments
  if Xtm Xt is independent of the past of the
  process for all t and m.
• A process is said to have stationary increments
  if the increments have the same distribution.

3
Stationarity

• Definition A stochastic process is said to be
  stationary if the joint distributions of Xt1,
  Xt2,,Xtn and Xk1, Xk2,,Xkn are the same
  for all t, k and all n.
• Hence statistical properties unaffected by a time
  shift.
• In particular, Xt and Xk have the same
  distribution
• In particular, the same mean and variance.
• Stationarity is a stringent requirement,
  difficult to test in practice.
• Note that the assumption of stationarity
  sweats the data allows max. use of available
  data.

4
Weak Stationarity

• Definition A stochastic process is said to be
  weakly stationary if
• EXtEXk for all t and k.
• CovXt , Xtm is a function only of m, for all
  t and m.
• Remarks
• Strong stationarity implies weak stationarity.
• Weak stationarity used extensively in time series
  analysis
• Remark Weak stationarity is not a foundational
  concept it says little enough about the
  underlying distribution and relationship
  structure. It is more practical, though.

5
Quick Questions

• Is the stochastic process of life stationary?
• Is White Noise stationary?
• Is a random walk stationary?
• Try to think of a stationary process which is not
  iid.

6
Quick Questions

• Question Let ltXtgt, t?Z such that ltXtgt is iid
  with EXt0 and EXt2lt?. Prove that the
  correlation between Xt-1 and (Xt-Xt-1) is
  -(2)-½.
• Hint There is only one way to really to start
  this question

7
The Markov Property

• When the future evolution of the system depends
  only on its current state it is not affected by
  the past the system has the Markov property.
• Definition Let ltXtgt, t? ? (the natural numbers)
  be a (discrete time) stochastic process. Then
  ltXtgt, is said to have the Markov property if, ?t
• PXt1 Xt, Xt-1,Xt-2,,X0PXt1 Xt.
• Definition Let ltXtgt, t? ? (the real numbers) be
  a (continuous time) stochastic process. Then
  ltXtgt, is said to have the Markov property if, ?t,
  and all sets A
• PXt?A Xs1x1, Xs2x2,,XsxPXt?AXsx
• Where s1lts2ltltsltt.

8
Markov Processes

• Definition A stochastic process that has the
  Markov property is known as a Markov process.
• If state space and time is discrete then process
  known as Markov chain (see Chapter 2).
• When state space is discrete but time is
  continuous then known as Markov jump process (see
  Chapter 3).

9
To Prove

• Lemma 1.1 A process with independent increments
  has the Markov Property.
• Proof On Board
• Lemma 1.2 Our definition of the Markov property
  (discrete time) is equivalent to
• PXt1 Xs, Xs-1,Xs-2,,X0PXt1 Xs, where
  s?t.
• Proof On Board

10

• Basic terminology
• Stochastic process sample path m-increment,
  stationary increment.
• Foundational concepts
• Stationary process weak stationarity Markov
  property martingale discrete time stopping
  time
• Some elementary examples
• White noise random walk moving average (MA).
• Some important practical examples
• Poisson process compound Poisson process
  Brownian motion (or Wiener Process).

11
More Special Processes MA(p)

• Let Z1,Z2,Z3, be white noise and let ?i be real
  numbers. Then Xn is a moving average process of
  order p iff
• Note process is stationary but not iid.
• Moving average processes are stationary but not,
  in general, Markovian.

12
Poisson Process

• Definition A Poisson process with rate ? is a
  continuous-time process Nt, t?0 such that
• N00
• ltNtgt has independent increments
• ltNtgt has Poisson distributed increments, i.e.,
• where n??

13
Remarks on Poisson Process

• Poisson Process is a Markov jump process, i.e.,
  Markovian with a discrete state space in
  continuous time.
• It is not even weakly stationary.
• Think of it as the stochastic generalisation of
  the deterministic natural numbers stochastic
  counting.
• A central process in insurance and finance due to
  role as the the natural stochastic counting
  process, e.g., number of claims.

14
Compound Poisson Process

• Definition Let ltNtgt be a Poisson process and
  let Z1,Z2,Z3,be white noise. Then Xt is said to
  be a compound Poisson process where
• With convention when Nt0 then Xt0.

15
Remarks on Compound Poisson Process

• We are stochastically counting incidences of an
  event with a stochastic payoff.
• Markov property holds.
• Important as model for cumulative claims on
  insurance companythe Cramér-Lundberg model
  after Lundbergs Uppsala thesis of 1903the
  basis of classical risk theory
• Key problem in classical risk theory is
  estimating the probability of ruin,
• i.e., ? s.t. ?(u)Puct-Xtlt0, for some tgt0.

16
Brownian Motion (or Wiener Process)

• Definition Brownian motion, Bt, t?0, is a
  stochastic process with state space ? (the real
  line) such that
• B00
• Bt has independent increments
• Bt-Bs is distributed N(?(t-s), ?2(t-s))
• Bt has continuous sample paths.

17
Remarks on Brownian Motion

• Guassian Normal
• ? is known as the drift.
• Standard Brownian motion is when B00, ?0, and
  ?21.
• Sample paths have no jumps.
• This is the continuous time analogue of a random
  walk (as well see in Semester 2).
• By CLT, Bt is the limiting continuous stochastic
  process for a wide class of discrete time
  processes.
• Simpler definition Brownian motion is a
  continuous process with independent Guassian
  increments.

18
Question 1-A

• Let Xt be a simple random walk with prob. of an
  upward move given by p. Calculate
• P(X22,X53X00)
• P(X20, X42X00)
• Is the random walk stationary?
• What is the joint distribution of X2,X4, given
  X00
• Prove that Xt has the Markov property

19
Completes Chapter 1