Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones (Author), Peter Smith

Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones (Author), Peter Sm




SOLUTION
MANUAL

,Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones
(Author), Peter Smith




Stochastic Processes: An Introduction
Solutions Manual
Third Edition

c Peter W Jones and Peter Smith
⃝

School of Computing and Mathematics, Keele University, UK




Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones
(Author), Peter Smith

,Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones
(Author), Peter Smith




Preface

The website includes answers and solutions of all the end-of-chapter problems in the textbook
Stochastic Processes: An Introduction, third edition. We hope that they will prove helpful to
lecturers in designing courses, and to students as a source of model examples. The original problems
as numbered in the text are also included.
There are obviously references to results and examples from the textbook, and the manual
should be viewed as a supplement to the book. To help identify the sections and chapters, the full
contents of Stochastic Processes follow this preface.
Every effort has been made to eliminate misprints or errors (or worse), and the authors, who
were responsible for the LaTeX code, apologise in advance for any which occur.

Peter W. Jones
Peter Smith Keele, 2017




1

, Solutions Manual for Stochastic Processes An Introduction 3rd Edition by Peter Watts Jones
(Author), Peter Smith




Contents of Stochastic Processes

Chapter 1: Some Background in Probability
1.1 Introduction
1.2 Probability
1.3 Conditional probability and independence
1.4 Discrete random variables
1.5 Continuous random variables
1.6 Mean and variance
1.7 Some standard discrete probability distributions
1.8 Some standard continuous probability distributions
1.9 Generating functions
1.10 Conditional expectation
Problems

Chapter 2: Some Gambling Problems
2.1 Gambler’s ruin
2.2 Probability of ruin
2.3 Some numerical simulations
2.4 Expected duration of the game
2.5 Some variations of gambler’s ruin
2.5.1 The infinitely rich opponent
2.5.2 The generous gambler
2.5.3 Changing the stakes
Problems

Chapter 3: Random Walks
3.1 Introduction
3.2 Unrestricted random walks
3.3 Probability distribution after n steps
3.4 First returns of the symmetric random walk
Problems

Chapter 4: Markov Chains
4.1 States and transitions
4.2 Transition probabilities
4.3 General two-state Markov chain
4.4 Powers of the transition matrix for the m-state chain
4.5 Gambler’s ruin as a Markov chain
4.6 Classification of states
4.7 Classification of chains
4.8 A wildlife Markov chain model
Problems

Chapter 5: Poisson Processes
5.1 Introduction
5.2 The Poisson process
5.3 Partition theorem approach
5.4 Iterative method
5.5 The generating function
5.6 Variance for the Poisson process


2