The purpose of this excellent graduate-level text is twofold: first, to present a nonmeasure-theoretic introduction to Markov processes, and second, to give a formal treatment of mathematical models based on this theory, which have been employed in various fields. Since the main emphasis is on applications, the book is intended both as a text and reference in applied probability theory. Prerequisites are a knowledge of elementary probability theory, mathematical statistics and analysis.