Skip to main content

Basic Concepts from Probability Theory

  • Chapter
Stochastic Processes and Calculus

Part of the book series: Springer Texts in Business and Economics ((STBE))

  • 150k Accesses

Abstract

This chapter reviews some basic material. We collect some elementary concepts and properties in connection with random variables, expected values, multivariate and conditional distributions. Then we define stochastic processes, both discrete and continuous in time, and discuss some fundamental properties. For a successful study of the remainder of this book, the reader is required to be familiar with all of these principles.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Ross (2010) provides a nice introduction to probability, and so do Grimmett and Stirzaker (2001) with a focus on stochastic processes. For a short reference and refreshing e.g. the shorter appendix in Bickel and Doksum (2001) is recommended.

  2. 2.

    Sometimes also called a σ-field, which motivates the symbol F.

  3. 3.

    An example for this is the Cauchy distribution, i.e. the t-distribution with one degree of freedom. For the Pareto distribution, as well, the existence of moments is dependent on the parameter value; this is shown in Problem 2.2.

  4. 4.

    Then σ describes the square root of Var(X) with positive sign.

  5. 5.

    The traditional German spelling is Gauß. Carl Friedrich Gauß lived from 1777 to 1855 and was a professor in Göttingen. His name is connected to many discoveries and inventions in theoretical and applied mathematics. His portrait and a graph of the density of the normal distribution decorated the 10-DM-bill in Germany prior to the Euro.

  6. 6.

    Cf. Sydsæter, Strøm, and Berck (1999, p. 53). A proof is contained e.g. in the classical textbook by Rudin (1976, Thm. 10.2), or in Trench (2013, Coro. 7.2.2); the latter book may be recommended since it is downloadable free of charge.

  7. 7.

    Up to this point a superscript prime at a function has denoted its derivative. In the rare cases in which we are concerned with matrices or vectors, the symbol will also be used to indicate transposition. Bearing in mind the respective context, there should not occur any ambiguity.

  8. 8.

    The general statement is: for a convex function g it holds

    $$\displaystyle{ g\left (\mbox{ E}\,(X)\right ) \leq \mbox{ E}\,\left (g(X)\right )\,; }$$
    (2.7)

    see e.g. Sydsæter et al. (1999, p. 181), while a proof is given e.g. in Davidson (1994, Ch. 9) or Ross (2010, p. 409).

  9. 9.

    This is not a really rigorous way of introducing expectations conditioned on random variables. A mathematically correct exposition, however, requires measure theoretical arguments not being available at this point; cf. for example Davidson (1994, Ch. 10), or Klebaner (2005, Ch. 2). More generally, one may define expectations conditioned on a σ-algebra, \(\mbox{ E}(X\vert \mathcal{G})\), where \(\mathcal{G}\) could be the σ-algebra generated by Y: \(\mathcal{G} =\sigma (Y )\).

  10. 10.

    These “consistency” requirements due to Kolmogorov are found e.g. in Brockwell and Davis (1991, p. 11) or Grimmett and Stirzaker (2001, p. 372). A proof of Kolmogorov’s existence theorem can be found e.g. in Billingsley (1986, Sect. 36).

  11. 11.

    The convention of using upper case letters for continuous-time process is not universal.

  12. 12.

    The acronym stands for “independently identically distributed”.

  13. 13.

    By assumption, the information at an earlier point in time is contained in the information set at a subsequent point in time: \(\mathcal{I}_{t} \subseteq \mathcal{I}_{t+s}\) for s ≥ 0. A family of such nested σ-algebras is also called “filtration”.

  14. 14.

    We cannot prove the first statement rigorously, which would require a generalization of Proposition 2.1(a). The more general statement taken e.g. from Breiman (1992, Prop. 4.20) or Davidson (1994, Thm. 10.26) reads in our setting as

    $$\displaystyle{\mbox{ E}\left [\mbox{ E}(x_{t}\vert \mathcal{I}_{t-1})\vert x_{t-h}\right ] = \mbox{ E}(x_{t}\vert x_{t-h})\,.}$$

References

  • Bickel, P. J., & Doksum, K. A. (2001). Mathematical statistics: Basic ideas and selected topics, volume 1 (2nd ed.). Upper Saddle River: Prentice-Hall.

    Google Scholar 

  • Billingsley, P. (1986). Probability and measure (2nd ed.). New York: Wiley.

    Google Scholar 

  • Breiman, L. (1992). Probability (2nd ed.). Philadelphia: Society for Industrial and Applied Mathematics.

    Google Scholar 

  • Brockwell, P. J., & Davis, R. A. (1991). Time series: Theory and methods (2nd ed.). New York: Springer.

    Google Scholar 

  • Davidson, J. (1994). Stochastic limit theory: An introduction for econometricians. Oxford/New York: Oxford University Press.

    Google Scholar 

  • Grimmett, G. R., & Stirzaker, D. R. (2001). Probability and random processes (3rd ed.). Oxford: Oxford University Press.

    Google Scholar 

  • Klebaner, F. C. (2005). Introduction to stochastic calculus with applications (2nd ed.). London: Imperical College Press.

    Google Scholar 

  • Ross, S. (2010). A first course in probability (8th ed.). Upper Saddle River: Prentice-Hall.

    Google Scholar 

  • Rudin, W. (1976). Principles of mathematical analyis (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Sydsæter, K., Strøm, A., & Berck, P. (1999). Economists’ mathematical manual (3rd ed.). Berlin/New York: Springer.

    Google Scholar 

  • Trench, W. F. (2013). Introduction to real analysis. Free Hyperlinked Edition 2.04 December 2013. Downloaded on 10th May 2014 from http://digitalcommons.trinity.edu/mono/7.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Hassler, U. (2016). Basic Concepts from Probability Theory. In: Stochastic Processes and Calculus. Springer Texts in Business and Economics. Springer, Cham. https://doi.org/10.1007/978-3-319-23428-1_2

Download citation

Publish with us

Policies and ethics