Skip to main content

Foundations of Probability

  • Chapter
  • First Online:
Mathematics for Econometrics

Abstract

Consider the problem of constructing a model of the process (experiment) of throwing a die and observing the outcome; in doing so, we need to impose on the experiment a certain probabilistic framework since the same die thrown under ostensibly identical circumstances, generally, yields different outcomes. The framework represents, primarily, the investigator’s view of the nature of the process, but it must also conform to certain logical rules.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Certain other usages are also common; thus the collection \(\mathcal{J}\) is also denoted by \(\mathcal{J} = \mathcal{A}_{1} \times \mathcal{A}_{2}\), which is to be distinguished from \(\mathcal{A}_{1} \otimes \mathcal{A}_{2}\), the latter being equal to \(\sigma (\mathcal{J} )\),

  2. 2.

    In this argument it is assumed that the collections \(Z_{\mathcal{C}},\ Z_{\mathcal{D}}\), are nonempty; otherwise there is nothing to prove. Evidently, if the collections \(\mathcal{C},\ \mathcal{D}\) are algebras then it is easy to see that \(Z_{\mathcal{C}},\ Z_{\mathcal{D}}\) are nonempty collections.

  3. 3.

    This is a consequence of the fact that if we have two (collections of) sets obeying \(\mathcal{C}_{1} \subset \mathcal{C}_{2}\) then the σ-algebras they generate obey \(\sigma (\mathcal{C}_{1}) \subset \sigma (\mathcal{C}_{2})\).

  4. 4.

    When the context is clear and no confusion is likely to arise we shall generally use the notation E  X.

  5. 5.

    In order to avoid this cumbersome phraseology in the future, when we say that X is a random variable, it is to be understood that we have predefined the appropriate probability and measurable spaces. Thus, mention of them will be suppressed.

  6. 6.

    It is a common practice that the subscript for the first moment is omitted for both scalar and vector random variables. We shall follow this practice unless reasons of clarity require otherwise.

  7. 7.

    For twice differentiable convex functions the matrix of the second order partial derivatives is positive semidefinite; for concave functions, it is negative semidefinite; in both cases this is to be understood in an a.e. sense.

  8. 8.

    This result is obtained by using a Taylor series expansion around the point x 0, retaining terms up to and including the second derivative (third term of the expansion).

  9. 9.

    Note that Ω j , j = 1, 2, are exact copies of the same space.

  10. 10.

    To connect this with the earlier discussion of the topic note that

    $$\displaystyle{P(D_{k}\mid D_{j2}) = \frac{P(D_{k} \cap D_{j2})} {P(D_{j2})} = P(D_{k-j,1} \cap D_{j2})/P(D_{j2}).}$$
  11. 11.

    These statements are to be understood in the a.c. sense, where appropriate.

Bibliography

  • Anderson, T.W. and H. Rubin (1949), Estimation of the Parameters of a Single Equation in a Complete System of Stochastic Equations, Annals of Mathematical Statistics, pp. 46–63.

    Google Scholar 

  • Anderson, T.W. and H. Rubin (1950), The Asymptotic Properties of Estimates of Parameters of in a Complete System of Stochastic Equations, Annals of Mathematical Statistics, pp. 570–582.

    Google Scholar 

  • Balestra, P., & Nerlove, M. (1966). Pooling cross section time series data in the estimation of a dynamic model: The demand for natural gas. Econometrica, 34, 585–612.

    Article  Google Scholar 

  • Bellman, R. G. (1960). Introduction to matrix analysis. New York: McGraw-Hill.

    MATH  Google Scholar 

  • Billingsley, P. (1968). Convergence of probability measures. New York: Wiley.

    MATH  Google Scholar 

  • Billingsley, P. (1995). Probability and measure (3rd ed.). New York: Wiley.

    MATH  Google Scholar 

  • Brockwell, P. J., & Davis, R. A. (1991). Time series: Theory and methods (2nd ed.). New York: Springer-Verlag.

    Book  Google Scholar 

  • Chow, Y. S., & Teicher, H. (1988). Probability theory (2nd ed.). New York: Springer-Verlag.

    Book  MATH  Google Scholar 

  • Dhrymes, P. J. (1969). Alternative asymptotic tests of significance and related aspects of 2SLS and 3SLS estimated parameters. Review of Economic Studies, 36, 213–226.

    Article  Google Scholar 

  • Dhrymes, P. J. (1970). Econometrics: Statistical foundations and applications. New York: Harper and Row; also (1974). New York: Springer-Verlag.

    Google Scholar 

  • Dhrymes, P. J. (1973). Restricted and Unrestricted Reduced Forms: Asymptotic Distributions and Relative Efficiencies, Econometrica, vol. 41, pp. 119–134.

    Article  MathSciNet  MATH  Google Scholar 

  • Dhrymes, P. J. (1978). Introductory economics. New York: Springer-Verlag.

    Book  Google Scholar 

  • Dhrymes, P.J. (1982) Distributed Lags: Problems of Estmation and Formulation (corrected edition) Amsterdam: North Holland

    Google Scholar 

  • Dhrymes, P. J. (1989). Topics in advanced econometrics: Probability foundations. New York: Springer-Verlag.

    Book  MATH  Google Scholar 

  • Dhrymes, P. J. (1994). Topics in advanced econometrics: Volume II linear and nonlinear simultaneous equations. New York: Springer-Verlag.

    Book  MATH  Google Scholar 

  • Hadley, G. (1961). Linear algebra. Reading: Addison-Wesley.

    MATH  Google Scholar 

  • Kendall, M. G., & Stuart, A. (1963). The advanced theory of statistics. London: Charles Griffin.

    Google Scholar 

  • Kendall M. G., Stuart, A., & Ord, J. K. (1987). Kendall’s advanced theory of statistics. New York: Oxford University Press.

    MATH  Google Scholar 

  • Kolassa, J. E. (1997). Series approximation methods in statistics (2nd ed.). New York: Springer-Verlag.

    Book  MATH  Google Scholar 

  • Sims, C.A. (1980). Macroeconomics and Reality, Econometrica, vol. 48, pp.1–48.

    Google Scholar 

  • Shiryayev, A. N. (1984). Probability. New York: Springer-Verlag.

    Book  MATH  Google Scholar 

  • Stout, W. F. (1974). Almost sure convergence. New York: Academic.

    MATH  Google Scholar 

  • Theil, H. (1953). Estimation and Simultaneous Correlation in Complete Equation Systems, mimeograph, The Hague: Central Plan Bureau.

    Google Scholar 

  • Theil, H. (1958). Economic Forecasts and Policy, Amsterdam: North Holland.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2013 the Author

About this chapter

Cite this chapter

Dhrymes, P.J. (2013). Foundations of Probability. In: Mathematics for Econometrics. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8145-4_8

Download citation

Publish with us

Policies and ethics