Skip to main content

On Logarithmically Asymptotically Optimal Testing of Hypotheses and Identification

  • Chapter
General Theory of Information Transfer and Combinatorics

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4123))

Abstract

We introduce a new aspect of the influence of the information-theoretical methods on the statistical theory. The procedures of the probability distributions identification for K(≥1) random objects each having one from the known set of M(≥2) distributions are studied. N-sequences of discrete independent random variables represent results of N observations for each of K objects. On the base of such samples decisions must be made concerning probability distributions of the objects. For \(N \longrightarrow \infty\) the exponential decrease of the test’s error probabilities is considered. The reliability matrices of logarithmically asymptotically optimal procedures are investigated for some models and formulations of the identification problems. The optimal subsets of reliabilities which values may be given beforehand and conditions guaranteeing positiveness of all the reliabilities are investigated.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Rao, R.C.: Linear Statistical Inference and its Applications. Wiley, New York (1965)

    MATH  Google Scholar 

  2. Bechhofer, R.E., Kiefer, J., Sobel, M.: Sequential Identification and Ranking Procedures. The University of Chicago Press, Chicago (1968)

    Google Scholar 

  3. Ahlswede, R., Wegener, I.: Search Problems. Wiley, New York (1987)

    MATH  Google Scholar 

  4. Ahlswede, R., Dueck, G.: Identification via channels. IEEE Trans. Inform. Theory 35(1), 15–29 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  5. Ahlswede, R.: General theory of information transfer, Preprint 97–118, SFB 343 Diskrete Strukturen in der Mathematik, Universität Bielefeld (1997); General theory of information transfer: updated, General Theory of Information Transfer and Combinatorics, a Special Issue of Discrete Applied Mathematics (to appear)

    Google Scholar 

  6. Hoeffding, W.: Asymptotically optimal tests for multinomial distributions. Annals. of Math. Statist. 36, 369–401 (1965)

    Article  MATH  MathSciNet  Google Scholar 

  7. Csiszár, I., Longo, G.: On the error exponent for source coding and for testing simple statistical hypotheses. Studia Sc. Math. Hungarica 6, 181–191 (1971)

    Google Scholar 

  8. Tusnady, G.: On asymptotically optimal tests. Annals of Statist. 5(2), 385–393 (1977)

    Article  MATH  MathSciNet  Google Scholar 

  9. Longo, G., Sgarro, A.: The error exponent for the testing of simple statistical hypotheses, a combinatorial approach. J. of Combin. Inform. Sys. Sc. 5(1), 58–67 (1980)

    MATH  MathSciNet  Google Scholar 

  10. Birgé, L.: Vitesse maximales de décroissance des erreurs et tests optimaux associés, Z. Wahrsch. verw Gebiete 55, 261–273 (1981)

    Article  MATH  MathSciNet  Google Scholar 

  11. Haroutunian, E.A.: Logarithmically asymptotically optimal testing of multiple statistical hypotheses. Problems of Control and Inform. Theory 19(5-6), 413–421 (1990)

    MATH  MathSciNet  Google Scholar 

  12. Csiszár, I., Körner, J.: Information Theory: Coding Theorems for Discrete Memoryless Systems. Academic Press, New York (1981)

    MATH  Google Scholar 

  13. Csiszár, I.: Method of types. IEEE Trans. Inform. Theory 44(6), 2505–2523 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  14. Natarajan, S.: Large deviations, hypotheses testing, and source coding for finite Markov chains. IEEE Trans. Inform. Theory 31(3), 360–365 (1985)

    Article  MATH  MathSciNet  Google Scholar 

  15. Haroutunian, E.A.: On asymptotically optimal testing of hypotheses concerning Markov chain (in Russian). Izvestia Acad. Nauk Armenian SSR. Seria Mathem. 22(1), 76–80 (1988)

    Google Scholar 

  16. Gutman, M.: Asymptotically optimal classification for multiple test with empirically observed statistics. IEEE Trans. Inform. Theory 35(2), 401–408 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  17. Blahut, R.E.: Principles and Practice of Information Theory. Addison-Weslay, Massachusetts (1987)

    MATH  Google Scholar 

  18. Blahut, R.E.: Hypotheses testing and information theory. IEEE Trans. Inform Theory 20(4), 405–417 (1974)

    Article  MATH  MathSciNet  Google Scholar 

  19. Fu, F.W., Shen, S.Y.: Hypothesis testing for arbitrarily varying source with exponents type constraint. IEEE Trans. Inform. Theory 44(2), 892–895 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  20. Ahlswede, R., Csiszár, I.: Hypotheses testing with communication constraints. IEEE Trans. Inform. Theory 32(4), 533–542 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  21. Han, T.S., Kobayashi, K.: Exponential-type error probabilities for multiterminal hypothesis testing. IEEE Trans. Inform. Theory 35(1), 2–13 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  22. Berger, T.: Decentralized estimation and decision theory. In: IEEE Seven Springs Workshop on Information Theory, Mt. Kisco, NY (September 1979)

    Google Scholar 

  23. Zhang, Z., Berger, T.: Estimation via compressed information. IEEE Trans. Inform. Theory 34(2), 198–211 (1988)

    Article  MATH  MathSciNet  Google Scholar 

  24. Ahlswede, R., Burnashev, M.: On minimax estimation in the presence of side information about remote data. Annals of Statist. 18(1), 141–171 (1990)

    Article  MATH  MathSciNet  Google Scholar 

  25. Han, T.S., Amari, S.: Statistical inference under multiterminal data compression. IEEE Trans. Inform. Theory 44(6), 2300–2324 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  26. Ahlswede, R., Yang, E., Zhang, Z.: Identification via compressed data. IEEE Trans. Inform. Theory 43(1), 48–70 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  27. Borovkov, A.A.: Mathematical Statistics (in Russian), Nauka, Novosibirsk (1997)

    Google Scholar 

  28. Ihara, S.: Information Theory for Continuous Systems. World Scientific, Singapore (1993)

    MATH  Google Scholar 

  29. Chen, P.N.: General formulas for the Neyman-Pearson type-II error exponent subject to fixed and exponential type-I error bounds. IEEE Trans. Inform. Theory 42(1), 316–323 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  30. Han, T.S.: Information-Spectrum Methods in Information Theory. Springer, Berlin (2003)

    MATH  Google Scholar 

  31. Han, T.S.: Hypothesis testing with the general source. IEEE Trans. Inform. Theory 46(7), 2415–2427 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  32. Maurer, U.M.: Authentication theory and hypothesis testing. IEEE Trans. Inform. Theory 46(4), 1350–1356 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  33. Cachin, C.: An information-theoretic model for steganography. In: Aucsmith, D. (ed.) IH 1998. LNCS, vol. 1525, p. 306. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Ahlswede, R., Haroutunian, E. (2006). On Logarithmically Asymptotically Optimal Testing of Hypotheses and Identification. In: Ahlswede, R., et al. General Theory of Information Transfer and Combinatorics. Lecture Notes in Computer Science, vol 4123. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11889342_33

Download citation

  • DOI: https://doi.org/10.1007/11889342_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-46244-6

  • Online ISBN: 978-3-540-46245-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics