Skip to main content

An Universal Predictor Based on Pattern Matching: Preliminary results 1

  • Conference paper
Mathematics and Computer Science

Part of the book series: Trends in Mathematics ((TM))

Abstract

We consider here an universal predictor based on pattern matching. For a given string x1, x2…, xn, the predictor will guess the next symbol xn+1 in such a way that the prediction error tends to zero as n →∞ provided the string x n1 = x1, x2, …, xn, is generated by a mixing source. We shall prove that the rate of convergence of the prediction error is 0(n) for any ε > 0. In this preliminary version, we only prove our results for memoryless sources and a sketch for mixing sources. However, we indicate that our algorithm can predict equally successfully the next k symbols as long as k= 0(1).

1 This work was supported by Purdue Grant GIFG-9919.

2 Additional support by the ESPRIT Basic Research Action No. 7141 (ALcom II).

3 This author was additionally supported by NSF Grants NCR-9415491 and C-CR-9804760.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. Algoet, Universal Schemes for Prediction, Gambling and Portfolio Selection, Ann. Prob, 20, 901–941, 1992.

    Article  MathSciNet  MATH  Google Scholar 

  2. T.M. Cover and J.A. Thomas, Elements of Information Theory,John Wiley&Sons, New York (1991).

    Book  MATH  Google Scholar 

  3. A. Ehrenfeucht and J. Mycielski, A Pseudorandom Sequence —How Random Is It? Amer. Math. Monthly,99, 373–375, 1992

    Article  MathSciNet  Google Scholar 

  4. M. Feder, N. Merhav, and M. Gutman, Universal Prediction of Individual Sequences, IEEE Trans. Information Theory,38, 1258–1270, 1992.

    Article  MathSciNet  MATH  Google Scholar 

  5. P. Jacquet, Average Case Analysis of Pattern Matching Predictor, INRIA TR, 1999.

    Google Scholar 

  6. J. Kieffer, Prediction and Information Theory, preprint, 1998.

    Google Scholar 

  7. K. Marton and P. Shields, The Positive-Divergence and Blowing-up Properties, Israel J. Math,80, 331–348 (1994).

    Article  MathSciNet  Google Scholar 

  8. N. Merhav, M. Feder, and M. Gutman, Some Properties of Sequential Predictors for Binary Markov Sources, IEEE Trans. Information Theory, 39, 887–892, 1993.

    Article  MathSciNet  MATH  Google Scholar 

  9. N. Merhav, M. Feder, Universal Prediction, IEEE Trans. Information Theory, 44, 2124–2147, 1998.

    Article  MathSciNet  MATH  Google Scholar 

  10. G. Moravi, S. Yakowitz, and P. Algoet, Weak Convergent Nonparametric Forecasting of Stationary Time Series, IEEE Trans. Information Theory

    Google Scholar 

  11. J. Rissanen, Complexity of Strings in the Class of Markov Sources, IEEE Trans. Information Theory, 30, 526–532, 1984.

    Article  MathSciNet  Google Scholar 

  12. J. Rissanen, Universal Coding, Information, Prediction, and Estimation, IEEE Trans. Information Theory,30, 629–636, 1984.

    Article  MathSciNet  MATH  Google Scholar 

  13. B. Ryabko, Twice-Universal Coding, Problems of Information Transmission, 173–177, 1984.

    Google Scholar 

  14. B. Ryabko, Prediction of Random Sequences and Universal Coding, Problems of Information Transmission, 24, 3–14, 1988.

    MathSciNet  Google Scholar 

  15. B. Ryabko, The Complexity and Effectiveness of Prediction Algorithms, J. Complexity,10, 281–295, 1994.

    Article  MathSciNet  MATH  Google Scholar 

  16. C. Shannon, Prediction and Entropy of Printed English, Bell System Tech. J, 30, 50–64, 1951.

    MATH  Google Scholar 

  17. W. Szpankowski, A Generalized Suffix Tree and Its (Un)Expected Asymptotic Behaviors, SIAM J. Compt, 22, 1176–1198, 1993.

    Article  MathSciNet  MATH  Google Scholar 

  18. W. Szpankowski, Average Case Analysis of Algorithms on Sequences, John Wiley & Sons, New York 2000 (to appear).

    Google Scholar 

  19. J. Vitter and P. Krishnan, Optimal Prefetching via Data Compression, J. ACM,43, 771–793, 1996.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer Basel AG

About this paper

Cite this paper

Jacquet, P., Szpankowski, W., Apostol, I. (2000). An Universal Predictor Based on Pattern Matching: Preliminary results 1 . In: Gardy, D., Mokkadem, A. (eds) Mathematics and Computer Science. Trends in Mathematics. Birkhäuser, Basel. https://doi.org/10.1007/978-3-0348-8405-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-0348-8405-1_7

  • Publisher Name: Birkhäuser, Basel

  • Print ISBN: 978-3-0348-9553-8

  • Online ISBN: 978-3-0348-8405-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics