Skip to main content
SpringerLink
Log in

Reliability of Semi-Markov Systems

  • Chapter
  • First Online:
Applied Nonparametric Statistics in Reliability

Part of the book series: Springer Series in Reliability Engineering ((RELIABILITY))

  • 1919 Accesses

Abstract

The purpose of this chapter is to present the reliability analysis of semi-Markov systems. The underconsideration semi-Markov processes are both of continuous and discrete time with countable or finite state space and of general state space. The basic definitions of Markov renewal and semi-Markov processes are presented, as well as the Markov renewal theorem and the basic statistical estimation theory. We describe a general reliability model and give corresponding estimators and their properties.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aalen O, Borgan O, Gjessing H (2008) Survival and event history analysis. Springer, New York

    Book  MATH  Google Scholar 

  2. Akritas MG, Roussas GG (1980) Asymptotic inference in continuous time semi-Markov processes. Scand J Stat 7:73–79

    MATH  MathSciNet  Google Scholar 

  3. Anisimov VV (2008) Switching processes in queueing models. ISTE–J. Wiley, Applied Stochastic Methods Series, London

    Google Scholar 

  4. Asmussen S (1987) Applied probability and queues. Wiley, Chichester

    MATH  Google Scholar 

  5. Aven T, Jensen U (1999) Stochastic models in reliability. Springer, New York

    Book  MATH  Google Scholar 

  6. Barbu V, Limnios N (2008) Semi-Markov chains and hidden semi-Markov models. Toward applications. Their use in reliability and DNA analysis. Lecture notes in statistics, vol 191. Springer, New York

    Google Scholar 

  7. Barbu V, Limnios N (2010) Some algebraic methods in semi-Markov chains. Contemp Math AMS 516:19–35

    MathSciNet  Google Scholar 

  8. Barlow RE, Prochan F (1975) Statistical theory of reliability and life testing: probability models. Holt, Rinehart and Winston, New York

    Google Scholar 

  9. Chiquet J, Limnios N (2008) A method to compute the reliability of a piecewise deterministic Markov process. Stat Probab Lett 78:1397–1403

    Article  MATH  MathSciNet  Google Scholar 

  10. Chryssaphinou O, Karaliopoulou M, Limnios N (2008) On discrete time semi-Markov chains and applications in words occurrences. Commun Stat Theory Methods 37:1306–1322

    Article  MATH  MathSciNet  Google Scholar 

  11. Çinlar E (1969) Markov renewal theory. Adv Appl Probab 1:123–187

    Article  MATH  Google Scholar 

  12. Çinlar E (1975) Introduction to stochastic processes. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  13. Cox DR (1955) The analysis of non-Markovian stochastic processes by the inclusion of supplementary variables. Proc Camb Philos Soc 51:433–441

    Article  MATH  Google Scholar 

  14. Csenki A (1995) Dependability for systems with a partitioned state space. Lecture notes in statistics, vol 90. Springer, Berlin

    Google Scholar 

  15. Devooght J (1997) Dynamic reliability. Adv Nucl Sci Technol 25:215–278

    Article  Google Scholar 

  16. Esary JD, Marshal AW, Proschan F (1973) Shock models and wear processes. Ann Probab 1:627–649

    Article  MATH  Google Scholar 

  17. Feller W (1964) On semi-Markov processes. Proc Natl Acad Sci USA 51(2):653–659

    Article  MATH  MathSciNet  Google Scholar 

  18. Gertsbakh I (2000) Reliability theory—with applications to preventive maintenance. Springer, Berlin

    MATH  Google Scholar 

  19. Gikhman II, Skorokhod AV (1974) Theory of stochastic processes, vol 2. Springer, Berlin

    MATH  Google Scholar 

  20. Gill RD (1980) Nonparametric estimation based on censored observations of a Markov renewal process. Z Wahrsch verw Gebiete 53:97–116

    Article  MATH  MathSciNet  Google Scholar 

  21. Girardin V, Limnios N (2006) Entropy for semi-Markov processes with Borel state spaces: asymptotic equirepartition properties and invariance principles. Bernoulli 12(3):515–533

    Article  MATH  MathSciNet  Google Scholar 

  22. Greenwood PE, Wefelmeyer W (1996) Empirical estimators for semi-Markov processes. Math Methods Stat 5(3):299–315

    MATH  MathSciNet  Google Scholar 

  23. Grigorescu S, Oprişan G (1976) Limit theorems for J-X processes with a general state space. Z Wahrsch verw Gebiete 35:65–73

    Article  MATH  Google Scholar 

  24. Gyllenberg M, Silvestrov DS (2008) Quasi-stationary phenomena in nonlinearly perturbed stochastic systems. de Gruyter, Berlin

    Book  Google Scholar 

  25. Harlamov BP (2008) Continuous semi-Markov processes. ISTE–J. Applied Stochastic Methods Series, Wiley, London

    Google Scholar 

  26. Huzurbazar AV (2004) Flowgraph models for multistate time-to-event data. Wiley, New York

    Book  Google Scholar 

  27. Iosifescu M, Limnios N, Oprişan G (2010) Introduction to stochastic models. Iste, Wiley, London

    MATH  Google Scholar 

  28. Janssen J (ed) (1986) Semi-Markov models. Theory and applications. Plenum Press, New York

    Google Scholar 

  29. Janssen J, Limnios N (eds) (1999) Semi-Markov models and applications. Kluwer, Dordrecht

    MATH  Google Scholar 

  30. Janssen J, Manca R (2006) Applied semi-Markov processes. Springer, New York

    MATH  Google Scholar 

  31. Keilson J (1979) Markov chains models—rarity and exponentiality. Springer, New York

    Google Scholar 

  32. Korolyuk VS, Limnios N (2004) Average and diffusion approximation for evolutionary systems in an asymptotic split phase space. Ann Appl Probab 14(1):489–516

    Article  MATH  MathSciNet  Google Scholar 

  33. Korolyuk VS, Limnios N (2005) Stochastic systems in merging phase space. World Scientific, Singapore

    Book  Google Scholar 

  34. Korolyuk VS, Turbin AF (1993) Mathematical foundations of the state lumping of large systems. Kluwer, Dordrecht

    MATH  Google Scholar 

  35. Korolyuk VS, Swishchuk A (1995) Semi-Markov random evolution. Kluwer, Dordrecht

    Google Scholar 

  36. Kovalenko IN, Kuznetsov NYu, Pegg PA (1997) Mathematical theory of reliability of time dependent systems with practical applications. Wiley, Chichester

    MATH  Google Scholar 

  37. Lagakos SW, Sommer CJ, Zelen M (1978) Semi-Markov models for partially censored data. Biometrika 65(2):311–317

    Article  MATH  MathSciNet  Google Scholar 

  38. Limnios N (2004) A functional central limit theorem for the empirical estimator of a semi-Markov kernel. J Nonparametr Stat 16(1–2):13–18

    Article  MATH  MathSciNet  Google Scholar 

  39. Limnios N (2006) Estimation of the stationary distribution of semi-Markov processes with Borel state space. Stat Probab Lett 76:1536–1542

    Article  MATH  MathSciNet  Google Scholar 

  40. Limnios N (2010) Semi-Markov processes and hidden models, EORMS Encyclopedia of operation research and management science. Wiley, New York

    Google Scholar 

  41. Limnios N (2011) Reliability measures of semi-Markov systems with general state space. Methodology and Computing in Applied Probability, doi: 10.1007/s11009-011-9211-5

  42. Limnios N, Nikulin M (eds) (2000) Recent advances in reliability theory: methodology, practice and inference. Birkhäuser, Boston

    MATH  Google Scholar 

  43. Limnios N, Oprişan G (2001) Semi-Markov processes and reliability. Birkhäuser, Boston

    MATH  Google Scholar 

  44. Limnios N, Ouhbi B (2003) Empirical estimators of reliability and related functions for semi-Markov systems. In: Lindqvist B, Doksum K (eds) Mathematical and statistical methods in reliability. World Scientific, Singapore

    Google Scholar 

  45. Limnios N, Ouhbi B (2006) Nonparametric estimation of some important indicators in reliability for semi-Markov processes. Stat Methodol 3(4):341–350

    Article  MathSciNet  Google Scholar 

  46. Lisnianski A, Levitin G (2003) Multi-state system reliability. World Scientific, Singapore

    MATH  Google Scholar 

  47. Moore EH, Pyke R (1968) Estimation of the transition distributions of a Markov renewal process. Ann Inst Stat Math 20:411–424

    Article  MATH  MathSciNet  Google Scholar 

  48. Osaki S (1985) Stochastic system reliability modeling. World Scientific, Singapore

    MATH  Google Scholar 

  49. Ouhbi B, Limnios N (1999) Nonparametric estimation for semi-Markov processes based on its hazard rate functions. Stat Inference Stoch Process 2(2):151–173

    Article  MATH  MathSciNet  Google Scholar 

  50. Ouhbi B, Limnios N (2003) Nonparametric reliability estimation of semi-Markov processes. J Stat Plann Inference 109(1/2):155–165

    Article  MATH  MathSciNet  Google Scholar 

  51. Ouhbi B, Limnios N (2002) The rate of occurrence of failures for semi-Markov processes and estimation. Stat Probab Lett 59(3):245–255

    Article  MATH  MathSciNet  Google Scholar 

  52. Pérez-Ocón R, Torres-Castro I (2002) A reliability semi-Markov model involving geometric processes. Appl Stoch Models Bus Ind 18:157–70

    Article  MATH  MathSciNet  Google Scholar 

  53. Prabhu NU (1980) Stochastic storage processes. Springer, Berlin

    MATH  Google Scholar 

  54. Pyke R (1961) Markov renewal processes: definitions and preliminary properties. Ann Math Stat 32:1231–1242

    Article  MATH  MathSciNet  Google Scholar 

  55. Pyke R (1961) Markov renewal processes with finitely many states. Ann Math Stat 32:1243–1259

    Article  MathSciNet  Google Scholar 

  56. Pyke R, Schaufele R (1964) Limit theorems for Markov renewal processes. Ann Math Stat 35:1746–1764

    Article  MATH  MathSciNet  Google Scholar 

  57. Pyke R, Schaufele R (1967) The existence and uniqueness of stationary measures for Markov renewal processes. Ann Stat 37:1439–1462

    MathSciNet  Google Scholar 

  58. Revuz D (1975) Markov chains. North-Holland, Amsterdam

    MATH  Google Scholar 

  59. Ross SM (1970) Applied probability models with optimization applications. Holden-Day, San Francisco

    MATH  Google Scholar 

  60. Shurenkov VM (1984) On the theory of Markov renewal. Theory Probab Appl 29:247–265

    Article  MathSciNet  Google Scholar 

  61. Silvestrov DS (1996) Recurrence relations for generalized hitting times for semi-Markov processes. Ann Appl Probab 6(2):617–649

    Article  MATH  MathSciNet  Google Scholar 

  62. Trevezas S, Limnios N (2009) Maximum likelihood estimation for general hidden semi-Markov processes with backward recurrence time dependence. In: Notes of scientific seminars of the St. Petersburg Department of the Steklov Mathematical Institute, Russian Academy of Sciences, vol 363, pp 105–125, and J Math Sci, special issue in honor of I. Ibragimov

    Google Scholar 

  63. Wilson A, Limnios N, Keller-McNulty S, Armijo Y (eds) (2005) Modern statistical and mathematical methods in reliability. Series on quality, reliability, engineering statistics. World Scientific, Singapore

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Facultad Ciencias, Depto. Estadistica e Investigacion Operativa, Universidad Granada, Campus Univ. Fuentenueva, 18071, Granada, Spain

    Assoc. Prof. M. Luz Gámiz

  2. Department of Mathematical Sciences, Clemson University, Clemson, SC, 29634-1907, USA

    Prof. K. B. Kulasekera

  3. Centre de Recherches de Royallieu, Laboratoire de Mathématiques Appliquées, Université de Technologie de Compiègne, BP 20529 , 60205, Compiègne, France

    Prof. Nikolaos Limnios

  4. Department of Mathematical Sciences, Norwegian University of Science and Technology, 7491, Trondheim, Norway

    Prof. Bo Henry Lindqvist

Authors
  1. Assoc. Prof. M. Luz Gámiz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Prof. K. B. Kulasekera
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Prof. Nikolaos Limnios
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Prof. Bo Henry Lindqvist
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Luz Gámiz .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Gámiz, M.L., Kulasekera, K.B., Limnios, N., Lindqvist, B.H. (2011). Reliability of Semi-Markov Systems. In: Applied Nonparametric Statistics in Reliability. Springer Series in Reliability Engineering. Springer, London. https://doi.org/10.1007/978-0-85729-118-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-118-9_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-117-2

  • Online ISBN: 978-0-85729-118-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation