Abstract
A problem of estimation of states and parameters in stochastic dynamic systems of observation with discrete time containing a Markovian chain is studied. Matrices of transient probabilities and observation plans are random with unknown distribution with a given compact carrier. Observations, on the basis of which the estimation is made, are available at a fixed interval of time [0, T]. As a loss function, we have a conditional mathematical expectation with respect to the available observations of ℓ 2-norm of the estimation error of a signal process on [0, T]. The problem is in constructing an estimate minimizing losses correspondent to the worst distribution of the pair “a matrix of transient probabilities—a matrix of observation plan” form a set of allowable distributions. For a correspondent minimax problem is demonstrated the existence of a saddle point and is obtained a form of the wanted minimax estimation. The applicability of the obtained results is illustrated by a numerical example of the estimation of a state of TCP under the conditions of uncertainty of communication channel parameters.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Sinitsyn, I.N., Fil'try Kalmana i Pugacheva (Kalman and Pugachev Filters), Moscow: Logos, 2007.
Wonham, W.N., Some Applications of Stochastic Differential Equations to Optimal Nonlinear Filtering, SIAM J. Control, 1965, no. 2, pp. 347–369.
Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer, 1995.
Bar-Shalom, Y., Li, R., Li, X.-R., and Kirubarajan, T., Estimation with Applications to Tracking and Navigation, New York: Wiley, 2001.
Miller, B.M., Avrachenkov, K.E., Stepanyan, K.V., and Miller, G.B., Flow Control as Stochastic Optimal Control Problem with Incomplete Information, Proc. INFOCOM'2005, Miami, 2005, pp. 1328–1337.
Cvitanic, J., Liptser, R.Sh., and Rozovskii, B., Tracking Volatility, Proc. 39th IEEE Conf. Decision Control, Sydnay, 2000, pp. 1189–1193.
Elliott, R.J., Malcolm, W.P., and Tsoi, A., HMM Volatility Estimation, Proc. 41th IEEE Conf. Decision Control, Las Vegas, 2002, pp. 398–404.
de Souza, C.E. and Fragoso, M.D., Robust H 1 Filtering for Uncertain Markovian Jump Linear Systems, Int. J. Robust Nonlinear Control, 2002, vol. 12, no. 5, pp. 435–446.
Miller, B.M. and Runggaldier, W.J., Kalman Filtering for Linear Systems with Coefficients Driven by a Hidden Markov Jump Process, Syst. Control Lett., 1997, vol. 31, pp. 93–102.
Shi, P., Boukas, E.K., and Agarwal, R.K., Kalman Filtering for Continuous-Time Uncertain Systems with Markovian Jumping Parameters, IEEE Trans. Automat. Control., 1999, vol. 44, no. 8, pp. 1592–1597.
Cappe, O., Moulines, V., and Ryden, T., Inferences in Hidden Markov Models, Berlin: Springer, 2005.
Merhav, N. and Ziv, J., Estimating with Partial Statistics the Parameters of Ergodic Finite Markov Sources, IEEE Trans. Inform. Theory, 1989, vol. 35, no. 2, pp. 326–333.
Dey, S. and Moore, J.B., Risk-Sensitive Filtering and Smoothing for Hidden Markov Models, Syst. Control Lett., 1995, vol. 25, pp. 361–366.
Zhang, L., Shi, P., Boukas, E.K., and Wang, C., Robust l 2-l ∞ Filtering for Switched Linear Discrete Time-Delay Systems with Polytopic Uncertainties, IET Control Theory Appl., 2007, vol. 3, no. 1, pp. 722–730.
Xie, L., Ugrinovskii, V.A., and Petersen, I.R., Finite Horizon Robust State Estimation for Uncertain Finite-Alphabet Hidden Markov Models with Conditional Relative Entropy Constraints, SIAM J. Control Optim., 2008, vol. 47, no. 1, pp. 478–508.
Borisov, A.V., Minimax A Posteriori Estimation in the Hidden Markov Models, Autom. Remote Control, 2007, vol. 68, no. 11, pp. 1917–1930.
Borisov, A.V., Minimax A Posteriori Estimation of the Markov Processes with Finite State Spaces, Autom. Remote Control, 2008, vol. 69, no. 2, pp. 233–246.
Liptser, R.S. and Shiryaev, A.N., Statistika sluchainykh protsessov (nelineinaya fil'tratsiya i smezhnye voprosy), Moscow: Nauka, 1974. Translated into English under the title Statistics of Random Processes: Theory and Applications, New York: Springer, 2000.
Wall, J.E., Willsky, A.S., and Sandell, N.R., On the Fixed-Interval Smoothing Problem, Stochastic, 1981, no. 1, pp. 1–42.
Gilbert, E.M., Capacity of a Burst-Noise Channel, Bell Syst. Tech., 1960, no. 5, pp. 1253–1265.
Semenikhin, K.V., Minimax Estimation of Random Elements by the Root-Mean-Square Criterion, Izv. Ross. Akad. Nauk, Teor. Sist. Upravlen., 2003, no. 5, pp. 12–25.
Bulinskii, A.V. and Shiryaev, A.N., Teoriya sluchainykh protsessov (Theory of Random Processes), Moscow: Fizmatlit, 2005.
Kirillov, A.A. and Gvishiani, A.D., Teoremy i zadachi funktsional'nogo analiza (Theorem and Problems of Functional Analysis), Moscow: Nauka, 1988.
Author information
Authors and Affiliations
Additional information
Original Russian Text © A.V. Borisov, A.V. Bosov, A.I. Stefanovich, 2011, published in Avtomatika i Telemekhanika, 2011, No. 2, pp. 41–55.
Rights and permissions
About this article
Cite this article
Borisov, V., Bosov, A.V. & Stefanovich, A.I. Minimax estimation in systems of observation with Markovian chains by integral criterion. Autom Remote Control 72, 255–268 (2011). https://doi.org/10.1134/S0005117911020056
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117911020056