Abstract
This article introduces a new form of ethogram that provides a basis for studying reinforcement learning in biologically inspired collective robotics systems. In general, an ethogram is a record of behavior patterns, which has grown out of ethology (ways to explain agent behavior). The rough set approach introduced by Zdzisław Pawlak in 1982 provides a ground for deriving pattern-based rewards in the context of an approximation space. The framework provided by an approximation space makes it possible to derive pattern-based reference rewards used to compute action rewards as well as action preferences. A brief description of a prototype of an ecosystem testbed used to record ethograms in a dynamically changing system of agents is presented. The contribution of this article is an introduction to an ethological approach to the study of action preferences and action rewards during reinforcement learning in intelligent systems considered in the context of approximation spaces.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bonabeau, E., Dorigo, M., Theraulaz, G. (1999): Swarm Intelligence. From Natural to Artificial Systems, Oxford University Press, UK
Lehner, P. N. (1996): Handbook of Ethological Methods, 2nd Ed. Cambridge University Press, UK
Pal, S. K., Polkowski, L., Skowron, A., Eds. (2004): Rough-Neural Computing. Techniques for Computing with Words. Springer-Verlag, Heidelberg
Pawlak, Z. (1991): Rough Sets. Theoretical Reasoning about Data. Kluwer, Dordrecht
Peters, J. F. (2004): Approximation space for intelligent system design patterns. Engineering Applications of Artificial Intelligence 17, No. 4, 1–8
Peters, J. F., Ramanna, S. (2004): Measuring acceptance of intelligent system models. In: M. Gh. Negoita et al. (Eds.), Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Artificial Intelligence 3213, Part I, 764–771
Peters, J. F. (2004): Approximation spaces for hierarchical intelligent behavioral system models. In: B.D.-Keplicz, A. Jankowski, A. Skowron, M. Szczuka (Eds.), Monitoring, Security and Rescue Techniques in Multiagent Systems. Advances in Soft Computing. Physica-Verlag, Heidelberg, 13–30
Peters, J. F., Skowron, A., Synak, P., Ramanna, S. (2003): Rough sets and information granulation. In: Bilgic, T., Baets, D., Kaynak, O. (Eds.), Tenth Int. Fuzzy Systems Assoc. World Congress IFSA, Instanbul, Turkey, Lecture Notes in Artificial Intelligence 2715, Springer-Verlag, Heidelberg, 370–377
Peters, J. F., Ahn, T. C., Borkowski, M., Degtyaryov, V., Ramanna, S. (2003): Line-crawling robot navigation: A rough neurocomputing approach. In: C. Zhou, D. Maravall, D. Ruan (Eds.), Autonomous Robotic Systems. Studies in Fuzziness and Soft Computing 116. Physica-Verlag, Heidelberg, 141–164
Polkowski, L. (2002): Rough Sets. Mathematical Foundations. Physica-Verlag, Heidelberg
Skowron, A., Stepaniuk, J. (1998): Information granules and approximation spaces. In: Proc. of the 7th Int. Conf. on Information Processing and Management of Uncertainty in Knowledge-based Systems (IPMU98), Paris, 1354–1361
Skowron, A. Stepaniuk, J. (1995): Generalized approximation spaces. In: Lin, T.Y., Wildberger, A.M. (Eds.), Soft Computing, Simulation Councils, San Diego, 18–21
Sutton, R. S., Barto, A. G. (1998): Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA
Tinbergen N. (1963): On aims and methods of ethology, Zeitschrift für Tierpsychologie 20, 410–433
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Peters, J.F., Henry, C., Ramanna, S. (2005). Rough Ethograms: Study of Intelligent System Behavior. In: Kłopotek, M.A., Wierzchoń, S.T., Trojanowski, K. (eds) Intelligent Information Processing and Web Mining. Advances in Soft Computing, vol 31. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32392-9_13
Download citation
DOI: https://doi.org/10.1007/3-540-32392-9_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25056-2
Online ISBN: 978-3-540-32392-1
eBook Packages: EngineeringEngineering (R0)