Skip to main content

Diversive Curiosity in Robots and Action Selection Method for Obtaining Unexperienced Sensory Information

  • Conference paper
  • First Online:
Intelligent Autonomous Systems 13

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 302))

  • 2762 Accesses

Abstract

Humans can acquire new knowledge by themselves, and robots are also expected to have such ability by introducing curiosity. In previous researches, curiosity is expressed as just a judging system that decides whether the robot continues looking over a specific environment. In this paper we define curiosity as a direction in the multidimensional sensory space, and propose an action selection method based on the curiosity vector. The system estimates the relation between action and resulting sensory changes using the stored observed data. It selects an action so as to obtain the desired sensory information, based on the curiosity vector. This paper also describes experiments in which a wheeled mobile robot moves toward an unknown area and a humanoid discovers actions to obtain unexperienced sensory information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 349.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 449.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ichimura, A., Mizuuchi, I.: Reaching hidden objects based on memory of environmental states and robot s movement and manipulation. In: Proceedings of 16th International Conference on Advanced Robotics (ICAR2013). (2013)

    Google Scholar 

  2. Simsek, Ö., Barto, A.G.: An intrisic reward mechanism for efficient exploration. In: Proceedings of the 23rd International Conference on Machine Learning. (2004) 127–130.

    Google Scholar 

  3. Schmidhuber, J.: Adaptive confidence and adaptive curiosity. Technical report, Institut fur Informatik Technische Universitat Munchen (1991).

    Google Scholar 

  4. Berlyne, D.E.: Conflict, arousal, and curiosity. McGraw-Hill (1960).

    Google Scholar 

  5. ves Oudeyer, P.Y., Kaplan, F.: Intelligent adaptive curiosity: a source of self-development. In: Lund University Cognitive Studies. (2004) 127–130.

    Google Scholar 

  6. Shimo, N., Pang, S., Horio, K., Kasabov, N., Tamukoh, H., Koga, T., Sonoh, S., Isogai, H., Yamakawa, T.: Effective and adaptive learning based on diversive/specific curiosity. In: Proceedings of 4th International Conference on Brain-Inspired Information Technology. (2007).

    Google Scholar 

  7. Berlyne, D.E.: A Theory Of Human Curiosity. British Journal of Psychology 45(3) (1954) 180–191.

    Google Scholar 

  8. Morita, M., Ishikawa, M.: Brain-inspired emergence of behaviors based on the desire for existence by reinforcement learning. In: Proceedings of the 15th international conference on Advances in neuro-information processing. (2008) 763–770.

    Google Scholar 

  9. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11) (1998) 1254–1259.

    Google Scholar 

  10. Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision 42(3) (2001) 145–175.

    Google Scholar 

  11. Oliva, A., Torralba, A. In: Building the gist of a scene: the role of global image features in recognition. Volume 155. (2006) 23–36.

    Google Scholar 

  12. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(9) (1986) 533–536.

    Google Scholar 

  13. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach (3rd Edition). Prentice Hall (2009).

    Google Scholar 

  14. McQueen, J.: Some methods for classification and analysis of multivariate observations. In. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. (1967).

    Google Scholar 

  15. Bellman, R.E.: Dynamic Programming. Princeton University Press (1957).

    Google Scholar 

  16. Minato, T., Asada, M.: Towards selective attention: Generating image features by learning a visuo-motor map. Robotics and Autonomous Systems 45 (2003) 211–221.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Toma Morisawa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Morisawa, T., Mizuuchi, I. (2016). Diversive Curiosity in Robots and Action Selection Method for Obtaining Unexperienced Sensory Information. In: Menegatti, E., Michael, N., Berns, K., Yamaguchi, H. (eds) Intelligent Autonomous Systems 13. Advances in Intelligent Systems and Computing, vol 302. Springer, Cham. https://doi.org/10.1007/978-3-319-08338-4_97

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08338-4_97

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08337-7

  • Online ISBN: 978-3-319-08338-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics