Abstract
This research implements a system that detects and records various human activities in indoor scenes. For example, it detects who brings in or takes out an object and the handled object’s image with the incident timestamp. It’s constructed over ROS2, a widely used distributed communication framework for robotic implementation based on micro-services architecture, so that it can separate each subprocess of detection and improve the maintainability of each module. This paper reports the constructed system with visual human and pose detection, object detection, and recognition of object handling activities. Since the system was able to separate hardware not only service process, it was able to employ computationally heavy machine learning models simultaneously on multiple PCs with GPU.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
IntelRealSense librealsense2: Intel® RealSense™ SDK. https://github.com/IntelRealSense/librealsense. Accessed 01 Mar 2021
Intel® RealSense™ technology. https://www.intel.co.jp/content/www/jp/ja/architecture-and-technology/realsense-overview.html. Accessed 01 Mar 2021
OpenCV-Python PyPI. https://pypi.org/project/opencv-python/. Accessed 01 Mar 2021
OpenPose ROS2. https://github.com/Rits-Interaction-Laboratory/openpose_ros2. Accessed 01 Mar 2021
ROS 2 overview. https://index.ros.org/doc/ros2/. Accessed 01 Mar 2021
Bolya, D., Zhou, C., Xiao, F., Lee, Y.J.: YOLACT: real-time instance segmentation. In: ICCV International Conference on Computer Vision, pp. 9157–9166 (2019)
Cao, Z., Hidalgo Martinez, G., Simon, T., Wei, S., Sheikh, Y.A.: OpenPose: real-time multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2019)
Maki, K., Katayama, N., Shimada, N., Shirai, Y.: Image-based automatic detection of indoor scene events and interactive inquiry. In: Proceedings of 19th International Conference on Pattern Recognition ICPR 2008, pp. 1–4 (2008)
Quigley, M., et al.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, Kobe, Japan, vol. 3, p. 5 (2009)
Thönes, J.: Microservices. IEEE Softw. 32(1), 116 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Yoshida, K., Matsuo, T., Shimada, N. (2021). ROS2-Based Distributed System Implementation for Logging Indoor Human Activities. In: Huang, DS., Jo, KH., Li, J., Gribova, V., Bevilacqua, V. (eds) Intelligent Computing Theories and Application. ICIC 2021. Lecture Notes in Computer Science(), vol 12836. Springer, Cham. https://doi.org/10.1007/978-3-030-84522-3_70
Download citation
DOI: https://doi.org/10.1007/978-3-030-84522-3_70
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-84521-6
Online ISBN: 978-3-030-84522-3
eBook Packages: Computer ScienceComputer Science (R0)