Abstract
Human in-bed pose estimation has huge practical values in medical and healthcare applications yet still mainly relies on expensive pressure mapping (PM) solutions. In this paper, we introduce our novel physics inspired vision-based approach that addresses the challenging issues associated with the in-bed pose estimation problem including monitoring a fully covered person in complete darkness. We reformulated this problem using our proposed Under the Cover Imaging via Thermal Diffusion (UCITD) method to capture the high resolution pose information of the body even when it is fully covered by using a long wavelength IR technique. We proposed a physical hyperparameter concept through which we achieved high quality groundtruth pose labels in different modalities. A fully annotated in-bed pose dataset called Simultaneously-collected multimodal Lying Pose (SLP) is also formed/released with the same order of magnitude as most existing large-scale human pose datasets to support complex models’ training and evaluation. A network trained from scratch on it and tested on two diverse settings, one in a living room and the other in a hospital room showed pose estimation performance of 98.0% and 96.0% in PCK0.2 standard, respectively. Moreover, in a multi-factor comparison with a state-of-the art in-bed pose monitoring solution based on PM, our solution showed significant superiority in all practical aspects by being 60 times cheaper, 300 times smaller, while having higher pose recognition granularity and accuracy.
Supported by the NSF Award #1755695. Source code and SLP dataset available at: https://web.northeastern.edu/ostadabbas/2019/06/27/multimodal-in-bed-pose-estimation/.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Achilles, F., Ichim, A.-E., Coskun, H., Tombari, F., Noachtar, S., Navab, N.: Patient MoCap: human pose estimation under blanket occlusion for hospital monitoring applications. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9900, pp. 491–499. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46720-7_57
Andriluka, M., Pishchulin, L., Gehler, P., Schiele, B.: 2D human pose estimation: new benchmark and state of the art analysis. In: CVPR, pp. 3686–3693, June 2014
Ding, J.R.: Bed status detection for elder-care center. In: 16th International Conference on Systems, Signals and Image Processing, pp. 1–4 (2009)
Johnson, S., Everingham, M.: Clustered pose and nonlinear appearance models for human pose estimation. In: BMVC, vol. 2, p. 5 (2010)
Lee, C.H., Kim, D.K., Kim, S.Y., Rhee, C.S., Won, T.B.: Changes in site of obstruction in obstructive sleep apnea patients according to sleep position: a dise study. Laryngoscope 125(1), 248–254 (2015)
Liu, S., Ostadabbas, S.: Inner space preserving generative pose machine. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11205, pp. 740–759. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01246-5_44
Liu, S., Yin, Y., Ostadabbas, S.: In-bed pose estimation: deep learning with shallow dataset. IEEE J. Transl. Eng. Health Med. 7, 1–12 (2019)
Martinez, M., Schauerte, B., Stiefelhagen, R.: “BAM!” depth-based body analysis in critical care. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013. LNCS, vol. 8047, pp. 465–472. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40261-6_56
McCabe, S.J., Gupta, A., Tate, D.E., Myers, J.: Preferred sleep position on the side is associated with carpal tunnel syndrome. Hand 6(2), 132–137 (2011)
Newell, A., Yang, K., Deng, J.: Stacked hourglass networks for human pose estimation. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9912, pp. 483–499. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46484-8_29
Ostadabbas, S., Pouyan, M., Nourani, M., Kehtarnavaz, N.: In-bed posture classification and limb identification. In: BioCAS, pp. 133–136 (2014)
Ostadabbas, S., Yousefi, R., Nourani, M., Faezipour, M., Tamil, L., Pompeo, M.: A posture scheduling algorithm using constrained shortest path to prevent pressure ulcers. In: BIBM, pp. 327–332 (2011)
Ostadabbas, S., Yousefi, R., Nourani, M., Faezipour, M., Tamil, L., Pompeo, M.Q.: A resource-efficient planning for pressure ulcer prevention. IEEE Trans. Inf. Technol. Biomed. 16(6), 1265–1273 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, S., Ostadabbas, S. (2019). Seeing Under the Cover: A Physics Guided Learning Approach for In-bed Pose Estimation. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11764. Springer, Cham. https://doi.org/10.1007/978-3-030-32239-7_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-32239-7_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32238-0
Online ISBN: 978-3-030-32239-7
eBook Packages: Computer ScienceComputer Science (R0)