Skip to main content

Fusing RFID and Computer Vision for Occlusion-Aware Object Identifying and Tracking

  • Conference paper
  • First Online:
Wireless Algorithms, Systems, and Applications (WASA 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11604))

Abstract

Real-time identifying and tracking monitored objects is an important application in a public safety scenario. Both Radio Frequency Identification (RFID) and computer vision are potential solutions to monitor objects while faced with respective limitations. In this paper, we combine RFID and computer vision to propose a hybrid indoor tracking system, which can efficiently identify and track the monitored object in the scene with people gathering and occlusion. In order to get a high precision and robustness trajectory, we leverage Dempster-Shafer (DS) evidence theory to effectively fuse RFID and computer vision based on the prior probability error distribution. Furthermore, to overcome the drift problem under long-occlusion, we exploit the feedback from the high-confidence tracking results and the RFID signals to correct the false visual tracking. We implement a real-setting tracking prototype system to testify the performance of our proposed scheme with the off-the-shelf IP network camera, as well as the RFID devices. Experimental results show that our solution can achieve 98% identification accuracy and centimeter-level tracking precision, even in long-term occlusion scenarios, which can manipulate various practical object-monitoring scenarios in the public security applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alshammari, A., Rawat, D.B.: Intelligent multi-camera video surveillance system for smart city applications. In: 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, pp. 0317–0323, IEEE (2019)

    Google Scholar 

  2. Liang, Y., Cai, Z., Yu, J., Han, Q., Li, Y.: Deep learning based inference of private information using embedded sensors in smart devices. IEEE Netw. 32(4), 8–14 (2018)

    Google Scholar 

  3. Zheng, X., Cai, Z., Yu, J., Wang, C., Li, Y.: Follow but no track: privacy preserved profile publishing in cyber-physical social systems. IEEE Internet Things J. 4(6), 1868–1878 (2017)

    Google Scholar 

  4. Han, Y., Chen, Z., Guo, T.: Design of equipment anti-theft tracker based on wireless sensor network. In: 2017 First International Conference on Electronics Instrumentation and Information Systems (EIIS), Harbin, pp. 1–5. IEEE (2017)

    Google Scholar 

  5. Subedi, S., Pauls, E., Zhang, Y.D.: Accurate localization and tracking of a passive RFID reader based on RSSI measurements. IEEE J. Radio Freq. Identif. 1(2), 144–154 (2017)

    Google Scholar 

  6. Dong, X., Shen, J., Yu, D., Wang, W., Liu, J., Huang, H.: Occlusion-aware real-time object tracking. IEEE Trans. Multimed. 19(4), 763–771 (2017)

    Google Scholar 

  7. He, S., Chan, S.H.G.: Wi-Fi fingerprint-based indoor positioning: recent advances and comparisons. IEEE Commun. Surv. Tutor. 18(1), 466–490 (2016)

    Google Scholar 

  8. Mehmood, H., Tripathi, N.K.: Optimizing artificial neural network-based indoor positioning system using genetic algorithm. Int. J. Digit. Earth 6(2), 158–184 (2013)

    Google Scholar 

  9. Figuera, C., Rojo-Álvarez, J.L., Wilby, M., et al.: Advanced support vector machines for 802.11 indoor location. Signal Process. 92(9), 2126–2136 (2012)

    Google Scholar 

  10. Dwiyasa, F., Lim, M.H.: Extreme learning machine for active RFID location classification. In: Handa, H., Ishibuchi, H., Ong, Y.S., Tan, K.C. (eds.) Proceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems. PALO, vol. 2, pp. 657–670. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-13356-0_52

    Google Scholar 

  11. Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)

    Google Scholar 

  12. Yuan, J., Chen, H., Sun, F., Huang, Y.: Multisensor information fusion for people tracking with a mobile robot: a particle filtering approach. IEEE Trans. Instrum. Meas. 64(9), 2427–2442 (2015)

    Google Scholar 

  13. He, Z., Cai, Z., Cheng, S., Wang, X.: Approximate aggregation for tracking quantiles and range countings in wireless sensor networks. Theor. Comput. Sci. 607(3), 381–390 (2015)

    Google Scholar 

  14. Teng, J., Zhang, B., Zhu, J., Li, X., Xuan, D., Zheng, Y.F.: EV-Loc: integrating electronic and visual signals for accurate localization. IEEE ACM Trans. Network. 22(4), 1285–1296 (2014)

    Google Scholar 

  15. Duan, C., Rao, X., Yang, L., Liu, Y.: Fusing RFID and computer vision for fine-grained object tracking. In: IEEE INFOCOM 2017 - IEEE Conference on Computer Communications, Atlanta, pp. 1–9. IEEE (2017)

    Google Scholar 

  16. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, pp. 779–788 (2016)

    Google Scholar 

  17. Danelljan, M., Bhat, G., Shahbaz Khan, F., Felsberg, M.: ECO: efficient convolution operators for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6638–6646 (2017)

    Google Scholar 

  18. Wang, J., Liu, F.: Temporal evidence combination method for multi-sensor object recognition based on DS theory and IFS. J. Syst. Eng. Electron. 28(6), 1114–1125 (2017)

    Google Scholar 

Download references

Acknowledgement

This work was supported by Collaborative Fund of China Electronics Technology Group Corporation (Project No. 6141B08080401).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Min Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, M., Chen, Y., Zhang, Y., Yang, J., Du, H. (2019). Fusing RFID and Computer Vision for Occlusion-Aware Object Identifying and Tracking. In: Biagioni, E., Zheng, Y., Cheng, S. (eds) Wireless Algorithms, Systems, and Applications. WASA 2019. Lecture Notes in Computer Science(), vol 11604. Springer, Cham. https://doi.org/10.1007/978-3-030-23597-0_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-23597-0_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-23596-3

  • Online ISBN: 978-3-030-23597-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics