Abstract
Architectural optimization for heterogeneous multi-sensor processing is a real technological challenge. Most of the vision systems involve only one single color sensor and they do not address the heterogeneous sensors challenge. However, more and more applications require other types of sensor, in addition, such as infrared or low-light sensor, so that the vision system could face various luminosity conditions. These heterogeneous sensors could differ in the spectral band, the resolution or even the frame rate. Such sensor variety needs huge computing performance, but embedded systems have stringent area and power constraints. Reconfigurable architecture makes possible flexible computing while respecting the latter constraints. Many reconfigurable architectures for vision application have been proposed in the past. Yet, few of them propose a real dynamic adaptation capability to manage sensor heterogeneity. In this paper, a self-adaptive architecture is proposed to deal with heterogeneous sensors dynamically. This architecture supports on-the-fly sensor switch. The architecture of the system is self-adapted thanks to a system monitor and an adaptation controller. A stream header concept is used to convey sensor information to the self-adaptive architecture. The proposed architecture was implemented in Altera Cyclone V FPGA. In this implementation, adaptation of the architecture consists in Dynamic and Partial Reconfiguration of FPGA. The self-adaptive ability of the architecture has been proved with low resource overhead and an average global adaptation time of 75 ms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nakamura, J.: Image Sensors and Signal Processing for Digital Still Cameras, pp. 143–178. CRC Press Taylor & Francis Group, Boca Raton (2005). Chapter 5, CMOS Image Sensors
Platzner, M., Teich, J., Wehn, N.: Dynamically Reconfigurable Systems, Architectures, Design Methods and Applications, pp. 375–415. Springer, The Netherlands (2010). Chapter 18
Birem, M., Berry, F.: DreamCam :a modular FPGA-based smart camera architecture. J. Syst. Archit. 60, 519–527 (2014)
Raikovich, T., Fehér, B.: Application of partial reconfiguration of FPGAs in image processing Conference on Ph.D. Research in Microelectronics and Electronics, (2010)
Khalifat, J., Arslan, T.: A novel dynamic partial reconfiguration design for automatic white balance. In: NASA/ESA Conference on Adaptive Hardware and Systems (AHS), Leicester, July 2014
van der Horst, J., van Leeuwen, R., Broers, H., Kleihorst, R., Jonker, P.: A real-time stereo SmartCam, using FPGA, SIMD and VLIW. In: Proceedings of 2nd Workshop on Applications of Computer Vision, pp. 1–8 (2006)
Muscoloni, A., Mattoccia, S.: Real-time tracking with an embedded 3D camera with FPGA processing. In: International Conference on 3D Imaging (IC3D), Liège, December 2014
Texas Instruments. DaVinci Video Processors and Digital Media System-On-Chip. tms320dm6446 Datasheet, 30 September 2010
ON Semiconductor, formerly Aptina Imaging. 1/3-Inch CMOS Digital Image Sensor. AR0130 Datasheet, 11/2014
E2V. 1.3 Mpixels B&W and Color CMOS image Sensor. E2V Datasheet, 10/2011
ULIS. Pico640 Gen2. Ulis Datasheet, 01/2015
Ngan, N., Dokladalova, E., Akil, M.: Dynamically adaptable NoC router architecture for multiple pixel streams applications. In: IEEE International Symposium on Circuits and Systems (ISCAS’12), Seoul, May 2012
Altera: Cyclone V Device Overview. CV-51001, 2015–06-12
Bhandari, S., Subbaraman, S., Pujari, S., Cancare, F., Bruschi, F., Santambrogio, M.D., Grassi, P.R.: High speed dynamic partial reconguration for real time multimedia signal processing. In: 15th Euromicro Conference on Digital System Design, Izmir (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Isavudeen, A., Dokladalova, E., Ngan, N., Akil, M. (2016). Self-Adaptive Architecture for Multi-Sensor Embedded Vision System. In: Kofroň, J., Vojnar, T. (eds) Mathematical and Engineering Methods in Computer Science. MEMICS 2015. Lecture Notes in Computer Science(), vol 9548. Springer, Cham. https://doi.org/10.1007/978-3-319-29817-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-29817-7_7
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-29816-0
Online ISBN: 978-3-319-29817-7
eBook Packages: Computer ScienceComputer Science (R0)