Abstract
Compressive spectral imaging (CSI) allows the acquisition of the spectral information of a three-dimensional scenes by using coded projections in a sensor with lower dimension. However, the compressed sampling of information with simultaneously high spatial and high spectral resolution demands expensive high-resolution sensors. One of the main challenges in CSI is to obtain a high-quality image of high-resolution reconstructions using low-cost architectures. Single pixel camera is an approach that has had a high impact in spectroscopy, due to its low-cost implementation compared to CSI architectures with 2D sensors. On the other hand, recent works have been shown that image fusion using measurements from a CSI sensor based on side information leads to improvement in the quality of the fused image. This work proposes a spectral image fusion methodology for increasing the spatio-spectral resolution through side information and at the same time improve the reconstruction quality of the data cube with a low-cost architecture, optimizing the similarity of the reconstructed spectral image with each sensor. Simulations and experimental results for the proposed methodology show that improve the quality of the reconstruction in up to 11 dB with respect to the traditional approach of upsampling the single pixel image reconstruction through bilinear interpolation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Lu, G., Fei, B.: Medical hyperspectral imaging: a review. J. Biomed. Opt. 19(1), 10901 (2014)
Manolakis, D.G.: Detection algorithms for hyperspectral imaging applications. IEEE Sig. Process. Mag. 19, 29–43 (2002)
Shaw, G.A., Burke, H.K.: Spectral imaging for remote sensing. Lincoln Lab. J. 14(1), 3–28 (2003)
Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)
Correa, C.V., Arguello, H., Arce, G.R.: Spatiotemporal blue noise coded aperture design for multi-shot compressive spectral imaging. J. Opt. Soc. Am. A 33(12), 2312–2322 (2016)
Duarte, M., et al.: Single-pixel imaging via compressive sampling. IEEE Sig. Process. Mag. 25(2), 1–19 (2008)
Lin, X., Liu, Y., Wu, J., Dai, Q.: Spatial-spectral encoded compressive hyperspectral imaging. ACM Trans. Graph. 33(6), 233:1–233:11 (2014)
Wagadarikar, A., John, R., Willett, R., Brady, D.: Single disperser design for coded aperture snapshot spectral imaging. Appl. Opt. 47(10), B44–B51 (2008)
Lin, X., Wetzstein, G., Liu, Y., Dai, Q.: Dual-coded compressive hyperspectral imaging. Opt. Lett. 39, 2044–2047 (2014)
Cao, X., Du, H., Tong, X., Dai, Q., Lin, S.: A prism-mask system for multispectral video acquisition. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2423–2435 (2011)
Carin, L., Yuan, X., Brady, D., Tsai, T.H., Zhu, R., Llul, P.: Compressive hyperspectral imaging with side information. IEEE J. Sel. Topics Sig. Process. 9(6), 964–976 (2015)
Espitia, O., Castillo, S., Arguello, H.: Compressive hyperspectral and multispectral imaging fusion. In: Proceedings of SPIE, p. 9840 (2016)
Galvis, L., Lau, D., Ma, X., Arguello, H., Arce, G.R.: Coded aperture design in compressive spectral imaging based on side information. Appl. Opt. 56(22), 6332 (2017)
Warnell, G., Bhattacharya, S., Chellappa, R., Basar, T.: Adaptive-rate compressive sensing using side information. IEEE Trans. Image Process. 24(11), 3846–3857 (2014)
Yasuma, F., Mitsunaga, T., Iso, D., Nayar, S.K.: Generalized assorted pixel camera: postcapture control of resolution, dynamic range, and spectrum. IEEE Trans. Image Process. 19(9), 2241–2253 (2010)
Figueiredo, M.A.T., Nowak, R.D., Wright, S.J.: Gradient projections for sparse reconstruction: application to compressed sensing and other inverse problems. J. Sel. Topics Sig. Process. IEEE 1(1), 586–598 (2007)
Acknowledgment
The authors gratefully acknowledge the optics laboratory from the High Dimensional Signal Processing (HDSP) research group for the assistance on the experimental tests. The scientific cooperation agreement subscribed between Universidad Autónoma de Bucaramanga (UNAB) and Universidad Industrial de Santander (UIS) through the summons Programa Generación ConCiencia-GEN 2017 (No. 006) for supporting this work registered under the project titled: Algoritmo de fusión de imágenes espectrales en el dominio comprimido para el aumento de la resolución espacio-espectral.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Jerez, A., Garcia, H., Arguello, H. (2018). Spectral Image Fusion for Increasing the Spatio-Spectral Resolution Through Side Information. In: Orjuela-Cañón, A., Figueroa-García, J., Arias-Londoño, J. (eds) Applications of Computational Intelligence. ColCACI 2018. Communications in Computer and Information Science, vol 833. Springer, Cham. https://doi.org/10.1007/978-3-030-03023-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-03023-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03022-3
Online ISBN: 978-3-030-03023-0
eBook Packages: Computer ScienceComputer Science (R0)