Multispectral imaging using multiplexed illumination

Jong Il Park, Moon Hyun Lee, Michael D. Grossberg, Shree K. Nayar

Research output: Contribution to conferencePaper

171 Scopus citations

Abstract

Many vision tasks such as scene segmentation, or the recognition of materials within a scene, become considerably easier when it is possible to measure the spectral reflectance of scene surfaces. In this paper, we present an efficient and robust approach for recovering spectral reflectance in a scene that combines the advantages of using multiple spectral sources and a multispectral camera. We have implemented a system based on this approach using a cluster of light sources with different spectra to illuminate the scene and a conventional RGB camera to acquire images. Rather than sequentially activating the sources, we have developed a novel technique to determine the optimal multiplexing sequence of spectral sources so as to minimize the number of acquired images. We use our recovered spectral measurements to recover the continuous spectral reflectance for each scene point by using a linear model for spectral reflectance. Our imaging system can produce multispectral videos of scenes at 30fps. We demonstrate the effectiveness of our system through extensive evaluation. As a demonstration, we present the results of applying data recovered by our system to material segmentation and spectral relighting.

Original languageEnglish
DOIs
StatePublished - 2007 Dec 1
Event2007 IEEE 11th International Conference on Computer Vision, ICCV - Rio de Janeiro, Brazil
Duration: 2007 Oct 142007 Oct 21

Other

Other2007 IEEE 11th International Conference on Computer Vision, ICCV
CountryBrazil
CityRio de Janeiro
Period07/10/1407/10/21

Fingerprint Dive into the research topics of 'Multispectral imaging using multiplexed illumination'. Together they form a unique fingerprint.

  • Cite this

    Park, J. I., Lee, M. H., Grossberg, M. D., & Nayar, S. K. (2007). Multispectral imaging using multiplexed illumination. Paper presented at 2007 IEEE 11th International Conference on Computer Vision, ICCV, Rio de Janeiro, Brazil. https://doi.org/10.1109/ICCV.2007.4409090