loading page

Multispectral Filter Array Design by Optimal Sphere Packing
  • +2
  • Nelson Diaz ,
  • Alejandro Alvarado ,
  • Pablo Meza ,
  • Felipe Guzman ,
  • Esteban Vera
Nelson Diaz
Pontificia Universidad Católica de Valparaíso

Corresponding Author:[email protected]

Author Profile
Alejandro Alvarado
Author Profile
Pablo Meza
Author Profile
Felipe Guzman
Author Profile
Esteban Vera
Author Profile

Abstract

Multispectral Imaging (MSI) collects a datacube of spatio-spectral information of a scene. Many acquisition methods for spectral imaging use scanning, preventing its widespread usage for dynamic scenes. On the other hand, the conventional color filter array (CFA) method often used to sample color images has also been extended to snapshot MSI using a Multispectral Filter Array (MSFA), which is a mosaic of selective spectral filters placed over the Focal Plane Array (FPA). However, even state-of-the-art MSFAs coding patterns produce artifacts and distortions in the reconstructed spectral images, which might be due to the non-optimal distribution of the spectral filters. To reduce the appearance of artifacts and provide tools for the optimal design of MSFAs, this paper proposes a novel mathematical framework to design MSFAs using a Sphere Packing (SP) approach. By assuming that each sampled filter can be represented by a sphere within the discrete datacube, SP organizes the position of the equal-size and disjoint spheres’s centers in a cubic container. Our method is denoted Multispectral Filter Array by Optimal Sphere Packing (MSFA-OSP), which seeks filter positions that maximize the minimum distance between the spheres’s centers. Simulation results show an image quality improvement of up to 2 dB and a remarkable boost in spectral similarity when using our proposed MSFA design approach for a variety of reconstruction algorithms. Moreover, MSFA-OSP notably reduces the appearance of false colors and zipper effect artifacts, often seen when using state-of-the-art demosaicking algorithms. Experiments using synthetic and real data prove that the proposed MSFA-OSP outperforms state-of-the-art MSFAs in terms of spatial and spectral fidelity.
2023Published in IEEE Transactions on Image Processing volume 32 on pages 3634-3649. 10.1109/TIP.2023.3288414