王瑞琳, 王立(通讯作者), 贺盈波. 基于小波和动态互补滤波的图像与事件融合方法[J]. 工程科学学报. DOI: 10.13374/j.issn2095-9389.2024.01.23.004
引用本文: 王瑞琳, 王立(通讯作者), 贺盈波. 基于小波和动态互补滤波的图像与事件融合方法[J]. 工程科学学报. DOI: 10.13374/j.issn2095-9389.2024.01.23.004
Image and event fusion method based on wavelet and dynamic complementary filtering[J]. Chinese Journal of Engineering. DOI: 10.13374/j.issn2095-9389.2024.01.23.004
Citation: Image and event fusion method based on wavelet and dynamic complementary filtering[J]. Chinese Journal of Engineering. DOI: 10.13374/j.issn2095-9389.2024.01.23.004

基于小波和动态互补滤波的图像与事件融合方法

Image and event fusion method based on wavelet and dynamic complementary filtering

  • 摘要: 本研究探讨了事件相机与传统帧相机的数据融合,并提出一种旨在提升高动态范围、高速运动目标及复杂光照条件下成像质量的新融合方法。事件相机作为一种新型视觉传感器,拥有高时间分辨率和低功耗优势,但其数据中存在大量噪声以及特征丢失的问题。虽然传统帧相机在空间分辨率上表现出色,但其处理高速运动和高动态范围场景的能力有限。为应对这些挑战,本文提出了一种结合离散小波变换和动态增益互补滤波的图像与事件数据融合方法。此方法首先计算图像信息熵以评估输入图像帧的曝光情况,随后利用离散小波变换提取事件流数据和图像帧数据中的高频和低频信息,并以动态增益互补滤波器实现图像与事件的融合。在HDR Hybrid Event-Frame数据集上进行的实验结果表明,该融合方法在提高图像质量方面效果显著,即使在高动态范围和复杂光照条件下,也能实现图像质量的提升。并且在HDR Hybrid Event-Frame数据集上与几种经典的高质量图像重建方法进行了比较,MSE,SSIM和Q-score三个评价指标分别达到了0.0199,0.90和6.07。

     

    Abstract: This paper discusses the data fusion of event camera and traditional frame camera, and proposes a new fusion method to improve the image quality under high dynamic range, high-speed moving objects and complex lighting conditions. As a new type of vision sensor, event camera has the advantages of high time resolution and low power consumption, but there are a lot of noise and feature loss in its data. While traditional frame cameras excel at spatial resolution, their ability to handle high-speed motion and high dynamic range scenes is limited. To address these challenges, this paper proposes an image and event data fusion method combining discrete wavelet transform and dynamic gain complementary filtering. In this method, the entropy of image information is calculated to evaluate the exposure of the input image frame, and then the high and low frequency information in the event stream data and image frame data is extracted by using discrete wavelet transform, and the fusion of image and event is realized by dynamic gain complementary filter. Experimental results on HDR Hybrid Event-Frame dataset shows that the fusion method is effective in improving image quality, even under high dynamic range and complex lighting conditions. In addition, compared with several classic high-quality image reconstruction methods on HDR Hybrid Event-Frame dataset, and the three metrics of MSE, SSIM and Q-score reach 0.0199, 0.90 and 6.07, respectively.

     

/

返回文章
返回