基于多尺度特征与频率注意力的轻量化矿井图像超分辨率重建方法

Lightweight super-resolution reconstruction method for mine images based on multiscale feature fusion and frequency attention

  • 摘要: 在煤矿井下光照非均匀分布、煤尘水雾干扰与电磁噪声耦合的复杂工况中,矿井图像普遍面临分辨率退化、纹理细节模糊等挑战. 传统超分辨率算法因网络结构复杂度高、内存占用大等问题,难以满足边缘设备的实时部署需求. 针对上述问题,提出了一种基于多尺度特征与频率注意力的轻量化矿井图像超分辨率重建方法. 首先,该网络基于像素注意力与多尺度特征感知机制设计了多感受野注意力模块,通过感知不同尺度的空间上下文信息,增强图像纹理边缘的表征能力. 其次,设计了基于Transformer的自适应加权多尺度特征融合机制,通过可学习的权重融合多尺度卷积提取的特征,并结合门控深度卷积前馈网络,提升图像全局结构的一致性. 最后,在上采样阶段引入频率注意力机制,通过频域信息指导高频细节重建. 实验结果表明,本文方法不仅在客观评价指标和主观视觉分析上优于现有主流算法,而且在模型性能和轻量化之间取得更好的平衡. 在4倍缩放因子下,与轻量级模型IMFRN相比,提出的模型参数量仅为617k,降低了22%,在复杂纹理场景的Urban100数据集上客观指标PSNR(Peak signal-to-noise ratio)和SSIM(Structural similarity index measure)分别提高0.05 dB和0.0041,在矿井测试集上PSNR和SSIM分别提高0.11 dB和0.0031. 结果证明了该方法可以有效提取图像多尺度的纹理特征,实现跨层级的特征关联,在轻量化约束下重建出高频细节更清晰的高分辨率图像,为矿井边缘设备部署提供高效解决方案.

     

    Abstract: Under complex underground coal-mine conditions, image acquisition is affected by non-uniform illumination, coal-dust and water mist interference, and coupled electromagnetic noise. These adverse factors cause resolution degradation, blurred edges, and loss of fine texture details, thereby reducing the visual quality of mine images. Although conventional super-resolution methods can restore some information, their complex architectures and large memory footprints hinder their real-time deployment on resource-constrained edge devices. Therefore, mine image reconstruction requires a model that improves image quality while maintaining low parameter complexity and efficient feature processing. This requirement is particularly important in underground environments, where edge equipment must process degraded images with limited memory resources while maintaining reliable reconstruction quality as well as demonstrate practical real-time operating efficiency. To address these challenges, this paper proposes a lightweight coal-mine image super-resolution reconstruction method based on multiscale features and frequency attention. The network first introduces a multireceptive-field attention module combining pixel attention with multiscale feature perception. By capturing spatial contextual information through receptive fields of different sizes, this module aggregates complementary local and contextual features. Therefore, it strengthens the representation of texture boundaries, structural edges, and other regions necessary for recovering fine image details. The multiscale design also mitigates the limitations caused by extracting spatial information under only a single receptive field. Next, a Transformer-based adaptive weighted multiscale feature fusion mechanism is designed to integrate features extracted via multiscale convolutions. Learnable weights dynamically regulate the contribution of each feature scale, thus allowing the network to select information based on image content. This mechanism enhances interactions among features from different levels and improves the consistency of the reconstructed global structure. A gated depth-wise convolutional feed-forward network is incorporated to refine the fused representation while controlling the additional computational burden. Collectively, adaptive weighting and gated depth-wise convolution improve cross-level feature correlation as well as preserve complementary structural and texture information. Finally, a frequency attention mechanism is introduced during upsampling to guide the reconstruction of high-frequency details using frequency-domain information. The mechanism emphasizes frequency components related to edges and textures, thus allowing visually meaningful high-frequency content to be prioritized during reconstruction. Consequently, the model can recover sharper textures and clearer boundaries without substantially increasing the network depth or parameter count. The spatial and frequency modules function synergistically to improve detail reconstruction while satisfying the lightweight-design requirement of edge deployment. Experimental results demonstrate that the proposed method outperforms existing mainstream algorithms in terms of objective evaluation metrics and subjective visual comparisons. Additionally, it achieves a favorable balance between reconstruction performance and model compactness. At a scale factor of 4, the proposed model contains only 617k parameters, representing a 22% reduction compared with the lightweight IMFRN model. On the complex-texture Urban100 dataset, the model improves the peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) by 0.05 dB and 0.0041, respectively. On the coal-mine test set, the corresponding improvements are 0.11 dB and 0.0031, respectively. These results indicate that the method effectively extracts multiscale texture features and establishes correlations across different feature levels. Under lightweight constraints, it reconstructs high-resolution images with clear high-frequency details and well-preserved structural information. The proposed method provides an efficient super-resolution solution for deployment on edge devices in underground coal mines.

     

/

返回文章
返回