“智能健康与医疗”专辑+基于多尺度底层结构约束的原始图像及标注生成方法

Original image and annotation generation method based on multi-scale underlying structural constraints

  • 摘要: 本文提出一种基于多尺度底层结构约束的原始图像和标注生成方法,可同时生成成对的原始图像及标注,用于扩增训练医疗影像图像分割模型所需的数据量,最终缓解数据匮乏对医疗影像分割模型泛化能力的制约。该方法通过标注生成网络输出多分辨率标注图像指导原始图像生成,使得两者共享多尺度语义特征,同时,在图像生成网络中引入标注先验信息以及距离损失显式约束底层结构差异,驱使图像生成器在训练过程中更加关注标注与图像之间的结构一致性,从而生成成对的高质量原始图像和标注。实验结果表明,该方法生成的原始图像及标注具有多样化的特征表示和高度一致的底层结构,其作为数据增广方法辅助于分割任务所获得的精度增益超过了传统数据增广方法。该方法可降低医疗影像数据获取和标注成本,且实验证明可有效应用于其他不同领域的数据集,可促进人工智能技术的落地应用。

     

    Abstract: This paper proposes a method for generating paired raw images and annotations based on multi-scale structural constraints, which can simultaneously generate paired raw images and annotations for augmenting the dataset required to train medical image segmentation models. This approach ultimately alleviates the limitations imposed by data scarcity on the generalization ability of medical image segmentation models. The method utilizes a label generation network to output multi-resolution annotation images that guide the generation of raw images, ensuring that both share multi-scale semantic features. Meanwhile, prior annotation information and a distance loss function are introduced into the image generation network to explicitly constrain the structural differences at the lower layers. This drives the image generator to focus more on the structural consistency between annotations and images during training, thereby producing paired high-quality raw images and annotations. Experimental results show that the raw images and annotations generated by this method exhibit diverse feature representations and highly consistent lower-level structures. As a data augmentation technique, it significantly outperforms traditional data augmentation methods in terms of accuracy gain for segmentation tasks. This method can reduce the cost of acquiring and annotating medical image data and has been demonstrated to be effectively applicable to datasets from various domains, promoting the practical application of artificial intelligence technology.

     

/

返回文章
返回