基于生成对抗网络的隧道渗水异质图像融合方法

Tunnel Leakage Infiltration Heterogeneous Image Fusion Method Based on Generative Adversarial Network

  • 摘要: 针对光照条件较差的隧道环境,单模态的渗漏水图像已无法满足病害感知需求,因此,基于可见光-红外光的跨模态异质图像融合技术,提出了一种基于双路径双判别生成对抗网络的异质图像融合算法D-DDcGAN。首先,利用生成对抗网络模型(Generative Adversarial Network, GAN)设计了双流输入架构的生成器结构、双判别器结构,以增强生成对抗网络的韧性;其次,引入结构相似性(Structure Similarity Index Measure, SSIM)损失函数以改进联合低秩稀疏方法(Joint Low-Rank Sparse Decomposition, JLRSD)对多源渗水图像进行特征分解;最后,将联合低秩稀疏分解生成的低秩图和稀疏图输入至生成对抗网络中,得到融合后的渗水图像。实验选用了红外与可见光各5000幅隧道渗水图像进行异质融合验证,结果表明:与经典的NSST、LRSD、JLRSD以及FusionGAN四种模型相比,D-DDcGAN算法在信息熵、互信息、平均梯度、空间频率、峰值信噪比以及均方根误差六项定量评价指标中分别提升了1.887%、0.987%、9.547%、12.732%、1.659%和2.299%,六项指标具有明显优势。实验证明了该方法丰富了渗水图像信息,增加了目标辨识度,有助于提升隧道渗水感知能力。

     

    Abstract: In view of the tunnel environment with poor lighting conditions, the single-modal tunnel leakage image can no longer meet the needs of disease perception. Therefore, based on the cross-modal heterogeneous image fusion technology of visible and infrared, a heterogeneous image fusion algorithm D-DDcGAN based on dual-path and dual-discrimination Generative Adversarial Network was proposed. Firstly, the generator structure and the double discriminator structure of the two-stream input architecture were designed by using the Generative Adversarial Network (GAN) model to enhance the resilience of the Generative Adversarial Network. Secondly, Structure Similarity Index Measure (SSIM) loss function is introduced to improve Joint Low-Rank Sparse Decomposition. (JLRSD) is used to decompose the features of multi-source tunnel leakage images. Finally, the low-rank graph and sparse graph generated by the JLRSD were input into the GAN to obtain the fused tunnel leakage image. In the experiment, 5000 tunnel leakage images of infrared and visible are selected for heterogeneous fusion verification. The results show that: Compared with the classical Non-Subsampled Shearlet Transform (NSST), Low-Rank Sparse Decomposition (LRSD), JLRSD and FusionGAN models. The D-DDcGAN algorithm has the six quantitative evaluation indicators of Information Entropy, Mutual Information, Average Gradient, Spatial Frequency, Peak Signal-to-Noise Ratio and Root Mean Square Error increased by 1.887%, 0.987%, 9.547%, 12.732%, 1.659% and 2.299%, respectively. The six indicators have obvious advantages. The experimental results show that the proposed method enriches the tunnel leakage image information, increases the target identification, and helps to improve the tunnel leakage perception ability.

     

/

返回文章
返回