胡小树, 闫义中, 王元, 邢培振. 基于多模态特征融合与时序上下文感知的水下目标检测算法MFTC-NetJ. 内江师范学院学报, 2026, 41(10): 30-38,87. DOI: 10.13603/j.cnki.51-1621/z.2026.10.005
    引用本文: 胡小树, 闫义中, 王元, 邢培振. 基于多模态特征融合与时序上下文感知的水下目标检测算法MFTC-NetJ. 内江师范学院学报, 2026, 41(10): 30-38,87. DOI: 10.13603/j.cnki.51-1621/z.2026.10.005
    HU Xiaoshu, YAN Yizhong, WANG Yuan, XING Peizhen. MFTC-Net: an underwater object detection algorithm based on multimodal feature fusion and temporal context awarenessJ. Journal of Neijiang Normal University, 2026, 41(10): 30-38,87. DOI: 10.13603/j.cnki.51-1621/z.2026.10.005
    Citation: HU Xiaoshu, YAN Yizhong, WANG Yuan, XING Peizhen. MFTC-Net: an underwater object detection algorithm based on multimodal feature fusion and temporal context awarenessJ. Journal of Neijiang Normal University, 2026, 41(10): 30-38,87. DOI: 10.13603/j.cnki.51-1621/z.2026.10.005

    基于多模态特征融合与时序上下文感知的水下目标检测算法MFTC-Net

    MFTC-Net: an underwater object detection algorithm based on multimodal feature fusion and temporal context awareness

    • 摘要: 针对水下目标检测因颜色失真及目标遮挡等原因导致检测精度低的问题,提出一种基于多模态特征融合与时序上下文感知的水下目标检测算法MFTC-Net.首先构建多模态特征融合模块,通过可变形卷积与注意力机制实现光学图像特征与模拟声呐特征的自适应融合,有效增强了模型对模糊目标的感知能力;其次设计时序上下文感知模块,利用光流估计与门控循环单元GRU(Gated Recurrent Unit)捕获连续帧间的运动信息,显著提升对遮挡目标的识别精度;最后引入上下文解耦检测头,优化分类与定位任务的特征表示.在RUOD数据集上的实验结果表明,IoU=0.5时,mAP(mean Average Precision)和mRecall(mean Recall)分别提升了4.1%、3.8%;IoU= 0.5∶0.95时,mAP和mRecall分别提升4.5%、4.3%.该算法为复杂水下环境中的目标检测提供了有效的解决方案.

       

      Abstract: To address the issue of low detection accuracy in underwater target detection caused by color distortion and target occlusion, an underwater object detection algorithm named MFTC-Net, based on multimodal feature fusion and temporal context awareness, is proposed. First, a multimodal feature fusion module is constructed, which achieves adaptive fusion of optical image features and simulated sonar features through deformable convolutions and attention mechanisms, effectively enhancing the model's perception of blurred targets. Second, a temporal context-aware module is designed, utilizing optical flow estimation and a Gated Recurrent Unit (GRU) to capture motion information across consecutive frames, significantly improving the recognition accuracy for occluded targets. Finally, a context-decoupled detection head is introduced to optimize feature representation for classification and localization tasks. Experimental results on the RUOD dataset demonstrate that at an IoU threshold of 0.5, the mean Average Precision (mAP) and mean Recall (mRecall) are improved by 4.1% and 3.8%, respectively; within the IoU threshold range of 0.5:0.95, improvements of 4.5% and 4.3% are achieved, respectively. The proposed algorithm provides an effective solution for target detection in complex underwater environments.

       

    /

    返回文章
    返回