A light-weight stereo matching network based on multi-scale features fusion and robust disparity refinement

文献类型： 外文期刊

第一作者： Yang, Xiaowei

作者： Yang, Xiaowei;Feng, Zhiguo;Zhang, Zhenbo;He, Lin;Yang, Xiaowei;Zhao, Yong;Sang, Haiwei;Zhang, Guiying;He, Lin;Feng, Zhiguo

作者机构：

关键词： computer vision; image processing; stereo image processing

期刊名称：IET IMAGE PROCESSING （ 影响因子：2.3； 五年影响因子：2.3 ）

ISSN： 1751-9659

年卷期： 2023 年 17 卷 6 期

页码：

收录情况： SCI

摘要： In recent years, convolutional-neural-network based stereo matching methods have achieved significant gains compared to conventional methods in terms of both speed and accuracy. Current state-of-the-art disparity estimation algorithms require many parameters and large amounts of computational resources and are not suited for applications on edge devices. In this paper, an end-to-end light-weight network (LWNet) for fast stereo matching is proposed, which consists of an efficient backbone with multi-scale feature fusion for feature extraction, a 3D U-Net aggregation architecture for disparity computation, and color guidance in a 2D convolutional neural network (CNN) for disparity refinement. MobileNetV2 is adopted as an efficient backbone in feature extraction. The channel attention module is applied to improve the representational capacity of features and multi-resolution information is adaptively incorporated into the cost volume via cross-scale connections. Further, a left-right consistency check and color guidance refinement are introduced and a robust disparity refinement network is designed with skip connections and dilated convolutions to capture global context information and improve disparity estimation accuracy with little computational cost and memory space. Extensive experiments on Scene Flow, KITTI 2015, and KITTI 2012 demonstrate that the proposed LWNet achieves competitive accuracy and speed when compared with state-of-the-art stereo matching methods.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序