文献类型： 外文期刊

作者： Yang, Xiaowei ¹ ; Feng, Zhiguo ¹ ; Zhao, Yong ³ ; Zhang, Guiying ⁴ ; He, Lin ¹ ;

作者机构： 1.Guizhou Univ, Sch Mech Engn, Guiyang 550025, Peoples R China

2.Guizhou Acad Agr Sci, Guizhou Tea Res Inst, Guiyang 550006, Peoples R China

3.Peking Univ, Sch Elect & Comp Engn, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China

4.Guangzhou Med Univ, Sch Basic Med Sci, Guangzhou 511436, Peoples R China

5.Liupanshui Normal Coll, Liupanshui 553004, Peoples R China

关键词： Stereo matching; Geometric constraints; Multi-scale cost volume; Disparity refinement network

期刊名称：IMAGE AND VISION COMPUTING （ 影响因子：3.86； 五年影响因子：3.818 ）

ISSN： 0262-8856

年卷期： 2022 年 117 卷

页码：

收录情况： SCI

摘要： Recently, methods based on Convolutional Neural Network have achieved huge progress in stereo matching. However, it is still difficult to find accurate matching points in inherently ill-posed regions (e.g., weak texture areas and around object edges), in which the accuracy of disparity estimate can be improved by the corresponding geometric constraints. To tackle this problem, we innovatively generate the depth ground-truth boundary dataset by mining the instance segmentation and semantic segmentation datasets and propose RDNet, which incorporates edge cues into stereo matching. The network learns geometric information through a separate processing branch edge stream, which can process feature information in parallel with the stereo stream. The edge stream removes noise and only focuses on processing the relevant boundary information. Besides, we introduce a multi-scale cost volume in hierarchical cost aggregation to enlarge the receptive fields and capture structural and global representations that can significantly improve the ability of scene understanding and disparity estimation accuracy. Moreover, a disparity refinement network with several dilated convolutions is applied to further improve the accuracy of the final disparity estimation. The proposed method is evaluated on Sceneflow, KITTI 2015 and KITTI 2012 benchmark datasets, and the qualitative and quantitative results demonstrate that the proposed RDNet significantly achieves the state-of-the-art stereo matching performance. (c) 2021 Published by Elsevier B.V.