Edge supervision and multi-scale cost volume for stereo matching

文献类型： 外文期刊

第一作者： Yang, Xiaowei

作者： Yang, Xiaowei;Feng, Zhiguo;He, Lin;Yang, Xiaowei;Zhao, Yong;Zhang, Guiying;He, Lin

作者机构：

关键词： Stereo matching; Geometric constraints; Multi-scale cost volume; Disparity refinement network

期刊名称：IMAGE AND VISION COMPUTING （ 影响因子：3.86； 五年影响因子：3.818 ）

ISSN： 0262-8856

年卷期： 2022 年 117 卷

页码：

收录情况： SCI

摘要： Recently, methods based on Convolutional Neural Network have achieved huge progress in stereo matching. However, it is still difficult to find accurate matching points in inherently ill-posed regions (e.g., weak texture areas and around object edges), in which the accuracy of disparity estimate can be improved by the corresponding geometric constraints. To tackle this problem, we innovatively generate the depth ground-truth boundary dataset by mining the instance segmentation and semantic segmentation datasets and propose RDNet, which incorporates edge cues into stereo matching. The network learns geometric information through a separate processing branch edge stream, which can process feature information in parallel with the stereo stream. The edge stream removes noise and only focuses on processing the relevant boundary information. Besides, we introduce a multi-scale cost volume in hierarchical cost aggregation to enlarge the receptive fields and capture structural and global representations that can significantly improve the ability of scene understanding and disparity estimation accuracy. Moreover, a disparity refinement network with several dilated convolutions is applied to further improve the accuracy of the final disparity estimation. The proposed method is evaluated on Sceneflow, KITTI 2015 and KITTI 2012 benchmark datasets, and the qualitative and quantitative results demonstrate that the proposed RDNet significantly achieves the state-of-the-art stereo matching performance. (c) 2021 Published by Elsevier B.V.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序