Dynamic Mode Decomposition Based Video Shot Detection

文献类型： 外文期刊

第一作者： Bi, Chongke

作者： Bi, Chongke;Yuan, Ye;Zhang, Jiawan;Xiang, Yiqing;Wang, Yuehuan;Shi, Yun;Zhang, Ronghui;Zhang, Ronghui

作者机构：

关键词： Dynamic mode decomposition; video shot detection; shot boundary

期刊名称：IEEE ACCESS （ 影响因子：3.367； 五年影响因子：3.671 ）

ISSN： 2169-3536

年卷期： 2018 年 6 卷

页码：

收录情况： SCI

摘要： Shot detection is widely used in video semantic analysis, video scene segmentation, and video retrieval. However, this is still a challenging task, due to the weak boundary and a sudden change in brightness or foreground objects. In this paper, we propose a new framework based on dynamic mode decomposition (DMD) for shot boundary detection. Because the DMD can extract several temporal foreground modes and one temporal background mode from video data, shot boundaries can be detected when the amplitude changes sharply. Here, the amplitude is the DMD coefficient to restore the video. The main idea behind the shot boundaries detection is finding the amplitude change of background mode. We can reduce error detection when the illumination changes sharply or the foreground object (or camera) moves very quickly. At the same time, our algorithm has a high detection accuracy, even the color changes are not obvious, the illumination changes slowly, or the foreground objects overlap. Meanwhile, a color space for DMD is selected for reducing false detection. Finally, the effectiveness of our method will be demonstrated through detecting the shot boundaries of the various content types of videos.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序