DOI码：10.1111/cgf.13566

所属单位：Department of Computer Science and Technology Tsinghua University

发表刊物：Computer Graphics Forum

摘要：Abstract Video stabilization is necessary for many hand‐held shot videos. In the past decades, although various video stabilization methods were proposed based on the smoothing of 2D, 2.5D or 3D camera paths, hardly have there been any deep learning methods to solve this problem. Instead of explicitly estimating and smoothing the camera path, we present a novel online deep learning framework to learn the stabilization transformation for each unsteady frame, given historical steady frames. Our network is composed of a generative network with spatial transformer networks embedded in different layers, and generates a stable frame for the incoming unstable frame by computing an appropriate affine transformation. We also introduce an adversarial network to determine the stability of apiece of video. The network is trained directly using the pair of steady and unsteady videos. Experiments show that our method can produce similar results as traditional methods, moreover, it is capable of handling challenging unsteady video of low quality, where traditional methods fail, such as video with heavy noise or multiple exposures. Our method runs in real time, which is much faster than traditional methods.

备注：Other ISSNs: 1467-8659

合写作者：Jun Hu,Miao Wang,Tai-Jiang Mu,Shi-Min Hu

第一作者：Sen-Zhe Xu

论文类型：期刊论文

学科门类：工学

文献类型：J

卷号：37

期号：7

页面范围：267–276

ISSN号：0167-7055

是否译文：否

发表时间：2018-10-24

发布期刊链接：https://onlinelibrary.wiley.com/doi/10.1111/cgf.13566