DOI码：10.1016/j.gvc.2021.200023

所属单位：Beijing Institute of Mathematical Sciences and Applications; Tsinghua University

发表刊物：Graphics and Visual Computing

项目来源：National Key Technology R&D Program (2017YFB1002604); NSFC (61772298, 61832016)

摘要：How do I look if I have the same nose shape as my favorite star? Existing methods for face image manipulation generally focus on modifying predefined facial attributes, editing expressions and changing image styles, where users cannot control the shapes of specific semantic facial parts freely in the generated face image. The facial part shapes are described by their geometries and need to be controlled by continuously generating geometric parameters. Therefore, the existing methods that work with discretely labelled attributes are not applicable on this task. In this paper, we propose a novel approach to learn the disentangled shape representation for a face image, namely the FaceShapeGene, which encodes the shape information of the semantic facial parts into separate chunks in the latent space. It allows users to freely recombine the part-wise latent chunks of a face image from other individuals to transfer a specified facial part shape, just like gene editing. Experimental results on several tasks demonstrate that the proposed FaceShapeGene representation correctly disentangles the shape features of different semantic parts. Comparisons to existing methods show the superiority of the proposed method on facial parts editing tasks.

备注：Funding: National Key Technology R&D Program (2017YFB1002604); National Natural Science Foundation of China (61772298, 61832016); Research Grant of Beijing Higher Institution Engineering Research Center; Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology

合写作者：Hao-Zhi Huang,Fang-Lue Zhang,Song-Hai Zhang

第一作者：Sen-Zhe Xu

论文类型：期刊论文

论文编号：200023

学科门类：工学

文献类型：J

卷号：4

页面范围：200023

ISSN号：2666-6294

是否译文：否

发布期刊链接：https://linkinghub.elsevier.com/retrieve/pii/S2666629421000061