面向医疗整容的三维人脸重建与编辑系统
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

广州市科技计划重点领域研发计划(202007030005)


3D Face Reconstruction and Editing System for Medical Plastic Surgery
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 增强出版
  • |
  • 文章评论
    摘要:

    针对医疗整容领域中客户在术前无法直观感受术后整容效果的问题, 提出了面向医疗整容领域的三维人脸重建与编辑系统. 该系统首先对用户上传的图片进行特征点标记, 然后结合三维形变模型(3D morphable model, 3DMM)对输入图像进行对齐, 接着将处理后的图像输入预先训练好的三维人脸重建网络中, 便可得到输入图像所对应的三维人脸模型. 系统对此模型进行加载渲染后, 用户可以对模型的脸颊、鼻梁和下巴进行编辑以达到模拟整容的效果, 之后可对模型进行保存并查看诊断结果. 最后, 对重建效果、整形效果和诊断结果可靠性进行测试. 实验结果表明, 该系统对中青年人脸的重建效果好, 重建模型与输入图片相似度高; 对模型整形后的部位依然保持平滑自然, 达到了模拟整容的效果; 在给定正确的人脸尺寸后, 诊断结果给出的整形建议在毫米级范围内, 说明了整形结果具有较高的可靠性.

    Abstract:

    Given the problem that in the field of medical plastic surgery, customers can not directly grasp the postoperative effect of plastic surgery before the surgery, this study proposes a three-dimensional (3D) face reconstruction and editing system for medical plastic surgery. Specifically, the system marks the feature points of the pictures uploaded by the user, aligns the input images with the 3D morphable model (3DMM), and then inputs the processed images into the pre-trained 3D face reconstruction network to obtain the 3D face model corresponding to the input images. After the system loads and renders this model, the user can edit the cheeks, bridge of the nose, and chin of the model to simulate the plastic surgery, and he/she can also save the model to view the diagnosis results. Finally, the reliability of the reconstruction effect, plastic surgery effect, and diagnosis results are tested. The experimental results show that the system is effective in reconstructing young and middle-aged faces, offering reconstructed models highly similar to the input images. The parts of the model remain smooth and natural after the plastic surgery, which means the effect of simulating the plastic surgery is achieved. After the correct face size is determined, the plastic surgery recommendations suggested by the diagnosis results are at the mm level, indicating that the plastic surgery results are highly reliable.

    参考文献
    相似文献
    引证文献
引用本文

何龙健,钟子乐,邹大辉,黄灿斌,邓卓然,梁艳.面向医疗整容的三维人脸重建与编辑系统.计算机系统应用,2022,31(12):69-77

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-04-04
  • 最后修改日期:2022-05-16
  • 录用日期:
  • 在线发布日期: 2022-07-28
  • 出版日期:
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号