Real-Like Virtual Fitting for Single Image
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [18]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    An image based real-like virtual fitting system focusing on head accessories such as glasses and hat is proposed in this paper. The key techniques are 3D registration and virtual-real synthesis. Firstly, a facial landmark detection and pose estimation based algorithm for capturing registration data is presented. Then the approach using color blending and depth buffering to solve occlusion and model material problem is discussed. The registration algorithm is evaluated on the AFLW(Annotated Facial Landmarks in the Wild) dataset and testified to be precise enough for virtual fitting. Finally, a series of virtual fitting results are showed. The experimental results, which are obtained on the condition of pose variation and part occlusion, indicate that the proposed virtual fitting technique is fast, accurate and real-like.

    Reference
    1 DITTO. http://www.ditto.com/.
    2 Deniz O, Castrillon M, Lorenzo J, et al. Computer vision based eyewear selector. Journal of Zhejiang University -SCIENCE C (Computers & Electronics), 2010, 11(2): 79-91
    3 李娟.基于特征点定位的虚拟试戴的研究[学位论文].上海:上海交通大学,2011.
    4 刘丽余.基于虚拟试戴技术的眼镜销售系统的研究与实现[学位论文].成都:电子科技大学,2011.
    5 欧诺虚拟配镜, http://www.ono.com.cn/.
    6 SmartBuyGlasses, http://www.smartbuyglasses.cn/3D-Try-On.
    7 Eyecare H. http://harmonyeyecare.opticalestore. com.
    8 Zhu JE, Hoi SCH, Lyu MR. Real-time non-rigid shape recovery via Active Appearance Models for Augmented Reality. Proc. of 9th European Conference on Computer Vision. Graz, Austria. 2006. 186-197.
    9 Azuma RT. A survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 1997, 6(4): 355-385.
    10 Uricar M, Franc V, Hlavac V. Detector of facial landmarks learned by the Structured Output SVM. Proc. of the 7th International Conference on Computer Vision Theory and Applications. Rome, Italy. 2012. 547-556.
    11 DeMenthon DF, Davis LS. Model-based object pose in 25 lines of code. International Journal of Computer Vision, 1995, 15(1-2): 123-141.
    12 Storer M, Urschler M, Bischof H. R3D-MAM: 3D morphable appearance model for efficient fine head pose estimation from still images. Proc. of the International Conference on Computer Vision Workshops. Kyoto, Japan. 2009. 192-199.
    13 Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D. Object detection with discriminatively trained part based models. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2009, 99(1).
    14 Viola P, Jones M. Robust real-time object detection. International Journal of Computer Vision, 2004, 57(2): 137- 154.
    15 sochantaridis I, Joachims T, Hofmann T, Altun Y, Singer Y. Large margin methods for structured and interdependent output variables. Journal of Machine Learning Research, 2005, 6:1453-1484.
    16 Heikkila M, Pietikainen M, Schmid C. Description of interest regions with local binary patterns. Pattern Recognition, 2009, 42(3): 425-436.
    17 Shreiner D, Sellers G, Kessenich JM, Licea-Kane BM. OpenGL Programming Guide: The Official Guide to Learning OpenGL: 8th Edition. United States: Addison-Wesley Professional, 2013.
    18 Koestinger M, Wohlhart P, Roth PM, Bischof H. Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. First IEEE International Workshop on Benchmarking Facial Image Analysis Technologies, 2011.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

杜瑶,王兆仲.单幅图像真实感虚拟试戴技术.计算机系统应用,2015,24(4):19-25

Copy
Share
Article Metrics
  • Abstract:1628
  • PDF: 2967
  • HTML: 0
  • Cited by: 0
History
  • Received:August 01,2014
  • Revised:August 28,2014
  • Online: April 24,2015
Article QR Code
You are the first990515Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063