Applying PCA to Dimensionality Reduction of Image Features Extracted By Deep Learning
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [14]
  • |
  • Related
  • |
  • Cited by [0]
  • | |
  • Comments
    Abstract:

    Deep learning is a kind of machine learning method widely used in the field of artificial intelligence. The high dependence of deep learning on data makes the dimension of the data needed to be processed, which greatly affects the computing efficiency and the performance of data classification. Taking data dimensionality as the research goal, the methods of dimensionality reduction in deep learning are analyzed in this paper. Then, taking Caltech 101 image dataset as experimental object, VGG-16 depth convolution neural network is used to extract image features, and PCA statistical method is taken as an example to achieve dimensionality reduction of high-dimensional image feature data. Euclidean distance is used as a similarity measure to test the accuracy index after dimensionality reduction at the testing stage. The experiments show that image can still maintain high feature information using the PCA method to reduce the data dimension to 64 dimensions after extracting the 4096 dimensional feature of the fc3 layer of the VGG-16 neural network.

    Reference
    [1] Jose C. A fast on-line algorithm for PCA and its convergence characteristics. IEEE Transactions on Neural Network, 2000, 4(2):299-305
    [2] Majumdar A. Image compression by sparse PCA coding in curvelet domain. Signal, Image and Video Processing, 2009, 3(1):27-34.[doi:10.1007/s11760-008-0056-5
    [3] Gottumukkal R, Asari VK. An improved face recognition technique based on modular PCA approach. Pattern Recognition Letters, 2004, 25(4):429-436.[doi:10.1016/j.patrec.2003.11.005
    [4] Mohammed AA, Minhas R, Wu QMJ, et al. Human face recognition based on multidimensional PCA and extreme learning machine. Pattern Recognition, 2011, 44(10-11):2588-2597.[doi:10.1016/j.patcog.2011.03.013
    [5] Kuo CCJ. Understanding convolutional neural networks with a mathematical model. Journal of Visual Communication and Image Representation, 2016, 41:406-413.[doi:10.1016/j.jvcir.2016.11.003
    [6] Schmidhuber J. Deep learning in neural networks:An overview. Neural Networks, 2015, 61:85-117.[doi:10.1016/j.neunet.2014.09.003
    [7] Girshick R. Fast R-CNN. 2015 IEEE International Conference on Computer Vision. Santiago, Chile. 2015. 1440-1448.
    [8] Szegedy C, Liu W, Jia YQ, et al. Going deeper with convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA. 2015. 1-9.
    [9] Rampasek L, Goldenberg A. TensorFlow:Biology's gateway to deep learning? Cell Systems, 2016, 2(1):12-14.[doi:10.1016/j.cels.2016.01.009
    [10] Sebe N, Tian Q, Lew MS, et al. Similarity matching in computer vision and multimedia. Computer Vision and Image Understanding, 2008, 110(3):309-311.[doi:10.1016/j.cviu.2008.04.001
    [11] Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science, 2006, 313(5786):504-507.[doi:10.1126/science.1127647
    [12] Zhuang FZ, Luo P, He Q, et al. Survey on transfer learning research. Journal of Software, 2015, 26(1):26-39
    [13] Han S, Pool J, Tran J, et al. Learning both weights and connections for efficient neural networks. Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal, Canada. 2015. 1135-1143.
    [14] Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. 13th European Conference on Computer Vision. Zurich, Switzerland. 2014. 818-833.]
    Related
Get Citation

杨博雄,杨雨绮.利用PCA进行深度学习图像特征提取后的降维研究.计算机系统应用,2019,28(1):279-283

Copy
Share
Article Metrics
  • Abstract:2930
  • PDF: 5009
  • HTML: 8836
  • Cited by: 0
History
  • Received:June 08,2018
  • Revised:June 27,2018
  • Online: December 27,2018
Article QR Code
You are the first992285Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063