Data Service Solution Based on FTP Protocol
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [23]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    With the continuous accumulation of data, the data storage system has evolved from a single-node, small-scale file system to a distributed file system that supports massive data storage. How to provide simple, efficient and stable data uploading and downloading service for users has become an extensive research problem in distributed file system. To this end, we propose a server-side solution based on FTP protocol, which includes the use of buffer, coroutine, multi-process, and other technologies to improve the algorithms and optimize the transmission model, so that the data flow can be transferred rapidly. The proposed solution achieves high availability, high concurrency, and good scalability with the cooperation of Keepalived and LVS. Modifications to the FTP protocol makes the server support dynamic validation and compatible with multiple encoding formats. In the actual operation, taking storage system of China Science and Technology Cloud, i.e. iHarbor, as an example, the effectiveness, reliability, and performance of data transmission of the proposed solution are verified, which can fully meet the needs of users.

    Reference
    [1] Ghemawat S, Gobioff H, Leung ST. The google file system. Proceedings of the 19th ACM Symposium on Operating Systems Principles. Bolton Landing, NY, USA. 2003. 29–43.
    [2] Shafer J, Rixner S, Cox AL. The hadoop distributed filesystem: Balancing portability and performance. 2010 IEEE International Symposium on Performance Analysis of Systems & Software. White Plains, NY, USA. 2010. 122–133.
    [3] Alibaba Taobao. TFS. https://github.com/alibaba/tfs.
    [4] Weil SA, Brandt SA, Miller EL, et al. Ceph: A scalable, high-performance distributed file system. Proceedings of the 7th Symposium on Operating Systems Design and Implementation. Berkeley, CA, USA. 2006. 307–320.
    [5] 何华. GlusterFS的数据分布策略与性能优化研究[硕士学位论文]. 长沙: 国防科学技术大学, 2013.
    [6] 盛乐标, 周庆林. 虚拟机环境中Keepalived虚拟IP自动漂移的研究. 电子技术与软件工程, 2019, (5): 153–154
    [7] Wei Q, Xu GL, Li YL. Research on cluster and load balance based on linux virtual server. International Conference on Information Computing and Applications. Tangshan, China. 2010. 169–176.
    [8] Gien M. A file transfer protocol (FTP). Computer Networks (1976), 1978, 2(4–5): 312–319
    [9] 苏悦. FIashFXP使用有秘技. 电脑知识与技术, 2006, (7): 30–31
    [10] Woodraska D, Sanford M, Xu DX. Security mutation testing of the FileZilla FTP server. Proceedings of the 2011 ACM Symposium on Applied Computing. Taichung, China. 2011. 1425–1430.
    [11] 黄仕凰. 基于FTP协议的客户端软件开发. 科技信息, 2008, (21): 164–166. [doi: 10.3969/j.issn.1001-9960.2008.21.130
    [12] 刘陆民, 董园飞. 基于vsftpd虚拟用户设置的研究与实现. 无线互联科技, 2018, 15(5): 17–18. [doi: 10.3969/j.issn.1672-6944.2018.05.009
    [13] Extremely fast and scalable Python FTP server library. https://github.com/giampaolo/pyftpdlib.
    [14] 王钊, 唐志, 康征. 建立proftp服务器并实现用户访问目录控制和磁盘限额的探索与实践. 数字石油和化工, 2009, (10): 87–90
    [15] Twisted Matrix Lab. https://twistedmatrix.com/trac/.
    [16] Li HL, Thng ILJ. Edge node buffer usage in optical burst switching networks. Photonic Network Communications, 2007, 13(1): 31–51
    [17] Radošević D, Magdalenić I. Python implementation of source code generator based on dynamic frames. 2011 Proceedings of the 34th International Convention MIPRO. Opatija, Croatia. 2011. 969–974.
    [18] Spivey M. Faster coroutine pipelines. Proceedings of the ACM on Programming Languages, 2017, 1(ICFP): 5
    [19] Roth A, Sohi GS. Speculative data-driven multithreading. Proceedings HPCA 7th International Symposium on High-Performance Computer Architecture. Monterrey, Mexico. 2001. 37–48.
    [20] 张欣艳. 流模式下FTP文件传输效率分析及改进. 智能计算机与应用, 2019, 9(2): 126–129. [doi: 10.3969/j.issn.2095-2163.2019.02.029
    [21] 赵学作. 打造安全可控的FTP服务器. 网络安全和信息化, 2019, (7): 125–127
    [22] Dan Blanchard. Chardet. https://github.com/chardet.
    [23] Sree TR, Bhanu SMS. Secure logging scheme for forensic analysis in cloud. Concurrency and Computation: Practice and Experience, 2019, 31(15): e5143
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

李云,张海明.基于FTP协议的数据服务解决方案.计算机系统应用,2021,30(1):63-69

Copy
Share
Article Metrics
  • Abstract:1122
  • PDF: 2559
  • HTML: 1655
  • Cited by: 0
History
  • Received:May 25,2020
  • Revised:June 16,2020
  • Online: December 31,2020
Article QR Code
You are the first990989Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063