一种基于授权机制的分布式文件系统小文件访问优化策略
作者:

Optimization Strategy Based on Delegation Mechanism for Distributed File System in Massive Small File Access Patterns
Author:
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献 [10]
  • |
  • 相似文献 [20]
  • | | |
  • 文章评论
    摘要:

    针对分布式文件系统应用于海量小文件访问模式时, 元数据请求过多导致系统性能下降的问题, 提出了客户端元数据缓存授权机制的解决方案. 客户端从服务器读取元数据时, 申请相应类型的授权, 服务器分析请求并决定是否授予此客户端所访问的元数据的授权. 若客户端成功获取授权, 则将其与本地缓存的元数据相关联, 作为缓冲有效性的凭证. 当再次访问本地缓存的元数据时, 若有相关授权, 则可以直接从本地获取元数据, 无需向服务器发送缓存数据的有效性验证RPC. 仿真实验表明, 文中的方法有效的降低了客户端发送元数据请求RPC的数量, 节省了宝贵的网络带宽资源, 降低了元数据服务器的负载.

    Abstract:

    Aiming at the system performance degradation problems of distributed file system in massive small file access patterns, designed and implemented a delegation mechanism for meta data cache in client .The client apply some kinds of delegations when getting meta data from the server. The meta data server checked and decided ecide whether to grant the delegation or not. Once the client getting the delegation which is stored in the local memory, the meta data getting operation can be unnecessary to sent RPC request. The simulation result shows that our method in this paper can reduce the number of the RPC request effectively, and aving valuable network bandwidth resources, reducing the metadata server load.

    参考文献
    1 Hilderbrand D, Ward L, Honeyman P. Large files, small writes,and pNFS. Proc. of the 20th Annual International Conference on Supercomputing. 2006: 116-124.
    2 Carns P, Lang S, Ross R, Yannur MV, Kunkel J, Ludwig T. Small-file access in parallel file systems. IPDPS, 2009.
    3 Cluster File Systems Inc. Lustre: A Scalable, High-Performance File System. www.lustre.org, 2002.
    4 Tomkins A, Patterson RH, Gibson G. Informedmulti-process prefetching and caching. Proc. of the 1997 ACM SIGMET-RICS Conference on Measurement and Modeling of Computer Systems. Seattle, Washington, 1997: 100-114.
    5 Patterson RH, Gibson GA, Ginting E. Informed prefetching and caching. 15th ACM Symposium on Operating System Principles. 1995.
    6 Anderson TE, Dahlin MD, Neefe JM, Patterson DA, Roselli DS, Wang RY. Server-less network file systems. ACM Trans. on Computer Systems, ACM, February1996,14(1):41-79.
    7 Hendricks J, Sambasivan RR, Sinnamohideen S, Ganger GR. Improving small file performance in object-based storage. Technical Report 06-104, Parallel Data Laboratory, Carnegie Mellon University, 2006.
    8 Patil S, Gibson G. Scale and Concurrency of GIGA+: File System Directories with Millions of Files. Proc. of the 9th USENIX Conference on File and Storage Technologies (FAST'11). San Jose CA, February 2011.
    9 https://btrfs.wiki.kernel.org/.April 24,2012.
    10 Radkov P, Yin L, Goyal P, Sarkar P, Shenoy P. A Performance Comparison of NFS and iSCSI for IP-Networked Storage. Proc. of the 3rd USENIX Conference on File and Storage Technologies. March 31, 2004, San Francisco, CA.
    引证文献
引用本文

曹风华.一种基于授权机制的分布式文件系统小文件访问优化策略.计算机系统应用,2013,22(7):183-186,176

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2012-12-25
  • 最后修改日期:2013-03-01
  • 在线发布日期: 2013-07-25
文章二维码
您是第11282485位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号