计算机科学 ›› 2020, Vol. 47 ›› Issue (9): 74-80.doi: 10.11896/jsjkx.190700037

• 数据库&大数据&数据科学 • 上一篇    下一篇

面向非易失性内存文件系统的NVM模拟与验证方法

王鑫鑫1, 诸葛晴凤2, 吴林1   

  1. 1 重庆大学计算机学院 重庆400044
    2 华东师范大学计算机科学与软件工程学院 上海200062
  • 收稿日期:2019-07-03 发布日期:2020-09-10
  • 通讯作者: 诸葛晴凤(qfzhuge@gmail.com)
  • 作者简介:wang_xinx@cqu.edu.cn
  • 基金资助:
    国家高技术研究发展计划(863计划)(2015AA015304);国家自然科学基金(61472052)

Method for Simulating and Verifying NVM-based In-memory File Systems

WANG Xin-xin1, ZHUGE Qing-feng2, WU Lin1   

  1. 1 College of Computer Science,Chongqing University,Chongqing 400044,China
    2 Shool of Computer Science and Software Engineering,East China Normal University,Shanghai 200062,China
  • Received:2019-07-03 Published:2020-09-10
  • About author:WANG Xin-xin,born in 1996,postgra-duate.His main research interests include non-volatile memory and in-memo-ry file systems.
    ZHUGE Qing-feng,born in 1970,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include parallel architectures,embedded systems,sup-ply-chain management,real-time systems,optimization algorithms,compi-lers,and scheduling.
  • Supported by:
    National High Technology Research and Development Program of China (2015AA015304) and National Natural Science Foundation of China (61472052).

摘要: 现有非易失性内存文件系统都以DRAM模拟非易失性内存(Non-Volatile Memory,NVM)进行测试,而没有充分考虑两者间的写时延和写磨损特性差异,使得测试结果无法准确反映文件系统在NVM物理设备上的写性能以及对NVM造成的磨损情况。现有NVM模拟器准确度不高,且仿真接口不完备,无法满足内存文件系统对NVM的仿真需求。对此,提出一种面向非易失性内存文件系统的NVM模拟与验证方法。首先,结合非易失性内存文件系统本身的数据读写特性,提出内存文件系统中NVM写时延的模拟方案;其次,跟踪内存文件系统对NVM的读写操作,以验证文件系统对NVM物理设备的写磨损分布情况。选取多个典型内存文件系统实现上述方法。实验结果表明,提出的写时延模拟方法能够将写时延的模拟误差平均降低65%,写磨损验证方法能够较准确地反映内存文件系统对不同粒度NVM页面的磨损分布情况。

关键词: 非易失性存储器, 磨损均衡, 内存文件系统, 写时延

Abstract: Most existing NVM-based file systems conduct experiments by simulating NVM with DRAM.However,they ignore the differences between NVM and DRAM,and make it impossible to accurately reflect the performance and wear distribution of file systems on NVM devices.The accuracy and interfaces of existing NVM emulators are not sufficient to support the simulation requirements of NVM-based file systems.This paper proposes a method for simulating NVM write latency and verifying wear distribution of NVM-based file systems.The accuracy of latency simulation is improved by injecting software-created delay according to the I/O characteristics of file system.To depict the wear distribution of NVM physical devices caused by the NVM-based file system,every update operation to NVM page is tracked.Experimental results show that the proposed method can reduce the error rate of write latency simulation by 65% on average,while accurately reflect the wear distribution of NVM.

Key words: In-memory file system, Non-volatile memory, Wear leveling, Write latency

中图分类号: 

  • TP316.89
[1] LEE B C,ZHOU P,YANG J,et al.Phase-change technologyand the future of main memory[J].IEEE Micro,2010,30(1):143-143.
[2] Intel Optane Memory[EB/OL].https://www.intel.com/content/www/us/en/architecture-and-technology/optane-memory.html.
[3] FREITAS R F,WILCKE W W.Storage-class memory:The next storage system technology[J].IBM Journal of Research and Development,2008,52(4/5):439-447.
[4] JUNG M,SHALF J,KANDEMIR M.Design of a large-scalestorage-class RRAM system[C]//Proceedings of the 27th international ACM Conference on International Conference on Supercomputing.ACM,2013:103-114.
[5] XU C,CHEN P Y,NIU D,et al.Architecting 3D vertical resistive memory for next-generation storage systems[C]//2014 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).IEEE,2014:55-62.
[6] LUO L,LIU Y,QIAN D P.Survey on in-memory computingtechnology[J].Ruan Jian Xue Bao/Journal of Software,2016,27(8):2147-2167.
[7] ARULRAJ J,PAVLO A,DULLOOR S R.Let’s talk about sto-rage & recovery methods for non-volatile memory database systems[C]//Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data.ACM,2015:707-722.
[8] CAULFIELD A M,DE A,COBURN J,et al.Moneta:A high-performance storage array architecture for next-generation,non-volatile memories[C]//Proceedings of the 2010 43rd Annual IEEE/ACM International Symposium on Microarchitecture.IEEE Computer Society,2010:385-395.
[9] WU C,ZHANG G,LI K.Rethinking computer architectures andsoftware systems for phase-change memory[J].ACM Journal on Emerging Technologies in Computing Systems,2016,12(4):33.
[10] CONDIT J,NIGHTINGALE E B,FROST C,et al.Better I/O through byte-addressable,persistent memory[C]//Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles.ACM,2009:133-146.
[11] WU X,REDDY A L.SCMFS:a file system for storage classmemory[C]//Proceedings of 2011 International Conference for High Performance Computing,Networking,Storage and Analysis.ACM,2011:39.
[12] DULLOOR S R,KUMAR S,KESHAVAMURTHY A,et al.System software for persistent memory[C]//Proceedings of the Ninth European Conference on Computer Systems.ACM,2014:15.
[13] XU J,SWANSON S.NOVA:a log-structured file system for hybrid volatile/non-volatile main memories[C]//Proceedings of the 14th Usenix Conference on File and Storage Technologies.USENIX Association,2016:323-338.
[14] OU J,SHU J,LU Y.A high performance file system for non-volatile main memory[C]//Proceedings of the Eleventh European Conference on Computer Systems.ACM,2016.
[15] SHA E H M,CHEN X,ZHUGE Q,et al.A new design of in-memory file system based on file virtual address framework[J].IEEE Transactions on Computers,2016,65(10):2959-2972.
[16] VOLOS H,MAGALHAES G,CHERKASOVA L,et al.Quartz:A lightweight performance emulator for persistent memory soft-.ware[C]//Proceedings of the 16th Annual Middleware Confe-rence.ACM,2015:37-49.
[17] DUAN Z,LIU H,LIAO X,et al.HME:A lightweight emulator for hybrid memory[C]//2018 Design,Automation & Test in Europe Conference & Exhibition (DATE).IEEE,2018:1375-1380.
[18] WU L,ZHUGE Q,SHA E H M,et al.DWARM:A wear-aware memory management scheme for in-memory file systems[J].Future Generation Computer Systems,2018,88:1-15.
[19] SHEN Z R,XUE W,SHU J W.Research on New Non-Volatile Storage[J].Journal of Computer Research & Development,2014,51(2):445-453.
[20] Fio:Flexible I/O Tester[EB/OL].http://freecode.com/projects/fio.
[21] PostMark[EB/OL].http://openbenchmarking.org/test/pts/postmark.
[22] BINKERT N,BECKMANN B,BLACK G,et al.The gem5 simulator[J].ACM SIGARCH Computer Architecture News,2011,39(2):1-7.
[23] CHEN X,SHA E H M,ZENG Y,et al.Efficient wear leveling for inodes of file systems on persistent memories[C]//2018 Design,Automation & Test in Europe Conference & Exhibition (DATE).IEEE,2018:1524-1527.
[1] 李月,王芳.
基于NVM的存储安全综述
Survey on Storage Security of Emerging Non-volatile Memory
计算机科学, 2018, 45(7): 53-60. https://doi.org/10.11896/j.issn.1002-137X.2018.07.008
[2] 孙强, 诸葛晴凤, 陈咸彰, 沙行勉, 吴林.
带磨损均衡的小粒度非易失性内存管理机制
In-page Wear-leveling Memory Management Based on Non-volatile Memory
计算机科学, 2018, 45(11A): 505-510.
[3] 孙志龙,沙行勉,诸葛晴凤,陈咸彰,吴剀劼.
面向内存文件系统的数据一致性更新机制研究
Research on Data Consistency for In-memory File Systems
计算机科学, 2017, 44(2): 222-227. https://doi.org/10.11896/j.issn.1002-137X.2017.02.036
[4] 赵利伟,陈咸彰,诸葛晴凤.
连接操作在SIMFS和EXT4上的性能比较
Performance Comparison of Join Operations on SIMFS and EXT4
计算机科学, 2016, 43(6): 184-187. https://doi.org/10.11896/j.issn.1002-137X.2016.06.037
[5] 姜国松.
一种高效、可扩展细粒度缓存管理混合存储研究
Research about Efficient and Scalable Hybrid Memories at Fine-granularity Cache Management
计算机科学, 2013, 40(8): 79-82.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!