Computer Science ›› 2020, Vol. 47 ›› Issue (9): 74-80.doi: 10.11896/jsjkx.190700037

• Database & Big Data & Data Science • Previous Articles     Next Articles

Method for Simulating and Verifying NVM-based In-memory File Systems

WANG Xin-xin1, ZHUGE Qing-feng2, WU Lin1   

  1. 1 College of Computer Science,Chongqing University,Chongqing 400044,China
    2 Shool of Computer Science and Software Engineering,East China Normal University,Shanghai 200062,China
  • Received:2019-07-03 Published:2020-09-10
  • About author:WANG Xin-xin,born in 1996,postgra-duate.His main research interests include non-volatile memory and in-memo-ry file systems.
    ZHUGE Qing-feng,born in 1970,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include parallel architectures,embedded systems,sup-ply-chain management,real-time systems,optimization algorithms,compi-lers,and scheduling.
  • Supported by:
    National High Technology Research and Development Program of China (2015AA015304) and National Natural Science Foundation of China (61472052).

Abstract: Most existing NVM-based file systems conduct experiments by simulating NVM with DRAM.However,they ignore the differences between NVM and DRAM,and make it impossible to accurately reflect the performance and wear distribution of file systems on NVM devices.The accuracy and interfaces of existing NVM emulators are not sufficient to support the simulation requirements of NVM-based file systems.This paper proposes a method for simulating NVM write latency and verifying wear distribution of NVM-based file systems.The accuracy of latency simulation is improved by injecting software-created delay according to the I/O characteristics of file system.To depict the wear distribution of NVM physical devices caused by the NVM-based file system,every update operation to NVM page is tracked.Experimental results show that the proposed method can reduce the error rate of write latency simulation by 65% on average,while accurately reflect the wear distribution of NVM.

Key words: In-memory file system, Non-volatile memory, Wear leveling, Write latency

CLC Number: 

  • TP316.89
[1] LEE B C,ZHOU P,YANG J,et al.Phase-change technologyand the future of main memory[J].IEEE Micro,2010,30(1):143-143.
[2] Intel Optane Memory[EB/OL].https://www.intel.com/content/www/us/en/architecture-and-technology/optane-memory.html.
[3] FREITAS R F,WILCKE W W.Storage-class memory:The next storage system technology[J].IBM Journal of Research and Development,2008,52(4/5):439-447.
[4] JUNG M,SHALF J,KANDEMIR M.Design of a large-scalestorage-class RRAM system[C]//Proceedings of the 27th international ACM Conference on International Conference on Supercomputing.ACM,2013:103-114.
[5] XU C,CHEN P Y,NIU D,et al.Architecting 3D vertical resistive memory for next-generation storage systems[C]//2014 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).IEEE,2014:55-62.
[6] LUO L,LIU Y,QIAN D P.Survey on in-memory computingtechnology[J].Ruan Jian Xue Bao/Journal of Software,2016,27(8):2147-2167.
[7] ARULRAJ J,PAVLO A,DULLOOR S R.Let’s talk about sto-rage & recovery methods for non-volatile memory database systems[C]//Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data.ACM,2015:707-722.
[8] CAULFIELD A M,DE A,COBURN J,et al.Moneta:A high-performance storage array architecture for next-generation,non-volatile memories[C]//Proceedings of the 2010 43rd Annual IEEE/ACM International Symposium on Microarchitecture.IEEE Computer Society,2010:385-395.
[9] WU C,ZHANG G,LI K.Rethinking computer architectures andsoftware systems for phase-change memory[J].ACM Journal on Emerging Technologies in Computing Systems,2016,12(4):33.
[10] CONDIT J,NIGHTINGALE E B,FROST C,et al.Better I/O through byte-addressable,persistent memory[C]//Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles.ACM,2009:133-146.
[11] WU X,REDDY A L.SCMFS:a file system for storage classmemory[C]//Proceedings of 2011 International Conference for High Performance Computing,Networking,Storage and Analysis.ACM,2011:39.
[12] DULLOOR S R,KUMAR S,KESHAVAMURTHY A,et al.System software for persistent memory[C]//Proceedings of the Ninth European Conference on Computer Systems.ACM,2014:15.
[13] XU J,SWANSON S.NOVA:a log-structured file system for hybrid volatile/non-volatile main memories[C]//Proceedings of the 14th Usenix Conference on File and Storage Technologies.USENIX Association,2016:323-338.
[14] OU J,SHU J,LU Y.A high performance file system for non-volatile main memory[C]//Proceedings of the Eleventh European Conference on Computer Systems.ACM,2016.
[15] SHA E H M,CHEN X,ZHUGE Q,et al.A new design of in-memory file system based on file virtual address framework[J].IEEE Transactions on Computers,2016,65(10):2959-2972.
[16] VOLOS H,MAGALHAES G,CHERKASOVA L,et al.Quartz:A lightweight performance emulator for persistent memory soft-.ware[C]//Proceedings of the 16th Annual Middleware Confe-rence.ACM,2015:37-49.
[17] DUAN Z,LIU H,LIAO X,et al.HME:A lightweight emulator for hybrid memory[C]//2018 Design,Automation & Test in Europe Conference & Exhibition (DATE).IEEE,2018:1375-1380.
[18] WU L,ZHUGE Q,SHA E H M,et al.DWARM:A wear-aware memory management scheme for in-memory file systems[J].Future Generation Computer Systems,2018,88:1-15.
[19] SHEN Z R,XUE W,SHU J W.Research on New Non-Volatile Storage[J].Journal of Computer Research & Development,2014,51(2):445-453.
[20] Fio:Flexible I/O Tester[EB/OL].http://freecode.com/projects/fio.
[21] PostMark[EB/OL].http://openbenchmarking.org/test/pts/postmark.
[22] BINKERT N,BECKMANN B,BLACK G,et al.The gem5 simulator[J].ACM SIGARCH Computer Architecture News,2011,39(2):1-7.
[23] CHEN X,SHA E H M,ZENG Y,et al.Efficient wear leveling for inodes of file systems on persistent memories[C]//2018 Design,Automation & Test in Europe Conference & Exhibition (DATE).IEEE,2018:1524-1527.
[1] LIU Gao-cong, LUO Yong-ping, JIN Pei-quan. Accelerating Persistent Memory-based Indices Based on Hotspot Data [J]. Computer Science, 2022, 49(8): 26-32.
[2] FAN Peng-hao, HUANG Guo-rui, JIN Pei-quan. NVRC:Write-limited Logging for Non-volatile Memory [J]. Computer Science, 2021, 48(3): 130-135.
[3] ZHANG Xiao, ZHANG Si-meng, SHI Jia, DONG Cong, LI Zhan-huai. Review on Performance Optimization of Ceph Distributed Storage System [J]. Computer Science, 2021, 48(2): 1-12.
[4] WANG Tao, LIANG Xiao, WU Qian-qian, WANG Peng, CAO Wei, SUN Jian-ling. Logless Hash Table Based on NVM [J]. Computer Science, 2019, 46(9): 66-72.
[5] HOU Ze-yi, WAN Hu, XU Yuan-chao. NMST:A Persistent Memory Management Optimization Approach Based on Segment Tree [J]. Computer Science, 2018, 45(7): 78-83.
[6] LI Yue,WANG Fang. Survey on Storage Security of Emerging Non-volatile Memory [J]. Computer Science, 2018, 45(7): 53-60.
[7] SUN Qiang, ZHUGE Qing-feng, CHEN Xian-zhang, Edwin H.-M.SHA, WU Lin. In-page Wear-leveling Memory Management Based on Non-volatile Memory [J]. Computer Science, 2018, 45(11A): 505-510.
[8] SUN Zhi-long, Edwin H-M Sha, ZHUGE Qing-feng, CHEN Xian-zhang and WU Kai-jie. Research on Data Consistency for In-memory File Systems [J]. Computer Science, 2017, 44(2): 222-227.
[9] ZHAO Li-wei, CHEN Xian-zhang and ZHUGE Qing-feng. Performance Comparison of Join Operations on SIMFS and EXT4 [J]. Computer Science, 2016, 43(6): 184-187.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!