Computer Science ›› 2026, Vol. 53 ›› Issue (6): 203-213.doi: 10.11896/jsjkx.251000115

• High Performance Computing • Previous Articles     Next Articles

MMCache:High-performance Cluster Cache with Memory-mapped Mirroring

LIU Zhongyi1,2,3, XIAO Wei1, ZHANG Lei1,2, YAN Songbai1,2, HUANG Xiangping1,3, LI Mengxiao1,3   

  1. 1 TravelSky Technology Limited,Beijing 101318,China
    2 Key Laboratory of Intelligent Passenger Service of Civil Aviation,Beijing 101318,China
    3 Beijing Engineering Research Center of Civil Aviation Big Data,Beijing 101318,China
  • Received:2025-10-27 Revised:2025-12-17 Online:2026-06-15 Published:2026-06-09
  • About author:LIU Zhongyi,born in 1987,master,is a member of CCF(No.T8746M).His main research interests include high performance computing,in-memory data grid and digital intelligence.
    XIAO Wei,born in 1970,master. His main research interests include real-time trading systems,civil aviation informatization and high performance distributed computing.
  • Supported by:
    National Natural Science Foundation of China(U2433212),Pilot Demonstration Project for Big Data Industry Development of the Ministry of Industry and Information Technology of China(MIIT Letter [2022] No.219) and Innovation Mission Project for Future Industry of the Ministry of Industry and Information Technology of China(MIIT Letter [2024] No.220).

Abstract: Applications of distributed systems in high-performance scenarios are becoming increasingly widespread.However,their reliance on traditional caching frameworks faces bottlenecks such as high overhead in complex object transmission,high synchronization latency across nodes,and inefficient data access and storage.To address these issues,this paper proposes MMCache,a high-performance cluster caching framework whose core innovations include:a memory-mapped mirroring data transfer and access mechanism,which leverages virtual address fixation to achieve cross-process zero-copy access and structure-level high-efficiency reads;a cooling pool-driven lock-free cache unit update mechanism,which ensures runtime state atomic visibility and rapid reclamation without blocking business access;and a generic memory allocation management framework for address space,which integrates TCMalloc with generic adapters to enable efficient allocation,reclamation,and fragmentation suppression of mirrored memory.Experimental results show that under multi-scenario workloads involving 3 million keys,MMCache maintains a controllable cooling pool occupancy ratio,achieves a transaction success rate above 99%,and sustains stable response times.Compared with Redis and Memcached,MMCache demonstrates significant advantages in high-frequency read/write operations,complex object storage,and cluster synchronization performance.The technology has been deployed in the back-end system for aviation fare transactions,showcasing high performance,low latency,and strong consistency,and has broad potential for application in high-performance data processing scenarios such as e-commerce and big data analytics.

Key words: Memory-mapped mirroring, Distributed cluster caching, Zero-copy access, Complex object storage, Lock-free update mechanism, Colling pool, Generic memory allocator, High-performance caching framework

CLC Number: 

  • TP391
[1]CARLSON J.Redis in Action [M].New York:Simon & Schus-ter,2013:126-134.
[2]FITZPATRICK B.Distributed caching with Memcached [J].Linux Journal,2004,2004(124):5.
[3]CHENG W,REN F,JIANG W,et al.Modeling and Analyzing Latency in the Memcached System [C]//Proceedings of 2017 IEEE 37th International Conference on Distributed Computing Systems(ICDCS).IEEE,2017:538-548.
[4]CHIDAMBARAM V,RAMAMURTHI D.Performance analysis of Memcached [EB/OL].http://citeseerx.ist.psu.edu/viewdoc/download.
[5]MERTZ J,NUNES I,DELLA TOFFOLA L,et al.Satisfying increasing performance requirements with caching at the application level [J].IEEE Software,2020,38(3):87-95.
[6]MERTZ J,NUNES I.A Qualitative Study of Application-Level Caching [J].IEEE Transactions on Software Engineering,2017,43(9):798-816.
[7]MARATHE V J,SELTZER M,BYAN S,et al.PersistentMemcached:Bringing Legacy Code to Byte-Addressable PersistentMemory [C]//Proceedings of the 9th USENIX Workshop on Hot Topics in Storage and File Systems(HotStorage'17).USENIX Association,2017.
[8]QIX C,HU H Q,WEI X,et al.High Performance Design for Redis with Fast Event-Driven RDMA RPCs [C]//Proceedings of the 25th International Conference on Database Systems for Advanced Applications(DASFAA 2020)Springer,2020:195-210.
[9]COSTA A J C.FLEEC:A Fast and Lock-Free ApplicationalCache [D].Lisboa:Universidade NOVA de Lisboa(Portugal),2023.
[10]COTRONEO D,NATELLA R,ROSIELLO S.Dependabilityevaluation of middleware technology for large-scale distributed caching [C]//2020 IEEE 31st International Symposium on Software Reliability Engineering(ISSRE).IEEE,2020:218-228.
[11]OLSON M A,BOSTIC K,SELTZER M I.Berkeley DB [C]//Proceedings of the USENIX Annual Technical Conference,FREENIX Track.USENIX Association,1999:183-191.
[12]HENRY G.Howard Chu on Lightning Memory-Mapped Database [J].IEEE Software,2019,36(6):83-87.
[13]WRIGHT C P,SPILLANE R,SIVATHANU G,et al.Exten-ding ACID semantics to the file system [J].ACM Transactions on Storage,2007,3(2):4-es.
[14]HUANG X P,PENG M T,YANG Y K.High performance inventory caching system based on memory-mapping files [J].Application of Electronic Technique,2020,46(7):113-117,126.
[15]LIANG H F,YANG Y,LIU Z Y.MMDB:A complex object-oriented high-performance database based on memory mapping [J].Computer Engineering & Design,2023,44(3):937-944.
[16]CUI Y L,PI D C.SQLmmdb:An Embedded Main Memory Database Management System [J].Information Technology Journal,2007,6(6):872-878.
[17]FAERBER F,KEMPER A,LARSON P A,et al.Main Memory Database Systems [J].Foundations and Trends in Databases,2017,8(1/2):1-130.
[18]HUANG X P,PENG M T,YANG Y K.Fast Reading Method of Complex Objects Based on Memory-Mapped Files [J].Computer Technology and Development,2020,30(3):82-87.
[19]LIANG H F,LIU Z Y,YANG Y.Architecture and Key Technologies of High-Performance Airfare Price and Shop System [J/OL].https://kns.cnki.net/kcms/detail/31.1260.tp.20240703.1142.002.html.
[20]YANG Y K,PENG M T,WANG W D.Design of Efficient and Reliable Data File Distribution Solution in Cluster [J].Compu-ter Technology and Development,2019,29(11):163-167.
[21]LIU Z Y,LI M X,LIN C,et al.Zynco:A distributed service framework supporting runtime state collaborative evolution [J/OL].https://link.cnki.net/urlid/51.1307.TP.20250925.1513.036.
[22]GHEMAWAT S,MENAGE P.Tcmalloc:Thread-Caching Malloc [EB/OL].(2009-01-01)[2018-06-14].http://goog-perftools.sourceforge.net/doc/tcmalloc.html.
[1] KE Changbo, LI Tianhao, ZHANG Bolei, XIAO Fu, XU Kang. Teaching Evaluation Sentiment Analysis Method Based on Capsule Network [J]. Computer Science, 2026, 53(6): 10-18.
[2] LIU Ruyi, LYU Xiaohan, MIAO Qiguang, LU Zixiang, WANG Di. Academic Early Warning Prediction Model Based on Attention Mechanism and FeatureInteraction [J]. Computer Science, 2026, 53(6): 19-29.
[3] XIE Hui, LIANG Dan, YANG Huiting, JIA Chunli, HE Jiangshan, DONG Zexiao, REN Ziqi, JIANG Mingzhe, CHEN Xueli. Research on Adaptive Disciplinary Learning Effectiveness Evaluation Model Driven by PrefrontalEEG [J]. Computer Science, 2026, 53(6): 39-49.
[4] SHANG Yi, YING Di, ZHAO Hui. Multi-task Classroom Title Generation Method Integrates Core Sentences and Keyword Guidance [J]. Computer Science, 2026, 53(6): 50-58.
[5] XU Zhihong, YANG Xinlei, WANG Liqin, DONG Yongfeng, WANG Xu. Knowledge Tracing Model Based on Relational Learning Memory Network [J]. Computer Science, 2026, 53(6): 84-92.
[6] ZHAO Lei, YANG Yulu, YUAN Bo. Personalized Course Recommendation System Based on Knowledge Graph [J]. Computer Science, 2026, 53(6): 93-101.
[7] ZHU Huming, LIU Huijie, DONG Ximiao, CHEN Zhipeng, GAO Tianqi, JIAO Licheng. Review on Parallel Training and Inference of Diffusion Models [J]. Computer Science, 2026, 53(6): 102-116.
[8] LI Zhenjia, WANG Wu. Kokkos-based Direct Solver and Its Implementation on Heterogeneous Platform [J]. Computer Science, 2026, 53(6): 137-144.
[9] ZHU Pengzhi, HUANG Chun, SHEN Jie, CHEN Cheng, XU Haoran, LONG Biao. Research on Fortran Compiler Implementation Technology on CPU-DSP Heterogeneous Processor [J]. Computer Science, 2026, 53(6): 145-152.
[10] LI Jinyou, ZHANG Wenshuai, SHEN Yu, ZHANG Yundong, LI Huimin, LI Jing. Machine Learning-based Parallel Parameter Optimization in High-performance ComputingApplications [J]. Computer Science, 2026, 53(6): 153-162.
[11] SHI Jun, WANG Qinglin, TIAN Feiyang, WANG Zhicheng, LI Runhua, LIU Jie. Optimizing SPMM on ARM Architectures with JIT Instruction Generation [J]. Computer Science, 2026, 53(6): 163-170.
[12] JI Wenyu, LI Yang, WANG Jiabao, FU Ruizhi, LIU Xiaoyu, MIAO Zhuang. Review of 3D Object Detection Based on LiDAR-camera Fusion [J]. Computer Science, 2026, 53(6): 214-231.
[13] LI Xiuying, CHEN Xuesong, LI Haoze, LIAO Hongwei, HAN Jiameng, DUAN Xiaoyi. MambaCS:Mamba-based Image Compressed Sensing Algorithm [J]. Computer Science, 2026, 53(6): 232-241.
[14] LI Peng, ZHANG Zihao, HAN Yahong. Primitive Dynamic Weighting for Multi-modal Salient Object Detection [J]. Computer Science, 2026, 53(6): 242-251.
[15] LIU Jikang, HUANG Lei, ZHANG Ke, NIE Jie, WEI Zhiqiang. Object Detection Method Based on Dynamic Feature Fusion [J]. Computer Science, 2026, 53(6): 263-269.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!