一种基于SCD文件的合并单元高速数据压缩方法

doi:10.11896/jsjkx.230700230

计算机科学 ›› 2023, Vol. 50 ›› Issue (12): 123-129.doi: 10.11896/jsjkx.230700230

• 数据库&大数据&数据科学 • 上一篇下一篇

一种基于SCD文件的合并单元高速数据压缩方法

陈星田¹, 熊小伏², 白勇¹, 胡海洋²

1 重庆电力高等专科学校重庆 400053
2 输配电装备及系统安全与新技术国家重点实验室(重庆大学) 重庆 400044

收稿日期:2023-07-31 修回日期:2023-10-31 出版日期:2023-12-15 发布日期:2023-12-07
通讯作者: 陈星田(30160954@qq.com)
基金资助:
重庆市自然科学基金(CSTB2022NSCQ-MSX0251)

High Speed Data Compression Method of Merge Unit Based on SCD File

CHEN Xingtian¹, XIONG Xiaofu², BAI Yong¹, HU Haiyang²

1 Chongqing Electric Power College,Chongqing 400053,China
2 State Key Laboratory of Power Transmission Equipment & System Security and New Technology(ChongQing University),Chongqing 400044,China

Received:2023-07-31 Revised:2023-10-31 Online:2023-12-15 Published:2023-12-07
About author:CHEN Xingtian,born in 1971,Ph.D,engineer.His main research interest is smart grid automation technology.
Supported by:
Natural Science Foundation of Chongqing,China(CSTB2022NSCQ-MSX0251).

摘要/Abstract

摘要： 在现代智能电网中,智能变电站安装了大量合并单元来同步发布电流互感器和电压互感器的暂态量,这些暂态数据有必要保存长达数年,从而覆盖设备生命周期,为设备状态维修、可靠性等研究提供原始信息支撑,但是如此长时与高频的海量数据给存储设备带来了巨大压力。文中首先将高频暂态数据分为固定不变的、状态变化的和周期变化的3种形式来进行预处理,将固定不变部分用SCD文件中的唯一标识代替,状态变化部分用事件记录文件代替,周期变化部分用SCD文件中双通道差量和周期差量来表示。然后使用16位哈夫曼完成最终压缩编码,并对比测试了各种预处理前后的压缩结果和不同编码的压缩结果。最终的测试结果表明该压缩方法比普通硬件压缩卡压缩比更大,压缩速率比普通压缩卡更快。

关键词: 合并单元采样值, 无损数据压缩, 哈夫曼编码, LZMA压缩算法, 小波变换

Abstract: In modern smart grid,many merging units are installed in smart substation to release transient data of current transformer and voltage transformer synchronously,these transient data need to be saved for several years,so as to cover the life cycle of equipment and provide original information support for condition maintenance and reliability of equipment,but such long-time and high-frequency massive data is a difficult problem for storage equipment.In this paper,the high-frequency transient data are preprocessed in three forms:fixed,state-changing and periodic-changing.Tthe fixed part is replaced by merge's APPID in SCD file,the state-changing part is replaced by event record file,and the periodic-changing part is represented by two-channel diffe-rence and periodic difference in SCD file,and the final compression coding is completed with 16-bit Huffman.The final test shows that the compression ratio of this compression method is larger than that of common hardware compression card,and the compression rate is faster than that of common compression card.

Key words: Merge unit sampling data, Lossless data compression, Huffman coding, LZMA compression algorithm, Wavelet transform

中图分类号:

TP391

陈星田, 熊小伏, 白勇, 胡海洋. 一种基于SCD文件的合并单元高速数据压缩方法[J]. 计算机科学, 2023, 50(12): 123-129. https://doi.org/10.11896/jsjkx.230700230

CHEN Xingtian, XIONG Xiaofu, BAI Yong, HU Haiyang. High Speed Data Compression Method of Merge Unit Based on SCD File[J]. Computer Science, 2023, 50(12): 123-129. https://doi.org/10.11896/jsjkx.230700230

参考文献

[1]DL/T860.92-2006.Communication networks and systems insubstations-Part 9-2:Specific Communication Service Mapping(SCSM)-Sampled values over ISO/IEC 8802-3[S].Beijing:National Electric Power System Management and Information Exchange Standardization Technical Committee,2006.
[2]FU G X,DAI C J.Integrated design and implementation of network analysis and fault recording for intelligent substation[J].Electric Power Automation Equipment,2013,33(5):163-167.
[3]HOU A J,XIONG X F,SHEN Z J,et al.A reliability decisionmethod of CBM maintenance schedule for transmission equipment[J].Power System Protection and Control,2012,40(22):108-112.
[4]LI L,XIONG W,LU D M,et al.Study on the prediction method for failure rate in the reliability evaluation of power transmission and transformation facility[J].Electrical Measurement & Instrumentation,2015,52(3):37-41.
[5]TIAN L,XING J G.Discussion on making decision about electric equipment for condition based maintenance[J].Power System Technology,2004,28(16):60-63.
[6]ZHAO M M,LIN S S,LI Q,et al.Reliability analysis of smart substation secondary equipment[J].Process Automation Instrumentation,2022,43(4):45-50.
[7]WU X,WANG Y,YIN X G,et al.Development and application of power equipment status evaluation system[J].High Voltage Apparatus,2020,56(6):7-12.
[8]CUI C,WANG M M,XU Y L,et al.Reliability Prediction ofElectronic Current Transformer Based on Rogowski Coil[J].Shandong Electric Power,2016,43(6):14-17,36.
[9]Q/GDW 10715-2016,Technical Specification for Network Message Recording and Analysis Device of Intelligent Substation[S].Beijing:State Grid Corporation of China,2017.
[10]WANG X A,DOU Z S,JIN H R,et al.The new realization of messages recorder and analyzer used in smart substation[J].Electrical Technology,2014(2):82-85.
[11]ZIV J,LEMPLE A.A universal algorithm for sequential data compression[J].IEEE Transactions on Information Theory,1977,23(3):337-343.
[12]ZIV J,LEMPLE A.Compression of individual sequences via va-riable-rate coding[J].IEEE Transactions on Information Theory,1978,24(5):530-536.
[13]XI W,LI P,LI P,et al.Atwo-stage PMU data compressionmethod for edge computing devices of distribution networks[J].Power System Technology,2023,47(8):3184-3193.
[14]YUE Q M,YU W Y,BAI C J,et al.Novel compression scheme of fault recording data in power systems based on lifting algorithm[J].Automation of Electric Power System,2005,29(5):74-78.
[15]LI B,ZHANG,LIU Y.FPGA hardware implementation of the LZMA compression algorithm[J].Journal of Beijing University of Aeronautics and Astronautics,2015,41(3):375-382.
[16]CHEN X J,LI B,ZHOU Q L.Implementation of RTL Scalable High-Performance Data Compression Method[J].Acta Electo-nica Sinica,2022,50(7):1548-1557.
[17]HUFFMAN D A.A method for the construction of minimum-redundancy codes[J].Proceedings of the IRE,1952,40(9):1098-1101.
[18]SHANNON C E.A mathematical theory of communication[J].The Bell System Technical Journal,1948,27(3):379-423.
[19]Lempel-Ziv-Markov chain algorithm[EB/OL].https://infogalactic.com/info/Lempel-Ziv-Markov_chain_algorithm.
[20]MA F Y,LI Q P,MA Z B,et al.The Research of Historical Data Compression and Storage Strategy in Power Dispatch SCADA System[J].Power System Technology,2014,38(4):1109-1114.
[21]HUANG C,YANG S X,LIANG Y C,et al.Practical data compression method for power system fault records[J].Electric Power Automation Equipment,2014,34(6):162-167.
[22]FEI M W,YUE Q M,ZHANG P C,et al.Wavelets Selection of Compression and Reconstruction Algorithm Based on Digital Recorded Data from a Faulted Power System[J].Automation of Electric Power Systems,2005(17):64-67,97.
[23]HUANG T S,WANG Y,WU D,et al.Second generation wavelet-based data compression algorithm for power system fault recorder[J].Electric Power Automation Equipment,2004(3):59-62.
[24]FU S Y,WANG L,CHENG Y D,et al.Synchrotron radiation source image compression method based on difference and neural network[J].Journal of National University of Defense Techno-logy,2022,44(5):53-62.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

一种基于SCD文件的合并单元高速数据压缩方法

High Speed Data Compression Method of Merge Unit Based on SCD File

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

Metrics

本文评价

推荐阅读 0