计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 250700136-8.doi: 10.11896/jsjkx.250700136
张旭林, 王磊, 牛梦锦, 梁军达
ZHANG Xulin, WANG Lei, NIU Mengjin, LIANG Junda
摘要: 在工业物联网、金融科技等领域浮点型时间序列数据呈爆发式增长的背景下,给数据存储和传输带来了巨大的挑战,浮点时间序列数据压缩变得至关重要。时序数据中通常存在异常值污染导致编码冗余、缺失值破坏时序连续性、非结构化时序引发预测模型失效,单一预测模型在应对线性短周期与稀疏复杂场景时性能差异显著的问题。针对这些问题,提出了ALHC 算法,为满足浮点压缩对数据准确性、连续性和分布特性还有残差计算的需求,设计了一套针对性的数据清洗流程,构建可以动态切换的 TCN-LSTM 神经网络预测器与基于 LMS 算法的自适应线性预测器的混合架构,使其可以在不同场景上适配,并将自适应预测器作为后处理模块进行残差修正,提升预测精度,降低残差,提高熵编码效率。在14个公开时间序列数据集上对所提压缩算法进行实验评估,结果表明,在无损的情况下平均压缩比可达到0.24。
中图分类号:
| [1] CHEN H,LIU L,MENG J,et al.AFC:An adaptive lossless floating-point compression algorithm in time series database[J].Information Sciences,2024,654:119847. [2] KNORR F,THOMAN P,FAHRINGER T.DNZIP:A High-Throughput Parallel Lossless Compressor for Scientific Data[C]//2021 Data Compression Conference(DCC).2021:103-112. [3] ZHU M H,LI Z,LI R Y,et al Survey on Floating-point Time Series Data Compression[J].Journal of Software,2025,36(6):2844-2874. [4] HE K J.High Performance Lossless Compression of Floating-Point Data for Scientific Computing[J].Chinese Journal of Computers,2010,33(6):966-976. [5] PELKONEN T,FRANKLIN S,TELLER J,et al.Gorilla:Afast,scalable,in-memory time series database[C]//Proceedings of the VLDB Endowment.2015:1816-1827. [6] LIAKOS P,PAPAKONSTANTINOPOULOU K,KOTIDIS Y.Chimp:Efficient lossless floating point compression for time series databases[C]//Proceedings of the VLDB Endowment.2022:3058-3070. [7] LI R Y,LI Z,WU Y,et al.Elf:Erasing-Based Lossless Floating-Point Compression[C]//Proceedings of the VLDB Endowment.2023:1763-1776. [8] CHIAROT G,SILVESTRI C.Time series compression survey[J].ACM Computing Surveys,2023,55(10):1-32. [9] CHANDAK S,TATWAWADI K,WEN C,et al.LFZip:Lossy Compression of Multivariate Floating-Point Time Series Data via Improved Prediction[C]//2020 Data Compression Conference(DCC).2020:342-351. [10] BURTSCHER M,RATANAWORABHAN P.FPC:A high-speed compressor for double-precision floating-point data[J].IEEE Transactions on Computers,2008,58(1):18-31. [11] YU X,PENG Y,LI F,et al.Two-Level Data Compression using Machine Learning in Time Series Database[C]//2020 IEEE 36th International Conference on Data Engineering(ICDE).2020:1333-1344. [12] BRUNO A,NARDINI F M,PIBIRI G E,et al.TSXor:A Simple Time Series Compression Algorithm[C]//String Processing and Information Retrieval(SPIRE 2021).Cham:Springer,2021. [13] FAN J,ZHANG K,HUANG Y,et al.Parallel spatio-temporal attention-based TCN for multivariate time series prediction[J].Neural Computing and Applications,2023,35:13109-13118. [14] BAI J,ZHU W,LIU S,et al.A Temporal Convolutional Network-Bidirectional Long Short-Term Memory(TCN-BiLSTM) Prediction Model for Temporal Faults in Industrial Equipment[J].Applied Sciences,2025,15(4):1702. [15] ZHOU H F,SUN K W.Research on Multi-timeslot Industrial Time Series Data Prediction Method Based on Improved LSTM[J].Process Automation Instrumentation,2025,46(4):86-91. [16] YU Y,SI X S,HU C H,J,et al.A Review of Recurrent Neural Networks:LSTM Cells and Network Architectures[J].Neural Comput,2019,31(7):1235-1270. [17] CHANDAK S,TATWAWADI K,WEN C,et al.LFZip:Lossy Compression of Multivariate Floating-Point Time Series Data via Improved Prediction[C]//2020 Data Compression Confe-rence(DCC).2020:342-351. [18] HUFFMAN D A.A method for the construction of minimum-redundancy codes[C]//Proceedings of the IRE.1952:1098-1101. [19] Daily temperature of major cities[EB/OL].www.kaggle.com/sudalairajkumar/daily-temperature-of-major-cities./ [20] Financial data set used in infore project[EB/OL].https://zenodo.org/record/3886895. [21] National Ecological Observatory Network(NEON):Ir biological temperature[EB/OL].https://data.neonscience.org/data-products/DP1.00005.001/RELEASE-2022. [22] Historical weather data download[EB/OL].https://www.me-teoblue.com/en/weather/archive/export/basel_switzerland. [23] National Ecological Observatory Network(NEON):Relative humidity above wateron-buoy(dp1.20271.001)[EB/OL].https://data.neonscience.org/data-products/DP1.20271.001/RELEASE-2022. [24] National Ecological Observatory Network(NEON):Barometric pressure(dp1.00004.001)[EB/OL].https://data.neonscience.org/data-products/DP1.00004.001/RELEASE-2022. [25] National Ecological Observatory Network(NEON):Dust andparticulate size dis-tribution(dp1.00017.001)[EB/OL].https://data.neonscience.org/data-products/DP1.00017.001/RELEASE-2022. [26] National Ecological Observatory Network(NEON):2d windspeed and di-rection(dp1.00001.001)[EB/OL].https://data.neonscience.org/data-products/DP1.00001.001/RELEASE-2022. [27] Influxdb 2.0 sample data[EB/OL].https://github.com/influxdata/influxdb2-sample-data. [28] The.xz file format[EB/OL].https://tukaani.org/xz/xz-file-format.txt. [29] ALAKUIJALA J,FARRUGGIA A,FERRAGINA P,et al.Brotli:A general-purpose data compressor[C]//ACM Transactions on Information Systems(TOIS).2018:1-30. [30] COLLET Y.Lz4:Extremely fast compression algorithm[EB/OL].https://github.com/lz4/lz4. [31] COLLET Y.Zstdgithub repository from facebook[EB/OL].https://github.com/facebook/zstd. [32] GUNDERSON S H.Snappy:A fast compressor/decompressor[EB/OL].http://google.github.io/snappy/. |
|
||