Computer Science ›› 2026, Vol. 53 ›› Issue (5): 157-163.doi: 10.11896/jsjkx.250900086

• Database & Big Data & Data Science • Previous Articles     Next Articles

Multi-scale Transformer Oil Price Prediction Framework with AEMD and Trend Cross-attention

LI Tengjia, MA Chun’ai   

  1. School of Economics and Management, China University of Petroleum(Beijing), Beijing 102249, China
  • Received:2025-09-12 Revised:2025-11-18 Published:2026-05-08
  • About author:LI Tengjia,born in 1987,Ph.D candidate.Her main research interests include technical economy,and energy economy and management.
  • Supported by:
    National Natural Science Foundation of China(71202118) and General Project of Beijing Social Science Foundation(22JB016).

Abstract: Against the backdrop of global low-carbon transition and energy restructuring,crude oil price forecasting has become not only a key topic in energy market analysis but also an essential reference for policy-making and investment decisions.How-ever,crude oil price series often exhibit strong nonlinearity and pronounced non-stationarity.Existing methods still face limitations in feature extraction and temporal modeling:on the one hand,the mining of multi-scale features is often insufficient,leading to biased characterization of short-term fluctuations and long-term trend evolution;on the other hand,the integration of short- and long-term information is frequently mishandled,making it difficult to balance predictive accuracy with trend stability.To address these challenges,this paper proposes a multi-frequency decoupled dual-branch Transformer model(MFD-DBV-Transformer) for Brent crude oil price forecasting.The method firstly employs adaptive empirical mode decomposition(AEMD) to decompose the crude oil price series into multiple intrinsic mode functions(IMFs).This distinguishes high-frequency short-term components from low-frequency long-term trends.An adaptive frequency decoupling module(AFDM) is then designed to construct dual-branch feature representations,separately capturing short-term volatility patterns and long-term trend features.A trend fusion module is further introduced,where cross-attention is used to achieve adaptive modulation of short-term predictions with long-term trend information.In addition,a temperature-regulated adaptive masking mechanism is incorporated to prevent overfitting in long-term trend modeling and to enhance the model’s generalization ability in volatile market environments.Experimental results demonstrate that the proposed MFD-DBV-Transformer achieves superior performance in capturing complex time-frequency characteristics of crude oil prices,significantly outperforming traditional LSTM and several mainstream deep learning models.The model not only improves forecasting accuracy but also demonstrates stronger stability and adaptability in trend tracking.The proposed approach provides policymakers and energy investors with an efficient and reliable forecasting and decision-support tool for coping with crude oil market volatility,while offering new insights and methodologies for modeling complex non-stationary time series.

Key words: Multi-scale transformer, Adaptive frequency decoupling, Crude oil price forecasting, Trend fusion, Low-carbon economy

CLC Number: 

  • F831.5
[1]COLOMINAS M A,SCHLOTTHAUER G,TORRES M E.Improved complete ensemble EMD:A suitable tool for biomedical signal processing[J].Biomedical Signal Processing and Control,2014,14:19-29.
[2]NIU D,CUI X.Crude Oil Price Prediction Based on HybridDeep Learning[J].Journal of North China Electric Power University(Social Sciences Edition),2023,4(6):30-42.
[3]ZHANG D,HUANG J,LING L,et al.Carbon Price Multi-decomposition Ensemble Prediction Integrating News Impact Decay[J].Journal of Henan University of Science & Technology(Natural Science),2024,45(1):51-61.
[4]MORANA C.A semiparametric approach to short-term oil price forecasting[J].Energy Economics,2001,23(3):325-338.
[5]BAUMEISTER C,PEERSMAN G.The role of time-varyingprice elasticities in accounting for volatility changes in the crude oil market[J].Journal of Applied Econometrics,2013,28(7):1087-1109.
[6]LI T,HU Z,JIA Y,et al.Forecasting crude oil prices using ensemble empirical mode decomposition and sparse Bayesian learning[J].Energies,2018,11(7):1882.
[7]LIAO J.Research on artificial intelligence prediction of international crude oilprice based on VMD-LSTM-ELMAN model[J].Journal of Chengdu University of Technology(Natural Science Edition),2024,51(1):164-180.
[8]SU Z H,SHANG L,LIU Z Z,et al.A stock price prediction method based on improved empirical mode decomposition and A-LSTM hybrid neural network[J].Journal of Nanjing University(Natural Sciences),2025,61(4):613-623.
[9]JIANG F,HU C,WANG H.Crude oil futures price prediction based on multi-source and multi-task automatic encoder[J].Systems Engineering-Theory & Practice,2025,45(2):702-716.
[10]PAN S,AARON L,WANG Y,et al.LSTM neural networkcrude oil price forecast[J].Computer Technology and Development,2021,31(5):180-185.
[11]YANG J,XUE X.International Natural Uranium Price Prediction Based on TF-CNN-BiLSTM Model[J].Atomic Energy Science and Technology,2025,59(6):1352-1360.
[12]ZHOU H,ZHANG S,PENG J,et al.Informer:Beyond Efficient Transformer for Long Sequence Time-Series Forecasting[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:11106-11115.
[13]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Procedings of the 31st International Confe-rence onNeural Information Processing Systems.2017:6000-6010.
[14]LIU Y,ZENG A,XU Q,et al.iTransformer:Inverted Transformations Are Effective for Time Series Forecasting[C]//The Twelfth International Conference on Learning Representations.Vienna,Austria,2024.
[15]YU W,FANG F.Research on China crude oil futures index prediction based on LSTM neural network[J].Natural science journal of Harbinnormal university,2020,36(2):32-37.
[16]NIE Y,NGUYEN N H,SINTHONG P,et al.A Time Series isWorth 64 Words:Long-term Forecasting with Transformers[C]//Proceedings of the 11th International Conference on Learning Representations.Addis Ababa:ICLR,2023.
[17]TORRES M E,COLOMINAS M A,SCHLOTTHAUER G,et al.A complete ensemble empirical mode decomposition with adaptive noise[C]//2011 IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP).Prague,Czech Republic:IEEE,2011:4144-4147.
[18]PAN S,YANG F,ZHAO C.Crude Oil Futures Price Prediction Based on CEEMDAN-SA-TCN[J].Natural Gas & Oil,2025,43(3):147-154.
[19]GAO H,HU Y,YU L.Oil price prediction based on decomposition and integration of LSTM neural network model[J].Computer Applications and Software,2021,38(10):78-83.
[20]LIN Y,YU Y,ZHANG X,et al.Research on crude oil futures price prediction based on error correction and deep reinforcement learning[J].Systems Engineering Theory and Practice,2023,43(1):206-221.
[21]ZHAI D,ZHANG T,LIANG G,et al.Research on crude oil futures price prediction methods:A perspective based on quantum deep learning[J].Energy,2025,320:135080.
[22]METWALLY D S,ALI M,ALGHAMDI S M,et al.A novel hybrid model to forecast the stock price based on CEEMDAN and support vector regression[J].Journal of Radiation Research and Applied Sciences,2025,18(2):101385.
[23]BI M,LIU Z,YANG X.A Hybrid Prediction Model for International Crude Oil Price Based on Variational Mode Decomposition withBiTCN-BiGRU-Attention Deep Learning Techniques[EB/OL][2025-10-10].https://doi.org/10.21203/rs.3.rs-5284460/v1.
[24]CHEN T,GUESTRIN C.Xgboost:A scalable tree boosting system[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM Press,2016:785-794.
[25]BREIMAN L.Random forests[J].Machine Learning,2001,45(1):5-32.
[26]ZHAO G Y,XUE M G.Prediction of the next-day price change direction and volatility of crude oil futures based on TN-LP-LSTM-SVM mixed model[J].Control and Decision,2022,37(10):2627-2636.
[1] MA Xin, JI Lixin, LI Shaomei. Forgery Face Detection Based on Multi-scale Transformer Fusing Multi-domain Information [J]. Computer Science, 2023, 50(10): 112-118.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!