Photovoltaic Power Long-sequence Time Series Forecasting via Period Selection and Variable Cross-attention
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [26]
  • | | | |
  • Comments
    Abstract:

    Accurate integrated energy load forecasting is a key prerequisite for the preliminary planning and subsequent on-demand coordinated operation of regional integrated energy systems. The recent Transformer-based method has shown significant potential in long sequence forecasting for its excellent global modeling capabilities. However, the permutationally invariant self-attention mechanism in Transformer leads to the loss of temporal information and ignores the key dependencies between different variables in multi-energy load forecasting. To address the above challenges, this study proposes a patch and variable mixing model (PVMM) to achieve accurate multi-energy load forecasting. PVMM uses patch embedding technology to convert the input multi-energy load sequence into a 3D vector, thereby retaining the temporal and variable information of the patch. Secondly, this study proposes a patch mixing module (PMM) based on deep separable convolution to establish a temporal dependency model. In addition, this study also proposes a variable dynamic projection attention module (VDP-AM) to map Query and Value variables to a higher dimension and handle the interaction between multiple variables through a self-attention mechanism. Finally, the prediction accuracy and generalization ability of this method on the online system dataset publicly available at Arizona State University surpass existing methods.

    Reference
    [1] 朱刘柱, 王绪利, 马静, 等. 基于小波包分解与循环神经网络的综合能源系统短期负荷预测. 电力建设, 2020, 41(12): 131–138.
    [2] 曾鸣, 杨雍琦, 李源非, 等. 能源互联网背景下新能源电力系统运营模式及关键技术初探. 中国电机工程学报, 2016, 36(3): 681–691.
    [3] Lindberg KB, Bakker SJ, Sartori I. Modelling electric and heat load profiles of non-residential buildings for use in long-term aggregate load forecasts. Utilities Policy, 2019, 58: 63–88.
    [4] Vaghefi A, Jafari MA, Bisse E, et al. Modeling and forecasting of cooling and electricity load demand. Applied Energy, 2014, 136: 186–196.
    [5] Li YJ, Yuan XL, Xu JY, et al. Medium-term forecasting of cold, electric and gas load in multi-energy system based on VAR model. Proceedings of the 13th IEEE Conference on Industrial Electronics and Applications. Wuhan: IEEE, 2018. 1676–1680.
    [6] Fang X, Zhang W, Guo YH, et al. A novel reinforced deep RNN-LSTM algorithm: Energy management forecasting case study. IEEE Transactions on Industrial Informatics, 2022, 18(8): 5698–5704.
    [7] 孙庆凯, 王小君, 张义志, 等. 基于LSTM和多任务学习的综合能源系统多元负荷预测. 电力系统自动化, 2021, 45(5): 63–70.
    [8] 马建鹏, 龚文杰, 张智晟. 基于Copula理论与KPCA-GRNN结合的区域综合能源系统多元负荷短期预测模型. 电工电能新技术, 2020, 39(3): 24–31.
    [9] Chen BY, Wang YF. Short-term electric load forecasting of integrated energy system considering nonlinear synergy between different loads. IEEE Access, 2021, 9: 43562–43573.
    [10] Wang SM, Wang SX, Chen HW, et al. Multi-energy load forecasting for regional integrated energy systems considering temporal dynamic and coupling characteristics. Energy, 2020, 195: 116964.
    [11] 王琛, 王颖, 郑涛, 等. 基于ResNet-LSTM网络和注意力机制的综合能源系统多元负荷预测. 电工技术学报, 2022, 37(7): 1789–1799.
    [12] Zhuang W, Fan JL, Xia M, et al. A multi-scale spatial-temporal graph neural network-based method of multi-energy load forecasting in integrated energy system. IEEE Transactions on Smart Grid, 2024, 15(3): 2652–2666.
    [13] 黄旭锐, 于丰源, 杨波, 等. 基于Transformer网络和多任务学习的园区综合能源系统电-热短期负荷预测方法. 南方电网技术, 2023, 17(1): 152–160.
    [14] Peng DG, Liu Y, Wang DH, et al. Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis. Energy, 2024, 308: 132796.
    [15] Fan JL, Zhuang W, Xia M, et al. Optimizing attention in a Transformer for multihorizon, multienergy load forecasting in integrated energy systems. IEEE Transactions on Industrial Informatics, 2024, 20(80): 10238–10248.
    [16] 丁浩, 周成杰, 车超, 等. 基于渐进式分解架构的风电时间序列预测. 计算机系统应用, 2024, 33(7): 112–120.
    [17] Kim T, Kim J, Tae Y, et al. Reversible instance normalization for accurate time-series forecasting against distribution shift. Proceedings of the 10th International Conference on Learning Representations. OpenReview.net, 2022.
    [18] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: Curran Associates Inc., 2017. 6000–6010.
    [19] Zhou HY, Zhang SH, Peng JQ, et al. Informer: Beyond efficient Transformer for long sequence time-series forecasting. Proceedings of the 35th AAAI Conference on Artificial Intelligence. AAAI Press, 2021. 11106–11115.
    [20] Wu HX, Xu JH, Wang JM, et al. Autoformer: Decomposition Transformers with auto-correlation for long-term series forecasting. Proceedings of the 35th International Conference on Neural Information Processing Systems. Curran Associates Inc., 2021. 1717.
    [21] Zhou T, Ma ZQ, Wen QS, et al. FEDformer: Frequency enhanced decomposed Transformer for long-term series forecasting. Proceedings of the 39th International Conference on Machine Learning. Baltimore: PMLR, 2022. 27268–27286.
    [22] Kitaev N, Kaiser Ł, Levskaya A. Reformer: The efficient Transformer. Proceedings of the 8th International Conference on Learning Representations. OpenReview.net, 2020.
    [23] Liu SZ, Yu H, Liao C, et al. Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. Proceedings of the 10th International Conference on Learning Representations. OpenReview.net, 2022.
    [24] Campos D, Zhang M, Yang B, et al. LightTS: Lightweight time series classification with adaptive ensemble distillation. Proceedings of the ACM on Management of Data, 2023, 1(2): 171.
    [25] Das A, Kong WH, Leach A, et al. Long-term forecasting with TiDE: Time-series dense encoder. arXiv:2304.08424. 2023.
    [26] Ekambaram V, Jati A, Nguyen N, et al. TSMixer: Lightweight MLP-mixer model for multivariate time series forecasting. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Long Beach: ACM, 2023. 459–469.
    Related
    Cited by
Get Citation

周恒,艾青,张婧汇.应用周期选择和变量交叉注意的光伏电力长时间序列预测.计算机系统应用,2025,34(4):256-265

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:October 10,2024
  • Revised:November 12,2024
  • Online: March 04,2025
Article QR Code
You are the first991233Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063