Contrastive Enhancement in Multi-level Graph for Knowledge-aware Propagation Recommender Algorithm
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [33]
  • |
  • Related [9]
  • | | |
  • Comments
    Abstract:

    Traditional algorithms for knowledge-aware propagation recommendation face challenges including low correlation of higher-order features, unbalanced information utilization, and noise introduction. To address these challenges, this study proposes a multi-level contrastive learning for knowledge-aware propagation recommender algorithm utilizing knowledge enhancement (MCLK-KE). By constructing enhanced views and utilizing mask reconstruction-based self-supervised pre-training, the algorithm extracts deeper information from key triples to effectively suppress noise signals. It achieves a balanced utilization of knowledge and interactive signals while enhancing feature representation by comparing graphs to capture effective node attributes globally. Multi-task training significantly improves model performance by incorporating recommendation prediction, contrastive learning, and mask reconstruction tasks. In tests on three publicly available datasets, MCLK-KE demonstrates a maximum increase of 3.3% in AUC and 5.3% in F1 scores compared to the best baseline model.

    Reference
    [1] Zou D, Wei W, Mao XL, et al. Multi-level cross-view contrastive learning for knowledge-aware recommender system. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. Madrid: ACM, 2022. 1358–1368.
    [2] 鄢凡力, 胥小波, 赵容梅, 等. 基于跨视图对比学习的知识感知推荐系统. 工程科学与技术, 2024, 56(1): 44–53.
    [3] 张波, 赵鹏, 张金金, 等. 基于用户潜在兴趣的知识感知传播推荐算法. 计算机应用研究, 2022, 39(9): 2615–2620.
    [4] Zou D, Wei W, Wang ZY, et al. Improving knowledge-aware recommendation with multi-level interactive contrastive learning. Proceedings of the 31st ACM International Conference on Information & Knowledge Management. Atlanta: ACM, 2022. 2817–2826.
    [5] Liu WJ, Zhou P, Zhao Z, et al. K-Bert: Enabling language representation with knowledge graph. Proceedings of the 34th AAAI Conference on Artificial Intelligence. New York: AAAI, 2020. 2901–2908.
    [6] Zhang FZ, Yuan NJ, Lian DF, et al. Collaborative knowledge base embedding for recommender systems. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco: ACM, 2016. 353–362.
    [7] Wang HW, Zhang FZ, Zhao M, et al. Multi-task feature learning for knowledge graph enhanced recommendation. Proceedings of the 2019 World Wide Web Conference. San Francisco: ACM, 2019. 2000–2010.
    [8] Chen HX, Li YC, Sun XG, et al. Temporal meta-path guided explainable recommendation. Proceedings of the 14th ACM International Conference on Web Search and Data Mining. ACM, 2021. 1056–1064.
    [9] Wang X, Wang DX, Xu CR, et al. Explainable reasoning over knowledge graphs for recommendation. Proceedings of the 33rd AAAI Conference on Artificial Intelligence. Honolulu: AAAI, 2019. 5329–5336.
    [10] Wang X, He XN, Cao YX, et al. KGAT: Knowledge graph attention network for recommendation. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Anchorage: ACM, 2019. 950–958.
    [11] Wang X, Huang TL, Wang DX, et al. Learning intents behind interactions with knowledge graph for recommendation. Proceedings of the 2021 Web Conference. Ljubljana: ACM, 2021. 878–887.
    [12] Qiu JZ, Chen QB, Dong YX, et al. GCC: Graph contrastive coding for graph neural network pre-training. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. California: ACM, 2020. 1150–1160.
    [13] Hassani K, Khasahmadi AH. Contrastive multi-view representation learning on graphs. Proceedings of the 37th International Conference on Machine Learning. PMLR, 2020. 4116–4126.
    [14] Hu ZN, Dong YX, Wang KS, et al. GPT-GNN: Generative pre-training of graph neural networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. California: ACM, 2020. 1857–1867.
    [15] Pan SR, Hu RQ, Long GD, et al. Adversarially regularized graph autoencoder for graph embedding. Proceedings of the 27th International Joint Conference on Artificial Intelligence. Stockholm: ijcai.org, 2018. 2609–2615.
    [16] You YN, Chen TL, Shen Y, et al. Graph contrastive learning automated. Proceedings of the 38th International Conference on Machine Learning. PMLR, 2021. 12121–12132.
    [17] Sun QY, Li JX, Peng H, et al. SUGAR: Subgraph neural network with reinforcement pooling and self-supervised mutual information mechanism. Proceedings of the 2021 Web Conference. Ljubljana: ACM, 2021. 2081–2091.
    [18] Yang YH, Huang C, Xia LH, et al. Knowledge graph contrastive learning for recommendation. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. Madrid: ACM, 2022. 1434–1443.
    [19] Tian Y, Yang YH, Ren XH, et al. Joint knowledge pruning and recurrent graph convolution for news recommendation. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2021. 51–60.
    [20] Huang TS, Lin WW, Shen L, et al. Stochastic client selection for federated learning with volatile clients. IEEE Internet of Things Journal, 2022, 9(20): 20055–20070.
    [21] Li T, Sahu AK, Zaheer M, et al. Federated optimization in heterogeneous networks. Proceedings of the 3rd Conference on Machine Learning and Systems. Austin: mlsys.org, 2020. 429–450.
    [22] Xiao ST, Liu Z, Shao YX, et al. RetroMAE: Pre-training retrieval-oriented language models via masked auto-encoder. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Abu Dhabi: Association for Computational Linguistics, 2022. 538–548.
    [23] Feichtenhofer C, Fan HQ, Li YH, et al. Masked autoencoders as spatiotemporal learners. Proceedings of the 36th International Conference on Neural Information Processing Systems. New Orleans: Curran Associates Inc., 2024. 2605.
    [24] 富坤, 郝玉涵, 孙明磊, 等. 基于优化图结构自编码器的网络表示学习. 计算机应用, 2023, 43(10): 3054–3061.
    [25] Xia LH, Huang C, Huang CZ, et al. Automated self-supervised learning for recommendation. Proceedings of the 2023 ACM Web Conference. Austin: ACM, 2023. 992–1002.
    [26] 郭洁, 林佳瑜, 梁祖红, 等. 基于知识感知和跨层次对比学习的推荐方法. 计算机应用, 2024, 44(4): 1121–1127.
    [27] Harper FM, Konstan JA. The MovieLens datasets: History and context. ACM Transactions on Interactive Intelligent Systems, 2015, 5(4): 19.
    [28] Schedl M. The LFM-1b dataset for music retrieval and recommendation. Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval. New York: ACM, 2016. 103–110.
    [29] Ziegler CN, McNee SM, Konstan JA, et al. Improving recommendation lists through topic diversification. Proceedings of the 14th International Conference on World Wide Web. Chiba: ACM, 2005. 22–32.
    [30] Wang HW, Zhang FZ, Wang JL, et al. RippleNet: Propagating user preferences on the knowledge graph for recommender systems. Proceedings of the 27th ACM International Conference on Information and Knowledge Management. Torino: ACM, 2018. 417–426.
    [31] Wang HW, Zhao M, Xie X, et al. Knowledge graph convolutional networks for recommender systems. Proceedings of the 2019 World Wide Web Conference. San Francisco: ACM, 2019. 3307–3313.
    [32] 黄偲偲, 柯文俊, 张杭, 等. 融合知识传播和提示学习机制的推荐模型. 中文信息学报, 2023, 37(5): 122–134.
    [33] Chen YK, Yang YM, Wang YJ, et al. Attentive knowledge-aware graph convolutional networks with collaborative guidance for personalized recommendation. Proceedings of the 38th IEEE International Conference on Data Engineering. Kuala Lumpur: IEEE, 2022. 299–311.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

樊海玮,张朝亮,牛新阳,万青松,邓玉莲.多层次图间对比增强的知识感知传播推荐算法.计算机系统应用,2025,34(2):49-60

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:July 11,2024
  • Revised:August 01,2024
  • Online: December 13,2024
Article QR Code
You are the first990552Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063