A paper recommendation method based on SPECTER and graph convolutional networks

Panpan Guo; Gang Zhou; Jicang Lu; Zhufeng Li; Taojie Zhu

doi:10.54254/2977-3903/2025.22028

Article Information

Received: 10 March 2025

Published: 11 April 2025

DOI: https://doi.org/10.54254/2977-3903/2025.22028

Article Type: Research Article

Cite this article

Guo,P.;Zhou,G.;Lu,J.;Li,Z.;Zhu,T. (2025). A paper recommendation method based on SPECTER and graph convolutional networks. Advances in Engineering Innovation,16(3),65-74.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About this Journal

Journal: Advances in Engineering Innovation

Volume: Vol.16, Issue 3

ISSN: 2977-3903 (Print) / 2977-3911 (Online)

Copyright & License

[1]Abbas, M. A., Ajayi, S., Bilal, M., Oyegoke, A., Pasha, M., & Ali, H. T. (2024). A deep learning approach for context-aware citation recommendation using rhetorical zone classification and similarity to overcome cold-start problem. Journal of Ambient Intelligence and Humanized Computing, 15(1), 419-433.

[2]İlya, K., Sinem, B., & Savas, O. (2023). A Novel Article Recommendation System Empowered by the Hybrid Combinations of Content-Based State-of-the-Art Methods. International Journal of Applied Mathematics Electronics and Computers, 11(1), 1-12.

[3]Wang, H., & Li, W. J. (2014). Relational collaborative topic regression for recommender systems. IEEE Transactions on Knowledge and Data Engineering, 27(5), 1343-1355.

[4]Wang, C., & Blei, D. M. (2011). Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 448-456). https://doi.org/10.1145/2020408.2020480

[5]Ali, Z., Ullah, I., Khan, A., Jan, A. U., & Muhammad, K. (2021). An overview and evaluation of citation recommendation models. Scientometrics, 126(5), 4083-4119. https://doi.org/10.1007/s11192-021-03909-y

[6]Dong, Y. F., Qu, X. Q., Li, L. H., & Dong, Y. (2022). An academic journal recommendation algorithm based on author preferences. Computer Applications, 42(1), 50-56.

[7]Fu, H. J., Xiong, Y., & Zhu, Y. Y. (2020). TLP: A temporal link prediction algorithm in dynamic networks. Computer Engineering, 46(1), 67-73.

[8]Du, N., Guo, J., Wu, C. Q., Hou, A., Zhao, Z., & Gan, D. (2020). Recommendation of Academic Papers based on Heterogeneous Information Networks. In Proceedings of the 2020 IEEE/ACS 17th International Conference on Computer Systems and Applications (AICCSA) (pp. 1-6).

[9]Zheng, Y., Gao, C., He, X., Li, Y., & Jin, D. (2020). Price-aware recommendation with graph convolutional networks. In 2020 IEEE 36th International Conference on Data Engineering (ICDE) (pp. 133-144).

[10]Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W. L., & Leskovec, J. (2018). Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (pp. 974-983).

[11]Jeong, C., Jang, S., Shin, H., Park, E., & Choi, S. (2020). A context-aware citation recommendation model with BERT and graph convolutional networks. Scientometrics, 124(3), 1907-1922. https://doi.org/10.1007/s11192-020-03561-y

[12]Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence embeddings using siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 3982-3992).

[13]Beltagy, I., Lo, K., & Cohan, A. (2019). SciBERT: A Pretrained Language Model for Scientific Text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 3615-3620). https://doi.org/10.48550/arXiv.1903.10676

[14]Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. S. (2020). SPECTER: Document-level Representation Learning using Citation-informed Transformers. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 270-2282). https://doi.org/10.48550/arXiv.2004.07180

[15]Chen, J., Liu, Y., Zhao, S., & Zhang, Y. (2019). Citation recommendation based on weighted heterogeneous information network containing semantic linking. In Proceedings of 2019 IEEE International Conference on Multimedia and Expo (pp. 31-36). https://doi.org/10.1109/ICME.2019.00014

[16]Gao, H. Y., Zhang, X. H., & Wang, J. (2021). Link prediction algorithm based on generative adversarial hierarchical network representation learning. Computer Engineering, 47(2), 60-68, 76.

[17]Liu, F., Wang, B., Zou, R., & Zhao, H. (2021). A recommendation algorithm for network representation learning based on random walks. Computer Engineering, 47(9), 90-96, 105.

[18]Gupta, S., & Varma, V. (2017). Scientific article recommendation by using distributed representations of text and graph. In Proceedings of the 26th International Conference on World Wide Web Companion (pp. 1267-1268). https://doi.org/10.1145/3041021.3053062

[19]Kong, X., Mao, M., Wang, W., Liu, J., & Xu, B. (2018). VOPRec: Vector representation learning of papers with text information and structural identity for recommendation. IEEE Transactions on Emerging Topics in Computing, 9(1), 226-237. https://doi.org/10.1109/TETC.2018.2830698

[20]Zhang, Y., & Ma, Q. (2020). Citation recommendations considering content and structural context embedding. In 2020 IEEE International Conference on Big Data and Smart Computing (BigComp) (pp. 1-7). https://doi.org/10.1109/BigComp48618.2020.0-109

[21]Du, Z., Tang, J., & Ding, Y. (2022). POLAR: Attention-based CNN for one-shot personalized article recommendation. In Machine Learning and Knowledge Discovery in Databases: European Conference (pp. 675-690). https://doi.org/10.1007/978-3-030-10928-8_40

[22]Ali, Z., Qi, G., Muhammad, K., Kefalas, P., & Khusro, S. (2021). Global citation recommendation employing generative adversarial network. Expert Systems With Applications, 180(C), 114888. https://doi.org/10.1016/j.eswa.2021.114888

[23]Ali, Z., Qi, G., Kefalas, P., Khusro, S., Khan, I., & Muhammad, K. (2022). SPR-SMN: Scientific paper recommendation employing SPECTER with memory network. Scientometrics, 127(11), 6763-6785. https://doi.org/10.1007/s11192-022-04425-3

[24]Berg, R., Kipf, T., & Welling, M. (2018). Graph Convolutional Matrix Completion. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 19-23).

[25]Wang, X., Feng, F., He, X., Chua, T.S., & Wang, M. (2019). Neural Graph Collaborative Filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 165-174).

[26]Chen, W., Wen, Y., Zhang, X., Yang, N., & Zhao, S. (2020). An improved TransE-based knowledge graph representation method. Computer Engineering, 46(5), 63-69, 77.

[27]Goel, R., Kazemi, S. M., Brubaker, M., & Poupart, P. (2020). Diachronic embedding for temporal knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 34, No. 04, pp. 3988-3995). https://doi.org/10.1609/aaai.v34i04.5815

[28]Kazemi, B., & Abhair, A. (2017). A comparative study on content-based paper-to-paper recommendation approaches in scientific literature. In Proceedings of the 20th Communications & Networking Symposium (pp. 1-10).

[29]Small, H. (1973). Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265-269. https://doi.org/10.1002/asi.4630240406

[30]Kanakia, A., Shen, Z., Eide, D., & Wang, K. (2019). A scalable hybrid research paper recommender system for Microsoft Academic. In The World Wide Web Conference (pp. 2893-2899). https://doi.org/10.1145/3308558.3313700

[31]Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning (Vol. 32, No. 2, pp. 1188-1196).

[32]Pan, L., Dai, X., Huang, S., & Chen, J. (2015). Academic paper recommendation based on heterogeneous graph. In Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data (pp. 381-392). https://doi.org/10.1007/978-3-319-25816-4_31

[33]Zhu, T. (2022). Academic literature recommendation method integrating network representation learning and textual information. Science & Technology Information, 8(3), 81-92. https://doi.org/10.3772/j.issn.2095-915X.2022