Leveraging Transformer-Based Topic Modeling using BERTopic for Publication Venue Recommendation

Sulaiman N.S., Yaqob A., Badieah, Mulyono S., Wiktasari, Chaerul Haviana S.F., Salim C.A., Febriansah M.T., Adli M.F.

Abstract

Topic modeling has become essential in a variety of text mining applications, such as document clustering and recommendation systems. This study investigates the potential of BERTopic, a transformer-based method that leverages BERT embeddings to recommend publication venues. Traditional topic modeling methods are made better by BERTopic, which uses the deep contextual embeddings that BERT (Bidirectional Encoder Representations from Transformers) offers. This investigation assesses the efficacy of BERTopic in clustering academic papers according to their content in order to suggest appropriate publication venues. We also compare the performance between different kinds of pre-trained sentence embedding models and input types (title, abstract, and title+abstract). The experimental results indicate that BERTopic performs well with the GARUDA dataset, which comprises 5272 records from three different research subjects. The results emphasize the transformative influence of the transformer-based model. The best performance of all cases was 99.17% mean average precision in the Top 3 position, using Title+Abstract as input data and all-mpnet-base-v2 as the sentence embedding model.

Journal
International Conference on Electrical Engineering Computer Science and Informatics Eecsi
Page Range
556-562
Publication date
2024
Total citations
Improving Document Similarity Calculation Using Cosine-Similarity Graphs

Iijima Y., Kobayashi A., Kobayashi K., Kohana M., Sakaji H., Sakuta H., Takano Y., Iijima Y., Kobayashi A., Kobayashi K., Kohana M., Sakaji H., Sakuta H., Takano Y.

Elsevier journal finder: Recommending journals for your paper

Doornenbal M., Kang N., Schijvenaars B.

CLAVER: An integrated framework of convolutional layer, bidirectional LSTM with attention mechanism based scholarly venue recommendation

Kumar P., Pal S., Pradhan T., Pradhan T., Kumar P., Pal S., Pradhan T., Pradhan T.

S2CFT: A New Approach for Paper Submission Recommendation

Dinh C.V., Huynh P., Huynh P., Huynh P., Huynh S., Huynh S., Huynh S., Nguyen B.T., Nguyen B.T., Nguyen B.T., Nguyen D., Nguyen D.

A content-based recommender system for computer science publications

Feng X., Guan R., Liang Y., Liang Y., Wang D., Xu D., Xu D., Feng X., Guan R., Liang Y., Liang Y., Wang D., Xu D., Xu D.

A hybrid personalized scholarly venue recommender system integrating social network analysis and contextual similarity

Pal S., Pradhan T., Pal S., Pradhan T.

HASVRec: A modularized Hierarchical Attention-based Scholarly Venue Recommender system

Gupta A., Pal S., Pradhan T., Pradhan T., Gupta A., Pal S., Pradhan T., Pradhan T.

The deep learning-based recommender system "pubmender" for choosing a biomedical publication venue: Development and validation study

Feng X., Feng X., Guan R., Liang Y., Ren Y., Shang P., Xu D., Xu D., Xu D., Zhang H., Zhu Y., Feng X., Feng X., Guan R., Liang Y., Ren Y., Shang P., Xu D., Xu D., Xu D., Zhang H., Zhu Y.

Scholarly publication venue recommender systems: A systematic literature review

Dehdarirad H., Ghazimirsaeid J., Jalalimanesh A., Dehdarirad H., Ghazimirsaeid J., Jalalimanesh A.

Exploiting Content-Based Filtering for Publication Venue Recommendations

Badieah, Haviana S.F.C., Mulyono S., Subroto I.M.I., Sulaiman N.S., Yacob A., Badieah, Haviana S.F.C., Mulyono S., Subroto I.M.I., Sulaiman N.S., Yacob A.