A Novel Hybrid Approach for Biomedical Text Summarization Using Pre-Trained Language Models

Authors

  • Pawan Makhija,Dr. Sanjay Tanwani,

Keywords:

Natural Language Processing (NLP), BART, T5, Pegasus, Biomedical Text Summarization (BTS)

Abstract

The rapid expansion of biomedical literature requires efficient methods for information extraction.This paper proposes a hybrid biomedical text summarization (BTS) system that leverages the  strengths of multiple pre-trained language models (PLMs): BART, Pegasus, and T5. Unlike existing approaches that rely on a single PLM, our hybrid system combines the output of these models, employing a novel sentence scoring mechanism and subsequently removing redundant information using cosine similarity to enhance the quality and conciseness of the summaries

References

. Lalitha, E., et al. (2023). Text Summarization of Medical Documents using Abstractive Techniques. 2nd International Conference on Applied Artificial Intelligence and Computing (ICAAIC).

. Lewis, M., et al. (2020). BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

Downloads

Published

2024-12-02

How to Cite

Pawan Makhija,Dr. Sanjay Tanwani,. (2024). A Novel Hybrid Approach for Biomedical Text Summarization Using Pre-Trained Language Models. Journal of Computational Analysis and Applications (JoCAAA), 33(08), 3053–3068. Retrieved from https://eudoxuspress.com/index.php/pub/article/view/2403

Issue

Section

Articles