Publication date: Oct 09, 2024
Despite numerous research efforts by teams participating in the BioCreative VIII Track 01 employing various techniques to achieve the high accuracy of biomedical relation tasks, the overall performance in this area still has substantial room for improvement. Large language models bring a new opportunity to improve the performance of existing techniques in natural language processing tasks. This paper presents our improved method for relation extraction, which involves integrating two renowned large language models: Gemini and GPT-4. Our new approach utilizes GPT-4 to generate augmented data for training, followed by an ensemble learning technique to combine the outputs of diverse models to create a more precise prediction. We then employ a method using Gemini responses as input to fine-tune the BioNLP-PubMed-Bert classification model, which leads to improved performance as measured by precision, recall, and F1 scores on the same test dataset used in the challenge evaluation. Database URL: https://biocreative. bioinformatics. udel. edu/tasks/biocreative-viii/track-1/.
Open Access PDF
| Concepts | Keywords |
|---|---|
| Bioinformatics | Computational Biology |
| Gemini | Data Mining |
| High | Databases, Factual |
| Models | Machine Learning |
| Oxford | Natural Language Processing |
Semantics
| Type | Source | Name |
|---|---|---|
| drug | DRUGBANK | Coenzyme M |
| disease | MESH | End stage renal disease |
| drug | DRUGBANK | Tretamine |
| drug | DRUGBANK | Trestolone |
| drug | DRUGBANK | Desoxycorticosterone acetate |
| drug | DRUGBANK | Trifluoro-thiamin phosphate |
| disease | MESH | seasonal affective disorder |
| drug | DRUGBANK | Galsulfase |
| drug | DRUGBANK | Alpha-1-proteinase inhibitor |
| disease | MESH | proteinuria |
| disease | MESH | oxidative stress |
| drug | DRUGBANK | Dextrose unspecified form |
| disease | MESH | necrosis |
| drug | DRUGBANK | Methionine |
| drug | DRUGBANK | Nonoxynol-9 |
| drug | DRUGBANK | Esomeprazole |
| disease | MESH | pus |
| disease | MESH | genetic disorders |
| drug | DRUGBANK | Didanosine |
| disease | MESH | drug interactions |