Chat GPT vs. Clinical Decision Support Systems in the Analysis of Drug-Drug Interactions.

Chat GPT vs. Clinical Decision Support Systems in the Analysis of Drug-Drug Interactions.

Publication date: Feb 11, 2025

The current standard method for the analysis of potential drug-drug interactions (pDDIs) is time-consuming and includes the use of multiple clinical decision support systems (CDSSs) and the interpretation by healthcare professionals. With the emergence of large language models developed with artificial intelligence, an interesting alternative arose. This retrospective study included 30 patients with polypharmacy, who underwent a pDDI analysis between October 2022 and August 2023, and compared the performance of Chat GPT and established CDSSs (MediQ(R), Lexicomp(R), Micromedex(R)) in the analysis of pDDIs. A multidisciplinary team interpreted the obtained results and decided upon clinical relevance and assigned severity grades using three categories: (i) contraindicated, (ii) severe, (iii) moderate. The expert review identified a total of 280 clinically relevant pDDIs (3 contraindications, 13 severe, 264 moderate) using established CDSSs, compared with 80 pDDIs (2 contraindications, 5 severe, 73 moderate) using Chat GPT. Chat GPT almost entirely neglected pDDIs with the risk to QTc prolongation (85 vs. 8), which could also not be sufficiently improved by using a specific prompt. To assess the consistency of the results provided by Chat GPT, we repeated each query and found inconsistent results in 90% of the cases. In contrast, Chat GPT provided acceptable and comprehensible recommendations for specific questions on side effects. The use of Chat GPT for the identification of pDDIs cannot be recommended currently, because clinically relevant pDDIs were not detected, there were obvious errors and results were inconsistent. However, if these limitations are addressed accordingly, it is a promising platform for the future.

Open Access PDF

Concepts Keywords
August Cdsss
Models Chat
Pharmacol Clinical
Severe Compared
Drug
Established
Gpt
Interactions
Large
Models
Moderate
Pddis
Relevant
Severe
Systems

Semantics

Type Source Name
disease MESH Drug Interactions
disease MESH clinical relevance
disease MESH contraindications
disease MESH edema
disease MESH hypotension
drug DRUGBANK Tacrolimus
disease MESH bleeding
disease MESH syndrome
disease MESH syncope
drug DRUGBANK Coenzyme M
drug DRUGBANK Trestolone
drug DRUGBANK Haloperidol
drug DRUGBANK Quetiapine
disease MESH sudden cardiac death
drug DRUGBANK Rosuvastatin
drug DRUGBANK Simvastatin
drug DRUGBANK Amlodipine
drug DRUGBANK Flecainide
drug DRUGBANK Mycophenolate mofetil
drug DRUGBANK Magnesium
drug DRUGBANK Pantoprazole
drug DRUGBANK Metamizole
disease MESH depression
disease MESH Seizure
drug DRUGBANK Sarizotan
disease MESH multiple sclerosis
disease MESH morbidity
drug DRUGBANK Spinosad
disease MESH hypercholesterolemia
disease MESH hypertension

Original Article

(Visited 4 times, 1 visits today)

Leave a Comment

Your email address will not be published. Required fields are marked *