Performance Comparison of Large Language Models in TAP Block Ultrasound Interpretation

Trial statusRecruiting
Trial phaseNot listed
Trial typeObservational
Biological sexAll
Age18-85
SponsorKanuni Sultan Suleyman Training and Research Hospital

About this trial

The goal of this study is to learn how accurately two artificial intelligence (AI) models, Gemini 2.5 Pro and ChatGPT-5.1, can interpret ultrasound videos of the Transversus Abdominis Plane (TAP) block, a regional anesthesia technique used for pain control after surgery.

The main questions this study aims to answer are:

How accurately can each AI model identify anatomical structures on TAP block ultrasound videos? Can the AI models correctly evaluate the spread of local anesthetic and determine whether the block is successful? How closely do the AI models' answers match the evaluations of expert anesthesiologists? No additional procedures will be performed on patients. TAP blocks will be done as part of routine clinical care, and the ultrasound videos will be recorded and de-identified.

Participants will not need to do anything extra for the study. Experienced anesthesiologists will review the videos and provide expert answers. The AI models will be given the same videos and asked the same questions. A second expert, who does not know which answers came from humans or AI, will compare all responses.

The results will help researchers understand whether advanced AI systems can safely support clinicians in interpreting ultrasound-guided regional anesthesia procedures and improve education and decision-making in anesthesia practice.

Eligibility criteria

Qualifiers

Adults aged 18-85 years

ASA I-III physical status

Undergoing elective surgery with a lateral TAP block performed as part of routine anesthesia care

Complete ultrasound-guided block procedure recorded on video

Disqualifiers

Unsuccessful or incomplete TAP block procedure

Poor-quality ultrasound video (needle tip or anesthetic spread not visible)

Missing demographic or clinical data

Withdrawal of consent at any time

Trial design

Treatments tested in this trial

  • Gemini 2.5 Pro Evaluation
  • ChatGPT-5.1 Evaluation

Treatment groups

No treatment groups listed