[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"health-study-detail:100645000":3},{"organization":4,"armGroups":7,"interventions":15,"overallOfficials":10,"centralContacts":25,"locations":31,"responsibleParty":46,"collaborators":50,"id":53,"slug":54,"hasResults":55,"nctId":56,"briefTitle":57,"officialTitle":58,"acronym":59,"eligibilityCriteria":60,"healthyVolunteers":61,"sex":62,"minAge":63,"maxAge":10,"enrollmentInfo":64,"targetDuration":67,"studyType":68,"phases":10,"briefSummary":69,"conditions":70,"keywords":74,"overallStatus":77,"whyStopped":10,"lastUpdateSubmitDate":78,"lastUpdatePostDateStruct":79,"startDateStruct":82,"completionDateStruct":84,"leadSponsor":86,"locationsCount":87},{"fullName":5,"class":6},"Neuron, Spain","OTHER",[8],{"label":9,"type":10,"description":11,"interventionNames":12},"Anonymized physiotherapy clinical case examinations",null,"Single cohort consisting of de-identified written clinical-reasoning case examinations produced by undergraduate physiotherapy students in the course \"Specific Methods in Physiotherapy.\" Each examination is assessed independently, using the same predefined rubric, by faculty (reference standard) and by three large language models (LLMs), with each model queried in duplicate to assess test-retest reliability. The examination is the unit of analysis; no participant follow-up is performed.",[13,14],"Diagnostic Test: LLM-based assessment","Diagnostic Test: Faculty assessment (reference standard)",[16,21],{"type":17,"name":18,"description":19,"armGroupLabels":20,"otherNames":10},"DIAGNOSTIC_TEST","LLM-based assessment","Assessment of each anonymized examination by three large language models (for example, Claude, ChatGPT, and Gemini, in the versions available during data collection). Each model receives an identical standardized prompt embedding the study rubric and returns a score per criterion, a global score, and structured qualitative feedback. Each model is queried in duplicate in independent sessions under fixed generation parameters to estimate intra-model (test-retest) reliability, and outputs are compared across models to estimate inter-model agreement.",[9],{"type":17,"name":22,"description":23,"armGroupLabels":24,"otherNames":10},"Faculty assessment (reference standard)","Assessment of the same anonymized examinations by faculty with expertise in the course, applying the identical rubric, serving as the reference standard. In the preferred scenario, two faculty members score each examination independently (paired human correction); if faculty workload precludes this, a single expert faculty rating, or the official course grade already assigned, is used as the reference. Faculty and LLM raters are blinded to one another's scores.",[9],[26],{"name":27,"role":28,"phone":29,"phoneExt":10,"email":30},"Alfredo Lerín Calvo, MSc","CONTACT","+34620187457","alfredo.lerin@lasallecampus.es",[32],{"facility":33,"status":10,"city":34,"state":34,"zip":35,"country":36,"countryCode":37,"cosmosGeoPoint":38,"geoPoint":43,"contacts":44},"Centro Superior de Estudios Universitarios La Salle","Madrid","28023","Spain","ES",{"type":39,"coordinates":40},"Point",[41,42],-3.70256,40.4165,{"lat":42,"lon":41},[45],{"name":27,"role":28,"phone":29,"phoneExt":10,"email":30},{"type":47,"investigatorFullName":48,"investigatorTitle":49,"investigatorAffiliation":5,"oldNameTitle":10,"oldOrganization":10},"PRINCIPAL_INVESTIGATOR","Alfredo Lerín Calvo","Mr.",[51],{"name":52,"class":6},"Centro Universitario La Salle","100645000","large-language-models-versus-human-examiners-for-grading-physiotherapy-clinical-cases-100645000",false,"NCT07677202","Large Language Models Versus Human Examiners for Grading Physiotherapy Clinical Cases","Agreement Between Large Language Models and Faculty Assessment in the Evaluation of Clinical Reasoning Case Examinations in Undergraduate Physiotherapy Education: A Comparative Reliability Study","PACE-AI","Inclusion Criteria:\n\n* Students officially enrolled in the course \"Specific Methods in Physiotherapy\" (third year of the Physiotherapy Degree) during the study period.\n* Submission of a completed written clinical-reasoning case examination as part of the course.\n* Provision of informed consent for the anonymized examination to be used for educational-research purposes.\n\nExclusion Criteria:\n\n* Refusal to provide, or withdrawal of, informed consent.\n* Blank, incomplete, or non-evaluable examinations (e.g., no developed written response).\n* Examinations that cannot be reliably de-identified prior to assessment.",true,"ALL","18 Years",{"count":65,"type":66},65,"ESTIMATED","1 Day","OBSERVATIONAL","This study evaluates whether large language models (LLMs) can reliably assess written clinical-reasoning case examinations completed by undergraduate physiotherapy students, compared with faculty assessment. In the course \"Specific Methods in Physiotherapy\" (third year of the Physiotherapy Degree), students solve complex clinical cases that require clinical reasoning, technical knowledge, and therapeutic decision-making. These cases are traditionally graded by faculty, a time-consuming process that may show inter-rater variability.\n\nA set of de-identified student case examinations will be assessed using the rubric currently applied in the course, which covers clarity and structure of clinical reasoning, integration of the biopsychosocial model (ICF and APTA frameworks), accuracy in identifying pain mechanisms, coherence between diagnosis, hypotheses, and treatment, originality and depth of analysis, and professional writing. Each examination will be scored independently by three LLMs (for example, Claude, ChatGPT, and Gemini), each receiving an identical standardized prompt that embeds the same rubric, and by faculty serving as the reference standard.\n\nTo avoid overloading faculty, full double human grading may not be feasible; the human reference will therefore consist of expert faculty grading by one independent rater or, when resources allow, two independent raters. In contrast, paired assessment is fully implemented across the AI models: each examination is scored by several LLMs, and each model is queried in duplicate, allowing the study to estimate agreement between models and the test-retest stability of each model.\n\nThe primary aim is to quantify agreement between LLM-generated scores and the faculty reference score. Secondary aims include agreement among the LLMs, test-retest reliability of each model, criterion-level agreement, the quality and usefulness of the qualitative feedback generated, the time and cost associated with each approach, and students' perceptions of the usefulness of human versus AI feedback.\n\nThe findings will clarify the strengths and limitations of LLMs as supportive tools for formative assessment in health-professions education and will inform criteria for their responsible and effective use. No LLM output will affect students' official grades, which remain the sole responsibility of faculty.",[71,72,73],"Educational Assessment","Artifical Intelligence","Physical Therapy Education",[75,76],"Clinical Competence","Educational, Medical","NOT_YET_RECRUITING","2026-06-24",{"date":80,"type":81},"2026-06-30","ACTUAL",{"date":83,"type":66},"2026-08-01",{"date":85,"type":66},"2026-08-10",{"name":5,"class":6},1]