Assessment of Hysteroscopy Skills With a New Assessment Tool

Objective To investigate validity of the hysteroscopy assessment tool (HYSAT) for assessment of competence in a clinical environment.

Methods Novices and experienced gynecologists are recruited from three hospitals and observed and assessed while performing hysteroscopy. Performances are assessed using the HYSAT tool by two independent raters. Validity evidence is gathered in accordance with Messick's framework: validity evidence for content was ensured in previously published Delphi study, response process is ensured by standardization of written rater instructions. Internal structure is explored using Cronbach's alpha for internal consistency reliability; inter-rater reliability and test-retest reliability are calculated as Pearson's r independently across all ratings. Relationship to other variables is investigated by comparing performances of the participants in each group. Consequences evidence is explored by calculating a pass/fail standard using the contrasting groups' standard setting method.