PROMIS Upper Extremity underperforms psychometrically relative to American Shoulder and Elbow Surgeons score in patients undergoing primary rotator cuff repair.
Academic Article
Overview
abstract
BACKGROUND: A number of patient-reported outcome measure (PROM) instruments are used to assess shoulder pain, function, and postoperative satisfaction. Computer adaptive tests (CATs) have been developed in an effort to tailor question delivery, decrease time to completion and floor/ceiling effects, and increase compliance. Previous investigations have demonstrated excellent correlation between Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity CAT (UE-CAT) and American Shoulder and Elbow Surgeons (ASES) instruments, indicating that the PROMIS UE-CAT may be an acceptable alternative to the ASES. Prior to widespread adoption, however, rigorous psychometric validation must be performed. Thus, the purpose of this study was to evaluate the psychometric properties of PROMIS UE-CAT relative to the ASES score in patients undergoing primary rotator cuff repair (RCR). METHODS: A retrospective study of an institutional RCR registry was performed from July 2018 through March 2019. Preoperative PROMIS UE-CAT and ASES scores were collected. Floor and ceiling effects were determined, and convergent validity was established through Pearson correlations. Rasch partial credit modeling was used for psychometric analysis of the validity of PROMIS UE-CAT and ASES question items, a previously established methodology for assessing shoulder PROMs. Person-item maps were generated to characterize the distribution of question responses along the latent dimension of shoulder disability. RESULTS: Responses from 107 patients (107 shoulders) were included. PROMIS UE-CAT had a strong correlation to ASES (r = 0.684; P < .001), with a 3.7% floor effect and no ceiling effect; ASES had no floor or ceiling effects. PROMIS UE-CAT person-item maps revealed excellent test item coverage between floor and ceiling effects; however, all PROMIS UE-CAT items except "Difficulty putting on a jacket" demonstrated nonsequentially ordered responses, indicating poor reliability of item responses corresponding to shoulder function. Although PROMIS UE-CAT initially demonstrated superior instrument efficiency with fewer test items for overall equivalent coverage of shoulder function assessment, final models after recursive item elimination revealed the ASES instrument to have more well-fitting items over a broader range of shoulder function. CONCLUSION: Despite its overall strong correlation with ASES and equivalent coverage between floor and ceiling effects, the psychometric properties of PROMIS UE-CAT indicate a need for optimization of individual test items to correspond to shoulder function. Until further refinements in the PROMIS UE-CAT instrument are made, it should not replace the ASES instrument in patients undergoing primary RCR.
