Advertisement
Research Article|Articles in Press

Evaluating the content validity of the Single Assessment Numeric Evaluation (SANE) in shoulder pathologies

  • Rochelle Furtado
    Correspondence
    Corresponding Author: Ms Rochelle Furtado, Western University, 1201 Western Rd, London, ON, Canada N6G 1H1
    Affiliations
    Physiotherapy, Health and Rehabilitation Science, Western University, London ON Canada

    Collaborative Program in Musculoskeletal Health Research, Bone and Joint Institute, Western University, London ON Canada

    Roth McFarlane Hand and Upper Limb Centre, St. Joseph's Hospital, London, ON Canada
    Search for articles by this author
  • Joy C. MacDermid
    Affiliations
    Physiotherapy, Health and Rehabilitation Science, Western University, London ON Canada

    Collaborative Program in Musculoskeletal Health Research, Bone and Joint Institute, Western University, London ON Canada

    Roth McFarlane Hand and Upper Limb Centre, St. Joseph's Hospital, London, ON Canada
    Search for articles by this author
Published:March 11, 2023DOI:https://doi.org/10.1016/j.jht.2022.10.006

      Abstract

      Background

      The Single Assessment Numeric Evaluation (SANE) is a single item patient reported outcome measure (PROM) of function, in where patients rate how normal they feel in relation to a specific joint or problem. Although validated for some orthopedic conditions, it is not yet validated for a population with shoulder pathologies; nor have other studies explored the content validity. This study aims to understand how 1) patients with shoulder conditions interpret and calibrate responses to the SANE and 2) how they define normal.

      Methods

      This study uses cognitive interviewing, a qualitative methodology that focuses on the interpretation of questionnaire items. Patients with rotator cuff disorders (n = 10), clinicians (n = 6) and measurement researchers (n = 10) were interviewed using a talk aloud structured interview that evaluated the SANE. All interviews were recorded and transcribed verbatim by one researcher (R.F). Analysis was done through an open coding scheme using a previously established framework for classification of interpretation variances.

      Results

      Overall, the single-item SANE was well received by all participants. Through the interviews, the themes of: Comprehension (20% of participants), Reference Point (20% of participants), Relevance (10% of participants), and Perspective Modifiers (50% of participants) emerged as potential sources of interpretation variances. Clinicians indicated this tool facilitates discussion when trying to create realistic recovery expectations for patients post-operatively. The word “normal” was defined by the themes of: 1) levels of current pain compared to pre-injury, 2) personal expectations of recovery and 3) pre-injury activity levels.

      Conclusions

      Overall, respondents found the SANE to be cognitively simple, but it was clear that the interpretation of the question and what factors calibrated their responses were highly variable between respondents. The SANE is perceived favorable by patients and clinicians, while providing a low response burden. However, the construct being measured may vary between patients.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Hand Therapy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      Reference

        • Luime J.J.
        • Koes B.W.
        • Hendriksen I.J.M.
        • Burdorf A.
        • Verhagen A.P.
        • Miedema H.S.
        • Verhaar J.A.N.
        Prevalence and incidence of shoulder pain in the general population; a systematic review.
        Scandinavian journal of rheumatology. 2004; 33: 73-81
        • Furtado R.
        • MacDermid J.
        Clinimetrics: single assessment numeric evaluation.
        Journal of physiotherapy. 2019; 65: 111
        • Williams G.N.
        • Taylor D.C.
        • Gangel T.J.
        • Uhorchak J.M.
        • Arciero R.A.
        Comparison of the single assessment numeric evaluation method and the Lysholm score.
        Clinical Orthopaedics and Related Research (1976-2007). 2000; 373: 184-192
        • Nazari G.
        • MacDermid J.C.
        • Bobos P.
        • Furtado R.
        Psychometric properties of the Single Assessment Numeric Evaluation (SANE) in patients with shoulder conditions. A systematic review.
        Physiotherapy. 2020;
        • Thigpen C.A.
        • Shanley E.
        • Momaya A.M.
        • Kissenberth M.J.
        • Tolan S.J.
        • Tokish J.M.
        • Hawkins R.J.
        Validity and responsiveness of the single alpha-numeric evaluation for shoulder patients.
        The American journal of sports medicine. 2018; 46: 3480-3485
        • Sciascia A.D.
        • Morris B.J.
        • Jacobs C.A.
        • Edwards T.B.
        Responsiveness and internal validity of common patient-reported outcome measures following total shoulder arthroplasty.
        Orthopedics. 2017; 40: e513-e519
        • Rentz AM
        • Skalicky AM
        • Burslem K
        • Becker K
        • Kaschinski D
        • Esser D
        • et al.
        The content validity of the PSS in patients with plaque psoriasis.
        J Patient Rep Outcomes. 2017; 1: 4https://doi.org/10.1186/s41687-017-0004-7
        • Food Drug Administration (FDA)
        Guidance for industry patient- reported outcome measures: use in medical product development to support labeling claims.
        Fed Regist. 2009; 74: 65132-65133
        • Willis GB.
        Cognitive interviewing: a tool for improving questionnaire design.
        Sage Publications, Thousand Oaks2004
        • Thorne S.
        Interpretive description.
        Routledge, New York2016
      1. MacDermid J. Cognitive interviewing (CI) - to identify sources of interpretation dissonance in in patient-reported outcome measures (PRO).1-3; 2018.

        • Furtado R.
        • MacDermid J.C.
        • Bryant D.M.
        • Faber K.J.
        • Athwal G.S.
        Interpretation and content validity of the items of the numeric rating version short-WORC to evaluate outcomes in management of rotator cuff pathology: a cognitive interview approach.
        Health and quality of life outcomes. 2020; 18: 1-9
        • Terwee CB
        • Prinsen CA
        • Chiarotto A
        • Westerman MJ
        • Patrick DL
        • Alonso J
        • et al.
        COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study.
        Qual Life Res. 2018; 27: 1159-1170
        • Mokkink LB
        • Terwee CB
        • Patrick DL
        • Alonso J
        • Stratford PW
        • Knol DL
        • et al.
        The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.
        Qual Life Res. 2010; 19: 539-549
        • Furtado R.
        • MacDermid J.C.
        • Nazari G.
        • Bryant D.M.
        • Faber K.J.
        • Athwal G.S.
        Cross-cultural adaptions and measurement properties of the WORC (Western Ontario rotator cuff index): a systematic review.
        Health and quality of life outcomes. 2020; 18: 17
        • Murtagh FE
        • Addington-Hall JM
        • Higginson IJ.
        The value of cognitive interviewing techniques in palliative care research.
        Palliat Med. 2007; 21: 87-93
        • Carroll Linda J.
        • Lis Angela
        • Weiser Sherri
        • Torti Jacqueline
        How Well Do You Expect to Recover, and What Does Recovery Mean, Anyway? Qualitative Study of Expectations After a Musculoskeletal Injury.
        Physical Therapy. 2016; 96 (VolumeIssue1 JunePages): 797-807
        • De Baets L.
        • Matheve T.
        • Meeus M.
        • Struyf F.
        • Timmermans A.
        The influence of cognitions, emotions and behavioral factors on treatment outcomes in musculoskeletal shoulder pain: a systematic review.
        Clinical rehabilitation. 2019; 33: 980-991
        • Enonbun K.I.
        • Furtado R.
        • MacDermid J.C.
        • Overend T.J.
        Patient Expectations for Outcomes of Upper Extremity Total Joint Arthroplasty: A Systematic Review.
        Critical Reviews™ in Physical and Rehabilitation Medicine. 2020; 32
        • Haanstra TM
        • van den Berg T
        • Ostelo RW
        • Poolman RW
        • Jansma EP
        • Jansma IP
        • Cuijpers PV
        • Henrica CV.
        Systematic review: Do patient expectations influence treatment outcomes in total knee and total hip arthroplasty?.
        Health Qual Life Outcomes. 2012; 10: 152
        • Damman OC
        • Hendriks M
        • Rademakers J
        • Delnoij DM
        • Groenewegen PP.
        How do healthcare consumers process and evaluate comparative healthcare information? A qualitative study using cognitive interviews.
        BMC Public Health. 2009; 9: 423
        • Walton D.M.
        • Macdermid J.C.
        • Nielson W.
        Recovery from acute injury: clinical, methodological and philosophical considerations.
        Disability and rehabilitation. 2010; 32: 864-874
        • Schwartz CE
        • Bode R
        • Repucci N
        • Becker J
        • Sprangers MA
        • Fayers PM.
        The clinical significance of adaptation to changing health: a meta-analysis of response shift.
        Qual Life Res. 2006; 15: 1533-1550
        • Packham TL
        • MacDermid J.
        Content validity of the patient-report Hamilton inventory for complex regional pain syndrome.
        J Hand Ther. 2014; 27: e3
      2. Statistics Canada. Census profile, 2006 census; 2016. Retrieved from: https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/details/page.cfm? Lang=E&Geo1=CMACA&Code1=555&Geo2=PR&Code2=35&Data= Count&SearchText=London&SearchType=Begins&SearchPR=01&B1= All&GeoLevel=PR&GeoCode=555&TABID=1.

        • Shi J
        • Mo X
        • Sun Z.
        Content validity index in scale development.
        J Central South Univ Med Sci. 2012; 37: 152-155
        • Kamper S.J.
        • Maher C.G.
        • Mackay G.
        Global rating of change scales: a review of strengths and weaknesses and considerations for design.
        Journal of Manual & Manipulative Therapy. 2009; 17: 163-170
        • Janssen M.F.
        • Pickard A.S.
        • Golicki D.
        • Gudex C.
        • Niewada M.
        • Scalone L.
        • Busschbach J.
        Measurement properties of the EQ-5D-5L compared to the EQ-5D-3L across eight patient groups: a multi-country study.
        Quality of life research. 2013; 22: 1717-1727