TY - JOUR
T1 - An 11-item measure of user- And human-centered design for personal health tools (UCD-11)
T2 - Development and validation
AU - Witteman, Holly O.
AU - Vaisson, Gratianne
AU - Provencher, Thierry
AU - Dansokho, Selma Chipenda
AU - Colquhoun, Heather
AU - Dugas, Michele
AU - Fagerlin, Angela
AU - Giguere, Anik M.C.
AU - Haslett, Lynne
AU - Hoffman, Aubri
AU - Ivers, Noah M.
AU - Légaré, France
AU - Trottier, Marie Eve
AU - Stacey, Dawn
AU - Volk, Robert J.
AU - Renaud, Jean Sébastien
N1 - Funding Information:
This study was funded by the Patient-Centered Outcomes Research Institute (PCORI): ME-1306-03174 (PI: HOW) and the Canadian Institutes of Health Research (CIHR): FDN-148246 (PI: HOW). PCORI and CIHR had no role in determining the study design, the plans for data collection or analysis, the decision to publish, nor the preparation of this manuscript. HOW is funded by a Tier 2 Canada Research Chair in Human-Centred Digital Health and received salary support during this work from Research Scholar Junior 1 and 2 Career Development Awards by the Fonds de Recherche du Québec—Santé (FRQS). AMCG received salary support during this work from a Research Scholar Junior 2 Career Development Award by the FRQS. NMI is funded by a Tier 2 Canada Research Chair in Implementation of Evidence-based Practice and received salary support during this work from a New Investigator Award by the CIHR as well as a New Investigator Award from the Department of Family and Community Medicine, University of Toronto. FL is funded by a Tier 1 Canada Research Chair in Shared Decision Making and Knowledge Translation. DS holds a University of Ottawa Research Chair in Knowledge Translation to Patients.
Publisher Copyright:
© 2021 Journal of Medical Internet Research. All rights reserved.
PY - 2021/3
Y1 - 2021/3
N2 - Background: Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development. Objective: The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools. Methods: We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis. Results: We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved. Conclusions: The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.
AB - Background: Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development. Objective: The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools. Methods: We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis. Results: We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved. Conclusions: The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.
KW - Co-design
KW - Health services research
KW - Human-centered design
KW - Human-centred design
KW - Humans
KW - Index
KW - Instrument
KW - Patient and public involvement
KW - Patient participation
KW - Patient-centered care
KW - Scale
KW - Surveys and questionnaires
KW - User-centered design
KW - User-centred design
KW - Validation studies as topic
UR - http://www.scopus.com/inward/record.url?scp=85103226617&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103226617&partnerID=8YFLogxK
U2 - 10.2196/15032
DO - 10.2196/15032
M3 - Article
C2 - 33724194
AN - SCOPUS:85103226617
SN - 1439-4456
VL - 23
JO - Journal of medical Internet research
JF - Journal of medical Internet research
IS - 3
M1 - e15032
ER -