TY - JOUR
T1 - The 9-criteria evaluation framework for perceptions survey
T2 - the case of VA’s Learners’ Perceptions Survey
AU - Kashner, T. Michael
AU - Clarke, Christopher T.
AU - Aron, David C.
AU - Byrne, John M.
AU - Cannon, Grant W.
AU - Deemer, David A.
AU - Gilman, Stuart C.
AU - Kaminetzky, Catherine P.
AU - Loo, Lawrence K.
AU - Li, Sophia
AU - Wicker, Annie B.
AU - Keitz, Sheri A.
N1 - Publisher Copyright:
©, This work was authored as part of the Contributor's official duties as an Employee of the United States Government and is therefore a work of the United States Government. In accordance with 17 U.S.C. 105, no copyright protection is available for such works under U.S. Law.
PY - 2020/1/1
Y1 - 2020/1/1
N2 - For its clinical, epidemiologic, educational, and health services research, evaluation, administrative, regulatory, and accreditation purposes, the perceptions survey is a data collection tool that asks observers to describe perceptions of their experiences with a defined phenomenon of interest. In practice, these surveys are often subject to criticism for not having been thoroughly evaluated before its first application using a consistent and comprehensive set of criteria for validity and reliability. This paper introduces a 9-criteria framework to assess perceptions surveys that integrates criteria from multiple evaluation sources. The 9-criteria framework was applied to data from the Department of Veterans Affairs’ Learners’ Perceptions Survey (LPS) that had been administered to national and local samples, and from findings obtained through a literature review involving LPS survey data. We show that the LPS is a robust tool that may serve as a model for design and validation of other perceptions surveys. Findings underscore the importance of using all nine criteria to validate perceptions survey data.
AB - For its clinical, epidemiologic, educational, and health services research, evaluation, administrative, regulatory, and accreditation purposes, the perceptions survey is a data collection tool that asks observers to describe perceptions of their experiences with a defined phenomenon of interest. In practice, these surveys are often subject to criticism for not having been thoroughly evaluated before its first application using a consistent and comprehensive set of criteria for validity and reliability. This paper introduces a 9-criteria framework to assess perceptions surveys that integrates criteria from multiple evaluation sources. The 9-criteria framework was applied to data from the Department of Veterans Affairs’ Learners’ Perceptions Survey (LPS) that had been administered to national and local samples, and from findings obtained through a literature review involving LPS survey data. We show that the LPS is a robust tool that may serve as a model for design and validation of other perceptions surveys. Findings underscore the importance of using all nine criteria to validate perceptions survey data.
KW - Education
KW - evaluation
KW - perceptions survey
KW - psychometrics
UR - http://www.scopus.com/inward/record.url?scp=85058650693&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85058650693&partnerID=8YFLogxK
U2 - 10.1080/24709360.2018.1553362
DO - 10.1080/24709360.2018.1553362
M3 - Article
SN - 2470-9360
VL - 4
SP - 140
EP - 171
JO - Biostatistics and Epidemiology
JF - Biostatistics and Epidemiology
IS - 1
ER -