The 9-criteria evaluation framework for perceptions survey: the case of VA’s Learners’ Perceptions Survey

T. Michael Kashner, Christopher T. Clarke, David C. Aron, John M. Byrne, Grant W. Cannon, David A. Deemer, Stuart C. Gilman, Catherine P. Kaminetzky, Lawrence K. Loo, Sophia Li, Annie B. Wicker, Sheri A. Keitz

Research output: Contribution to journalArticlepeer-review

Abstract

For its clinical, epidemiologic, educational, and health services research, evaluation, administrative, regulatory, and accreditation purposes, the perceptions survey is a data collection tool that asks observers to describe perceptions of their experiences with a defined phenomenon of interest. In practice, these surveys are often subject to criticism for not having been thoroughly evaluated before its first application using a consistent and comprehensive set of criteria for validity and reliability. This paper introduces a 9-criteria framework to assess perceptions surveys that integrates criteria from multiple evaluation sources. The 9-criteria framework was applied to data from the Department of Veterans Affairs’ Learners’ Perceptions Survey (LPS) that had been administered to national and local samples, and from findings obtained through a literature review involving LPS survey data. We show that the LPS is a robust tool that may serve as a model for design and validation of other perceptions surveys. Findings underscore the importance of using all nine criteria to validate perceptions survey data.

Original languageEnglish
Pages (from-to)140-171
Number of pages32
JournalBiostatistics and Epidemiology
Volume4
Issue number1
DOIs
StatePublished - Jan 1 2020

ASJC Scopus Subject Areas

  • Epidemiology
  • Health Informatics

Keywords

  • Education
  • evaluation
  • perceptions survey
  • psychometrics

Cite this