Assessing Research Methodology

Abstract

This paper reports the development and application of a method for evaluating the methodology of social science research. In this study, 11 social scientists rated the methodology of 126 federally sponsored, social science research projects. Written documentation from each research project was divided into three packets, representing three stages of the research process: proposal, interim report, and completed research. Each project was independently rated at each of the three stages by two different reviewers, using a comprehensive methodology review instrument created for this purpose. A series of factor analyses of the ratingsfor 75 evaluative methodological features reveals a multidimensional structure underlying the evaluations. This structure appears to become more elaborate as research progresses toward completion. The implications of the structuring of methodological assessments are discussed for research funding procedures, research monitoring, the conduct of research, and the training of social scientists.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 10 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.