Survey Design, Sampling & Instrument Development
Quantitative Data Analysis
Survey Design and Sampling
IMPAQ conducted two studies for the Beating the Odds/School Turnaround Research Alliance of the Midwestern Regional Educational Laboratory. These included:
- Performing an applied research study to examine and compare methods of identifying schools that outperform expectations based on demographics;
- Developing and validating a survey that can be administered to teachers to measure school practices associated with high performance. We also produced a paper for districts and schools on administration and use of this survey.
The main goal was to support the Michigan Department of Education and other states with similar turnaround goals, to help them identify and publicize these schools, learn about successful practices, and inform future policy.
We compared several models for selecting schools that “beat the odds.” This included comparing results when samples, outcome measures, and demographic control variables varied. We also developed a survey of practices associated with high performance, using methods that included literature review, cognitive interviewing, and survey validation using both classical test theory and item response theory.
This project drew on our experience with educational research and policy; our past work with Regional Educational Laboratories; and our expertise in quantitative methods, survey design and validation, and research-to-practice. The senior education researchers working on this project brought many years of experience in education policy, statistical methods, survey research, and psychometrics.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Midwest. (2015). How Methodology Decisions Affect the Variability of Schools Identified as Beating the Odds. (REL 2015–071). Washington, DC: Abe, Y., Weinstock, P., Chan, V., Meyers, C., Gerdeman, R. D., & Brandt, W. C.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Midwest. (2016). How to Use the School Survey of Practices Associated with High Performance. (REL 2016–162). Washington, DC: Abe, Y., Weinstock, P., Yumoto, F., Meyers, C., & Wan, Y.