Tuesday, February 24, 2015

Methodology Decisions and Schools "Beating the Odds"


Well this is just fascinating!

New REL Report Demonstrates How Methodology Decisions Can Affect What Schools are Identified as Beating the Odds

A number of states and school districts have identified schools that perform better than expected given the populations they serve in order to recognize these schools or to learn from their practices and policies. To identify schools that seem to "beat the odds," states and school districts have adopted various methodological approaches. In partnership with the Beating the Odds Research Alliance, Regional Education Laboratory Midwest used data from Michigan to examine how the selection of statistical methods and technical specifications leads to variation in lists of schools identified as beating the odds.
They found that less than 50 percent of the schools appearing on the list generated by one statistical method also appeared on the list generated by the other method. The study also found that, among three sets of criteria, the selection of academic performance measures made the biggest difference in which schools were selected. Selection of school demographic characteristics made some difference, but whether schools were compared by the grade levels they served or all grade levels were pooled in the sample made little difference.
The findings of this study highlight the importance of careful consideration of the conceptual basis for the selection criteria for beating-the-odds schools, as well as technical decisions in operationalizing these selection criteria.
Read the report at: http://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=353
*****
REL Research Alliances are a type of research-practice partnership in which a group of education stakeholders use data and research to investigate an education problem and choose and test solutions. To learn more about the REL program and research alliances, visit http://ies.ed.gov/ncee/edlabs/.

No comments:

Post a Comment