Well this is just fascinating!
New REL Report Demonstrates How Methodology Decisions Can
Affect What Schools are Identified as Beating the Odds
|
|
A number
of states and school districts have identified schools that perform better
than expected given the populations they serve in order to recognize these
schools or to learn from their practices and policies. To identify schools
that seem to "beat the odds," states and school districts have
adopted various methodological approaches. In partnership with the Beating
the Odds Research Alliance, Regional
Education Laboratory Midwest used data from Michigan to examine how the
selection of statistical methods and technical specifications leads to
variation in lists of schools identified as beating the odds. They found that less than 50 percent of the schools appearing on the list generated by one statistical method also appeared on the list generated by the other method. The study also found that, among three sets of criteria, the selection of academic performance measures made the biggest difference in which schools were selected. Selection of school demographic characteristics made some difference, but whether schools were compared by the grade levels they served or all grade levels were pooled in the sample made little difference. The findings of this study highlight the importance of careful consideration of the conceptual basis for the selection criteria for beating-the-odds schools, as well as technical decisions in operationalizing these selection criteria. Read the report at: http://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=353 ***** REL Research Alliances are a type of research-practice partnership in which a group of education stakeholders use data and research to investigate an education problem and choose and test solutions. To learn more about the REL program and research alliances, visit http://ies.ed.gov/ncee/edlabs/. |
No comments:
Post a Comment