Research Update: The Current State of Research Use in Education

Since the passage of the No Child Left Behind Act of 2001 (NCLB), there has been an increased focus on using evidence-based practice to improve education and student learning. This movement encourages educators to use instructional strategies backed by scientifically based research—specifically, randomized controlled trials and other types of rigorous research that address questions of effectiveness. Educators are also encouraged to use student and other types of data to guide decisions. In short, educators are being asked to do “what works.”

Because of the increased demand for evidence-based practices in education, the amount of rigorous education research has increased. Taking the next step, researchers have now begun looking at educators’ use of this research. Specifically, researchers are examining the circumstances under which educators use evidence, what factors encourage and discourage the use of evidence, and how to create a school environment conducive to the use of evidence.

What Encourages and Discourages the Use of Evidence

Educators have reported a number of factors that influenced whether they were likely to use research. The factors listed here, although not comprehensive, include those mentioned in several research studies or literature reviews.

Availability of High-Quality Evidence. Although a large volume of education research reports has been produced since the passage of NCLB, educators reported that only a small proportion of the studies used rigorous research designs like randomized controlled trials or quasi-experimental designs. As a result, educators found little high-quality evidence to guide instructional practices (Hayward & Phillips, 2009; Nelson, Leffler, & Hansen, 2009).

Relevance and Ease of Implementation. Many educators expressed a desire for research studies that applied to their specific situation. In a number of studies, educators reported they were more likely to use research findings if they thought they could apply them directly to their work (Honig & Coburn, 2008; Nelson et al., 2009).

Timeliness of Research. Some educators expressed concerns about the timeliness in which research findings are disseminated. While research studies may take years to complete, these educators felt the pressure to begin using evidence-based instructional strategies and decisions in a much shorter timeframe (Honig & Coburn, 2008; Nelson et al., 2009).

Time Constraints. Educators reported that a lack of time in their busy schedules was a factor in whether they used research evidence. One literature review of evidence-based decision making concluded that “the sheer volume of [administrators’] responsibilities combined with limited time for accomplishing them . . . seems to significantly curb evidence use” (Honig & Coburn, 2008, p. 598; Nelson et al., 2009).

Biases and Incentives. Personal biases and incentives also played a role. For example, many educators stated they were more likely to believe a research report if it conformed to their personal experiences. Educators also reported that they needed an incentive before they would find the time to access evidence. Some studies found that educators only were willing to adopt a new practice, including one that was evidence based, if they were dissatisfied with their current practice (Millar & Osborne, 2009). Other studies found that educators often had ulterior motives in using research: for example, they had a program or practice they already wanted to use and were looking for evidence to support it (Honig & Coburn, 2008).

How Educators Use Research

The barriers to using evidence can paint a discouraging picture, but many educators are in fact accessing research and adopting or facilitating the adoption of evidence-based practices. Educators’ use of research occurs within a specific context and as part of a larger process. In the classroom, research is just one of many factors that influence a teacher’s decisions and practices. Other factors include teachers’ knowledge of their content area, how it is taught, curriculum and standards, and available resources. Such myriad factors form the context in which educators use evidence. For example, educators often modify innovations to fit their setting and the practices with which they are familiar (Millar & Osborne, 2009; Norris, Phillips, & Macnab, 2009). As one report concluded, “Research is more likely to be adapted than adopted” (Nutley, Walter, & Davies, 2007, p. 303). Yet the question of the effectiveness of such adaptations remains.

What a Researcher-Practitioner Partnership Looks Like

SEDL has a rich history of helping educators identify and implement evidence-based practices.

• We guide schools and districts in adopting the Professional Teaching and Learning Cycle, an ongoing, job-embedded professional development approach in which teachers collaborate to plan and implement standards-based lessons. “Using Data” on page 10 describes this process.
• Through the Early Warning System Tool and Response to Intervention, we are helping educators collect and analyze student data. See stories on pages 6 and 10 for more details.
• We are conducting regional and national randomized controlled trials of literacy and math programs, including Imagine It! and Everyday Math.

Acknowledging these findings, many studies describe educators’ implementation of evidence-based practices as a dynamic process rather than a single act. “Research can make a difference when teachers integrate new ideas or approaches into practice and then reflect on their own experiences to abstract and construct new understandings,” observes one author. Evidence suggests that professional development sessions give educators the opportunity to try new practices and collaborate with colleagues as they reflect on the outcomes (Butler & Schnellert, 2008, p. 38).

Some studies have begun to place educators’ use of evidence within the larger organizational change process. The decision to adopt a particular program is often made at the school, district, or state level, yet it is often up to the individual to implement research. Whether this happens depends on the organizational culture since barriers to using evidence often exist at the organizational level. It is up to the school or district to create a culture that promotes the use of evidence-based practices (Hemsley-Brown & Sharp, 2003; Nutley, Jung, & Walter, 2008).

Redefining the Researcher-Practitioner Relationship

In light of this information, researchers, educators, and policymakers are re-examining the researcher-practitioner relationship. Calls for greater collaboration between researchers and practitioners are encouraging researchers to seek educators’ input early on to ensure that researchers are addressing relevant research questions and communicating findings in a way that practitioners can use.

Another emerging trend is the role of third-party organizations in helping educators connect research and practice. These organizations employ several strategies to help educators use evidence-based practices: They survey the broad range of research findings; present findings in shorter, user-friendly formats; help educators identify emerging issues; and build their capacity to collect, analyze, and interpret data. A number of educators report that they access information about evidence-based practices through trusted colleagues, conferences, professional development sessions, and professional membership organizations and publications (Honig & Coburn, 2008; Nelson et al., 2009; Hemsley- Brown & Sharp, 2003; Levin, 2004; Cooper, Levin, & Campbell, 2009).

As policymakers, researchers, and educators continue to negotiate the best way to connect research and practice, there are many indications that evidence-based practice will continue to play a crucial role in education. Just as educators and other stakeholders learn from the growing body of evidence, they are learning from the growing number of studies on effective dissemination practices.

Bibliography

• Butler, D. L., & Schnellert, L. (2008, November). Bridging the research-to-practice divide: Improving outcomes for students. Education Canada 48(5), 36–40.
• Cooper, A., Levin, B., & Campbell, C. (2009). The growing (but still limited) importance of evidence in education policy and practice. Journal of Educational Change, 10(2–3), 159–171.
• Hayward, D. V. & Phillips, L. M. (2009). Considering research quality and applicability through the eyes of stakeholders. In M. C. Shelley, II, L D. Yore, & B. Hand (Eds.), Quality research in literacy and science education: International perspectives and gold standards (pp. 139–148). New York: Springer.
• Hemsley-Brown, J. V., & Sharp, C. (2003). The use of research to improve professional practice: A systematic review of the literature. Oxford Review of Education, 29(4), 449–471. doi:10.1080/0305498032000153025
• Honig, M., & Coburn, C. (2008). Evidence-based decision making in school district central offices: Toward a policy and research agenda. Educational Policy, 22(4), 578–608.
• Levin, B. (2004). Making research matter more. Education Policy Analysis Archives, 12(56). Retrieved from http://epaa.asu.edu/ojs/article/view/211
• Millar, R., & Osborne, J. (2009). Research and practice: A complex relationship? In M. C. Shelley, II, L. D. Yore, & B. Hand (Eds.), Quality research in literacy and science education: International perspectives and gold standards (pp. 41–59). New York: Springer.
• Nelson, S. R., Leffler, J. C., & Hansen, B. A. (2009). Toward a research agenda for understanding and improving the use of research evidence. Portland, OR: Northwest Regional Educational Laboratory. Retrieved from http://educationnorthwest.org/resource/694
• Norris, S. P., Phillips, L. M., Macnab, J. S. (2009). The gold standard and knowing what to do. In M. C. Shelley, II, L D. Yore, & B. Hand (Eds.), Quality research in literacy and science education: International perspectives and gold standards (pp. 603–620). New York: Springer.
• Nutley, S., Jung, T., & Walter, I. (2008). The many forms of research-informed practice: A framework for mapping diversity. Cambridge Journal of Education, 38(1), 53–71.
• Nutley, S. M., Walter, I., & Davies, H. T. O. (2007). Using evidence: How research can inform public services. Bristol, UK: The Policy Press.

Next Article: Reading the Warning Signs - Using Research to Prevent High School Dropouts in Texas