Evidence-Based Policy

Evidence-based policy is based on the idea of evidence-based medicine; it is the idea that public policy shall be informed by scientific evidence. Research has proven that evidence-based policy can save lives and have a significant impact on societal outcomes. While the concept is logical and straightforward, it is quite complex to implement. Policymaking is often a lengthy and complicated process. A government may be tasked with implementing a policy; however, the level to which this is driven by research evidence varies among territories and jurisdictions. For more effective use of evidence-based policy, which can benefit health and social outcomes, more dialogue is necessary between researchers and policymakers. Researchers must have a solid understanding of the policymaking environment and the people involved as well as their priorities. Many times, research plays a part in policymaking; however, evidence is not the main driver of policy. Research evidence may be perceived by policymakers as being inapplicable, poorly timed, or obscure.

93787610-107017.jpg93787610-107016.jpg

Brief History

The idea of evidence-based policy comes from evidence-based medicine, which is decision-making based on empirical evidence from well-designed and high-quality research. There are different types of scientific studies, with the strongest types eliciting strong recommendations. Strong studies include randomized controlled trials, meta-analyses, and systematic reviews. Weaker studies, such as case control studies, provide weak recommendations. These were originally medical terms used for making determinations about individual patients; however, they were quickly expanded to policies for groups of patients and populations. Evidence-based medicine is used throughout health care and other fields.

Public policy is a complex, ever-evolving, and interactive system in which societal problems are identified, analyzed, and addressed by creating new policies or reforming old ones. An example of evidence-based policy in action in the United States is Pay for Success, an innovative program that helps to gather more resources for welfare initiatives through private investors who carry the upfront costs of the selected programs. If a program successfully provides services which significantly improve the lives of the target population, then the government repays the investors. However, if the program does not deliver significant results, the investors are not repaid. This ensures taxpayer dollars are spent only on programs that get results.

By the 2020s, particularly after the declaration of the global COVID-19 pandemic in 2020, the United Kingdom's government renewed an emphasis on the importance of evidence-based policymaking. In 2021, the Evaluation Task Force formed to ensure that evidence would inform government decisions, particularly in terms of spending policies. Similarly, other countries across the world had launched or strengthened existing initiatives around implementing systematic evidence-based decision-making.

Overview

Evidence-based policy is characterized by the following methodology:

  • There is a measurement of the impact.
  • Both direct and indirect effects of the policy are examined.
  • There is a counterfactual analysis: What would be the outcome if the policy were not implemented?
  • It examines why the policy will be effective and what end outcomes to expect when it is successful.
  • It can be tested and reproduced by a third party.
  • Outside variables and uncertainties whose influences may affect the desired outcome of the policy are accounted for and controlled.

There are different ways of measuring the net payoff of a specific policy. Depending on the policy and stakeholders, the ability to pinpoint, with accuracy, the exact effect of the policy may be difficult; in these circumstances, researchers and policymakers may choose to look at whether overall benefits outweigh the costs.

Linking evidence with policy is a complex and multivariable effort. It is also context specific, in that what works in one setting may not work in another. Researchers who study policy have concluded that tools that work in mathematical, financial and scientific studies, such as cost–benefit analyses, project management tools, and logical frameworks, often do not work on their own and do not adapt to the complexity that characterizes evidence-based policy. Therefore, strategies to translate evidence into policy are often not straightforward. To improve turning evidence-based research into policy, researchers have concluded four things must be in place: (1) better presentation and marketing of research findings, (2) an increase in technical knowledge of policymakers, (3) the establishment of groups and networks to help link evidence with policy outcomes, and (4) the effective use of social networks.

There are several challenges in implementing evidence-based findings into policy. The first major challenge is the policy process itself: policymaking often involves many stages and varying lengths of time. The second challenge is policymakers themselves: policymakers are not scientists and often do not have the foundational knowledge to interpret the findings. Further complicating matters are other variables such as secrecy, time constraints, and politics. Another challenge is a need for the clear picture of the entire situation. Those responsible for selling the solution must have many skills to influence the outcome. They must be great storytellers to convey the importance of research findings and its positive impact when implemented; they must be good at networking with all parties involved; they must be good engineers/program managers to manage the implementation; and they must be talented with people and able to navigate political situations. Finally, there must be a team approach toward championing evidence-based policy. This is quite different from the academic mindset a researcher is accustomed to. The policy promoter may be a person or department. This individual or group must turn their focus to engaging with the policy community, creating multidisciplinary teams, learning new skills, and developing new systems.

Bibliography

Cartwright, Nancy, and Jeremy Hardie. Evidence-based Policy: A Practical Guide to Doing It Better. Oxford UP, 2012.

Center for Evidence-Based Policy, centerforevidencebasedpolicy.org. Accessed 31 July 2024

Liverani, M., et al. "Political and Institutional Influences on the Use of Evidence in Public Health Policy. A Systematic Review." PLoS One, vol. 8, no. 10, 2013, doi:10.1371/journal.pone.0077404. Accessed 31 July 2024.

Moat, K. A., et al. "How Contexts and Issues Influence the Use of Policy-Relevant Research Syntheses: A Critical Interpretive Synthesis." The Milbank Quarterly, vol. 91, no. 3, 2013, pp. 604–48, doi:10.1111/1468-0009.12026. Accessed 31 July 2024.

Naude, C. E., et al. "Research Evidence and Policy: Qualitative Study in Selected Provinces in South Africa and Cameroon." Implementation Science, vol. 10, 2015, doi:10.1186/s13012-015-0315-0. Accessed 31 July 2024.

Pawson, Ray. Evidence-Based Policy: A Realist Perspective. Sage, 2006.

Pawson, Ray. The Science of Evaluation: A Realist Manifesto. 1st ed. Sage, 2013.

"Pay for Success: An Opportunity to Find and Scale What Works." The White House, obamawhitehouse.archives.gov/administration/eop/sicp/initiatives/pay-for-success. Accessed 31 July 2024.

Sayer, R. Andrew. Realism and Social Science. Sage, 2000.

Vagnoni, Cristiana. "Research Evidence in Policy-Making: Increasing Demand, Publication Speed and Public Scrutiny." UK Parliament, 29 Apr. 2021, post.parliament.uk/research-evidence-and-policy-making-increasing-demand-publication-speed-and-public-scrutiny/. Accessed 31 July 2024.

Wichmann, Caroline. "Evidence-Based Policymaking: New Study on International Perspectives and Best-Practice Models." Phys.org, 12 Dec. 2023, phys.org/news/2023-12-evidence-based-policymaking-international-perspectives-best-practice.html. Accessed 31 July 2024.