The Truth About Creating Policy: It Can't Be Evidence-Based

Research in cognitive sciences is dictating that we can no longer rely on the presentation of scientific facts when building policy.

Read Time: 3 minutes

November 19, 2017, 1:00 PM PST

By Steven Snell @Stevenpsnell

Public Comment

stock_photo_world / Shutterstock

You're up there presenting to council the policy you just developed. You're confident in your baby: it's evidence-based, after all. You probably even wrote that in your report. You did your background research, accumulated and consolidated information. You poured over it and whittled down the data into tight policy statements. You completed what's considered the "problem-oriented approach" to writing policy. There was a gap, a problem. You resolved it. That's what your policy is based on. It's likely a failure.

Recently, a paper in the Policy Sciences journal used research in cognitive sciences to more fully understand the multifaceted nature of developing policy. The authors, Cairney and Weible, convey that the evidence-based approach to policy development does not consider the "too-messy link between cognitive and contextual explanations for action."

We've long understood that there's a limit to what we can research to develop policy. Only recently, state Cairney and Weible, have we begun to draw on social and organizational psychology to understand how emotions act as informational short cuts and coexist with cognition. We're learning the importance of group processes in leveraging emotional decision-making over rational thought.

A policy scientist analyzing the literature in her field of research may understand its various dimensions and produce recommendations based on it, but the myriad contexts, including her own (ir)rationality, in which the policy is contextualized cannot be fully considered. This should be expected. As Cairney and Weible state, "Our value orientations change following interactions with people who reinforce or challenge our beliefs." We frame our research and are led by those principles as we prioritize the goals of our research.

The authors continue: "A policymaker's environment consists of a myriad of actors and factors: multiple policymakers and influencers spread across levels and types of government; the formal and informal institutions that guide their actions at each level; the networks they form; the ideas of beliefs that dominate the ways in which they think about problems and solutions; the biophysical and socio-economic conditions to which they respond; and the events that offer opportunities and shocks."

What's the result? The authors suggest its tempting to assume we know what makes our audience tick, but policy operates in a context outside the influence of any one person; it's influenced by the crowd. There are many ticks. Thus there's a balance between the rational need of evidence and irrational reality of where decisions about policy are made. We should be making "good enough" decisions in our policy prescriptions. We don't need to seek a rationally perfect depiction of reality.

"If people engage emotionally with information, there is no way to appeal to all audiences with the same information." What are the lessons for developing policy? We're storytellers. Policy authors should tell a simple story with a clear moral, be trustworthy and consider the power structures of politics. We should accept that developing policy is ultimately an output of irrationality (read, political). It isn't an objective relay of evidence.

Ultimately, the authors conclude, "the choice is not whether or not to focus on skillful persuasion which appeals to emotion, but how to do it most effectively while adhering to key ethical principles. Generating trust in the messenger and knowing your audience may be more important to success than presenting evidence."

Steven Snell

Steven Snell has over ten years of professional urban planning experience with a focus on conservation policy.

The  Rue Sainte-Catherine in Bordeaux is crowded with pedestrians in a lively European scene.

European Cities Act on Density

The sprawling mass of suburbia has been a disaster for the environment. But now smaller, denser cities herald a renaissance in city living.

November 20, 2022 - Wired Magazine

Victorian two-story buildings with retail shops in downtown Nashvile, Tennessee

Nashville Sets Downtown Parking Maximums

Nashville is the latest city to enact a substantive change to the parking requirements set by the city’s zoning code—doing away with parking minimums and setting parking maximums in the city’s Urban Zoning Overlay.

November 20, 2022 - The Tennessean

Musician playing guitar in front of outdoor seating and sidewalk vendors in Houston, Texas

Houston Development Aims to Create Hyper-Walkable, Micro-Living Neighborhood

The 17-acre Second Ward project has spurred both optimism for a more walkable city and concerns about displacement and gentrification.

November 21, 2022 - Houston Chronicle

Three Lyft electric scooters parked on a sidewalk in West Los Angeles

Lyft Pulls Micromobility From Los Angeles Area

The company will no longer provide shared bikes and scooters in the L.A. region, citing a ‘lack of longterm commitment’ from cities.

November 25 - Santa Monica Daily Press

View of Duwamish River with Seattle and Mount Rainier in background

King County Water Treatment Station Set to Open

The facility is part of a plan to protect the Duwamish River from polluted runoff from overflowing sewer pipes.

November 25 - The Center Square

View of Houston buildings over White Oak Bayou

Proposed Park Yet Another Hurdle for Houston Interstate Expansion

The Interstate 45 widening project, halted by a federal order and opposed by many local officials and organizations, could hit a new snag if White Oak Bayou becomes a city park.

November 25 - Axios

Urban Design for Planners 1: Software Tools

This six-course series explores essential urban design concepts using open source software and equips planners with the tools they need to participate fully in the urban design process.

Planning for Universal Design

Learn the tools for implementing Universal Design in planning regulations.