Toward Comprehensive and Multi-Modal Performance Evaluation

One of planners’ most important jobs is to help develop the indicators and frameworks use to define problems and evaluate potential solution. Often, a particular solution will seem cost effective and beneficial when evaluated one way, and wasteful and undesirable if evaluated another. It is important that we help develop comprehensive evaluation frameworks that effectively inform decisions.

7 minute read

November 27, 2012, 4:45 AM PST

By Todd Litman


One of planners’ most important jobs is to help develop the indicators and frameworks use to define problems and evaluate potential solution. Often, a particular solution will seem cost effective and beneficial when evaluated one way, and wasteful and undesirable if evaluated another. It is important that we help develop comprehensive evaluation frameworks that effectively inform decisions.

I was reminded of this when reviewing the U.S. Bureau of Transportation Statistic’s recently released National Transportation Statistics Report, which provides various bits of information about the U.S. transportation system. It is old-school, reflecting the assumption that our primary transportation problem is congestion delay. Of the nine tables in the Physical Performance section, four reflect air travel cancellations and delays, one reflects air travel baggage losses, and four are based on the Texas Transportation Institute’s congestion cost estimates.

What’s wrong with the BTS’s current approach? First, assumes that there are only two important modes of personal travel (commercial air and motor vehicle), that our main goal is to travel faster, and our main problem is that we are too often delayed. There is no consideration of other modes, goals or performance indicators such as availability, comfort and affordability. All congestion cost estimates are based on the Texas Transportation Institute’s calculations, without mentioning their weaknesses and biases, as discussed in a previous column, Toward More Comprehensive Understanding of Traffic Congestion.

Congestion is actually a modest cost overall. For example, the TTI’s most recent Urban Mobility Report estimates that in 2010 U.S. congestion caused 4.8 billion person-hours of delay and 1.9 billion gallons of additional fuel consumption, valued at $101 billion, this only averages 15.5 hours, 6.2 gallons and $327 per capita. The TTI methodology uses an unrealistic freeflow baseline speed (it assumes that all roads should always have level-of-service A; most economists argue that level-of-service C or D is actually more optimal under urban-peak conditions) and high travel time unit costs (they assume that congestion delay is worth $16.30/hr, although in practice, few motorists are willing to pay that much for incremental time savings), which bias their estimates upward. Applying more realistic analysis would reduce estimated congestion cost to approximately $110 per capita. This compares with about $4,000 in vehicle costs, $1,500 in crash damages, more than $1,000 in vehicle parking costs, $400 in roadway costs and $357 in environmental costs per capita.

Automobile dependency and sprawl tend to increase transport costs far more than traffic congestion, as discussed in Joe Cortright's report, Driven Apart: How Sprawl is Lengthening Our Commutes and Why Misleading Mobility Measures are Making Things Worse. For example, the TTI indicates that in 2010 Washington D.C. automobile commuters experience 74 average annual hours of congestion delay, but since only 43% of commuter in that region drive, this averages just 32 hours per commuter overall. In contrast, Houston automobile commuters experience 57 annual hours of delay, but since that region has a 88% auto mode share this averages 50 hours per commuter overall, much higher than Washington D.C. Cities with high quality public transit, such as New York, Boston and San Francisco, rate much better when congestion is measured per commuter rather than automobile commuter due to their low auto mode shares.

The TTI estimates that in the largest U.S. cities congestion causes 34 annual hours of delay and 16.5 gallons of additional fuel consumed per commuter. In contrast, according to analysis described in my report, Smart Congestion Relief, residents of automobile-dependent regions, who average more than 30 daily miles of vehicle travel, spend an estimated 104 additional hours and 183 additional gallons of fuel compared with more compact, multi-modal regions where residents average fewer than 20 daily vehicle-miles. This suggests that policies which stimulate sprawl impose more than three times the total cost as traffic congestion.

Fortunately, more comprehensive and multi-modal evaluation tools are now available for evaluating transportation system performance. For example, the Florida Department of Transportation’s new report, Expanded Transportation Performance Measures to Supplement Level of Service (LOS) for Growth Management and Transportation Impact Analysis critically evaluates current transport system performance indicators such as Roadway Level of Service (LOS) and identifies and evaluates more multi-dimensional and multi-modal transport system performance indicators. The report summarizes various examples from Florida cities that apply multi-modal transport system performance evaluation, and provides guidance for selecting and applying them in a particular situation.

Another approach is the National Association of Regional Council’s Livability Literature Review: A Synthesis Of Current Practice recently published by the U.S. Department of Transportation. It examines ways to define and evaluate livability and sustainability, and how they relate to various current planning concepts including smart growth, complete streets, lifelong communities, safe routes to schools, context sensitive solutions/design, new urbanism, transit-oriented development and placemaking. It provides a foundation for applying more comprehensive community planning, including more accessible development and multi-modal transport planning.

The New York City Department of Transportation’s very attractive report, Measuring the Street: New Metrics for 21st Century Streets discusses ways to evaluate urban street performance. It describes various urban street planning goals, strategies (specific ways to achieve goals) and metrics (specific ways to measure progress toward goals), as summarized in the following table:

-----------------------------------------------------------------------------------

Goals

Strategies

Metrics

Safety

Accommodate all users

Create great public spaces

Design safe streets

Build great public spaces

Improve bus service

Reduce delay and speeding

Efficiently manage parking and loading

Motorist, pedestrian, and cyclist crashes and injuries

Vehicle, bus passenger, bicycle rider, and public space user volumes

Traffic volumes

Travel speeds

Traffic speeds (not too slow, but not too fast)

Economic vitality (retail sales, building vacancies, visitors)

Bus ridership and travel speeds

User satisfaction

Environmental and public health quality

Double parking and parking duration

-----------------------------------------------------------------------------------

These reports reflect different perspective in multi-dimensional and multi-modal transport system performance evaluation. The Florida DOT study is very comprehensive and technical. It describes a large number of possible indicators and how they are applied in specific jurisdictions. The NARC report is intended for planners and public officials who want support and guidance for more comprehensive analysis that integrates various planning innovations. The New York DOT’s report is intended for a general audience, and so describes a very limited indicator set, and highlights the city’s successes with little critical analysis.

I have a few specific concerns about these documents. The Florida and NYC reports refer to sustainability, livability and accessibility without clearly defining the terms. Some goals and objectives (strategies) overlap. For example, some indicator sets tend to overweigh congestion impacts by including congestion reduction, improved freight transport and improved travel reliability objectives, while others overweigh energy consumption impacts by including energy conservation, local emission reductions, global emission reductions, and environmental quality. It is important to recognize how such double-counting can bias evaluation results.

Another concern is the poor way these indicators address social objectives such as affordability, basic mobility for non-drivers, and improved public health. These are all implied as goals, but I don’t think they are as well articulated or measured as economic objectives (congestion reduction, improved freight transport, agency cost efficiency, etc.) and environmental objectives (energy conservation, emission reductions, habitat preservation, etc.). This area needs more research and guidance.

To end on a positive note, I was delighted by the recent President's Message in last month's ITE Journal by Rock E. Miller in which he explains, “One of my career highlights has been working in our profession long enough to see urban areas throughout North America begin to look at walking and bicycling as valid forms of transportation.” Way to go, Rock! Our profession increasingly recognizes the important roles that walking, cycling and public transport play in an efficient, equitable and healthy transport system.

What do you think?

For More Information

Robert L. Bertini (2005), You Are the Traffic Jam: An Examination of Congestion Measures, Department of Civil & Environmental Engineering, Portland State University.

Joe Cortright (2010), Driven Apart: How Sprawl is Lengthening Our Commutes and Why Misleading Mobility Measures are Making Things Worse, CEOs for Cities.

Richard Dowling, et al. (2008), Multimodal Level Of Service Analysis For Urban Streets, NCHRP Report 616, Transportation Research Board.

FDOT (2012), Expanded Transportation Performance Measures to Supplement Level of Service (LOS) for Growth Management and Transportation Impact Analysis, Florida Department of Transportation.

Todd Litman (2011), Smart Congestion Relief: Comprehensive Analysis Of Traffic Congestion Costs and Congestion Reduction Benefits, Victoria Transport Policy Institute.

Todd Litman (2012), Toward More Comprehensive and Multi-modal Transport Evaluation, Victoria Transport Policy Institute.

Todd Litman (2012), Evaluating Complete Streets: The Value of Designing Roads For Diverse Modes, Users and Activities, Victoria Transport Policy Institute.

NARC (2012), Livability Literature Review: A Synthesis Of Current Practice, National Association of Regional Councils and the U.S. Department of Transportation.

NYCDOT (2012), Measuring the Street: New Metrics for 21st Century Streets, New York City Department of Transportation.


Todd Litman

Todd Litman is founder and executive director of the Victoria Transport Policy Institute, an independent research organization dedicated to developing innovative solutions to transport problems. His work helps to expand the range of impacts and options considered in transportation decision-making, improve evaluation methods, and make specialized technical concepts accessible to a larger audience. His research is used worldwide in transport planning and policy analysis.

Sweeping view of Portland, Oregon with Mt. Hood in background against sunset sky.

Oregon Passes Exemption to Urban Growth Boundary

Cities have a one-time chance to acquire new land for development in a bid to increase housing supply and affordability.

March 12, 2024 - Housing Wire

Aerial view of green roofs with plants in Sydney, Australia.

Where Urban Design Is Headed in 2024

A forecast of likely trends in urban design and architecture.

March 10, 2024 - Daily Journal of Commerce

Cobblestone street with streetcar line, row of vintage streetlights on left, and colorful restaurant and shop awnings on right on River Street in Savannah, Georgia.

Savannah: A City of Planning Contrasts

From a human-scales, plaza-anchored grid to suburban sprawl, the oldest planned city in the United States has seen wildly different development patterns.

March 12, 2024 - Strong Towns

Aerial View of Chuckanut Drive and the Blanchard Bridge in the Skagit Valley.

Washington Tribes Receive Resilience Funding

The 28 grants support projects including relocation efforts as coastal communities face the growing impacts of climate change.

March 18 - The Seattle Times

Historic buildings in downtown Los Angeles with large "Pan American Lofts" sign on side of building.

Adaptive Reuse Bills Introduced in California Assembly

The legislation would expand eligibility for economic incentives and let cities loosen regulations to allow for more building conversions.

March 18 - Beverly Press

View from above of swan-shaped paddleboats with lights on around artesian fountain in Echo Park Lake with downtown Los Angeles skylien in background at twilight.

LA's Top Parks, Ranked

TimeOut just released its list of the top 26 parks in the L.A. area, which is home to some of the best green spaces around.

March 18 - TimeOut

News from HUD User

HUD's Office of Policy Development and Research

Call for Speakers

Mpact Transit + Community

New Updates on PD&R Edge

HUD's Office of Policy Development and Research

Write for Planetizen

Urban Design for Planners 1: Software Tools

This six-course series explores essential urban design concepts using open source software and equips planners with the tools they need to participate fully in the urban design process.

Planning for Universal Design

Learn the tools for implementing Universal Design in planning regulations.