Municipal Vaporware: Why NYC's Data Mine is A Data Dump

This morning, Mayor Mike Bloomberg unveiled New York City's long-awaited Big Apps contest. Big Apps seeks to promote the Internet industry in the Big Apple (it's sponsored by the New York City Economic Development Corporation) and make local government more transparent.I've been following the evolution of open data initiatives at the municipal level for about a year now, and was really hoping that New York was going to set the bar for future efforts across the country. It doesn't. In fact it's hard to understand why some notable local tech superstars like investors Fred Wilson and John Borthwick would sign on to such a lame effort.

2 minute read

October 6, 2009, 11:55 AM PDT

By Anthony Townsend


This morning, Mayor Mike Bloomberg unveiled New York City's long-awaited Big Apps contest. Big Apps seeks to promote the Internet industry in the Big Apple (it's sponsored by the New York City Economic Development Corporation) and make local government more transparent.

I've been following the evolution of open data initiatives at the municipal level for about a year now, and was really hoping that New York was going to set the bar for future efforts across the country. It doesn't. In fact it's hard to understand why some notable local tech superstars like investors Fred Wilson and John Borthwick would sign on to such a lame effort.

First of all, the prize structure doesn't make sense. First prize is $5,000 and dinner with Bloomie himself. No commitment to fund, adopt, promote or license the app for citywide use. People that build city apps want to engage the public and the investor community, not the city's political elite. I bet they'd rather have dinner with Andrew Raisej.

Second, despite the fact that the project is primarily aimed at stimulating new business development (it's coming from the econ dev folks) the rules require all entrants to grant the city a one-year license to distribute the app freely. So anyone thinking of building a paid iPhone app, you're shit out of luck.

Finally, and most importantly, the NYC Data Mine that is supposed to be the raw materials for these apps, is more of an NYC Data Dump than anything else. Browsing through the 100+ datasets posted this afternoon to the city's site, you see that about half are just boundary shapefiles easily downloaded or licensed through existing channels. The other half are a dog's breakfast of static datasets (New! Updated monthly!) in every format from Excel to Access to (gag!) SAS. Hello, people, its 2009. API+XML FTW! Just to take one example, I can't wait to see what fascinating mashups stem from the historic release of the Department of Consumer Affairs' list of licensed electronic shops. Because what the world is really lacking is more information about the location of electronics retailers. What this Data Dump looks like is the collected attachments received in reponse to the poor bureaucrat who had to twist every department's arms for one dataset, so the city could say every department contributed.

As someone who's spent time brainstorming with government agencies about open data ecosystems, I'm saddened to see that the city has engineered this program for maximum political impact, minimal risk and mediocre innovation. It's municipal vaporware.

p.s. Guys, you forgot to the the website URL in your press release. p.p.s The one cool thing they did was used Challenge Post to host the site. Thanks BetaWorks!


Anthony Townsend

Anthony has been researching the implications of new technology on cities and public institutions for over a decade. As Research Director at the Institute for the Future (IFTF) in Palo Alto, California, Anthony's work focuses on several inter-related topics: pervasive computing, the urban environment, economics and demographics, public and nonprofit organizations, and the media industry.

portrait of professional woman

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching. Mary G., Urban Planner

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching.

Mary G., Urban Planner

Cover CM Credits, Earn Certificates, Push Your Career Forward

Logo for Planetizen Federal Action Tracker with black and white image of U.S. Capitol with water ripple overlay.

Planetizen Federal Action Tracker

A weekly monitor of how Trump’s orders and actions are impacting planners and planning in America.

June 11, 2025 - Diana Ionescu

Rendering of Shirley Chisholm Village four-story housing development with person biking in front.

San Francisco's School District Spent $105M To Build Affordable Housing for Teachers — And That's Just the Beginning

SFUSD joins a growing list of school districts using their land holdings to address housing affordability challenges faced by their own employees.

June 8, 2025 - Fast Company

Yellow single-seat Japanese electric vehicle drivign down road.

The Tiny, Adorable $7,000 Car Turning Japan Onto EVs

The single seat Mibot charges from a regular plug as quickly as an iPad, and is about half the price of an average EV.

June 6, 2025 - PC Magazine

People riding bicycles on separated bike trail.

With Protected Lanes, 460% More People Commute by Bike

For those needing more ammo, more data proving what we already knew is here.

1 hour ago - UNM News

Bird's eye view of half-circle suburban street with large homes.

In More Metros Than You’d Think, Suburbs are Now More Expensive Than the City

If you're moving to the burbs to save on square footage, data shows you should think again.

3 hours ago - Investopedia

Color-coded map of labor & delivery departments and losses in United States.

The States Losing Rural Delivery Rooms at an Alarming Pace

In some states, as few as 9% of rural hospitals still deliver babies. As a result, rising pre-term births, no adequate pre-term care and "harrowing" close calls are a growing reality.

June 15 - Maine Morning Star