A Resource for Open Data Users
The Open Civic Data Standards ebook outlines the status of open data standards in several civic domains and lists domains where there is strong potential for developing or defining new open data standards.
Why create Open Civic Data Standards?
We’re a B Corp with a mission to apply geospatial technology, data analysis, and research for civic, social, and environmental impact. We work on projects that range from climate change to public transit and from homelessness to public safety. Almost every project we develop relies, at least in part, on open data. We also developed and continue to operate the open data portal for Philadelphia, OpenDataPhilly, and we share much of our work by releasing our software under open source licenses. We want to encourage and cultivate broad use of open data, open source, open standards, and open algorithms, because we believe it results in better, more functional communities.
Why Do Open Data Standards Matter?
Data analysis and visualization are important advocacy tools and have been used to help nonprofits acquire funding and government agencies choose priority locations for programming. For these projects to take place, one needs access to open data – but access to data that follows a standard formatting methodology is even better.
Open data is more value when it is formatted according to specified standards. Standardizing open data can improve data quality, compatibility with existing applications, and comparisons of data by location. When combined with open source applications, open data standards support the development of an ecosystem of tools that can be used in several locations.
Success Stories
Since 2005, the General Transit Feed Specification (GTFS) has become the common language for transit. Currently, over 700 agencies worldwide have adopted the GTFS standard for reporting public transit schedules. Open source software like OpenTripPlanner uses GTFS and OpenStreetMap data to enable journey planning and routing. The Network Analyst extension for Esri ArcMap also incorporates GTFS data for transit routing. While mainly used for trip planning, GTFS data can also be used for data visualization and maps, measures of accessibility, and timetable creation.
Local Inspector Value Entry Specification (LIVES) was developed by Code for America in cooperation with Yelp and the City of San Francisco to enable municipalities to publish restaurant inspection information to Yelp. According to Yelp, 20 municipalities have LIVES feeds, to date. The fact that this standard integrates with Yelp, means that the public has easy access to restaurant health score data in the cities that have adopted the standard.
Criteria for Selecting Standards
This report is organized into two sections, one for standards that have been released and are in use in at least a few cities, and a second section for potential new standards.
The criteria used to select the standards includes the following:
- Location-based – We’re a geospatial analysis and visualization company, so we focused on standards that have a location component; that turns out to not limit us very much, as the vast majority of data being released by governments has a location component to it.
- Published standard – Documentation for the specification has been published and is available online.
- Machine-readable – Based on JSON, CSV, XML, or similar structure that can be consumed by software in a consistent, organized way.
- Focus on Cities – Standards for data commonly used by cities that facilitate improved civic processes.
- Adoption – Adopted by at least one large city or heavily used by an aggregator of civic data.
What Can You Do to Support Open Data Standards?
There are several ways you can support open data standards.
- Explore the open data portal for your city. If you see open data that is not published to a standard, use the contact information provided on the open data portal to notify the team or contact the government department that manages data efforts.
- Contact the Open Data Officer for your city to learn about the ways that open data standards are being used in your region. You can find lists of Open Data Officers and open data repositories in the OpenDataVote Guide (more below).
- Coordinate with local open data advocates to encourage your government to publish open data by running your own OpenDataVote. Read the OpenDataVote Guide for step by steps instructions!
- Find your local elected officials and contact them to tell them about the importance of supporting open data standards.
- Use open data that is published with a standard in a civic hacking project. Build tools that utilize open data standards – prove their utility!
- Contribute to OpenStreetMap through the iD Editor, Humanitarian OpenStreetMap Team Tasking Manager, or at a Missing Maps Mapathon. OpenStreetMap uses several open data standards to provide a free and collaborative map of the world. Join our HOTLunch initiative to volunteer for these impactful nonprofits!
View and Contribute
Read the Open Civic Data Standards ebook, view the source code, and contribute to this open source effort by submitting issues or pull requests to the Github repository.