How to Improve the Best Open Data Site?

The World Bank Data initiative has asked for feedback about what we would like to change on their Open Data site.

This is a tough question as I personally think that, for many reasons, they already own the best Open Data site in the world so far. From tons of quality data to great searchdeveloper and visualization tools, as well as a variety of communication, dissemination and training resources. They have even explored places that others still consider inhospitable. It is really difficult to find some room for improvement, anyway, we can make a wish, so here is mine.

A community meeting place at the World Bank Data site

As all we know, just putting data online is not enough to get it used. Efforts on outreach, community building and engagement are always required, as well as designing for participation, allowing multiple kinds of contributions and letting people contribute in multiple ways. Support conversation around the data and join actively that conversation contributing with the World Bank expertise will increase value, connectivity and the overall network impact derived from the ability of participants to affect each other.

Community

This is why my wish is a thematic space where the stakeholder community can join the World Bank in decision making, building skills and make real contributions. Open Data need to be developed by an amazing variety of people with varying interests and incentives. It is not just about government, business, academic and certain institutions, but also about individuals, nonprofits or any other informal group of people that have already proved to be instrumental in its operation and growth. For me this is the only missing piece to complete the Open Data building blocks jigsaw at the World Bank.

I am aware of the great community building stuff that the World Bank has already put in place, as well as apps competitions that challenge developers to come up with prototypes to show data potential or discussion groups to support them. But we need to get further into the Open Data engagement scale and be able to create an ecosystem devoted to lead to useful and sustainable tools or services based on data.

Of course, this is not only about letting everybody play, but also about playing nice and getting others to involve in the game as a unique team. That’s not an easy task and, apart from online tools and resources, will require special leadership, but I am sure that the World Bank can find it within its great staff.

The European Commission steps forward on Open Data and PSI re-use

As so often repeated these days, data is the new fuel for the digital age. Considering the wide spectrum of opportunities Open Data may bring, it is no surprise that the EC plans how to keep shaking up the way public authorities share data. The following lines aim to be an overview of the EC developments so far on Open Data and Public Sector Information, as well as a review of future planned actions.

Logo European Commission

A Landmark Event: Data Workshop at the Digital Agenda Assembly 2011

The EC organized the first Digital Agenda Assembly in June 2011 to discuss advances with regards to the Digital Agenda objectives for Europe. With that aim, twenty-four thematic workshops and two plenary sessions were conducted. One of those events was the Open data and Re-use of Public Sector Information workshop, where different types of stakeholders congregated to collaborate with the Commission on developing its strategy for Open Data in the EU.

Khalil Rouhana (DG Information Society and Media Content & Cognitive Systems of the European Commission) made several key announcements in relation to Open Data policies in the EU during that workshop. We will focus briefly on these in the forthcoming sections.

The role of European Open Data portals

Open Data portals are aimed to be a key referral of the digital infrastructure bound for facilitating access to and re-use of Public Sector Information. Open Data portals have been -and are being- created around many EU Member States at all governmental levels. Given that the quantity of data published so far is relatively limited as compared to that potentially available for publication, the EC plans to publish two new central Open Data portals to facilitate access to European Open Data:

data.gov.eu screenshoot

  • The European Commission Open Data portal data.gov.eu, a portal easing the search for Commission data, as well as other EU institutions, bodies and agencies to citizens and industry. The portal, currently under developement, is expected to be released soon in 2012.
  • Pan-European Open Data portal, to make data from EU, national, regional and local administrations more easily available and re-usable. A prototype is expected to be released in 2013.

Review of the Directive on the Re-use of Public Sector Information

First adopted on November 17, 2003 and by now completely transposed to all member States, this original PSI Directive provided a minimal harmonisation of rules and procedures across the EU in order to facilitate cross-border re-use of the PSI. A proposal for a revision of the Directive, which is currently being discussed by the Union legislator, was presented in December 2011 to further open up the market for services based on PSI by:

  • Including new bodies in the scope of application of the Directive such as libraries, museums and archives.
  • Determining limits on the fees that can be charged by the public authorities at marginal costs.
  • Introducing independent oversight re-use rules in the Member States.
  • Making standard machine-readable formats for information held by public authorities.

Other Meaningful Previous Steps

That first Open Data and PSI workshop was a landmark event both in Open Data and PSI policies in the EU as well as in the way that the EC communicates these policies and interacts with the different stakeholders. Nevertheless, several steps forward were also made by the EC on the Open Data and PSI matters before this first Digital Agenda Workshop, such as:

December 2011: The Communication on Open Data

Following the first Digital Agenda workshop, the Commission adopted a Communication on Open Data by December 2011. In this Communication, the Commission proposes several actions to accomplish the objectives previously announced in the aforementioned DAE workshop:

  • To create a portal site for Commission-held information aiming at an expansion to other EU institutions, bodies and agencies at a later stage.
  • To work with the Member States on data formats and interoperability between existing sites.
  • To create a Pan-European umbrella site linking information held by EU institutions, bodies and agencies and by Member States.

First Update: New Data Workshop at the Digital Agenda Assembly 2012

In June 2012, the Digital Agenda Assembly 2012 housed a new Data Workshop where the European Commission Open Data and PSI roadmap was presented again, mainly:

It is also remarkable to recall the European overall bet for data handling, Open Data and Open Access, not only by Open Data policies and a regulatory strand (PSI Directive), but also by means of research, innovation and ICT deployment pilots and portals implemented through financial support instruments such as the FP7 and CIP-ICT-PSP 2011-13 R&D&I multiple programmes, that are currently almost gone but will have continuity with the new Horizon 2020 programme.

Horizon 2020 logoSome of the questions that lead this Workshop where:

European Data license

There is a strong need to investigate requirements for an European Data License, given that if we want to encourage use and reuse of data across European borders, there may be the need for a single cross-border license. Several questions then arise: Will one of the existing licenses do the job, or do we need a new one? If we do need a license, is there an obvious choice, or is something new required?

Release of Core Data

A first-priority task will be to identify and evangelise Open release of Core Reference Data, given that European Member States have already huge quantities of valuable data. Some of this data is now becoming freely available in certain Member States, but too much of it remains locked up behind odd rules and unsustainable cost-recovery models. It is also difficult to compare data between Member States.

Future Steps

In addition to all the work in progress that has been previously mentioned, and as announced by the Vice President of the Commission Mme Neelie Kroes, the EC also plans to continue developing their European strategy for the publication and reuse of public sector data from European institutions and the Member States, as established with Commission’s commitment to turn public data into business included in action 3 of the Digital Agenda for Europe Communication.

Some highlights of the future planned distributed actions include:

Services for publication, access and reuse of EU Open Public Data

A series of services will be purchased aimed at supporting the EU-wide availability of PSI and Open Data from public bodies at different governmental levels. These services will include:

  • The provision of data preparation, transformation and publication services, with a commitment to publish at least 15.000 new data sets from all EU Member States in machine readable formats, including Linked Open Data technologies.
  • Training services in the area of Open Data, in particular to favour the uptake of Linked Open Data technologies by public bodies within the European Union.
  • Provision of an IT advisory and consultancy service in the area of Open Data, and in particular on Linked Open Data technologies, including specific software development tasks.

The Open Data Reuse Incubator

Financial support instruments will continue to support several Open Data developments, notably, the FP7-ICT Work programme 2013 will help Small and Medium Enterprises (SMEs) to develop innovative applications in structured and unstructured digital content management and, particularly, in the reuse of open data through an Open Data Incubator.

This Incubator will establish an environment to:

  • Solicit open data reuse ideas from the general public and conduct a European wide open data reuse information campaign.
  • Publish and manage regularly scheduled calls for SMEs to submit mini-proposals to be funded for a period between six and twelve months.
  • Create a computing infrastructure where the winning mini-proposals will find accurate and up-to-date versions of the data they need for their services.
  • Establish a mechanism for connecting open data demand and supply by systematically contacting European public bodies for their open data and assisting them in the efficient and sustainable publication of such data.

Harmonization of Open Data initiatives

In response to the increasing clamour in search of harmonising Open Data initiatives, the European Union is financing projects such as “Harmonising Open Data in the Mediterranean through better access and Reuse of Public Sector Information – Homer”, which aims mainly to set up an effective strategy able to harmonise Open data policy and portals across the Mediterranean area, supporting regional and local governments.Homer Logo

New paths for growth

As important as political, structural and educational efforts, uncovering new paths for growth, in which Open Data possibilities about a given topic are explored, is also critical in order for Open Data and PSI re-use to advance. Some Open Data and PSI topics that are currently being explored by the European Commission are:

  • Cultural Data: The EU’s digital libraries initiative sets out to make all Europe’s cultural and scientific resources accessible to all, and preserve them for future generations. In this area it should be pointed out that recent Europeana’s move to CC0 is a step change in open data access, given that releasing data from across EU country sets an important new international precedent and a decisive move away from the world of closed and controlled data.

Europeana

  • Smart Cities: One of the greatest challenges facing the EU is how best to design and adapt cities into smart intelligent and sustainable environments. Smart urban technologies can make a major contribution in tackling urban challenges by breaking down boundaries between the sectors involved, ensuring adaptable and interoperable solutions and finding a way to use data transparently and openly, without breaching privacy.
  • Open Science: The European Commission outlined measures to improve access to scientific information produced in Europe. Broader and more rapid access to scientific papers and data will make it easier for researchers and businesses to build on the findings of public-funded research, boosting Europe’s innovation capacity and give citizens quicker access to the benefits of scientific discoveries. The Commission will make open access to scientific publications a general principle of Horizon 2020, the EU’s Research & Innovation funding programme for 2014-2020.

Networking, awareness raising and Dissemination

As seen from the last Digital Agenda Assembly Open Data conclusions above, networking, awareness raising, dissemination and outreach activities are considered key elements for the Open Data and PSI re-use market success at the EU. Complementary to legislation, the Commission supports deployment, support, awareness raising, and networking actions such as:

  • The Public Sector Information Group, an PSI expert group which includes representatives of 27 Member States that was set up by the EC to exchange good practices and initiatives supporting public sector information re-use and discuss and recommend solutions to challenges such as charging, exclusive agreements, development indicators for measuring public sector information and technology.
  • LAPSI, The European Thematic Network on Legal Aspects of Public Sector Information to become the main European point of reference for high-level policy discussions and strategic action on all legal issues related to the access and the re-use of the PSI, namely in the digital environment.
  • The European Data Forum, with a first meeting in Copenhagen (June 2012), and the next scheduled for Dublin in April 2013. It is a forum in which business actors, including a large number of SMEs, researchers and other stakeholders can come together to work out what a data economy really looks like.

The European Public Sector Information Platform

The EPSI Platform is Europe’s One-Stop Shop on Public Sector Information (PSI) Re-use which objective is the promotion of a dynamic PSI re-use market across the EU, a place where the different stakeholders can get all the relevant information about the European and international PSI re-use developments, emerging good practices, legislation, legal cases, examples of PSI re-use products and services, etc.

EPSI PlatformThe Platform provides news on European PSI developments, legal cases around re-use, good practices and examples of new products and services, covering the main PSI re-use markets. It follows and reports on a daily basis the developments of the PSI re-use/open-data/government-data policies, initiatives and/or projects in the EU and elsewhere.

Fomento de la reutilización de los datos en iniciativas Open Data

Durante el repaso realizado a las Pautas para el desarrollo de políticas Open Data de la Sunlight Foundation ya hemos revisado los aspectos relacionados con la planificación de la iniciativa,  aquellos relativos a la preparación de los datos, las implicaciones técnicas y los aspectos políticos y legales. Hoy para finalizar analizaremos aquellos aspectos que tienen que ver con las actividades cuyo objetivo es fomentar la reutilización de los datos.

Fomento de la reutilización

Otros de los aspectos importantes, y probablemente el que puede marcar la diferencia entre el éxito y el fracaso a la hora de llevar a cabo una iniciativa Open Data, es la realización de una campaña de promoción activa para fomentar la reutilización de los datos publicados.

Este es uno de los aspectos aún en fase de exploración para la mayoría de las iniciativas, y en los que menos se incide también por parte de la Sunlight Foundation, pero aún así nos dedican también algunas pautas básicas que se deberían tomar como objetivos mínimos al respecto.

Explorar y utilizar mecanismos de colaboración público-privada

El hecho de potenciar sinergias entre la Administración y otros entes externos como organizaciones no gubernamentales, instituciones academicas o grupos de expertos, permitirá un mejor desarrollo de la iniciativa al incluir otros elementos que pueden ayudar a fomentar la participación pública y mejorar y completar algunos aspectos débiles de las políticas.

Esta es una herramienta que deberá utilizarse con cuidado para tratar de evitar que dichos mecanismos de colaboración acaben degenerando en alianzas exclusivas que centralicen la explotación de los datos a través de un único proveedor o den lugar a cualquier otro tipo de ventaja competitiva para un agente específico del mercado.

LLAMAR A LA PARTICIPACIÓN PÚBLICA

Las políticas de Apertura de Datos tendrán repercusiones que afecten a toda la sociedad y por tanto podrían beneficiarse enormemente de la participación pública. Establecer distintos mecanismos de escucha y participación, ya sean formales o informales, ayudará sin duda alguna a mejorar sustancialmente la política de apertura de datos que se desarrolle.

Promocionar concursos y otros eventos de reutilización

Los concursos y otros eventos de reutilización similares han demostrado ser un medio efectivo para llamar la atención sobre los datos, generar interés y demostrar el potencial de los mismos, contribuyendo además a la generación de una comunidad activa en torno a los datos.

No obstante es necesario complementar estos eventos con otro tipo de actuaciones en las que se de cabida también a la participación de otros sectores menos técnicos y que permitan desarrollar productos y servicios más maduros que vayan más allá de una mera prueba de concepto.

Publicar datos y estadísticas de uso

Hacer públicas estadísticas detalladas de explotación y utilización debería ser obligatorio en cualquier iniciativa Open Data, tanto por la transparencia de la propia iniciativa como para facilitar una herramienta de análisis que permita optimizar la efectividad y realizar los ajustes necesarios.