Nueva Directiva Europea de Reutilización de la Información del Sector Público

Recientemente el Comité de Representantes de los países miembro de la Unión Europea ha dado su visto bueno a la actualización de la Directiva de Reutilización de la Información del Sector Público. Aunque todavía habrá que esperar al trámite de su aprobación por el Parlamento Europeo en Junio, es de esperar que no se produzcan cambios ni retrasos significativos.

En general la nueva Directiva supone un avance respecto a la directiva anterior del 2003 y un nuevo paso adelante en la estrategia Open Data de la Unión Europea, destacando la intención general de la actualización:

“Una vez implementada la nueva Directiva establecerá un derecho legítimo sobre la reutilización de la información pública que no estaba presente en la Directiva del 2003” – Neelie Kroes, Vicepresidenta de la Unión Europea.

No obstante, tras un primer análisis inicial por parte de la comunidad parece que sigue también habiendo algunos puntos mejorables, por ejemplo:

  • Existe la posibilidad de cargar costes marginales en el tratamiento de los datos y mantener otros modelos adicionales de ingresos mediante tasas cuando sean de aplicación en casos concretos con normativas propias.
  • En general se permite la aplicación de cualquier tipo de tasas, siempre que se justifique y se aplique de forma transparente, ignorando los efectos negativos que la aplicación de tasas tiene sobre la reutilización o los beneficios indirectos adicionales que una mayor apertura de los datos puede proporcionar.
  • Los formatos abiertos y legibles por máquinas serán obligatorios, pero siempre que sea posible y apropiado. Un matiz que sin duda dará lugar a distintas interpretaciones que permitan saltarse la regla general.
  • Se mantienen los acuerdos exclusivos de explotación de los datos siempre que sean por el bien del interés público. Lo que en la práctica supone la posibilidad de perpetuar estos acuerdos.

En cualquier caso, también existen puntos muy positivos, como la garantía de que los documentos afectados por las libertad de información deben ser no únicamente accesibles, sino también reutilizables, las mejoras sustanciales en los mecanismos de reclamación para garantizar su independencia, la promoción de licencias únicas, automatizables y estándar para todos los organismos dentro de un mismo estado miembro o la ampliación de la directiva al ámbito cultural.

Por tanto, y aunque tengamos todavía un par de años de transposición por delante una vez aprobada por el Parlamento, en general la Directiva supone un nuevo avance del Open Data en la Agenda Digital Europea, y por tanto bienvenida sea. Estaremos pendientes también de cómo se lleva a cabo la transposición de la Directiva en el caso de España y el impacto que tendrá sobre la actual Ley de Reutilización del Sector Público.

The European Commission steps forward on Open Data and PSI re-use

As so often repeated these days, data is the new fuel for the digital age. Considering the wide spectrum of opportunities Open Data may bring, it is no surprise that the EC plans how to keep shaking up the way public authorities share data. The following lines aim to be an overview of the EC developments so far on Open Data and Public Sector Information, as well as a review of future planned actions.

Logo European Commission

A Landmark Event: Data Workshop at the Digital Agenda Assembly 2011

The EC organized the first Digital Agenda Assembly in June 2011 to discuss advances with regards to the Digital Agenda objectives for Europe. With that aim, twenty-four thematic workshops and two plenary sessions were conducted. One of those events was the Open data and Re-use of Public Sector Information workshop, where different types of stakeholders congregated to collaborate with the Commission on developing its strategy for Open Data in the EU.

Khalil Rouhana (DG Information Society and Media Content & Cognitive Systems of the European Commission) made several key announcements in relation to Open Data policies in the EU during that workshop. We will focus briefly on these in the forthcoming sections.

The role of European Open Data portals

Open Data portals are aimed to be a key referral of the digital infrastructure bound for facilitating access to and re-use of Public Sector Information. Open Data portals have been -and are being- created around many EU Member States at all governmental levels. Given that the quantity of data published so far is relatively limited as compared to that potentially available for publication, the EC plans to publish two new central Open Data portals to facilitate access to European Open Data:

data.gov.eu screenshoot

  • The European Commission Open Data portal data.gov.eu, a portal easing the search for Commission data, as well as other EU institutions, bodies and agencies to citizens and industry. The portal, currently under developement, is expected to be released soon in 2012.
  • Pan-European Open Data portal, to make data from EU, national, regional and local administrations more easily available and re-usable. A prototype is expected to be released in 2013.

Review of the Directive on the Re-use of Public Sector Information

First adopted on November 17, 2003 and by now completely transposed to all member States, this original PSI Directive provided a minimal harmonisation of rules and procedures across the EU in order to facilitate cross-border re-use of the PSI. A proposal for a revision of the Directive, which is currently being discussed by the Union legislator, was presented in December 2011 to further open up the market for services based on PSI by:

  • Including new bodies in the scope of application of the Directive such as libraries, museums and archives.
  • Determining limits on the fees that can be charged by the public authorities at marginal costs.
  • Introducing independent oversight re-use rules in the Member States.
  • Making standard machine-readable formats for information held by public authorities.

Other Meaningful Previous Steps

That first Open Data and PSI workshop was a landmark event both in Open Data and PSI policies in the EU as well as in the way that the EC communicates these policies and interacts with the different stakeholders. Nevertheless, several steps forward were also made by the EC on the Open Data and PSI matters before this first Digital Agenda Workshop, such as:

December 2011: The Communication on Open Data

Following the first Digital Agenda workshop, the Commission adopted a Communication on Open Data by December 2011. In this Communication, the Commission proposes several actions to accomplish the objectives previously announced in the aforementioned DAE workshop:

  • To create a portal site for Commission-held information aiming at an expansion to other EU institutions, bodies and agencies at a later stage.
  • To work with the Member States on data formats and interoperability between existing sites.
  • To create a Pan-European umbrella site linking information held by EU institutions, bodies and agencies and by Member States.

First Update: New Data Workshop at the Digital Agenda Assembly 2012

In June 2012, the Digital Agenda Assembly 2012 housed a new Data Workshop where the European Commission Open Data and PSI roadmap was presented again, mainly:

It is also remarkable to recall the European overall bet for data handling, Open Data and Open Access, not only by Open Data policies and a regulatory strand (PSI Directive), but also by means of research, innovation and ICT deployment pilots and portals implemented through financial support instruments such as the FP7 and CIP-ICT-PSP 2011-13 R&D&I multiple programmes, that are currently almost gone but will have continuity with the new Horizon 2020 programme.

Horizon 2020 logoSome of the questions that lead this Workshop where:

European Data license

There is a strong need to investigate requirements for an European Data License, given that if we want to encourage use and reuse of data across European borders, there may be the need for a single cross-border license. Several questions then arise: Will one of the existing licenses do the job, or do we need a new one? If we do need a license, is there an obvious choice, or is something new required?

Release of Core Data

A first-priority task will be to identify and evangelise Open release of Core Reference Data, given that European Member States have already huge quantities of valuable data. Some of this data is now becoming freely available in certain Member States, but too much of it remains locked up behind odd rules and unsustainable cost-recovery models. It is also difficult to compare data between Member States.

Future Steps

In addition to all the work in progress that has been previously mentioned, and as announced by the Vice President of the Commission Mme Neelie Kroes, the EC also plans to continue developing their European strategy for the publication and reuse of public sector data from European institutions and the Member States, as established with Commission’s commitment to turn public data into business included in action 3 of the Digital Agenda for Europe Communication.

Some highlights of the future planned distributed actions include:

Services for publication, access and reuse of EU Open Public Data

A series of services will be purchased aimed at supporting the EU-wide availability of PSI and Open Data from public bodies at different governmental levels. These services will include:

  • The provision of data preparation, transformation and publication services, with a commitment to publish at least 15.000 new data sets from all EU Member States in machine readable formats, including Linked Open Data technologies.
  • Training services in the area of Open Data, in particular to favour the uptake of Linked Open Data technologies by public bodies within the European Union.
  • Provision of an IT advisory and consultancy service in the area of Open Data, and in particular on Linked Open Data technologies, including specific software development tasks.

The Open Data Reuse Incubator

Financial support instruments will continue to support several Open Data developments, notably, the FP7-ICT Work programme 2013 will help Small and Medium Enterprises (SMEs) to develop innovative applications in structured and unstructured digital content management and, particularly, in the reuse of open data through an Open Data Incubator.

This Incubator will establish an environment to:

  • Solicit open data reuse ideas from the general public and conduct a European wide open data reuse information campaign.
  • Publish and manage regularly scheduled calls for SMEs to submit mini-proposals to be funded for a period between six and twelve months.
  • Create a computing infrastructure where the winning mini-proposals will find accurate and up-to-date versions of the data they need for their services.
  • Establish a mechanism for connecting open data demand and supply by systematically contacting European public bodies for their open data and assisting them in the efficient and sustainable publication of such data.

Harmonization of Open Data initiatives

In response to the increasing clamour in search of harmonising Open Data initiatives, the European Union is financing projects such as “Harmonising Open Data in the Mediterranean through better access and Reuse of Public Sector Information – Homer”, which aims mainly to set up an effective strategy able to harmonise Open data policy and portals across the Mediterranean area, supporting regional and local governments.Homer Logo

New paths for growth

As important as political, structural and educational efforts, uncovering new paths for growth, in which Open Data possibilities about a given topic are explored, is also critical in order for Open Data and PSI re-use to advance. Some Open Data and PSI topics that are currently being explored by the European Commission are:

  • Cultural Data: The EU’s digital libraries initiative sets out to make all Europe’s cultural and scientific resources accessible to all, and preserve them for future generations. In this area it should be pointed out that recent Europeana’s move to CC0 is a step change in open data access, given that releasing data from across EU country sets an important new international precedent and a decisive move away from the world of closed and controlled data.

Europeana

  • Smart Cities: One of the greatest challenges facing the EU is how best to design and adapt cities into smart intelligent and sustainable environments. Smart urban technologies can make a major contribution in tackling urban challenges by breaking down boundaries between the sectors involved, ensuring adaptable and interoperable solutions and finding a way to use data transparently and openly, without breaching privacy.
  • Open Science: The European Commission outlined measures to improve access to scientific information produced in Europe. Broader and more rapid access to scientific papers and data will make it easier for researchers and businesses to build on the findings of public-funded research, boosting Europe’s innovation capacity and give citizens quicker access to the benefits of scientific discoveries. The Commission will make open access to scientific publications a general principle of Horizon 2020, the EU’s Research & Innovation funding programme for 2014-2020.

Networking, awareness raising and Dissemination

As seen from the last Digital Agenda Assembly Open Data conclusions above, networking, awareness raising, dissemination and outreach activities are considered key elements for the Open Data and PSI re-use market success at the EU. Complementary to legislation, the Commission supports deployment, support, awareness raising, and networking actions such as:

  • The Public Sector Information Group, an PSI expert group which includes representatives of 27 Member States that was set up by the EC to exchange good practices and initiatives supporting public sector information re-use and discuss and recommend solutions to challenges such as charging, exclusive agreements, development indicators for measuring public sector information and technology.
  • LAPSI, The European Thematic Network on Legal Aspects of Public Sector Information to become the main European point of reference for high-level policy discussions and strategic action on all legal issues related to the access and the re-use of the PSI, namely in the digital environment.
  • The European Data Forum, with a first meeting in Copenhagen (June 2012), and the next scheduled for Dublin in April 2013. It is a forum in which business actors, including a large number of SMEs, researchers and other stakeholders can come together to work out what a data economy really looks like.

The European Public Sector Information Platform

The EPSI Platform is Europe’s One-Stop Shop on Public Sector Information (PSI) Re-use which objective is the promotion of a dynamic PSI re-use market across the EU, a place where the different stakeholders can get all the relevant information about the European and international PSI re-use developments, emerging good practices, legislation, legal cases, examples of PSI re-use products and services, etc.

EPSI PlatformThe Platform provides news on European PSI developments, legal cases around re-use, good practices and examples of new products and services, covering the main PSI re-use markets. It follows and reports on a daily basis the developments of the PSI re-use/open-data/government-data policies, initiatives and/or projects in the EU and elsewhere.

Los tres retos del Open Data en la Asamblea de la Agenda Digital Europea

Este artículo fue publicado primero en inglés.

Esta semana el  Workshop sobre Datos de la Agenda Digital Europea nos ha dejado una buena discusión acerca de las oportunidades y los obstáculos a los que se enfrenta el Open Data, así como reflexiones sobre cómo deben implicarse todas las partes interesadas para superarlos.

El plan de trabajo de la Comisión Europea

Las iniciativas de la Comisión Europea hasta el momento podrían resumirse como el desarrollo de una estrategia de comunicación de Datos Abiertos, la revisión de la directiva de la Información del Sector Público (PSI) y la política de reutilización de la Comisión Europea. Todo ello incluye el lanzamiento de la beta del nuevo portal Open Data de la Comisión Europea a mediados de Julio y un futuro portal Paneuropeo.

También es importante recordar la apuesta Europea por la gestión de los datos, el Open Data y el libre acceso a través de proyectos pilotos y portales mediante los programas de I+D+i FP7 y CIP 2011-13 que, aunque actualmente están prácticamente liquidados, tendrán su continuidad en el nuevo programa Horizon 2020.

Los temas candentes en cuanto a datos

Paul Miller hizo una estupenda introducción, basada en el diálogo previo online, en la que se revelaron los principales temas candentes para la Agenda: Open Data, Linked Data y Big Data, así como la importancia de las cuatro Vs de los datos: Gran Volumen, Velocidad, Variedad y Valor.

También nos recuerda la importancia de seguir las mejores prácticas en cuanto a estándares abiertos para Open Data, un tema recurrente, dado que actualmente contamos con más de 150 iniciativas en marcha a lo largo de Europa, pero todas ellas cuentan con componentes ligeramente diferentes.

Finalmente, François Bancihon en su discurso reivindicó una vez más la necesidad de una licencia única Europea y nos advirtió acerca de los peligros del Open Data y el Poder de los Datos con algunos ejemplos muy buenos:

  • Twitter cuenta con información más precisa acerca de las caídas del sistema de Netflix que la que el propio Netflix tiene.
  • Google tiene constancia de las notificaciones de desempleo antes incluso que las propias oficinas de empleo.
  • Target se entera de los embarazos de adolescentes antes que sus propios padres.

Áreas de aplicación de la reutilización

Bajo el lema inicial de que  Los datos son la nueva moneda de la democracia la primera sesión se centró en mostrar áreas de aplicación específicas:

Registros mercantiles

Sin lugar a dudas, uno de los temas más controvertidos del Workshop, debido sobre todo a el estupendo y controvertido informe presentado por Chris Taggart, de Open Corporates acerca de cómo de abiertos son los registros mercantiles en la Unión Europea, y la inevitable comparación con el modelo cerrado del  Registro mercantil Europeo basando en el pago por acceso.

Por desgracia, España obtiene una puntuación final de 0 en el informe debido a su registro completamente cerrado y de pago, una pena tratándose de uno de los conjuntos de datos más populares y deseados.

Información Geográfica

Una vez más, impresionantes las estadísticas de uso de datos geográficos: 120k accesos y 60k Gb de datos. La información Geoespacial se confirma así como una de las áreas más exitosas para el Open Data en Europa, dado que el 80% de las decisiones que tienen que tomar las autoridades públicas cuentan con un componente geoespacial. Se trata sin duda de una capa fundamental y necesaria para el open data y la innovación, de ahí la necesidad de que el acceso sea libre.

Interesante también el caso de uso del Earth Observatory, que sirve de ayuda en la gestión de recursos como la energía, el agua potable o la agricultura, ayudando así a afrontar los retos sociales asociados. La lección a aprender en este proyecto: todos los intentos de comercializar los datos han fracasado, es necesario que se mantengan disponibles de forma abierta y gratuita. Importante también recalcar que la iniciativa fue posible gracias al apoyo del Gobierno, por lo que los Gobiernos tienen también un papel de liderazgo en el progreso del Open Data.

Transporte

La experiencia presentada se centró en los problemas y barreras legales encontradas durante su desarrollo. ¿Es el scrapping legal? ¿Quién es el propietario de la información? Desafortunadamente, nos encontramos con que en algunos casos la información es ya abierta por defecto, pero en otros casos los gestores de los datos se niegan a proporcionar los datos.

En el lado malo: Las reclamaciones en los tribunales suelen llevar meses o incluso años, independientemente de lo obvio que pueda resultar el caso.

Los retos del idioma en los datos

La sesión reunió a varias de las compañías Europeas expertas en los campos de traducción, internacionalización, localización y servicios multilingües, centrando la discusión en la semántica del contenido, no en los metadatos.

La conclusión fue que una de las pocas barreras que todavía tenemos en Europa son las barreras culturales e idiomáticas, lo que supone un problema real a la hora de conseguir un mercado digital único. El multilingüismo puede llegar a ser beneficioso si se explota adecuadamente, ya que una vez se consiguen procesar los datos en base al conocimiento del idioma obtendríamos una clara ventaja competitiva. El verdadero reto es ser capaz de procesar los datos multilingües y permitir que fluyan a través de idiomas, países y mercados.

Una infraestructura multilingüe será tan importante para Europa como la infraestructura de banda ancha.

Generación de valor y el futuro de la economía del dato en Europa

La última sesión se centró en la generación de valor mediante los datos, basándose en la premisa de que los datos por sí mismos no son valiosos y lo que necesitamos no es sólo tecnología, sino  soluciones de análisis que aporten conocimiento y ayuden en la toma de decisiones.

Mención especial para varias áreas de negocio intensivas en datos que son potenciales oportunidades para las PYMES: Venta al por menor, manufactura, medios sociales, envejecimiento de la población, gestión urbana, transporte, seguridad alimentaria, el sector público o la sanidad y medicina.

Existe también consenso en cuanto al hecho de que es el momento de buscar modelos de negocio innovadores en torno al Open Data, como por ejemplo el análisis de datos en tiempo real sin almacenamiento. La duda que sigue en el aire es ¿qué debe ser lo primero? ¿más datos abiertos o mejores modelos de negocio?

Los retos del Open Data

En la sesión de conclusiones, además de varias observaciones finales de las que se extrae que el Open Data será clave para la sostenibilidad de un mercado digital único, se consensuaron tres retos principales en cuanto al Open Data para la Agenda Digital:

  • Sostenibilidad de las iniciativas Open Data.
  • Casos de uso de interés público frente a casos de uso de negocio.
  • Retos del Multilingüismo.

Como conclusión final podemos terminar con una de las citas más memorables del día, por obra de Chris Taggart:

Abre tus datos o prepárate para decir adiós a la democracia

El debate continuará en el Encuentro Aporta de iniciativas Open Data en España la próxima semana.

Three Challenges of Open Data at the Digital Agenda Assembly

Today’s Digital Agenda Data Workshop left us with a good discussion about what the opportunities and hurdles of Open Data are, and what can be done by all the stakeholders.

The European Commission roadmap

EC initiatives so far could be summarized as the development of an Open Data communication strategy, the revision of the PSI directive and an EC reuse policy. That includes the launch on beta stage of the new Open Data EC portal at mid July and a future Pan-European portal.

Also important to recall the European bet for data handling, open data and open access pilots and portals through the FP7 and CIP 2011-13 R&D&I programmes, currently almost gone, but that will have continuity with the new Horizon 2020 programme.

Data hot topics

Paul Miller gave an excellent introduction based on the previous online discussion that uncovers the main hot topics for the Agenda: Open Data, Linked Data and Big Data, as well as the importance of the four V’s of data: Big Volume, Velocity, Variety and Value.

He also remembered us the importance of best practices and open standards for open data, a recurrent topic, given that we have currently 150+ on-going initiatives all around Europe, but all of them are slightly different.

Finally, François Bancihon in his keynote raised his voice again for the need of a single pan-European license and advised us about the perils of Open Data and the Power of Data, with a few very good examples:

  • Twitter has more accurate information about Netflix’s downtime that Netflix.
  • Google knows about unemployment claims before the unemployment office.
  • Target knows about the pregnancy of the teen before their parents.

PSI application areas

With the opening tagline of Data is the new currency of democracy the first session focused on showcasing specific application areas:

Company registers

Without any doubt, one of the hot topics at the Workshop, mainly due to the great and controversial report published by Chris Taggart, from Open Corporates about how open company registers in Europe are, and the inevitable comparison with the European business registry closed model based on pay-to-play access.

Sadly, Spain scores 0 points in the report due to its fully closed registry, a pity for one of the most popular and desired datasets.

Geographical information

On more time, impressive stats on GEOdata usage: 120k accesses and 60k Gb of data. Geospatial confirms as one of the EU Open Data successful areas, given that 80% of needs for decisions from public authorities have a geospatial component. It is a fundamental layer necessary for open data and innovation, thus the need to remain open.

Also interesting the Earth Observatory use case that helps to manage resources such as energy, freshwater and agriculture. It measures land-use change and help to address social challenges. The lesson to learn from the project: all attempts to commercialise data supply failed, it needs to be open and freely available. Important to say that it was launched with government support and sponsorship, so Governments play also a leading role in Open Data progress.

Transportation

The use case presented focused on the legal issues and barriers for reuse. Is scrapping legal? Who is the owner of the information? Unfortunately, you can find some cases where data is open by default and others where data managers refuse to supply the information.

The bad side: Fighting in court could take long months, even years, no matter how obvious the case is.

Data and language challenges

One of the sessions I was personally expecting was the one which got together some of the European expert companies in the fields of translation, internationalization, localization and multilingual services. Surprisingly for me, the discussion focused on semantics of contents and not metadata as I expected.

The conclusion was that one of the few remaining European barriers are the cultural and language ones, a real problem for a successful Single Digital Market. Multilingualism can be a benefit if properly exploited, once we can process data based on language knowledge, we can obtain remarkable results and a competitive advantage. The real challenge is to be able to process multilingual data and enable it to flow through languages, countries and markets.

A multilingual infrastructure is as important for Europe as a broadband infrastructure.

Value generation and the future of the EU data economy

The last session focused on data value generation based on the premise that data itself is not valuable alone and what we need are data analysis solutions for insight and decisions, not just technology.

Several data intensive areas were mentioned as potential SMEs business opportunities for analysis, simulation or analytics, such as: Retail, Manufacturing, Social Media, Ageing Population, Urban Management, Transport, Food Security, the Public Sector or Health and Medical data.

There is also an agreement on the fact that it’s time to look for innovative business models around Open Data, such as streaming data analytics with live data that is not stored but processed on the fly. The doubt is still what come first, more data openness or better business models.

Open Data challenges

In the wrap-up session, some final remarks, three main Open Data challenges were proposed for the Digital Agenda:

  • Sustainability of Open Data.
  • Profit vs. public interest data uses.
  • Multilingualism issues.

As a conclusion, we can finish with one of the most remarkable quotes of the day, by Chris Taggart:

Open your data or say good-bye to democracy