Uncategorized

You are currently browsing the archive for the Uncategorized category.

I met Alex at the Cybera Summit at the Banff Centre in October and that is where I was  introduced to the WEHUB. There are many interesting ways to do open data, science and to use the cloud to do so.  I invited Alex to prepare the following guest post about how WEHUB  does it.
********************************

Water and Environmental Hub…aggregating water data from across North America and making it available through an API

by:

Alex Joseph, Executive Director – Water and Environmental Hub 

As anyone searching for water data from multiple sources knows…there isn’t really a Google for water data. 

A search for water data often results in a web page with a phone number to call someone, or an anonymous info request form. The water datasets that are available are often embedded as graphs in .pdf files obscuring the raw data or available in real time but embedded in html code on web pages. In the best cases, raw water data is available in large .zip files where you get the whole dataset or the opposite, you are faced with downloading hundreds of individual observation stations and then try and sew together hundreds of spreadsheet files, hoping that the columns all line up!

It gets even more time consuming and expensive when one tries to find water data that crosses political boundaries. Imagine the effort required to find data on the “Lake Winnipeg Watershed”? A search involves multiple provinces, states, 3 levels of government, multiple departments within those governments etc. etc. with a high probability that each of those datasets is in a different format.

Besides the challenges with access to water data, the few water datasets that are accessible on the web are unlikely to be provided through an API. Thus, those generous web developers that attended the World Bank sponsored Water Hackathons last week likely found that very little water data is available through an API allowing them to build dynamic water apps….

…but this is changing.

The Water and Environmental Hub (WEHUB) project is an open cloud-based web platform that aggregates, federates, and connects water data and information with users looking to search, discover, download, analyze, model and interpret water and environmental-based information. By combining water expertise with an open web development approach and an entrepreneurial foundation, the project hopes to spur economic diversification and benefit both public users and the private sector by improving the access to water data and tools for academia, government, industry, NGOs and the general public.

The WEHUB also enables organizations and users to develop customized applications on top of the WEHUB platform using our (RESTful) API, so that the data can be easily shared, integrated, leveraged, and customized.

The web platform is structured as a three-tiered system with a Client, Server and Database.  Each tier in the system is divided into components that address the catalogue, spatial and non-spatial data, and the social network requirements.  The catalogue acts as the index for the data and allows for easy search, download and upload of the data. The spatial data is shown on the client – as a map – making it easy for the user to visualize the data.  The social network allows for commenting, flagging and sharing of data. The WEHUB employs a Representational State Transfer (REST) software architecture. Open standards (e.g. OGC standards such as WMS, WFS, SOS, WaterML, GroundwaterML) are used whenever practical, efficient and economical to meet the needs of users.

In terms of geographical scope, the project began with Alberta and Western Canadian water data and information, a region to which the partners have relevant expertise and networks. As development successes are achieved, the project has extended across North America, with scalability a key design thrust.

The University of Toronto Map and Data Librarians put together a really fun panel for Open Access Week with the City of Toronto Open Data team and Jury Konga on the topic of Open Data. As promised here are my slides. There were some great questions from the audience and it was a very well attended session.

There is also an honourable mention to the Toronto Wellbeing initiative.

This year I thought I would honour Wendy Watkins a founder with Ernie Boyko of the Data Liberation Initiative (DLI) in Canada on for Ada Lovelace Day.

Wendy Watkins

In Canada our census data is sold back to us under a cost recovery program initiated by the Brian Mulroney Conservative Government in the early 1980s.  In fact, the Conservatives of that day also tried to Cancel the census but alas the constitution prevented them for doing so and instead they cut Statistics Canada’s budget severely which instituted a very regressive cost recovery practice.  The prices were so high that not only could citizens not afford to use their own data, universities encouraged students to use free US census data since they did not have the resources to pay for Canadian census data.  During those years, Canadians became experts on the US and not on Canada.

It is through the hard work of Wendy Watkins, her collaborators, data & map & research librarians that Canadian universities now have Census data for faculty and students along with associated census geographic files.  I had the good fortune as a student to benefit from the DLI.  Here is an excerpt from one of Wendy’s papers about the history of the DLI:

In April 1993, after receipt of the “Liberation Paper,” the Social Science Federation of Canada (SSFC) hosted a meeting with representatives from the Social Sciences and Humanities Research Council (SSHRC), the Association of Universities and Colleges of Canada (AUCC), the Canadian Association of Research Libraries (CARL), the Canadian Association of Public Data Users (CAPDU) and other interested parties to devise a strategy to make Canadian data more readily available to the education and research communities. The meeting resulted in the striking of a smaller working group, under the aegis of the SSFC, to devise a plan that would be acceptable to all parties. Statistics Canada and the DSP [Depository Service Program] played advisory roles in this process. While the initiative has involved government in an advisory role, it is unique in that it was conceived and developed by members of the Canadian research community.

The working group, consisting of researchers, representatives from CARL and CAPDU, as well as members of the SSFC, held a series of meetings over the next months. Advice from both Statistics Canada and the Depository Services Program was invited and found to be invaluable. When the group had formulated a working document to which both Statistics Canada and the DSP agreed, meetings were arranged with senior management in several government departments. The SSFC also met with Ministers and their executive assistants in order to move the proposal forward. Finally, in December 1995, the DLI had received a strong enough informal blessing that the project was deemed to be a go. Letters of agreement were distributed and data began to be released.

More officially, the DLI received approval by the Treasury Board Ministers in a February 1996 decision. It was subsequently included as part of the federal government’s Science and Technology Strategy in March. Most recently, in October 1996, it was officially announced by Dr. John Gerard, Minister of State for Science and Technology at a press conference held in conjunction with National Science and Technology Week and the 30th anniversary of Carleton University’s Data Centre. ( Data Liberation and Academic Freedom, 1996).

The DLI not only fueled Canadian research, it promoted academic freedom, advanced data driven informed decision-making and created a new class of librarian called data librarians and also data centres in libraries.  Data also became artifacts to be collected in libraries, which added a new practice of adding digital material in a catalog along with hard copy books on shelves, the DLI spurred the early adoption of the Internet with the use of basic FTP protocols to transfer data from Statistics Canada and university libraries, and it was the forerunner in the acquisition of digital materials.  The DLI also promoted collaboration between universities and government via a consortium agreement that has been embraced by other organizations such as the Community Social Data Strategy.  Finally, the DLI also accelerated a new type of expertise in data metadata, data catalogs, data citation and data preservation (b).

Today there is a very vibrant DLI community of practice that shares knowledge on a yearly basis at DLI Bootcamps, maintains a repository of training materials, an active blog Data Interests Group for Reference Services and actively exchanges expertise on a DLILIST listserv.

The DLI also politicized access to data very early on and in a sense they began the discourse on data access in Canada.  The cancellation of the 2011 Census being one of the big issues DLI supporters took on.  Further Wendy Watkins and her colleagues participate in key roundtable discussions on access to research data, the preservation of data and develop important infrastructures that disseminate Canadian Data.

Data users and Canadians can thank Wendy for being on the vanguard of open data, open government and data liberation in Canada and for building an incredible cadre of data literate librarians, faculty and students.  Open Data initiatives in Canada can benefit from her work and should recognize Wendy as one of their data access pioneers.  Now we just need to have a census and for those data to be cost free to the public.

Some Watkins’ Papers:

Take Away: Understanding of the history of the Canadian census. The use of census data through Canadian history and the effects of changing census data collection methods.
Objective: Understanding the following: what a national census is; the history of the Canadian national census; effects of changes to the 2010 long form; survey versus census; where we are and what do we have in May 2011. Methods: lecture and presentation Results: increase awareness of what comprises census data and how it is used by Canadians (individuals, researchers, business, governments, libraries who serve these users) Conclusions: If the Census 2011 is vastly different from previous national census’, what alternative resources are available for libraries and their users?
Description: The long form census was changed in the summer of 2010 to a long form survey. What are the long term effects of this change for Canadians (individuals, researchers, business, governments, libraries) who use census data.

This is a guest post by Mark Weiler:

It’s with great pleasure that OpenGovernmentRecords.net announces the launch of the video “Canada’s Access to Information Act: An Epic Introduction

The video begins with a brief overview of the Access to Information Act, which is a mystery to most Canadians. The video then removes some of the mystery by providing an example of an order for documents filed through the Access to Information Act. The video then replaces the “mystery of not knowing ATI” with the “wonder of using ATI” by opening a door to a world of FOI magic, mages, dragon’s, and re/quests! The video includes a movie titled “Re/quest”, which is about the greatest Freedom of Information Legislation mage on her first re/quest into an unknown world — the Federal Other World. Join her as she crosses scorching deserts, lush forests, and frigid mountains to find in the Federal Other World materials that some adults in This World might be able to use to learn the magic of freedom of information legislation!

The video and movie were made with creative works – music, industry quality computer animation, and images – released through the Creative Commons. The video and movie are released through a Creative Commons Attribute 2.5 license which means you are free to remix and distribute them, even for commercial purposes.

Watch the trailer to the movie “Re/quest” and/or the full epic introduction.

The video and movie are intended for civically-minded adults with a creative spirit.

Mark Weiler
OpenGovernmentRecords.net

L’image globale: Qu’est-ce qu’il y a de neuf dans le monde des données

Atelier national de formation de l’IDD – session d’ouverture

À tous les jours on retrouve de l’innovation dans le monde des données : le web sémantique, l’informatique en nuage, la visualisation, la cartographie, les portails, les infrastructures de données géospatiales, etc.  Cette partie de la journée de formation portera  sur les nouvelles initiatives canadiennes concernant l’accès public aux données en mettant l’accent sur ??la transparence et les données ouvertes. Dans cette session, les participants/tes seront initiés à la démocratie participative et à l’utilisation des données numériques, aux définitions de données ouvertes et à des exemples de politiques gouvernementales éclairées.  En outre, nous nous pencherons sur ce que certains groupes communautaires font, la direction dans les grandes villes du Canada et dans la province de la Colombie-Britannique par les administrations et les citoyens. Nous traiterons notamment de licences, d’initiatives de données ouvertes, de « hackfest », de « hackathons », d’applications, des défis et des possibilités. Il est espéré que ce survol fournira aux participants/tes un aperçu des nouveautés dans le monde des données publiques au Canada.

The Big Picture: What is new in the Data World

DLI National Training Day – Opening Session

Data innovations happen daily: the semantic web, the cloud, visualization, mapping, sensors, spatial data infrastructures, etc. This portion of the Training Day will focus on recent access to public data initiatives in Canada with an emphasis on open government and open data. In this session participants will be introduced to data and participatory democracy, open data definitions and examples of good government policy. In addition, we will look at what some community groups are doing, the leadership in Canada’s big cities and the Province of BC by administrations and citizens. This will include licenses, open data initiatives, hackfests, hackathons, applications, challenges and opportunities. It is hoped that this overview will provide participants with insight about what is new in the Canadian access to public data world.

CTV News: Internet abuzz with tweets about mandatory census

Globe and Mail: Short-form census stays

This is what is left!

The Globe’s Web-based groups urge youth to get involved in election article about new media and getting youth to vote introduces some interesting tools.  A previous blog post Tools for the Elections has some for grown-ups.  Project Democracy was just launched, its former self Vote for the Environment which was one of my favourite tool during the last few elections.

Youth Voting Tools:

« Older entries § Newer entries »