![Page 1: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/1.jpg)
STEVEN DE COSTASteering Group Member
@STARL3N
PUBLIC DATA AND CKAN
![Page 2: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/2.jpg)
![Page 3: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/3.jpg)
Introduction 3
Link Digital Executive Director
CKAN AssociationSteering Group Member
Open Knowledge AustraliaCo-Secretary & Treasurer
Data ShadesFounder
GovHackNational Organiser
AWS User GroupCBR Organiser
![Page 4: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/4.jpg)
STEVEN DE COSTASteering Group Member
@STARL3N
![Page 5: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/5.jpg)
STEVEN DE COSTASteering Group Member
@STARL3N
![Page 6: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/6.jpg)
6Link Digital’s Network Map
![Page 7: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/7.jpg)
![Page 8: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/8.jpg)
Data portal software:
1. Open Source
2. Large and expanding installation base within Government worldwide
3. Expanding use cases in the wider dataecosystem
4. Python web app, PostgreSQL DB
5. Built for machines, custodians and end users
WHAT IS CKAN?
![Page 9: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/9.jpg)
LEARN MORE AT CKAN.org
![Page 10: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/10.jpg)
DOWNLOAD FROM github.com/ckan/ckan
![Page 11: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/11.jpg)
1. >> Organisations (optionally with sub-organisations)
2. >> >> Datasets
3. >> >> >> Resources
4. >> Platform Custodian
5. >> >> Organisation Custodian, Editor or Member
6. >> Published or Private datasets
CKAN STRUCTURE
![Page 12: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/12.jpg)
1. >> Constitution
2. >> >> Parliamentary Legislation and Acts (Jurisdiction = Platform)
3. >> >> >> Ministries (Organisation)
4. >> >> >> >> Programs (Sub-Organisations)
5. >> >> >> >> >> Projects (Datasets)
6. >> >> >> >> >> >> Outcomes (Resources)
CKAN USE CASE PARADIGM
![Page 13: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/13.jpg)
1. User registration
2. User management
3. Custodian workflows (manage datasets and data resources)
4. Directory Browse by organisation or group
5. Faceted search for multiple fields (supporting end user discovery)
6. Resource views to preview data (a recently improved feature)
7. Metadata view
CKAN UI
![Page 14: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/14.jpg)
1. Create an organistation (usually done by platform owner)
2. Login as member of organisation
3. Click ‘add dataset’
4. Step 1: Add a title, description and other metadata
5. Step 2: Add resources (links to data or upload data files for hosting)
6. Step 3: Add any additional info
CKAN CUSTODIAN WORKFLOW
![Page 15: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/15.jpg)
1. Join the dev mailing list (monitored by tech team):https://lists.okfn.org/mailman/listinfo/ckan-dev
2. Search Stack overflow under CKAN:http://stackoverflow.com/search?q=CKAN
3. Check the roadmap on waffle.io:https://waffle.io/ckan/ideas-and-roadmap
4. Join a tech team meeting:http://ckan.org/about/technical-team/
WHERE TO GET HELP
![Page 16: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/16.jpg)
CKAN API DOCUMENTATION
![Page 17: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/17.jpg)
1. Get JSON-formatted lists of a site’s datasets, groups or other CKAN objects
2. Get a full JSON representation of a dataset, resource or other object
3. Search for packages or resources matching a query
4. Create, update and delete datasets, resources and other objects
5. Get an activity stream of recently changed datasets on a site
CKAN API
![Page 18: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/18.jpg)
1. CKAN as an Information Asset Register
2. FileStore – For hosting of data and resources
3. DataStore - provides a database for structured storage of data together with a powerful Web-accessible Data API
4. License Selection (machine ready?)
5. Harvesting
A FEW MORE POINTS
![Page 19: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/19.jpg)
Delivering the world’s best open data management system
The purpose of the CKAN Association is to support sustainable growth and development of CKAN while also protecting the interests of the CKAN community.
The Association values a healthy and thriving community which continues to deliver the best open data management system in the world.
CKAN ASSOCIATION: STATEMENT OF PURPOSE
![Page 20: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/20.jpg)
Community interests, or needs, can be generalised as:
1. Users need an enterprise level open data management system tailored to meet their needs now and into the future.
2. Individual contributors need a project that is rewarding to work for, inclusive and active.
COMMUNITY INTERESTS
![Page 21: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/21.jpg)
Who owns or directly manages the CKAN project?
The project, its releases and future direction are cooperatively managed by its community of users and contributors. Association delegates, staff and office holders may be active within the project but will exercise no more or less influence than any other contributor or user.
More information about CKAN and how to contribute can be found at CKAN.org.
DELEGATION TO SERVE AND PROTECT
![Page 22: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/22.jpg)
What is the current structure of the CKAN Association?
See http://ckan.org
The steering group carries on a number of business activities.
This includes raising revenue, managing resources and directing projects or programs of activity relevant to the CKAN Association’s statement of purpose.
COMPLETENESS OF PURPOSE
![Page 23: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/23.jpg)
FORMAL MEMBERSHIPS
![Page 24: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/24.jpg)
It's easy to find people willing to fund or work on the flashier parts of CKAN, and there is some funding for core work such as meetings and preparing releases. But there are a few important things that aren't getting addressed.
Fix Security Issues
There are a small number of known issues that high profile sites work around by implementing workflows and tight controls over users and data published. Everyone else would benefit from a more-secure-by-default CKAN.
Clear Technical Debt
CKAN, has some parts that should be replaced or removed. This work doesn't add any new features and worse, threatens to break upgrades for existing sites and extensions. It is necessary work though. Unless performance and technical limitations are addressed they will grow and start turning users away from CKAN.
Ref: https://github.com/ckan/ideas-and-roadmap/issues/152 - Raised by Ian Ward, Tech Team Lead
HOW MEMBERSHIPS BENEFIT CKAN
![Page 25: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/25.jpg)
Foundations of Open Government 25
My Administration is committed to creating an unprecedented level of openness in Government. We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. Openness will strengthen our democracy and promote efficiency and effectiveness in Government.
Sources: http://www.whitehouse.gov/the_press_office/TransparencyandOpenGovernmentHope Poster by Shepard Fairey: http://en.wikipedia.org/wiki/File:Barack_Obama_Hope_poster.jpg
![Page 26: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/26.jpg)
The role of Government in Australia 26
It should support civil society and its multiplicity of voices and activities.
It should provide the economic framework and the essential infrastructure for public and private enterprise.
Source: http://www.australiancollaboration.com.au/pdf/FactSheets/Role-government-FactSheet.pdf
![Page 27: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/27.jpg)
Business Cases: Theory of the firm & Transaction costs 27
![Page 28: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/28.jpg)
Where is there work to do with Open Data? 28
![Page 29: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/29.jpg)
Published Data Handbook 29
![Page 30: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/30.jpg)
Published Data Handbook 30
Recipe Name What you’ll need Ingredients Method Perfect for…
![Page 31: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/31.jpg)
31Establishing Data Publishing Policy
![Page 32: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/32.jpg)
32Establishing Data Management Systems
![Page 33: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/33.jpg)
33Educating Data Publishers
![Page 34: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/34.jpg)
34Facilitation within tech communities
![Page 35: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/35.jpg)
Establishing enterprise solution architecture 35
![Page 36: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/36.jpg)
36Extract, Transform and Load Connectors
![Page 37: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/37.jpg)
37Cleaning of Messy Data
![Page 38: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/38.jpg)
38Geospatial Integration
![Page 39: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/39.jpg)
39Resource View Integration
![Page 40: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/40.jpg)
40Enriched Data and Analytics
![Page 41: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/41.jpg)
41The perfect storm
![Page 42: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/42.jpg)
42Drupal interface
![Page 43: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/43.jpg)
43CKAN interface
![Page 44: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/44.jpg)
44What the DFMP does
![Page 45: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/45.jpg)
45Launched Globally as CKAN Galleries
![Page 46: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/46.jpg)
46Launched Globally as CKAN Galleries
![Page 47: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/47.jpg)
47Government as an API - Digital Transformation Office
![Page 48: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/48.jpg)
48Data.vic.gov.au on CKAN, Drupal and AWS
![Page 49: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/49.jpg)
Classifying data 49
The three tiers are:
internal
whole of Government
open
![Page 50: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/50.jpg)
50Data.vic.gov.au data classification
![Page 51: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/51.jpg)
51The ‘go. no go’ gates for going open
![Page 52: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/52.jpg)
OEH Data Management System 52
![Page 53: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/53.jpg)
Take Note: What is NOT good 53
![Page 54: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/54.jpg)
Take Note: What is best… 54
![Page 55: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/55.jpg)
![Page 56: CKAN and Australian open data updates for Wikimedia - 7 October 2015](https://reader030.vdocuments.site/reader030/viewer/2022021506/589ae6e31a28abee708b5f2b/html5/thumbnails/56.jpg)