friday lunchtime lecture: open data and the government data programme

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 1/55

ODI Friday Lunchtime Lecture

8 January 2016

Paul MaltbyDirector of Data

Government Digital Service@maltbyps

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 2/55

In the last Parliament our dataapproach was dominated by

open data

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 3/55

We did okay

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 4/55

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 5/55

The data user communityworked wonders

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 6/55G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 7/55

Now we need to focus onquality , not just quantity

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 8/55

Driving data quality by dog-fooding within government

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 9/55

And concentrating on shared data, not just open data

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 10/55

We have a new GovernmentData Programme aiming totransform how data is usedacross public services

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 11/55

G

Too much government data isDuplicatedIn many different formatsHard to reachHard to maintainHard to put to good use

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 12/55

G

Our aim = better digital services

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 13/55

G

Our aim = good policy and

operational decisions

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 14/55

G

Our aim = economic benefits

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 15/55

G

Our aim = public trust & security

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 16/55

G

The Government DataProgramme has 3 workstreams

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 17/55

1. Better use of dataOpen data

Data ScienceData literacy and capability

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 18/55

@cgchristrottConsul General, Cape Town, SA

Data science opportunities:Unstructured data and

visualisationsG

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 19/55

Data Science & the Civil Service

Data science opportunities:Clustering and prediction

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 20/55

There is some unfinishedbusiness on open data

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 21/55

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 22/55

We want to maintain inputfrom external users to keep

driving the open data agenda

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 23/55

Creating mainstream datascience capability amonganalysts in government, withONS

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 24/55

GDS will be supporting this,including through data literacy

for non-data specialists

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 25/55

2. Modernising datainfrastructure

Registers APIsData access tools

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 26/55

G

companies, charities, trade unions, courts, schools,universities, hospitals, zoos, circuses, inspections,

licences, certificates, births, marriages, deaths,electoral roll, insolvencies, bankruptcies, passports,animal passports, drivers, vehicles, land parcels,land ownership, land use, legal boundaries, awards,

tax rates, benefits, livestock movements, flood risk,river levels, companies, fish caught, patents,trademarks, designs, non-native invasive plants,bank holidays, food standards, clock changes …

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 27/55

“SCOLAND UK”“SCOTALND UK”“SCOTKLAND UK”“SCOTLAD UK”“SCOTLAND”“SCOTLAND UK”

“SCOTLAND UK”“SCOTLAND UNITED KINGDO”“SCOTLAND UNITED KINGDOM”“SCOTLAND UNITED KINGODM”

“SCOTLAND, UK” G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 28/55

Registers are more than just a list

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 29/55

G

● Persistent & canon● Minimum viable da● A service, not a lis● Integrity of history

● Open / shared / pr

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 30/55

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 31/55

G

Starting with commonlyreferenced registers such as

● Countries● Companies (limited companies,

charities, sole traders)● Local authorities● Schools● Addresses

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 32/55

Creating an API infrastructureacross government and, where

appropriate, to users outside

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 33/55

Reducing the need for bulkdata sharing in government

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 34/55

Moving away fromdownloading and emailing dataaround Whitehall

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 35/55

And disks in the post

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 36/55

(but we know how importantbulk availability of data is forsome external users via data.

gov.uk)

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 37/55

We’re also starting to thinkabout better data discoverytools - both inside and outside

government

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 38/55

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 39/55

There are currently no tools forcivil servants to know whethernon-open data exists across

government

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 40/55

Never mind knowing whetherthey can or should access it

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 41/55

Or having tools available tohelp them query the data orprovide basic manipulation, eg

plot on a map

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 42/55

A discovery process on toolingwill start soon - we will bedoing user research with users

inside and outside government

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 43/55

3. Data policy and governanceCommon policies and leadershipPossible legislationInternational leadership

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 44/55

G

A new Ministerial Group onDigital Transformation -including data

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 45/55

An external Steering Groupchaired by National StatisticianJohn Pullinger

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 46/55

Open Data Institute keepingour feet to the fire andconnected with external datausers

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 47/55

G

At the heart of the programmesenior Data Leaders drawn fromacross government

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 48/55

Agreeing:

Common policies (eg external sharing)Data standardsResponsibility for registers

Opportunities for collaboration

And leading the new data vision

across WhitehallG

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 49/55

Possible new da ta a ccess legislation?

G

Research andstatistics

● HMRC● ADRNs● ONS admin data

Tailored publicservices

● Personal data fordefined & limitedindividual benefit

Fraud● Personal data

tackling fraud(with sunsetclause)

See more on the earlier open policy process with civil society at datasharing.org.uk

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 50/55

Data science ethical framework

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 51/55

1

23

45

Start with clear user need and public benefit

Use data and tools which have the minimum

intrusion necessary

Create robust data science models

Be alert to public perceptions

Be as open as possible

6 Keep data secure

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 52/55

G

Better use of dataOpen data

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 53/55

Open dataData ScienceData literacy and capability

Modernising data infrastructureData discovery tools

APIs

Registers

Data policy and governanceCommon policies and leadership

Possible legislationInternational leadership

ll b i i i i ?

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 54/55

Your collaboration priorities?● Data infrastructure (registers/APIs)● Input to discovery for data discovery tools● Prioritising requests for o pen data tar get datasets● How to develop engagement process with the

whole community● Shared data and appropriate rules of the road● Data science ethics framework● [Data access legislation - via Involve sessions ]

G

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 55/55

Paul Maltby

Director of DataGovernment Digital Service@maltbyps