friday lunchtime lecture: open data and the government data programme

8/20/2019 Friday lunchtime lecture: Open data and the Government Data Programme

http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 1/55

ODI Friday Lunchtime Lecture

8 January 2016

Paul MaltbyDirector of Data

Government Digital Service@maltbyps



In the last Parliament our dataapproach was dominated by

open data

G



We did okay

G



G



The data user communityworked wonders

G


http://slidepdf.com/reader/full/friday-lunchtime-lecture-open-data-and-the-government-data-programme 6/55G



Now we need to focus onquality , not just quantity

G



Driving data quality by dog-fooding within government

G



And concentrating on shared data, not just open data

G



We have a new GovernmentData Programme aiming totransform how data is usedacross public services

G



G

Too much government data isDuplicatedIn many different formatsHard to reachHard to maintainHard to put to good use



G

Our aim = better digital services



G

Our aim = good policy and

operational decisions



G

Our aim = economic benefits



G

Our aim = public trust & security



G

The Government DataProgramme has 3 workstreams



1. Better use of dataOpen data

Data ScienceData literacy and capability

G

https://gdsdata.blog.gov.uk/2014/08/15/ambassador-twitter-networks/



@cgchristrottConsul General, Cape Town, SA

Data science opportunities:Unstructured data and

visualisationsG








http://www.mastodonc.com/




Data Science & the Civil Service

Data science opportunities:Clustering and prediction

G






There is some unfinishedbusiness on open data

G

http://www.skillsroute.com/



http://www.skillsroute.com/



We want to maintain inputfrom external users to keep

driving the open data agenda

G



Creating mainstream datascience capability amonganalysts in government, withONS

G



GDS will be supporting this,including through data literacy

for non-data specialists

G



2. Modernising datainfrastructure

Registers APIsData access tools

G



G

companies, charities, trade unions, courts, schools,universities, hospitals, zoos, circuses, inspections,

licences, certificates, births, marriages, deaths,electoral roll, insolvencies, bankruptcies, passports,animal passports, drivers, vehicles, land parcels,land ownership, land use, legal boundaries, awards,

tax rates, benefits, livestock movements, flood risk,river levels, companies, fish caught, patents,trademarks, designs, non-native invasive plants,bank holidays, food standards, clock changes …



“SCOLAND UK”“SCOTALND UK”“SCOTKLAND UK”“SCOTLAD UK”“SCOTLAND”“SCOTLAND UK”

“SCOTLAND UK”“SCOTLAND UNITED KINGDO”“SCOTLAND UNITED KINGDOM”“SCOTLAND UNITED KINGODM”

“SCOTLAND, UK” G



Registers are more than just a list

G

https://gds.blog.gov.uk/2015/10/13/the-characteristics-of-a-register/



G

● Persistent & canon● Minimum viable da● A service, not a lis● Integrity of history

● Open / shared / pr







https://gdstechnology.blog.gov.uk/2015/10/13/guaranteeing-the-integrity-of-a-register/


https://gds.blog.gov.uk/2015/09/01/registers-authoritative-lists-you-can-trust/



G





G

Starting with commonlyreferenced registers such as

● Countries● Companies (limited companies,

charities, sole traders)● Local authorities● Schools● Addresses



Creating an API infrastructureacross government and, where

appropriate, to users outside

G



Reducing the need for bulkdata sharing in government

G



Moving away fromdownloading and emailing dataaround Whitehall

G



And disks in the post

G



(but we know how importantbulk availability of data is forsome external users via data.

gov.uk)

G



We’re also starting to thinkabout better data discoverytools - both inside and outside

government

G

https://data.gov.uk/



G





There are currently no tools forcivil servants to know whethernon-open data exists across

government

G



Never mind knowing whetherthey can or should access it

G



Or having tools available tohelp them query the data orprovide basic manipulation, eg

plot on a map

G



A discovery process on toolingwill start soon - we will bedoing user research with users

inside and outside government

G



3. Data policy and governanceCommon policies and leadershipPossible legislationInternational leadership

G



G

A new Ministerial Group onDigital Transformation -including data



An external Steering Groupchaired by National StatisticianJohn Pullinger

G



Open Data Institute keepingour feet to the fire andconnected with external datausers

G



G

At the heart of the programmesenior Data Leaders drawn fromacross government



Agreeing:

Common policies (eg external sharing)Data standardsResponsibility for registers

Opportunities for collaboration

And leading the new data vision

across WhitehallG



Possible new da ta a ccess legislation?

G

Research andstatistics

● HMRC● ADRNs● ONS admin data

Tailored publicservices

● Personal data fordefined & limitedindividual benefit

Fraud● Personal data

tackling fraud(with sunsetclause)

See more on the earlier open policy process with civil society at datasharing.org.uk

http://datasharing.org.uk/

http://datasharing.org.uk/

https://theodi.org/data-spectrum



Data science ethical framework

https://theodi.org/data-spectrum



1

23

45

Start with clear user need and public benefit

Use data and tools which have the minimum

intrusion necessary

Create robust data science models

Be alert to public perceptions

Be as open as possible

6 Keep data secure

G



G

Better use of dataOpen data



Open dataData ScienceData literacy and capability

Modernising data infrastructureData discovery tools

APIs

Registers

Data policy and governanceCommon policies and leadership

Possible legislationInternational leadership

ll b i i i i ?



Your collaboration priorities?● Data infrastructure (registers/APIs)● Input to discovery for data discovery tools● Prioritising requests for o pen data tar get datasets● How to develop engagement process with the

whole community● Shared data and appropriate rules of the road● Data science ethics framework● [Data access legislation - via Involve sessions ]

G

http://datasharing.org.uk/category/meeting-invitations/

http://datasharing.org.uk/category/meeting-invitations/



Paul Maltby

Director of DataGovernment Digital Service@maltbyps

friday lunchtime lecture: open data and the government data programme

Documents