Information, data and metadata: Information, data and metadata: why they need to be managedwhy they need to be managed

MeMe

Information Systems professional

Data Manager

Soldier

Engineer

Teacher

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

EquipmentEquipmentEquipment

Key business resourcesKey business resources

MoneyMoneyMoneyPeoplePeoplePeople

BuildingsBuildingsBuildings

What is Missing?

INFORMATIONINFORMATIONINFORMATION

EquipmentEquipmentEquipment

Key business resourcesKey business resources

MoneyMoneyMoneyPeoplePeoplePeople

BuildingsBuildingsBuildings

Information?Information?

Information is a business resource

which supports: Strategic planning for

the future

Management of the business

Operational tasks and activities

Information?Information?

It is the quality of the information which determines whether it is an asset or a liability to the business

Information must be ~~ Up-to-date and complete~ Sufficiently accurate for the purpose~ Available when required

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

Information v Data?Information v Data?

Extract from The Guardian

Information v Data?Information v Data?

Information v Data?Information v Data?

Information?

Information v Data?Information v Data?

190267

Information = data in context

DataData

InformationInformation

Information or Data?Information or Data?

Data is a re-interpretable representation of information in a formalised manner suitable for communication, interpretation or processing

Knowledge about objects. etc

Information

Representation of information

Data

Subject of information

Information

Interpretation of data

DataStorage and processing

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

What is Metadata?What is Metadata?

"Metadata is data about data"

metadata for data management

metadata for content management

metadata for describing data values

Data v metadata?Data v metadata?

Author:

Title:

Publisher:

Publication date:

ISBN:

GORDON, Keith

Principles of Data Management: Facilitating

British Computer Society

August 2007

978-1-902505-84-8

Information Sharing

For a Librarian, this is MetadataFor a Librarian, this is Metadata

Data v metadata?Data v metadata?

Author:

Title:

Publisher:

Publication date:

ISBN:

GORDON, Keith

Principles of Data Management: Facilitating

British Computer Society

August 2007

978-1-902505-84-8

Information Sharing

For a Data Manager, this is DataFor a Data Manager, this is Data

For a Data Manager, this is MetadataFor a Data Manager, this is Metadata

Data v metadata?Data v metadata?

ISBN Author Title Pub Pub Date

978-1-902505-84-8 Gordon, Keith Principles of … BCS 2007-08-17

Or, as data in a table:

For a Librarian, this is MetadataFor a Librarian, this is Metadata

Data v metadata?Data v metadata?

ISBN Author Title Pub Pub Date

978-1-902505-84-8 Gordon, Keith Principles of … BCS 2007-08-17

Or, as data in a table:

For a Data Manager, this is DataFor a Data Manager, this is Data

For a Data Manager, this is MetadataFor a Data Manager, this is Metadata

Gordon, Keith Light Brown Hazel Yes 1943-12-05

Name Picture Hair Colour Eye Colour Spectacles Birthdate

Data v metadata?Data v metadata?

Describing values?

Is this metadata?Is this metadata?

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

Data Problems?Data Problems?

Inability to share data

Poor data definition

Poor data quality

A data problem?A data problem?

Personnel

Customer

FinanceMarketingSales

A data problem?A data problem?

CustomerOrderplacer of

placed by

Each Customer may be placer of one or more Orders

CustomerOrderplacer of

placed by

Each Customer must be placer of one or more Orders

ICT Department

Marine Operations

Landside Operations

Secretariat

Human Resources

Police Marketing

Port Safety

Engineering

FinanceCustoms

PIMS

SOS

Damage ReportsMainSave

Clearway

Extra

A data problem?A data problem?

Arrivals Displays

Truckstop

Departures

DACSInformation

Signs

Weighbridge Signs

Embarkation Lounge Signs

WB DataPAXISUTP

Portana Audit Work SystemEMS

MVI Export plus 25 others!

CPP Permits

GeoffreyPolice DB Tourist Parking

?

SSPRSirius

Sun 5

Room Reservations

WIS-IntOODB

CIPHR

A data problem?A data problem?

THPA_Code

Weapon_Count

A data problem?A data problem?

Call centres!

A data problem?A data problem?

Harrier?

Challenger?

A data problem?A data problem?

Friendly fire?

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

Data Management

What is Data Management?What is Data Management?

… a corporate service which helps with the provision of Information Services by controlling and/or co-ordinating the definitions and usage of reliable and relevant data

Strategically -- it supports the

corporate definition, management and use of business data

Operationally -- it supports the

development and maintenance of computerised systems

Data management goalsData management goals

1) To achieve recognition of data as a valuable resource

2) To improve the quality of data

3) To facilitate data sharing across the business

4) To make line management accountable for data definition

5) To achieve a single source for reference data

Data management activitiesData management activities

Education

DataManagement

Policy andStrategy

DataIdentification

(Models)(Standards)(Ownership)

InformationService

SystemDevelopment

Support

DataManagement

Tools

Co-ordination

Facilitation

Education

DataManagement

Policy andStrategy

DataIdentification

(Models)(Standards)(Ownership)

InformationService

SystemDevelopment

Support

DataManagement

Tools

Co-ordination

Facilitation

Corporate data modelIdentified data ownersApproved data definitions

Corporate data modelIdentified data ownersApproved data definitions

Data management deliverablesData management deliverables

Policy documentsPlans

Policy documentsPlans

Quality assured data modelsDatabase schema

Quality assured data modelsDatabase schema

Managed set of repositories and dictionariespopulated to standards

Managed set of repositories and dictionariespopulated to standards

Knowledge baseCo-ordination of data usage

Knowledge baseCo-ordination of data usage

Training coursesSeminarsArticles

Training coursesSeminarsArticles

The relationship to the businessThe relationship to the business

BusinessBusiness

SteerSteerDriveDrive

Education

DataManagement

Policy andStrategy

DataIdentification

• Models• Standards• Ownership

InformationService

SystemDevelop-

mentSupport

DataManagement

Tools

Co-ordination

Facilitation

Terms ofReferenceData

ManagementData

Management

Database Administration

Data Administration

Data Management

Data Management RolesData Management Roles

Repository Administration

Data management responsibilitiesData management responsibilities

Data AdministrationCorporate data modelling

Metadata

Data quality

Educating the enterprise

Database AdministrationDatabase design

DBMS selection

Data accessibility

Performance and measurement

Repository AdministrationDBA responsibilities + metadata

Data administration skillsData administration skills

Background Knowledgeof the Organisation

Expertise in Methods and TechniquesData AnalysisDatabase DesignSystems Development MethodologiesData Dictionaries / Repositories

Interpersonal SkillsCommunicationNegotiationArbitration

Lateral Thinking

Information managementInformation management

Data Management

Information Management

Derived from “Data Management” (CCTA)

BusinessInformation

Support

ProcessManagement

DataAdministration

DatabaseAdministration

RepositoryAdministration

SystemManagement

Current data management themesCurrent data management themes

Data Governance

Enterprise Information Management (EIM)

Customer Data Integration (CDI)

Information quality

Master Data Management (MDM)

Data Quality ImportanceSemantic Content

Volume of DataLate Population

Shorter Life Span

Master Data Management (MDM)Master Data Management (MDM)The authoritative, reliable foundation for data used across many applications

and constituencies with the goal to provide a single version of the truth

Master Data = Reference Data

(code tables, taxonomies)+ Transaction Structure Data

(product, customer)+ Enterprise Structure Data

(CoA, organisation structure)

Metadata

Reference Data

Transaction Structure Data

Most Relevantto Technology

Most Relevantto Business

Most Relevantto Outside World

Most Relevantto Design

Enterprise Structure Data

Transaction Activity Data

Transaction Audit Data

Metadata

Reference Data

Transaction Structure Data

Enterprise Structure Data

Transaction Activity Data

Transaction Audit Data

Customer Data Integration (CDI)Customer Data Integration (CDI)

Processes and technologies for recognising a customer and its relationships at any touch-point

360-degree view of Customer?

Single view of Customer?

Information qualityInformation quality

The fitness for use of information; information that meets the requirements of its authors, users, and administrators

Data quality wearing a new dress?

Data GovernanceData Governance

The formal orchestration of people, process and technology to enable an organisation to leverage data as an enterprise asset

Sarbanes-Oxley (2002)Public Company Accounting Reform and Investor Protection ActSOX

Basel II (2004)

Markets in Financial Instruments Directive (MiFID) (2007)

Driven by regulations, for example:

Data Protection Act (1998)

Enterprise Information Enterprise Information Management (EIM)Management (EIM)

The authoritative, reliable foundation for data used across many applications and constituencies with the goal to provide a single version of the truth

Data management wearing a new dress?

AgendaAgenda

Why the interest in information?

Information v data?

Data v metadata?

Why we need to manage data?

What is Data Management?

Any questions?

“The beginning of wisdom is the definition of terms”

Socrates

“There is nothing more difficult to take in hand, more perilous to conduct or more uncertain in its success than to take the lead in the introduction of a

new order of things”Niccolo Machiavelli, The Prince

The book:Principles of Data Principles of Data ManagementManagementFacilitating Information SharingFacilitating Information SharingKeith Gordon