value of-grey-to-research-business-jeffery-gl conf-2013

The Value of Grey to Research, Business and Society

Keith G [email protected]

©Keith G Jeffery Recognising the value of Grey Literature 20131114 1

STRUCTURE

• Introduction• Grey Literature• Research, Business and Society• The value of ‘grey’• How to achieve that value• Conclusion


STFC Rutherford Appleton Laboratory


CAREER

• Late 60s First UK relational system: G-EXEC

• 70s Filematch: interoperation

• Early 80s Online grants, library, science

• Late80s IDEAS, EXIRPTS• 90s CERIF• 00s e-Science


And the running theme is…

METADATATo describe: Persons (users), Data (including publications), Processes, e-Infrastructure


Which allows….

VIRTUALISATIONThe user neither knows nor cares how her processing is done as long as service levels and quality of service are appropriate


Grey Literature Publications• Jeffery, K G: ‘An Architecture for Grey Literature in a R&D Context’ Proceedings GL'99 (Grey Literature)

Conference Washington DC October 1999 ; TextRelease• Keith G. Jeffery, (2000) "An architecture for grey literature in a R&D context", International Journal on

Grey Literature, Vol. 1 Iss: 2, pp.64 - 72 DOI: 10.1108/14666180010327429• K G Jeffery, A G S Asserson Relating Intellectual Property Products to the Corporate Context; Proceedings

Grey Literature 6 Conference, New York, December 2004; TextRelease; ISBN 90-77484-03-5• Asserson, A; Jeffery, K.G.; ‘Research Output Publications and CRIS’ The Grey Journal volume 1 number 1:

Spring 2005 TextRelease/Greynet ISSN 1574-1796 pp5-8• K G Jeffery, A G S Asserson ‘Grey in the R&D Process’; Proceedings Grey Literature 7 Conference, Nancy,

December 2005; TextRelease; ISBN 90-77484-06-X ISSN 1386-2316• K G Jeffery, A G S Asserson ‘Grey in the R&D Process’; The Grey Journal Vol 2 Number 3 September 2006

ISSN 1574-1796• Keith G Jeffery, Anne Asserson: ‘Hyperactive Grey Objects’ Proceedings Grey Literature 8 Conference

(GL8), New Orleans, December 2006; TextRelease; ISBN 90-77484-08-6. ISSN 1386-2316 ; No. 8-06-X • Keith G Jeffery, Anne Asserson: ‘Hyperactive Grey Objects’ in Robert E Baensch (Ed); Publishing Research

Quarterly Vol 23 Number 1 March 2007; pp 71-77; Springer New York and www.springeronline.com • Keith G Jeffery, Anne Asserson: ‘Greyscape’ Opening Paper in Proceedings Grey Literature 9 Conference

Antwerp (GL9) 10-11 December 2007 pp9-14; Textrelease, Amsterdam; ISSN 1386-2316• Keith G Jeffery, Anne Asserson: ‘Greyscape’ The Grey Journal 4 (3) 2008 pp 137-142 ISSN 1574-1796


http://dx.doi.org/10.1108/14666180010327429

http://www.springeronline.com/

Grey Literature Publications• Keith G Jeffery, Anne Asserson: ‘INTEREST’ Proceedings Grey Literature Conference Amsterdam 8-9

December 2008 in Tenth International Conference on Grey Literature : Designing the Grey Grid for Information Society, 8-9 December 2008, Science Park Amsterdam, The Netherlands ed. by Dominic J. Farace and Jerry Frantzen ; GreyNet, Grey Literature Network Service. - Amsterdam : TextRelease, February 2009. GL-Conference series, ISSN 1386-2316; No. 10. - ISBN 978-90-77484-11-1.

• Keith G Jeffery, Anne Asserson: ‘MOSAIC: Shades of Grey’ Proceedings Eleventh International Conference on Grey Literature Conference Washington DC 15-16 December 2009 Ed Dominic Farace and Jerry Frantzen pp54-58 TextRelease Amsterdam Series ISSN 1386-2316; no 11; ISBN 978-90-77484-13-5

• Keith G Jeffery, Anne Asserson ‘GL Transparency: Through a Glass, Clearly’ Proceedings Twelfth International Conference on Grey Literature, Prague December 2010 Ed Dominic Farace and Jerry Frantzen 95-100, TextRelease Amsterdam Series ISSN 1386-2316; no 12; ISBN 978-90-77484-16-6

• Keith G Jeffery, Anne Asserson ‘GL Transparency: Through a Glass, Clearly’ The Grey Journal, Volume 7, Number 2, pp 99-104 Summer 2011 ISSN 1574-1796

• Keith Jeffery & Anne Asserson: ‘Grey in the Innovation Process’ GL14 2012: In Dominic Farace & Jerry Frantzen (Eds): Proceedings International Conference on Grey Literature November Rome 2012

• Keith Jeffery & Anne Asserson: ‘Grey in the Innovation Process’ The Grey Journal Volume 9, Number 3, Autumn 2013 http://www.greynet.org/thegreyjournal/forthcoming.html

• Keith Jeffery & Anne Asserson: ‘Auditing Grey in a CRIS Environment’ accepted for presentation at GL15 2013 Bratislava December 2013


http://www.greynet.org/thegreyjournal/forthcoming.html

http://www.greynet.org/thegreyjournal/forthcoming.html

Grey Literature Career

• And references to GL in many other publications and presentations

• You will note much of the work has been done jointly with Anne Asserson, University of Bergen Library, whose contributions are hereby acknowledged.


STRUCTURE



GL Questions (Greynet.org)1. What is the definition of grey literature?2. How is grey literature best described?3. Once grey literature is indexed and referenced, does it cease

to be grey?4. Should grey literature be free to access?5. Is grey literature subject to a review process?6. Is the content of commercially published documents superior

to grey?7. Does grey literature constitute a field in information studies?8. Should the average net-user recognize the term grey

literature?9. What problems currently face grey literature?10 What is the impact of grey literature?


What is Grey Literature• "Grey literature stands for

manifold document types produced on all levels of government, academics, business and industry in print and electronic formats that are protected by intellectual property rights, of sufficient quality to be collected and preserved by library holdings or institutional repositories, but not controlled by commercial publishers i.e., where publishing is not the primary activity of the producing body”.– International Conference on

Grey Literature 2010

• That which is not ‘white’– Quality– Institutional holding– Not managed by commercial

publishers

• In fact commonly it is – the IP (intellectual property)– the ‘know how’

Of an organisation

• And is thus more valuable than the ‘white’ literature– which ‘gives away’ the IP


Examples• PhD Thesis • Workshop Reports• Unrefereed conference material• Technical reports

– May be later published as refereed papers

– Possibly after revision• Seminar materials• Learning Materials• Masters Thesis• Technical manuals, instructions

– Usually version controlled

• Records of management decisions– Policy documents– Meeting minutes, agendas

• Marketing material– Usually version controlled

• Computer software• Data not validated independently

• Art artefacts

• Popular articles, interviews, presentation

• Does one include ephemera?


Grey and WhiteExample: Doctoral Thesis

Doctoral Thesis

Doctoral Thesis

Published peer-Reviewedpaper

Published peer-Reviewedpaper

extract

aggregate

The whitest of the grey? (double review)


GL Issues

• Is the process documented?• Does it include review?

– Internal, informal External, formal– By whom?– With what role?

• Is the provenance documented?• Are versions documented?


Quality

• Data (the document or object)– The quality is determined by

• Provenance• Review process

– (internal, [formal | informal])

• Subsequent reconsideration (annotation)

• Metadata– The quality of the metadata determines

• Recall and relevance in retrieval• Access and rights management


Achieving Quality

• Collected as early as possible in the process by people intimately related to the subject

• Quality checked within the process– ISO9001– Some grey literature

critically important for business continuity / risk management


GL and OA• Grey Literature is increasingly stored in an

institutional OA repository by the organisation where it is generated

• Access: metadata must be in standard form and of high quality (minimally OAI-PMH-DC)– Ease of access: recall, relevance– Access restrictions: rights, security

• Object quality: may be measured by hyperlinks from other objects, accesses or downloads– Is this the equivalent of citations


GL Repository Issues

• Measuring impact of grey– Academic– Wealth creation / improvement in quality of life

• Version management• Access management• Rights management• How to distinguish in the repository grey from

green?


GL Repository Issues

• Measuring impact of grey– Academic– Wealth creation / improvement in quality of life

• Version management• Access management• Rights management• How to distinguish in the repository grey from

green?The answer is

: high quality

metadata


CRIS-IRIn 2002 CRIS and IR were different worlds.Progressive integration.Catalogue of IRs in euroCRIS DRISRecognition of value of CERIF as metadata for IROpenAIRE adopted CERIFCOAR strategic relationship

2011 Rome Declaration


Introducing GL and CERIF• CERIF places the grey literature in context• A Result_Publication or Product linked to:

– Project, Person, OrganisationalUnit– Funding– Event– Facility, equipment– Prize/Award

• Which allows the end-user to assess better relevance, quality of grey material

• Which allows research managers to measure output of grey material• Which allows innovators (subject to security) to discover research

products to take to wealth creation or improvement in the quality of life


Introducing GL and CERIF

• A CERIF-CRIS (together with a repository) solves most of the issues documented previously

• By providing a structured, logical context for the grey object

• Within the R&D process• Allowing the end-user to determine quality


STRUCTURE



Value of ResearchThe ability to create, distribute and exploit knowledge has become a major source of competitive advantage, wealth creation and improvements in the quality of life.[OECD 2000]Civilised society has always carried out research. Such research is documented from early Chinese civilisations, and may well have been documented in Neolithic times. Indeed, the paintings in caves such as Lascaux appear to be both an observational record (of local fauna) and a modelling or simulation of intended action (hunting). The key point is that research leads to wealth creation and improvement in the quality of life. The problem is that the process to create wealth or life improvement from research outputs is little understood and apparently non-deterministic. However, there is a general belief that if one documents the research activity, and the research output, then the opportunities for wealth creation or improvement in the quality of life are increased.[Asserson & Jeffery wissenschaftsmanagement 1 • januar/februar • 2009]


R&D Spend

• World annual spend on R&D is ~1.5 trillion usd• This needs to be managed

– By funders to justify spend– By research institutions to justify outputs from

inputs


UK Examples of Impact


Knowledge/ Technology Transfer

• The process from research to:– Wealth creation (business)– Improvement in the quality of life (society)

• Appears to be non-deterministic• However it can be improved by:

– Making information on the research easily available• What it is (with as much context as possible)• How it could be used• Ownership and conditions of use (protecting IP)

The answer is: high quality metadata©Keith G Jeffery Recognising the value of Grey Literature 20131114 28

STRUCTURE



Impact and Grey

• Behind (almost) all impact examples there is a large body of grey material– Technical reports, manuals, datasets, software

IDEA DECISION PATENT

PUBLISH

GREY MATERIAL


Grey Citations


J. Schöpfel, et al. (2005). `Citation Analysis and Grey Literature: Stakeholders in the Grey Circuit'. vol. 1, pp. 31-40

Obstacles to Realising Value

• Difficult to find / utilise the grey material– Not recorded / catalogued– Access restrictions

• IP protection

– Poor metadata• Hard to understand the context of the grey material• Hard to envisage how the research products may be

used for business and/or society

– Lack of classification of kinds of grey• Confuses potential users


STRUCTURE



Policies

• In many countries and institutions there exist policies on research publications:– Usually publicly-funded research should be

available to the public toll-free– Various licensing schemes each with advantages

and disadvantages– Green v Gold

• But they apply to peer-reviewed white publications


Policies

• There are attempts to extend to research datasets– Since they are commonly intimately related to and

support a peer-reviewed white publication• But none for grey• Left to individual institutions

– Repository of scholarly publications– Distinguish grey from white


Towards Policies

• Recognising the value– http://

www.nlm.nih.gov/nichsr/greylitreport_06.html• Access

– Open data (data.gov)• Datasets but in fact many are pdf reports

– Using legislation• Freedom of information requests


http://www.nlm.nih.gov/nichsr/greylitreport_06.html



Achieving Value

• Availability• Relevance• Quality

• Within an organisation• Between partner

organisatons• Open

• Metadata– As well as title, abstract

keywords..– And access restrictions

– Process steps recorded– Context recorded (project,

organisation, person, funding, facilities / equipment)

– Related publications recorded• Related datasets, software

recorded


User Classes

• Research and Development Information– For the political decision-makers– For the funding organisations– For the entrepreneurs– For the researchers– For the research managers– For the innovators– For the media– For the general public


Project

Person / CV

Institution

Event

Equipment

Books

Journal/article

PatentResearch

Group

Publisher

Information of Interest


http://images.google.no/imgres?imgurl=http://www.cse.uconn.edu/icde04/IEEE.logo.jpg&imgrefurl=http://www.cse.uconn.edu/icde04/&h=620&w=500&sz=41&hl=no&start=6&usg=__gKix6EtyKTK__T2nrxLy3MxDXCM=&tbnid=azQAuSc6zeqAXM:&tbnh=136&tbnw=110&prev=/images?q=IEEE+conference&gbv=2&hl=no

http://www.elsevier.com/wps/find/homepage.cws_home

http://www2.wit.ie/Research/ResearchGroupsCentres/groups/macularpigmentresearchgroup/MPR%20GROUP.jpg

Contextual Metadata: CERIF


RESULT_PUBLICATION

PROJECT

ORGUNITPERSON

Result_Publication

Can Express:Person A (DT1 - DT2) (is author of) Publication XOrgunit O (DT1 - DT2) (is owner of IPR in) Publication XPerson A (DT1 - DT2) (is employee of ) Orgunit OPerson A (DT1 - DT2) (is project leader of) Project PPerson A (DT1-DT2) (is member of) Orgunit MPerson A (DT1-DT2) (is member of) Orgunit NOrgunit M (DT1-DT2) (is part of) Orgunit OOrgunit N (DT1-DT2) (is part of) Orgunit O

CERIF Expressiveness


Result_PublicationInstance Diagram

Person A

Publication X

OrgUnit O

OrgUnit M

OrgUnit N

Project P

member

member

employee

Part of

Part of

owns IPRauthor

Project leader


Repositories and CERIF• To view content (white or grey) in repositories through

contextualised, structured metadata – E.g. Relate publication to:

• Persons• Organisations• Projects• Funding• Facilities• Equipment• Event• Patent• Product

• Repository metadata DC (Dublin Core) insufficient• (as recognised by OpenAIREPlus when adopted CERIF)


Allows the user to judge better relevance, quality

CERIF Features• Developed by international community – consensus• Flexible and extensible• Separation of base and link entities

– Flexible / extensible– Rich semantics (role)– Temporal : it is the relationships that have duration

• Multi characterset• Multilingual• Formal Syntax

– Efficient, accurate computer processing• Declared Semantics

– Including crosswalks for interoperation

CERIF


STRUCTURE



Conclusion

• Grey material is a critically important component of information generated by R&D

• It provides the basis for commercial exploitation of R&D

• It provides the basis for improvements in the quality of life

• It needs to be exposed by quality metadata

It is time the value of grey is recognised


EXTRAS IF NEEDED

Metadata Standards• There are hundreds of specific formats used as a ‘standard’ within a specific

community but ones used widely are:

• DC (Dublin Core): used to describe web pages web resources• CKAN (Comprehensive Knowledge Archive Network): used in government

open data sites – based on DC• eGMS; e-Government Metadata Standard – based on DC• DCAT (Data Catalog): used for datasets on the web – based on DC• INSPIRE : used for datasets with geospatial coordinates

– EU Directive and standard; some overlap with DC but extended• CERIF (Common European research Information Format): used for all research

information

• All but CERIF are ‘flat’ or ‘linear’


• Contributor• Coverage• Creator• Date • Description • Format• Identifier• Language• Publisher• Relation• Rights• Source• Subject• Title• Type

• Text• HTML• XML• RDF

• Namespaces• Ontologies

Metadata Standards: DC


• Title• Unique Identifier• Groups• Description• Revision History• Licence• Tags• Multiple Formats• API key• Extra Fields

• RDF

• ontologies

Metadata Standards: CKAN

Blue signifies same as DC©Keith G Jeffery Recognising the value of Grey Literature 20131114 50

Metadata Standards: e-GMS• Accessibility• Addressee• Aggregation• Audience• Contributor• Coverage• Creator• Date• Description• Digital signature• Disposal• Format• Identifier

• Language• Location• Mandate• Preservation• Publisher• Relation• Rights• Source• Status• Subject• Title• Type


Blue signifies same as DC

Metadata Standards: DCAT

Same as DC are:Title, description, identifier, keyword, language


Metadata Standards: INSPIRE

• EU Directive (2008, 2009)• For Geospatial datasets

– Initiated by ESA• Essentially DC plus geospatial information• Geospatial information very detailed –

coordinate system, precision etc


Metadata Standards: CERIF

• Common European Research Information Format• Data Model for exchange and storage of information about

research• CERIF91 (1987-1990) quite like the later Dublin Core (late

1990s)• CERIF2000 (1997-1999) used full E-E-R modelling

– Base entities– Linking entities with role and temporal interval

• 2002 EC requested euroCRIS to maintain, develop and promote CERIF www.eurocris.org

• Now in use in 43 countries and national standard for research information in 10


http://www.eurocris.org/

CERIF-CRIS in context

Publicationrepository

DatasetSoftwarerepository

Finance system

HumanResources

system

Project Management

system

CERIF-CRIS

Web pages DirectoryServices


CERIF Indicators Segment
