royal netherlands academy of arts and sciences narcis, integrating cris, oai and web crawling elly...

33
Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of Research Information CRIS 2006 Bergen (Norway), 11-13 May 2005

Upload: liliana-barker

Post on 02-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

NARCIS, Integrating CRIS, OAI and Web Crawling

Elly Dijk, Arjan Hogenaar and Marga van MeelDepartment of Research Information

CRIS 2006Bergen (Norway), 11-13 May 2005

Page 2: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Outline

• KNAW Research Information• NARCIS- Background of the NARCIS project- Content of NARCIS- Advantages for the users- NARCIS techniques- End-users tests- Future plans

Page 3: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

KNAW Research Information

• National focal point research information• Dutch Research Database (NOD) – the

national CRIS• Scientific communication (thematic databases,

overview articles; e.g. about nanotechnology)• Research information system and repository

of the Academy• Development of NARCIS…

Page 4: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

What is NARCIS?

Page 5: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

NARCIS is a portal that combines:

• Structured research information, about current research, researchers, and research institutes• Information from academic repositories, (full text) publications, and others research results• Information from websites of research institutes: datasets, digital publications, and news items• All these types of information are searchable at the same time.

Page 6: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Partners in the NARCIS project• Royal Netherlands Academy of Arts and Sciences (KNAW), department of Research Information• Netherlands Organisation for Scientific Research (NWO)• Association of Universities in the Netherlands (VSNU)• Information Centre of the Radboud University of Nijmegen, (RU-UCI)

•Funded by the DARE programme

Page 7: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

DARE: Digital Academic REpositories

• Joint initiative by the Dutch universities, the KNAW, NWO and the National Library• DAREnet gives free access to academic research output in the Netherlands. • DAREnet contains now about 70.000 digital files from 16 institutes

Page 8: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Goals of the NARCIS project

• Giving an overview of research in the Netherlands• Central place for searching all the different types of data• Data collection via the already existing administrative systems of the participating institutes• Registering of data once only• Minimization of administrative report burden for researchers and institutes

Page 9: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Page 10: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Content of NARCIS

Information on 400,000 items:

Research institutes - profiles, addresses, programmes, projects Researchers - expertise, addresses, projects, publications Research activities - research programmes and projects (web) publications - metadata, full text Datasets - metadata News items - webpages of research institutes

Page 11: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Advantages for the users

• The different types of research information are searchable at the same time (one-stop-shopping)• Free access to Dutch academic full text publications and other research results• Up-to-date information: data gathered in an early stage of the registration process• High quality information: editors select the sources of NARCIS• Overview of Dutch scientific output•Scientific information also from repositories and websites

Page 12: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Page 13: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

NARCIS: part two

• Technical background

• User Surveys

• Future Developments

Page 14: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Applied Techniques

•METIS-NARCIS exchange schema

•NWOdelfi-METIS interface

•OAI-PMH

•Web-crawling

•Collexis categorising

•RSS

Page 15: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

METIS

• Dutch Research Information System

• Used by all Dutch universities

• For both research management and information supply

• Information on research groups, individual researchers, research output

Page 16: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Exchanging METIS info

• XML-schema (CERIF-based) developed by KNAW, NWO and RU; Implemented in METIS

• For service-provider accessible via URL

• XML-export to service provider automatically generated

• Data-provider no longer needs to create reports of new entered research projects in its METIS-system

Page 17: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Interface NWOdelfi-METIS

• enables xml-data exchange between METIS and NWOdelfi (with a copy to NARCIS)

• uses webservices with xml-SOAP

Page 18: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Advantages of the interface

•minimization of administrative report burden:

- NWO granted projects sent automatically to the university-METIS systems (with a CC to NARCIS)

- In METIS-system entered research output data (bibliographic descriptions of publications) automatically sent to NWO (with a CC to NARCIS)

Page 19: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting)

• Darenet is a good example

• protocol for harvesting metadata descriptions (xml-documents) of full-text records in a repository

Page 20: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Web-crawling

• used for harvesting of data not available via METIS or NWO or repositories

• focused on non-university research institutes

• J-spider based

• spidering of news-items and of ‘web-publications’ (i.e. digital publications available on webpages of research institutes)

Page 21: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Categorising

• indexing all the data retrievable via NARCIS via one terminology system

• Dutch Research Database classification system is used

• first attempt: via Lucene search engine

• now: via Collexis software

Page 22: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

METIS

Webpages Institutional Repositories

NARCIS

Web-formsNWO

NOD

Categorizer

Page 23: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Notification tool: RSS feed• content RSS-feed normally news-provider based (see BBC RSS-feed)

• In NARCIS: RSS-feed search action based

• User decides which information he regularly will be notified on

Page 24: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

User Surveys

Page 25: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Preliminary results• two user surveys conducted:

• amongst repository specialists (library personnel)• amongst researchers, policy advisors and science

education officers

• goals of the survey:• impression and functionality of the NARCIS homepage• search and limit functionality test• imput for further improvement of the site

Page 26: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Outcomes user surveys :1

• NARCIS-webview appreciated

• Retrieval of web publications is value adding service

• Quality of research information is high

• Broad range of search options and search performance

Page 27: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Outcomes user surveys : 2

• complexity of NARCIS-portal urges a need for extra clarification of the possibilities of the contents and search tools

• limiting options too complicated

• users see NARCIS as a new independent information system, instead as a shell around existing ones

• presenting search results not only by relevance but also chronologically

Page 28: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Outcomes user surveys : 3

• presentation of information that has been spidered leads to some confusion

Page 29: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Page 30: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Future developments: technical

• automatic categorisation of the contents via Collexis

• working with Digital Identifiers (for authors, institutes and objects) in order to connect the Dutch CRIS systems to the repositories

• including CV-information of Dutch research into NARCIS (PROMAS)

Page 31: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Future developments: organisational

• installation of a NARCIS Advisory Board, formed by

• KNAW• NWO• VSNU• plus: SURF

• the Advisory Board will decide in which way NARCIS will be developed

Page 32: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Conclusions

• national research information portal

• 400,000 items

• many different information types

• one stop shopping

• RSS-feed

• new xml exhange schema

Page 33: Royal Netherlands Academy of Arts and Sciences NARCIS, Integrating CRIS, OAI and Web Crawling Elly Dijk, Arjan Hogenaar and Marga van Meel Department of

Royal Netherlands Academy of Arts and Sciences

Poster presentations: during the breaks

WWW.NARCIS.INFO