netarchive suite at the bne. juan carlos garcía arratia y mar pérez morillo
DESCRIPTION
Descripción del sistema de archivado web en la Biblioteca Nacional de EspañaTRANSCRIPT
![Page 1: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/1.jpg)
Título de la presentación
NetarchiveSuite at the BNE
Juan Carlos García Arratia – Chief of IT Development Service, NLS
Mar Pérez Morillo – Chief of Web Service, NLS
IIPC GA Paris 2014, 22nd May
1
![Page 2: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/2.jpg)
Título de la presentación
Table of contents
1. Starting point
2. Non-print Legal Deposit regulation
3. Agreement with Red.es
4. Why NAS?
5. Installation of test environment
6. First test crawls
7. Specifications and needs
8. What we expect
2
![Page 3: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/3.jpg)
Título de la presentación
1. Starting point
With Internet Archive (2009-2013):
o 8 domain crawls
o 2 selective crawls:
• General Elections 2011
• Humanities
o Total: ± 100 TB
Collection delivery (Red.es)
3
![Page 4: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/4.jpg)
Título de la presentación
Allegations answered
• Ministery of Education and Culture
• Stakeholders (publishers and content providers)
• Public information
Last step of the process
Enactment expected by the end of the year
4
2. Non-print Legal Deposit Regulation
![Page 5: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/5.jpg)
Título de la presentación
Strong investment:
Network
Storage
Servers
5
3. Red.es
![Page 6: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/6.jpg)
Título de la presentación
4. Why Netarchive Suite?
Other tools considered
Whole lifecycle covered
First workshop on NAS at Vienna
BnF, as a model:
o Legal deposit law
o Similar starting point with IA
o National domain
o Size of the French web
Ability of sharing tools and experiences
Community of users and developers (Denmark, Austria)
Modularity
6
![Page 7: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/7.jpg)
Título de la presentación
5. Installation of test environment
Summer 2013: pilot installation 6 servers
1st crawl: internal administrative network
Lack of documentation
Problems understanding configuration profiles
Need of strong network security
7
![Page 8: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/8.jpg)
Título de la presentación
6. First test crawls
Mining Historical Archive (Archivo Histórico Minero)
Death of Adolfo Suárez
Death of Gabriel García Márquez
8
URL únicas Tamaño GB
ADOLFO SUAREZ 322.722 37,66
ADOLFO ESPECIALES 344.418 9,65
ADOLFO INTERNACIONAL 19.509 0,25
ADOLFO QA 32.326 1,86
TOTAL 718.975 49,42
URL únicas Tamaño GB
García Márquez 455.581 7,38
![Page 9: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/9.jpg)
Título de la presentación
6.1 Archivo Historico Minero www.archivohistoricominero.org
9
![Page 10: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/10.jpg)
Título de la presentación 10
6.2. Death of Adolfo Suárez
![Page 11: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/11.jpg)
Título de la presentación
6.3. Ongoing crawls
Regional Governments proposals
European Elections
11
![Page 12: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/12.jpg)
Título de la presentación
http://bns08.bne.local/HarvestDefinition/Definitions-selective-harvests.jsp
12
NAS at the BNE
![Page 13: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/13.jpg)
Título de la presentación
7. Specifications and needs
13
![Page 14: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/14.jpg)
Título de la presentación
7.1. National cooperation
Designing a workflow in a collaborative environment
Legal deposit purposes
Using administrative Network
Need of common interface for proposals
14
![Page 15: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/15.jpg)
Título de la presentación
7.2. Web content curators at the Library
Internal and external curators
Interface to share
Easier to use for librarians
New reason to choose NAS…
15
![Page 16: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/16.jpg)
Título de la presentación
16
BCWeb
![Page 17: Netarchive Suite at the BNE. Juan Carlos García Arratia y Mar Pérez Morillo](https://reader034.vdocuments.site/reader034/viewer/2022042815/557da589d8b42acb768b46c3/html5/thumbnails/17.jpg)
Título de la presentación
8. What we expect
17
Better understanding of templates and configuration
Dashboard for Quality Assurance:
o to show big figures to monitor crawl status
Modularity
o Fine tuning