CHIP Project @ Rijksmuseum Amsterdam

Cultural Heritage Information PersonalizationCultural Heritage Information Personalization

Eindhoven University of Technology, the NetherlandsEindhoven University of Technology, the NetherlandsLora Aroyo, Paul De Bra, Natalia Stash & Yiwen Wang

Telematica Instituut, the NetherlandsTelematica Instituut, the NetherlandsRogier Brussee, Lloyd Rutledge

Rijksmuseum Amsterdam, the NetherlandsRijksmuseum Amsterdam, the NetherlandsPeter Gorgels

2

Contents CHIP goalCHIP goal Approach to providing personalized Approach to providing personalized

accessaccess CHIP ArchitectureCHIP Architecture CHIP demonstratorsCHIP demonstrators Future Work and LinksFuture Work and Links

Cultural partner: Rijksmuseum Amsterdam

Onlinehttp://www.rijksmuseum.nlInside museum

7000 artworks

50000 artworks

Personalized Art ExperiencePersonalized

Web SitePersonalized Museum Tour

Personalized Tour on a Mobile Device

•Interactive user modeling•Personalization of navigation & presentation

•Printed tour maps through the Rijksmuseum

•Interactive user modeling•Route adaptation inside the Rijksmuseum

Artwork Description

Approach

Making museum metadatametadata available in RDF/OWLin RDF/OWL

Making relevant vocabulariesvocabularies available in in RDF/OWLRDF/OWL

Aligning & enrichingAligning & enriching vocabularies/metadata

Using resulting RDF/OWL graph for building a combined (virtual and physical) user modelcombined (virtual and physical) user model

Using the above results for (semi)automatic generation of virtual and physical museum toursgeneration of virtual and physical museum tours

7

The Semantic Web = Web with a meaning

Information for the slide is taken from http://www.w3schools.com

7

"If HTML and the Web made all the online documents look like one huge book, RDF, schema, and inference languages will make all the data in the world look like one huge database"Tim Berners-Lee, Weaving the Web, 1999

8

Semantic Web: describing relationships

RembrandtCreator

• Rembrandt is the creator of the The Night Watch.• Rembrandt is the student of Peter Lastman.• The Night Watch was created on unprimed canvas.• Peter Lastman is the creator of Orestes and Pylades Disputing at

the Altar.

Student of Material support

Peter Lastman

The Night Watch

Unprimed canvas

Orestes and Pylades Disputing at the Altar

Creator

9

Semantic Web: describing relationships

http://www.getty.edu/vocabularies/ulan#500011051 vra:creator

http://www.getty.edu/vocabularies/ulan#500032894

http://www.chip-project.org/Rijksmuseum#artefactSK-C-5

http://www.getty.edu/vocabularies/aat#300238097

Triples: {Subject, Predicate, Object}

vra:material.support

vra:creator

http://www.chip-project.org/Rijksmuseum#artefactSK-C-5

ulan:student_of

Converting Museum Metadata in RDF/OWL

Rijksmuseum data: ARIA database (Website-targeted)

729 artworks 47,329 triples

Adlib database (Curator-targeted) 16,156 artworks 400,405 triples

Converting Vocabularies in RDF/OWL

provided by E-Culture project (http://e-culture.multimedian.nl)

TGN (#425,517) ULAN (#1,896,936) AAT (#1,249,162)

provided by STITCH project(http://www.cs.vu.nl/STITCH)

IconClass (# 24349)

12

13

Artist: Rembrandt van RijnArtist: Rembrandt van Rijn

14

Style: BaroqueStyle: Baroque

15

Location: AmsterdamLocation: Amsterdam

Aligning Vocabularies

Manual alignment of internal ARIAManual alignment of internal ARIA Rijksmuseum vocabulary to external (Getty and IconClassGetty and IconClass): 2825 mappings to 283 different AATAAT concepts 485 mappings to 263 different ULANULAN concepts 507 mappings to 69 different TGNTGN concepts 503 mappings to 178 different IconClassIconClass concepts

Oil paint Oil paint ARIA: artefactMaterial ARIA: artefactMaterial

Oil paintOil paint AAT: #300015050 AAT: #300015050

Symbolist artSymbolist art ARIA: #encyclopedia/ ARIA: #encyclopedia/00047132 00047132

SymbolistSymbolist AAT:#300021514 AAT:#300021514

Rembrandt Rembrandt ARIA: #artists/00016943ARIA: #artists/00016943

RembrandtRembrandt ULAN: #500011051 ULAN: #500011051Amsterdam Amsterdam ARIA: #Place88668ARIA: #Place88668

AmsterdamAmsterdam TGN: #1092823 TGN: #1092823

SplittingSplitting Rijksmuseum “Location/PeriodLocation/Period” metadata and mapping them to TGN Locations TGN Locations and AAT PeriodsAAT PeriodsAmsterdam, 1625-1650 Amsterdam, 1625-1650 RM: #Atlas157849 RM: #Atlas157849

Amsterdam Amsterdam TGN: #1092823TGN: #1092823

Second quarter of the 17th centurySecond quarter of the 17th century AAT: stylePeriod AAT: stylePeriod

Bible Bible ARIA: #encyclopedia/00046971ARIA: #encyclopedia/00046971

BibleBible IconClass: #7 IconClass: #7

AltarpiecesAltarpieces ARIA: # ARIA: #encyclopedia/00048862encyclopedia/00048862

Altar with altar-pieceAltar with altar-piece IconClass: # IconClass: #11Q71411311Q714113

Aligning Vocabularies

Manual alignment of internal AdLibManual alignment of internal AdLib Rijksmuseum vocabulary to external (GettyGetty): 534 different AATAAT concepts 3846 different ULANULAN concepts

Enriching Rijksmuseum Vocabulary

Adding and mapping AAT StyleAdding and mapping AAT Style metadata to artistsartists Rijksmuseum collection

Van Gogh Van Gogh ULAN: #500115588 ULAN: #500115588 hasStylehasStyle

RealistRealist AAT: #300172861 AAT: #300172861ImpressionistImpressionist AAT: #300021503 AAT: #300021503ExpressionistExpressionist AAT: #300021502 AAT: #300021502

Semantically Enriched Data

20

style: Baroquestyle: Baroque

teacher of: Gerrit Douteacher of: Gerrit Dou

teacher of: Nicolaes teacher of: Nicolaes MaesMaes

teacher of: Ferdinand Bol teacher of: Ferdinand Bol

self-portraitself-portrait

militiamilitia

place: place: Amsterdam, Amsterdam, 1625 to 16501625 to 1650

RDF/OWL Graph for Building User Model

Asking users to rate any Rijksmuseum artwork: first 20 pre-selected by museum curators rest random

Possibility to rate semantic properties of artworks

You Rate - We Recommend

CHIP User Model - Core classes and properties

N-ary relation for Rate

Approaches to Solving Cold Start Problem

Input From FOAF profile External tagging or recommendation

systems profiles, e.g. flickr.com del.icio.us amazon.com iCity (http://icity.di.unito.it/dsa)

Automatically generated tours: “Favorites” tour Positively rated artworks “Recommended artworks” tour 20 top recommended artworks Creating tours manually: Adding artworks and topics to tours Searching for semantically related information

(via E-Culture API) related artists (students or teachers of an artist) artworks created in the same style as artist’s style etc..

Using RDF/OWL Museum Data & User Model for Generation of Museum Tours

CHIP Architecture

27

CHIP Demonstrators

Future Work

Improving existing content-based Improving existing content-based recommendations algorithmrecommendations algorithm

Social aspectsSocial aspects based on FOAF profileFOAF profile Adapting the tour sequenceAdapting the tour sequence on the fly Mobile Guide on iPod TouchMobile Guide on iPod Touch

Links

www.chip-project.orgwww.chip-project.org CHIP demonstration tutorial PDA tour presentation

www.chip-project.org/demowww.chip-project.org/demo