old maps, annotations, and open data networks

Old Maps, Annotations, and Open Data Networks

Bernhard Haslhofer (Cornell University)

...with input from Rainer Simon (Austrian Institute of Technology)

Harvard University, January 2013

Harvard, January 2013

My plan for today...

• Background and Context

• Annotations on Historical Maps

• Maphub Demo + Technical Details

• yuma.min.js / Annotorious

• Next Steps, Ideas, ...

• Related Projects

2

Harvard, January 2013

About me...

• Postdoc at Cornell

• Research in the area of global data networks

• how can open data support scholarship?

• how can scholarly knowledge flow back into open data networks?

3

Harvard, January 2013

The big picture...

4

2007 2013

LEMOLinked Data Annotation ModelAudio, Video, ImagesServer + Flash Clients

Open Annotation Collaboration (OAC)

YUMAOAC ModelAudio, Video, ImagesServer + GWT Clients

yuma.min.js / AnnotoriousAudio, (Zoomable) ImagesJavaScript

yuma4jStorage Server (Java)OAC Model

W3C Open Annotations

maphub(Zoomable) Historic MapsJavaScript, Ruby on Rails

Open KnowledgeFoundation Annotator

Semantic Tagging

Harvard, January 2013

Annotations on Historical Maps

5

Harvard, January 2013

Annotations on Historical Maps

6

Harvard, January 2013

Annotations on Historical Maps

7

Harvard, January 2013

Annotations on Historical Maps

8

Harvard, January 2013

Possible Benefits

• Engage people; let them tell their stories

• Collect knowledge; enhance metadata records

• Connect digitized maps with other Web resources

9

Harvard, January 2013

Maphub Demo + Technical Details

10

Harvard, January 2013

Maphub Screencast

• http://vimeo.com/46114369

11

Harvard, January 2013

Maphub Features

• Geo References + Map Overlays

• Comments + Semantic Tagging

• Multilingual Search

• (Open Annotation) API

12

Harvard, January 2013

Geo References

13

Harvard, January 2013

Geo References

x

y x = a*lat + b*lng + cy = d*lat + e*lng + f

lat = a*x + b*y + clng = d*x + e*y + f

Affine TransformationModel

14

Harvard, January 2013

Map Overlays

• Generate overlay tilesets using GDAL and gdal2tiles.py

/raw/thumbnails/ts_zoomify/ts_google

/scripts/convert.rb... new control points?

15

Harvard, January 2013

Harvard, January 2013

Harvard, January 2013

Harvard, January 2013

Comments on map regions

19

Harvard, January 2013

Semantic Tagging

WikipediaMiner

annotation text

extracted named entities(Wikipedia Links)

20

Harvard, January 2013

Semantic Tagging

21

Resources UsersTags

t1, t2, t3

t1, t4, t5

t6, t7

t1, t6, t7

t1

Label-based Tagging Model Semantic Tagging Model

Resources UsersSemanticTags

Knowledge Context

based on Marlow et al. (2006)

Harvard, January 2013

Multilingual Search

fetch enrichments

(abstract + label translations)

index map metadata + annotations + enrichments

search & retrieval

22

Harvard, January 2013

Maphub API

• Central Maphub information entities:maps, annotations (comments), control points

• Each instance of these entities becomes a first-class Web resource, identified by a URI

• http://maphub.herokuapp.com/maps/355

• http://maphub.herokuapp.com/annotations/1

• http://maphub.herokuapp.com/control_points/1

23

Harvard, January 2013

Maphub API

24

Harvard, January 2013

Open Annotation API

http://sws.geonames.org/

2643743/

http://maphubdev.mminf.univie.ac.at/

control_points/1

oax:Tagging

rdf:type

oax:hasSemanticTagoa:hasTarget

uuid:1235oa:annotator

http://maphubdev.mminf.univie.ac.at

oa:generator

"behas"

foaf:name

"bernhard.haslhofer@cornell.edu"

foaf:mbox

oa:Annotation

rdf:type"2012-07-18T02:

01:07Z"

oa:generated

"2012-07-18T02:01:07Z"

oa:annotated

maphub:GeoReference

rdf:type

uuid:4567

http://samos.mminf.univie.ac.

at/maps/raw/g3200.ct000725C.jp2

oa:SpecificResource

rdf:type

oa:hasSourceuuid:8910

oa:hasSelector

oa:FragmentSelector

rdf:type

xywh=6550,6228,1,1

rdf:value

dcterms:StillImage

rdf:type

image/jp2

dc:format

25

Harvard, January 2013

Open Annotation API

http://maphubdev.mminf.univie.ac.at/

annotations/1

oa:Annotation

rdf:type

oa:hasTarget

uuid:1235oa:annotator

http://maphubdev.mminf.univie.ac.at

oa:generator

"behas"

foaf:name

"bernhard.haslhofer@cornell.edu"

foaf:mbox"2012-07-18T02:

01:07Z"

oa:generated

"2012-07-18T02:01:07Z"

oa:annotated

uuid:4567

http://samos.mminf.univie.ac.

at/maps/raw/g3200.ct000725C.jp2

oa:SpecificResource

rdf:type

oa:hasSource uuid:2752

oa:hasSelector

ct:ContentAsTextrdf:type

image/svg

dcterms:format

dcterms:StillImage

rdf:type

image/jp2

dc:format

oa:hasBody

uuid:2751

cnt:ContentAsText

rdf:type

"text/plain"

dc:format

In antiquity, the Strait of Gibraltar (which connects the Atlantic Ocean with the Mediterranean Sea) was also known by the name \"The Pillars of Hercules\". This is the reason for this inscription!

cnt:chars

dbpedia: Strait_of_Gibraltar

oax:hasSemanticTag

dbpedia: Pillars_of_Hercules

oax:hasSemanticTag

<svg…..>ct:chars

uuid:2753

oa:hasSelector

ct:ContentAsText

rdf:type

application/wkt

dcterms:format

POLYGON((5315 5639,5444….)

ct:chars

26

Harvard, January 2013

Controlpoint Index

http://maphubdev.mminf.univie.ac.at/

control_points

ore:Aggregation

rdf:type

http://maphubdev.mminf.univie.ac.at/

control_points/1

http://maphubdev.mminf.univie.ac.at/

control_points/....

ore:aggregates

ore:aggregates

Maphub Controlpointsdc:title

27

Harvard, January 2013

Annotation Index

http://maphubdev.mminf.univie.ac.at/

annotations

ore:Aggregation

rdf:type

http://maphubdev.mminf.univie.ac.at/

annotations/1

http://maphubdev.mminf.univie.ac.at/

annotations/5

ore:aggregates

ore:aggregates

Maphub Commentarial Annotationsdc:title

28

Harvard, January 2013

Next Steps, Ideas, ...

29

Harvard, January 2013

Semantic Tagging Study

• Effects of semantic tagging on

• comments, tag usage / types

• user satisfaction

• in-lab user experiment

• currently in-progress @ Cornell

30

Harvard, January 2013

Maphub Construction Areas

• Infrastructure stability

• GIS functionality + overlay generation

• Learning from Semantic Tagging (accept/reject)

• Annotation moderation

• ...

31

Harvard, January 2013

Possible Extensions

• Semi-automatic annotation (toponym detection) (http://rsimon.github.com/toponym_identification/)

Josephinische Landesaufnahme: Gebiet von Mooskirchen bis Grazer Feld, Steiermark, Österreich, 1764-1787. Wikimedia Commons.

32

Harvard, January 2013

Possible Extensions

• Semantic Tagging with placenames from different Gazetteers

• http://pleiades.stoa.org

• Pleiades dataset (http://thedatahub.org/dataset/pleiades)

• 34,000+ ancient places

• cool URIs for these resources

• http://pelagios-project.blogspot.com

33

Harvard, January 2013

Related Projects

34

Harvard, January 2013

Annotorious

35

• Light-weight image annotation library; no big client/server framework

• Adds annotation features to existing Web pages<html>

<head> <link rel="stylesheet" type="text/css" href="css/annotorious.css" /> <script type="text/javascript" src="annotorious.min.js"></script> </head>

<body> <img src="example.jpg" class="annotatable" /> </body>

</html>

Harvard, January 2013

Annotorious

36

• Plugin-Framework

• Different storage backends and GUI components (Tags, Replies)

• Additional selectors

• Interoperable with OKFN Annotator

https://github.com/annotorious/annotorious

Harvard, January 2013

Lucene-SKOS

• Plugin for Apache Lucene / Solr

• Works with SKOS-based knowledge contexts

• Uses semantic tags (links to SKOS concepts) for query expansion

• query time

• indexing time

37

https://github.com/behas/lucene-SKOS

Harvard, January 2013

References

• Haslhofer et al. (2007): The LEMO annotation framework: weaving annotations with the Web (IJDL)

• Haslhofer et al. (2010): Augmenting Europeana Content with Linked Data Resources (I-Semantics)

• Simon et al. (2011): Semantically augmented annotations in digitized map collections (JCDL)

• Haslhofer et al. (2012): Open Annotations on Multimedia Web Resources (MTAP)

• Haslhofer et al. (2013): Old Maps and Open Data Networks (iConference Demo / Poster)

38

Harvard, January 2013

Further Information

39

http://maphub.github.com

Thank you!

Harvard, January 2013

Acknowledgements (Maphub)

• Rainer Simon

• Werner Robitza

• Keith Newman

• Amanda Stefanik

• Carl Lagoze

• Francois Guimbretiere

40