old maps, annotations, and open data networks

Old Maps, Annotations, and Open Data Networks

Bernhard Haslhofer (Cornell University)

...with input from Rainer Simon (Austrian Institute of Technology)

Harvard University, January 2013

Harvard, January 2013

My plan for today...

• Background and Context

• Annotations on Historical Maps

• Maphub Demo + Technical Details

• yuma.min.js / Annotorious

• Next Steps, Ideas, ...

• Related Projects

2


About me...

• Postdoc at Cornell

• Research in the area of global data networks

• how can open data support scholarship?

• how can scholarly knowledge flow back into open data networks?

3


The big picture...

4

2007 2013

LEMOLinked Data Annotation ModelAudio, Video, ImagesServer + Flash Clients

Open Annotation Collaboration (OAC)

YUMAOAC ModelAudio, Video, ImagesServer + GWT Clients

yuma.min.js / AnnotoriousAudio, (Zoomable) ImagesJavaScript

yuma4jStorage Server (Java)OAC Model

W3C Open Annotations

maphub(Zoomable) Historic MapsJavaScript, Ruby on Rails

Open KnowledgeFoundation Annotator

Semantic Tagging


Annotations on Historical Maps

5



6



7



8


Possible Benefits

• Engage people; let them tell their stories

• Collect knowledge; enhance metadata records

• Connect digitized maps with other Web resources

9


Maphub Demo + Technical Details

10


Maphub Screencast

• http://vimeo.com/46114369

11

http://vimeo.com/46114369

http://vimeo.com/46114369


Maphub Features

• Geo References + Map Overlays

• Comments + Semantic Tagging

• Multilingual Search

• (Open Annotation) API

12


Geo References

13


Geo References

x

y x = a*lat + b*lng + cy = d*lat + e*lng + f

lat = a*x + b*y + clng = d*x + e*y + f

Affine TransformationModel

14


Map Overlays

• Generate overlay tilesets using GDAL and gdal2tiles.py

/raw/thumbnails/ts_zoomify/ts_google

/scripts/convert.rb... new control points?

15


Comments on map regions

19


Semantic Tagging

WikipediaMiner

annotation text

extracted named entities(Wikipedia Links)

20


Semantic Tagging

21

Resources UsersTags

t1, t2, t3

t1, t4, t5

t6, t7

t1, t6, t7

t1

Label-based Tagging Model Semantic Tagging Model

Resources UsersSemanticTags

Knowledge Context

based on Marlow et al. (2006)


Multilingual Search

fetch enrichments

(abstract + label translations)

index map metadata + annotations + enrichments

search & retrieval

22


Maphub API

• Central Maphub information entities:maps, annotations (comments), control points

• Each instance of these entities becomes a first-class Web resource, identified by a URI

• http://maphub.herokuapp.com/maps/355

• http://maphub.herokuapp.com/annotations/1

• http://maphub.herokuapp.com/control_points/1

23

http://maphub.herokuapp.com/maps/355

http://maphub.herokuapp.com/maps/355

http://maphub.herokuapp.com/annotations/1

http://maphub.herokuapp.com/annotations/1

http://maphub.herokuapp.com/control_points/1

http://maphub.herokuapp.com/control_points/1


Maphub API

24


Open Annotation API

http://sws.geonames.org/

2643743/

http://maphubdev.mminf.univie.ac.at/

control_points/1

oax:Tagging

rdf:type

oax:hasSemanticTagoa:hasTarget

uuid:1235oa:annotator

http://maphubdev.mminf.univie.ac.at

oa:generator

"behas"

foaf:name

"[email protected]"

foaf:mbox

oa:Annotation

rdf:type"2012-07-18T02:

01:07Z"

oa:generated

"2012-07-18T02:01:07Z"

oa:annotated

maphub:GeoReference

rdf:type

uuid:4567

http://samos.mminf.univie.ac.

at/maps/raw/g3200.ct000725C.jp2

oa:SpecificResource

rdf:type

oa:hasSourceuuid:8910

oa:hasSelector

oa:FragmentSelector

rdf:type

xywh=6550,6228,1,1

rdf:value

dcterms:StillImage

rdf:type

image/jp2

dc:format

25


Open Annotation API


annotations/1

oa:Annotation

rdf:type

oa:hasTarget

uuid:1235oa:annotator

http://maphubdev.mminf.univie.ac.at

oa:generator

"behas"

foaf:name

"[email protected]"

foaf:mbox"2012-07-18T02:

01:07Z"

oa:generated

"2012-07-18T02:01:07Z"

oa:annotated

uuid:4567

http://samos.mminf.univie.ac.

at/maps/raw/g3200.ct000725C.jp2

oa:SpecificResource

rdf:type

oa:hasSource uuid:2752

oa:hasSelector

ct:ContentAsTextrdf:type

image/svg

dcterms:format

dcterms:StillImage

rdf:type

image/jp2

dc:format

oa:hasBody

uuid:2751

cnt:ContentAsText

rdf:type

"text/plain"

dc:format

In antiquity, the Strait of Gibraltar (which connects the Atlantic Ocean with the Mediterranean Sea) was also known by the name \"The Pillars of Hercules\". This is the reason for this inscription!

cnt:chars

dbpedia: Strait_of_Gibraltar

oax:hasSemanticTag

dbpedia: Pillars_of_Hercules

oax:hasSemanticTag

<svg…..>ct:chars

uuid:2753

oa:hasSelector

ct:ContentAsText

rdf:type

application/wkt

dcterms:format

POLYGON((5315 5639,5444….)

ct:chars

26


Controlpoint Index


control_points

ore:Aggregation

rdf:type


control_points/1


control_points/....

ore:aggregates

ore:aggregates

Maphub Controlpointsdc:title

27


Annotation Index


annotations

ore:Aggregation

rdf:type


annotations/1


annotations/5

ore:aggregates

ore:aggregates

Maphub Commentarial Annotationsdc:title

28


Next Steps, Ideas, ...

29


Semantic Tagging Study

• Effects of semantic tagging on

• comments, tag usage / types

• user satisfaction

• in-lab user experiment

• currently in-progress @ Cornell

30


Maphub Construction Areas

• Infrastructure stability

• GIS functionality + overlay generation

• Learning from Semantic Tagging (accept/reject)

• Annotation moderation

• ...

31


Possible Extensions

• Semi-automatic annotation (toponym detection) (http://rsimon.github.com/toponym_identification/)

Josephinische Landesaufnahme: Gebiet von Mooskirchen bis Grazer Feld, Steiermark, Österreich, 1764-1787. Wikimedia Commons.

32

http://rsimon.github.com/toponym_identification/





Possible Extensions

• Semantic Tagging with placenames from different Gazetteers

• http://pleiades.stoa.org

• Pleiades dataset (http://thedatahub.org/dataset/pleiades)

• 34,000+ ancient places

• cool URIs for these resources

• http://pelagios-project.blogspot.com

33

http://pleiades.stoa.org/

http://pleiades.stoa.org/

http://thedatahub.org/dataset/pleiades

http://thedatahub.org/dataset/pleiades

http://pelagios-project.blogspot.com

http://pelagios-project.blogspot.com


Related Projects

34


Annotorious

35

• Light-weight image annotation library; no big client/server framework

• Adds annotation features to existing Web pages<html>

<head> <link rel="stylesheet" type="text/css" href="css/annotorious.css" /> <script type="text/javascript" src="annotorious.min.js"></script> </head>

<body> <img src="example.jpg" class="annotatable" /> </body>

</html>


Annotorious

36

• Plugin-Framework

• Different storage backends and GUI components (Tags, Replies)

• Additional selectors

• Interoperable with OKFN Annotator

https://github.com/annotorious/annotorious




Lucene-SKOS

• Plugin for Apache Lucene / Solr

• Works with SKOS-based knowledge contexts

• Uses semantic tags (links to SKOS concepts) for query expansion

• query time

• indexing time

37

https://github.com/behas/lucene-SKOS




References

• Haslhofer et al. (2007): The LEMO annotation framework: weaving annotations with the Web (IJDL)

• Haslhofer et al. (2010): Augmenting Europeana Content with Linked Data Resources (I-Semantics)

• Simon et al. (2011): Semantically augmented annotations in digitized map collections (JCDL)

• Haslhofer et al. (2012): Open Annotations on Multimedia Web Resources (MTAP)

• Haslhofer et al. (2013): Old Maps and Open Data Networks (iConference Demo / Poster)

38


Further Information

39

http://maphub.github.com

Thank you!




Acknowledgements (Maphub)

• Rainer Simon

• Werner Robitza

• Keith Newman

• Amanda Stefanik

• Carl Lagoze

• Francois Guimbretiere

40

old maps, annotations, and open data networks

Education