jist tutorial semantic wikis and applications
DESCRIPTION
Semantic Wiki and applications tutorial for JIST 2011TRANSCRIPT
Semantic Wikis and ApplicationsSemantic Wikis and Applications
Jesse Wang Mark Greaves Vulcan Inc
jessew markgvulcancom
Ning Hu Justin ZhangTeamMersion LLC
ning justinzhteammersioncom
December 4 2011
2
Your InstructorsYour Instructors
MarkJesse
NingJustin
3
Who is VulcanWho is Vulcan
4
What does Vulcan doWhat does Vulcan do
Vulcan Inc was established in 1986 by investor and philanthropist Paul G Allen co-founder of Microsoft to manage his
business and philanthropic efforts Allen is chairman of Vulcan and his sister Jody
Allen is president and CEO
5
It all began with an ideahellipIt all began with an ideahellip
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
2
Your InstructorsYour Instructors
MarkJesse
NingJustin
3
Who is VulcanWho is Vulcan
4
What does Vulcan doWhat does Vulcan do
Vulcan Inc was established in 1986 by investor and philanthropist Paul G Allen co-founder of Microsoft to manage his
business and philanthropic efforts Allen is chairman of Vulcan and his sister Jody
Allen is president and CEO
5
It all began with an ideahellipIt all began with an ideahellip
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
3
Who is VulcanWho is Vulcan
4
What does Vulcan doWhat does Vulcan do
Vulcan Inc was established in 1986 by investor and philanthropist Paul G Allen co-founder of Microsoft to manage his
business and philanthropic efforts Allen is chairman of Vulcan and his sister Jody
Allen is president and CEO
5
It all began with an ideahellipIt all began with an ideahellip
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
4
What does Vulcan doWhat does Vulcan do
Vulcan Inc was established in 1986 by investor and philanthropist Paul G Allen co-founder of Microsoft to manage his
business and philanthropic efforts Allen is chairman of Vulcan and his sister Jody
Allen is president and CEO
5
It all began with an ideahellipIt all began with an ideahellip
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
5
It all began with an ideahellipIt all began with an ideahellip
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
6
Now the Idea Continues as Project HaloNow the Idea Continues as Project Halo
Project Halo is a staged long-range research effort by Vulcan Inc towards the development of a Digital Aristotlemdasha reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific
disciplines and related human affairs The project focuses on creating two primary functions a tutor capable of instructing and assessing students in those
subjects and a research assistant with broad interdisciplinary skills to help scientists and others in their work
Automatic Question Answering System
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
7
Project Halorsquos Knowledge Acquisition GoalsProject Halorsquos Knowledge Acquisition Goals
Address the problems in building Knowledge Basesndash scalendash cost
Have high impact
KB E
ffort (co
st p
eople
hellip)
KB size (number of assertions complexityhellip)
Vulcan
Now
Future
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
8
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
WIKI AND SEMANTICSWIKI AND SEMANTICSIntroduction
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
10 YEARS AGOHUMAN BEING
BEGAN AN EXPERIMENT
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
editwow I can change the web
letrsquos share and publish knowledge
to make an [[encyclopedia]]
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Some Wiki PlatformsSome Wiki Platforms
Wikiandash Wiki communities for everyone
PBWikiPBWorksndash Online Collaboration that just Works
TWikindash the Open Source Enterprise Wiki and Web 20 Application
Platform MoinMoin
ndash advanced easy to use and extensible WikiEngine
13
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
So What is a WikiSo What is a Wiki
By Wikipediandash A wiki (pronounced w kiˈ ɪ WIK-ee) is a website that allows the
easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor[2][3] Wikis are typically powered by wiki software and are often used to createcollaborative websites to power community websites for personal note taking in corporate intranets and in knowledge management systems
14
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
What Wiki Really Is aboutWhat Wiki Really Is about
Quick ndash from idea to resultndash no need of extra software
Easy ndash Mass participation
Collaborative Community Authoringndash Notification (Watch)
Version Control
15
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
A Key Feature of WikiA Key Feature of Wiki
Consensus
This distinguishes wikis from other publication tools
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Consensus in Wikis Comes fromConsensus in Wikis Comes from
Collaborationndash ~17 editspage on average in
Wikipedia (with high variance)ndash Wikipediarsquos Neutral Point of View
Conventionndash Users follow customs and
conventions to engage with articles effectively
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Software Support Makes Wikis SuccessfulSoftware Support Makes Wikis Successful
Trivial to edit by anyone Tracking of all changes one-
step rollback Every article has a ldquoTalkrdquo page
for discussion Notification facility allows
anyone to ldquowatchrdquo an article Sufficient security on pages
logins can be required A hierarchy of administrators
gardeners and editors Software Bots recognize certain
kinds of vandalism and auto-revert or recognize articles that need work and flag them for editors
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Success of WikisSuccess of Wikis
One of humanrsquos greatest inventions
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Leverage Crowdrsquos WisdomLeverage Crowdrsquos Wisdom
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Wikis are greatWikis are great
Enable new scale of human collaboration
Everyone can read Everyone can write Everyone gets aggregated Everyone is accountable for everything
But some things are better left to machineshellip
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Wiki ClockWiki Clock
httppageoftextcomwikiclock
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
editedit
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Deep InfoDeep Info
Wikipedia has articles abouthellipbull hellip all cities with info on their
populations locations and skyscrapers etchellip all German cars with engine size accelerating datahellip
Can you find Skyscrapers with 50+ floors and built between 2000 and 2008 in Shanghai (or Chinese cities with 1000000+ people)
Or German(Porsche) cars that accelerate from 0-100kmh in 5 seconds
24
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
How Wikipedia Answers ndash ListHow Wikipedia Answers ndash List
httpenwikipediaorgwikiList_of_fastest_cars_by_acceleration
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Going DeeperGoing Deeper
httpenwikipediaorgwikiList_of_German_cars
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
DeeperhellipDeeperhellip
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
And DeeperhellipAnd Deeperhellip
28
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
And NowhellipAnd Nowhellip
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Look into List in WikipediaLook into List in Wikipedia
httpenwikipediaorgwikiList_of_German_cars
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Editing Standard Wiki Article ndash Static ListEditing Standard Wiki Article ndash Static List
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Static List Tables hellipStatic List Tables hellip
httpenwikipediaorgwikiList_of_lists_about_Oregon
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Problems with Static Lists TablesProblems with Static Lists Tables
Duplicated data Inconsistent data Data may not be up-to-date Hard to maintain Considerable efforts to make new listtable
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
We need structured data
with clear and consistent
semantics
Semantics Come To RescueSemantics Come To Rescue
To find answers likebull All Porsche vehicles made in Germany
that accelerate from 1-100 kmh less than 4 seconds
bull Sci-Fi movies made after year 2000 that cost less than $10M and gross more than $30M
bull A map showing where all Mercedes-Benz vehicles are manufactured
bull All skyscrapers in China (Japan Thailandhellip) of 50 (406070) floors or more and built in year 2000 (20012002) and after sorted by built year floorshellip grouped by cities regionshellip
bull And many more
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
What is a Semantic WikiWhat is a Semantic Wiki
A wiki that has an underlying model of the knowledge described in its pages
To allow users to make their knowledge explicit and formal Semantic Web Compatible
Semantic Wiki
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Two PerspectivesTwo Perspectives
Wikis for Metadata
Metadata for Wikis
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Why Semantic WikiWhy Semantic Wiki
Annotation of existing structures with machine readable metadatalinks carry meaning typing of links typing of pages
Context dependent adaptation and presentationdifferent domains have different ways of presenting content personal preferences etc
Improved ldquointelligentrdquo search and navigationqueries to the structure visualisation of structure derived information
Improved interoperability between systemsexchange of content integration of different systems agents etc
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
What is the Promise of Semantic WikisWhat is the Promise of Semantic Wikis
Semantic Wikis promise Consensus over Data and Structure
Combine low-expressivity data authorship with the best features of traditional wikis
User-governed user-maintained user-defined
Easy to use as an extension of text authoring
The ultimate data aggregator
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Challenges on Data ConsensusChallenges on Data Consensus
Data modeling is (seemingly) a specialized skill Finding disagreements in data is difficult Consistently revising data schemas is difficult Consistency of schema information (ldquoPopulationrdquo ldquoPoprdquo
ldquoNumber_of_inhabitantsrdquo etc) Consistency of types units of measure application of
ruleshellip Semanticsinterpretation of properties need explanation for
humans hellip
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
One Key Helpful Feature of Semantic WikisOne Key Helpful Feature of Semantic Wikis
Semantic Wikis are ldquoSchema-LastrdquoDatabases require DBAs and schema design
Semantic Wikis develop and maintain the schema in the wiki
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Basics of Semantic WikisBasics of Semantic Wikis
Still a wiki with regular wiki featuresndash CategoryTags Namespaces Title Versioning
Typed Content (built-ins + user created eg categories)ndash PageCard Date Number URLEmail String hellip
Typed Links (eg properties)ndash ldquocapital_ofrdquo ldquocontainsrdquo ldquoborn_inrdquohellip
Querying Interface Supportndash Eg ldquo[[CategoryMember]] [[Agelt30]]rdquo (in SMW)
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
List of Semantic WikisList of Semantic Wikis
AceWikiArtificialMemoryWagn - Ruby on Rails-basedKiWi ndash Knowledge in a WikiKnoodl ndash Semantic Collaboration tool and application platformMetaweb - the software that powers FreebaseOntoWikiOpenRecordPhpWiki
Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wikiSwirrl - a spreadsheet-based semantic wiki applicationTaOPis - has a semantic wiki subsystem based on Frame logicTikiWiki CMSGroupware integrates Semantic links as a core featurezAgile Wikidsmart - semantically enables Confluence
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SEMANTIC MEDIAWIKISEMANTIC MEDIAWIKIAn Extension to MediaWiki
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Short History of Semantic MediaWikiShort History of Semantic MediaWiki
Born at AIFBndash Typed links and types and morendash Export articles as RDFndash Maximally flexible for the wiki user
SMW 01 released by AIFB in Sept 2005ndash Parserstorage support for typed links ndash [[typelink | label]]ndash FactBox for semantic relations at end of articlendash SpecialSearchSemantic with basic auto-completion for link typesndash Simple query language (ldquoaskrdquo)
Vulcan kicks off Halo Extensions to SMW project in August 2007
SMW 10 released by AIFB in Dec 2007 Ontoprise releases Halo Extension 10 in parallelndash ldquoPropertyrdquo instead of ldquoRelationrdquo and ldquoAttributerdquondash Many new datatypesspecial pagesUI features
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Semantic MediaWiki (SMW) Markup SyntaxSemantic MediaWiki (SMW) Markup Syntax
[[PropertyValue | Display]]
Zhejiang University is located in [[Has locationHangzhou]] with
[[Has population39000|about 39 thousands]] students
In page PropertyHas locationrdquo[[Has typePage]]
In page PropertyHas populationrdquo[[Has typenumber]]
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Special PropertiesSpecial Properties
ldquoHas Typerdquo is a pre-defined ldquospecialrdquo property for meta-datandash Example [[Has typeString]]
ldquoAllowed Valuesrdquo is another special propertyndash [[Allows valueLow]] ndash [[Allows valueMedium]] ndash [[Allows valueHigh]]
In Halo Extensions there are domain and range supportndash RDFs expressivityndash Semantic Gardening extension also supports ldquoCardinalityrdquo
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Define ClassesDefine Classes
Beijing is a city in [[Has countryChina]] with population [[Has population2200000]]
[[CategoryCities]]
Categories are used to define classes because they are better for class inheritance
The Jin Mao Tower (金茂大厦 ) is an 88-story landmark supertall skyscraper in hellip
[[Categories 1998 architecture | Skyscrapers in Shanghai | Hotels in Shanghai | Skyscrapers over 350 meters | Visitor attractions in Shanghai | Landmarks in Shanghai | Skidmore Owings and Merrill buildings]]
CategorySkyscrapers in China Category Skyscrapers by country
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Database-style Query over Wiki DataDatabase-style Query over Wiki Data
ask[[CategorySkyscrapers]][[Located inChina]][[Floor countgt50]][[Year builtlt2000]][[Year builtgt2008]] hellip
Example Skyscrapers in China higher than 50 stories built between
2000 and 2008
ASKSPARQL query target
Data via DBpedia
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Semantic MediaWiki SoftwareSemantic MediaWiki Software
Open source (GPL)ndash Well documented
Active developmentndash Commercial support available
World-wide communityndash International Conferences
bull Next SMWCon 425-27 2012 in Carlsbad CA
httpsemantic-mediawikiorgVery stable core various extensions
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Extensions ndash Help Build Great ThingsSMW Extensions ndash Help Build Great Things
bull Halo Extensions Semantic Forms Semantic Notification hellip
Data IO
bull Semantic Toolbar Semantic Drilldown Enhanced Retrieval Searchhellip
Query and Browsing
bull Semantic Result Printers Tree View Exhibit Flash chartshellip
Visualization
bull HaloACL Deployment Triplestore Connector Simple Ruleshellipbull Semantic WikiTags and Subversion Integration extensions bull Linked Data Extension with R2R and SILK from FUBerlin
Other useful extensions
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
External data reuseExternal data reuse
Export formats RDFXML SPARQL end points RDFa CSV JSON iCal vCard Bibtex
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Extensible architectureExtensible architecture
Built on MediaWiki Small core SMW Extension hooks of its own Allow apps on top of it
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
56
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
57
Semantic MediaWiki (SMW) and SMW+Semantic MediaWiki (SMW) and SMW+
Semantic MediaWikindash The project where the original semantic wiki ideas were developedndash A compact extension of MediaWiki that supports storage retrieval and use of basic data markup in wiki
pagesndash Core code developed at Karlsruumlhe Institute of Technology beginning in 2004
Open source (GPL) well documented active mailing list world-wide community commercial support available
Very stable core plus ~50 extensions that add featuresndash Data IO Semantic Forms Semantic Notification Linked Datahellipndash Query and Browsing Halo Extensions Semantic Drilldown Semantic Searchhellipndash Visualization Semantic Result Printers TreeView Flash chartshellip ndash Other useful extensions HaloACL Deployment RichMediahellip
SMW+ is a commercial-grade semantic wiki based on SMWndash A GPL (open-source) package of interoperable enterprise-oriented SMW extensions with installer
and business-critical featuresndash ~2K downloadsmonth ~5K unique visitorsmonth to SMW+ Forumndash Usersrsquo group meetings in North America and Europe (next meeting April in San Diego)ndash A growing developer community at httpwwwsmwpluscom ndash Available commercial support
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+halo extensions
The Goal of SMW+The Goal of SMW+
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
From MediaWiki to SMW+From MediaWiki to SMW+
Halo Extension Usability extension
to Semantic MediaWiki
Increases user consensus
Increases use of semantic data
SemanticMediaWiki Core Semantic
Wiki engine Authoring of
explicit knowledge in content
Basic reasoning capabilities
SMW+ Shrink wrap suite of
open source software products
Comes with ready to use ontology
Easy to procure and install
Standard support contract available
MediaWiki Powerful Wiki
engine Basic CMS
feature set
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ In One (Marketing) SlideSMW+ In One (Marketing) Slide
SMW+ is a Semantic Enterprise Wiki for agile collaboration on rich text and data
It is a Wiki Platform for web-based collaboration and quick authoring of text and data content
It is a database Users write data and text together on wiki pages and visualize the data with simple queries
It is an integration tool Users access data from external databases web services or the Semantic Web within the Wiki
It is enterprise-ready Installs in 15 minutes and comes with business-critical features Extendible and scalable
httpwwwsmwpluscom
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Selected SMW+ Extensions for this Tutorial (1 of 4)Selected SMW+ Extensions for this Tutorial (1 of 4)
Faceted Search and BrowsingHigh speed exploration of data and text together
Drill-down search results by categories properties and their values
Find relevant articles facts and semantic content
Identify suitable properties for queries
Help httpsmwforumontoprisecomsmwforumindexphpHelpFaceted_browsing_153
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Selected SMW+ Extensions for this Tutorial (2 of 4)Selected SMW+ Extensions for this Tutorial (2 of 4)
Data Browser Semantic Toolbar WYSIWYG EditorFlexibly create and curate data in the wiki
Use the Data Browser as a single place to view create and edit categories properties subproperties and instances
Use the Semantic Toolbar while editing pages to add and browse data values
WYSIWYG editor allows users to rapidly create compelling pages without having to master specialized wiki markup
Help httpsmwforumontoprisecommwforumindexphpHelpDescription_of_the_Ontology_browserhttpsmwforumontoprisecomsmwforumindexphpHelpDescription_of_the_Semantic_toolbar
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Selected SMW+ Extensions for this Tutorial (3 of 4)Selected SMW+ Extensions for this Tutorial (3 of 4)
Query InterfaceEasy query construction with the
Query Interface GUI
Creation testing loading editing and re-using of existing queries
Choice of query result formatters (visualizers)
Handles multiple query results and result formats
Search over queries
Help httpsmwforumontoprisecomsmwforumindexphpQuery_Interface
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Selected SMW+ Extensions for this Tutorial (4 of 4)Selected SMW+ Extensions for this Tutorial (4 of 4)
Semantic Forms and Automatic Semantic FormsCreate data in the wiki with easy form-based UIs
Define form layouts data validation and
Automatically create forms right on wiki pages based on the data structure currently in the wiki
An easy familiar way for usersto add data to the wiki
Help httpsmwforumontoprisecomsmwforumindexphpSemantic_Forms httpsmwforumontoprisecomsmwforumindexphpHelpAutomatic_Semantic_Forms_extension
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Extensions Microsoft Office ConnectorSMW+ Extensions Microsoft Office Connector
65
How do we further embed semantic wikis into corporate practicendash Many users will not use wikisndash How do we maximally share data and
collaborate
Leverage the MS Office user base
Microsoft Office Connectorndash Bring semantic information into Office
applications on-demandndash Consume and contribute from the Office
suitendash Use semantic information to enable
appropriate actionsndash Office 2007 and Office 2010
Microsoft Outlook Connectorndash Bring data into SMW just by emailing itndash Automatic metadata extraction
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Full Extension SuiteSMW+ Full Extension Suite
Starts small ndash grows with useAdd special purpose extensions and manage your wiki installation with the Wiki Administration Tool
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Open Source Extension Library (1 of 3)SMW+ Open Source Extension Library (1 of 3)
Usabilityndash Collaboration ndash The Collaboration Extension enables commenting and rating of wiki
articles ndash WYSIWYG ndash The WYSIWYG Extension to MediaWiki replaces the standard
MediaWiki editor with the more user-friendly CKeditorndash Rich Media ndash The Rich Media extension allows the easy upload and embedding of
media files such as documents images videos and audio files into the wiki Media files can be attached to related articles and tagged with an enhanced meta-data set
ndash Semantic Forms ndash Semantic Forms is an extension to MediaWiki that lets users add and edit data using forms It is meant to be used for structured data that has semantic markup
ndash Automatic Semantic Forms ndashAutomatic Semantic Forms extension automatically creates Semantic Forms based on the current Wiki ontology
ndash Semantic Notifications ndash Keeps you informed about changes in your semantic data and sends you notifications via email
ndash User Manual ndash Provides direct access to help and context-sensitive selection of help pages Users can submit direct feedback (such as bug issues) and ask questions in the online community
67
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Open Source Extension Library (2 of 3)SMW+ Open Source Extension Library (2 of 3)
Data Processingndash Rule Knowledge ndash Offers a graphical rule editor for creating logical rules Rules allow
you to state complex interrelations
Data Re-Usendash Data Import ndash Integrates external data into the wiki via Web Services (SOAP or
RESTful) or data import of eg CSV files or emails ndash Linked Data ndash Integrates access to data in the Web of Data in SMW+ Data can be
imported into the wikis triple store and exported via RDF and a SPARQL endpoint
Securityndash Access Control List ndash Powerful access control for protecting single wiki pages
articles in categories or namespaces and values of semantic properties Access can be restricted via a Graphical User Interface (GUI) for individual users and user groups
Data Backend (Jena for open-source Ontobroker for cost)ndash Triple Store Connector ndash Adds a full standards-compliant semantic datastore with
powerful SPARQL queries and data integration support68
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Open Source Extension Library (3 of 3)SMW+ Open Source Extension Library (3 of 3)
Data Consistencyndash Semantic Gardening ndash The Gardening extension lets you detect and clean
inconsistencies via automatic bots It further provides an export functionality for OWL ontologies
Retrievalndash Enhanced Retrieval ndash Provides a powerful search engine with auto-completion
spell-checking (did you mean feature) and advanced search functionalities such as fuzzy and path search The search covers full text contents (also from uploaded PDF and Word documents) as well as elements from the ontology
ndash Semantic Treeview ndash Automatically displays a hierarchical view of the selected wiki elements such as categories articles or semantically annotated data
ndash Semantic Result Formats ndash This extension to MediaWiki bundles a number of result formats for inline queries The individual formats can be added to the installation independently
69
Download from httpwwwsmwpluscom
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
70
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Hands-on tasksHands-on tasks
Create account Create a plain new article ndash plain wiki text editing Add semantic annotations
ndash Plain wiki textndash Data toolbar
Using WYSIWYG editorndash Rich text insertionndash Using Query Interface to get results
Using Automatic Semantic Forms Semantic query results of our achievements
ndash Ontology Browser Visualizations
71
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ontologies ndash ConstituentsOntologies ndash Constituents
Ontology entities and their counterpart in the wikindash Category Wiki page in namespace bdquoCategoryldquo
ndash Instance Any wiki page in the main namespace
ndash Property Wiki page in namespace bdquoPropertyldquo
Event
Semantic Wiki Tutorial
attendee
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ontologies ndash ConstituentsOntologies ndash Constituents
Basic ontology statements in the wikindash Is-a Sub-category relation Category page tagged with a category
bull [[CategoryEvent]]
ndash Instance-of Category assertion Wiki page tagged with a categorybull [[CategoryPerson]]
ndash Relating instances Property on a page pointing to another pagebull [[AttendeeDaniel]]
ndash Attributes for instances Property on a page with a data valuebull [[Budget300000]]
EventWorkshopis-a
PersonDanielinstance-of
Semantic Wiki Tutorial Danielattendee
Project Xbudget
300000
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics)ndash all characteristics are specified as annotations on the property page
Type ndash defines the ldquodata typerdquo of the property (see next slide) Domain - articles of this category can have values for this property Range - articles of this category can be objects of this property Only
relevant if the property is of type is Page Allowed values ndash Defines a set of values which are allowed for this
property Minimal cardinality - The minimum number of values of the property Maximum cardinality - The maximum number of values of the
propertyThis is good for autocompletion proposing values and checking validity
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ontologies ndash PropertiesOntologies ndash Properties
Properties have types TypePage - links to pages (the default) TypeString - text strings that are not longer than 250 letters TypeNumber - integer and decimal numbers with optional exponent TypeBoolean - restricts the value of a property to truefalse (also 10 or yesno) TypeDate - specifies particular points in time TypeText - like TypeString but can have unlimited length the trade-off is values of this
type cannot be selection or sort criteria in queries Other
ndash TypeCode ndash TypeTemperaturendash TypeTelephone numberndash TypeURLndash TypeEmail
HelpProperties_and_types_156
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ontologies ndash PropertiesOntologies ndash Properties
Properties can have properties (or characteristics) Subproperty of ndash This property is a specialization of the given property
ndash On page PropertyHasSubtitle [[Subproperty ofPropertyHasTitle]] Inverse of ndash This property is an inverse of the given property
bull On page PropertyHasParent [[Is inverse ofPropertyHasChild]] Transitivity - Defines that the property is transitive This field is only enabled if the
propertys type is Page ndash On page PropertyIsRelatedTo [[CategoryTransitive properties]]
Symmetry - Defines that the property is symmetric This field is only enabled if the propertys type is Page ndash On page PropertyHasBorderWith [[CategorySymmetrical properties]]
This is good for inferring new knowledge
HelpSpecifying_property_properties_156
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
79
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Semantic Wikisin Practice
Mark Greaves
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW InstallationsSMW Installations
Patterns for applying SMW+ndash As a flexible and user-friendly front end to large data resources
bull Data is mostly provided from databasesbull Wiki pages provide context for the data and associated queries
ndash As a collaborative knowledge management platformbull Semi-structured knowledge text mixed with database and user-contributedbull Encyclopedia resources for larger organizations
ndash Metadata and data together in one human-readable place
On wwwsmwpluscomndash Repository of sample wiki apps (SCRUM project management etc)
bull Framework to deploy an app with its ontologies and pagesndash Commercial case studiesndash SMW Ambassadors
81
Letrsquos look at some selected SMW installations
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Examples OpenEIorgSMW Examples OpenEIorg
82
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Examples SNPediaSMW Examples SNPedia
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Examples SNPediaSMW Examples SNPedia
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SNPedia wins the ldquo23 and Merdquo prizeSNPedia wins the ldquo23 and Merdquo prize
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Example Collaborative Proposal ManagementSMW Example Collaborative Proposal Management
86
Active Bid Viewer Service Desk Selector
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ with Automatic Document AnnotationSMW+ with Automatic Document Annotation
87
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Editing the Document AnnotationsEditing the Document Annotations
88
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
NYC BigApp 20 Prize to Revelytix and TCGNYC BigApp 20 Prize to Revelytix and TCG
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Example NYCreationSMW+ Example NYCreation
90
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW+ Example NYCManticsSMW+ Example NYCMantics
91
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Example Oh InternetSMW Example Oh Internet
92
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW Example SCRUM Coordination WikiSMW Example SCRUM Coordination Wiki
93
Augment wiki articles with data
Automatically populate data tables
Bugzilla integration
Calendars and timelines
Basic workflows SCRUM Reports Form-oriented
inputs Notifications via
emailRSS MS Office
integration
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
94
What Would an Analytic Encyclopedia Look LikeWhat Would an Analytic Encyclopedia Look Like
Back to the original vision An SMW demo built to explore ldquoSemantic Wikipediardquo
Wikipedia articles merged with the power of SMWndash For Authors tools to create more compelling articles
bull Great visualizations charts tables timelines photos analyticsbull Always up-to-date across the Encyclopediabull Encourage data consistency and find data errorsbull Link in other web data sources
ndash For Readers bull Enhanced articles and data interactionbull Faceted navigationbull Sophisticated queries (both standing and ad-hoc)
Crowdsource data as well as text articles into a queryable living Wikipedia
Leverage the live stream of updates from millions of Wikipedia authors
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ultrapedia An Analytic EncyclopediaUltrapedia An Analytic Encyclopedia
Goal Prototype a small semantic encyclopediandash Create an semantic version of a part of Wikipediandash Software is SMW and the Halo Extensionsndash Wikipedia-based checking and correctionsndash Link back to other parts of Project Halo
Ultrapedia Prototype Detailsndash Test domain is German carsndash ~2500 Wikipedia pages ~40000 triplesndash Private versions of Wikipedia SMW OB
and DBpedia hosted at wikingvulcancomndash Features
bull Corrections flow from Wikipedia to Ultrapedia in real time
bull Full data source tracking from Wikipediabull Wikipedia table ingestion and parsingbull Feedback (user rating) loop for databull New visualizations for tables charts photosbull External data integrated into articlesbull SPARQL-based queriesbull Derived assertions (via OntoBroker)
Class Articles Infobox Articles
Company 134 53
Person 93 57
Automobile 370 345
Auto Generation
1480 1380
Engine 135 12
Other 283 3
Totals 2495 1850
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Title
Description
Languages
Further DownWeb Links
Categorization
Domain specific
Data
Images
InfoboxProperties
Extracting Structured Data from WikipediaExtracting Structured Data from Wikipedia
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Extracting Data from Wikipedia TablesExtracting Data from Wikipedia Tables
98
TableData
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Ultrapedia Prototype Data FlowUltrapedia Prototype Data Flow
English Wikipedia subsetDynamic extraction of WP semantic data into RDF
Real-time feed of WP changesbull Note most WP page changes will be text
and have no semantic import
DBpedia update streambull WP page text updates bull DBpedia data updates
WP updatesbull User-created page
updates in Wikipedia
Enhanced Ultrapedia Usabilitybull Familiar WP page text and layoutbull Exhibit-based visualizationsbull Dynamic tablescategoriesbull Faceted navigationbull Queries (both standing and ad-hoc)bull Wikitag-based MS Office augmentation
Wikipedia-based Correctionsbull UP shows the user where to correct
data in WP so that DBpedia will extract the correctionbull Ultrapedia exposes the data source in
terms of where the data was extracted from WP
bull WP changes and corrections get quickly propagated to UP
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
100
Demo UltrapediaDemo Ultrapedia
Domain is German carsndash Cars Companies Engines
Transmissions People etcndash ~2500 pages ~40000 triples
An SMW-based encyclopediandash Similar look and feel to Wikipediandash Dynamic tables and chartsndash Powerful queriesndash Navigation beyond searchndash Trustworthy data sourcendash Edit discuss and rate datandash Data is validated by the Wikipedia
community
Ultrapedia Demo Things to take away
ndash A better Wikipedia for authors and readers
ndash Interact with data as well as textndash Monitor data with standing queriesndash External data integration via web
services (EBay)
Rapid to buildndash SMW platform is stablendash Most time was spent on data
cleaning and new visualizations
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
101
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Wiki Object ModelWiki Object ModelData as Fine Objects
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Wiki Object Model MotivationWiki Object Model Motivation
Strong needs for access the structured data and unstructured data in the wiki as a data storendash From internal and external applicationsrsquo point of view
A DOM-like approach is good choicendash Xpath is a reasonable tool and standard
Granularity offers flexibility and power Easier to operate on known objects and calling REST APIs
rather than parsing and handling wiki texts Common gateway for both internal and external apps
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Wiki Object Model ObjectsWiki Object Model Objects
Page Section Parameter Parameter value Template Template field Parser function List item Table Table cell
Category Link Property Text Magic word HTML tag Sentence Word Image
104
Not yet implemented as of April 2011
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Demo of WOMDemo of WOM
Demo at httpwikingvulcancomdev_sandbox Demo 1 APIs
The API is part of MediaWiki API with our additions to allow get and set (readwrite) the content of a wiki page
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelApis
Demo 2 Inline Editor A simple inline editor (AJAX styled) to let user modify a specific portion of
the wiki page Based on
httpwikingvulcancomdevindexphpExtensionWiki_Object_ModelFunctions
105
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Widget EditorWidget EditorA ldquoDesignerrdquo Wiki Application Builder
106
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Collaboration Collecting structured data Sharing information Management of heterogeneous data Simple workflow management User-generated arbitrary queries Data analysis and information discovery
Usage of SMWUsage of SMW
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Schema Design Extension Choice Form Design Template Authoring Skin Customization Query Generation
Common Work ItemsCommon Work Items
Expert in need
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
The Bar to be ExpertThe Bar to be Expert
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Most users just like to share or collect contentsndash CMS Drupal WordPress MWSMW
hellipndash SNS MySpace Ning WetPaint
LinkedIn hellip Frameworks or applications allow
users to focus on content or data
Modeling = Yes Coding = NoModeling = Yes Coding = No
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Code is essential building blocksndash Not everyone is good at writing code
Frameworks enables ldquometa-datardquo usendash User developers or adminsndash Meta-data drive content
Handle Content via meta-data ndash Parameter configuration
Data (Content)
Metadata (Configuration)
Functions (Code)
Users
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Existing examples ndash ldquoAllowed valuesrdquo Auto-completion in SFndash ldquohas default formrdquo Map form to data (category)
We want to enhance the experiencendash ldquohas rangerdquo auto-completion in Semantic Formsndash ldquohas domainrdquo auto-construct form for the domainndash ldquohas labeldescriptionrdquo metadata to use in formsndash ldquohas stylerdquo the visual part of customization
Model Metadata Model Metadata
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Helpdesk Wiki App OverviewHelpdesk Wiki App OverviewA simple workflow wiki application built on top of Widget Designer
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
115
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Widget Designer Hands-onWidget Designer Hands-onHow to create and customize the pages
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
RecapRecap
Access Wiki Content as Fine Objects Designing via metadata modeling Metadata configured by UI Metadata data and UI are linked
ndash Action Connector A social semantic web application in a day
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
118
The InspirationThe Inspiration
We started with a
Now we have an
wiki site
web application
Social Semantic
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
119
Requirements for Wiki ldquoDevelopersrdquoRequirements for Wiki ldquoDevelopersrdquo
One need notndash Write code like a hardcore programmerndash Design setup RDBMS or make frequent
schema changesndash Possess knowledge of a senior system
admin Instead one need
ndash Configure the wiki with desired extensionsndash Design and evolve the data model
(schema)ndash Design Content
bull Customize templates forms styles skin etc
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
120
Effectiveness of SMW as a Platform ChoiceEffectiveness of SMW as a Platform Choice
Packaged Software
Very quick to obtainN Hard to customizeN Expensive
Microsoft Project Version One Microsoft
SharePoint
Custom Development
N Slow to developExtremely flexibleN High cost to develop and maintain
NET Framework J2EE hellip Ruby on rails
SMW + Extensions
Still quick to program Easy to customize Low-moderate cost
Vulcan Project Wiki BLS RPI map
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
122
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Connecting to SMW+ and Consuming DataConnecting to SMW+ and Consuming Data
Wiki - Microsoft Office Connectorndash As known as WikiTagsndash Access wiki content in your Microsoft Office applications
Motivation Background
ndash Scrum wiki for Agile Software Development Demo
123
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
SMW powerful tools and contentsSMW powerful tools and contents
Semantic MediaWiki and related extensions have more potential power
Need Release The PowerNeed Release The Power
Be used by more people
Content in more places
Accessible via more applications
Enhanced with more semantics
The more usersThe better
Need Workflow Integration + Usability EnhancementsNeed Workflow Integration + Usability Enhancements
Infrequent Wiki users frequently forget where the wiki pages are located
Search is a break from current workflow Search result can be noisy or irrelevant Usability
ndash WikiTemplateSF markup syntax is not extremely hard but enough to turn off many users
ndash To locate and consume info in SMW is just not easy enough need something better
Why donrsquot we leverage Microsoft Office suite
Microsoft Office The Most Popular Productivity SuiteMicrosoft Office The Most Popular Productivity Suite
500m users worldwide
gt90 market share
Users live in the ldquosuiterdquo
Outlook always open
Potential for SMW
Need Workflow Integration + Usability EnhancementsNeed Workflow Integration + Usability Enhancements
Infrequent Wiki users frequently forget where the wiki pages are located
Search is a break from current workflow Search result can be noisy or irrelevant Usability
ndash WikiTemplateSF markup syntax is not extremely hard but enough to turn off many users
ndash To locate and consume info in SMW is just not easy enough need something better
Why donrsquot we leverage Microsoft Office suite
Microsoft Office The Most Popular Productivity SuiteMicrosoft Office The Most Popular Productivity Suite
500m users worldwide
gt90 market share
Users live in the ldquosuiterdquo
Outlook always open
Potential for SMW
Microsoft Office The Most Popular Productivity SuiteMicrosoft Office The Most Popular Productivity Suite
500m users worldwide
gt90 market share
Users live in the ldquosuiterdquo
Outlook always open
Potential for SMW
MICROSOFT OFFICE CONNECTOR How It WorksMICROSOFT OFFICE CONNECTOR How It Works
Leverage Microsoft Office Add-ins technology
Bring SMW info to Office applications on-demand
API for semantic data IO Utilize semantics to
improve relevance Smart actions for
semantic properties
OfficeAdd-ins
Connections
API
API
Smarts
AGILE PROJECT MANAGEMENT AGILE PROJECT MANAGEMENT Before the demo letrsquos look a data wiki
Wiki Agile Project Management ndash Scrum++Wiki Agile Project Management ndash Scrum++
Project Wiki for Milestones User Stories Developer Tasks etc
Page is form- based with queries and semantics built-in
LIVE ACTIONSLIVE ACTIONSNow see the demo
For more info go to httpwikingvulcancomdev
BackstageSemantic Wiki Object ModelBackstageSemantic Wiki Object Model
Wiki Validation Authentication To get the categories
ndash And descriptions To get the article titles To get the semantic
properties
To get page info Get all forms related info Edit and save page w form Change a property Set form of a page Create form templates To upload into the Wiki
httpwikingvulcancomdevindexphpSMW_Webservice_APIs
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
AGILE PROJECT MANAGEMENT AGILE PROJECT MANAGEMENT Before the demo letrsquos look a data wiki
Wiki Agile Project Management ndash Scrum++Wiki Agile Project Management ndash Scrum++
Project Wiki for Milestones User Stories Developer Tasks etc
Page is form- based with queries and semantics built-in
LIVE ACTIONSLIVE ACTIONSNow see the demo
For more info go to httpwikingvulcancomdev
BackstageSemantic Wiki Object ModelBackstageSemantic Wiki Object Model
Wiki Validation Authentication To get the categories
ndash And descriptions To get the article titles To get the semantic
properties
To get page info Get all forms related info Edit and save page w form Change a property Set form of a page Create form templates To upload into the Wiki
httpwikingvulcancomdevindexphpSMW_Webservice_APIs
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Wiki Agile Project Management ndash Scrum++Wiki Agile Project Management ndash Scrum++
Project Wiki for Milestones User Stories Developer Tasks etc
Page is form- based with queries and semantics built-in
LIVE ACTIONSLIVE ACTIONSNow see the demo
For more info go to httpwikingvulcancomdev
BackstageSemantic Wiki Object ModelBackstageSemantic Wiki Object Model
Wiki Validation Authentication To get the categories
ndash And descriptions To get the article titles To get the semantic
properties
To get page info Get all forms related info Edit and save page w form Change a property Set form of a page Create form templates To upload into the Wiki
httpwikingvulcancomdevindexphpSMW_Webservice_APIs
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
LIVE ACTIONSLIVE ACTIONSNow see the demo
For more info go to httpwikingvulcancomdev
BackstageSemantic Wiki Object ModelBackstageSemantic Wiki Object Model
Wiki Validation Authentication To get the categories
ndash And descriptions To get the article titles To get the semantic
properties
To get page info Get all forms related info Edit and save page w form Change a property Set form of a page Create form templates To upload into the Wiki
httpwikingvulcancomdevindexphpSMW_Webservice_APIs
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
BackstageSemantic Wiki Object ModelBackstageSemantic Wiki Object Model
Wiki Validation Authentication To get the categories
ndash And descriptions To get the article titles To get the semantic
properties
To get page info Get all forms related info Edit and save page w form Change a property Set form of a page Create form templates To upload into the Wiki
httpwikingvulcancomdevindexphpSMW_Webservice_APIs
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Microsoft Office Connector Smart ConnectionsMicrosoft Office Connector Smart Connections
bull Consume relevant targeted informationndash With the tools you are already familiar withndash In the context ndash better relevance and productivityndash In place ndash no search overhead to break workflowndash In real time ndash data from wiki is livendash Automatically ndash linking to wiki
bull Let you contribute to Wikindash Without knowing where the content isndash Without learning wikitemplate syntax
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
135
Tutorial StructureTutorial Structure
Wiki and Semantics (Jesse) Semantic MediaWiki (Jesse) SMW+ (Mark) Hands-On Session 1 (All)
Semantic Wikis in Practice (Mark) Wiki Object Model and Widgets (Jesse Ning) Hands-On Session 2 (All) Connecting to SMW+ (Jesse Justin) Wrap Up and QampA (All)
Part I
Part II
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
136
Openness of SMW as a PlatformOpenness of SMW as a Platform
Open Source
Open Content
Open Metadata
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
137
Summary SMW and ApplicationsSummary SMW and Applications
Semantic MediaWiki combines the power of semantics with wikirsquos usability and social ingredients
Semantic MediaWiki + wide range of extensions make it a great choice for knowledge management and acquisition
Semantic MediaWiki evolves into a potential application development platform for social semantic webndash Fits into cost-effective sweet spot
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
138
Questions
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Backup slides start herehellipBackup slides start herehellip
139
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
140
Questions about SMW in Enterprise and GovernmentQuestions about SMW in Enterprise and Government
SMW in a multi-datasource environmentndash Microsoft Office plugin experience
Usability ndash User-level authoring of ontology information ndash usefulndash What is the next necessary visualizationndash How do you manage ontologydata evolution
Deployability in the enterprise
Is the current level of security sufficient
Where is SMW weakest
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Wikipedia for Porsches (Acceleration Data Example)Wikipedia for Porsches (Acceleration Data Example)
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
More Porsche Acceleration Data in WikipediaMore Porsche Acceleration Data in Wikipedia
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Main PageUltrapedia Main PageUltrapedia Main Page
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Tree View Control AbstractSummary quick preview
Semantics for Improved Wiki NavigationSemantics for Improved Wiki Navigation
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
The Porsche 996 Acceleration Table In UltrapediaThe Porsche 996 Acceleration Table In Ultrapedia
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Same Table as a QuerySame Table as a Query
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Which Porsches accelerate fastDynamically-Generated Tables for QueriesDynamically-Generated Tables for Queries
Information Need All Porsche models that accelerate 0-100kph in under 5 6 and 7 seconds
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Graph Views of the Acceleration DataGraph Views of the Acceleration Data
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
External Data via a Live Ebay QueryExternal Data via a Live Ebay Query
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Linking to External Ebay DataLinking to External Ebay Data
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as DataPhotos in Wiki Articles as Data
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Volkswagen Production Timeline ViewTimelines from DataTimelines from Data
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-
Dynamic Mapping and ChartingDynamic Mapping and Charting
- Semantic Wikis and Applications
- Your Instructors
- Who is Vulcan
- What does Vulcan do
- It all began with an ideahellip
- Now the Idea Continues as Project Halo
- Project Halorsquos Knowledge Acquisition Goals
- Tutorial Structure
- Wiki and Semantics
- Slide 10
- Slide 11
- Slide 12
- Some Wiki Platforms
- So What is a Wiki
- What Wiki Really Is about
- A Key Feature of Wiki
- Consensus in Wikis Comes from
- Software Support Makes Wikis Successful
- Success of Wikis
- Leverage Crowdrsquos Wisdom
- Wikis are great
- Wiki Clock
- Slide 23
- Deep Info
- How Wikipedia Answers ndash List
- Going Deeper
- Deeperhellip
- And Deeperhellip
- And Nowhellip
- Look into List in Wikipedia
- Editing Standard Wiki Article ndash Static List
- Static List Tables hellip
- Problems with Static Lists Tables
- Semantics Come To Rescue
- What is a Semantic Wiki
- Two Perspectives
- Why Semantic Wiki
- What is the Promise of Semantic Wikis
- Challenges on Data Consensus
- One Key Helpful Feature of Semantic Wikis
- Basics of Semantic Wikis
- List of Semantic Wikis
- Tutorial Structure (2)
- Semantic MediaWiki
- Short History of Semantic MediaWiki
- Semantic MediaWiki (SMW) Markup Syntax
- Special Properties
- Define Classes
- Database-style Query over Wiki Data
- Semantic MediaWiki Software
- SMW Extensions ndash Help Build Great Things
- External data reuse
- Extensible architecture
- Tutorial Structure (3)
- Semantic MediaWiki (SMW) and SMW+
- The Goal of SMW+
- From MediaWiki to SMW+
- SMW+ In One (Marketing) Slide
- Selected SMW+ Extensions for this Tutorial (1 of 4)
- Selected SMW+ Extensions for this Tutorial (2 of 4)
- Selected SMW+ Extensions for this Tutorial (3 of 4)
- Selected SMW+ Extensions for this Tutorial (4 of 4)
- SMW+ Extensions Microsoft Office Connector
- SMW+ Full Extension Suite
- SMW+ Open Source Extension Library (1 of 3)
- SMW+ Open Source Extension Library (2 of 3)
- SMW+ Open Source Extension Library (3 of 3)
- Tutorial Structure (4)
- Hands-on tasks
- Ontologies ndash Constituents
- Ontologies ndash Constituents (2)
- Ontologies ndash Properties
- Ontologies ndash Properties (2)
- Ontologies ndash Properties (3)
- Tutorial Structure (5)
- Slide 80
- SMW Installations
- SMW Examples OpenEIorg
- SMW Examples SNPedia
- SMW Examples SNPedia (2)
- SNPedia wins the ldquo23 and Merdquo prize
- SMW Example Collaborative Proposal Management
- SMW+ with Automatic Document Annotation
- Editing the Document Annotations
- NYC BigApp 20 Prize to Revelytix and TCG
- SMW+ Example NYCreation
- SMW+ Example NYCMantics
- SMW Example Oh Internet
- SMW Example SCRUM Coordination Wiki
- What Would an Analytic Encyclopedia Look Like
- Ultrapedia An Analytic Encyclopedia
- Extracting Structured Data from Wikipedia
- Extracting Structured Data from Wikipedia (2)
- Extracting Data from Wikipedia Tables
- Ultrapedia Prototype Data Flow
- Demo Ultrapedia
- Tutorial Structure (6)
- Wiki Object Model
- Wiki Object Model Motivation
- Wiki Object Model Objects
- Demo of WOM
- Widget Editor
- Usage of SMW
- Common Work Items
- The Bar to be Expert
- Modeling = Yes Coding = No
- Slide 111
- Model Metadata
- Helpdesk Wiki App Overview
- Tutorial Structure (7)
- Widget Designer Hands-on
- Recap
- The Inspiration
- Requirements for Wiki ldquoDevelopersrdquo
- Effectiveness of SMW as a Platform Choice
- Tutorial Structure (8)
- Connecting to SMW+ and Consuming Data
- SMW powerful tools and contents
- Need Release The Power
- Need Workflow Integration + Usability Enhancements
- Microsoft Office The Most Popular Productivity Suite
- Microsoft Office Connector How It Works
- Agile Project Management
- Wiki Agile Project Management ndash Scrum++
- Live actions
- BackstageSemantic Wiki Object Model
- Microsoft Office Connector Smart Connections
- Tutorial Structure (9)
- Openness of SMW as a Platform
- Summary SMW and Applications
- Slide 138
- Backup slides start herehellip
- Questions about SMW in Enterprise and Government
- Wikipedia for Porsches (Acceleration Data Example)
- More Porsche Acceleration Data in Wikipedia
- Ultrapedia Main Page
- Semantics for Improved Wiki Navigation
- The Porsche 996 Acceleration Table In Ultrapedia
- Same Table as a Query
- Dynamically-Generated Tables for Queries
- Graph Views of the Acceleration Data
- External Data via a Live Ebay Query
- Linking to External Ebay Data
- Photos in Wiki Articles as Data
- Timelines from Data
- Dynamic Mapping and Charting
-