smwcon spring 2012 smw+ team dev update

49
SMW+ Development Update Past, Present and Future Jesse Wang 1 , Wil Smith 1 , Ning Hu 2 , Justin Zhang 2 1. @Vulcan.com 2. @TeamMersion.com

Upload: jesse-wang

Post on 16-May-2015

522 views

Category:

Technology


1 download

DESCRIPTION

SMW+ Development Update for SMWCon Spring 2012

TRANSCRIPT

Page 1: SMWCon Spring 2012 SMW+ Team Dev Update

SMW+Development

UpdatePast, Present and Future

Jesse Wang1, Wil Smith1, Ning Hu2, Justin Zhang2

1. @Vulcan.com 2. @TeamMersion.com

Page 2: SMWCon Spring 2012 SMW+ Team Dev Update

2

Who We Are

Page 3: SMWCon Spring 2012 SMW+ Team Dev Update

3

What does Vulcan do

Vulcan Inc. was established in 1986 by investor and philanthropist Paul G. Allen, co-founder of Microsoft, to manage his business and philanthropic efforts. Allen is chairman of Vulcan and his sister, Jody Allen, is president and CEO.

Page 4: SMWCon Spring 2012 SMW+ Team Dev Update

Paul Allen | Idea Man

Page 5: SMWCon Spring 2012 SMW+ Team Dev Update

5

Vulcan Tech R & D

Project Halo is a staged, long-range research effort by Vulcan Inc. towards the development of a "Digital Aristotle"—a reasoning system capable of answering novel questions and solving advanced problems in a broad range of scientific disciplines and related human affairs. The project focuses on creating two primary functions: a tutor capable of instructing and assessing students in those subjects, and a research assistant with broad, interdisciplinary skills to help scientists and others in their work.

Automatic Question Answering System

Page 6: SMWCon Spring 2012 SMW+ Team Dev Update

6

Focus Areas• Automated User-Centered

Reasoning and Acquisition System

• Text book you can talk to

AURA

• Semantic Inference with Large Knowledge-base

• Non-monotonic rule system / RIF

SILK

• Semantic MediaWiki +• Knowledge authoring with

SMEs

SMW+

Plus other related semantic technologies and commercial efforts

Knowledge Acquisition

Page 7: SMWCon Spring 2012 SMW+ Team Dev Update

7

For Better Knowledge Acquisition

Page 8: SMWCon Spring 2012 SMW+ Team Dev Update

8

What is the Promise of

Semantic Wikis?Semantic Wikis facilitate Consensus over Data

Combine low-expressivity data authorship with the best features of traditional wikis

User-governed, user-maintained, user-defined

Easy to use as an extension of text authoring

The ultimate data aggregator

Page 9: SMWCon Spring 2012 SMW+ Team Dev Update

9

One Key Feature

Semantic Wikis are “Schema-Last”Databases require DBAs and schema design; Semantic Wikis develop and maintain the schema in the wiki

Page 10: SMWCon Spring 2012 SMW+ Team Dev Update

10

Leverage Crowd’s Wisdom

KB E

ffort (co

st, p

eople

,…)

KB size (number of assertions, complexity…)

Vulcan

Now

Future

Page 11: SMWCon Spring 2012 SMW+ Team Dev Update

ApplicationsBusiness

IntelligenceInformation Integration

Knowledge management

Page 12: SMWCon Spring 2012 SMW+ Team Dev Update

A Semantic Sci-Fi Movie Database

From Wikipedia.org

Structure extracted from templatesInfoboxes and so on

Queries and visualizations

12http://wiking.vulcan.com/cinema

Page 13: SMWCon Spring 2012 SMW+ Team Dev Update

13

Work Order Handling

Simple semantic form-

based wiki

Used by people of different

roles

Semantic markup via form

templates

Complete capture of

semantic data

Ingredients for cool presentati

on

Semantic notificatio

ns and RSS

Page 14: SMWCon Spring 2012 SMW+ Team Dev Update

SMWPlus.com

Page 15: SMWCon Spring 2012 SMW+ Team Dev Update

15

UltrapediaUltrapedia: An SMW demo built to explore general knowledge acquisition in a wiki

Wikipedia merged with the power of a database

Help Readers and Writers Be More Productive

An Analytical Encyclopediahttp://wiking.vulcan.com/up/

Page 16: SMWCon Spring 2012 SMW+ Team Dev Update

Standard View of the Wiki Data

http://wiking.vulcan.com/up/index.php/Porsche_996

Page 17: SMWCon Spring 2012 SMW+ Team Dev Update

Dynamic View of Data

Page 18: SMWCon Spring 2012 SMW+ Team Dev Update

Graph View of the Acceleration Data

Page 19: SMWCon Spring 2012 SMW+ Team Dev Update

Dynamic Mapping and Charting

Page 20: SMWCon Spring 2012 SMW+ Team Dev Update

20

Information Discovery via Visualization

Page 21: SMWCon Spring 2012 SMW+ Team Dev Update

And A Lot MoreMouse-Hover Preview of Semantic Data

SRF: Exhibit Semantic Result Formatter

SRF with OFC (Open Flash Chart)

Lazy Loading (in Tabs)

Aggregation Enhancement

Triple-store integration (sparql ask)

Importing etc.

Page 22: SMWCon Spring 2012 SMW+ Team Dev Update

22

The InspirationWe started with a

We could have an

wiki site

Web application

Page 23: SMWCon Spring 2012 SMW+ Team Dev Update

Semantic Entertainment

Social database-style characterization

Database search + wiki text search

Semantic consistency via wiki mechanisms

Easy to engineer

Semantic Football

Page 24: SMWCon Spring 2012 SMW+ Team Dev Update

24

Automatically populate tables

Just the data you want, At the level you want Calendars and timelines Workflows Personal menus Form-oriented inputs Notifications via

email/RSS MS Office integration SVN integration

Project Management with

SMW+

Previous Demo: http://wiking.vulcan.com/dev/index.php/Sprint_101020

Page 26: SMWCon Spring 2012 SMW+ Team Dev Update

NeuroWiki & LDIF• Open, public online access• Data from multiple RDF

data stores• Complete import pipeline

using LDIF framework• Outlines of each imported

instance embedding inline wiki properties and providing views of

imported properties from original RDF datasets

• Charting tools that ‘pivot’ SPARQL queries providing

several views of each query• Navigation and composition tools for

accessing and mining the data

Page 27: SMWCon Spring 2012 SMW+ Team Dev Update

LDIF Wiki BridgeR2R visual editor for mappings between linked data sources and the wiki ontology

SILK visual editor for mappings between linked data instances and pre-existing instances within the wiki

Data source mapping namespace for defining and reloading LDIF sources

For more info, attend Wil’s visualization talk on Friday

Page 28: SMWCon Spring 2012 SMW+ Team Dev Update

28

SMWCON SPRING 2012 WIKI

Page 29: SMWCon Spring 2012 SMW+ Team Dev Update

What We’ve Done (1)

SMW Core and Semantic Form Enhancement

Ask/Inline Query Group & Aggregation

Semantic NotifyMe is still alive and good!

True View Extension SMARTY view layer for javascript/html/css injection and manipulation

Pivot view of SPARQL result in 2 views (broadtable + dynamic charts)

Page 30: SMWCon Spring 2012 SMW+ Team Dev Update

What We’ve Done (2)

Semantic Result Formatter (SRF)Better Exhibit (Google Map Geo-lookup, Multi-label…)

Better charting (SRF++, OFC-Scatter Plot, High Charts)

Wiki Object Model Inline Editing, Data I/O

Widget Editor (Semantic Page Maker)

Microsoft Office Connector Semantic WikiTags + Semantic Connector

Page 31: SMWCon Spring 2012 SMW+ Team Dev Update

What We’ve Done (3)

Improve of SMWPlus website usability

And development process

Update mechanisms for scheduled tasks

Improve Semantic Forms and Automatic Semantic Forms

Improve Wiki Administration Tool

Improve Faceted Search

Improve tabular forms

Improve WYSIWYG editor

Wiki Performance Profiling

Build a WikiApp for Master Data Managment

Page 32: SMWCon Spring 2012 SMW+ Team Dev Update

What We’ve Done (4)

LDIF: Linked Data Integration Framework

R2R Ontology Mapping Tools

Configuration File

Web GUI

Entity Resolution (via SILK)

Performance ImprovementFaster

Smaller memory footprint

More Data I/O SupportRDF, N-Triple

Download / Crawling

SPARQL endpoints

Scaling OutNew triple store for more data in single machine

Hadoop for parallelization

Quality and Trust Policy Engine

Page 33: SMWCon Spring 2012 SMW+ Team Dev Update

ExtTab extension

ExtTab : http://www.mediawiki.org/wiki/Extension:ExtTab

Page 34: SMWCon Spring 2012 SMW+ Team Dev Update

SemanticArchive extension

Display Edit History on Wiki Pages

Can be used for Comments

Or just view of change hisotry

SemanticArchive : http://wiking.vulcan.com/wikitags_release/extensions/SemanticArchive

Page 35: SMWCon Spring 2012 SMW+ Team Dev Update

SRFPlus extension

ExhibitTimeline

Map

Open Flash Charts

SIMILE Runway

http://wiking.vulcan.com/wikitags_release/extensions/SRFPlus 

Page 36: SMWCon Spring 2012 SMW+ Team Dev Update

Wiki Object Model

api.php?

• action=womget• page=WOM Test Page• format=xml• xpath=

• //template[@name="Wom test"]• /template_field[position()<3]

WOM API uses xpath syntaxcan return results in xml and json

Page 37: SMWCon Spring 2012 SMW+ Team Dev Update

Wiki Widget Editors (SemanticPageMaker)

Enable Wiki Users to Create Wiki Apps by

Modeling an ontology

Configure options

Automatic Semantic Forms on Steroids

Core techniques behind SMWCon Spring 2012

And our new Scrum Wiki (dev2)Previous SMWCon talk : http://www.slideshare.net/jiaxinwang/semantic-wiki-page-maker http://wiking.vulcan.com/smwcon/extensions/WikiEditors/helps/help_WE_designer.html Download Link

Page 38: SMWCon Spring 2012 SMW+ Team Dev Update

WikiNG Scrum Site

http://wiking.vulcan.com/dev2

Page 39: SMWCon Spring 2012 SMW+ Team Dev Update

svnhelp extension

http://wiking.vulcan.com/dev2/index.php/Property:Project_task#SVN_Map_Settings

http://wiking.vulcan.com/dev2/index.php/(SVN_Post-commit)_wiking_rid:1097

Page 40: SMWCon Spring 2012 SMW+ Team Dev Update

Microsoft Office Connector Version 2

Leverage Microsoft Office applications and technology

Bring SMW info to Office applications on-demand

API for data I/O: add and modify wiki data within Microsoft Office

Utilize semantics to improve relevance

Smart actions for semantic properties

Connections

API

API

SmartJesse Wang | SemTech 2010

Page 41: SMWCon Spring 2012 SMW+ Team Dev Update

Support Office 2010

Page 42: SMWCon Spring 2012 SMW+ Team Dev Update

Support MediaWiki APISupport Wikipedia directlyMOC can access any wiki

Page 43: SMWCon Spring 2012 SMW+ Team Dev Update

Support WOM API / WE API

Page 44: SMWCon Spring 2012 SMW+ Team Dev Update

Support External Data

Page 45: SMWCon Spring 2012 SMW+ Team Dev Update

What’s Next (1)Improvement of our extensions

Wiki Object Model

WE/Semantic Page Maker

Faceted Browsing/Search

Data Integration

Maintenance of existing wiki appsScrum

Neurowiki

Page 46: SMWCon Spring 2012 SMW+ Team Dev Update

What’s Next (2)Social as in “Social Semantic Web”

Better semantic notifications

Social ProfileInteractivity

Social Network integration in SMW

Gamification!

Semantics as in Social Semantic Web Natural Language Processing Integration

Analytics

Page 47: SMWCon Spring 2012 SMW+ Team Dev Update

What’s Next (3)

Usability: Wiki = Quick and Easy

Used to be… Now?

Page 48: SMWCon Spring 2012 SMW+ Team Dev Update

What’s Next, Really…

What our stakeholdersLike youSay

Page 49: SMWCon Spring 2012 SMW+ Team Dev Update

AcknowledgementPaul Allen

Mark Greaves

Project Halo

SMW Core Developers

SMW+ Team

Wil Smith

Vulcan Technology

TeamMersion LLC

49

Thank you!