Zentity v2.0Overview

Oscar NaimSr. Research Program Manager

Microsoft External Research

• What’s Zentity?– Research Output Repository Platform– Hybrid store (triples + relational)

• Key Features– Semantically rich functionality– Data agnostic– Support for extensibility and interoperability

• Key Scenario– Repository for all scholarly related byproducts of the

research life cycle

Zentity 101

ZentityPlatform

Client Applications

Desktop Tools

SyndicationInterop

Search

• A platform for building services and tools for research output repositories

• Papers, Videos, Presentations, Lectures, References, Data, Code, etc.

• Relationships between stored entities

Overview

• Aims to provide necessary building blocks, tools, and services for creating and managing an organization’s repository ecosystem around research content.

• Built on top of Microsoft SQL Server 2008 and the ADO .NET Entity Framework and LINQ.

Overview

• Core data model with extensibility, which can be used to create custom data models, even for domains other than Scholarly Communications

• Built-in Scholarly Works data model with predefined resources• Extensive Search similar to Advanced Query Syntax (AQS)• Pluggable Authentication and Authorization Security API• Basic Web-based User Interface to browse and manage

resources with reusable custom controls (Scholarly Works only)• RSS/ATOM, OAI-PMH, AtomPub, SWORD Services for exposing

resource information• Extensive help with code samples extend the platform by

developers

Key Features

Data Models

Zenti

ty.C

ore

Zenti

ty.S

chol

arly

Wor

ks

Data Model Module

Resource Type

Scalar Property Navigation Property

InheritanceAssociation

• Change history management for tracking changes to resource metadata and relationships

• Various ASP .NET custom controls such as ResourceProperties, ResourceListView, TagCloud, etc.

• Import/ export BibTex for managing citations• Prevent duplicates using the Similarity Match API• RDFS parser provides functionality to construct an RDF Graph

from RDF XML • OAI-PMH to expose metadata to external search engine

crawlers• OAI-ORE support for Resource Maps in RDF/XML• AtomPub implementation for supporting deposits to repository

Additional Features

Hybrid Approach

Triple stores-Evolution friendly-Poor performance-No need to model everything in advance-Semantic interpretation at the application level

Relational schema-Evolution not so easy-Great opportunities for optimization-Model everything in advance

Zentity Platform-Maintain a balance-Try to model the frequently used entities in our app domain-Try to capture the frequently used relationships-Allow for extensibility (Relationships, Properties)

• Focus on “Resources”• Surface “Relationships” as first-class entities

through our API• Model few relationships explicitly for performance

reasons (e.g. “contains”, “author”, etc.) for our Scholarly Communications data model

• Model key entities explicitly for our Scholarly Communications model

• Expose the same functionality to arbitrary data models

Key Design Decisions

• Create a platform for building “research output” repositories

• An ecosystem of services and tools

• Build an easy-to-install collection of basic services and tools

• Extensibility

Architecture Goals

SQL Server 2008, Entity Framework, .NET 4.0, LINQ

Zentity Platform(based on the Entity Framework +

semantic data model)

3rd-party services, tools,

applications, Zentity SDK

Zentity services, Web site,

interoperability

Zentity v2.0 – What’s in it?• Source code release• Target MS-PL or BSD/Apache 2.0• Full test pass/bug fixesCodePlex

• Up and running in 1 hour• SQL “AdventureWorks” equivalent experience• Available on a Windows client (i.e. Windows 7)

One-hour Evaluation

• Visually compelling sample applications• Dynamic sample data sets that demonstrate value/prop• Well documentedZentity SDK

• ADO .NET Data Services enhancements• ODATA compliant.NET 4.0 Upgrade

• Provide services layer• Enable 3-tier applications (backend, middle ware, client)• Enterprise readyZentity Services

Open Data Protocol

Zentity Services

RSS, Atom AtomPub, SWORD

OAI PMH, OAI ORE

Data Service

Pivot Collection

Service

Zentity Client Applications

Visual ExplorerZentity Console

(PowerShell)Pivot Viewer

Web UI (Scholarly Works)

Zentity Server

Core Data Model Scholarly Works My Custom

Data Model

Zentity v2.0 – Architecture

Introduction to Pivot

Zentity Pivot Viewer

Zentity Pivot Viewer

Zentity Visual Explorer

Define Collection

Generate Collection

Publish Collection

Consume Collection

Update Collection

Incremental Collection Updates

Pivot Collection

Images

Meta-data

Data Model

Zentity v2.0 - Pivot Collection Service

Graph of Relationships

PowerPoint presentation

Lecture on 7/9/2010

authored by

Oscar

presented byorganized by

Open Repositories 2010

PDF file

is representation ofcontains

Graph of Relationships

Zentity 2.0 Technical Preview

DEMO

Project Goals

CodePlex Release• Community involvement• ISVs + Third parties

“Enterprise” ready• MSR Repository

Adoption• University of New

Mexico• Seattle Art Museum• Universidad de La Salle

and Tadeo Lozano (Colombia)

• Queen Margaret University, University of Edinburgh

• UK ESRC• Pharma (e.g. Novartis,

J&J)• UCLA, University of

Southampton

Project Libra Integration• Semantic annotations• Active Text• Visual Summaries

• RIC Integration• SQL Semantic Engine Integration• Academic Search Integration• Azure Integration

Zentity v2.0 – What’s next?

ZentityResearch Output Repository Platform

Goals• Support the MSR publishing and dissemination

platform for all researcher outputs• Enable a tools and services ecosystem for

“research output” repositories on MS technologies

Execution• Built on SQL Server 2008 + Entity Framework +

LINQ + .NET 4.0• Use of standard community protocols

(e.g. SWORD, OAI-ORE, etc)• Zentity v2.0 Technical Preview available soon!

A platform for building services and tools for research output repositories:• Papers, Videos, Presentations, Lectures, References, Data,

Code, etc.• Relationships between stored entities

Data Acquisition &

ModelingCollaboration Analysis Disseminate

& Share Archiving