What Is Microsoft Marketplace What Is Microsoft Marketplace DataMarketDataMarket?

What Is Microsoft Marketplace What Is Microsoft Marketplace DataMarketDataMarket?

Michael StiefelMichael Stiefelwww.reliablesoftware.com

development@reliablesoftware.comwww.reliablesoftware.com/dasblog/

default.aspxLevel: Intermediate

A marketplace of data sets with a A marketplace of data sets with a standard API.standard API.

DataMarket is about the possibilities…DataMarket is about the possibilities…

Application: Should I Move There?Application: Should I Move There?

Is it safe?Crime Data from the U. S. Government

What are my neighbors like?Consumer Expenditure Data

Key US Demographics by Zip Code, Place and County

What is the weather like?Weather Data

Can I buy a house there?Home Valuation

Mortgage Information

Trusted Data ProvidersTrusted Data Providers

AuthoritativeCommercial

Government

Structured and Unstructured Data

Uses OData ProtocolUses OData Protocol

REST based OData feed use HTTP/HTTPS URIs.Open Data Protocol

Astoria / ADO.NET Data Services / WCF Data Services

Builds on ATOM, JSON, XML

Clients can be Java, .NET, PHP, Silverlight, iPhone, Windows Phone 7, etc.

OData Data ModelOData Data Model

OData Feed is a collection of typed Entrieshttp://services.odata.org/OData/OData.svc/Products

Entry has simple or complex properties

Service Operations can be exposedhttp://services.odata.org/OData/OData.svc/

Metadata availablehttp://services.odata.org/OData/OData.svc/$metadata

Allows for automated discovery of different feeds

Types of QueriesTypes of Queries

Flexible QueryDynamically Build Queries

Use Visual Studio Add Service Reference

Fixed QueryPredetermined provider query

May or may not have optional parameters

Use provider created proxy class

Making a QueryMaking a Query

Formulate Query String

Add parameters for filters, paginationServer based filtering

Get back XML payload

Authenticate with Account Key

DataMarket Portal…..DataMarket Portal…..

DemosDemos

Business ModelBusiness Model

Some Free Data Sets for Developers

Transaction (query) or Subscription Pricing

Broad Spectrum of data

"Easy to understand licensing“

Microsoft takes a brokerage commission

Content Developer Opportunities Content Developer Opportunities

One place to look for data

One format for getting data

Understand data set through Explorer

Clear licensing

Clear Subscription Model

Subscription ModelsSubscription Models

OptionsUnlimited

Limited to a fixed number of transactions

Billed monthly

Optional throttling by content provider

Auto renew

Free public data sets available

Content Provider OpportunityContent Provider Opportunity

MarketplaceControl data, terms, price

Single point of billingPeriodically receive payments and reports

Data transformation to common formats

Long Tail for Data providers

Built on Windows Azure

AdvantagesAdvantages

Developer has one billing relationship through the marketplace

Access data sets that were previously difficult to obtain

Standard API allows DataMarket to be used from Java, PHP, or on an IPhone.

DataMarket Front End ArchitectureDataMarket Front End Architecture

Azure Web role for portal and requests

Frequent requests cachedIn memory cache for VM

Azure tables for distributed cache

Data sources help define cache lifetimes

DataMarket Bank End ArchitectureDataMarket Bank End Architecture

Queues and Worker roles for returning data

SQL Azure for account information

Data sets with CSDL mappingSQL Azure

Provider Web services

Health Monitoring with sample queriesTransferred to Azure tables with reporting

Alerts based on results

Certificates for 3rd party connection info

SummarySummary

Dallas is an application built on Azure

Uses OData API for simplicity

Can integrate with Access Control Service

Business Model drives "sense" of the application