Spark the future.

Chris Hewitt

Adding magic to your business with Perceptual Intelligence

ARC323B

People are better than machinesAt communicating and understanding:

ButPeople are expensiveAnd can’t handle huge volumes of communications (emails, tweets, posts, phone calls)

Cortana Analytics Suite

Business ScenariosRecommendations,

customer churn,forecasting, etc.

Personal Digital Assistant

Cortana

Dashboards and Visualizations

Power BI

Machine Learning and Analytics

Azure Machine Learning

Azure HDInsight (Hadoop)

Azure Stream Analytics

DATA

Business apps

Custom apps

Sensors and devices

INTELLIGENCE ACTION

People

Automated Systems

Big Data Stores

Azure Data Lake

Azure SQL Data Warehouse

Information Management

Azure Data Factory

Azure Data Catalog

Azure Event Hub

Vision LUISFace Speech Text

Cortana Analytics Perceptual APIs

Help you build applications that understand and communicate with people

Emotion

Spell

A b c

Analyse ImagesOCR text in imagesGenerate thumbnails

Vision APIs

Uses for Vision APIsApplications that allow users to upload images

Auto check for racy or pornographic imagesCarsales – Replace/assist humans to check images. Detect number plates in image set (good) or phone numbers (bad)

Image collections (commercial or personal)Category based searches, colour based searches, image type, images with people etc.Sophisticated thumbnail creation

Vision API Demo

Face APIs

Face detectionFace verificationSimilar face searchingFace groupingFace identification

JSON:

[

{

"faceId": "763721cb-2156-4507-b43f-649f310aa74e",

"attributes": {

"age": 38,

"gender": "female"

}

},

{

"faceId": "7694d078-2567-42ce-b89e-3f2af65ab7be",

"attributes": {

"age": 38,

"gender": "male",

}

}

]

Uses for Face APIs

So many uses…You could build how-old.netMake our border control kiosks work fasterSecure your applications (do I know you?)Find your long lost clonesFeaturise faces to feed ML modelsCheck for excluded people in bars…

Face API Demo

Emotion API

Analyse facialemotions

"Scores": { "Anger": 0.0000669986039, "Contempt": 0.0189291481, "Disgust": 0.00009537181, "Fear": 0.00005882179, "Happiness": 0.4889999, "Neutral": 0.4900676, "Sadness": 0.00144875725, "Surprise": 0.0003333804 }

Uses for Emotion API

Distance Educationhow-happy.net?Audience reactionBorder security

Emotion API Demo

<speak version='1.0' xml:lang='en-US'>

<voice xml:lang='en-US' xml:gender='Female'

name='Microsoft Server Speech Text to Speech Voice (en-AU, Catherine)'>

The icon says it all. Text to speech and speech to text.

</voice>

</speak>

Speech API

Uses for Speech API

Out of the boxAdd speech recognition to your applicationsHave your application/web page speak text

With some help from its friendsImplement voice commands for your app (+ LUIS)Advanced call direction (+ LUIS)

Speech API Demo

LUISLanguage Understanding Intelligent Service

Detect intent Determine entities to act onYour application can understand what your users are sayingConstant improvement through active learningRe-use existing models from Bing and Cortana

Uses of LUIS

Natural language interaction with applicationsRetrofit to existing apps

intent => controller/action methodsentities => models

Get rid of the keyboard (+ Speech API)

"query": "open the pod bay doors please HAL",

"intents": [

{"intent": "Open", "score": 0.9999995

}],

"entities": [

{"entity": "hal","type": "HAL"},

{"entity": "pod bay doors", "type": "Pod Bay Doors"}]

LUIS Demo

Spell Checker API

Not your grandmother’s spell checker. It can spell… andDetect ambiguous language and word usage, word breaking issues, common name errors, slang and colloquialisms, brands and coined expressions.

Uses of Spell Checker API

You add it to your application…Which can then speil properly

spellingErrors": [ { "offset": 15, "token": "speil", "type": UnknownToken", "suggestions": [ {"token": "spell"}, {"token": "speak"}, {"token": "spiel"}

Spell Checker Demo

Text Analytics API

Sentiment AnalysisKey Phrase Extraction

abc

Uses of Text Analytics

Can process large batchesKey phrases amenable to further analysis

This presentation is very interesting.The Text Analytics API's pre trainedmodel makes sentiment analysis easy.

abc

Text Analytics Demo

abc

Content Moderator

https://www.microsoft.com/en-us/moderator

abc

https://www.microsoft.com/gigjam

Microsoft GigJam

SDK

GithubNugetMaven

Finally

The Perceptual APIs allow you to easily implement sophisticated features in your apps that were previously hard to do.

A b c

Complete your session evaluation on My Ignite for your chance to win one of many daily prizes.

Continue your Ignite learning pathVisit Microsoft Virtual Academy for free online training visit https://www.microsoftvirtualacademy.com

Visit Channel 9 to access a wide range of Microsoft training and event recordings https://channel9.msdn.com/

Head to the TechNet Eval Centre to download trials of the latest

Microsoft products http://Microsoft.com/en-us/evalcenter/

© 2015 Microsoft Corporation. All rights reserved.Microsoft, Windows and other product names are or may be registered

trademarks and/or trademarks in the U.S. and/or other countries.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,

AS TO THE INFORMATION IN THIS PRESENTATION.