gianluigi viganò - how to use hp heaven-on-demand functions for big data apps

35
HPE Haven OnDemand functions for Big Data app gianluigi viganò | HP Big Data Platform Technologist Architect

Upload: codemotion

Post on 13-Apr-2017

303 views

Category:

Technology


1 download

TRANSCRIPT

HPE Haven OnDemand functions for Big Data app

gianluigi viganò | HP Big Data Platform Technologist Architect

HAVEn: Powered by the industry’s leading Big Data engines

“Analysis at the speed of business”

HP Vertica Analytics Platform: Purpose-built analytics platform to manage petabytes of data at massive scale with blazing-fast analytics

How it works: Columnar architecture with intelligent data compression, built-in analytic functions, and open integration to meet analytic use cases

Key advantage: Extremely accessible technology to manage and analyze massive volumes of data in seconds, not weeks

Spectrum of use cases: Network QoS, supply chain optimization, ecommerce analysis, sensor data analytics, customer analytics

Vertica

“Structure and insight from chaos”

HP IDOL Information platform for processing free text, audio, video, image and “create” structured data

How it works: Probabilistic modeling and pattern-matching to understand concepts in information in context

Key advantage: Analyze diverse forms of unstructured information to probe and explore data

Spectrum of use cases: Information governance, eDiscovery, knowledge management, insider trading

IDOL

Understand

& analyze

100% of your

information from

any source, with

extreme speed

and scale

https://haven.hpwsportal.com

3

HP Vertica: No limits, no compromises.

Supports all preferred tools

Open architecture

Columnar: 50x-1,000x faster

Blazing fast analyticsUnlimited low-cost nodes

Massive scalability10x-30x more data per server

Optimized data storage

Private Cloud Public Cloud ApplianceSoftware Only

Purpose built for Big Data - from the very first line of code

Flexible deployment

Vertica Community, Marketplace, InnovationsCollaboration Platform

IDOL: understanding human informationHarnessing the power

• Access and understand virtually any source of information on-premise and in the cloud

• Eduction: ‘understand items’ (names, place, organization, context)

• On screen text reconition, speech to text, face recognition…

Social Media Video Audio Email Texts Mobile

Transactional Data IT/OTDocuments Search Engine Images

Haven OnDemand Developer PlatformA Self-Service API platform for building data-rich Applications and Analytics

7

• Platform of functionalities for the building of

data-rich applications

• Text, Images, Audio, Video, Semi-structured, Structured

• Exposed as REST-like APIs

• Data-flow Orchestration for combining individual functions

into truly powerful application components.

• Developer-focused

• 100% Self Service

• Truly OnDemand

Just a click away

Immediate availability - Sign up for a trial account

at www.havenondemand.com

What’s an API?

8

API’s are powerful ways to

solve problems

Problem: I’d like to know the sentiment of

the tweets about my product so I can

make better decisions

API = Sentiment Analysis: Give me the

text and I’ll tell you all about what people

feel about your product.

What API Choices do I have?

9

Around 70 API’s today…Check them out! www.havenondemand.com

Can I combine APIs?“Actually I’m looking to automate the Net Promoter Score analysis for my company, sentiment was simply a step toward that end. Can I add other API’s and make them work together?”

10

Technology

11

APIs for Enrichment, Search, Analytics & Automation

12

Unstructured

Text Search

Unstructured

Analytics

Textual

EnrichmentAudio /

Video

Statistical

AnalysisCategorizati

on

APIs for Data Ingestion

13

Central Cloud

Administration

SMTP

Syslog

Usage Examples

14

Electronic Discovery AppConnect the dots

15

Customer Call Analysis AppConnect the dots

16

Sphero AppConnect the dots

17

How to use Haven OnDemand

18

19

20

21

22

How to use Haven OnDemandAPI

23

24

25

APIs Category

– Audio-Video Analytics

– Speech recognition

– Connectors

– Retrieve data from repository, build and manage index

– Format Conversion

– Text Extraction, View Document, OCR Document

– Store Object (return store reference for use in other APIs..

– Graph Analysis

– Image Analysis

– Barcode recognition, Face detection, Image recognition, OCR document

– Policy

– Classify and define policy on documents

– Prediction

– Predict and analyze data (Decision Tree, Logistic Regression, Naive Bayes and SVM algorithms)

– Search

– query text index

– Find similar

– Get content

– Text analysis

– Sentiment analysis, language identification,…

– Text indexing

– Index management

26

API details

27

description

Supported inputs

API details

28

Requested input

How to call it

Optional parameter

API details

29

API details

30

API details

31

API details

32

Connectors

33

- Connectors allow you to retrieve information from external systems

- You can use it to create an index (created by the Create Text Index API)

- Connectors type:- Cloud ( Web, Dropbox…)- On-Premise (File System, SharePoint, ODBC, Documentum, Confluence, Exchange, Notes..

- Connector parameters include:- Action to take, schedule, credentials Policy & expiration, limits…

- Start/Stop Connector API

- Update/Delete....

A simple program

34

APIs location and ‘My’ APIs-Key

API call

Thank [email protected]

https://www.havenondemand.com/https://my.vertica.com/https://haven.hpwsportal.com/ 35