gianluigi viganò - how to use hp heaven-on-demand functions for big data apps
TRANSCRIPT
HPE Haven OnDemand functions for Big Data app
gianluigi viganò | HP Big Data Platform Technologist Architect
HAVEn: Powered by the industry’s leading Big Data engines
“Analysis at the speed of business”
HP Vertica Analytics Platform: Purpose-built analytics platform to manage petabytes of data at massive scale with blazing-fast analytics
How it works: Columnar architecture with intelligent data compression, built-in analytic functions, and open integration to meet analytic use cases
Key advantage: Extremely accessible technology to manage and analyze massive volumes of data in seconds, not weeks
Spectrum of use cases: Network QoS, supply chain optimization, ecommerce analysis, sensor data analytics, customer analytics
Vertica
“Structure and insight from chaos”
HP IDOL Information platform for processing free text, audio, video, image and “create” structured data
How it works: Probabilistic modeling and pattern-matching to understand concepts in information in context
Key advantage: Analyze diverse forms of unstructured information to probe and explore data
Spectrum of use cases: Information governance, eDiscovery, knowledge management, insider trading
IDOL
Understand
& analyze
100% of your
information from
any source, with
extreme speed
and scale
HP Vertica: No limits, no compromises.
Supports all preferred tools
Open architecture
Columnar: 50x-1,000x faster
Blazing fast analyticsUnlimited low-cost nodes
Massive scalability10x-30x more data per server
Optimized data storage
Private Cloud Public Cloud ApplianceSoftware Only
Purpose built for Big Data - from the very first line of code
Flexible deployment
IDOL: understanding human informationHarnessing the power
• Access and understand virtually any source of information on-premise and in the cloud
• Eduction: ‘understand items’ (names, place, organization, context)
• On screen text reconition, speech to text, face recognition…
Social Media Video Audio Email Texts Mobile
Transactional Data IT/OTDocuments Search Engine Images
Haven OnDemand Developer PlatformA Self-Service API platform for building data-rich Applications and Analytics
7
• Platform of functionalities for the building of
data-rich applications
• Text, Images, Audio, Video, Semi-structured, Structured
• Exposed as REST-like APIs
• Data-flow Orchestration for combining individual functions
into truly powerful application components.
• Developer-focused
• 100% Self Service
• Truly OnDemand
Just a click away
Immediate availability - Sign up for a trial account
at www.havenondemand.com
What’s an API?
8
API’s are powerful ways to
solve problems
Problem: I’d like to know the sentiment of
the tweets about my product so I can
make better decisions
API = Sentiment Analysis: Give me the
text and I’ll tell you all about what people
feel about your product.
Can I combine APIs?“Actually I’m looking to automate the Net Promoter Score analysis for my company, sentiment was simply a step toward that end. Can I add other API’s and make them work together?”
10
APIs for Enrichment, Search, Analytics & Automation
12
Unstructured
Text Search
Unstructured
Analytics
Textual
EnrichmentAudio /
Video
Statistical
AnalysisCategorizati
on
APIs Category
– Audio-Video Analytics
– Speech recognition
– Connectors
– Retrieve data from repository, build and manage index
– Format Conversion
– Text Extraction, View Document, OCR Document
– Store Object (return store reference for use in other APIs..
– Graph Analysis
– Image Analysis
– Barcode recognition, Face detection, Image recognition, OCR document
– Policy
– Classify and define policy on documents
– Prediction
– Predict and analyze data (Decision Tree, Logistic Regression, Naive Bayes and SVM algorithms)
– Search
– query text index
– Find similar
– Get content
– Text analysis
– Sentiment analysis, language identification,…
– Text indexing
– Index management
26
Connectors
33
- Connectors allow you to retrieve information from external systems
- You can use it to create an index (created by the Create Text Index API)
- Connectors type:- Cloud ( Web, Dropbox…)- On-Premise (File System, SharePoint, ODBC, Documentum, Confluence, Exchange, Notes..
- Connector parameters include:- Action to take, schedule, credentials Policy & expiration, limits…
- Start/Stop Connector API
- Update/Delete....
Thank [email protected]
https://www.havenondemand.com/https://my.vertica.com/https://haven.hpwsportal.com/ 35