focal point: how to adjust your analytical lens
TRANSCRIPT
Twitter Tag: #briefr
The Briefing Room
! Reveal the essential characteristics of enterprise software, good and bad
! Provide a forum for detailed analysis of today’s innovative technologies
! Give vendors a chance to explain their product to savvy analysts
! Allow audience members to pose serious questions... and get answers!
Mission
Twitter Tag: #briefr
The Briefing Room
Topics
This Month: ANALYTICS
October: DATA PROCESSING
November: DATA DISCOVERY & VISUALIZATION
Twitter Tag: #briefr
The Briefing Room
Analytics
TOOLS Data Visualization
PERSPECTIVE DISCOVERY
YREVOCSID
Twitter Tag: #briefr
The Briefing Room
Analyst: Richard Winter
Richard Winter is an industry expert in large scale data management and big data, architecture and implementation with over 25 years of experience. As President of WinterCorp, he advises executives on their strategies and critical projects, focusing on scalability, performance and availability in big data, data analytics and data warehousing. Mr. Winter is a frequent author and speaker, and leads seminars and structured workshops on scalability management, including the architecture and selection of big data, analytic data and data warehouse platforms, and on the development of big data solutions. Mr. Winter also has extensive experience in the creation, direction and evaluation of pilot systems; proofs-of-concept; benchmarks; and, other performance measurement and systems engineering projects relating to analytic data platforms and solutions.
Twitter Tag: #briefr
The Briefing Room
Teradata
! Teradata is known for its analytics data solutions with a focus on integrated data warehousing, big data analytics and business applications
! It offers a broad suite of technology platforms and solutions and a wide range of data management applications
! The Teradata Aster Discovery Platform was designed specifically to help business users navigate big data
Twitter Tag: #briefr
The Briefing Room
Guest: Chris Twogood
Chris Twogood is Vice President of Product and Services Marketing for Teradata Corporation. He is responsible for marketing Teradata products (database, utilities and platform), Teradata services (professional and customer services), plus technical field sales support teams. Chris has 25 years of experience in the computer industry specializing in data warehousing, decision support, customer management, and appliance platforms. He started his career with NCR in retail Point of Sale solutions (POS), and then moved to AT&T to manage channel development and strategic partners. At Teradata, Chris has had roles that span Strategy, Application Definition, Marketing, Product Requirements/Management, Platform Solutions, and Product Marketing.
Chris Twogood VP, Product & Services Marketing, Teradata
ADJUST YOUR ANALYTICAL LENS WITH ASTER DISCOVERY PLATFORM
10 9/10/13
Seeing Your Business in High-Definition
Ø DATA enables INSIGHTS which drive ACTIONS to provide BUSINESS ADVANTAGE thru BETTER DECISIONS
Ø Big Data is DATA. It “adds to” the depth and types of INSIGHTS ... But the rest of the story is the SAME
Ø However,
• the economics have changed, increasing the amount of data you can capture
• the tools have been enhanced, expanding the data types you can analyze
• The architecture framework has evolved so you can use the right tool for the right job
UNIFIED DATA ARCHITECTURE
ACCESS MOVE MANAGE Marketing Executives
Operational Systems
Frontline Workers
Customers Partners
Engineers
Data Scientists
Business Analysts'
Math and Stats
Data Mining
Business Intelligence
Applications
Languages
Marketing
APPLICATIONS
USERS
DISCOVERY PLATFORM
INTEGRATED DATA WAREHOUSE
ERP
SCM
CRM
Images
Audio and Video
Machine Logs
Text
Web and Social
SOURCES
DATA PLATFORM
UNIFIED DATA ARCHITECTURE
ACCESS MOVE MANAGE Marketing Executives
Operational Systems
Frontline Workers
Customers Partners
Engineers
Data Scientists
Business Analysts'
Math and Stats
Data Mining
Business Intelligence
Applications
Languages
Marketing
APPLICATIONS
USERS
DATA PLATFORM
Fast Loading
Filtering and Processing
Online Archival
DISCOVERY PLATFORM
Data Discovery
Path, graph, time-series analysis
Pattern Detection
ERP
SCM
CRM
Images
Audio and Video
Machine Logs
Text
Web and Social
SOURCES
INTEGRATED DATA WAREHOUSE
Business Intelligence
Predictive Analytics
Operational Intelligence
Marketing Executives
Operational Systems
Frontline Workers
Customers Partners
Engineers
Data Scientists
Business Analysts'
Math and Stats
Data Mining
Business Intelligence
Applications
Languages
Marketing
APPLICATIONS
USERS
SQL-H, UNITY, SMART LOADER
CONNECTORS UNITY
VIEWPOINT TVI
MDM
TERADATA UNIFIED DATA ARCHITECTURE
INTEGRATED DATA WAREHOUSE
DISCOVERY PLATFORM
ERP
SCM
CRM
Images
Audio and Video
Machine Logs
Text
Web and Social
SOURCES
TERADATA PORTFOLIO FOR
HADOOP
TERADATA DATABASE
TERADATA ASTER DATABASE
DATA PLATFORM
14 9/10/13
Teradata Aster Discovery Platform
DATA SOURCES
Structured Data
Multi-Structured
Data
Non- Relational
Data
DISCOVERY DISCOVERY TOOLS USERS
Discovery Platform
Data Scientist
Business Analyst
SQL, MapReduce, Graph, Stats, ML
Custom Development
Analytic Applications
OLTP DBMS’s
• Structured and multi-structured data
• Doesn’t require extensive data modeling
• Doesn’t balance the books
• Data quality can be good enough
• No stringent SLAs
• Fraud patterns • Customer behavior • Digital marketing
optimization
Business Users
15 9/10/13
Data Acquisition
Data Preparation Analysis Visualization
Business Users
Data Scientist
Discovery Process Requirements
Rapid Exploration
Fail Fast and Discovery More
16 9/10/13
Teradata Aster Discovery Platform 5.10
TERADATA ASTER DISCOVERY PLATFORM
The Teradata Aster Discovery Platform spurs innovation by unlocking new value from big data. It is the market leading Discovery Platform that provides a complete solution for visual, interactive, and powerful analytic applications that require minimal time and e!ort to derive value from. It comprises of the Teradata Aster Database and the Teradata Aster Discovery Portfolio.
The Discovery Platform is designed for all types of enterprise users to derive novel, high-value business insights through synergistic multi-genre analytics that invoke various state-of-the-art tools (SQL, MapReduce, Text, Graph, and Statistical solutions). It features the industry’s only SQL-MapReduce® framework and an expanding portfolio of over 70 pre-built MapReduce functions. It comes with out-of-the box functionality for data acquisition, preparation, analysis, and visualization and enables users to incorporate all four functions within a single SQL statement. It can be easily used by any SQL-savvy analyst as well as being powerful and flexible for the most technically sophisticated data scientists. Figure 1. Teradata Aster Discovery Platform
TERADATA ASTER DISCOVERY PLATFORM – KEY CAPABILITIES ~ Industry’s only SQL-MapReduce framework that allows developers to write powerful SQL-MapReduce applications (fully database embedded) in languages such as Java, C#, Python, C++, and R and push them into the Discovery Platform for in-database analytics. Applications are invoked using standard SQL commands with ultra-fast query returns.
~ Ability to analyze all data types (structured, multi-structured, and unstructured) at varying volumes and speeds of acquisition, for discovery and exploration. All steps of the discovery process from acquisition to visualization can be executed through one SQL statement.
~ Expanding portfolio of 70+ SQL-MapReduce functions that include path/pattern, statistical, text, and graph analysis that address a variety of use cases in the Manufacturing (yield, a"nity), Finance (fraud, market
basket), Insurance (risk), Health Care (customer behavior), Digital Marketing Optimization (advertising e"cacy), Telecommunications (customer churn), and Retail (personalization, recommendation) verticals.
~ Industry’s first visual SQL-MapReduce functions that use advanced graphing techniques that create powerful visualizations on customer insights. These out-of-the-box visualizations are available inside the database and complement the BI tool visualization functionality.
~ Customers can issue ANSI-standard SQL and SQL-MapReduce queries on the database and to transparently connect to Hadoop via SQL-H™. The Aster database is built on MPP architecture with row or column data storage options.
~ Flexible deployment options include: an integrated hardware and software appliance, software-only solution, or public or private cloud instances.
DATA SHEET04.13 EB-7573
17 9/10/13
What’s New – Aster Discovery Platform 5.10 Aster Lens
Ø Enterprise consumers to find, view and share insights generated by Data Analysts
Ø Data Analysts to publish results of analytics performed on Teradata Aster Discovery Platform
Ø Organizations to move from big data science experiments to increasing business impact
Interactive Web Application that enables:
19 9/10/13
Next Generation Discovery Platform Architecture
”Industry’s First Purpose-Built Platform for Big Data Analytics & Discovery”
Ø New Processing & Storage Architecture for Discovery
Ø New Integrated Analytic Engines
Ø New Data Store
Coming Soon…Aster Discovery Platform 6
20 9/10/13
TERADATA PORTFOLIO FOR HADOOP ”Taking Hadoop from Silicon Valley to Main Street”
• Most Trusted and Flexible Hadoop Platforms for Your Next-Generation Unified Data Architecture™
1. Teradata Aster Big Analytics Appliance 2. Teradata Appliance for Hadoop 3. Teradata Commodity Offering with Dell 4. Hortonworks Data Platform software-only support resell
• Complete consulting and training capability > Big Analytics Services—across the UDA > Data Integration Optimization—ETL, ELT across the UDA > Hadoop deployment and mentoring > Teradata delivering Hortonworks training > Hadoop Managed Services—operations and administration
• Customer Support for Hadoop > World-class Teradata customer support, backed by Hortonworks
What’s New – Teradata Portfolio For Hadoop
21 9/10/13
TERADATA ASTER WINS STEVIE PEOPLE'S CHOICE AWARD FOR FAVORITE NEW PRODUCT OF 2013
FAVORITE BUSINESS INTELLIGENCE SOFTWARE - TERADATA ASTER DISCOVERY PLATFORM 5.10
W I N T E R C O R P
T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
Data Discovery The Path to Value from Data
Richard Winter
WinterCorp
September 10, 2013 V1
©2010 Winter Corporation. All Rights Reserved. 25!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
How Do We Get Significant Additional Value from Data?
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
1. New Insights 2. New Analytics or Tools 3. New Data
©2010 Winter Corporation. All Rights Reserved. 26!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
What is Data Discovery?
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
New Insights
New Algorithms
New Tools
New Data
Discover Business Results
• Improved Business Process • New product or strategy • More effective decisions
Imple-‐‑ment
©2010 Winter Corporation. All Rights Reserved. 27!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
What is Different Lately?
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
1. Many new sources & types of data 2. New economics 3. New analytical tools 4. New visualization tools 5. Huge volumes
©2010 Winter Corporation. All Rights Reserved. 28!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
Where Does Discovery Occur?
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
Hadoop Discovery Platform
Data Warehouse
Storage Processing/Refining Archiving Analytics
Analytics
Repeatable Use Query Reporting Decisioning Analytics
©2010 Winter Corporation. All Rights Reserved. 29!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
Questions
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
1. You have defined a role for a discovery platform, separate from Hadoop and also separate from the data warehouse. But both Hadoop and the data warehouse provide data analytics. What does the customer get from the separate discovery platform that is not readily available elsewhere? In other words, what is the benefit of having a separate platform for discovery?
2. What types of data is the Aster platform able to store and analyze efficiently? For example, does it have any special capabilities for text analytics? Image?
3. A central idea in discovery is that new sources of data are readily explored. How does the Aster platform make that especially easy? And how do customers govern their discovery environment to keep it from becoming difficult?
©2010 Winter Corporation. All Rights Reserved. 30!W I N T E R C O R P : T H E L A R G E S C A L E D A T A M A N A G E M E N T E X P E R T S
©2010 Winter Corporation. All Rights Reserved.
Questions
© 2010, 2011, 2012 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED. © 2012, 2013 WINTER CORPORATION, CAMBRIDGE MA. ALL RIGHTS RESERVED.
4. In data discovery, it is important to fail fast and go on to the next possibility. How does the Aster platform help with this problem?
5. Data visualization is an important aspect of data discovery: sometimes when the investigator sees the visualization, the key insight follows. Can you speak to some of the new and distinct visualizations?
6. Aster features SQL/MR, a unique integration of SQL and MapReduce. Several other platforms offer one or both of these, but not integrated. Can you give an example where the integration of the two adds really significant value for the customer?
Twitter Tag: #briefr
The Briefing Room
Upcoming Topics
www.insideanalysis.com
September: ANALYTICS
October: DATA PROCESSING
November: DATA DISCOVERY & VISUALIZATION