analytic maturity: bringing predictive into the mainstream
DESCRIPTION
The Briefing Room with Dean Abbott and TIBCO Live Webcast on June 3, 2014 Watch the archive: https://bloorgroup.webex.com/bloorgroup/lsr.php?RCID=51377935ef54613b87fa7cfba0c9e1bf The power of predictive software multiplies as it spreads throughout the enterprise. Long used by power analysts to drive corporate strategy and improve decision-making, this technology is now being leveraged by all manner of front-line workers, from operations personnel to customer service, and even up the supply chain. There are several critical success factors for making such solutions work well, including visibility, accuracy and manageability. Register for this episode of The Briefing Room to learn from veteran Analyst Dean Abbott as he explains the barriers and access points to advanced analytics. He’ll be briefed by Lou Bajuk-Yorgan of TIBCO Spotfire, who will discuss how his company’s Analytics Platform empowers all users – data scientists, analysts, and business users – to harness the power of predictive insights within a visual data discovery environment. He’ll discuss the depth & breadth of advanced analytics in Spotfire, using both databases and real-time data streams, and show how you can provide analytics guidance and workflow automation to fully empower business users to gain advanced insights. Visit InsideAnlaysis.com for more information.TRANSCRIPT
![Page 1: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/1.jpg)
Grab some coffee and enjoy the pre-show banter before the top of the hour!
![Page 2: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/2.jpg)
The Briefing Room
Analytic Maturity: Bringing Predictive into the Mainstream
![Page 4: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/4.jpg)
Twitter Tag: #briefr
The Briefing Room
! Reveal the essential characteristics of enterprise software, good and bad
! Provide a forum for detailed analysis of today’s innovative technologies
! Give vendors a chance to explain their product to savvy analysts
! Allow audience members to pose serious questions... and get answers!
Mission
![Page 5: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/5.jpg)
Twitter Tag: #briefr
The Briefing Room
Topics
This Month: ANALYTICS & MACHINE LEARNING
July: INNOVATIVE TECHNOLOGY
August: BIG DATA ECOSYSTEM
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
![Page 6: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/6.jpg)
Twitter Tag: #briefr
The Briefing Room
Database
![Page 7: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/7.jpg)
Twitter Tag: #briefr
The Briefing Room
Analyst: Dean Abbott
Dean Abbott is President of Abbott Analytics, Inc. Dean has more than 21 years of experience applying advanced data mining, data preparation and data visualization methods in real-world data-intensive problems, including fraud detection, response modeling, survey analysis, planned giving, predictive toxicology, signal process and missile guidance. He has developed and evaluated algorithms for use in commercial data mining and pattern recognition products, including polynomial networks, neural networks, radial basis functions and clustering algorithms. He is a seasoned instructor, having taught a wide range of data mining tutorials and seminars.
![Page 8: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/8.jpg)
Twitter Tag: #briefr
The Briefing Room
TIBCO Spotfire
! TIBCO Spotfire is a BI and analytics platform known for its robust visualizations and data analysis capabilities
! The platform offers predictive analytics, and includes Statistics Services, Enterprise Runtime for R and predictive modeling tools
! The TIBCO platform applies real-time, event-driven analytics against streams of data, and it provides workflow guidance and automation
![Page 9: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/9.jpg)
Twitter Tag: #briefr
The Briefing Room
Guest: Lou Bajuk-Yorgan
Lou Bajuk-Yorgan leads Predictive Analytics product strategy at TIBCO Spotfire, including the development of TIBCO Enterprise Runtime for R (TERR), an enterprise deployment platform for R-language analytics. With a background in Physics and Atmospheric Sciences, Lou was a Research Scientist at NASA JPL before focusing on Advanced Analytics and Business Intelligence software. Since then, Lou has worked with scores of customers across many industries to understand their analytic goals and challenges, and helped them to attain strong results through the use of Predictive Analytics. An avid runner and gamer, Lou frequently speaks and tweets (@LouBajuk) about the value of Predictive Analytics.
![Page 10: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/10.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!
As Simple as Possible !Put Advanced Analytics into the Hands of Business! Lou Bajuk-Yorgan!Sr. Director Product Management!TIBCO Software!
![Page 11: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/11.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-11-!
E V E R Y T H I N G S H O U L D B E M A D E A S S I M P L E A S
P O S S I B L E …
But no simpler. Albert Einstein!
![Page 12: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/12.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-12-!
• Quick Overview of the Spotfire Analytics Approach!• Advanced Analytics for Business Users !
– As Simple As Possible!– But No Simpler !
• Benefits !• Demonstration !
Today’s Discussion!
![Page 13: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/13.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-13-!
Everyone looks at data. Inevitably, you see something unexpected, maybe one bar in a bar graph is higher than anticipated; or some points on plot are in the far corner.! !Naturally, you want to learn more and understand why. !
The Fundamental Challenge!
![Page 14: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/14.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-14-!
TIBCO Spotfire is the easiest and simplest tool for understanding why.!!Unlike other approaches, Spotfire was created to help users quickly drill into information and gain insight. !
Spotfire Solution
The TIBCO Spotfire Solution !
![Page 15: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/15.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-15-!
!
All Users!Business ♦ Analysts ♦ Data Scientists ♦ App Developers ♦ Sys Admins!
!
Analytics Platform!Empowers You Every Step of Your
Analytics Journey"!
All Data !Historical & Real-Time ♦ Internal & External ♦ Structured Unstructured!
!
Visual Data Discovery ♦ Analytic Applications & Dashboards !Predictive Analytics ♦ Real-Time Analytics ♦ Location Analytics!
!Governed Data Discovery !
Cloud and On-Premises Deployment!
![Page 16: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/16.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-16-!
Discover Value At Every Step!
Measure!
Diagnose!
Predict &Optimize!
Operationalize!
Automate!
Transform!
ANALYTICS MATURITY!
CO
MPE
TITI
VE A
DVA
NTA
GE!
Descriptive!
Exploratory!
Proactive!
Repeatable!
Real-Time!
Continuous!
![Page 17: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/17.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-17-!
Value With Predictive Analytics!
Measure!
Diagnose!
Predict & Optimize!
Operationalize!
Automate!
Transform!
ANALYTICS MATURITY!
CO
MPE
TITI
VE A
DVA
NTA
GE!
Descriptive!
Exploratory!
Proactive!
Repeatable!
Real-Time!
Continuous!
![Page 18: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/18.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-18-!
Advanced Analytics for
Business Users?!
![Page 19: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/19.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-19-!
Yes!!!!
Everything Should Be Made As Simple As Possible.!
!But no Simpler.!
![Page 20: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/20.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-20-!
Advanced Analytics for Business!
Easy for Business Users…!• Improve decision-making, increase competitiveness!
– Powerful, advanced analytics embedded “under the hood” to discover meaningful patterns and trends!
– Integrated within the analytics decision-making process, side-by-side with descriptive analytics & visualizations!
• Get the answers you need, when you need them !– Self-service, easily discovered and shared!– Targeted and relevant!
![Page 21: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/21.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-21-!
Advanced Analytics for Business!
Flexible for Business Analyst / Analysis Author…!• Easy to create analytics dashboards & applications !
– Support rich, multi-step analytic workflows!– Intuitive tools for predictive modeling and forecasting!
• Secure usage !– Ensure compliance & proper usage of analytics & models!– Incorporate & share best practices and consistent workflows !– Control access to applications and data with standard enterprise
security!
![Page 22: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/22.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-22-!
Does “Simple” Mean
Simplified Analytics?!
![Page 23: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/23.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-23-!
No!!
Everything Should Be Made As Simple As
Possible.!!
But no Simpler!
![Page 24: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/24.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-24-!
The Power of Advanced Analytics!
TIBCO Spotfire!S+!
Open Source R!
TIBCO Enterprise
Runtime for R (TERR)!
SAS®!
MATLAB®!
Teradata Aster!
Powerful for Statisticians…!• Full breadth of Advanced
Analytics native within Spotfire!– Find the best analytic approach for a
given problem!– Develop cutting-edge & proprietary
analytics in the popular R language!• Enterprise Class Engine for
R Language (TERR)!– Agile development & iteration!– Enterprise-ready deployment to
applications, real-time system, and cloud services!
• Leverage existing Predictive Analytic investments!
– Rich Advanced Analytic ecosystem!• SAS®, MATLAB®, R, S+, Teradata
Aster!
![Page 25: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/25.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-25-!
Value with Spotfire Advanced Analytics!
Increase market competitiveness !• Put advanced analytics into the hands of
business decision makers, you increase confidence & effectiveness of decisions across the organization!
Take advantage of market opportunity and threats!
• Anticipate and react to emerging trends!• Identify and respond to potential threats!
Reduce uncertainty & manage risk!• Scenario planning, forecasting, fraud
detection!• Aggregate and evaluate risk!
Proactively act on analysis…!• Segment customers into distinct markets !• Identify opportunities to cross-sell & upsell
products/services!• Forecast unhappy customers and turn
them into fans !
![Page 26: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/26.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-26-!
Demo!
![Page 27: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/27.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-27-!
E V E R Y T H I N G S H O U L D B E M A D E A S S I M P L E A S
P O S S I B L E …
But no simpler. Albert Einstein!
![Page 28: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/28.jpg)
© Copyright 2000-2014 TIBCO Software Inc.!-28-!
Analy9cs on Any Device
Empower All Users
Re-‐Usable Enterprise & Applica9on Objects
Fastest Data Processing Engine
Broadest Integra9on of Data Sources
Enterprise Analytics Architecture !
![Page 29: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/29.jpg)
Twitter Tag: #briefr
The Briefing Room
Perceptions & Questions
Analyst: Dean Abbott
![Page 30: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/30.jpg)
What is Analytic Maturity?
• Sophistication
• Usability
• Automation
© Abbott Analytics, Inc. 2001-201430
![Page 31: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/31.jpg)
What Do We Mean by Predictive Analytics?
• Algorithms?
• or Process?
© Abbott Analytics, Inc. 2001-201431
• CRISP-DM
![Page 32: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/32.jpg)
Algorithms and Maturity • Linear Regression: 1890s
• K-Means: 50s / 60s
• K-NN: 50s / 60s
• Decision trees: 60s / 70s
• Neural networks: 60s (70s) 80s
• Support Vector Machines: 90s
• Ensembles: • Bagging and Boosting: 90s • Heterogeneous ensembles: 2000s
© Abbott Analytics, Inc. 2001-201432
![Page 33: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/33.jpg)
Who’s Going to do this?
The Most In-Demand Skill Today
"If you are looking for a career where your services will be in high demand, you should find something where you provide a scarce, complementary service to something that is getting ubiquitous and cheap. So what’s getting ubiquitous and cheap? Data. And what is complementary to data? Analysis. So my recommendation is to take lots of courses about how to manipulate and analyze data..."
- Hal Varian, Chief Economist at Google
© Abbott Analytics, Inc. 2001-201433
From http://www.teamleada.com
![Page 34: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/34.jpg)
Where are these Analytics Coming From?
© Abbott Analytics, Inc. 2001-201434
Degrees in 2011-2102 Humanities
Social and behavioral science
Natural sciences and mathematics
Computer sciences and engi-neering
Education
Business
Other fields
![Page 35: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/35.jpg)
But do these analysts need to know the math?
• Can software overcome the gulf between the mathematics and the use of the mathematics?
• Can the mathematics be a tool without knowing why it works?
© Abbott Analytics, Inc. 2001-201435
![Page 36: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/36.jpg)
But we use software! • In the 70s and 80s, analysis / statistics software was
commandline. • SAS, SPSS, S • Others: specified “control files” or “command line options”
and run the Unix or DOS executable
• In the 90s, GUIs emerged for pattern recognition and data mining • Most often, Windows, drop-down interfaces • Some workflow
• Late 2000s and currently, workflow interfaces have won the day for commercial and most open source tools
• Now: are we really back to commandline interfaces? • R, Python
© Abbott Analytics, Inc. 2001-201436
![Page 37: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/37.jpg)
Automation
• What gets automated -- development • Data preparation—80%+ of time spent here
• Building predictive models
• Assessing predictive models
• What gets automated – deployment • Data preparation – reproduce what one did
during model building
• Decisioning from model predictions
• A/B testing of model performance
© Abbott Analytics, Inc. 2001-201437
![Page 38: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/38.jpg)
Questions
• What is simplified by Spotfire? Which parts of the CRISP-DM process…
• For Predictive Analytics, what is the expectation placed on the modelers? • R, SAS, Matlab are all programming languages. S+ is
both language and GUI. Spotfire Miner?
• How does Spotfire integrate with back-end deployment of models (operational or visualization)?
© Abbott Analytics, Inc. 2001-201438
![Page 39: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/39.jpg)
Twitter Tag: #briefr
The Briefing Room
![Page 40: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/40.jpg)
Twitter Tag: #briefr
The Briefing Room
Upcoming Topics
www.insideanalysis.com
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
This Month: ANALYTICS & MACHINE LEARNING
July: INNOVATIVE TECHNOLOGY
August: BIG DATA ECOSYSTEM
![Page 41: Analytic Maturity: Bringing Predictive into the Mainstream](https://reader035.vdocuments.site/reader035/viewer/2022062710/559aef861a28ab97218b47a3/html5/thumbnails/41.jpg)
Twitter Tag: #briefr
The Briefing Room
THANK YOU for your
ATTENTION!