Download - Using Open Source Bi In The Real World
![Page 1: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/1.jpg)
Open Source
Adoption and Use in the Real World
![Page 2: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/2.jpg)
0
20
40
60
80
1001
2
3
4
5
6
789
10
11
12
13
14
15
Margin of error: +/- 100 points
Smooth
Chunky
Summing up data warehousing & business intelligence:
Transaction processing is a commodity. Analysis is not.
![Page 3: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/3.jpg)
Cautionary Tale: Visions of Yesterday’s Future
![Page 4: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/4.jpg)
Cautionary Tale: Visions of Yesterday’s Future
![Page 5: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/5.jpg)
Cautionary Tale: Visions of Yesterday’s Future
![Page 6: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/6.jpg)
Cautionary Tale: Visions of Yesterday’s Future
![Page 7: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/7.jpg)
“Prediction is very difficult, especially about the future.”
Niels Bohr
![Page 8: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/8.jpg)
![Page 9: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/9.jpg)
“Open source is not worth paying attention to.”A Gartner analyst I don’t want to make too much fun of, January 2006
Where the analysts are on the adoption curve
![Page 10: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/10.jpg)
“The future is the present projected.”Aldous Huxley
![Page 11: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/11.jpg)
What is the state of the enterprise software market today?
![Page 12: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/12.jpg)
March 2009 Mark R. Madsen
Any Industry This Big is Maturing
Annual US software sales
-10
10
30
50
70
90
110
130
150
70 75 80 85 90 95 00Source: US Dept. of Commerce
![Page 13: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/13.jpg)
March 2009 Mark R. Madsen
Evolution of the Software Market 1987
Source: John Prendergast (data: Bloomberg, Factset)
![Page 14: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/14.jpg)
March 2009 Mark R. Madsen
Evolution of the Software Market 1997
Source: John Prendergast (data: Bloomberg, Factset)
![Page 15: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/15.jpg)
March 2009 Mark R. Madsen
Evolution of the Software Market 2007
Source: John Prendergast (data: Bloomberg, Factset)
![Page 16: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/16.jpg)
March 2009 Mark R. Madsen
The DW & BI Software Market Today According to IDC, the analytics and data warehouse software market is growing at 10.3% CAGR
17,38619,342
21,40823,601
26,00128,682
31,595
2005 2006 2007 2008 2009 2010 2011
![Page 17: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/17.jpg)
How to predict like an analyst.
![Page 18: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/18.jpg)
Moore’s Law via the Lens of the Industry Analyst
Time
CPU Speed
![Page 19: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/19.jpg)
Moore’s Law: Power Consumption
Time
Power Use
2019
![Page 20: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/20.jpg)
Moore’s Law: Heat Generation
Time
CPU Temp
2019
![Page 21: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/21.jpg)
Conclusion #1: Your own nuclear reactor by 2019
Time
Power Use
2019
![Page 22: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/22.jpg)
Conclusion #2: You will need a new desk in 2019
Time
CPU Temp
2019
![Page 23: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/23.jpg)
“If the automobile had followed the same development as the computer, a Rolls-Royce would today cost $100, get a million miles per gallon, and explode once a year killing everyone inside.”
Robert Cringely
Time
Anything
Reality
![Page 24: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/24.jpg)
March 2009 Mark R. Madsen
The Real State of Enterprise Software?
![Page 25: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/25.jpg)
March 2009 Mark R. Madsen
Software Revenue = Corporate IT Cost
IT costs as a percent of equipment investment
0
10
20
30
40
50
68 72 76 80 84 88 92 96 00 04Source: US Dept. of Commerce
![Page 26: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/26.jpg)
March 2009 Mark R. Madsen
Enterprise Software Economics
! 70% - 80% of sales & marketing is for new sales
! 76% of new license revenue goes to sales & marketing
! Maintenance makes up 45% of revenues and this number is increasing
! 75% of R&D for mature products is for updates, bug fixing, and non-revenue enhancements
! Maintenance and support is becoming the biggest factor is software company profitability.
Sources Godman-Sachs, Tech Strategy Partners, Forrester
The enterprise software model is breaking down. Some facts:
![Page 27: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/27.jpg)
March 2009 Mark R. Madsen
BI is Entering Mainstream Adoption
This means the BI market is entering a period of commodification: demand up, supply up, prices and margins down. Door open for OSS.
Platforms
DatabasesReporting & Analysis
Data Integration
Predictive analytics
![Page 28: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/28.jpg)
March 2009 Mark R. Madsen
Technology Priorities in IT
Informing the business trumps automating the business.This held true for three years in a row.
Source: CIO Insight
![Page 29: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/29.jpg)
March 2009 Mark R. Madsen
Spending Priorities in IT
In 2007 and 2008 IT budgeted most new project money for databases and business intelligence.
Sources: CIO Insight
![Page 30: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/30.jpg)
March 2009 Mark R. Madsen
Open Source Disruption
“Which sector of the industry is most vulnerable to disruption by open source in the next five years?”
1. Web publishing and content management2. Social software3. Business Intelligence
Source: North Bridge Venture Partners
![Page 31: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/31.jpg)
March 2009 Mark R. Madsen
Signs of Maturity
Source: Open Source Index 2008, Red Hat, Inc.
![Page 32: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/32.jpg)
March 2009 Mark R. Madsen
Use of OSS BI/OLAP tools worldwide
![Page 33: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/33.jpg)
March 2009 Mark R. Madsen
Open Source BI Use Looks Like Proprietary BI Use
![Page 34: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/34.jpg)
March 2009 Mark R. Madsen
Rationale When Evaluating OSS
![Page 35: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/35.jpg)
March 2009 Mark R. Madsen
Good News: It Works
![Page 36: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/36.jpg)
State of Adoption & Use of Open Source BI
33%
9%12%
18%21%
0%5%
10%15%20%25%30%35%40%45%50%
Database!/DW!platform
Reportingand!OLAP
Dataintegrationand!ETL
Embedded!/applicationreports
Advancedanalytics
None Considering Completed!Evaluation Using!in!Production
![Page 37: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/37.jpg)
45%
22%
7% 7%9%
7%3%
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
0"49 50"100 100"499 500"999 1"5!TB 5"25!TB >25!TB
81% of the sample < 1TB
Data size for all survey respondents including those using proprietary databases.
![Page 38: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/38.jpg)
![Page 39: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/39.jpg)
March 2009 Mark R. Madsen
Why did BI software evaluations fail?
25%
26%
27%
41%
56%
0% 10% 20% 30% 40% 50% 60%
Required!more!expertise!than!expected
Difficulty!integrating!into!environment
Lack!of!available!consulting
Scalability!problems
Missing!or!incomplete!features
![Page 40: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/40.jpg)
There’s still work to be done
![Page 41: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/41.jpg)
Data is the future
![Page 42: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/42.jpg)
March 2009 Mark R. Madsen
Questions?“When a new technology rolls over you, you're either part of the steamroller or part of the road.” – Stewart Brand
![Page 43: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/43.jpg)
March 2009 Mark R. Madsen
We Could Use Your HelpIf you evaluated open source software for any aspect of the BI or data warehouse environment, please fill out the online open source adoption survey athttp://bitly.com/scRhF
The survey is running until May 30, 2009.
![Page 44: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/44.jpg)
March 2009 Mark R. Madsen
Creative CommonsThanks to the people who made their images available via creative commons:highway storm.jpg - http://flickr.com/photos/areyoumyrik/235230688firemen not noticing fire.jpg - http://flickr.com/photos/oldonliner/1485881035/godzilla_vs_bhudda_big.jpg - http://flickr.com/photos/olivander/262293544/acapluco_cliff_divers_cc.jpg - http://flickr.com/photos/raveller/
![Page 45: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/45.jpg)
March 2009 Mark R. Madsen
Creative CommonsThis work is licensed under the Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 United States License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-nd/3.0/us/ or send a letter to Creative Commons, 543 Howard Street, 5th Floor, San Francisco, California, 94105, USA.
![Page 46: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/46.jpg)
‘
MySQL Conference & ExpoBruce Belvin
![Page 47: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/47.jpg)
Company Mission
Monolith Software Solutions is dedicated to providing scalable business intelligence for multi-unit QSR restaurant operations.
![Page 48: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/48.jpg)
Open Source Components
SUSE Linux Enterprise
![Page 49: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/49.jpg)
Overview
! 3000+ disparate data sources! 4500 users! Complex organizational structures / hierarchy! Multi tenant environment! Segregated data bases per individual organization! Same data used for various business functions! Granular data
![Page 50: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/50.jpg)
Vertical Landscape
I. Fragmented ownershipII. Legacy hardware/various data sourcesIII. Hesitancy to adopt Open SourceIV. Small margin industry
![Page 51: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/51.jpg)
Why SaaS Works
• Subscription business model fits segment price pressures
• Unlimited users solves user heavy structure• Initial price / on going maintenance• Low barrier to entry• Pay as you go for additional integration/modules
![Page 52: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/52.jpg)
Keys to SaaS Success
• Educate multiple decision making groups within organization
• Utilize support from technology partners and open source community
• Be aware of impact on IT/political past decisions
• Prove open source solution
• Develop silver bullet strategies to over come open source perceptions
![Page 53: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/53.jpg)
![Page 54: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/54.jpg)
Background
" President / COO of Consorte Media
" Formerly CTO of BlueLithium, Adteractive, Fathom Online, and Cybernautics
" 13 years as a technical executive in the online advertising industry
54
![Page 55: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/55.jpg)
Scope of Online Advertising
55
Delivers the right ad to the right
person
Collect Metrics for performance
measurement and analytics
Dynamically builds pages for
visitor using predictive models
![Page 56: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/56.jpg)
Business Challenges
56
Performance Reports
Internal Applications
Revised Models
Web API
Analytics
Data Mining
Model Development
![Page 57: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/57.jpg)
Our Stack
" CentOS
" MySQL
" BIRT
" Hibernate
" Apache
" Camel
" Kettle
" Hadoop
![Page 58: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/58.jpg)
Best Practices
58
• Use analytics to design and test advertising models using only
relevant dimensions
• Gather and determine business requirements before embarking
on the journey
• Build an infrastructure plan that will support the data collection
and analytics platform
![Page 59: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/59.jpg)
The Role of Open Source
59
• Several important innovations in data processing have been driven largely by
online advertising
• Industry needs software and tools to match pace of innovation and fast-
changing business climate
• Proprietary software vendors unable to respond quickly enough to support the
industry
• Open Source has provided innovative solutions and flexibility to support new
business requirements
![Page 61: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/61.jpg)
Q&A: Bruce Belvin, Jay Webster, Mark Madsen
![Page 62: Using Open Source Bi In The Real World](https://reader034.vdocuments.site/reader034/viewer/2022042813/5462d9dab1af9f86228b52b1/html5/thumbnails/62.jpg)
March 2009 Mark R. Madsen
We Could Use Your HelpIf you evaluated open source software for any aspect of the BI or data warehouse environment, please fill out the online open source adoption survey athttp://bitly.com/scRhF
The survey is running until May 30, 2009.