agile enterprise analytics - duke university · agile analytics needs analytics as a service...
TRANSCRIPT
![Page 1: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/1.jpg)
Agile Enterprise Analytics
OLIVER RATZESBERGER
Sr. Director Architecture & Operations Sr. Director Architecture & Operations
eBay Inc.
February 2010
![Page 2: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/2.jpg)
eBay Inc Overview
Pierre Omidyar founded eBay on a simple idea: People are basically good. This fundamental belief created a completely new kind of marketplace, forever transforming e-commerce. Today our values continue to guide how we do business and connect buyers and sellers around the world.
eBay Inc. confidential2
![Page 3: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/3.jpg)
eBay Inc Overview
With more than 88 million active users globally, eBay is the world's largest online marketplace, where practically anyone can buy and sell practically anything. With a diverse and passionate community of individuals and small businesses, eBay offers an online platform where millions of items are traded each day.
eBay Inc. confidential3
With more than 75 million active registered accounts worldwide, PayPal is the faster, safer way to pay and get paid online. Available in 190 markets and 19 currencies around the world, PayPal enables global e-commerce by making payments possible across different locations, currencies, and languages.
![Page 4: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/4.jpg)
eBay Inc Overview
Newsweek Ranks eBay Inc. One of the Greenest Companies in America - Newsweek magazine ranks eBay Inc. as one of the top green companies in America – coming in at No. 76 on the list of the 500 largest corporations in the United States.
eBay Inc.: The Most Trusted Company for Privacy - eBay tops the list of the "Most Trusted Companies for Privacy" in the 2009
eBay Inc. confidential4
the list of the "Most Trusted Companies for Privacy" in the 2009 consumer study commissioned by TRUSTe and PonemonInstitute, a privacy and information security research company. In 2008, eBay Inc. ranked in the top five.
eBay Inc. Recognized by the President of the United States -eBay Inc. was awarded the 2007 National Medal of Technology and Innovation, becoming the first Internet company to receive the prestigious award. The medal is presented annually to companies and individuals by the President of the United States during a ceremony at The White House.
![Page 5: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/5.jpg)
Every Second – in over 50,000 Categories
eBay Inc. confidential
Every Second – in over 50,000 Categories
![Page 6: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/6.jpg)
eBay Analytics Technology Highlights
>50 TB/day of new, incremental data
>50 PB/day>150^10 new records/day
>5000>50k chains of logic
>100k data elements
eBay Inc. confidential6
>50 PB/day
Millions of queries/day
>5000business users & analysts
24x7x36599.98+% Availability
turning over a TB every5 secondsActive/Active
Near-Real-time
Always online
Processed
![Page 7: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/7.jpg)
eBay Analytics Core
Relational Data
Teradata Teradata
Primary Secondary
2.2PB2.5PBMPP
MPP Relational Data
MicroStrategy Unica SOA/DAL
Data Access
Hadoop SAS SQL MAXCrystal
eBay Inc. confidential7
Deep Data, Semi Structured
Teradata Teradata
8PB 8PB
Phoenix, AZ Sacramento, CA
2.2PB2.5PB
MPP/HPC/GridLinux
Local Interconnect
Wide AreaInterconnect1000 miles
Ab Initio Informatica UC4 SOA
Data Integration
Local Interconnect
Golden Gate BES MAX
‘Singularity’
Linux
![Page 8: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/8.jpg)
Analytics CustomersTrading Search Fraud Site Analytics Finance Technology BUs
Self Service & Visualization
eBay Inc. confidential
Data Platform (EDW/High Density)
Analytics as a Service (AaaS) 2.0
8
Self Service & Visualization
![Page 9: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/9.jpg)
Design for the Unknown
>85% of eBay analytical workload is NEW & Unknown
Exploration is the core of an analytical company
The metrics you know are ‘cheap’
eBay Inc. confidential99
The metrics you know are ‘cheap’
The metrics you don’t know are expensive but also high in potential ROI
Design can’t be static or dependent on specific questions or dimensions
![Page 10: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/10.jpg)
Analytics DNA
Embedded in our daily life
Bottoms-up & Tops-down
eBay Inc. confidential10
Think and Live Analytics
AlwaysBut know when do avoid Analysis Paralysis!
![Page 11: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/11.jpg)
Types of Analytics at eBay
Basically measure anything possible - A few examples:
MarketingMarketing Buyer Experience
Buyer Experience
FinanceFinanceTrust & SafetyTrust & Safety
eBay Inc. confidential11
Technology OperationsTechnology Operations
Customer ServiceCustomer Service
LoyaltyLoyaltyInformation Security
Information Security
InfrastructureInfrastructure FindingFindingUser
BehaviorUser
BehaviorSeller
ExperienceSeller
Experience
![Page 12: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/12.jpg)
Key Performance Indicators
Align individual and departmentalperformance objectives
eBay Inc. confidential12
performance objectives
with corporategoals
![Page 13: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/13.jpg)
KPI Example: Technology Operations
Parallel Efficiency – (simplified) The effectiveness of distributing large amounts of workload over pools and grids of servers.
100% is GOOD Less than 70% is BAD
eBay Inc. confidential13
10,000 Server running at an average PE of 50%
Established through Analytics of Operations Data – Minute by minute utilization metrics of entire infrastructure
Raising PE from 50% to 80% equals Millions in OpEx savings
![Page 14: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/14.jpg)
KPI Example: Technology Operations (cont)
eBay Inc. confidential14
• Individual process rollup• Grid level Parallel Efficiency at 99.9%
![Page 15: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/15.jpg)
Proliferation of Analytics
Decentralized Analytics
Shortened Time to Market Requirements
Adhoc ExplorationDepartmental Data
eBay Inc. confidential1515
Prototyping - Can’t wait for EDW
”We Need Data Marts!”
![Page 16: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/16.jpg)
Data Marts in the Enterprise
Customer SupportCustomer Support
ProcurementProcurement
FinanceFinanceSearchSearch
Capacity PlanningCapacity Planning
FacilitiesFacilities
CustomerCustomer CustomerCustomer
CustomerCustomer
ProductProduct ProductProduct
ProductProduct
ProductProduct
EquipmentEquipment
EquipmentEquipment
EquipmentEquipment
eBay Inc. confidential
ITIT
SupplyChainSupplyChain
LegalLegal
Strateg
yStrateg
y
ShippingShipping
FraudFraud
CorporateCorporate
MarketingMarketing
HRHR
OperationsOperations
CustomerCustomer
CustomerCustomer
CustomerCustomer
CustomerCustomer
CustomerCustomer
CustomerCustomer
CustomerCustomer
ProductProduct
ProductProduct
ProductProduct
ProductProduct ProductProduct
ProductProduct
CustomerCustomer
EquipmentEquipment
EquipmentEquipment
EquipmentEquipment
EquipmentEquipment
![Page 17: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/17.jpg)
Storage Utilization
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
IT
SupplyChain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 18: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/18.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 19: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/19.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 20: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/20.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 21: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/21.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 22: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/22.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 23: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/23.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 24: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/24.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 25: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/25.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 26: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/26.jpg)
Processing Capacity
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 27: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/27.jpg)
Data Mart Implications
• Locked in• Fragmented• Redundant• Slow Time to Market
eBay Inc. confidential
10-20x (and more) Storage Waste
10-20% Overall Resource Utilization
FTEs to operate: 40+
![Page 28: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/28.jpg)
Data Mart Dilemma
Total Cost of Ownership (TCO)Fully loaded cost staggering $500k-M++
Biggest drivers areMaintaining separate databases
weekly/daily/hourly data transfers
inconsistencies
eBay Inc. confidential28
Data inconsistenciesData redundancy
Increased complexityLoss of lineage over time
A Data Mart cannot be ‘cheap’ enough to justify its existence
![Page 29: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/29.jpg)
Agile Analytics needs Analytics as a Service
Massive scale Analytical Utility Computing
Bring your data - Perform your Analytics
eBay Inc. confidential29
From Simple Web based data upload
...to fully private Utility access
Combine custom data and code with ALL existing data
![Page 30: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/30.jpg)
Virtual Data Marts in the Enterprise
Customer SupportCustomer Support
ProcurementProcurement
FinanceFinanceSearchSearch
Capacity PlanningCapacity Planning
FacilitiesFacilities
eBay Inc. confidential
ITIT
SupplyChainSupplyChain
LegalLegal
Strateg
yStrateg
y
ShippingShipping
FraudFraud
CorporateCorporate
MarketingMarketing
HRHR
OperationsOperations
![Page 31: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/31.jpg)
Virtual Data Marts
CustomerSupport
Procurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 32: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/32.jpg)
Virtual Data Marts
Strateg
y
CustomerSupport
Search
Capacity Planning
Facilities
Finance
Procurement
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
FraudFraud
Corporate
HR
Operations
Marketing
![Page 33: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/33.jpg)
Virtual Data Marts
CustomerSupport
FinanceFinanceSearch
Capacity Planning
FacilitiesProcurement
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Corporate
MarketingMarketing
HR
Operations
Fraud
![Page 34: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/34.jpg)
Virtual Data Marts
CustomerSupport
Procurement
Finance
Capacity Planning
Facilities
Search
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
Marketing
HR
Operations
![Page 35: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/35.jpg)
Virtual Data Marts
CustomerSupport
SearchSearch
Capacity Planning
FacilitiesProcurement
Finance
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Marketing
HR
Operations
SearchSearch
Corporate
![Page 36: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/36.jpg)
Virtual Data Marts
CustomerSupport
Procurement
FinanceSearchSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
HR
Operations
Marketing
![Page 37: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/37.jpg)
Virtual Data Marts
CustomerSupport
ProcurementProcurement
FinanceSearch
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
ShippingShipping
Fraud
Corporate
Marketing
HR
Operations
![Page 38: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/38.jpg)
Virtual Data Marts
CustomerSupport
Procurement
FinanceOperationsOperations
Search
Capacity Planning
Facilities
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
Fraud
Corporate
OperationsOperations
Marketing
![Page 39: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/39.jpg)
Virtual Data Marts
CustomerSupport
ProcurementCapacity Planning
Facilities
Search
eBay Inc. confidential
ITSupply Chain
Legal
Strateg
y
Shipping
MarketingMarketing
HR
Operations
Fraud
![Page 40: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/40.jpg)
Virtual Data Marts in the Enterprise
Single MPP Infrastructure
eBay Inc. confidential
Single MPP InfrastructureOne Physical Grid
![Page 41: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/41.jpg)
Virtualized Analytics
Extremely Flexible and NimbleCan adjust to workload changes in seconds
Share a SINGLE copy of data
eBay Inc. confidential
1/10th of the storage for the Enterprise
5-10 x Capacity per $ invested
FTEs to operate: 2-4 Unbeatable
TCO
![Page 42: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/42.jpg)
Virtual Data Marts
Various Types:Prototype/SandboxProduction Data MartDevelopmentQATesting and Experimentation
eBay Inc. confidential
Testing and Experimentation…
Logical Definitions NOT physical instances
![Page 43: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/43.jpg)
Analytics as a Service 2.0
Virtual Data Mart Self ProvisioningYour personal Data Mart in 5 min
Templatized Data MartsPick from a variety of predefined templates
eBay Inc. confidential
Pick from a variety of predefined templates
Click StreamFinancialSite Analytics…
![Page 44: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/44.jpg)
Self Service Example
eBay Inc. confidential
![Page 45: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/45.jpg)
Key to success for AaaS
Unlimited ScalabilityData VolumeConcurrent Users# Applications# QueriesComplexity
Large Scale MPP
eBay Inc. confidential
Complexity
Sophisticated Workload ManagementResource PartitionsWorkload Queuing
Application Level Virtualization Support
![Page 46: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/46.jpg)
IO
ConcurrencyCPU
A B C
Technology Stack Decision is Multi Dimensional
eBay Inc. confidential
Storage
Governance
Flexibility
![Page 47: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/47.jpg)
Analytics as a Service - Benefits
Improved Time To Market -Days/Weeks vs Months
Enable the business to do agile prototyping
eBay Inc. confidential47
Enable the users to “Fail Fast” - Make it easy
to try out new ideas
Eliminate stray Data Marts
![Page 48: Agile Enterprise Analytics - Duke University · Agile Analytics needs Analytics as a Service Massive scale AnalyticalUtility Computing Bring your data -Perform your Analytics 29 eBay](https://reader033.vdocuments.site/reader033/viewer/2022051812/6026fc2caf39277da66c3377/html5/thumbnails/48.jpg)
Questions
?eBay Inc. confidential4848
?