transforming it with an open source strategy
TRANSCRIPT
1 ©HortonworksInc.2011– 2016.AllRightsReserved
TransformingITwithanOpenSourceStrategyKennethSmithGeneralManager– Oil&Gas
2 ©HortonworksInc.2011– 2016.AllRightsReserved
AboutHortonworksCustomerMomentumà ~800customers(asofJanuary2016)à ~400customersaddedin2015à PubliclytradedonNASDAQ:HDP
TheLeaderinConnectedDataPlatformsà HortonworksDataFlowfordatainmotionà HortonworksDataPlatformfordataatrestà Poweringnewmoderndataapplications
PartnerforCustomerSuccessà Leaderinopen-sourcecommunity,focused
on innovationtomeetenterpriseneedsà Unrivaledsupportsubscriptions
Foundedin2011
Original24Architects,Developers,OperatorsofHadoopfromYahoo!
800+EMPLOYE E S
1500+ECOS YS T EMPAR TN E R S
4 ©HortonworksInc.2011– 2016.AllRightsReserved
EMBRACEANOPENAPPROACH
MASTERTHEVALUEOFDATA
EVERYBUSINESSISADATABUSINESS
6 ©HortonworksInc.2011– 2016.AllRightsReserved
4ZBDATAINTERNET
OFANYTHING
44ZBDATA
TOMORROW
6 © HortonworksInc.2011– 2016.AllRightsReserved
7 ©HortonworksInc.2011– 2016.AllRightsReserved
DATA–MoreVolumeandMoreTypes
I N C R EAS I N G D ATA VAR I E T Y AND C OMP L EX I T Y
USERGENERATEDCONTENT
MOBILEWEB
SMS/MMS
SENTIMENT
EXTERNALDEMOGRAPHICS
HDVIDEO
SPEECHTOTEXT
PRODUCT/SERVICELOGS
SOCIALNETWORK
BUSINESSDATAFEEDS
USERCLICKSTREAM
WEBLOGS
OFFERHISTORY DYNAMICPRICING
A/BTESTING
AFFILIATENETWORKS
SEARCHMARKETING
BEHAVIORALTARGETING
DYNAMICFUNNELSPAYMENTRECORD
SUPPORTCONTACTS
CUSTOMERTOUCHESPURCHASEDETAIL
PURCHASERECORD
SEGMENTATIONOFFERDETAILS
P E TAB YT E S
T ER AB YT E S
G I G AB YT E S
EX AB YT E S
ERP
BIG DATA
WEB
CRM
IOT
8 ©HortonworksInc.2011– 2016.AllRightsReserved
InvestmentinBigDataAnalytics
Source: Cloudtech - “HowEnterprises See BigData AnalyticsChangingthe Competitive Landscape NextYear”, December 2014
9 ©HortonworksInc.2011– 2016.AllRightsReserved
ImportanceofBigDataAnalyticsvs.OtherPriorities
Source: Cloudtech: “How Enterprises See Big Data Analytics Changing the Competitive Landscape Next Year”, December 2014
10 ©HortonworksInc.2011– 2016.AllRightsReserved
TraditionalWorldofApplicationsandDataSilos
Constrainsdatatospecificapps
NoinsightacrossALLdata
Builtforstructureddata
Doesnotscale(costandtech)
ERP CRM SCM EXT
11 ©HortonworksInc.2011– 2016.AllRightsReserved
NewDataParadigmOpensUpNewOpportunity
2.8zettabytesin2012
44zettabytesin2020
N EW
1 zettabyte (ZB) = 1 million petabytes (PB); Sources: IDC, IDG Enterprise, and AMR Research
Clickstream
ERP,CRM, SCM
Web&social
Geolocation
InternetofThings
Server logs
Files,emails
Transformeveryindustryviafullfidelityofdataandanalytics
Opportunity
TR AD I T I O N A L
LAGGARDS
LEADERS
AbilitytoConsumeData
EnterpriseBlindSpot
12 ©HortonworksInc.2011– 2016.AllRightsReserved
OpenHadoopArchitectureUnlocksOpportunitypportunit
Consolidatesalldatasets
Deliversreal-timeinsights
Integrateswithdatacenter
Scalableandaffordable
Communityinnovation
T U R N A L L O F Y OU R DATA I N T O VA LU E
| HadoopandtheHadoopelephantlogoaretrademarksoftheApacheSoftwareFoundation
”Hadooponomics”willmakeApache’sopen-sourcebigdataplatforma“musthaveforlarge
enterprises.”
Source: Forrester – “Predictions2015:HadoopwillBecomeaCornerstoneofYour BusinessTechnology Agenda
14 ©HortonworksInc.2011– 2016.AllRightsReserved
BlindSpotsBlockYourAbilitytoUseAlltheData
GROUP 3
GROUP 2 GROUP 4
GROUP 1INTERNET
OFANYTHING
Fragmenteddata-at-restincreasesthecostofinsight
Data-in-motionstreamsthroughyourblindspots
15 ©HortonworksInc.2011– 2016.AllRightsReserved
DATAATRESTDATAINMOTION
ACTIONABLEINTELLIGENCE
Modern DataApplications
PERISHABLEINSIGHTS
HISTORICALINSIGHTS
INTERNETOF
ANYTHING
HortonworksDataFlow
HortonworksDataPlatform
HortonworksDeliversConnected DataPlatforms
16 ©HortonworksInc.2011– 2016.AllRightsReserved
ModernDataAppsCustomorOfftheShelf
Real-TimeCyberSecurityprotectssystemswithsuperiorthreatdetectionSmartManufacturingdramaticallyimprovesyieldsbymanagingmorevariablesingreaterdetailConnected,AutonomousCarsdrivethemselvesandimproveroadsafetyFutureFarmingoptimizingsoil,seedsandequipmenttomeasuredconditionsoneachsquarefootAutomaticRecommendationEnginesmatchproductstopreferencesinmilliseconds
DATAATREST
DATAINMOTION
ACTIONABLEINTELLIGENCE
ModernDataApplications
HortonworksDataFlow
HortonworksDataPlatform
17 ©HortonworksInc.2011– 2016.AllRightsReserved
Hortonworks® customersleverageourConnected DataPlatformstotransformtheirindustries– renovatingtheir ITarchitecturesandinnovatingwiththeirDatainMotionorDataatResttopoweractionable intelligencethroughModern DataApplications.
SocialMapping
PaymentTracking
FactoryYields
DefectDetection
CallAnalysis MachineData
ProductDesign M&A
DueDiligence
NextProductRecs
CyberSecurity
RiskModeling
AdPlacement
ProactiveRepair
DisasterMitigation
InvestmentPlanning
InventoryPredictions
CustomerSupport
SentimentAnalysis
SupplyChain
AdPlacement
BasketAnalysis Segments
Cross-Sell
CustomerRetention
VendorScorecards
OptimizeInventories
OPEXReduction
MainframeOffloads
HistoricalRecords
DataasaService
PublicDataCapture
FraudPrevention
DeviceDataIngest
RapidReporting
DigitalProtection
17 © HortonworksInc.2011– 2016.AllRightsReserved
19 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyMercy’sJourney
MercyMedicalSystemSoughtaDataLakeforaSingleViewofits Patients–“OnePatient,OneRecord”
à ExistingplatformimpededgoalofenrichingEpicdatafor1millionpatientsover35Hospitalsand500clinics
à MovingEMRdatatoEDWtook24hoursandwas“nevergoingtoenablereal-timeanalytics”.Nowthattakes3-5minuteswithHDP.
à Improvedbillingprocessesresultedin$1Madditionalannualrevenuefromnewlydocumentedsecondarydiagnosesandcare
20 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyMercy’sJourney
Better HealthBilling VitalSign
Monitoring
SinglePatientRecord
LabNotesArchive
PrivacyDatabase
MedicalDecisionSupport
DeviceDataIngest
PreventiveCare
EpicEnrichment
OPEXEfficiency
EpicEMRReplication
Innovate
Renovate
BetterHealthThroughData
à Searchesoffree-textlabnotes,speedresearcherinsightfrom“never”to“seconds”
à IngestofICUvitalsignsincreasedby900X,lettingcliniciansrespondmorequickly
à Mercyisbuildingreal-timetoolstosupportsurgicaldecisionsandpreventivecare
22 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyProgressive’sJourney
ProgressiveWantedtoIngestIoTDatatoPredictRiskforitsUsage-basedInsuranceProduct
à ProgressiveSnapshotoffersusage-basedinsurancethroughanin-carsensorthattransmitsIoTdrivingdata
à Sensorscollectuptosixmonthsofdatafromdriversandthedataisarchivedforyears,perregulatoryrequirements
à Progressive’sexistingsystemswerenotscalingefficientlyà Ittook5–7daystotransformonly25%ofavailableUBIdata
23 ©HortonworksInc.2011– 2016.AllRightsReserved
Progressive’sJourney
RewardingSaferDriversandImprovingTrafficSafety
à Snapshotplug-indevicescapturedrivingdetail
à Progressivestoresmorethan10billionmilesdriven
à Throughawebapp,customerscanreviewtheirowndrivingdetailandimprovetheirsafety
à Snapshotandusage-basedinsurancedrove$2.6billionin2014Progressivepremiums
Innovate
Renovate
SafeRoads
ClaimsNotesMining
IndividualDrivingHistories
Usage-BasedInsurance(UBI)
WebLogAnalysis
OnlineAdPlacement
SensorDataIngest
25 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyWesternDigital’sJourney
à WesternDigitalmanufactureshalfoftheworldsharddrives,200Mannuallyà Despiteastate-of-the-artmanufacturingprocess,over10Kdeviceswerereturned
monthlyduetopoorqualityinadditiontodefectivedrivesthatwerescrappedattheendoftheline
à Defectanalysiswasdonebyphysicalinspectionsbecauseonlyasubsetofsensordatafrommanufacturingtestingwasretainedinlegacysystemsfor3-12months
à Accesstothatdatawaslimitedtoarelativelysmallnumberofemployees
WesternDigitalWantedtoOptimizeManufacturingandImproveProductQualityandYields
26 ©HortonworksInc.2011– 2016.AllRightsReserved
Renovate
IncreasedProfitability
SensorTestData
SuperiorProductQualityandHigherYields
à RepositoryofsensordatainHDPnowcapturesmoretestdata,doublingretentionto2years
à CriticalParameterDashboardcanbecreated10xmorequicklythanbeforeHDP,speedingtimetoinsighttoidentifyqualityissues
à Dashboardsharesdatawith1,000+employees,returningsearchresultsinlessthanonesecond
WesternDigital’sJourney
EDW Offload
Quality Analysis
Product Monitoring
ProcessMonitoring
DATA DISCOVERY
Innovate
28 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyLargeHomeImprovementChain’sJourney
à No“GoldenRecord”foranalyticsoncustomerbuyingbehavioracrossallchannelsà Datarepositoriesonwebsitetraffic,POStransactions,andin-homeservicesexistedin
fragmentedsilosà Limitedabilityfortargetedmarketingtospecificsegmentsà Datastoragecostsintheirdatawarehousecontinuedtoincrease
LargeHomeImprovementChainSoughttoBuild360°ViewofLifetimeCustomerValue
29 ©HortonworksInc.2011– 2016.AllRightsReserved
HDPDeliversTargetedMarketingandDataStorageSavings
à GoldenRecordenablestargeted,customizedmarketing
à Datawarehouseoffloadsavedmillionsinrecurringexpenses
à Customerteamcontinuestofindunexpected,unplannedusefortheir360° viewofcustomerbuyingbehavior
à Newusecase:priceoptimizationvs.competition=severalmillionintop-linerevenuegrowth
LargeHomeImprovementChain’sJourney
Personalized 1:1 Marketing
Price Optimization
Cost of Goods Sold
Customer GoldenRecord
EDW Offload
Innovate
RenovateStock-out
Prevention
Clickstream Analysis
31 ©HortonworksInc.2011– 2016.AllRightsReserved
CaseStudyMultinationalBankingandFinancialServicesCompany’sJourney
à Regulatorypressuresrequiringdatagovernanceandlineageà Startupsblurringboundariesbetweenbanksandtechcompaniesà Fraudmonitoringanddetectionà 360-degreecustomerviewacrossvariousbankproductsà Riskdataaggregationandprediction
RegulatoryandMarketPressureDroveNeedforDataDiscovery,SingleViewandPredictiveAnalytics
32 ©HortonworksInc.2011– 2016.AllRightsReserved
MarketRiskAnalysiswithMachineLearning
MultinationalBankingandFinancialServicesCompany’sJourney
Innovate
à InitialengagementwithITteamthatdeliverssolutionstoOps,Risk,&Financegroups
à “MarketRiskProjectionEngine”models1600marketshockconditionsover800Kpositions
à Machinelearningspedpredictionsfrom20hoursto30seconds
à Anti-moneylaunderingandriskmanagementuse-casescurrentlyin-progress
Renovate
Predicting the Future of Markets
Teradata Offload
Grid Compute Analytics
Market RiskPredictions
AML Investigation
Credit Card Fraud
File Archive
Customer Portfolio Analysis
33 ©HortonworksInc.2011– 2016.AllRightsReserved
UseCasesinOilandGas&Energy
à SingleViewofanAssettoReduceUnplannedEquipmentDowntimeà PredictiveMaintenanceà Real-timeDrillingtoIncreaseOperationEfficienciesà PumpTruckFleetOperationOptimizationtoReduceFuelCostsà WellLogData(LAS)PredictiveAnalyticsà Web&SocialMediaAnalyticstoforThreatAssessment&NewMarketAnalysisà ESPProductionOptimizationà PlantFailurePredictiveAnalyticsà DownstreamMarketingandRetailAnalyticsà SmartMeterAnalyticsforDemand/LoadForecasting,OutagePrevention,Theft
Protection,PredictiveMaintenance,CustomerRetention
34 ©HortonworksInc.2011– 2016.AllRightsReserved
EnterpriseHaveTurnedtoOpenSource
Source: BlackDuck Software – “2015FutureofOpenSourceSurvey” April2015,April2015
35 ©HortonworksInc.2011– 2016.AllRightsReserved
ButWheretoBegin?
1.ConductaUseCaseWorkshop toplantheroadmap
2.PickanEasyWinforthefirstusecase
3.RememberthatRenovationpaysforInnovation
#futureofdata