di in the age of digital disruptions v1.0
TRANSCRIPT
www.LnTInfotech.com
DI Modernization at the Age of Digital DisruptionsAmar RoyL&T Infotech Ltd.
2
About Myself
I help my customers in their digital journey by developing their big, small & fast data solution.
3
About L&T Infotech
L&T Infotech is a global IT services and solutions provider. We provide the winning edge to our clients by leveraging our Business-to-IT Connect and Deeply Committed People.
Our clients have found in us a right-size partner who combines scale, stability and customer-centricity.
4
Digital businesses - disrupting “business as usual”!
5
Data is the glue of all digital businesses!
And an efficient data integration platform is the logical starting point towards success
6
Today we will discuss…
What is a digital business? Needs and challenges of DI modernization Strategies an organization can adopt Capabilities to be acquired Platform & toolset and Operating model to make the transformation to work
7
What does it mean to be Digital?
8
Being Digital Means*…
And it demands innovation, speed & agility!
creating value at the new frontiers of the business world creating value in the processes that execute a vision of
customer experiences and building foundational capabilities that support the
entire structure.
*Source: What ‘digital’ really means | McKinsey & Company
9
This is new normal of customer service and satisfaction!
Uber runs its business on a platform which uses enables this level of customer service and more…
10 Image Source: http://www.datanami.com/2015/10/05/how-uber-uses-spark-and-hadoop-to-optimize-customer-experience/
It’s fundamentally a data problem! - Aaron Schildkrout, Head of Data @ Uber
11
However, this is not easy for every organizations!
12
Their present Data Integration landscape looks like this!
Where to start?
13
Clearly , it is not only about technology!
14
You will need to
choose the right modernization strategy, acquire the right capabilities and integrate with
existing ones, implement state of the art platform & toolset,adopt to an agile operating model which makes
everything work seamlessly
to get your DI ready for Digital Transformation…
15
What are the right strategy an organizations can adopt?
Depending upon your situation, you can choose either of these 2 strategies,
Big Bang Approach2-Speed Transformation
Most of our customer adopts the 2nd strategy
16
Identify the candidates which need to change at faster speed
Not all DI applications need to change at faster speed
17
Back office adopts slowly
18
Customer facing systems needs to change faster!
19
Big Data is only a piece in the DI puzzle…
Stream Computing will make real-time integration possible
Cloud Infrastructure will provide one-click provisioning and elasticity
API Based Integration will enable a data as Microservices
Logical Data Warehouse will contain Small/Big & Fast Data
20
API based integration provides seamless cross channel experience by enabling data as a microservice…
design of data services around business capabilities, automated deployment and decentralized control of language & data.
REST is the de facto standard
Image Source: https://blog.karmawifi.com/how-we-build-microservices-at-karma-71497a89bfb4#.ixbgljju0
21
Real time streaming for responsiveness…
Image Source: https://spark-summit.org/2014/wp-content/.../Lambda-Architecture-Jim-Scott..pdf
22
Logical DW extends existing infrastructure to cater new data and related workloads…
DataQuality
ILM
Data Governance
Data Integration
MDM
SourceSecurity
Web Services
APIs
SQL Queries
Search
CustomApplications
ERP
SCM
CRM
Image
Audio& Video
Machine Logs
Emails
Web &Social
Sensor Data
Documents Eg Pdf, Docs
Stru
ctur
edU
n-st
ruct
ured
Data Acquisition Layer Data Consumption Layer
Marketing Executives
Operational Managers
Data Scientists
Business Analysts
Engineers
CustomersPartners
Frontline Workers
DataLake Archived
Data
MasterData
StagingData
Non ProdData
Metadata Management
Data
Virt
ualiz
ation
AnalyticalData
Data Fill Platform
Data Mill Platform
Data Drill Platform
Data Warehousing Platform
Near Real Time Load
Batch Load
Advanced Analytics
Prescriptive Predictive Descriptive
Business Intelligence
BI Reports Ana Reports Dashboards Visualization
OLAPODS Data Marts
23
One-click provisioning & elasticity through a cloud infrastructure; allowing faster innovation
“…Cloud Computing is multi-tenant, it’s faster, half the cost, pay as you go, it grows as you grow or shrinks as you shrink. It is extremely efficient…”
- Marc Benioff, CEO SFDC [Oracle Open World 2010]
24
Plethora of tools to architect your agile & scalable data platform
Data Sources
Flow Controller
Stream Processor
Storage Analytics
Enterprise Applications
Mobile Devices IoT Sensors System logs Web Scrapping
Messaging Queue i.e. Kafka, Tibco EMS
Amazon Kinesys
Storm Spark
Streaming Informatica
CDC Flink Azure
Streaming
RDBMS NoSQL HDFS Cloud Storage
S3, HDInsight Cloud DB -
Redshift
Custom Application – D3
Tools – Tableau, Qlik
Elastic Search Many more
25
Because of the speed and agility digital initiatives will usher a cultural shift in the way organization builds and deliver software…
26
DevOps & Continuous Integration – Lean Execution Model for DI Transformation
Sta
rt
Continuous Integration
Server
Source code
Repository
Resolve Dependen
cies
Get Latest
job/package
Integration of
components
Static Analysis
Deploy in QA
Environment
Unit & Functional
Test
Regression Test
Result Validatio
n
Update MatchingDefects
Send Notificati
on
(Start)
(End)
Build Tool
(xml test cases)
(Coding Standard,
Sanity checks)
(xml test cases)
Java API
Trigger Mechanis
m
Code Check-in
Matrix Dashboa
rd(pearl, shell, js)Test
Management Server
SMTP Server
Bug Reportin
g ToolAutomated Test Script
Raise Defect
Feed
back
ETL jobs
BI Dashboar
ds
27
“Companies rarely die from moving too fast, and they frequently die from moving too slowly.”- Reed Hastings, CEO of Netflix
