di in the age of digital disruptions v1.0

Post on 19-Feb-2017

113 Views

Category:

Data & Analytics

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

www.LnTInfotech.com

DI Modernization at the Age of Digital DisruptionsAmar RoyL&T Infotech Ltd.

2

About Myself

I help my customers in their digital journey by developing their big, small & fast data solution.

3

About L&T Infotech

L&T Infotech is a global IT services and solutions provider. We provide the winning edge to our clients by leveraging our Business-to-IT Connect and Deeply Committed People.

Our clients have found in us a right-size partner who combines scale, stability and customer-centricity.

4

Digital businesses - disrupting “business as usual”!

5

Data is the glue of all digital businesses!

And an efficient data integration platform is the logical starting point towards success

6

Today we will discuss…

What is a digital business? Needs and challenges of DI modernization Strategies an organization can adopt Capabilities to be acquired Platform & toolset and Operating model to make the transformation to work

7

What does it mean to be Digital?

8

Being Digital Means*…

And it demands innovation, speed & agility!

creating value at the new frontiers of the business world creating value in the processes that execute a vision of

customer experiences and building foundational capabilities that support the

entire structure.

*Source: What ‘digital’ really means | McKinsey & Company

9

This is new normal of customer service and satisfaction!

Uber runs its business on a platform which uses enables this level of customer service and more…

10 Image Source: http://www.datanami.com/2015/10/05/how-uber-uses-spark-and-hadoop-to-optimize-customer-experience/

It’s fundamentally a data problem! - Aaron Schildkrout, Head of Data @ Uber

11

However, this is not easy for every organizations!

12

Their present Data Integration landscape looks like this!

Where to start?

13

Clearly , it is not only about technology!

14

You will need to

choose the right modernization strategy, acquire the right capabilities and integrate with

existing ones, implement state of the art platform & toolset,adopt to an agile operating model which makes

everything work seamlessly

to get your DI ready for Digital Transformation…

15

What are the right strategy an organizations can adopt?

Depending upon your situation, you can choose either of these 2 strategies,

Big Bang Approach2-Speed Transformation

Most of our customer adopts the 2nd strategy

16

Identify the candidates which need to change at faster speed

Not all DI applications need to change at faster speed

17

Back office adopts slowly

18

Customer facing systems needs to change faster!

19

Big Data is only a piece in the DI puzzle…

Stream Computing will make real-time integration possible

Cloud Infrastructure will provide one-click provisioning and elasticity

API Based Integration will enable a data as Microservices

Logical Data Warehouse will contain Small/Big & Fast Data

20

API based integration provides seamless cross channel experience by enabling data as a microservice…

design of data services around business capabilities, automated deployment and decentralized control of language & data.

REST is the de facto standard

Image Source: https://blog.karmawifi.com/how-we-build-microservices-at-karma-71497a89bfb4#.ixbgljju0

21

Real time streaming for responsiveness…

Image Source: https://spark-summit.org/2014/wp-content/.../Lambda-Architecture-Jim-Scott..pdf

22

Logical DW extends existing infrastructure to cater new data and related workloads…

DataQuality

ILM

Data Governance

Data Integration

MDM

SourceSecurity

Web Services

APIs

SQL Queries

Search

CustomApplications

ERP

SCM

CRM

Image

Audio& Video

Machine Logs

Emails

Web &Social

Sensor Data

Documents Eg Pdf, Docs

Stru

ctur

edU

n-st

ruct

ured

Data Acquisition Layer Data Consumption Layer

Marketing Executives

Operational Managers

Data Scientists

Business Analysts

Engineers

CustomersPartners

Frontline Workers

DataLake Archived

Data

MasterData

StagingData

Non ProdData

Metadata Management

Data

Virt

ualiz

ation

AnalyticalData

Data Fill Platform

Data Mill Platform

Data Drill Platform

Data Warehousing Platform

Near Real Time Load

Batch Load

Advanced Analytics

Prescriptive Predictive Descriptive

Business Intelligence

BI Reports Ana Reports Dashboards Visualization

OLAPODS Data Marts

23

One-click provisioning & elasticity through a cloud infrastructure; allowing faster innovation

“…Cloud Computing is multi-tenant, it’s faster, half the cost, pay as you go, it grows as you grow or shrinks as you shrink. It is extremely efficient…”

- Marc Benioff, CEO SFDC [Oracle Open World 2010]

24

Plethora of tools to architect your agile & scalable data platform

Data Sources

Flow Controller

Stream Processor

Storage Analytics

Enterprise Applications

Mobile Devices IoT Sensors System logs Web Scrapping

Messaging Queue i.e. Kafka, Tibco EMS

Amazon Kinesys

Storm Spark

Streaming Informatica

CDC Flink Azure

Streaming

RDBMS NoSQL HDFS Cloud Storage

S3, HDInsight Cloud DB -

Redshift

Custom Application – D3

Tools – Tableau, Qlik

Elastic Search Many more

25

Because of the speed and agility digital initiatives will usher a cultural shift in the way organization builds and deliver software…

26

DevOps & Continuous Integration – Lean Execution Model for DI Transformation

Sta

rt

Continuous Integration

Server

Source code

Repository

Resolve Dependen

cies

Get Latest

job/package

Integration of

components

Static Analysis

Deploy in QA

Environment

Unit & Functional

Test

Regression Test

Result Validatio

n

Update MatchingDefects

Send Notificati

on

(Start)

(End)

Build Tool

(xml test cases)

(Coding Standard,

Sanity checks)

(xml test cases)

Java API

Trigger Mechanis

m

Code Check-in

Matrix Dashboa

rd(pearl, shell, js)Test

Management Server

SMTP Server

Bug Reportin

g ToolAutomated Test Script

Raise Defect

Feed

back

ETL jobs

BI Dashboar

ds

27

“Companies rarely die from moving too fast, and they frequently die from moving too slowly.”- Reed Hastings, CEO of Netflix

www.LnTInfotech.com

Please send your questions to amar.roy@lntinfotech.com

Let’s Solve

top related