implementinga big data strategy prasa passenger rail ...€¦ · implementinga big data strategy...

EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna

Implementing a Big Data StrategyPRASA Passenger Rail Agency of South Africa

MarkLogic World 2016San Francisco

Agenda

MARKLOGIC WORLD 2016AGENDA


• Introduction• About the customer• Project Goals• Challenges• The Solution• Demo


Introduction

MARKLOGIC WORLD 2016WHO AM I

Alexander DelesCEO, EBCONT

• More than 20 years experience in IT• MarkLogic Partner since 2011

• EBCONT delivered more than 20 MarkLogic projects successfully

EBCONT groupEBCONT is a leading Austrian provider of IT, communication and personnel services. Established in 2000, its founder Rupert Weissenlehner still privately owns the company. Initially positioned as a pure IT service provider, EBCONT used its first ten years of systematic development and stable growth to consolidate a corporate structure in 2010.

Employees 550+

Turnover 52 Mio. Euro

Owner Rupert Weissenlehner

Focus IT, Communication


MARKLOGIC WORLD 2016WHO WE ARE

Award: EBCONT is MarkLogicPartner of Excellence!

The Customer

MARKLOGIC WORLD 2016THE CUSTOMER


Passenger Rail Agency of South AfricaPRASA – BE MOVED

MARKLOGIC WORLD 2016THE CUSTOMER


Name PRASA

Industry Passenger rail

Founded 1990 (as SARCC)

Headquarter Hatfield, Pretoria

Revenue ZAR 4.2 billion (USD 275 Mio.)

Employees 500,000 (whole group)

Project Goals

MARKLOGIC WORLD 2016PROJECT GOALS



MARKLOGIC WORLD 2016REASON TO ACT

Digital Evolution

Overall Goals• Create a Data Strategy• Define a data centric enterprise IT architecture• Define a data centric interface strategy and

workflow for all IT systems• Deliver Proof-of-Concept• Implement

– Reference Implementation– Reference Infrastructure

MARKLOGIC WORLD 2016GOALS




Goals• 360 degree overview• Standardize reporting• Improve quality of service• Fraud detection• Geo spatial data / heat maps• Point-in-Time analysis• Alerting• Root cause analysis• Virtualize data• Ease of use – use everywhere with:

– Desktop PC– Tablet– Smartphone



Why Data Virtualization?

CRM, Web CMS, Marketing, Ticketing, Contact centers, HR, Counters, Incident Management, Schedules, etc.

Challenges

MARKLOGIC WORLD 2016



MARKLOGIC WORLD 2016CHALLENGES

Challenges• Variety of data• Different systems and formats for the same purpose

– e.g. more than one incident management

system• Data quality

– Different coverages• Data linkage• Different languages

– English– Africans


MARKLOGIC WORLD 2016DATA

Ticket Sales

Incident Management

Fuel Prices

Documents

Tracks

Stations

Weather Data

Work Shift DataTwitter

Input DataTrain Movement Data


MARKLOGIC WORLD 2016PERSPECTIVES

Different PerspectivesExecutive

Org. Performance

Operations

• Exploration• Find patterns• Improvements

• Near real-time data• Reporting• Ad-hoc insights

• Root cause analysis• Data streams• Alerting


Solution



MARKLOGIC WORLD 2016PROJECT SETUP

Project StreamsQuarter 1 Quarter 2 Quarter 3

Prototypingstream

Data strategy stream

Reference infrastructure stream

Reference implementation stream


MARKLOGIC WORLD 2016INGREDIENTS

Ingredients1 2 3CONCEPT APPROACH TECHNOLOGIE

Next Generation Database – Enterprise NoSQL

“For all your data!”

• Schema-agnostic• Massive scale• Query and search• Analytics• Application services• Semantics• Geo Spatial

Data CentricBi-Modal IT

Bi-Modal IT

MARKLOGIC WORLD 2016BI-MODAL IT


MARKLOGIC WORLD 2016ARCHITECTURE


So - What’s the plan?


Relia

bilit

y

System 1

API

Stable ITIT CentricSystem

2

API

System 3

API

System 4

API

System n

API

BI-M

OD

AL IT

Agi

lity

Data Transport

Data Integration

• Poly-structured Content• Government Grade Security• Extraction• Semantics• Geo-spatial• Data Intelligence• Data Quality

Flexible ITData CentricData Centric

Approach

Integration Pattern(Template)• Initial Data Load• Updates

ApplicationsBusiness Centric

Shor

t Cy

cles

API

Business- and Customer-Centric

Dashboard Search Apps StreamsRo

les

and

Gov

erna

nce

MARKLOGIC WORLD 2016PROVEN PRACTICE: EBCONT‘S DATA SERVICES HUB CONCEPT


MARKLOGIC WORLD 2016INFRASTRUCTURE

Scalable Reference Infrastructure

DATA LAYER

VIRTUALIZATION CLUSTER

VMS

ESB 1

MarkLogic 1

SVN

Storage

VMH1 VMH2 VMH3

MarkLogic 2 MarkLogic 3 MarkLogic 4

ESB 2 Load Balancer

Nexus

ETL 2

ETL 1

APP 1 APP 2 Admin DB

Firewall

MarkLogic 5

Technology stack• Apache Loadbalancer

• Red Hat Enterprise Linux

• VM Ware Cluster

• NETAPP (Storage)

• HP (Server)• Astaro (Firewall, virtualized))

• Zabbix (Monitoring)

• Veeam (Backup)VMH4 VMH5


MARKLOGIC WORLD 2016HOW MARKLOGIC HELPED

How MarkLogic helped

Semantics

Geo spatial

Schema agnostic

Search

English, AfricansData linkage

TracksStations, Assets, Signal

Train movementsData linkage

Fast integrationVariety of formats

Easy data consolidation

ExplorationAnalysis

Data linkage



Live Demo

Any Questions?



Thank you for your attention!

EBCONT proconsult GmbH

Millennium TowerHandelskai 94-961200 ViennaAustria

http://www.ebcont.com



WE ARE LOOKING FORWARD TO INTERESTING

DISCUSSIONS