Everything as a Service, including Big Data: BDaaS

Franco-British bilateral workshop on Big Data

LondonNovember 2012

Mick SymondsPrincipal Solutions Architect, Atos MS NL,7 November 2012

2

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Introducing Atos

Atos is an international information technology services company, delivering hi-tech transactional services, consulting, systems integration and managed services. Atos is focused on business technology that powers progress and helps organizations to create their firm of the future. It is the Worldwide Information Technology Partner for the Olympic Games and is quoted on the Paris Eurolist Market. Atos operates under the brands Atos, Atos Consulting & Technology Services, Atos Worldline and Atos Worldgrid.

▶ Annual revenues of € 8,6 billion (pro-forma 2010) ▶ Almost 74,000 business technologists worldwide

in 42 countries▶ Worldwide headquarters in Bezons / Paris, France▶ Atos was established on July 1st 2011, following the

successful integration of Atos Origin and Siemens IT Solutions and Services and the establishment of a global strategic partnership with Siemens AG

3

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Foundation IT Services:Global Delivery to Trusted Partner

ERP Applications

Desktop

Server Management

900,000 SAP users

2,4 Million Seats45 Million calls / year

105,000 managed server instances (74,000 managed physical servers)

Data Centers

13 Global Data Centers +50 Local / Regional Data Centers

93,000 sq meters Data Center1.42 average global virtualization ratio

Hosting:▶ 40,000 MIPS▶ 41,500 terabytes storage ▶ 6000 COD/IaaS/Cloud instances

Enterprise Management Centers

Global EMC’s in Timisoara and Kuala Lumpur & 15 local EMCs with almost 700 staff

Network & Security services

40,000 switches, 6,000 routers, 12,500 WLAN access points, 327,000 voice end users, 350,000 RAS users, 31,000 unified communications end users, filtering for 146,000 email mailboxes

4

MAS 07 November 2012Franco-British bilateral workshop on Big DataPowering progress for our clients

Financial Services

Public Sector, Healthcare & Transport

Energy & Utilities

Manufacturing, Retail & Services

Telecom, Media & Technology

5

MAS 07 November 2012Franco-British bilateral workshop on Big Data

What I want to tell you about

▶ It feels strange to come and tell Researchers about “Innovation”▶ Most of our “innovation” is finding out what researchers and vendors are

reporting– we are a long way down the food chain in most respects

▶ However, we find that one man’s business-as-usual is sometimes another man’s innovation

▶ The real development in Cloud in general and Helix Nebula in particular is not really technology– it is deploying services, between suppliers, and making it work as a business

▶ In Cloud, everything is “as a Service” (XaaS)– including, potentially, Bid Data storage and management

▶ You can liberate yourselves from the tedious grind of production operations:– a. by delegating the structured deployment of rules and policies to us– b. by using us to supply point/niche capabilities– c. to provide enabling facilities for people who provide real added value

6

MAS 07 November 2012Franco-British bilateral workshop on Big Data

What is Big Data, the 3-4 traditional V’s

Source: Oracle

7

MAS 07 November 2012Franco-British bilateral workshop on Big Data

From the traditional 3-4 V’s towardsthe 5-6 V’s

Viscosity – Viscosity measures the resistance to flow in the volume of data. This resistance can come from different data sources, friction from integration flow rates, and processing required to turn the data into insight. Technologies to deal with viscosity include improved streaming, agile integration bus’, and complex event processing.Virality – Virality describes how quickly information gets dispersed across people to people (P2P) networks. Virality measures how quickly data is spread and shared to each unique node. Time is a determinant factor along with rate of spread.

Value

8

MAS 07 November 2012Franco-British bilateral workshop on Big Data

▶ Large Hadron Collider: An example of sensor and machine data is found at the Large Hadron Collider at CERN, the European Organization for Nuclear Research. CERN scientists can generate 40 terabytes of data every second during experiments.

▶ Boeing Jets: Boeing jet engines can produce 10 terabytes of operational information for every 30 minutes they turn. A four-engine jumbo jet can create 640 terabytes of data on just one Atlantic crossing; multiply that by the more than 25,000 flights flown each day, and you get an understanding of the impact that sensor and machine-produced data can make on a BI environment.

▶ Twitter: The micro blogging site Twitter serves more than 200 million users who produce more than 90 million "tweets" per day, or 800 per second. Each of these posts is approximately 200 bytes in size. On an average day, this traffic equals more than 12 gigabytes and, throughout the Twitter ecosystem, the company produces a total of eight terabytes of data per day. In comparison, the New York Stock Exchange produces about one terabyte of data per day.

▶ Wal-Mart: Transactional data has grown in velocity and volume at many companies. As recently as 2005, the largest data warehouse in the world was estimated to be 100 terabytes in size. Today, Wal-Mart, the world's largest retailer, is logging one million customer transactions per hour and feeding information into databases estimated at 2.5 petabytes in size.

▶ Financial services: Discover fraud patterns based on multi-years worth of credit card transactions and in a time scale that does not allow new patterns to accumulate significant losses. Measure transaction processing latency across many business processes by processing and correlating system log data.

▶ Internet retailers: Discover fraud patterns in Internet retailing by mining web click logs. Assess risk by product type and session Internet Protocol (IP) address activity.

▶ Retailers: Perform sentiment analysis by analysing social media data.▶ Drug discovery: Perform large-scale text analytics on publicly available information sources.▶ Healthcare: Analyse medical insurance claims data for financial analysis, fraud detection, and preferred patient treatment

plans. Analyse patient electronic health records for evaluation of patient care regimes and drug safety.▶ Mobile telecom: Discover mobile phone churn patterns based on analysis of call detail records and correlation with activity

in subscribers' networks of callers.▶ IT technical support: Perform large-scale text analytics on help desk support data and publicly available support forums to

correlate system failures with known problems.▶ Scientific research: Analyse scientific data to extract features (e.g., identify celestial objects from telescope imagery).▶ Internet travel: Improve product ranking (e.g., of hotels) by analysis of multi-years worth of web click logs.

Big Data is transforming business, as well as research

9

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Long-term service trends

Shorter lifecycles

Change in ownership and business model

Consult-build-operate

Assess-compose-orchestrate

Assemble from stock

Rapid assembly and integration of services, to address customer’s

changing business needs and opportunities

Build to orderBespoke systems, tailored, put in place and dedicated to running one application

for one customer, for a number of years

10

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Towards an open future …

▶ As a Tier 1 player in Cloud, Atos is becoming much more pro-active in moving developments forward – often in an open and collaborative manner with others,

who may also include our competitors▶ Examples of this include:

– the Open Data Centre Alliance: a cloud user group, defining common requirements for how cloud services are delivered to (initially) large enterprises. See: https://www.opendatacenteralliance.org

– Helix Nebula: an initiative to deliver cloud services (initially) to European-based scientific research organisations

▶ Both are cases where an initial development and deployment is expected to propagate to a much wider community, over time

▶ Another common factor between these developments is the prevalence of Open Standards and Open Source tooling, and close involvement with the research community which pioneers them– Atos have an inside track on these developments with Atos

Research and Innovation (ARI), who live in this world: see http://www.atosresearch.eu

11

MAS 07 November 2012Franco-British bilateral workshop on Big Data

▶ Addressing the issue will help avoid local (re-)inventions▶ What can we do about it?– Training– Re-deployment– Recruitment– Alliances– Acquisitions

Staffing trends and approaches with Utility and Cloud

+Increase ability to analyse customer needs (solution architecture)

+Plan capacity, manage risks+Address governance issues within

customer+Develop more flexible services+Developing and using Solutions

Templates

- Automate, e.g. using RBA - Off-shore+Monitor operational exceptions

- Further automate- Outsource to vendors

Operations

Administration

Design

12

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Big Data competences and roles

▶ New rolls and skills arise:– Data Scientist– Data Virtualization Specialist– Data Stewards– Big Data Architects– Big Data Analists– ….

▶ New knowledge is necessary!

13

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Atos’ services during a migration and services lifecycle

Customerto be

Service implementation and integration▶ Transition, standardisation, consolidation▶ Conversion and migration▶ Identity management▶ Service integration

▶ Infrastructure, Platform, Software as a Service

▶ Service aggregation▶ Identity, authorisation,

security monitoring▶ Contingency, recovery

Operational Cloud Services

▶ Optimize legacy useTraditional Services

Solutions architecture and planning▶ Opportunity

assessment to determine business needs

▶ TCO analysis, norms, trends, to help build a business case

▶ Establish portfolio of Cloud offerings and capabilities

▶ Solutions selection, architecture and brokerage

▶ Plateau Planning Customer

as is

9. Contract, SL

different-iation

8. Run Book

automation

4. Global

sourcing/off-

shoring

5. Physical

consolidation

6. Demand/

Supply

structures

7. Rational

consolidation

3. Logical

consolid-

ation

10. Information

lifecycle

management

11. On Demand,

Utility Computing

2. Outsourcing

1. Select

standards

14

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Service component relationships

Services

What: service portfolio

Who:supplierinvolvement and integration

Processes

ToolsOrganisation

How: common techniques

Cost

sPr

ices

Environment(s) to be

managed

Inputs

Demand Supply

Business (= customers)Governanc

e

Datacentres

Directories

Workplace

Storage

Security

Networks

Servers

Database Middleware

Specificapplications

Genericapplications

Outputs

Outcomes

15

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Dynamic Management of Data/Information

Tiered Storage Solutions

Storage On DemandCentral Backup

ServicesArchiving on Demand

ILM Application Integrated Solutions

Tier 2 Tier 3 Tier 4 Tier 5Tier 1

Mission critical

Business Critical

Productivityimportant

Compliant Archive

InstantAccess Archive

Tier 6

Archive and Backup to

tape

ILM service offerings:Consult - Build - Operate

Business Goals

Data/Information

TechnologyAlignment of

ILM Consultancy Services

ILM Quick Scan – ILM Assessment – ILM Business Case

16

MAS 07 November 2012Franco-British bilateral workshop on Big Data

Using IaaS as a basis for adding value

Big DataProcessing facilitiesNetwork access

PaaS:test and development facilitiesto create added value services

SaaS:use AppStore and DevPay-type facilitiesdeliver added value informationpay-per-use, with transactional charging

IaaS:from HNsuppliers

PaaS

SaaS

17

MAS 07 November 2012Franco-British bilateral workshop on Big Data

EO Application Platform

ESA UNCLASSIED - For Offical Use 05/07/2012

Data & CatalogueUser (CNR)

Cloud Controller

API

OCCI

Web Interface

Sandbox private

public

18

MAS 07 November 2012Franco-British bilateral workshop on Big Data

User

EO Application Platform at work

1. Instantiates the virtual machine and a development environment

2. Uploads his/her software and defines input data3. Adapts applications to the Cloud to exploit the

distributed computing (PaaS abstraction of the Hadoop MapReduce model)

4. Uses the available toolbox that makes easier the transition between the local development environment (local workstation) and the Cloud

5. Tests, re-test, re-re-test, …6. Transparently deploys the application and runs in

cluster mode against large archives of data!

ESA UNCLASSIED - For Offical Use 05/07/2012

For more information please contact:Mick SymondsPrincipal Solutions Architect/Loose Cannon AtosB.5.L08, Papendorpseweg 93, 3528 BJ Utrecht The Netherlandsmichael.symonds@atos.netm +31 651 755 779

19

20

MAS 07 November 2012Franco-British bilateral workshop on Big Data

More information and details…

▶ More information is documented in various White Papers– Shaping the Cloud

▶ And from the scientific community and others

▶ Cloud Orchestration– Written in summer 2010– Proof of concept created with Cordys

and Open Source▶ Augmented by: A Cloud Message Broker– Extending connectivity to whatever else

is out there▶ Downloadable from the Atos web site:

– http://atos.net/en-us/about_us/insights-and-innovation/scientific_community/scientific_community_whitepapers/default.htm

21

MAS 07 November 2012Franco-British bilateral workshop on Big Data

More on the Atos Cloud platforms…

Platform Canopy Yunano CIS Trusted Agile Infrastructure

A3C, Azure Oracle Extreme Performance Cloud

Helix Nebula Anytime Workplace

AIX

Owner-ship, control

Separate company, with VMware, EMC

JV with Yunano Atos Atos Atos with Microsoft partnership

Atos with Oracle partnership

Consortium: Atos prime role

Atos Atos, with IBM support

Location(s) Cloud hubs ? Cloud hubs and satellites

Initially Munich Initially Paris, UK, Munich

Initially Eindhoven Tbd: Europe Cloud huba and satellites

France

SaaS Yunano, Zimbra, ISV’s, via AppStore

Ufida CRM, ERP Sharepoint aaS, Anytime Files, Enterprise Project Mgmt

ISV’s - XenDesktop, XenApp, App-V, ThinApp

PaaS Java development environment, vFabric

On Canopy Web aaS, SAP FH: Middleware for SAP hosting, etc.

Development environments

Azure Oracle DB - - IBM development and middleware

IaaS VMware On Canopy VMware, Windows, Linux

VMware - Oracle Exadata/ Exalogic

Open Nebula - AIX as a Service

Hyper-visor

VMware VMware VMware Hyper-V Oracle KVM XenServer

Usages Yunano ERP/CRM, AppStore, Hosting for ISV’s, rigid stack, limited customisation

SME’s wanting best-in-class business systems as a service

Professional hosting for customer’s business-critical systems, flexible solutions and customisation

Cloud-based test and development environment

Office 365 and Azure as a service on Atos private cloud

Performance boost for Oracle-based systems

Scalable infrastructure for scientific research organisations

Hosted virtual workplaces, XenClient

Enterprises wanting to continue use of AIX in a flexible environmentCloud Services