smart backup architectures for big data in complex, open source based it environments

Post on 30-Jun-2015

254 Views

Category:

Technology

3 Downloads

Preview:

Click to see full reader

DESCRIPTION

Slides for my presentation during the Open Source Conference in Amsterdam - 6th of December 2013, around 800 participants. Agility, flexibility and data growth are key challenges in todays IT world.Virtualization, Internet and Cloud are buzz words which seems to help the IT department to fullfil the requirements. More flexibility often means also more complexity.What does it mean for modern backup strategies? Is backup still necessary? What to do with growing amount of data? How to secure the flexible, growing number of servers, databases and application? SEP sesam and Red Hat Storage are the base for a smart backup architecture based on Linux and Open Source solutions. This session will provide you an approach how backup and recovery plannings may be handled to secure modern server environments

TRANSCRIPT

• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene

Smart Backup Architectures for Big Data in complex, Open Source based IT Environments

Hubert Schweinesbeinhs@sep.de

Session title

Hot IT Topics

Forrester Research Inc.

IT Projects 2013

• Virtualization• Master Data Management• Enterprise Security• Integration of Standard and

Individual Software• Data Quality Management

Cap Gemini

The Top 10 Strategic Technology Trends• Mobile device battles• Mobile applications and HTML5• The personal cloud• The Internet of Things• Hybrid IT and cloud computing• Strategic big data

Session title

Big Data

Cloud Computing

Cost

driven by OSS

RE CO V E RY

SEP sesam

B A CK UPRE S T O RE

KEY

Co m p e te n c i e s

Session title

Big Data

Session title

SEP & Big Data

SMART Architecture

Multiple StreamMultilocation Backup

Deduplication

Session title

Cloud Computing

Session title

SEP & Cloud

It's about Agility - Flexibility

Hybrid BackupWidest DB & OS support

Dedup & Replication

Session title

Cost

Session title

SEP & Costs

Unlimited Usage

One subscribtion – use alle SEP backup modules

Reduce your investCOO instead COG

The Real World

• Founded 1998 - Spin-off from the Institute of Clinical Chemistry at the University Hospital Grosshadern of the Ludwig-Maximilians University

• Specialized in genetic and immunological diagnostics

• Health Care - very cost sensitive• Open Source is a key strategy of their IT• Use of Standard Hardware instead of

expensive dedicated Storage solutions• Special Linux Distribution - Scientific Linux

www.scientificlinux.org• Different databases – huge amount of Data

Requirements

• Sophisticated backup strategy with different medias, retention times, remove of backup media to external locations, single servers with 5TB of data

• Integrated Bare System Recovery for all Servers – Linux and Windows

• Variety of Linux Distributions - “old” Linux Distributions (RH 7.1)• Each backup has to be available 2 times – at least • Backup to Disk and Tape• Wide range of Databases – mySQL, MS SQL, Sybase,

PostgreSQL• Upredictable data growth – 100 GB to 500 GB per month

Data Growth

06.01.07

03.02.07

05.03.07

10.04.07

06.05.07

02.06.07

17.07.07

06.08.07

01.09.07

06.10.07

03.11.07

01.12.07

06.01.08

02.02.08

05.03.08

08.04.08

03.05.08

07.06.08

05.07.08

02.08.08

06.09.08

04.10.08

03.11.08

08.12.08

03.01.09

09.02.09

07.03.09

04.04.09

02.05.09

06.06.09

13.07.09

01.08.09

05.09.09

04.10.09

07.11.09

05.12.09

02.01.10

06.02.10

06.03.10

03.04.10

01.05.10

05.06.10

03.07.10

07.08.10

04.09.10

02.10.10

06.11.10

04.12.10

01.01.11

05.02.11

05.03.11

02.04.11

07.05.11

04.06.11

02.07.11

06.08.11

03.09.11

01.10.11

05.11.11

03.12.11

07.01.12

11.02.12

10.03.12

14.04.12

12.05.12

09.06.12

14.07.12

11.08.12

08.09.12

06.10.12

10.11.12

08.12.12

12.01.13

09.02.13

09.03.13

06.04.13

11.05.13

08.06.13

13.07.13

10.08.13

07.09.13

12.10.13

09.11.13

0

2.000

4.000

6.000

8.000

10.000

12.000

14.000

16.000

Jan 2007 Nov 2013

Actual Implementation

• Cluster FS Storage Cluster with Replication – 50TB of Backup Data ==> 100 TB soon

• SEP sesam Server on Linux• File, Database and Bare System Recovery Backup

of Linux and Windows Servers to Cluster FS (Storage Cluster)• Automated replication of the backup data via Cluster FS• Migration of dedicated backups to tape• Automated restore possible from all Nodes and from tape

Ongoing Projects

• Enlarge the storage capacity• Deduplication of Backup Data by SEP Si3T Technology

• Conflict of interest - performance vs. invest for storage

• New Storage HW – Standard Server with 130 TB net capacity

• Slow disks slow down the backup - „smart“ backup tasks speeds up to 2,5 TB / hour

Session title

Red Hat Storage & SEP Sesam

Session title

Free technical Workshop

Free technical Workshop

• SEP sesam

& Red Hat Storage

• 1 Day @ Dupaco Leusden

• 18th of March 2014

• www.dupaco.de

Session title

88% Capability related challanges

84% Complexity

87% CostVeeam,Annual Data Protection Report 2013

Backup issues

Backup is not important

All backup is done to ensure a fast and reliable restore!

The restore and disaster recovery requirements define the backup strategy – not the other way around!

SEP sesam can do it

• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene

Q & A

Hubert Schweinesbeinhs@sep.de

top related