smart backup architectures for big data in complex, open source based it environments
DESCRIPTION
Slides for my presentation during the Open Source Conference in Amsterdam - 6th of December 2013, around 800 participants. Agility, flexibility and data growth are key challenges in todays IT world.Virtualization, Internet and Cloud are buzz words which seems to help the IT department to fullfil the requirements. More flexibility often means also more complexity.What does it mean for modern backup strategies? Is backup still necessary? What to do with growing amount of data? How to secure the flexible, growing number of servers, databases and application? SEP sesam and Red Hat Storage are the base for a smart backup architecture based on Linux and Open Source solutions. This session will provide you an approach how backup and recovery plannings may be handled to secure modern server environmentsTRANSCRIPT
• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene
Smart Backup Architectures for Big Data in complex, Open Source based IT Environments
Hubert [email protected]
Session title
Hot IT Topics
Forrester Research Inc.
IT Projects 2013
• Virtualization• Master Data Management• Enterprise Security• Integration of Standard and
Individual Software• Data Quality Management
Cap Gemini
The Top 10 Strategic Technology Trends• Mobile device battles• Mobile applications and HTML5• The personal cloud• The Internet of Things• Hybrid IT and cloud computing• Strategic big data
Session title
Big Data
Cloud Computing
Cost
driven by OSS
RE CO V E RY
SEP sesam
B A CK UPRE S T O RE
KEY
Co m p e te n c i e s
Session title
Big Data
Session title
SEP & Big Data
SMART Architecture
Multiple StreamMultilocation Backup
Deduplication
Session title
Cloud Computing
Session title
SEP & Cloud
It's about Agility - Flexibility
Hybrid BackupWidest DB & OS support
Dedup & Replication
Session title
Cost
Session title
SEP & Costs
Unlimited Usage
One subscribtion – use alle SEP backup modules
Reduce your investCOO instead COG
The Real World
• Founded 1998 - Spin-off from the Institute of Clinical Chemistry at the University Hospital Grosshadern of the Ludwig-Maximilians University
• Specialized in genetic and immunological diagnostics
• Health Care - very cost sensitive• Open Source is a key strategy of their IT• Use of Standard Hardware instead of
expensive dedicated Storage solutions• Special Linux Distribution - Scientific Linux
www.scientificlinux.org• Different databases – huge amount of Data
Requirements
• Sophisticated backup strategy with different medias, retention times, remove of backup media to external locations, single servers with 5TB of data
• Integrated Bare System Recovery for all Servers – Linux and Windows
• Variety of Linux Distributions - “old” Linux Distributions (RH 7.1)• Each backup has to be available 2 times – at least • Backup to Disk and Tape• Wide range of Databases – mySQL, MS SQL, Sybase,
PostgreSQL• Upredictable data growth – 100 GB to 500 GB per month
Data Growth
06.01.07
03.02.07
05.03.07
10.04.07
06.05.07
02.06.07
17.07.07
06.08.07
01.09.07
06.10.07
03.11.07
01.12.07
06.01.08
02.02.08
05.03.08
08.04.08
03.05.08
07.06.08
05.07.08
02.08.08
06.09.08
04.10.08
03.11.08
08.12.08
03.01.09
09.02.09
07.03.09
04.04.09
02.05.09
06.06.09
13.07.09
01.08.09
05.09.09
04.10.09
07.11.09
05.12.09
02.01.10
06.02.10
06.03.10
03.04.10
01.05.10
05.06.10
03.07.10
07.08.10
04.09.10
02.10.10
06.11.10
04.12.10
01.01.11
05.02.11
05.03.11
02.04.11
07.05.11
04.06.11
02.07.11
06.08.11
03.09.11
01.10.11
05.11.11
03.12.11
07.01.12
11.02.12
10.03.12
14.04.12
12.05.12
09.06.12
14.07.12
11.08.12
08.09.12
06.10.12
10.11.12
08.12.12
12.01.13
09.02.13
09.03.13
06.04.13
11.05.13
08.06.13
13.07.13
10.08.13
07.09.13
12.10.13
09.11.13
0
2.000
4.000
6.000
8.000
10.000
12.000
14.000
16.000
Jan 2007 Nov 2013
Actual Implementation
• Cluster FS Storage Cluster with Replication – 50TB of Backup Data ==> 100 TB soon
• SEP sesam Server on Linux• File, Database and Bare System Recovery Backup
of Linux and Windows Servers to Cluster FS (Storage Cluster)• Automated replication of the backup data via Cluster FS• Migration of dedicated backups to tape• Automated restore possible from all Nodes and from tape
Ongoing Projects
• Enlarge the storage capacity• Deduplication of Backup Data by SEP Si3T Technology
• Conflict of interest - performance vs. invest for storage
• New Storage HW – Standard Server with 130 TB net capacity
• Slow disks slow down the backup - „smart“ backup tasks speeds up to 2,5 TB / hour
Session title
Red Hat Storage & SEP Sesam
Session title
Free technical Workshop
Free technical Workshop
• SEP sesam
& Red Hat Storage
• 1 Day @ Dupaco Leusden
• 18th of March 2014
• www.dupaco.de
Session title
88% Capability related challanges
84% Complexity
87% CostVeeam,Annual Data Protection Report 2013
Backup issues
Backup is not important
All backup is done to ensure a fast and reliable restore!
The restore and disaster recovery requirements define the backup strategy – not the other way around!
SEP sesam can do it
• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene
Q & A
Hubert [email protected]