release 16.2 and roadmap 2017 - open source backup …...conventional backup scheme 1. daily...
TRANSCRIPT
![Page 1: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/1.jpg)
Release 16.2 and Roadmap 2017
Bareos 16.2 and Roadmap 2017
![Page 2: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/2.jpg)
![Page 3: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/3.jpg)
Agenda1. What's new in Bareos 16.22. In depth: Always Incremental Backup Scheme3. What's on the roadmap for 2017?
![Page 4: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/4.jpg)
What's new in Bareos 16.21. Always Incremental Backup Scheme2. Client initiated connection (see dedicated presentation)3. Enhanced ACLs: multitenancy4. Performance Enhancements5. News about the Web UI6. NDMP Enhancements7. New subdirectory configuration scheme8. Configuration API: First steps9. Plugins: Incremental backup und pointintime recovery forMySQL
![Page 5: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/5.jpg)
In depth: AlwaysIncremental Backup
Scheme
![Page 6: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/6.jpg)
Conventional backupscheme
1. daily incremental backups kept for one week2. weekly differential backups kept for three weeks3. monthly full backups kept for half year
![Page 7: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/7.jpg)
Job availability for conventional backup scheme
![Page 8: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/8.jpg)
Job history loss for conventional backup scheme
![Page 9: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/9.jpg)
Data being moved in conventional backup scheme
![Page 10: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/10.jpg)
Problems with conventionalbackup scheme
1. Full data is copied over the network in regular intervals2. Identical Data is copied from client multiple times3. Job history loss caused by retention expiry
![Page 11: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/11.jpg)
always incremental backup schemeBasic conceptOnly changes are copied from the clients alwaysincrementalExisting data from the client is consolidated with the newincremental information (keep history)The consolidation happens without client interactionMinimized number of incrementals is kept to have adefined change history
![Page 12: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/12.jpg)
Two main tasks:1. Incremental backup job is run every night during the backupwindow
2. Consolidation job consolidates during the day
![Page 13: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/13.jpg)
How to configure always incrementalBackup Job
Job { Name = BackupClient1 ... Accurate = yes Always Incremental = yes Always Incremental Job Retention = 7 days }
Consolidation Job Job { Name = "Consolidate" Type = Consolidate }
![Page 14: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/14.jpg)
The Backup Jobruns an incremental backup during the backup windowAlways Incremental directives configure behaviouraccurate Backup to notice file deletion
![Page 15: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/15.jpg)
The Consolidation JobLoops over all Backup JobsStarts virtual backups according to Always Incrementalsettings
![Page 16: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/16.jpg)
Job availability with always incremental backup scheme
![Page 17: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/17.jpg)
Job availability compared
![Page 18: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/18.jpg)
Always Incremental Jobdata
![Page 19: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/19.jpg)
Always Incremental Jobdata Problem
good: mininal data from the clientbad: Every day the consolidation runs the whole client data ismoved during consolidationimpossible for a large number of clients
![Page 20: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/20.jpg)
Always Incremental Jobdata Solution
only consolidate latest incremental during consolidationleave the full backup as it is during daily consolidationsconsolidate the full in longer intervals
Job { Always Incremental Max Full Age = 21 days }
![Page 21: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/21.jpg)
Always Incremental Max Full Age = 21 days
![Page 22: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/22.jpg)
Always Incremental Max Full Age = 21 days
![Page 23: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/23.jpg)
Always Incremental Max Full Age with multiple clients
![Page 24: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/24.jpg)
Always Incremental Max Full Age with multiple clients andMax Full Consolidations
![Page 25: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/25.jpg)
Always Incremental configurationoverviewBackup Job
Job { Always Incremental = yes # enabled? Always Incremental Job Retention = 7 days # how long is the job history? Always Incremental Keep Number = 7 # guaranteed number of incs left? Always Incremental Max Full Age = 21 days # if full is older it will be # part of the consolidation }
Consolidation JobJob { Name = "Consolidate" Type = Consolidate Max Full Consolidations = 1 # how many consolidation jobs # with full included can be started }
![Page 26: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/26.jpg)
Always Incremental summaryOnly incremental Backups are done from the clientMinimal network loadMinimal backup timeIn backup window
![Page 27: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/27.jpg)
Always Incremental summaryConsolidation is done locally on storageOutside of backup windowVery fast as localExisting backups are consolidated into new backupsNo holes in the backup history
Defined incremental backup history is always availableAdequate for File Backup, NOT for plugin Backups
![Page 28: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/28.jpg)
Subdirectory configuration schemeBeforeone configuration file per daemon:
Configuration file contains all configuration resourcesIncluding additional configuration files complicated
/etc/bareos/bareos-dir.conf /etc/bareos/bareos-sd.conf /etc/bareos/bareos-fd.conf
@/file/to/config/file @|"/etc/bareos/generate_configuration_to_stdout.sh"
![Page 29: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/29.jpg)
Subdirectory configuration schemeNewone configuration directory per daemon:
one configuration file per resource in resource typedirectory:
Including additional configuration files is easy,
/etc/bareos/bareos-dir.d /etc/bareos/bareos-sd.d /etc/bareos/bareos-fd.d
/etc/bareos/bareos-dir.d/pool/Differential.conf /etc/bareos/bareos-dir.d/pool/Incremental.conf /etc/bareos/bareos-dir.d/pool/Full.conf /etc/bareos/bareos-dir.d/director/bareos-dir.conf /etc/bareos/bareos-dir.d/console/bareos-mon.conf /etc/bareos/bareos-dir.d/storage/File.conf /etc/bareos/bareos-dir.d/job/BackupClient1.conf
/etc/bareos/bareos-dir.d/*/*.conf is automatically loaded
![Page 30: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/30.jpg)
Subdirectory configuration schemecompatibility:if /etc/bareos/bareosdir.conf exists, it is usedotherwise config subdirectories are used.
![Page 31: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/31.jpg)
Configuration APIUses new configuration directory layoutCreate client via director API or bconsole
![Page 32: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/32.jpg)
Enhanced ACL supportFixed inherited ACL limitations in the directorAffects bconsole, Web UI and director APIFull multitenancy supportDefinitions of rules and rolesUsers can only access and see data according to role accessPrerequisite for web UI as selfserviceportal for restore
![Page 33: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/33.jpg)
News from the web UIMultilanguage supportGermanEnglishFrenchRussian
Client overview shows available FD updatesMedia HandlingAutochanger support
![Page 34: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/34.jpg)
Autochanger View
![Page 35: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/35.jpg)
Restore in Russian Language
![Page 36: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/36.jpg)
NDMP EnhancementsDiskToDiskToTape SupportLMDB Backend for NDMP FileHierarchy Data (to be able tohandle very large number of files)
![Page 37: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/37.jpg)
New MySQL / MariaDBPlugin
Uses xtrabackup from PerconaIncremental backups for INNODB tablesHotbackupPointInTime Recovery
![Page 38: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/38.jpg)
RoadmapNDMP: Backup to storage attached tape drivesPerformance Enhancements for large environmentsRHEV / oVirt PluginDeduplicationEnhance configuration APIWebuiUse configuration APIJob availability GraphsPerformance Graphs included
![Page 39: Release 16.2 and Roadmap 2017 - Open Source Backup …...Conventional backup scheme 1. daily incremental backups kept for one week 2. weekly differential backups kept for three weeks](https://reader036.vdocuments.site/reader036/viewer/2022071212/6024212de8652a4f4b42675d/html5/thumbnails/39.jpg)
Thank you
Philipp Storz + Maik Außendorf, Bareos GmbH & Co. KG Open Source Backup Conference 2016