oracle cloud storage service & oracle database backup cloud service

41
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Storage Cloud Service & Oracle Database Backup Cloud Service Jean-Philippe PINTE Cloud Architect Oracle EMEA

Upload: jean-philippe-pinte

Post on 16-Jul-2015

242 views

Category:

Software


5 download

TRANSCRIPT

Page 1: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service & Oracle Database Backup Cloud Service

Jean-Philippe PINTE Cloud Architect Oracle EMEA

Page 2: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 3: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Cloud Day 2015 / Storage & Backup Agenda

Oracle Storage Cloud Service Oracle Database Backup Cloud Service

1

2

Page 4: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service

Page 5: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Overview

• Oracle Storage Cloud Service is an Infrastructure as a Service (IaaS) product, which provides an enterprise-grade, large-scale, object storage solution for files and unstructured data

• The Oracle Storage Cloud Service architecture is highly available and redundant. It provides support for external access methods

Page 6: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Features • Replication within the primary data center

– All objects or containers created in Oracle Storage Cloud Service are replicated to three separate machines within the primary data center.

• Automatic error detection and healing – Object copies are actively scanned for data corruption.

• Fine-grained read/write access control to containers – Read and write access to an object is controlled by its container.

– Each container can be assigned its own read and write access control lists.

• REST API and Java library interfaces – Primary method for accessing Oracle Storage Cloud Service

– A Java library that wraps the RESTful web service is also available

Page 7: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Architecture

Page 8: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Key Concepts

• Terminology –Objects

• Logical representation of stored binary data

• Un object is most commonly created by uploading a file or from ephemeral unstructured data. Objects are created within a container. A single object can hold up to 5 GB of data, but multiple objects can be linked together to hold more than 5 GB of contiguous data.

–Containers • A named collection of objects

• Containers are similar to a directory structure but with a key distinction

• A container is a user-created resource, which can hold an unlimited number of objects, unless you specify a quota for the container

Page 9: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Key Concepts

• Basics –Objects are referenced by their canonical URL paths

• Protocol: HTTPS

• Host: storage.<data_center>.cloud.oracle.com

• Path: /v1/<storage_account>/<container-name>/<object-name>

–Objects must reside within a Container

–Containers cannot be nested

–Objects and Containers can have arbitrary key/value properties

–Uploads are limited to 5GB but Objects can be any size

Page 10: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service How to interact

• OpenStack browser (e.g. CloudBerry, CyberDuck)

• OpenStack Client API –Command line

• $swift list <container_name>

• $swift upload <container_name> <file_name>

–Scripted / Python shell

–Other ports of OpenStack API

• Java Client API

Page 11: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Openstack Tool

• Cloudberry Browser

• Cyberduck

Page 12: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Python Swiftclient • Container list : – swift -A https://storage.us2.oraclecloud.com/auth/v1.0 -U Storage-

IdentityDomain:username -K password list

• Download a file: – swift -A https://storage.us2.oraclecloud.com/auth/v1.0 -U Storage-

IdentityDomain : username –K password ContainerName FileName

Page 13: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service cURL

1. Obtain Authentication Token curl -v -X GET \ -H 'X-Storage-User: Storage-IdentityDomain:username ' -H 'X-Storage-Pass: password' https://storage.us2.oraclecloud.com/auth/v1.0

Page 14: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service cURL

2. Container list curl -v -X GET -H 'X-Auth-Token: AUTH_tk69758e217718c5eccd82f95dbf71ebf8' https://storage.us2.oraclecloud.com/v1/Storage-IdentityDomain?limit=15

Page 15: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service cURL

3. Upload a file curl -v -X PUT –T Sample.jpg -H 'X-Auth-Token: AUTH_tk69758e217718c5eccd82f95dbf71ebf8' https://storage.us2.oraclecloud.com/v1/Storage- IdentityDomain/ContainerName /Sample.jpg

3. Download a file curl -v -s -X GET –o Sample_New.jpg -H 'X-Auth-Token: AUTH_tk69758e217718c5eccd82f95dbf71ebf8 ' https://storage.us2.oraclecloud.com/v1/Storage- IdentityDomain/ContainerName /Sample.jpg

Page 16: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Dashboard

Page 17: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Cloud Storage Demo

Page 18: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Use Cases

• Backup

– Use public cloud storage as the backup target (email backups, non-Oracle databases, applications, unstructured data etc.) • Customers can Simplify Backups and Lower Capital and Operational Expenditures

• Dedupe & Compress Large Unstructured Files and Shrink Your Storage Requirements

• Archive – Archive infrequently accessed data for long-term retention (image archives,

healthcare, engineering renderings) • Lower Costs by Moving Infrequently Accessed Data to More Economical Cloud Storage

Page 19: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Storage Cloud Service Summarize

• Secure: Enterprise-grade data protection and privacy policies

• Scalable: Eliminate storage hardware planning with capacity on-demand

• Reliable: Redundancy policies that ensure your data is highly available

• Simple: Manage data through a RESTful Web Service or Java library

Page 20: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Cloud Service

Page 21: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service

• Backup on-premise or Cloud Databases to Oracle Database Backup Service hosted in Oracle Public Cloud

• Cost effective, scalable cloud storage for database backups

• End-to-end enterprise-grade data encryption, compression and protection • Clients: Data is always encrypted with keys kept locally at client, optionally compressed, and securely transmitted

• Cloud: Encrypted data is protected with 3-way mirroring on every write

Oracle Company Confidential – Shared Under Terms of OPN NDA 24

Replace Offsite Tape Backups with Simple and Low Cost Cloud Backup

On Premises Oracle Cloud Oracle Database Backup Service

Page 22: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Offsite Storage Location •Addresses cloud based backup solution for Oracle Databases – Complements disk & tape backups

•Object storage based on OpenStack Swift (Cloud Storage Software) –Replicates to at least 3 nodes for redundancy (Swift)

–Data accessed using REST API

•Data center in US (Chicago) –Soon: more data centers including EMEA

• Monitoring capacity usage via cloud admin dashboard

Page 23: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Recovery Manager (RMAN)

• RMAN is an Oracle Database client that performs backup and recovery tasks on your databases and automates administration of your backup strategies – Integrated backup & recovery tool • Bundled with Oracle Databases with no additional cost

– Perform backup & recovery operations at various levels • Database, data file, tablespace, table, block

– Protects from physical failures – Simple commands • RMAN> BACKUP DATABASE;

• RMAN> RESTORE DATABASE

Page 24: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Support Matrix / Client Databases

Versions

Oracle Database - EE 10.2, 11g, 12c (64 bits)

Oracle Database - SE 10.2, 11g, 12c (64 bits) + Patch for Bug 18339044

Platforms (64 bits) Linux, Solaris, SPARC, Windows, HP-UX, AIX, zLinux

RMAN Compression HIGH, MEDIUM, BASIC, LOW (depends on DB version)

RMAN Encryption Password, TDE, Dual-mode

Page 25: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Components of Cloud Backup Solution

• Cloud Side (Storage Capacity) – Oracle Database Backup Service (ODBS)

• Customers subscribe for this service –Available as non-metered and metered subscription

• Unmetered: 1TB blocks per month, Month-to-month / longer term • Metered: Pre-paid Database Cloud subscription funds for storage & bandwidth

• Client Side – On-Premise Databases –Oracle Database Cloud Backup Module (ODCBM) • RMAN integrated library • Perform backups to ODBS using RMAN interface

• Client Side – In the Cloud Databases –Automatic configuration when using Cloud Tooling

Page 26: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Oracle Database Cloud Backup Module (ODCBM) • SBT (Tape) library with built-in REST API to stream to ODBS

• Seamless integration with the Recovery Manager (RMAN)

• ODCBM is Stateless – From RMAN, ODBS looks like another tape media

– RMAN encryption for backups enforced - keys kept locally to client (Stored in Wallet)

– Securely transmitted to the cloud over HTTPS

Oracle

Database Cloud

Backup Module

Database, FRA

RMAN

WAN

(HTTPS)

Oracle Database

Backup Service

Encryption &

Optional

Compression

Page 27: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Steps To Deploy Database Backup Service • Download installer from OTN (opc_install.jar )

• Executes the installer

java -jar opc_install.jar -serviceName serviceName -identityDomain MyIdentityDomain -opcId opc_user-opcPass opc_user_pwd -walletDir /home/oracle/opc/wallet -libDir /home/oracle/opc/lib

•Installer does the following: –Creates an Oracle wallet and stores credentials

–Downloads platform specific SBT library (libopc12.so)

–Pre-populates ODBS configuration files

Page 28: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Steps To Deploy Database Backup Service $mkdir /home/oracle/OPC/wallet

$mkdir /home/oracle/OPC/lib

$java -jar opc_install.jar -serviceName myService -identityDomain myDomain -opcId [email protected] -opcPass abc123 -walletDir /home/oracle/OPC/wallet -libDir /home/oracle/OPC/lib

Oracle Database Cloud Backup Module Install Tool, build 2014-03-13

Oracle Database Cloud Backup Module credentials are valid.

Oracle Database Cloud Backup Module wallet created in directory /home/oracle/OPC/wallet.

Oracle Database Cloud Backup Module initialization file /orclhome/dbs/opcmySID.ora created.

Downloading Oracle Database Cloud Backup Module Software Library from file

opc_linux64.zip.

Downloaded 13165919 bytes in 204 seconds. Transfer rate was 64538 bytes/second.

Download complete.

Extracted file /home/oracle/OPC/lib/libopc12.so

On Executing of the above command, some files like libopc.so, opcSID.ora & cwallet.sso files are created. These files would be used with RMAN for backup/restore of your database

Page 29: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Steps To Deploy Database Backup Service

Parameter Name Description

OPC_HOST REST destination URL * Ex: https://storage.us2.oraclecloud.com/v1/odbssvc-odbsdom

OPC_WALLET OPC credential wallet location * Ex: ‘LOCATION=file:/home/oracle/OPC/wallet CREDENTIAL_ALIAS=odbs_opc’

OPC_CONTAINER (Optional)

User specified container name (Customer need to create that using tools like cloudberry until Oracle Cloud has GUI) Ex:PAYROLL_DB

OPC_PROXY (Optional)

Proxy Information * Ex: www-proxy.smallcompany.com:80

OPC_CHUNK_SIZE (Optional)

Transfer size to cloud. Default is 20MB. Ex: 10MB

Run time configurations ($ORACLE_HOME/opc<sid>.ora)

Page 30: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Steps To Deploy Database Backup Service • Configure RMAN Backup

$ rman target / RMAN> configure channel device type sbt parms='SBT_LIBRARY=/abc/libopc12.so’ , SBT_PARMS=(OPC_PFILE=/abc/opcSID.ora)'; RMAN> configure device type sbt parallelism 2;

RMAN> set encryption on identified by “abc” only;

RMAN> backup device type sbt database;

Page 31: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Example : Performing Backup & Recovery

Page 32: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Oracle Enterprise Manager

1

2

3

4

Page 33: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service RMAN Backup Data Cloud Objects • RMAN streams backup data (pieces) into the cloud module

• Cloud module accumulates until a chunk size (~20MB) is reached and ships to ODBS – Failed transmissions are retried automatically

• Each chunk is stored as an object inside the ODBS user container

• Typical URL formation for every object – http://storage.us2.oraclecloud.com/v1/<service>-<domain>/<container>/<piece name>/<unique ID>/0000001,

0000002 ..

– Default container name : “oracle-data-[first 8 chars of service & domain] – Create you dedicated container (preferred)

• Creates heart beat file in the cloud during backup/restore/delete operations

• Deletes heart beat file after the operation completion

Page 34: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service RMAN Compression : Increases Effective Backup Rate • Optional – not enforced but recommended

• RMAN compression supports HIGH, MEDIUM, LOW and BASIC – RMAN> configure compression algorithm ‘MEDIUM’

– RMAN> backup as compressed backupset database;

• ACO licensing not required when used with ODBS –HIGH, MEDIUM, LOW options generally require ACO license

• MEDIUM is recommended for Cloud Backups

• Can be used along with Oracle Database Compressions

Page 35: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service RMAN Encryption : Enforced for Security • Mandatory

• RMAN encryptions supports Password, Transparent Data Encryption (TDE), Dual-mode

• ASO license not required when used with ODBS

• Passphrase does not require any Oracle Wallet Configuration – RMAN> set encryption on identified by “abc123” only;

– RMAN> backup database;

• Encrypted at the source, securely transmitted over SSL, and 3-way protection in the Cloud

• Can be used with Oracle Data Encryption (ASO)

Page 36: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service RMAN Operations – Fully Flexible Across EE / SE Database

(Backup Set)

• Full Database

• Selected Tablespace(s)

• Selected Data Files

• Incremental – Differential

• Incremental – Cumulative

• Compressed

• Encrypted

Backups From

Fast Recovery Area or NFS

• Image Copies

• Archived logs

• Compressed

• Encrypted backup sets

• Un-encrypted backup sets cannot be backed up

Restore from ODBS

• Full Database

• Tablespace

• Datafile

• Table Recovery (12c)

• Block Recovery

Maintenance

• Retention Period

• Crosscheck

• Obsolete

• Delete Obsolete

• Delete Backups

Page 37: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Service Dashboard

Page 38: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Cloud Service Use Cases

• Protect Data with Backup & Recovery Service – What:

• Create secure, encrypted backup off site

• Backup OPC databases with ease

– Benefits

• Create secure, encrypted backups in an off-premises location

• Store backups using reliable 3-way mirroring

• Familiar using simple standard RMAN commands

• Scale capacity on demand

Page 39: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Cloud Service Summarize • Simple to use to store the backups offsite for any DR purposes

• Low cost Oracle cloud storage with no up front CAPEX

• End to end security with RMAN encryption / compression capabilities

• On-demand scalable storage with unlimited database backups

• Faster deployment with familiar RMAN interface with no new commands to learn

• Backups can be used to duplicate databases for cloning purposes anywhere

Page 40: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

http://cloud.oracle.com

Page 41: Oracle Cloud Storage Service & Oracle Database Backup Cloud Service

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Backup Cloud Service Try it out !

• Request from cloud.oracle.com a FREE 30-day trial for the Database Backup Service