meetup oracle database: 1.2 oracle database 18c (autonomous database)

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |

Oracle Autonomous Database

Guillermo Best Cloud PlaAorm Presales Manager November, 2017

1

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | ConfidenHal – Oracle Internal/Restricted/Highly Restricted

2

Oracle Database Cloud Service -‐ Strategy


Strategy – Unified Data Management PlaAorm Service Special purpose access with standards based integraHon for any data type

Cloud Services for any Data Type and Workload

XML

{JSON} Special Purpose Developer Enabled access drivers

Autonomous Database (OLTP, Warehousing, Graph, Documents)

service

NoSQL Database service

Hadoop & Spark

service

Integrated, SQL Standards based access to any data source Oracle SQL

NoSQL Data Lake

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | ConfidenHal – Oracle Internal/Restricted/Highly Restricted

4

Oracle Autonomous Database -‐ Overview


Oracle’s Vision for Autonomous Database

• Self-‐Driving – User defines service levels, database makes them happen

• Self-‐Securing – ProtecHon from both external a\acks and malicious internal users

• Self-‐Repairing – Automated protecHon from all downHme

5

Autonomous Database


Autonomous Database Goals • Much Less Labor, Costs, Errors • Much More Secure, Reliable

•  Much easier for developers to get started with an industrial strength database

•  Support Mission CriOcal workloads at the biggest enterprises

•  Run in Public Cloud or Cloud at Customer

•  Four year effort that is in Beta test now

6

Autonomous Database


Oracle Database 9i, 10g •  AutomaHc Storage Management (ASM) •  AutomaHc Memory Management •  AutomaHc DB DiagnosHc Monitor (ADDM) •  AutomaHc Workload Repository (AWR) •  AutomaHc Undo tablespaces •  AutomaHc Segment Space Management •  AutomaHc StaHsHcs Gathering •  AutomaHc Standby Management (Broker) •  AutomaHc Query Rewrite

Oracle Database 11g, 12c •  AutomaHc SQL Tuning •  AutomaHc Workload Replay •  AutomaHc Capture of SQL Monitor •  AutomaHc Data OpHmizaHon •  AutomaHc Storage Indexes •  AutomaHc Columnar Cache •  AutomaHc DiagnosHc Framework •  AutomaHc Refresh of Database Cloning •  Autonomous Health Framework

7

Journey to Autonomous Database • Oracle has been developing sophisHcated database automaHon for decades


Journey to Autonomous Database

• With Engineered Systems, Oracle automated database infrastructure

8


Journey to Autonomous Database

• Cloud enables Oracle to deliver a Fully Autonomous Database – Expanded Database AutomaHon – Integrated with complete infrastructure automaHon – With addiHonal automaHon for operaHons, HA, security, etc.

9

World’s Best Database is Now World’s Simplest

Autonomous Database


TradiHonally DBAs are Responsible for:

10

•  Generic Tasks – ConfiguraHon and tuning of systems, network, storage – Database provisioning, patching – Database backups, H/A, disaster recovery – Database opHmizaHon

•  Tasks Specific to Business – Architecture, planning, data modeling – Data security and data lifecycle management – ApplicaHon related tuning – End-‐to-‐End service level management


•  Generic Tasks –  Infrastructure -‐ integraHon, tuning of systems, network, storage – Database provisioning, patching – Database backups, H/A, disaster recovery – Database opHmizaHon

•  Tasks Specific to Business – Architecture, planning, data modeling – Data security and lifecycle management – ApplicaHon related tuning – End-‐to-‐End service level management

Autonomous Database Removes Generic Tasks

11

Freedom from Drudgery for DBA: More Time to Innovate and Improve the Business

Autonomous Database


Agenda

Full End-‐to-‐End AutomaHon

Specialized by Workload

Role of Database Administrator

1

2

3

12


Full End-‐to-‐End AutomaHon • CreaHng an Autonomous Database is very difficult

• Must handle a large number of complex tasks – Provisioning complex scale-‐out clusters with disaster recovery – Patching, upgrading, and backing up online – Monitoring, scaling, diagnosing performance, tuning, opHmizing – TesHng and change management of complex applicaHons and workloads – AutomaHcally handling failures and errors

• Autonomous Database brings difficult trade-‐offs: – Best Performance vs. Consistent Performance – Simplicity vs. Completeness

13

Autonomous Database



• Autonomous Database must be MORE Secure and MORE Available – Databases are criHcal -‐ no one wants to automate themselves into bankruptcy

• What makes this possible: – SpecializaHon -‐ Oracle has thousands of engineers, can expertly automate all areas – StandardizaHon -‐ Cloud scale enables learning at scale and economies of scale

• AutomaHon is a Journey – like every other technology – IniHal release automaHon is very complete – AutomaHon will keep gemng smarter and be\er

14

Autonomous Database


Automated vs. Autonomous

• Customer can choose to just use automaHon or hand over all management to Oracle Cloud OperaHons for Autonomous operaHon

•  If Customer hands over management to Oracle then: – Database and OS Administrator Privileges are not needed and not provided – ExcepHon and failure cases are handled by Oracle experts

•  The payoff is huge -‐ eliminate generic tasks, reduce labor, reduce costs, reduce errors, while increasing security and availability

15


Autonomous Database is AutomaHcally Provisioned

• Pre-‐built, pre-‐opHmized, pre-‐tested

16


AutomaHcally Provisioned

• AutomaHcally provisions a scalable, highly available database – Find, allocate, and configure all needed hardware and sooware – Private sooware defined network for customer or workgroup •  Visible only to authorized tenant using VPN

– Server, Storage, Virtual Machine – Oracle Database 18c Container or Pluggable Database – Scalable RAC Cluster – Remote Standby Database with Observer at third region for automaHc failover

•  IniHal releases run on Exadata Cloud Service and Exadata Cloud@Customer – One database or system can consolidate many databases

17

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 18

Autonomous Database AutomaHcally Patches Itself Online


AutomaHcally Patches Itself

•  Full stack patching once a quarter – Firmware, OS, VM, Clusterware, Database, using prebuilt Gold Image – Pre-‐checks run in days before patching to ensure reliability

• Applied in a rolling fashion across nodes of cluster for availability • Customer specifies maintenance window – Time to apply patch is automaHcally selected, customer can override

• Oracle Cloud patches thousands of systems in a day – Scale of patching has driven huge improvements in automaHon and reliability

19


Autonomous Database AutomaHcally Secures Itself


AutomaHcally Secures Itself

• Automated ProtecHon from external a\acks – AutomaHcally applies latest security updates online •  Quarterly, or off-‐cycle for high impact security vulnerability

– NaHve encrypHon prevents data access from outside the database •  Allows keys to be managed by customer’s exisHng Security Module (HSM) • Will interface with Database Aware Key Management Cloud Service

• Automated ProtecHon from malicious internal users – Database Vault prevents administrators from seeing user data – Data Masking finds and conceals sensiHve data from testers

• Oracle staff is locked out -‐ well defined “break glass” procedure, with customer approval, for Oracle OperaHons to access system

21


Autonomous Database AutomaHcally Monitors Itself


AutomaHcally Monitors Itself

• Monitors for capacity limits and bo\lenecks in key components – CPU, Memory, Storage, Network – Ensures resource exhausHon does not cause poor performance or outage – Alert thresholds vary by applicaHon, e.g. OLTP vs Warehouse

• Resource Management prevents one user or database from monopolizing resources • Cluster Health Monitor uses Machine Learning to monitor acHvity, recognize anomalous events and recommend (or automaHcally implements) correcHve acHons

23


Autonomous Database AutomaHcally Scales


Automated ElasHcity and Scaling

•  Independent scaling of compute and storage – Add and remove CPUs or enHre compute or storage servers completely online

•  Instantly auto-‐scales within customer defined limits •  ElasHcity eliminates overprovisioning, reducing costs

25


Autonomous Database AutomaHcally Backs Itself UP


AutomaHcally Backed Up

• Backups are scheduled on nightly basis •  To Database Backup Cloud Service • Or Zero Data Loss Recovery Cloud Service in the future for – Lowest overhead – Fastest restore – Lowest data loss

• RetenHon Time for backups is configurable

27


Autonomous Database AutomaHcally Withstands Failures


AutomaHcally Withstands Failures

• Autonomous database must be safer than manually operated database

•  ExcepOonal SLA Guarantee: – 99.995 NRX% (No Ridiculous eXclusions) – Less than 2.5 minutes downHme a month – Includes patching and upgrade, database bugs, regional outages

• Minimal brownout for maintenance

29

Outage Key Feature

PotenOal DownOme

Server Outage (HA) RAC Near-‐Zero

Regional Outage, Disaster Recovery

ADG Seconds

Data CorrupHon ADG Zero

Patches (Updates) RAC Near-‐Zero

Database Upgrade ADG Seconds

Table/Index Changes Online RedefiniOon

Zero

User Error Flashback Time Since Error


Autonomous Database AutomaHcally Diagnoses Performance


AutomaHcally Diagnoses Performance

• Autonomous Database includes Oracle’s industry leading diagnosHcs automaHon • AutomaHc Database DiagnosHc Monitor (ADDM) – AutomaHcally diagnoses root cause of performance issues – A.I. (Expert System)

• AutomaHc Workload Repository (AWR) – AutomaHcally keeps detailed performance and resource uHlizaHon history

• Real-‐Time SQL Monitoring – AutomaHcally diagnoses how resources are used in SQL statements

31


Autonomous Database AutomaHcally OpHmizes Itself


AutomaHcally OpHmizes Itself

•  Autonomous Database includes Oracle’s industry leading database tuning automaHon •  Many database algorithms self opHmize – caching, locking, storage indexes, offload, etc.

•  OpHmizer is now further automated by gathering staHsHcs as new data is loaded

•  AutomaHc SQL (Re)Tuning – Machine learning technology that is constantly re-‐evaluaHng SQL plans based on the latest staHsHcs and recommending/implemenHng be\er plans

•  Tuning is workload dependent – e.g. OLTP vs analyHcs so we specialize services •  Tuning is an extremely difficult problem – Even scheduling a fleet of trucks to opHmally make deliveries is incredibly complex – Database has many degrees of freedom and tradeoffs that must be considered

33


Autonomous Database AutomaHcally Ensures Changes are Safe


Automates TesHng – Ensures Changes and Upgrades are Safe • Autonomous Database includes Oracle’s industry leading tesHng automaHon •  SQL Performance Analyzer – Automates and simplifies the process of assessing a change on SQL workloads – Captures producHon SQL, executes SQL in test environment pre and post changes

• Workload Capture and Replay – Captures full producHon workload including concurrency and Hming informaHon – Replays workload on test environment and idenHfies, analyzes, and fixes issues

• Data Masking – Finds sensiHve data and replaces it with masked data in a test environment

35


Autonomous Database AutomaHcally Handles Errors


AutomaHcally Handles Errors •  Scans for issues across all layers of stack using key diagnosHc tools – ORAchk, EXAchk, oswatcher, procwatcher, etc.

•  If an error occurs: – Collects all relevant diagnosHc data – Analyses logs to establish a Hmeline to disHnguish iniHal problem from side-‐effects – Uploads to Oracle Support – Machine Learning algorithm analyses diagnosHcs to match to known cause

• Oracle Engineering using Machine Learning to prevent issues from happening – AnHcipate bugs customers are likely to hit, and prioriHze fixing those first – Determine regression tests developer should run first when modifying code

37


Autonomous Database Automates MigraHon and Data Loading


Automated MigraHon and Data Loading

• Automates migraHon to cloud using – Backup to Cloud – Data Pump Export – Data Guard Standby – Golden Gate

• Database now directly reads and loads flat file data from object store – No need to store file data on Database Servers

39


Autonomous Database Provides REST Based Interfaces

• All Database Cloud provisioning and lifecycle operaHons are exposed through Web Interfaces and RESTful APIs –  AcHvate/DeacHvate Service –  Grow compute or storage – Manage Virtual Network and Security Lists – Manage access keys –  Start/Stop Compute

• Can be managed by Oracle Enterprise Manager Cloud Control

• Allows integraHon with customer’s exisHng automaHon infrastructure – ServiceNow, OpenStack, Cloud Foundry

40

–  Create Database (RAC, AcHve Data Guard, PDB) –  Patch Database –  Clone Database –  Configure IO Resource Management –  Backup and Recovery


Agenda




1

2

3

41


One Autonomous Database – OpHmized by Use Case

42

Oracle Autonomous Database

Enterprise OLTP, Mixed

Workloads

Data Warehousing

Departments, Developers

2017 2018 Now


Autonomous Database Cloud For Departments or Developers

•  Easy – Ideal entry level service for running Oracle Database in cloud – Packed with tools for modern app development – Built-‐in ApplicaHon Express low code development environment

•  Fast – Based on Exadata technology

•  ElasHc – Choose from simplified all-‐inclusive shapes

43

Available Now (Exadata Express)


Autonomous Database Cloud For Data Warehouse •  Easy – AutomaHcally opHmizes AnalyHc workloads – Simply “load and go” – Database tunes itself -‐ No need to define indexes, parHHons, materialized views, etc. – Works with any BI analyHcs tool

•  Fast – Based on Exadata technology – Performance matches or exceeds most hand-‐tuned Data Warehouses

•  ElasHc –  Instant scaling of compute or storage with no downHme – Pay for compute when in use only

44

Expected CY 2017


Autonomous Database Cloud For OLTP or Mixed Workloads

45

Expected CY 2018

•  Easy – Configured for Mission CriOcal workloads •  Full Maximum Availability Architecture with scale-‐out clustering and disaster recovery

– Or Configured for Low Cost •  Single server for non-‐criHcal workloads or test/dev

•  Fast – Based on Exadata technology

•  ElasHc – Instant scaling of compute or storage with no downHme


Agenda




1

2

3

46


Database Administrator QuesHons and Fears

• Will my job go away?

• Will my job change?

• Will I lose control?

47


Reality vs. Fears

•  Your job will not go away -‐ there is a shortage of skilled database experts – Database automaHon has been improving for decades

• But your job will change, so you must change •  You will spend less Hme on generic maintenance, more Hme innovaOng • More Hme with the business – ExecuHng more projects, reducing backlog, gemng more value from data – Cloud’s fast provisioning and pay-‐as-‐you-‐go enables rapid experimentaHon

• More Hme with developers – OpHmizing data access, improving end-‐user experience

• More Hme on new techniques like Machine Learning 48


Database Administrator Must Ensure End-‐to-‐End Service Levels •  Focus on opHmizing how applicaHons and databases work together: – Define good data model, and good SQL – Avoid row at a Hme processing, and repeated logins/parsing – Understand where Hme is being spent – Understand tradeoffs in parallelism, plans, indexes, parHHons, etc. – Ensure that sensiOve data is kept secure end-‐to-‐end – Beware what an applicaHon asks for – the database will do exactly that • Need new skills in Cloud Systems, Cloud Networking, Cloud Storage – DBA sizes, monitors, ensures full stack works as expected

• Database Administrator will gain more control – Will be in charge of, and in control of, end-‐to-‐end service levels

49


Summary: Oracle Autonomous Database

• World’s First Autonomous Mission CriOcal Database – Self-‐Driving, Self-‐Securing, Self-‐Repairing – Full End-‐to-‐End AutomaHon – Less Labor, Lower Cost, Fewer Errors, More Secure, More Reliable – Frees DBAs from generic operaHonal drudgery to innovate more

• Runs – World’s #1 Database, Specialized by Workload – In Public Cloud or Cloud at Customer

50

Autonomous Database

meetup oracle database: 1.2 oracle database 18c (autonomous database)

Technology