Download - Mysql Bigdata Otn
-
7/27/2019 Mysql Bigdata Otn
1/52
Oracle MySQL Visin &EstrategiaJornada de Actualizacin TecnolgicaBuenos Aires, Argentina
Pedro.Andrade@oracle .com MySQL Strategic Accounts ~ Latin America & CaribbeanManuel .Contreras@oracle .com MySQL Senior Consultant ~ Latin America & Caribbean
-
7/27/2019 Mysql Bigdata Otn
2/52
Compromiso de Oracle hacia clientes,desarrolladores y usuarios de MySQL*
- Continuo desarrollo de MySQL Enterprise & Community bajolicenciamiento pblico (GPL)
- Mayor inversin en investigacin & desarrollo (R&D)
- Creacin de una Junta Consultiva de Clientes de MySQL
- Continuidad de opciones de soporte Enterprise (anual o multi-anual)
* Oracle com mitm ents to MySQL, press re lease :
http://www.oracle.com/us/corporate/press/042364
http://www.oracle.com/us/corporate/press/042364http://www.oracle.com/us/corporate/press/042364http://www.oracle.com/us/corporate/press/042364 -
7/27/2019 Mysql Bigdata Otn
3/52
-
7/27/2019 Mysql Bigdata Otn
4/52
Softw are Open Sou rce @ Oracle\
Oracle & So f tw are L ibre
-
7/27/2019 Mysql Bigdata Otn
5/52
mysql.com
-
7/27/2019 Mysql Bigdata Otn
6/52
Base Instalada Oracle
70% utiliza
-
7/27/2019 Mysql Bigdata Otn
7/52
Enfoque MySQL
-
7/27/2019 Mysql Bigdata Otn
8/52
Oracle LinuxOracle VM
Oracle Solaris Cluster
Oracle GoldenGate
Oracle Secure BackupOracle Database Firewall
MySQL Enterprise OracleIntegrations/Certifications
Oracle Fusion MiddleWare
WebLogic Server Database Adapter for Oracle SOAOracle Business Process ManagemOracle Virtual DirectoryOracle Data Integrator
Oracle Enterprise PerformanceManagementOracle Identity AnalyticsOpen SSO STS, Open SSO Fedlet
-
7/27/2019 Mysql Bigdata Otn
9/52
MySQL Cluster 7.3 CGE * NoSQL* Cloud computing * Mejor Performance* Procesamiento Active Active
MySQL Enterprise Server 5.6
* Mejor performance* InnoDB Full Text Search* HA Scripting
-
7/27/2019 Mysql Bigdata Otn
10/52
Falso:
MySQL es solo parasistemas pequeos, no apto
para sistemas con grandemanda transaccional
-
7/27/2019 Mysql Bigdata Otn
11/52
Copyright 2012, Oracle and/or
MySQL & Big Data ?
80% of Hadoop users integrate withCloudera Partner Management
-
7/27/2019 Mysql Bigdata Otn
12/52
MySQL en Latinoamrica
-
7/27/2019 Mysql Bigdata Otn
13/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Qu es Big Data?
Big Data referencia, en el sector de las TI, a los sistemas que manipulagrandes conjuntos de datos (o data sets).
Las dificultades ms habituales en estos casos se centran en laalmacenamiento , bsqueda , anlisis & visualizacin .
Big Data es tpicamente definido como altos volmenes de co
estructurado, recolectado desde fuentes de datos no tradicionales como:web logs, clickstreams, social media, email, sensors, images, video, etc.
-
7/27/2019 Mysql Bigdata Otn
14/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
MakeBetter Decisi
UsingBig Da
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
-
7/27/2019 Mysql Bigdata Otn
15/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Where Does MySQL Fit?
-
7/27/2019 Mysql Bigdata Otn
16/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
B
BI Solutions
ACQUIRE
ORGANIZ ANALYZE
DECIDE
MySQL in the Big Data Lifecycle
NoSQL A
-
7/27/2019 Mysql Bigdata Otn
17/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
NoSQL AMySQL DaMySQL Clu
MySQL in the Big Data Lifecycle
ANALYZE
DECIDE
ORGANIZE
ACQUIRE
-
7/27/2019 Mysql Bigdata Otn
18/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
MySQL NoSQL APIsDesign Goals
Fullytransactional /
ACID
Blazing FastKey / Value
Queries
NoSQLacross
Dat
Combined with Schema Flexibility: Online DDL
-
7/27/2019 Mysql Bigdata Otn
19/52
Copyright 2012, Oracle and/or
Key-value accessBypasses SQL pa
Implemented via:- Memcached plug-in- Memcached mappe
InnoDB API- Use existing Memc- Shared process for u
MySQL 5.6: InnoDBMemcached API
-
7/27/2019 Mysql Bigdata Otn
20/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Performance
Up to 9x Higher SET / INSERT Throughput
M SQL Cl t E t i Ch i f N SQL AP
-
7/27/2019 Mysql Bigdata Otn
21/52
Copyright 2012, Oracle and/or
MySQL Cluster: Extensive Choice of NoSQL AP
Mix &
Match
-
7/27/2019 Mysql Bigdata Otn
22/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Import Apache SqMySQL B
MySQL in the Big Data Lifecycle
ANALYZE
DECIDE ACQUIRE
ORGANIZE
-
7/27/2019 Mysql Bigdata Otn
23/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Qu es Hadoop? Apache Hadoop es un framework de software que soporta aplicadistribuidas bajo una licencia libre.
Permite a las aplicaciones trabajar con miles de nodos y petabyte
Hadoop se inspir en los documentos Google para MapReduce y Google FileSystem (GFS).
Hadoop es un proyecto de alto nivel Apache que est siendo construido yusado por una comunidad global, basado en Java.
Productos Comerciales, que implementan Hadoop Framework:Cloudera, HortonWorks, MapR, Amazon EMR
-
7/27/2019 Mysql Bigdata Otn
24/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Qu es Sqoop?
Sqoop is a Command-line interface application for transferring data betweerelational databases and Hadoop.
It supports incremental loads of a single table or a free form SQL queras saved jobs which can be run multiple times to import updates made to adatabase since the last import.
Can be used to put data from Hadoop into a relational database.
Importing Data
-
7/27/2019 Mysql Bigdata Otn
25/52
Copyright 2012, Oracle and/or
Transactional
Data
HDFS StoraSqoop Job
Map
Map
Map
Map
Hadoop Cluster
Sqoop Import
Gather Metadata
Submit Map Only JobImporting Data
-
7/27/2019 Mysql Bigdata Otn
26/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Hadoop Ecosystem
-
7/27/2019 Mysql Bigdata Otn
27/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Classic Use-Case, On-Line Retail
UsersBrowsing
RecommendationsProf
PurchHist
Web Logs:Pages Viewed
Comments Posted
Social media updatesPreferences
Brands Liked
Telephony Stream
MySQL Binary Log API
-
7/27/2019 Mysql Bigdata Otn
28/52
Copyright 2012, Oracle and/or
MySQL Binary Log APIReal-Time Log Scraping
Provides access to the binary loprogrammatically receive all daas they happen
CDC process Read-only currently
Worked example available fromhttp://bit.ly/binlogapi Maintains a Lucene index f
search engine
Available from LaunchPad https://code.launchpad.net/mysq
listener
Working on integration code for
Master Slave
Search DB-X
Your App
Hadoop
http://bit.ly/binlogapihttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttp://bit.ly/binlogapi -
7/27/2019 Mysql Bigdata Otn
29/52
Copyright 2012, Oracle and/or
MySQL in the Big Data Lifecycle
AnalyzeExport DDecide
ANALYZE
DECIDE
A l Bi D
-
7/27/2019 Mysql Bigdata Otn
30/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Analyze Big Data
-
7/27/2019 Mysql Bigdata Otn
31/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Analyze: Apache Hive
Hive is a data warehouse infrastructure built on top of Hadoopfor prov id in g d a ta sum mar iza tion , query, and analysis.
Initially developed by Facebook , Apache Hive is now used and developother companies such as Netflix.
It provides an SQL-like language called HiveQL while maintaining full suppfor map/reduce. To accelerate queries, it provides indexes, including bitmapindexes. Hive stores metadata in databases like MySQL , and otherstorage in an RDBMS, significantly reducing the time to perform semanticchecks during query execution.
SQL-like queries (Hive QL), which are implicitly converted into map-reduce
Export Data
-
7/27/2019 Mysql Bigdata Otn
32/52
Copyright 2012, Oracle and/or
Export Data
Transactional
& AnalyticsData
HDFS SSqoop Job
Map
Map
Map
Map
Hadoop Cluster
Sqoop Export
Gather Metadata
Submit Map Only Job
M SQL O ti l D t b f W b
-
7/27/2019 Mysql Bigdata Otn
33/52
MySQL Operational Database for Web
MySQL Reporting Database for BI
-
7/27/2019 Mysql Bigdata Otn
34/52
MySQL Reporting Database for BI
Leveraging Oracle Solutions
-
7/27/2019 Mysql Bigdata Otn
35/52
Leveraging Oracle Solutions For Data Acquired in MySQL
Acquire Organize Analyze Decide
Web Data Acquired in MySQL Analyzed with
oracle Exadata
Organized withOracle Big Data
Appliance
Depo
M SQL E t i Editi / CGE
-
7/27/2019 Mysql Bigdata Otn
36/52
Copyright 2012, Oracle and/or
Oracle Premier Lifetime Support
Oracle Product
Certifications/Integrations
MySQL Enterprise
High Availability
MySQL Enterprise
Security
MySQL Enterprise
Scalability
MySQL Ent
Back
MySQL Enterprise
Monitor/Query Analyze
MySQL
MySQL Enterprise Edition / CGEHighest Levels of Security, Performance and Scalability
MySQL Enterprise
Audit
MySQL Enterprise Monitor
-
7/27/2019 Mysql Bigdata Otn
37/52
y Q p Replication Monitor
Un asDBA
para M
MySQL Enterprise Monitor
-
7/27/2019 Mysql Bigdata Otn
38/52
Vista nica consolidada delambiente MySQL
Auto descubrimiento deservidores MySQL,replicacin y topologas
Alertas y monitoreo adaptable y basado en reglas
Identificacin de problemasantes de que ocurran
Reduccin de riesgo ytiempo de inactividad
y Q p
-
7/27/2019 Mysql Bigdata Otn
39/52
MySQL Enterprise Edition
-
7/27/2019 Mysql Bigdata Otn
40/52
MySQL Enterprise EditionSupport Break / Fix
Consultative
Tools Enterprise Monitor Query Analyzer
Enterprise Backup
Workbench SE
DB Enhancements Thread Pool
External Authentication
Enterprise Audit
Thread Pooling
-
7/27/2019 Mysql Bigdata Otn
41/52
Thread Pooling
Scaling Security and Data Protection
-
7/27/2019 Mysql Bigdata Otn
42/52
Scaling, Security and Data Protection
MySQL Enterprise Scalability
MySQL Enterprise Security
MySQL Enterprise Audit
MySQL Enterprise Backup
Oracle Premier Support for MySQL
-
7/27/2019 Mysql Bigdata Otn
43/52
Straight from the Source Largest Team of MySQL Experts
Backed by MySQL Developers Forward Compatible Hot Fixes MySQL Maintenance Releases MySQL Support in 29 Languages 24/7/365 Unlimited Incidents Knowledge Base MySQL Consultative Support
pp y Q
"The MySQL support service hessential in helping us with trouand providing recommendationproduction cluster, Thanks."
-- Carlos Morales Playful
Only
-
7/27/2019 Mysql Bigdata Otn
44/52
-
7/27/2019 Mysql Bigdata Otn
45/52
MySQL Agosto 2013
Buenos Aires, Argentina
Pedro.Andrade@oracle .com MySQL Strategic Accounts ~ Latin America & CaribbeanManuel .Contreras@oracle .com MySQL Senior Consultant ~ Latin America & Caribbean
-
7/27/2019 Mysql Bigdata Otn
46/52
Copyright 2012, Oracle and/or
-
7/27/2019 Mysql Bigdata Otn
47/52
Big Data in Action
-
7/27/2019 Mysql Bigdata Otn
48/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
g
ACQUIRE
Acquire : Data is captured at sas part of ongoing operational p
Big Data in Action
-
7/27/2019 Mysql Bigdata Otn
49/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
g
ORGANIZE
Organize : Data is transferredvarious operational systems anconsolidated into a big data plaHadoop / HDFS (Hadoop DistrSystem).
Big Data in Action
-
7/27/2019 Mysql Bigdata Otn
50/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
g
ANALYZE
Analyze : Data stored in Hadoprocessed, either in batches by
jobs or interactively with technas the Apache Drill or Clouderinitiatives.
Hadoop may perform pre-proc
before being loaded into data wsystems.
Big Data in Action
-
7/27/2019 Mysql Bigdata Otn
51/52
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
g
DECIDEDecide : The results of the An
above are presented to users, enactions to be taken.
For example, the data maybe lointo the operational MySQL dasupporting a web site, enablingrecommendations to be made treporting MySQL databases usthe dashboards of BI (Businesstools.
MySQL Enterprise Edition
-
7/27/2019 Mysql Bigdata Otn
52/52
Comprehensive Suite of Management Tools