distributed data management graeme kerr oracle in r&d programme
TRANSCRIPT
![Page 1: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/1.jpg)
<Insert Picture Here>
Distributed Data ManagementGraeme KerrOracle in R&D Programme
![Page 2: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/2.jpg)
Distributed Data Management
• Provides access to data when and where you need it• Optimizes information access regardless of physical
location of data.• Enables virtualisation of data in Grids.
• Types of Data:• Flat Files, Relational.• Structured & unstructured.• Text, Binary, proprietary.• Scalar, user defined typed, XML, RDF• Images, DICOM, LOB, Spatial.• High Volumes.
![Page 3: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/3.jpg)
Methods of Data Distribution
• Distribute• Federate• Consolidate
![Page 4: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/4.jpg)
Distribute Information
• Share information between users, applications, databases, organisations and partners. • Move or copy / replicate information as needed• Traditionally implemented as replication or message
queuing• Wide range of technology solutions to achieving distribution.• Continuous feed and periodic refresh capabilities are key
requirements.
• Common within Scientific Grid Approach• Works well when replicas are read-only.• Considerable issues when replicas are updateable.
![Page 5: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/5.jpg)
Data Distribution - Example
SOURCE SITE
REPLICA SITES
Continuous Feeds
![Page 6: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/6.jpg)
Data Distribution - Example
SOURCE SITE
REPLICA SITES
Continuous Feeds
Periodic Refresh
![Page 7: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/7.jpg)
Data Distribution - Example
SOURCE DATABASE
REPLICA DATABASES
Oracle STREAMS
Transportable Tablespaces,RMAN,
Data Pump
![Page 8: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/8.jpg)
CERN LCG Example
RAL
BNL
CNAFIN2P3
Gridka
ASGC
TRIUMPF
SARA
PIC
NorduGrid
Online DB @ Detector
Offline DB @ CERN IT
![Page 9: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/9.jpg)
Methods of Data Distribution
• Distribute• Federate• Consolidate
![Page 10: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/10.jpg)
Federate Information
• Federate data in multiple data stores into a single virtual database• Access both Database and non-Database data• Access both structured and unstructured data• Hide physical location of data from applications• Vendor and open-source solutions.
• Used mostly as point solution within Commercial World rather than as a key design point.
![Page 11: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/11.jpg)
Data Federation - Example
DB2Excel
WebServices
![Page 12: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/12.jpg)
Data Federation - Example
DB2
XML
ExcelFlatFilesText
WebServices
FlatFiles Sybase
![Page 13: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/13.jpg)
Data Federation - Example
DB2
XML
ExcelFlatFilesText
WebServices
FlatFiles Sybase
![Page 14: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/14.jpg)
Data Federation - Example
DB2
XML
ExcelFlatFilesText
WebServices
FlatFiles Sybase
![Page 15: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/15.jpg)
Methods of Data Distribution
• Distribute• Federate• Consolidate
![Page 16: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/16.jpg)
Consolidate Information
• Consolidate heterogeneous data into a central pool.• Single database or pool of databases• Any data (audio, video, XML, email, messages, etc…)• Any platform (Linux, Windows, Solaris, HPUX, AIX, Tru64,
OpenVMS, OS/390)• Proven scalability
• Hundreds of Very Large Database customers• Industry leading benchmarks
• Very common in commercial world.
![Page 17: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/17.jpg)
Typical Data Centre View
DB Clusters
Disk
DB Users
![Page 18: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/18.jpg)
Consolidated Clusters with RAC & ASM
DB Cluster
Pool
Disk Pool
DB Users
![Page 19: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/19.jpg)
DB Server & Disk Virtualisation
DB Cluster
Pool
Disk Pool
DB Users
![Page 20: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/20.jpg)
DB Server & Disk Virtualisation
DB Cluster
Pool
Disk Pool
DB Users
![Page 21: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/21.jpg)
DB Server & Disk Virtualisation
DB Cluster
Pool
Disk Pool
DB Users
![Page 22: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/22.jpg)
Distributed Data Management : Summary
• Oracle supports efficient utilization of all resources:• Consolidate Information—Scalable access to large amounts
of information• Federate Information—Data can be located where needed
but accessed as single database• Share Information—Multiple users and applications can share
data/information to operate more effectively
• Information Integration & fast connectivity critical to Grid Computing
![Page 23: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/23.jpg)
Oracle Database Versions.
• Database 10G Express Edition• Entry-Level, small footprint, free to develop, deploy & distribute.• 32 Bit Windows, RHEL3 & 4, FC 4, SLES9, Debian 3.1, Ubuntu & Mandriva
• Database 10G Enterprise Edition• Flagship, Full-featured version.
• Database 10G Standard Edition• Limited featured version, RAC, ASM, Streams Apply supported
• Database 10G Standard Edition 1• SE on limited hardware. Streams Apply supported.
• Data Grid / Distributed Caching• TimesTen • TangoSol Coherence
![Page 24: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/24.jpg)
Oracle Database Versions.
• Database 10G Express Edition• Entry-Level, small footprint, free to develop, deploy & distribute.• 32 Bit Windows, RHEL3 & 4, FC 4, SLES9, Debian 3.1, Ubuntu &
Mandriva
• Database 10G Enterprise Edition• Flagship, Full-featured version.
• Database 10G Standard Edition• Limited featured version, RAC, ASM, Streams Apply supported
• Database 10G Standard Edition 1• SE on limited hardware. Streams Apply supported.
• Data Grid / Distributed Caching• TimesTen • TangoSol Coherence
![Page 25: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/25.jpg)
For More Information
Database: www.oracle.com/database/index.html
Express Edition: www.oracle.com/technology/products/database/xe/index.html
Tangosol: www.oracle.com/tangosol/index.html
Times 10: www.oracle.com/database/timesten.html
or
http://search.oracle.com
Database | Tangosol | etc
![Page 27: Distributed Data Management Graeme Kerr Oracle in R&D Programme](https://reader035.vdocuments.site/reader035/viewer/2022070412/56649f415503460f94c60b29/html5/thumbnails/27.jpg)