database futures workshop
DESCRIPTION
Database Futures Workshop. Database Futures Workshop CERN 6.+7.6.2011 Michael Dahlinger, GSI [email protected]. Database Futures Workshop - 2. Beschleuniger: 2x Administration + Engeneering: 1x CERN Drupal: 1x noSQL : 5x CORAL, COOL, Frontier, HTTP caching: 2x. Alice: 2x (DCS, DAQ) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/1.jpg)
Database Futures Workshop
Database Futures WorkshopCERN 6.+7.6.2011
Michael Dahlinger, GSI
![Page 2: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/2.jpg)
Database Futures Workshop - 2
![Page 3: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/3.jpg)
Anwendungs-Bereiche
•Beschleuniger: 2x•Administration + Engeneering: 1x•CERN Drupal: 1x
•noSQL : 5x•CORAL, COOL, Frontier, HTTP caching: 2x
•Alice: 2x (DCS, DAQ)•CMS: 3x•LHCb: 1x•ATLAS: 3x
Ca. 80 Teilnehmer, meist aus CERN und CERN-Experimenten
Talks aus folgenden Bereichen:
![Page 4: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/4.jpg)
Beschleuniger
![Page 5: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/5.jpg)
![Page 6: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/6.jpg)
Beschleuniger
Controls: Relational, a lot of Oracle databases + featuresMission critical services: Controls Configuration Service (Oracle based) Based on Oracle ADF, 200
users, 12 editing applications. Reports (based on Oracle APEX), History Log Browser. APIs (Java, PL/SQL, C)
Accelerator Alarms (alarms DB). Short + long term storage. PL/SQL jobs. Pack long-long term (4-10 GB/a)
Settings:Mission critical, based on relational model , Oracle DBMSLogging:Oracle, filled by SCADA systems. 20 years of filtered data! 250000 signals, 250
GB/daySimple schema, many Oracle features, e.g. Oracle timestamp (nanosecond)Access only via APIs.
![Page 7: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/7.jpg)
![Page 8: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/8.jpg)
Administration + Engineering
GS: General services
AIS: Administrative Information Services
ASE: Access, Safety and Engineering tools
![Page 9: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/9.jpg)
![Page 10: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/10.jpg)
![Page 11: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/11.jpg)
![Page 12: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/12.jpg)
Drupal
• Ausgewähltes Web CMS, Drupal 6
![Page 13: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/13.jpg)
![Page 14: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/14.jpg)
Drupal
• Ausgewähltes Web CMS
• Database Abstraction Layer benutzen (trotz Möglichkeit direkten Datenbank Zugriffs auf MySQL)
• Nur 12 von 350000 sites benutzen Oracle
• -> MySQL ausgewählt
• MySQL database run by IT/DB ! Spezialfall
![Page 15: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/15.jpg)
Experimente
• CMS– Online Conditions Database (Oracle)– Offline Conditions Database (Oracle)
• ATLAS– All Oracle databases + COOL for many Online/offline databases– Remove hybrid database technologies (SQLite), all now in Oracle for
production dbs– Extensive Verwendung fortgeschrittener Oracle 11g features in
Entwicklung
• LHCb– Use of SQLite (1) and Oracle (many) and MySQL (Drupal, LFC)
• Alice– DCS (Detector Control System), Oracle– DAQ (Data acquisition) mySQL
![Page 16: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/16.jpg)
![Page 17: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/17.jpg)
![Page 18: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/18.jpg)
CMS Offline Summary
• The CMS Offline Condition DB plays a key role in the CMS database infrastructure.
• Focus of its design is the control of a potentially large set of access patterns into a single software supporting predefined use‐cases.
• The successful operation of the system relies on a set of key features that are provided by the IT DB service within the Oracle technology.
• No major change are expected in the system in the near future
06/06/11 Giacomo Govi
![Page 19: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/19.jpg)
![Page 20: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/20.jpg)
![Page 21: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/21.jpg)
![Page 22: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/22.jpg)
![Page 23: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/23.jpg)
CERN Datenbank Schnittstellen
• CERN IT + ATLAS, CMS, LHCb Software Entwicklungsprojekte:• COOL:
– LCG Conditions Database Project
– provides specific software components and tools for the handling of the time variation and versioning of the experiment conditions data.
• POOL:– Pool Of persistent Objects for LHC
– hybrid technology store for C++ objects, using a mixture of streaming and relational technologies to implement both object persistency and object metadata catalogs and collections. It provides generic components that can be used by the experiments to store both their event data and their conditions data.
![Page 24: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/24.jpg)
CERN Datenbank Schnittstellen
• CORAL: – COmmon Relational Abstraction Layer– is an abstraction layer with an SQL-free API to access data
stored using relational database technologies. It is used directly by experiment-specific applications and internally by both COOL and POOL.
• FRONTIER:– distributes data from central databases that are read by many
client systems around the world. The name comes from "N Tier" where N is any number and tiers are layers of locations of distribution. Based on HTTP technology.
– Limitations: Public Data only (no authorization), Subset of SQL (SELECT only)
![Page 25: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/25.jpg)
![Page 26: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/26.jpg)
NoSQL Datenbanken
• Interesse von CMS, ATLAS, PANDA (Job System)
• PANDA: Cassandra NoSQL DB
• ATLAS Distributed DataManagement System DQ2: MongoDB, Cassandra
• CMS: Hadoop, CouchDB,..
• IT Monitoring: Cassandra
![Page 27: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/27.jpg)
![Page 28: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/28.jpg)
![Page 29: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/29.jpg)
![Page 30: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/30.jpg)
Eigenschaften von NoSQL
• Bewegung, eine neue Art von Datenbanken voranzutreiben
• Keine Relationen zwischen Tabellen
• Clusterfähig (horizontal Skalierbar), hoher Durchsatz
• Keine Konsistenz, keine Transaktionen. Anwendung muss Konsitenz sichern.
• Schemalos, flexibel
• Effizient für genau definierte Abfragen, weniger für ad-hoc Queries
• Eher ein „verteilter strukturierter Speicher“
![Page 31: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/31.jpg)
NoSQL database cartooon
![Page 32: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/32.jpg)
![Page 33: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/33.jpg)
![Page 34: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/34.jpg)
![Page 35: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/35.jpg)
![Page 36: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/36.jpg)
![Page 37: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/37.jpg)
![Page 38: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/38.jpg)
![Page 39: Database Futures Workshop](https://reader036.vdocuments.site/reader036/viewer/2022062516/56812ae8550346895d8ece4f/html5/thumbnails/39.jpg)