presentation on bcs database products january 2011
DESCRIPTION
BCS products are designed to make databases more useful, efficient, and productive for "technologists" (i.e., scientists, engineers, medical researchers, health care administrators, defense and civilian technicians, university professors, financial services analysts, ...).TRANSCRIPT
![Page 1: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/1.jpg)
Databases, Files, and “Technologists”A Presentation to an Ocean Technology Workshop
Tuesday, January 11, 2011
Ian Barrodale
Barrodale Computing Services Ltd. (BCS)
Develops customized software for “technologists” (scientists, engineers, medical researchers, health care administrators, defense and civilian technicians, university professors, financial services analysts, etc.)
Has completed 450+ software projects in the past 33 years
Is going to market with plug-in products that significantly extend and enhance databases for complex and high volume data applications
![Page 2: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/2.jpg)
Why don’t more technologists use databases?
Based on a recent customer survey that BCS conducted with technologists, the main criticisms of DBMSs* were:
“Loading my files into a database is not a simple task.”
“Databases don’t have the features that I need.”
“Databases are slow and my files are large and complex.”
* DBMS = DataBase Management System
![Page 3: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/3.jpg)
A DBMS equipped with BCS extensions (plug-ins) can be faster and easier to use than writing code to organize, analyze and query multiple files
BCS DaL makes it simple to load technologists’ data files into a database
BCS Grid DataBlade easily meets the sophisticated requirements of meteorologists, atmospheric scientists, oceanographers, aviation authorities, military personnel, and others to ‘slice and dice’ 4D gridded datasets
BCS DBXten DataBlade column compression gives impressive performance improvements over the performance of the most recent versions of DBMSs using row compression
Still don’t want to load your files into a DBMS - but need to query them?
Then BCS UFI combined with a free DBMS might be just what you need!
See www.barrodale.com and/or contact [email protected]
BCS Database Solutions for Technologists
![Page 4: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/4.jpg)
DaL makes it easy to load technologists’ data filesinto a database
![Page 5: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/5.jpg)
Using your mouse, you can draw lines between graphic nodes that represent file contents and
database tables
![Page 6: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/6.jpg)
DaL also provides functions: currently, ID generators, table lookup functions, general SQL
expressions, and built-in functions
![Page 7: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/7.jpg)
Multidimensional gridded data arises in many technology applications, but DBMSs didn’t really accommodate grids – prior to the Grid DataBlade
10m,10m,-100m
40m,30m,-100m
40m,20m,-100m
45m,10m,-100m40m,10m,-100m20m,10m,-100m
40m,30m,-90m
40m,30m,-50m
(t1,s1,p1)
(t6,s6,p6)
(t3,s3,p3)
(t4,s4,p4) (t5,s5,p5)
(t2,s2,p2)
EASTING
NORTHING
`
DEPTH
10m 20m 5m` ` ` `` `
`
`
`
`
40m
10m
![Page 8: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/8.jpg)
Typical Navy environmental gridded datasets
• Humidity-Refractive Effects
• Air Temperature • Aerosols• Dust
• Trafficability
• Fog
• Soil Moisture• Beach Profile
• Waves• Reefs, Bars, Channels
• Sediment Transport
• Shelf /InternalWaves
• Swell / WaveRefraction
• Hydrography - Fine Scales
• Ice
• Biologics
• Slope (Sea Floor)
• Coastal Configuration
• Tidal Pulse
• Sensible andLatent Heat
• Wind Speed / Direction
• Land Cover
• Terrain
• Surf
• Turbidity
• Rain Rate
• Straits
• Island Flow
• Wind - Driven Circulation
• Wrecks
![Page 9: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/9.jpg)
Navy deployment of the Grid DataBlade
![Page 10: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/10.jpg)
Medical Application demo using the Grid DataBlade(http://www.barrodale.com/grid_Demo/GridBladeApplet.html)
![Page 11: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/11.jpg)
DBXten significantly improves DBMS performance whenever fast streams of complex data are involved
US Patent Application #11/779,791
![Page 12: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/12.jpg)
UFI allows users to index and query complex files without having to load them into a DBMS
• Life Sciences
• (BioHDF)
• Oceanographic
• (NetCDF)
• Your application?
• Your format?
![Page 13: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/13.jpg)
A depiction of how a complete solution might employ all four BCS products
Grid DataBlade Objects
Grid DataBlade Functions
DBXten Functions
DBXten Objects
Report 1
UFI
Report 2
DaL
DaL
Weather Forecast files
(GRIB2)
Ocean Forecast data
(table)
![Page 14: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/14.jpg)
Current BCS database plug-in products include:
the DBXten DataBlade - for fast and compact storage of large quantities of measurement/sensor data
the Grid DataBlade - for storing, resampling, and retrieving multi-dimensional gridded datasets (weather, ocean, atmosphere, oil & gas)
the Universal File Interface (UFI) - for indexing and querying files as if they were database tables
and, in addition,
Draw and Load (DaL) – a GUI-based tool for loading binary data files into database tables
The URLs for these products are:http://www.barrodale.com/bcs/dbxten
http://www.barrodale.com/bcs/bcs-grid-datablade
http://www.barrodale.com/bcs/universal-file-interface-ufi
http://www.barrodale.com/bcs/dal-draw-and-load
Summary: BCS Product List
![Page 15: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/15.jpg)
Summary: The Traditional (Non-Federated) Setup
Application
Web service FileData logger DBMS
Application
![Page 16: Presentation on BCS Database Products January 2011](https://reader036.vdocuments.site/reader036/viewer/2022062708/5588f2a2d8b42a246b8b4697/html5/thumbnails/16.jpg)
Summary: The New (Federated) Setup using a DBMS
Application
Web service
FileData logger
DBMS
Application
Web serviceUFI DBXten