![Page 1: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/1.jpg)
Free Software and the
Future of Database Technology
Josh BerkusPostgreSQL Core TeamNovember 14, 2008
![Page 2: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/2.jpg)
Who is Josh?● PostgreSQL Core Team
– a leader of 30,000 participant international community
● Free software advocate– Since 2000– OpenOffice, SuSE Linux, PostgreSQL, SPI, OSI ...
● Database Engineer & Application Developer– PostgreSQL, MySQL, Drizzle, MS SQL, Oracle
![Page 3: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/3.jpg)
Database Past
![Page 4: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/4.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
![Page 5: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/5.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
100% Proprietary Databases
![Page 6: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/6.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
100% Proprietary Databasesexcept ...
![Page 7: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/7.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
100% Proprietary Databasesexcept ...
Illustra
![Page 8: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/8.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
100% Proprietary Databasesexcept ...
Illustra POSTGRES
![Page 9: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/9.jpg)
1998
1. Oracle
2. Informix
3. Sybase
4. Microsoft SQL Server
5. IBM DB2
100% Proprietary Databasesexcept ...
Illustra POSTGRES?
![Page 10: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/10.jpg)
PostgreSQL: History
• 1986: POSTGRES at the University of California, Berkeley> Michael Stonebraker project> Successor to INGRES
• 1994: first commecialized> as Illustra (later merged into Informix)
• 1995: opensourced> Ported to SQL> PostgreSQL Global Development Group
formed
• 1997: ported to Japanese, supported in Japan
![Page 11: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/11.jpg)
MySQL: History
● MySQL Server development started in 1994, marketed by TCX DataKonsult AB
● MySQL AB founded in 1995 by Michael “Monty” Widenius, David Axmark and Allan Larsson
● Server development based on requirements for practical production use: few features, but fast and stable
● Frequent releases with small changes● Easy to install and use (15minute rule)
![Page 12: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/12.jpg)
2004
1. MySQL
2. Microsoft SQL Server
3. Oracle
4. IBM DB2
5. PostgreSQL
![Page 13: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/13.jpg)
2004
1. MySQL
2. Microsoft SQL Server
3. Oracle
4. IBM DB2
5. PostgreSQL
6. Sybase
![Page 14: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/14.jpg)
Database Present
![Page 15: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/15.jpg)
2008
1. MySQL
2. Microsoft SQL Server
3. Oracle
4. IBM DB2
5. PostgreSQL
6. Sybase
![Page 16: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/16.jpg)
Adoption Momentum
Source: Forrester 2006
![Page 17: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/17.jpg)
● Europe's largest online hotel booking site
– 20 million visitors a month– 30,000 listed hotels– 100% growth 2005 > 2006
● Built site using MySQL– Dozens of servers– Used Linuxbased DRBD replication for high
availability– Inexpensive support, licenses (about $50 000 per
year)
![Page 18: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/18.jpg)
● Runs .ORG, .INFO domains
– 3.8 million domain names– 100% transactional workload
● Built using PostgreSQL– custom replication solution for dozens of servers– free software, low cost let them win the .ORG
hosting bid
![Page 19: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/19.jpg)
Database Future
![Page 20: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/20.jpg)
2009
1. SQLite
2. MySQL
3. Microsoft SQL Server
4. Oracle
5. PostgreSQL
6. IBM DB2
![Page 21: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/21.jpg)
2009
1. SQLite
2. MySQL
3. Microsoft SQL Server
4. Oracle
5. PostgreSQL
6. IBM DB2
What?
![Page 22: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/22.jpg)
● Embedded SQL database
– Tiny memory footprint– Full SQL parser– Transactions, foreign keys
● Designed by Dr. Richard Hipp– In United Kingdom– Released under a public domain license– 100+ million installations
![Page 23: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/23.jpg)
![Page 24: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/24.jpg)
![Page 25: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/25.jpg)
Yahoo! Data Warehouse
StreamBase
Skytools
memcached
BerkeleyDB XML
ZopeDB
Kickfire
MySQL NDB
![Page 26: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/26.jpg)
Yahoo! Data Warehouse
StreamBase
Skytools
memcached
BerkeleyDB XML
ZopeDB
ScalableSpecialty
Embedded
StreamingBusiness Intelligence
Kickfire
MySQL NDB
![Page 27: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/27.jpg)
1998: Database server
![Page 28: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/28.jpg)
2008: Database servers
![Page 29: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/29.jpg)
2008: Database servers1. Large RAM2. Large Disk
3. Multicore CPU4. Solidstate drives5. Virtualization
![Page 30: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/30.jpg)
● Geographic Information Database
– stores spatial and positional data● points, lines, polygons
– based on PostgreSQL– power your own Google Maps!
● #1 open source solution– database for all OpenGeo tools– works with all GIS applications: MapServer, ESRI,
KaMap, deCarta● Being developed in Italy and Canada
![Page 31: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/31.jpg)
European Fisheries
PositionStatus
PositionsStatuses
PositionStatus
MapData
MapServer Interface
![Page 32: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/32.jpg)
European Fisheries
![Page 33: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/33.jpg)
Repertorio Nazionale dei Dati Territoriali
● Public service of Italy– operated by CNIPA– supply national map data for all Italian users– similar to USGS in United States– critical for developing Italian geo service industry
● All free software stack– PostGIS– Mapserver– KaMap
![Page 34: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/34.jpg)
2010: What is a database server?
![Page 35: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/35.jpg)
2010: What is a database server?
![Page 36: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/36.jpg)
"Cloud" Hosting
Largescale, managedanonymous hosting
![Page 37: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/37.jpg)
"Cloud" Hosting
● Large numbers of servers– rapid deployment of cloned virtual machines– rapid expansion of capacity
● Needs:– no perinstallation licensing fees– lowadministration databases– Free Software
![Page 38: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/38.jpg)
● "A Microkernel DBMS for High Performance
ScaleOut Applications"– designed for cloud hosting– small footprint, simple database, limited features– easy to administer in large numbers
● A fork of MySQL– developed by lead MySQL developers– not released yet
![Page 39: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/39.jpg)
PHP / Perl / Python / Ruby
memcached
![Page 40: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/40.jpg)
● A "web scale" clustered database– based on concept of Google's BigTable– designed to scale to 1000's of servers– like Memcached, but with persistence– uses Hadoop distributed filesystem
● Nonrelational– only stores keyvalue pairs– all operations are singlekey
● Currently alpha
![Page 41: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/41.jpg)
![Page 42: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/42.jpg)
![Page 43: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/43.jpg)
● #1 VoiceoverIP service
– 350 million users– 5 million SkypeOut calls per day– 6% of worldwide international calling
● SkyTools/PostgreSQL platform– PostgreSQL allowed them to build custom
clustering framework– 200 servers
● Expand capacity without licensing costs
![Page 44: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/44.jpg)
![Page 45: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/45.jpg)
Yahoo! Data Warehouse
StreamBase
Skytools
memcached
BerkeleyDB XML
ZopeDB
Kickfire
MySQL NDB
Free Software
Built with Free Software
![Page 46: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/46.jpg)
New 100% NonFree Databases
![Page 47: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/47.jpg)
"Building a new software is like scaling a mountian. Using open
source to build on means that I get to start 80% of the way to the top."
Julian Hyde, Chief Architect, SQLStream
![Page 48: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/48.jpg)
Where are we going?
● More diversity● More free software databases
– some free databases– some built on free software databases
● More innovation● More free software
![Page 49: Free Software and the Future of Database Technology](https://reader036.vdocuments.site/reader036/viewer/2022081602/54b596b04a79594d038b45cc/html5/thumbnails/49.jpg)
Questions?● Josh Berkus
– [email protected]● PostgreSQL project
– www.postgresql.org● Links
– EU Fisheries: http://fish.jrc.cec.eu.int/Booking.com: http://www.mysql.com/whymysql/scaleout/booking.htmlSkytools: https://developer.skype.com/SkypeGarage/DbProjects/SkyToolsPostGIS: http://postgis.refractions.net/ Drizzle: http://drizzleproject.org/Afilias: www.afilias.info Hypertable: http://hypertable.org/This talk is copyright 2008 Josh Berkus, and is licensed under the creative commons attribution license
All trademarks belong to their respective owners and are used according to principles of fair use here.Other uses of these trademarks must be authorized by the trademark owner.Josh Berkus speaks only for himself, and not for any of the companies or open source projectsreferenced herein.