mysql schema maintenance

MySQL schema maintenance

Giuseppe MaxiaMySQL Community Team Lead

This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License.

Thursday, 03 December 2009

about me - Giuseppe Maxia a.k.a. The Data Charmer MySQL Community Team Lead Long time MySQL hacker Formerly, database consultant, designer, coder. A passion for QA An even greater passion for open source ... and community Passionate blogger http://datacharmer.blogspot.com


http://datacharmer.blogspot.com

























Schema what?

In a relational database, the schema defines the tables, the fields in each table, and the relationships between fields and tables.

http://en.wikipedia.org/wiki/Schema_(database)


http://www.google.com/url?q=http://en.wikipedia.org/wiki/Schema_%28database%29&ei=UjAWS4_iJYimnQO-jZSFBw&sa=X&oi=define&ct=&cd=1&ved=0CBsQpAMoBQ&usg=AFQjCNEzKdrmsBucXKRid5pDsr3rvCVyPg

http://www.google.com/url?q=http://en.wikipedia.org/wiki/Schema_%28database%29&ei=UjAWS4_iJYimnQO-jZSFBw&sa=X&oi=define&ct=&cd=1&ved=0CBsQpAMoBQ&usg=AFQjCNEzKdrmsBucXKRid5pDsr3rvCVyPg

tables


tables

table nametable nametable name

column column column


tables

table nametable nametable name

column column column

CREATE TABLE employees ( ID INT NOT NULL, name VARCHAR(20), salary INT, PRIMARY KEY (ID))


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

departmentsdepartments

ID INT

name varchar (10)


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT


ID INT

name varchar (10)

1


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT


ID INT

name varchar (10)

1many


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

11


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

manymany

11


relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

manymany

11

many to many


Main actors

• Production

• Development

• Stage

• Test


Production database

• You must have one


Development database

• Where you create new thingsThursday, 03 December 2009

Test database

• Where you experiment crazy ideas


Stage database

• Where you test before deploying to production


Schema maintenance actions

• Reverse engineering

• Forward engineering

• Synchronization


Reverse Engineering


Reverse Engineering

DDLdept_empdept_empdept_emp

departmentdepartmentdepartment

dept_managerdept_managerdept_manager

employeesemployeesemployees

titlestitlestitles

salariessalariessalaries


Forward Engineering


Forward Engineering





titlestitlestitles



Forward Engineering





titlestitlestitles


WARNING!

Forward engineerin

g is destr

uctive.


Synchronization


How it works

Production

StageTest

Development

OK?

no

yes

OK?yes

no


How else it works

Production

StageTest

Development

• Partition adjustment

• Dynamic schemas

• Hot fixes


What happens in between

Test

Development

OK?

no



Test

Development

OK?

no What now?



Test

Development

OK?

no What now? Wrong schema here



Test

Development

OK?

no What now? Wrong schema here

REWIND?


Schema maintenance: how to

1. Poor man's wayThursday, 03 December 2009

How poor is the poor man?• only command line access• No Perl, PHP, or Python• Can't install anything

• Command line access• Perl or Python available• Can install modules

• Command line access• GUI• Can install everything





EXTREMELY

POOR





POOR

EXTREMELY

POOR





POOR

EXTREMELY

POOR

RICH


HOST 1

so, the extremely poor man's way ...

HOST 2

ProductionDevelopment


HOST 1


get the schema

TEXT FILE

HOST 2



HOST 1


get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE



HOST 1


get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE

diff



HOST 1


get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE

diff


then … uh … figure out how to continue


HOST 1

the poor man's way ...HOST 2


Perl Script

get the schema

TEXT FILE

get the schema

TEXT FILE

diff


HOST 1

the poor man's way ...HOST 2


Perl Script

get the schema

TEXT FILE

get the schema

TEXT FILE

diff

TELLS YOU WHAT TO DO


HOST 1

not so poor man's way ...HOST 2


Python Script

DOES A LOT OF THINGS

http://schemasync.org





HOST 1

not so poor man's way ...HOST 2


Python Script

DOES A LOT OF THINGS



WARNING: doesn't deal with partitionsThursday, 03 December 2009



The rich man

http://aquafold.com




The rich man

http://aquafold.com

WARNING: doesn't deal with partitionsThursday, 03 December 2009



MySQL Workbench

http://wb.mysql.com


http://wb.mysql.com

http://wb.mysql.com

Schema and model


Schema and model





titlestitlestitles



Physical schema

implemented in a specific DBMS


Physical schema





titlestitlestitles


implemented in a specific DBMS


Conceptual model

DBMS agnostic


MySQL Workbench basics


Creating tables (1)


Creating tables (2)


Creating tables (3)


Creating tables (4)


Creating tables (5)


database connections(1)


database connections(2)


Reverse engineering in the old world


Reverse engineering in the old world

show create table departments\G

Create Table: CREATE TABLE `departments`

(

`dept_id` int(10) unsigned NOT NULL,

`department` char(30) NOT NULL,

PRIMARY KEY (`dept_id`),

KEY `department` (`department`)

) ENGINE=InnoDB DEFAULT CHARSET=latin1

1 row in set (0.00 sec)


Reverse engineering (1)


forward engineering in the old world

mysqldump --host=development -B \

--no-data crosstab > crosstab.sql

mysql --host=stage < crosstab.sql


Forward engineering (1)


synchronization in the old world


Synchronization (1)


Synchronization (2)


Synchronization (3)


Synchronization (4)


Synchronization (5)


Synchronization (6)


More goodies

• MySQL Workbench 5.2 (Beta) - live demo


Thanks

Let's talk!


mysql schema maintenance

Technology

command line

mysql workbench

create table

extremely

python script

forward engineering

forward engineering

poor man