database systems
DESCRIPTION
Database Systems. Lecture #1. Staff. Instructor: Tova Milo http://www.cs.tau.ac.il/~milo Schreiber, Room 314, milo@cs Office hours: See web site TA: Yael Amsterdamer http://www.cs.tau.ac.il/~yaelamst Schreiber, Databases lab, M-20, yaelamst@post Office hours: See web site. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/1.jpg)
1
Database Systems
Lecture #1
![Page 2: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/2.jpg)
2
Staff• Instructor: Tova Milo
– http://www.cs.tau.ac.il/~milo– Schreiber, Room 314, milo@cs– Office hours: See web site
• TA: Yael Amsterdamer– http://www.cs.tau.ac.il/~yaelamst– Schreiber, Databases lab, M-20, yaelamst@post– Office hours: See web site
.tau.ac.il
.tau.ac.il
![Page 3: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/3.jpg)
3
Communications• Web page:
courses.cs.tau.ac.il/databases/databases201415
• Mailing list: [email protected]
![Page 4: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/4.jpg)
4
Textbook(s)
Main textbook (In the library)• Database Systems: The Complete Book, Hector
Garcia-Molina, Jeffrey Ullman, Jennifer Widom
Almost identical• A First Course in Database Systems, Jeff Ullman
and Jennifer Widom• Database Implementation, Hector Garcia-Molina,
Jeff Ullman and Jennifer Widom
![Page 5: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/5.jpg)
5
Other Texts• Database Management Systems, Ramakrishnan
– very comprehensive• Fundamentals of Database Systems, Elmasri, Navathe
– very widely used• Foundations of Databases, Abiteboul, Hull, Vianu
– Mostly theory of databases• Data on the Web, Abiteboul, Buneman, Suciu
– XML and other new/advanced stuff
![Page 6: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/6.jpg)
6
Other Readings
Reading from the Web:• SQL for Web Nerds, by Philip Greenspun,
http://philip.greenspun.com/sql/• Others, especially for MapReduce, PigLatin
![Page 7: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/7.jpg)
7
Outline for Today’s Lecture
• Overview of database systems– Recommended readings from SQL for Web
Nerds, by Philip Greenspun, Introductionhttp://philip.greenspun.com/sql/
• Course Outline• Structure of the course
![Page 8: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/8.jpg)
8
What Is a Relational Database Management System ?
Database Management System = DBMSRelational DBMS = RDBMS
• A collection of files that store the data
• A big C program written by someone else that accesses and updates those files for you
![Page 9: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/9.jpg)
9
Where are RDBMS used ?
• Backend for traditional “database” applications
• Backend for large Websites• Backend for Web services
![Page 10: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/10.jpg)
10
Example of a Traditional Database Application
Suppose we are building a system to store the information about:• students• courses• professors• who takes what, who teaches what
![Page 11: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/11.jpg)
11
Can we do it without a DBMS ?
Sure we can! Start by storing the data in files:
students.txt courses.txt professors.txt
Now write C or Java programs to implement specific tasks
![Page 12: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/12.jpg)
12
Doing it without a DBMS...
• Enroll “Mary Johnson” in “CSE444”:
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
Write a C program to do the following:
![Page 13: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/13.jpg)
13
Problems without an DBMS...• System crashes:
– What is the problem ?• Large data sets (say 50GB)
– What is the problem ?• Simultaneous access by many users
– Need locks: we know them from OS, but now data on disk; and is there any fun to re-implement them ?
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
CRASH !
![Page 14: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/14.jpg)
14
Enters a DMBS
Data files Applications
connection(ODBC, JDBC)
“Two tier database system”
Database server(someone else’s
C program)
![Page 15: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/15.jpg)
15
Functionality of a DBMSThe programmer sees SQL, which has two components:• Data Definition Language - DDL• Data Manipulation Language - DML
– query language
Behind the scenes the DBMS has:• Query engine• Query optimizer• Storage management• Transaction Management (concurrency, recovery)
![Page 16: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/16.jpg)
16
Functionality of a DBMS
Two things to remember:
• Client-server architecture– Slow, cumbersome connection– But good for the data
• It is just someone else’s C program– In the beginning we may be impressed by its speed– But later we discover that it can be frustratingly slow– We can do any particular task faster outside the DBMS– But the DBMS is general and convenient
![Page 17: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/17.jpg)
17
How the Programmer Sees the DBMS
• Start with DDL to create tables:
• Continue with DML to populate tables:
CREATE TABLE Students (Name CHAR(30)SSN CHAR(9) PRIMARY KEY NOT NULL,Category CHAR(20)
) . . .
INSERT INTO StudentsVALUES(‘Charles’, ‘123456789’, ‘undergraduate’). . . .
![Page 18: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/18.jpg)
18
How the Programmer Sees the DBMS
• Tables:
• Still implemented as files, but behind the scenes can be quite complex
SSN Name Category123-45-6789 Charles undergrad234-56-7890 Dan grad
… …
SSN CID123-45-6789 CSE444123-45-6789 CSE444234-56-7890 CSE142
…
Students: Takes:
CID Name Quarter CSE444 Databases fall CSE541 Operating systems winter
Courses:
“data independence” = separate logical view from physical implementation
![Page 19: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/19.jpg)
19
Transactions
• Enroll “Mary Johnson” in “CSE444”:BEGIN TRANSACTION;
INSERT INTO Takes SELECT Students.SSN, Courses.CID FROM Students, Courses WHERE Students.name = ‘Mary Johnson’ and Courses.name = ‘CSE444’
-- More updates here....
IF everything-went-OK THEN COMMIT;ELSE ROLLBACK
If system crashes, the transaction is still either committed or aborted
![Page 20: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/20.jpg)
20
Transactions
• A transaction = sequence of statements that either all succeed, or all fail
• Transactions have the ACID properties:A = atomicityC = consistencyI = isolationD = durability
![Page 21: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/21.jpg)
21
Queries
• Find all courses that “Mary” takes
• What happens behind the scene ?– Query processor figures out how to answer the
query efficiently.
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
![Page 22: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/22.jpg)
22
Queries, behind the scene
Imperative query execution plan:
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
Declarative SQL query
Students Takes
∏ c.name
σname=“Mary”
⋈cid=cid
Courses
The optimizer chooses the best execution plan for a query
⋈ssn=ssn
![Page 23: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/23.jpg)
23
Database Systems• The big commercial database vendors:
– Oracle– IBM (with DB2)– Microsoft (SQL Server)– Sybase (Advantage)
• Some free database systems :– PostgreSQL– MySQL– SQLite
• Here we use MySQL
![Page 24: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/24.jpg)
24
New(er) Trends in Databases• Object-relational databases• Main memory database systems• XML
– Relational databases with XML support– Middleware between XML and relational databases– Native XML database systems
• Data integration• Peer to peer, stream data management • Cloud, MapReduce, BigData
![Page 25: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/25.jpg)
25
Course Outline (may vary slightly)
Part I• SQL (Chapter 7)• The relational data model (Chapter 3)• Database design (Chapters 2, 3, 7)
Part II• Data storage, indexes (Chapters 11-13)• Query execution and optimization (Chapter 15,16)• Data integration
Part III (time permiting)• New stuff (Cloud and Crowd, MapReduce, PigLatin,…)
![Page 26: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/26.jpg)
26
Structure
• Prerequisites: Data structuresLogics (recommended)
• Work & Grading:– Homework: 15%. 2 exercises, some programming.– Project: 35%. to be explained– Final Exam: 50%.
![Page 27: Database Systems](https://reader035.vdocuments.site/reader035/viewer/2022062310/56816137550346895dd09496/html5/thumbnails/27.jpg)
27
So what is this course about, really?
• SQL:– An old language, but still widely used
• Theory!• Storage and optimizations• Implementation: hacking and thinking!
– You need to learn a lot as-you-go