scaling lamp stacks

Scalable LAMP Stacks

Jakob HeuserAlan Kasindorf

OPSON Lamp Meetup Feb 2008

• Jakob Heuser - Gaia OnlineEngineer, Architect

• Alan Kasindorf - Six ApartDBA, Former head of Gaia’s Operations

Reality: Scale Out

What We Had

S S

LB

WWWWWWW W W W W W W

M read

write

S S

Mread

write

What We Had

it’s too easy to end up like this

S S

LB

WWWWWWW W W W W W W

M read

write

S S

Mread

write

BAD

BAD

BAD

LAMP

• Hardware

• Package Management

LAMP

• Not starting a religious war

• Commodity != Cheap

LAMP

• Automate

• Simplify

LAMP

• Avoid starvation

• It doesn’t have to be Apache (shhhh)

Amazingly even BIGGER DB

Even BIGGER DBBigger DBLAMP

This is BadDB

LAMP

ShardingUsers 1-99,999

Users 100,000-199,999

Users 200,000-299,999

Users 300,000-399,999

Users 400,000-499,999

Users 1-499,999

LAMP

ShardingUsers 1-99,999

Users 100,000-199,999

Users 200,000-299,999

Users 300,000-399,999

Users 400,000-499,999

Users 1-499,999

DB 1

DB 2

LAMP

ShardingUsers 1-99,999

Users 100,000-199,999

Users 200,000-299,999

Users 300,000-399,999

Users 400,000-499,999

Users 1-499,999

DB 1

DB 2

DB 3

LAMP

• Caching

• Replication

• Fuzz testing

LAMP

• Pick a framework

• Avoid DB Layers that depend on “join”

Outside the Stack

• OSS for anything

• Pay services too

?