What’s behind facebook

A Jen

outline

• font-end

o HipHop

o BigPipe

• back-end

o Thrift

o Scribe

o Tornado

• data persistence

• other

font-end Linux & Apache

PHP + HipHop

BigPipe

HipHop • PHP complier developed by Facebook.

• Convert PHP code to C ++.

• Compiled by gcc.

• CPU usage recudes 50%.

• Git Hub

BigPipe • It’s a fundamental redesign of the dynamic web.

page serving system.

• Decomposing web pages into 「pagelets」.

• Implemented by ONLY PHP + JavaScript!

• Link

back-end Thrift

Scribe

Tornado

Thrift • Cross-language services development.

• Code generation engine.

• Sample Code

definition file thrift complier source code

Scribe • Distributed Loggin System.

• git hub

Tornado • Web Server written by python.

• For real-time web services

• non-blocking web service.

• git hub

• show case

• link

data persistence MySQL

Hive + Hadoop + Hbase + HDFS Memcache

Haystack

MySQL • It’s still backbon of database infra.

• How ? o Learn more : link

o facebook patches

Hive + hadoop + Hbase + HDFS

Hive

hadoop

Hbase

HDFS

Memcache • Distributed memory object caching system

• MySQL Cache

• General purpose cache

• Link

Haystack • Efficient storage of billions of photos.

• Reducing Disk I/O.

• Components o Haystack Diretory

o Haystack Store

o Haystack Cache

• Link

Other • Chat

o Epoll Server using Erlang

o Accessed using thrift

• Message Search o Inverted index stored in HBase

Thank you A Jen