Thriving in a cloud provider ecosystem with Varnish & upgrading from Varnish 3 to 4

Working with Varnish at-scale

Pinterest is a platform to Discover,

Save, and Do the things you love

2:50 PM 100%

2

50+ Billion Pins categorized by people into more than

1 Billion Boards 100M Active Users

3Confidential

4

Varnish in Numbers180k requests representing unique user

actions (non-cache)

5

Resilient DesignResilient systems, built on top of

unreliable cloud components

6

Scaling for UsersKeeping backend servers up-to-date for

varnish

7

Service DiscoveryServing configuration data at scale with

high availability

8

Varnish ServiceUnique service hooks, and inspecting the

varnish daemon

9

ReliabilityMonitoring, repairing and establishing a

development environment for varnish

10

Http AcceleratorsWorking with http headers and

understanding the varnish state diagram

TCP kernel tuning◊ net.core.somaxconn ◊ net.ipv4.tcp_max_syn_backlog ◊ net.core.netdev_max_backlog ◊ net.ipv4.ip_local_port_range ◊ net.ipv4.tcp_tw_reuse ◊ net.ipv4.tcp_tw_recycle

net.ipv4.tcp_orphan_retries ◊ net.ipv4.tcp_slow_start_after_idle

12

Varnish 4 UpgradesA few features to look forward to &

working with varnish packages

13

Upgrading VMODsVMODS must be compiled against the varnish version they will be run with.

14

VCL Syntax Updatesvarnish3to4 direct syntax updates and the

vmod_director addition

Pinterest believes having a team of dedicated, talented, authentic people working collectively to innovate and build enables us to

move fast.

Josh EndersKaran Gupta Jayme Cox

Jeremy Carrol Doc (Rogier Mulhuijzen - Fastly)

Thanks to Varnish-Cache for providing a place for us to come together as a community at the Varnish Summit.

With special thanks to Alexandra Lehner