introduction to rabbitmq | meetup at pivotal labs

Introduction to RabbitMQ Alvaro Videla - Pivotal / RabbitMQ

Friday, September 13, 13

Alvaro Videla

• Developer Advocate at Pivotal / RabbitMQ

• Co-Author of RabbitMQ in Action

• Creator of the RabbitMQ Simulator

• Blogs about RabbitMQ Internals: http://videlalvaro.github.io/internals.html

• @old_sound | [email protected]/videlalvaro


http://videlalvaro.github.io/internals.html

http://videlalvaro.github.io/internals.html

About Me

Co-authored

RabbitMQ in Action

http://bit.ly/rabbitmq




Why do we need messaging?


Classic Web Apps


Implement a Photo Gallery


Two Parts:


Pretty Simple


‘Till new requirements arrive


The Product Owner


Can we also notify the user friends when she uploads a new

image?


Can we also notify the user friends when she uploads a new

image?

I forgot to mention we need it for tomorrow…


The Social Media Guru


We need to give badges to users for each picture upload


We need to give badges to users for each picture upload

and post uploads to Twitter


The Sysadmin


Dumb! You’re delivering full size images!

The bandwidth bill has tripled!


Dumb! You’re delivering full size images!

The bandwidth bill has tripled!

We need this fixed for yesterday!


The Developer in the other team


I need to call your Java stuff but from Python


I need to call your Java stuff but from Python

And also PHP starting next week


The User


I don’t want to waittill your app resizes

my image!


You


(╯°□°）╯（ ┻━┻


Let’s see the code evolution


%% image_controllerhandle('PUT', "/user/image", ReqData) -> image_handler:do_upload(ReqData:get_file()), ok.

Pseudo Code

Comments



Pseudo Code

Function Name



Pseudo Code

Arguments



Pseudo Code

Function Body



Pseudo Code

Return Value



First Implementation:


%% image_controllerhandle('PUT', "/user/image", ReqData) -> {ok, Image} = image_handler:do_upload(ReqData:get_file()), resize_image(Image),

ok.

Second Implementation:



notify_friends(ReqData:get_user()),ok.

Third Implementation:



notify_friends(ReqData:get_user()),add_points_to_user(ReqData:get_user()),ok.

Fourth Implementation:



notify_friends(ReqData:get_user()),add_points_to_user(ReqData:get_user()),tweet_new_image(User, Image),ok.

Final Implementation:


Can our code scale to new requirements?


What if


• We need to speed up image conversion

What if


• We need to speed up image conversion• User notifications sent by email

What if


• We need to speed up image conversion• User notifications sent by email• Stop tweeting about new images

What if


• We need to speed up image conversion• User notifications sent by email• Stop tweeting about new images• Resize in different formats

What if


• We need to speed up image conversion• User notifications sent by email• Stop tweeting about new images• Resize in different formats• Swap Language / Technology (No Down Time)

What if


Can we do better?


Sure.Using messaging


DesignPublish / Subscribe Pattern


%% image_controllerhandle('PUT', "/user/image", ReqData) -> {ok, Image} = image_handler:do_upload(ReqData:get_file()),

Msg = #msg{user = ReqData:get_user(), image = Image},publish_message('new_image', Msg).






%% friends notifieron('new_image', Msg) ->

notify_friends(Msg.user, Msg.image).







%% points manageron('new_image', Msg) ->

add_points(Msg.user, 'new_image').







%% points manageron('new_image', Msg) ->

add_points(Msg.user, 'new_image').

%% resizeron('new_image', Msg) ->

resize_image(Msg.image).



THIS PAGE INTENTIONALLY LEFT BLANK


What is RabbitMQ


RabbitMQ


RabbitMQ

• Multi Protocol Messaging Server


RabbitMQ

• Multi Protocol Messaging Server• Open Source (MPL)


RabbitMQ

• Multi Protocol Messaging Server• Open Source (MPL)• Polyglot


RabbitMQ

• Multi Protocol Messaging Server• Open Source (MPL)• Polyglot• Written in Erlang/OTP


Multi Protocol

http://bit.ly/rmq-protocols


http://blogs.vmware.com/vfabric/2013/02/choosing-your-messaging-protocol-amqp-mqtt-or-stomp.html

http://blogs.vmware.com/vfabric/2013/02/choosing-your-messaging-protocol-amqp-mqtt-or-stomp.html

Polyglot


Polyglot

• Java


Polyglot

• Java• node.js


Polyglot

• Java• node.js• Erlang


Polyglot

• Java• node.js• Erlang• PHP


Polyglot

• Java• node.js• Erlang• PHP• Ruby


Polyglot

• Java• node.js• Erlang• PHP• Ruby• .Net


Polyglot

• Java• node.js• Erlang• PHP• Ruby• .Net• Haskell


Polyglot

Even COBOL!!!11


Some users of RabbitMQ



• Instagram



• Instagram

• Indeed.com



• Instagram

• Indeed.com

• MailboxApp



• Instagram

• Indeed.com

• MailboxApp

• Mercado Libre


Messaging with RabbitMQ

A demo with the RabbitMQ Simulator

https://github.com/RabbitMQSimulator/RabbitMQSimulator




Thanks

Alvaro Videla - @old_sound


introduction to rabbitmq | meetup at pivotal labs

Technology

reqdata image

controller handleput

user friends

new images

new requirements

pseudo code comments

pseudo code arguments

pseudo code returnvalue