RabbitMQ at Skills Ma-er Cloud Exchange. Cloud Messaging Use Cases

Transcription

1 RabbitMQ at Skills Ma-er Cloud Exchange Cloud Messaging Use Cases April 2010 Alexis Richardson VMware Inc.

2 Thank you! RabbitMQ is a messaging server that just works Im in yr serverz, queueing yr messagez Photo credit:

3 We es7mate or more in produc7on, >20K in dev

4 Using RabbitMQ is easy RabbitMQ integrated with more than 100 developer plaforms Rabbit distributed by most Linux type plaforms RabbitMQ.NET and MicrosoO IVA partnership We offer packages for many other OS plaforms

5 Using RabbitMQ is easy RabbitMQ integrated with more than 100 developer plaforms Rabbit distributed by most Linux type plaforms RabbitMQ.NET and MicrosoO IVA partnership We offer packages for many other OS plaforms Cloud messaging is the future 45 5

6 Cloud has re energised IT

7 Cloud maiers because we operate at real 7me on a global scale Mobile, video, presence, live streams - anywhere, anytime How to deliver this without lock-in to any one platform or location? Massive amounts of data everywhere and changing all the time Security, privacy, consistency of customer experience eg latency, relevance Cloud Messaging matters!

8

9 9

10 Cloud + Queues makes it easy to manage an ARMY of worker bots

11 We also care about SCALE...

12 We also care about SCALE... when we cannot predict demand

13 Cloud applica7ons are component based and need intra app messaging to scale See more here:

14 Inter cloud applica7ons use inter applica7on messaging to route and deliver data West Europe data centre NE Europe data centre Southern Europe data centre!

15 Inter cloud secure network overlay uses RabbitMQ under the covers See

16 PUBSUB at massive scale: TwiIer for Data in the Cloud Service.DomainName Region Virtual IP Cloud IPs DMAC See:

17 Pubsub? wz?

18 At scale, coping with changing data can be a problem

19 Social applica7ons store data 19

20 Social applica7ons store data And thereʼs terabytes of it 20

21 Social applica7ons store data And thereʼs terabytes of it And itʼs in the cloud 21

22 Tell me when THIS changes

23 Pubsub wins because Polling Sucks... Are we there yet?, Are we there yet?,.. Pubsubhubbub provides web pubsub Pubsub Hubs are Cloud Messaging Technology Check out RabbitHub on github for more info/code Check out the Google teamʼs video at

24 Monitoring done wrong

25 Monitoring done right

26 Monitoring done right See: Ben Hyde s post at

27 Monitoring done right 27

28 Monitoring done right Lots more event processing goodness here: 28

29 Pubsub gets you Monitoring and if you add Queues you get Logging 29

30 Recording informa7on is of fundamental human value

31 So what is messaging? messaging is data in moson and it is really important and the move to cloud compusng will put messaging everywhere Messages Pubsub Queues Log Storage

32 There are LOTS of cloud messaging technologies! SMTP, HTTP, XMPP, AMQP AMQP, HTTP PSHB, XMPP AMQP, (XMPP) AMQP, NoSQL, SQL Messages Pubsub Queues Log Storage , Chat, Comet, BOSH,.. SMS, Twitter,.. Trading, Cash transfer Routing, transforming, alerting eg SNS, ESBs and Esper CEP Buffering, caching, filtering eg SQS, Redis Archiving + search eg Riak, Cassandra

33 Thank you!... and RabbitMQ s goal is to make all of this really simple , Chat, Comet, BOSH,.. SMTP, HTTP, XMPP, AMQP AMQP, HTTP PSHB, XMPP AMQP, (XMPP) Messages Pubsub Queues SMS, Twitter,.. Trading, Cash transfer Routing, transforming, alerting eg SNS, ESBs and Esper CEP Buffering, caching, filtering eg SQS, Redis AMQP, NoSQL, SQL Im in yr serverz, Log Storage queueing yr messagez Archiving + search eg Riak, Cassandra Photo credit:

34 RabbitMQ Towards a PLATFORM for Cloud Messaging

35 If cloud requires a Cloud OS, then is messaging the Cloud Bus?

36 For Infra, yes. Many clouds, eg NASA Nebula, have a RabbitMQ cloud bus: Use cases: Inter VM chaier And lots of Management: Request capacity Start 100 VMs. Shut them down. I am overloaded Find me who am I? Move me Back me up Scale back capacity

37 That s great but we also need a PLATFORM if we are to deploy and run apps SaaS cloud applications PaaS eg RabbitMQ on Heroku IaaS eg Rabbit at NASA

38 PlaZorm as a service example: Heroku! SaaS cloud applications PaaS eg RabbitMQ on Heroku IaaS eg Rabbit at NASA

39 Conceptually: a plazorm represents freedom from complexity App App App IaaS infra is hidden Scalable cloud bus run as many as you like (Rabbit is open source and can run on any cloud as its central nervous system )

40 Pubsub is made simple like apps twee7ng at each other! App App App hey hey hey

41 Queues are easy too App App App hey hey

42 Queues are easy too App App App App hey

43 By being 100% open we can also do intercloud just as simply! Intra-App Intra-Cloud Inter-Cloud Rabbit Cloud Rabbit Cloud Rabbit Cross-cloud PaaS Service Service Services Rabbit inside the RabbitMQ as infra: Federated IaaS Cloud VM Cloud Bus RabbitMQ

44 To bridge private and public clouds, open source and open standards are best SAY NO TO CLOUD LOCK IN 44 (CC)

45 Summary clouds break the link between applica7on and loca7on Can t predict where apps and VMs are running Can t predict scale Design for DATA IN MOTION In motion VMs need PUBSUB and ROUTING like with cell phones VMs suspended or offline need QUEUES Messaging lets you dial up VMs and broadcast changes safely

46 Solu7on RabbitMQ is the open cloud messaging plazorm Fantastic community support for messaging intra app Language neutral open protocols for messaging inter app Federation - bridge private and public intercloud Cloud Bus for IaaS Messaging PaaS

47 Solu7on RabbitMQ as an open cloud messaging plazorm We ll manage messaging for you Scalable, easy to use Completely portable - no lock in Pre-provisoned - zero install, pay as you go, self-service Latency is low: Application logic and data are CO-LOCATED WIN

48 Rich Wolski, CTO and Founder, Eucalyptus pre-y much everything you own is going to be trying to send you data Stefan Norberg, Chief Architect, Unibet If you remove the need to invest in infrastructure, the need to train people on the operasonal aspects and then get excellent scalability and low latency guaranteed by contract, I d buy it in a second. Who will provide me with the Real Time Web as a service?

49 Thank you Get started: h-p://