Clouds, Performance Platforms, and Agility Mark Stuart Day Riverbed Technology

Transcription

1 Clouds, Performance Platforms, and Agility Mark Stuart Day Riverbed Technology

2 Some hot questions 2 Will all IT migrate to the cloud? Will cloud services eliminate all concerns about performance and scale? Is the cloud some kind of IT nirvana?

3 Let s not go to the opposite extreme 3 Can I ignore the cloud? Is it all a bunch of hype?

4 Warning 4 It is very easy for two people saying cloud to talk past each other Lots of different problems and solutions lumped together Easy to spend a whole talk just working out taxonomies

5 Agenda 5 Fluff Vision Clouds High Medium Performance Platforms Low Low Agility Low High 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

6 CLOUDS

7 7 $19.8 B $59.3 B 7

8 Enterprises Moving to Public Cloud 8 8

9

10 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 10

11 Problems 11 Too much data The mountain is big Not enough bandwidth The paths are narrow Too far away The paths are long 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

12 Hamina, Finland? Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

13 History: Consolidation / virtualization 13 F M Data Center WAN Branch Offices 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

14 Serverless Branches: Great! 14 F M F Data Center M WAN Branch Offices 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

15 New problem: Application performance 15 F M F Data Center M WAN Branch Offices 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

16 Solution: WAN Acceleration 16 F M F Data Center M WAN Accel WAN WAN Accel WAN Accel WAN Accel WAN Accel Branch Offices 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

17 Why does this matter to you? 17 F M F M Data Center in Hanmina, Finland WAN Branch Offices 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

18 Observations 18 It s cheaper to move photons than electrons so data centers will continue to be sited in weird places with cheap electricity People still get value from being near other people in attractive places (e.g. metro Boston) so are unlikely to relocate en masse to the data center locations Conclusion: in the cloud era pretty much everyone is a remote user 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

19 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 19

20 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 20

21 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 21

22 Solution #1: Deduplication 22 In flight: reduce bandwidth demands, time to transmit At rest: reduce storage required Note: tricky to reconcile with indexing and search 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

23 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 23

24 Solution #2: Chattiness reduction 24 The fastest round trip is one you don t take Protocol rearrangement Prefetching Caching Opportunities at transport level work across many apps Opportunities at per-app layer sometimes give dramatic results 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

25 How is this realized today? 25 Riverbed Steelhead WAN optimization Speedup & bandwidth reduction across broad spectrum of enterprise traffic» Appliances and virtual appliances for branches» Appliances for data centers and private clouds» Software clients for Windows, Mac» Integrated into Amazon cloud Riverbed Whitewater cloud gateway Deduplication, encryption, fast recovery for backup data in public clouds» Appliances and virtual appliances for data centers» Amazon, AT&T, Nirvanix clouds 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

26 PERFORMANCE PLATFORMS

27 Agenda 27 Fluff Vision Clouds High Medium Performance Platforms Low Low Agility Low High

28 Lessons learned: General clouds and enterprise IT 28 Common cloud use cases: Web 2.0 (designed for cloud) Very-large scale public-facing websites Scientific computations (big compute and/or big data) Dev/test Enterprise IT usage is real but not typically captured above Where we see cloud usage: Hosted Exchange Hosted SharePoint General server consolidation/migration Backup to cloud storage 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

29 WAN acceleration perspective: Cloud = WAN 29 Many issues around cloud are really data center concerns Network performance issues are familiar Main change: data center appliances virtual appliances So where does the complexity of the cloud lie?

30 A concrete example: Cloud A 30 Offers SharePoint and Exchange (among others) Popular among large enterprises Already supports Riverbed-based WAN optimization In use by F100 pharma, F100 financial services, others Interesting problems Trust relationships are workable but nontrivial» Encryption is not a solution just shifts to a new problem of trusted key sharing» What is the right trust relationship between a public cloud and a corporate domain? Business and technology solutions are easier in dedicated environments» Shared facility but nonshared equipment» Well-established mechanisms for inserting network gear of various kinds» Not the favored arrangement of the cloud provider going forward

31 Another concrete example: Cloud B 31 Focuses on compute & storage no Exchange service or SharePoint service No dedicated infrastructure at all (!) Does support virtual private infrastructure Thus no possibility for using physical appliances Virtual appliance version is natural fit Cloud provider need not be aware of WAN optimization Virtual appliance can be loaded in as just another server Already in use for demos and small-scale proofs of concept For full cloud experience, virtual appliance is necessary but not sufficient With cloud provider cooperation, can provide better integration Seamless checkbox experience for enabling WAN optimization

32 Performance Platform 32 Applications Performance Platform (Infrastructure Middleware) Network Plumbing

33 Performance Platform 33 Large-scale (whole-network, flows) 2-ended (symmetric) Visibility Performance Platform Control Fine-grained (Packets, fields) 1-ended (asymmetric)

34 Autodiscovery and TCP proxying per connection 34 Logical (client/server) connection LAN WAN LAN Steelhead WAN Steelhead Office/Users Data Center/Cloud

35 Data Streamlining Overcomes Bandwidth Limitations 35 Files & Data Data Request Reconstructed Files & Data WAN DATA CENTER BRANCH OFFICE Requests go directly from the client to the server Steelhead auto-intercepts response, and segments data De-dupes data so only new bytes compressed & sent over the WAN 16-Byte references represent megabytes of warm data Remote Steelhead reconstructs data and delivers it to the client Works bi-directionally, cross-protocol and across applications

36 Transport Streamlining Overcomes TCP Limitations 36 The net effect is a 60-98% reduction in TCP round trips WAN DATA CENTER BRANCH OFFICE Make TCP window bigger Data 16KB Repack window to with references 100KB+ From 100KB+ to Virtual 1MB+ References New data

37 Application Streamlining Overcomes Application Protocol Limitations 37 Request Optimized WAN Transfer WAN DATA CENTER BRANCH OFFICE Steelhead completes transaction locally Steelhead completes transaction locally The net effect is 65-98% reduction in WAN round trips

38 Some of our application-protocol knowledge 38 CIFS (Microsoft Windows) Including with SMB signing Including for Mac clients MAPI (MS Outlook/Exchange) Including encrypted MAPI Including all major variants Lotus Notes Including port encryption HTTP HTTPS FTP And other protocols on SSL EMC SRDF/A FCIP Citrix ICA Including compression Including encryption NFS v3 Microsoft SharePoint Oracle Forms All network variants Microsoft SQL Server

39 Performance Platform 39 Large-scale (whole-network, flows) 2-ended (symmetric) Visibility Performance Platform Control Fine-grained (Packets, fields) 1-ended (asymmetric)

40 Cascade supports all common flow types 40 J-Flow Enhanced NetFlow NetFlow IPFIX sflow Packeteer FDR NetFlow NetStream Cascade Gateway

41 41 Flow de-duplication, preserving interface detail Flow record 1 Flow record 2 Exporter Address IP Source / Dest Protocol TCP TCP Source / Dest Bytes / Packets 34,778 / 29 Interfaces 1 2 Exporter Address IP Source / Dest Protocol TCP TCP Source / Dest Bytes / Packets 38,221 / 33 Interfaces 4 6 Application SSH De-duplicated flow record IP Source / Dest Protocol TCP TCP Source / Dest Application SSH Exporter Address Interfaces 1 2 Bytes / Packets 34,778 / 29 Exporter Address Interfaces 4 6 Bytes / Packets 38,221 / 33 Increased density of visibility Accurate byte / packet count End-to-end visibility for a flow Shared knowledge

42 42 Behavior Analysis Web Tier App Tier DNS AD NTP DB Tier Meaningful change

43 End-to-End dependency mapping 43

44 Unified data records combining Flow, Probe, User 44 Example: problem related to high WAN utilization Let s find the application Let s find the server Which user is responsible? We found it s John Smith

45 AGILITY

46 Agenda 46 Fluff Vision Clouds High Medium Performance Platforms Low Low Agility Low High 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion.

47 WAN issues everywhere! 47 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

48 Typical WAN-optimization solutions 48 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

49 New solution 1: Branch Office Box / Cloud Gateway 49 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

50 New solution 2: Mobile Cloud Gateway 50 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

51 New solution 3: Virtual Appliance 51 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

52 New solution 4: Integrated Cloud Optimization 52 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

53 New solution 5: Cloud Storage Gateway 53 Compute cloud Storage cloud Branch Mobile Data center Backup/secondary Data center

54 New solution 6: Virtual Edge 54 Compute cloud Storage cloud Branch VE Mobile Data center VE Backup/secondary Data center VE

55 Summary of cloudy optimization scenarios 55 BOB/Gateway features support primary data centers, secondary data centers, and clouds in any combination Flexibility in speed/intensity of cloud adoption More power & manageability for in-branch consolidation Virtual appliance and cloud-integrated approach support WAN optimization where appliances can t go First is classic perpetual-use box without hardware usable everywhere Second is pay-as-you-go, integrated with provider Cloud Storage Gateway is storage-focused, not application-focused Dedupe and simple interface for backup to storage clouds Virtual Edge gives effect of local storage despite intervening WAN WAN optimization for block storage Allows consolidation of previously-impossible servers

56 2009 Riverbed Technology. Confidential. IMPORTANT NOTE: The roadmap is for information purposes only and is not a commitment, promise or legal obligation to deliver any new products, features or functionality. The development, release, and timing of any features or functionality described remains at Riverbed's sole discretion. 56