Erlang, Open Networking, and the Future of Computing. Stu Bailey, Founder/CTO

Size: px

Start display at page:

Download "Erlang, Open Networking, and the Future of Computing. Stu Bailey, Founder/CTO"

Eugenia Simon
8 years ago
Views:

1 Erlang, Open Networking, and the Future of Computing Stu Bailey, Founder/CTO

4 How Can We Program a Million Cores?

5 And We Must Assume Hardware is Failing (or changing) ALL the Time: Write Once, Run Forever

8 Traditional Model Kernel Bypass Model Application Application User Kernel Sockets Layer User Kernel Sockets Layer RDMA Of Course TCP/IP Transport TCP/IP Transport Infiniband! Driver Driver Except! Hardware Hardware

Sockets Layer RDMA Of Course TCP/IP Transport TCP/IP

11 A STANDARD Forwarding Plane and Logically Centralized Control Plane Control Plane eg: OpenFlow OF Forwarding Plane Vendor B OF Forwarding Plane Vendor C OF Forwarding Plane Vendor D Capabilities across forwarding plane vendors are fairly uniform Performance and capacity are primary differentiators Infoblox Inc. All Rights Reserved.

Plane Vendor D Capabilities across forwarding plane vendors are fairly uniform

13 Full SDN Stack Timeline FlowForwarding Community + alpha LINC Switch code availability LINC Switch beta v2.x LINCX Switch v LINC Switch beta v1.0 Loom Control Plane + Tapestry PoC Loom Scalable SDN Control Plane Infoblox Inc. All Rights Reserved.

15 Erlang/OTP = SDN + Big Data + IoT Applications Configuration Protocol Netconf Loom Loom LS LS LS LINC: OpenFlow LINCX on Capable LING/XEN Switch On BEAM/Linux Control Plane & Configuration Point Data Path Element Network White Boxes (Hardware) Infoblox Inc. All Rights Reserved.

Switch On BEAM/Linux Control Plane & Configuration Point Data Path

16 LINC Switch Architecture OpenFlow Configuration Points OpenFlow Controllers OpenFlow Protocol OpenFlow Controllers OpenFlow Protocol OF-Config Secure Channel Group Table Secure Channel Group Table Flow Table Flow Table Flow Table Flow Table Pipeline Pipeline OpenFlow Logical Switch OpenFlow Logical Switch OpenFlow Resource OpenFlow Resource OpenFlow Resource OpenFlow Resource OpenFlow Operational Context OpenFlow Capable Switch Infoblox Inc. All Rights Reserved.

Flow Table Pipeline Pipeline OpenFlow Logical Switch OpenFlow Logical Switch OpenFlow Resource OpenFlow Resource

17 Erlang Implementation Architecture OpenFlow Configuration Point OpenFlow Controller OF-Config OpenFlow Protocol of_configl of_protocol of_cfg_channel of_channel of_cswitch of_switch Erlang VM API kernel module Infoblox Inc. All Rights Reserved.

of_configl of_protocol of_cfg_channel of_channel of_cswitch

21 Future Started Multicore December 9, 2013! A switch per port? Per two ports? Faster software bridges! Replace generic Linux bridges with faster alternative PCI passthrough! Eliminate Linux completely from the packet path Infoblox Inc. All Rights Reserved.

22 The State of the Art!is Not Data Platforms Distributed Data Intensive Applications (e.g. Hadoop, Apache Spark, Sensor Nets) Manual System Abstractions OS (e.g. Linux), Abstract Machines (e.g. JVM), Languages (e.g. Ruby), Clustering Frameworks (e.g. OpenStack), Databases/FileSystems (e.g. MongoDB, HDFS), HDN++ Fundamental Abstractions Increasingly Ubiquitous Hardware Ethernet Frame Network Processors (Broadcomm, Qualcomm) Virtual Machine Microprocessors (x86, ARM) Cloud Private Cloud Embedded Systems Infoblox Inc. All Rights Reserved.

23 The Right Perspective!and Perfect Timing

24 The Right Perspective!and Perfect Timing The network IS the computer John Gage (1984)

25 We Need a Better Distributed System! Value Specific Distributed Apps Scalable Analytic Library Scalable System Abstractions (Data Intensive Distributed Control Plane) SDN + Distributed GraphDB + Functional Language Fundamental Abstractions Ethernet Frame Virtual Machine (Xen) Increasingly Ubiquitous Hardware Network Processors (Broadcomm, Qualcomm) Microprocessors (x86, ARM) Infoblox Inc. All Rights Reserved.

26 Specific Distributed Apps Value Sample App Scalable Analytic Library Scalable System Getting there Abstractions (DataErlang/OTP Intensive Distributed + OpenFlow Control + Xen Plane) SDN +(No Distributed Linux, No GraphDB CloudStack, + Functional No Hadoop) Language Fundamental Abstractions Increasingly Ubiquitous Hardware 26 Ethernet Frame Virtual Machine Network Processors (Broadcomm, Qualcomm) Microprocessors (x86, ARM) 2014 Infoblox Inc. All Rights Reserved.

42 Or is Communication Just as Fundamental? Where are Joe s Contract Checkers??

43 Some Grand Challenges to Modernize Distributed Erlang Security (e.g. Internode Security) Modernize Distribution with SDN Scalable GUI, Testing, and Diagnostic Frameworks Packaging and Code Maintenance Million-clause Functions, Modern Mailboxes, etc. 100% Erlang SDN at EUC 2015!

OpenFlow - the key standard of Software-Defined Networks. Dmitry Orekhov, Epam Systems

OpenFlow - the key standard of Software-Defined Networks Dmitry Orekhov, Epam Systems Software-defined network The Need for a New Network Architecture Limitations of Current Networking Technologies Changing