JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks

Size: px

Start display at page:

Download "JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks"

Augustus Joel Stevens
8 years ago
Views:

1 JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks Bernard Traversat tra@jxta.org JXTA Chief Architect Sun Microsystems 2005 JavaOne SM Conference Session 7208

2 Extended and Deep Internet Vision Everybody and everything connected to the Internet Integrated networks (Internet, Enterprise, Home, Ad Hoc, etc.) Network of People, Places, Things A complex network problem 2

networks (Internet, Enterprise, Home, Ad Hoc, etc.

3 The Internet reaching its limits Information overload Hard to find, impossible to catalog and index Google indexes ~5 Billion Web Pages Deep web (data beyond web servers and dynamic pages) Next wave of gizmo devices (sensors, smart things) want to participate Server-centric Model Hot links get hotter, cold links stay cold Access from centralized location Asymmetric computing model 3

Next wave of gizmo devices (sensors, smart things) want to participate Server-centric Model Hot

4 The Internet reaching its limits (suite ) A location-dependent addressing model (URL) A centralized name service (DNS) No QoS for message delivery Primarily a point-to-point network (multicast/anycast limitation) Topology controlled by network administrators, not applications No scoping or searching capability A binary security model (Intranet vs. Internet) 4

network (multicast/anycast limitation) Topology controlled by network administrators, not

5 P2P Makes Sense Now More nodes on the Internet and wireless web More people connected, more data at the edge More edge bandwidth available More computing resource available (disk, memory, CPU) More interesting applications, content, and services Everything that touches the network is growing at an exponential rate Bandwidth Transaction s Users Services Devices Data Network Computing Explosion Edge devices are increasingly more powerful and have better connectivity! 5

content, and services Everything that touches the network is growing at an exponential rate Bandwidth Transaction s

6 Knowledge Addressable Network Shift in addressing model from IP address to content address Internet routers form the largest P2P network As TCP/IP packets get routed within the Internet, content queries can be routed using a similar decentralized P2P knowledge addressable network 6

network As TCP/IP packets get routed within the Internet, content

7 Decentralized Searching Models Centralized Decentralized Directory Slave(s) Publish search Publish The Internet is the directory Network Network Discover 7

8 Why Google is doomed to fail: Centralized Indexing Effect Performance Web Site Decentralized Discovery Inflection Point (Cost of updating index = Cost of routing queries) Centralized Discovery Rate of Change 8

Inflection Point (Cost of updating index = Cost of

9 How does Decentralized Indexing work? Content Addressable Network f DHT (Content Name) = Peer address(s) Similar to IP Routing where IP addresses are Content addresses P1 P1 f DHT ( Content A) P1 Peer P1 Content A Publish Download f DHT (Content A) Search 9

address(s) Similar to IP Routing where IP addresses are Content

10 Content Addressable Network DHT Hash 11 Content B Hash 12 Hash 1j Hash 1l Hash 1n Hash ij Hash m1 Hash ml Hash mn Content A f(content B)= Hash ml f(content A)= Hash ij 10

11 What is JXTA TM? A network protocol for creating fully decentralized Internet peer-to-peer (P2P) network A set of protocols (XML-based) Works with any language, OS, network, and service models A virtual Internet overlay Universal resource advertisement Decentralized DHT routing protocol A set of mechanisms, not policies An Open Source project: 11

set of protocols (XML-based) Works with any language, OS, network, and service models A

12 JXTA Peer Types Micro peers Standard peers Super peers: Rendezvous peer Relay peer Proxy peer 12

13 JXTA Virtual P2P Network Peer ID Peer ID Peer ID Peer ID Peer ID Peer ID Peer ID Peer ID Virtual Mapping TCP/IP Physical Network Peer Firewall Peer Peer HTTP Peer Peer NAT Peer Peer Peer Peer 13

14 What JXTA Technology Does Brings devices, services, and networks together Enables interactions among highly dynamic resources Takes the complexity out of the network and operating environments so developers can quickly build peer-to-peer applications Users have better access to content across multiple devices, regardless of location Find it, get it, use it 14

operating environments so developers can quickly build peer-to-peer applications Users

15 JXTA Building Blocks JXTA ID's provide location-independent resource addressing Dynamic PeerGroup domains Universal Resource advertisements Decentralized Resource resolver Pipes as communication channels 15

PeerGroup domains Universal Resource advertisements

16 JXTA ID JXTA IDs to uniquely identify virtually any kinds of network resources (peers, peer group, pipes, contents, users, etc.) Uniform addressing scheme IDs enable resources to be addressed independently of their physical network location Self-generated 128Bytes UUID JXTA ID 16

) Uniform addressing scheme IDs enable resources to be addressed

17 Peer Groups: Virtual Internet Domains JXTA Virtual Internet Peer Peer Peer Peer Peer Peer Peer Peer Virtual Mapping Internet Network 17 17

18 Why Use Peer Groups? Create secure and protected knowledge domains Scope peer operations Discovery, search, communications Resource context Provide a group identity Group peers sharing a common interest Enable monitoring and auditing 18

19 Universal Resources Advertisements All network resources represented by advertisements Language-neutral XML documents Can be sub-typed for application specific advertisements Peers cache, publish, and exchange advertisements Each advertisement is published with a lifetime (time-to-live) Enable deletion of obsolete advertisements without requiring centralized control 19

Peers cache, publish, and exchange advertisements Each advertisement is published with a

20 Universal Advertisement Resolver Asynchronous mechanism for searching advertisements (peers, peer groups, pipes, services, contents) Send resolver query message To a specific peer Routed within the JXTA network 20

groups, pipes, services, contents) Send resolver

21 Rendezvous Super-Peer DHT Structure Rendezvous organize themselves into a loosely-consistent peerview Rendezvous only maintain index of edge advertisements Queries only propagated within Rendezvous Lazy repair of RDV index peerview Each peergroup domain uses its own Rendezvous peerview for scoping purpose 21

22 Rendezvous Super-Peer DHT R4 Adv1 Index f(adv1) R1 R3 R2 Edge Peers Index R6 R5 P1 Query (adv1) 22

23 Security in JXTA Peer security Every peer has its own certificate registry Public key certificate part of peer advertisements Credential certificate embedded in every project JXTA protocol message TLS Endpoint Transport Peergroup membership certificates Web of trust 23

24 Transport Layer Security (TLS) Application Data Application Data JXTA Messages Virtual TLS Transport JXTA Messages I/O Pipes PeerID2 PeerID4 I/O Pipes PeerID1 PeerID6 PeerID3 Relay Firewall PeerID5 24

25 jxta.org Based on a Proven Open Source Model All source, projects, docs, examples on-line Apache style software license No barriers to getting started No royalties, no fees, no registration Meritocracy The more you've done, the more you can do 25

26 JXTA Technology Enables Wide range of content distributions Communications, collaboration, gaming Content delivery and sharing networks Resource sharing 26

27 Storage Backup 312 Inc. LeanOnMe 27

28 Brevient Connect Web Conferencing 28

29 Grid Computing Codefarm's Galapagos 29

30 Collaboration Ifreestyle by Digital Dream 30

31 SNS - Social Network Application (file, voice, video sharing) 31

32 Petroleum Convenience Store Alliance for Technology Standards (PCATS) 32

33 And more! FCS US Army Military Network (Boeing) Self-organizing network Resilient network A global integrated network (satellite, GPRS, wireless, land and proximity) Telco and ISP Providers (Verizon) A global integrated network (Internet, enterprise, home and proximity) Content delivery and sharing network Lower down the cost of delivering contents Bandwidth optimization 33

34 FCS US Army Network 34

35 Verizon IOBI ( Merging of voice and data network Build a P2P IP Multimedia sharing network infrastructure Deliver virtually any kinds of contents (file, video, music, radio, TV, etc.) Build a symmetric network (delivering and sharing of contents) Lower down the cost of delivering contents Provide an integrated Internet, Home and Enterprise network 35

36 JXTA Implementation Status JXTA-J2SE ΤΜ (June 15 th Release 2.3.4) Full implementation of JXTA protocols Standard and Super Peer functionality APIs and functionality frozen Quarterly Release (on schedule 11 th in a row!) JXTA-C/C++ (June 15 th Release 2.1.1) Standard Peer functionality Extended discovery (Xpath) Rendezvous support Runs on Linux, Solaris TM OE, and Windows 36

37 JXTA Implementation Status JXTA-J2ME TM Implementation (June 15 th Release 2.0) New implementation Edge peer capability No super-peer support CDC 1.1 Compliant Other community driven implementations C#.Net JPython 37

38 JXTA Community Momentum (4/2001 6/2005) 6,500,000+ downloads ~120 Projects 80,000+ download a month Active discussion groups Community actively contributing and integrating technology Please join our efforts! 38

39 Summary Build Knowledge addressable network as IP routing network JXTA is an open source platform for deploying P2P virtual Internet applications it is free! JXTA technology is language, operating system, network, and service agnostic. JXTA technology works on any network device -- from embedded devices, cell phones, desktops to super computers JXTA can be used to build virtually any kinds of knowledge addressable network 39

JXTA Overview. Mathieu Jan IRISA Rennes Projet Paris

JXTA Overview. Mathieu Jan IRISA Rennes Projet Paris JXTA Overview Mathieu Jan IRISA Rennes Projet Paris Plan Why peer-to-peer (P2P)? Introduction to JXTA Goals Basic concepts Protocols JXTA 2.0 Loosely-Consistent DHT Conclusion 2 Why peer-to-peer (P2P)?