Organization of Complex Networks



Similar documents
Big Data Analytics of Multi-Relationship Online Social Network Based on Multi-Subnet Composited Complex Network

Bioinformatics: Network Analysis

Structural constraints in complex networks

1. Introduction Gene regulation Genomics and genome analyses Hidden markov model (HMM)

Active Measurements: traceroute

How To Understand The Network Of A Network

Graph theoretic approach to analyze amino acid network

Internet Topology. Yihua He Michalis Faloutsos University of California, Riverside. Glossary 2.

Greedy Routing on Hidden Metric Spaces as a Foundation of Scalable Routing Architectures

Chapter 29 Scale-Free Network Topologies with Clustering Similar to Online Social Networks

Distance Degree Sequences for Network Analysis

Complex Networks Analysis: Clustering Methods

The architecture of complex weighted networks

TÓPICOS AVANÇADOS EM REDES ADVANCED TOPICS IN NETWORKS

Temporal Dynamics of Scale-Free Networks

Structural Cloud Audits that Protect Private Information

3. The Junction Tree Algorithms

General Network Analysis: Graph-theoretic. COMP572 Fall 2009

Internet (IPv4) Topology Mapping. Department of Computer Science The University of Texas at Dallas

The Joint Degree Distribution as a Definitive Metric of the Internet AS-level Topologies

How To Cluster Of Complex Systems

Research Article A Comparison of Online Social Networks and Real-Life Social Networks: A Study of Sina Microblogging

TÓPICOS AVANÇADOS EM REDES ADVANCED TOPICS IN NETWORKS

Community Detection Proseminar - Elementary Data Mining Techniques by Simon Grätzer

Towards a Networks-of-Networks Framework for Cyber Security

KNOWLEDGE NETWORK SYSTEM APPROACH TO THE KNOWLEDGE MANAGEMENT

Classification of graph metrics

Machine Learning and Data Analysis overview. Department of Cybernetics, Czech Technical University in Prague.

MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL

! E6893 Big Data Analytics Lecture 10:! Linked Big Data Graph Computing (II)

Valuation of Network Effects in Software Markets

Visualizing Structured Data About Music

QUANTITIVE AND SOCIOLOGICAL ANALYSIS OF BLOG NETWORKS

Social Network Mining


How To Create A Data Visualization Engine For Your Computer Or Your Brain

Data Science Center Eindhoven. Big Data: Challenges and Opportunities for Mathematicians. Alessandro Di Bucchianico

Sampling Biases in IP Topology Measurements

D A T A M I N I N G C L A S S I F I C A T I O N

Filtering Based Techniques for DDOS Mitigation

Disaster Recovery Design Ehab Ashary University of Colorado at Colorado Springs

Course: Model, Learning, and Inference: Lecture 5

Web Mining using Artificial Ant Colonies : A Survey

Forecasting Traffic Growth and Impact with Cisco MATE Design

Graph Mining and Social Network Analysis

Network Analysis. BCH 5101: Analysis of -Omics Data 1/34

Social Network Analysis

A Network Management Software Based on Secure Shell (SSH) Channels. and Java Universal Network Graph (JUNG)

LOAD BALANCING AND EFFICIENT CLUSTERING FOR IMPROVING NETWORK PERFORMANCE IN AD-HOC NETWORKS

The Structure of Growing Social Networks

Security Management of Cloud-Native Applications. Presented By: Rohit Sharma MSc in Dependable Software Systems (DESEM)

The Internet Is Like A Jellyfish

Network Virtualization and Data Center Networks Data Center Virtualization - Basics. Qin Yin Fall Semester 2013

Social Media Mining. Network Measures

2. What is the maximum value of each octet in an IP address? A. 28 B. 255 C. 256 D. None of the above

5. Binary objects labeling

The Big Data Paradigm Shift. Insight Through Automation

RNM Reply Network Manager

Analytical Test Method Validation Report Template

SIMPLE NETWORKING QUESTIONS?

CS224W Project Report: Finding Top UI/UX Design Talent on Adobe Behance

Structural and functional analytics for community detection in large-scale complex networks

Graph Theory and Complex Networks: An Introduction. Chapter 08: Computer networks

MODEL DRIVEN DEVELOPMENT OF BUSINESS PROCESS MONITORING AND CONTROL SYSTEMS

Gephi Tutorial Quick Start

Managing a Fibre Channel Storage Area Network

USE OF GRAPH THEORY AND NETWORKS IN BIOLOGY

Understanding the dynamics and function of cellular networks

A survey of results on mobile phone datasets analysis

IP Telephony Management

Transcription:

Organization of Complex Networks Maksim Kitsak Boston University Collaborators: L.K. Gallos, S. Havlin, H. A. Makse and H.E. Stanley

K-cores: Definitions, Extraction Rules K-core is the sub-graph with nodes of degree at least k within the sub-graph. Pruning Rule: 1) Remove from the graph all nodes with k=1. 2) Some remaining nodes may now have new k = 1 nodes. 3) Repeat until there is no nodes with k = 1. 4) The remaining network forms the 2-core. 5) Repeat the process for higher k to extract other cores 1 2 3 K-shell is a set of nodes that belongs to the K-core and NOT to the K+1 core K-crust is a union of all shells with indices <= k Any network can be represented as a number of selfenclosed K-cores!

Topology Analysis: Some Facts, Questions and Answers Understanding the topology of a Complex System is often an important step towards understanding its function. Many Systems are extremely large: 4 N ~ 10 Robust techniques are required for exploration of large systems. What characteristics/techniques are employed in studies of network topology? Node degree, Clustering, Cliques, Centrality, Modularity, K-cores K-core is the sub-graph with nodes of degree at least k within the sub-graph. What are the features of the k-core analysis? K-core analysis promotes node degree to a global property of a network K-core analysis allows natural representation of a network as a set of layers. K-core calculation is fast compared to other global characteristics. O(N) 10 7

The Internet: Autonomous System Level : K-core structure AS Internet Randomized AS Internet 0 0 30 40 50 Shell Randomized version of the AS Internet has smaller number of k-shells. Nodes with larger degrees are typically located in higher k-shells.

Internet at the Router Level: K-core structure 10 4 RL Internet Randomized RL Internet 0 20 40 60 Shell Randomized version of the RL Internet has very few shells! Nodes with larger degrees are typically located in small k-shells!

Are K-shells Fully Determined by Distribution? 10 4 Original Random RL Internet 0 0 30 40 50 AS Internet 0 0 30 40 50 Shell# 10 4 Cond-mat 0 0 30 WWW 1 00 Shell# No! K-shells depend on the way nodes are connected in the network.

Hypotheses 1) K-shell structure depends on clustering: k=1 pruning k=1 pruning Tree-like networks are entirely decomposed at the k=1 step. k=1 pruning Loops are vital for the k-shell structure. Triangle is the simpliest loop. We use clustering as a measure of density of loops. Networks with higher clustering should have more shells

Hypotheses 2) K-shell strucrure depends on degree-degree correlation: q=4 k=1 pruning q=4 q=4 q=2 Hubs, mostly connected to small degree nodes tend to loose their links faster under k-pruning. (Compared to hubs that connect to other hubs.) Assortative Networks are resilient under k-pruning and should have more shells! What happens to the k-shell structure if one preserves both P ( q, q 1 2) C(q) and?

What if we preserve Correlation and Clustering? RL Internet 0 0 30 40 50 10 4 Original Random) P(k,q) + C(k) preserved C(k) preserved AS Internet 0 0 30 40 50 Shell# Cond-mat 0 0 30 Shell# Both Assortativity and Clustering seem to increase the total number of k-shells. Preserving only clustering allows to achieve Greater number of k-shells in AS internet due to its disassortativity. M.Kitsak, L.K. Gallos, S. Havlin, H.A. Makse, and H.E. Stanley, Organization of Complex Networks (in preparation) (2008).

Summary and Conclusions K-core analysis is a powerful tool for the analysis of global network structure. K-shell structure promotes the degree concept to the global level Network is covered with a set of naturally emerging k-shell layers. Real Networks have non-trivial k-shell structure which significantly deviates from random models. The analysis of the k-shells of real networks allows one to reveal new aspects of the network topology. The k-cores appear to be strongly affected by degree correlation and clustering in networks. Assortativity and clustering level strongly affect the k-cores (k-shells) in the network.

Credits We express our gratitude for valuable discussions to: Shai Carmi, Dr. Chaoming Song, Dr. Diego Rybsky Dr. S.N. Dorogovtsev We thank for financial support: ONR European project DAPHNet EPRIS project Israel Science Foundation We thank for making the trip to NetSci 2008 possible: ONR USMA