Reinforcement Learning for Resource Allocation and Time Series Tools for Mobility Prediction
|
|
- Giles Tate
- 7 years ago
- Views:
Transcription
1 Reinforcement Learning for Resource Allocation and Time Series Tools for Mobility Prediction Baptiste Lefebvre 1,2, Stephane Senecal 2 and Jean-Marc Kelif 2 1 École Normale Supérieure (ENS), Paris, France, baptiste.lefebvre@ens.fr 2 Orange Labs, Issy-les-Moulineaux, France stephane.senecal@orange.com, jeanmarc.kelif@orange.com First GdR MaDICS Workshop on Big Data for the 5G RAN 25 November Huawei FRC 1/38
2 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 2/38
3 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 3/38
4 Wireless Networks UE = User Equipment BS = Base Station f 4/38
5 Radio Resource Management (RRM) 12 subcarriers (18 khz) slot (.5 ms) PRB 1 PRE 2 Allocation Sharing of joint timeslots and frequency bands Load ρ = Quality of Service (QoS) C c=1 QoS = 1 T r R D n c c ( ) 1 ρ 2 Energy/Power Consumption ) P = P BS + r (P RS + ρp AP 1. Physical Ressource Block 2. Physical Ressource Element ρ = min(ρ, 1) 5/38
6 Goal : optimization of the energy consumption under QoS constraints Formal framework considered : reinforcement learning [SB98] More specifically, Markov Decision Processes (MDP) [Put94] : A system state enumerates UEs of each radio condition and enumerates active resources An action is either null, either a deactivation or an activation of a resource A policy associates to every state an action to proceed In order to perform energy savings, one needs to compute or estimate an optimal policy, i.e. a policy which implements a good trade-off between energy (electrical power) consumption and targeted QoS level 6/38
7 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 7/38
8 MDP Controler A controler executes a policy Π, which for a given traffic amount, aims at maximizing an objective function (QoS, power) Transition Probability Operator P(s, a, s ) Instantaneous Reward Function R(s, a) Searching for an optimal policy for a fully known MDP model can be performed by dynamic programming 8/38
9 Controler for Geometric Criterion max Π ( [ ]) E φ t R(s t, Π(s t )) s = s t= Solving an equations system by iterating until reaching a fixed point (geometric criterion) : ( ( ) ) Π(s) = arg max a A P(s, a, s ) R(s, a) + φv(s ) s S V(s) = ( ) P(s, Π(s), s ) R(s, Π(s)) + φv(s ) s S Parameter φ [; 1[ 9/38
10 Controler for Average Criterion max Π ( lim E T [ 1 T ]) T R(s t, Π(s t )) s = s t= Solving an equations system 1 by iterating until reaching a fixed point (average criterion) : ( ( ) ) Π(s) = arg max a A P(s, a, s ) R(s, a) + V(s ) s S V(s) = ( ) P(s, Π(s), s ) R(s, Π(s)) + V(s ) s S 1. Dynamic programming valid if V < + 1/38
11 States Transitions and Rewards The system evolves in continuous time and not in discrete time It is possible to turn a continuous-time MDP into a discrete-time MDP via the use of uniformization and discretization schemes P(s, a, s ) is replaced by Q(s, a, s ) which denotes the transition rate (i.e. Poisson process parameter) R(s, a) is replaced by C(s, a) which denotes the cost per time unit 11/38
12 States Transitions Modeling ( ) Q (n, r), a, (n, r ) = λ i if B λi (s, a, s ) 1 r n R n D i i if B µi (s, a, s ) F i else Data traffic on LTE network with Round Robin scheduling 12/38
13 States Transitions Modeling ( ) Q (n, r), a, (n, r ) = λ i if B λi (s, a, s ) 1 r n R n D i i if B µi (s, a, s ) F i else ( ) B λi (s, a, s ) = n = n + e (i) r = r + a ( ) B µi (s, a, s ) = n = n e (i) r = r + a e (i) = C-uplet composed of s except i th element which equals to 1 12/38
14 Rewards - Costs Functions C(s, a) = s S Q(s,a,s ) ( ) γe(n, r + a) + (1 γ)f (n, r + a) Multiobjective optimization via scalarization 13/38
15 Rewards - Costs Functions C(s, a) = s S Q(s,a,s ) ( ) γe(n, r + a) + (1 γ)f (n, r + a) P BS + rp RS P BS + R(P RS + P AP ) E(n, r) = P BS + r(p RS + P AP ) P BS + R(P RS + P AP ) F (n, r) = 1 exp log(2)t r Rn C i=1 n i n i D i C i=1 if n = else Multiobjective optimization via scalarization 13/38
16 Current Results The optimal policy is a threshold policy The optimal policy depends on traffic volume, on target throughput and on cell capacity The execution of the optimal policy enables energy savings of the order of 4% Proposal of taking into account activation time by adding a timer Adaptation to traffic evolution through an ε-greedy strategy 14/38
17 Optimization under Congestion The controler does not activate the whole resources in order to reduce congestion as fast as possible 15/38
18 Unused Resources The controler cannot activate its whole resources 16/38
19 Excessive QoS The controler can grant an effective QoS level much greater than initially targeted QoS level (e.g. 5 Kbps 4 Kbps) 17/38
20 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 18/38
21 States Transitions Modeling Q(s, a, s ) = λ i if B λi (s, a, s ) 1 n n i n i 1 n r+a R D i F i if B µi (s, a, s ) B(s, a, s ) r R D i F i if B µi (s, a, s ) B(s, a, s ) else Temporality difference for action execution 19/38
22 States Transitions Modeling Q(s, a, s ) = λ i if B λi (s, a, s ) 1 n n i r+a R D i if B µi (s, a, s ) B(s, a, s ) F i 1 r n R n D i i if B µi (s, a, s ) B(s, a, s ) F i else ) ( ) B λi ((n, r), a, (n, r ) = n = n + e (i) (n = n n = N) ( ) r = r + a B(r, a, r) ) ( B µi ((n, r), a, (n, r ) = n = n e (i)) ( r = r + a B(r, a, r) B(r, a, r) = (r = r = 1 a = ) (r = r = R a = 1) ) Temporality difference for action execution 19/38
23 Ideal and Effective Power Consumption Ideal Power Consumption : { PBS + P RS if α(n) = P (n) = P BS + α(n) P RS + α(n)p AP Ideal Number of Resources 2 : ( C ) T α(n) = min n i R, R D i i=1 else Effective Power Consumption : { PBS + rp RS if n = ˆP(n, r) = P BS + rp RS + rp AP else 2. Solving equation F (n, r) = 1 2 = β 2/38
24 Power Consumption Error Modeling Normalized Regret : ˆP(n, r) P ( ) (n) R(P RS + P AP ) E (n, r), a = ˆP(n, r + a) P (n) R(P RS + P AP ) if B(r, a) else B(r, a) = (r = 1 a = ) (r = R a = 1) 21/38
25 Rewards - Costs Functions Symmetrical Instantaneous Reward : R(s, a) = E(s, a) Asymmetrical Instantaneous Reward : R θ (s, a) = E(s, a) I E(s,a)< θe(s, a) I E(s,a) 22/38
26 Results 23/38
27 Overall Performance β current controler proposed controler γ ˆq,1 ˆq,5 ˆq,99 θ ˆq,1 ˆq,5 ˆq,99, 64, 98 +, 4 +, 8 1, 2 +, +, 2, 5 +, 21 +, 52 +, 84 1e 4, 2 +, +, 2, 4 +, 23 +, 54 +, 85 1e 8, 2 +, +, 2, 64, 98 +, 33 +, 6 1, 8 +, 2 +, 4, 5 +, 21 +, 44 +, 66 1e 2, 4 +, 2 +, 8, 4 +, 22 +, 47 +, 7 1e 4 +, +, 6 +, 12, 64, 98 +, 3 +, 41 1, 34, 2 +, 32, 5, 15, 21 +, 5 55e 3, 13 +, 21 +, 44, 4, 9 +, 27 +, 54 3e 3 +, +, 35 +, 54 24/38
28 Overall Performance β = 3 4 β = /38
29 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 26/38
30 Mobility Traffic due to arrivals and departures of UEs in the coverage zone of the BS, modeled by Poisson processes Moves of UEs inducing propagation losses, shadowing and fast-fading 27/38
31 Problem Statement The activation/deactivation timeframe of a physical resource is not taken into account in the modeling Idea : implement the prediction of states to be visited in the next seconds This approach makes it possible to consider mobile users Given SINR traces of users who crossed the cell and the SINR trace of a user currently crossing the cell, we aim at estimating the SINR to be measured in the near future 28/38
32 Problem Modeling Let T = {T 1,, T K } denote a set of time series Let T 1 = t 1,1,, t 1,N1 denote a time series... Let T K = t K,1,, t K,NK denote a time series Let T = t 1,, t N denote a time series to be completed ˆt N = f (T ) ˆt N = g(t ) T k D ˆt N = h(t ) T k D = {D 1,, D M } 29/38
33 Dynamic Time Warping (DTW) Let T = t 1,, t N denote a time series Let T = t 1,, t N denote another time series Let d denote a distance measure between elements of these time series D(t i, t j) = d(t i, t j) + min ( D(t i, t j), D(t i, t j), D(t i, t j) ) DTW (T, T ) = D(t N, t N ) Computation via dynamic programming in O(N 2 ), cf. [SC78] 3/38
34 Barycentric Averaging DTW Let T = {T 1,, T K } denote a set of time series Let T 1 = t 1,1,, t 1,N1 denote a time series... Let T K = t K,1,, t K,NK denote a time series The barycentric averaging DTW T satisfies (cf. [PKG11]) : N N, T = t 1,, t N K k=1 ( DTW (T, T k ) ) 2 K k=1 ( ) 2 DTW (T, T k ) Computation via iterative scheme in Θ(I K N 2 ) where I << N 31/38
35 Fast Dynamic Time Warping (FastDTW) Multi-level approach for the computation of the dynamic time warping, cf. [SC4] Linear spatial complexity Linear temporal complexity Approximation method enjoying a good precision (via tuning parameter r) Computation in Θ(I K r N) 32/38
36 Preliminary Results Estimations implemented with a precision of db order for time horizons of 1s order 33/38
37 Agenda 1 Context 2 Current Controler 3 Proposed Controler 4 Mobility Prediction 5 Conclusion 34/38
38 Conclusion Summary : Review of State-of-the-Art controlers Proposal of a modified and improved controler Proposal of a mobility prediction mechanism (different from those proposed for intercells transfert management) Work in progress/perspectives : Integration of the mobility prediction module to the controler Enhancement of the mobility prediction mechanism Design of a higher-level control system for many cells, even for an entire network 35/38
39 References [PKG11] François Petitjean, Alain Ketterlin, and Pierre Gançarski. A global averaging method for dynamic time warping, with applications to clustering. Pattern Recognition, 44(3) : , 211. [Put94] [SB98] [SC78] [SC4] Martin Puterman. Markov decision processes : discrete stochastic dynamic programming. Wiley-Interscience, Richard S. Sutton and Andrew G. Barto. Reinforcement Learning : An Introduction. MIT Press Cambridge, Hiroaki Sakoe and Seibi Chiba. Dynamic Programming Algorithm Optimization for Spoken Word Recognition. Transactions on Acoustics, Speech and Signal Processing, 26(1) :43 49, Stan Salvador and Philip Chan. FastDTW : Toward accurate dynamic time warping in linear time and space. In KDD workshop on mining temporal and sequential data. ACM, /38
40 Thank you! Thanks for your attention! Questions? These research works are funded by Orange and supported by the collaborative research project ANR NETLEARN (ANR-13-INFR-4) 37/38
41 Appendix : example of a MDP-based controler /38
42 Appendix : example of a MDP-based controler /38
43 Appendix : example of a MDP-based controler /38
44 Appendix : example of a MDP-based controler /38
Inductive QoS Packet Scheduling for Adaptive Dynamic Networks
Inductive QoS Packet Scheduling for Adaptive Dynamic Networks Malika BOURENANE Dept of Computer Science University of Es-Senia Algeria mb_regina@yahoo.fr Abdelhamid MELLOUK LISSI Laboratory University
More informationNational Technical University of Athens School of Electrical and Computer Engineering
the simulation and analysis of OFDMA subcarrier allocation techniques in multicellular environments. the performance evaluation of simple algorithms compared to a more sophisticated and computationally
More informationUsing Markov Decision Processes to Solve a Portfolio Allocation Problem
Using Markov Decision Processes to Solve a Portfolio Allocation Problem Daniel Bookstaber April 26, 2005 Contents 1 Introduction 3 2 Defining the Model 4 2.1 The Stochastic Model for a Single Asset.........................
More informationStochastic Models for Inventory Management at Service Facilities
Stochastic Models for Inventory Management at Service Facilities O. Berman, E. Kim Presented by F. Zoghalchi University of Toronto Rotman School of Management Dec, 2012 Agenda 1 Problem description Deterministic
More informationAn Algorithm for Automatic Base Station Placement in Cellular Network Deployment
An Algorithm for Automatic Base Station Placement in Cellular Network Deployment István Törős and Péter Fazekas High Speed Networks Laboratory Dept. of Telecommunications, Budapest University of Technology
More informationHow performance metrics depend on the traffic demand in large cellular networks
How performance metrics depend on the traffic demand in large cellular networks B. B laszczyszyn (Inria/ENS) and M. K. Karray (Orange) Based on joint works [1, 2, 3] with M. Jovanovic (Orange) Presented
More informationCDMA Network Planning
CDMA Network Planning by AWE Communications GmbH www.awe-com.com Contents Motivation Overview Network Planning Module Air Interface Cell Load Interference Network Simulation Simulation Results by AWE Communications
More informationADHOC RELAY NETWORK PLANNING FOR IMPROVING CELLULAR DATA COVERAGE
ADHOC RELAY NETWORK PLANNING FOR IMPROVING CELLULAR DATA COVERAGE Hung-yu Wei, Samrat Ganguly, Rauf Izmailov NEC Labs America, Princeton, USA 08852, {hungyu,samrat,rauf}@nec-labs.com Abstract Non-uniform
More informationOn the Traffic Capacity of Cellular Data Networks. 1 Introduction. T. Bonald 1,2, A. Proutière 1,2
On the Traffic Capacity of Cellular Data Networks T. Bonald 1,2, A. Proutière 1,2 1 France Telecom Division R&D, 38-40 rue du Général Leclerc, 92794 Issy-les-Moulineaux, France {thomas.bonald, alexandre.proutiere}@francetelecom.com
More informationForesighted Resource Scheduling in Software-Defined Radio Access Networks
Foresighted Resource Scheduling in Software-Defined Radio Access Networks Xianfu Chen, Zhu Han, Honggang Zhang, Mehdi Bennis, and Tao Chen VTT Technical Research Centre of Finland Ltd, Finland Department
More informationEfficient Network Marketing Strategies For Secondary Users
Determining the Transmission Strategy of Cognitive User in IEEE 82. based Networks Rukhsana Ruby, Victor C.M. Leung, John Sydor Department of Electrical and Computer Engineering, The University of British
More informationMotivation. Motivation. Can a software agent learn to play Backgammon by itself? Machine Learning. Reinforcement Learning
Motivation Machine Learning Can a software agent learn to play Backgammon by itself? Reinforcement Learning Prof. Dr. Martin Riedmiller AG Maschinelles Lernen und Natürlichsprachliche Systeme Institut
More informationEvolution in Mobile Radio Networks
Evolution in Mobile Radio Networks Multiple Antenna Systems & Flexible Networks InfoWare 2013, July 24, 2013 1 Nokia Siemens Networks 2013 The thirst for mobile data will continue to grow exponentially
More informationA Network Simulation Tool to Generate User Traffic and Analyze Quality of Experience for Hybrid Access Architecture
A Network Simulation Tool to Generate User Traffic and Analyze Quality of Experience for Hybrid Access Architecture Oscar D. Ramos-Cantor, Technische Universität Darmstadt, oscar.ramos@nt.tu-darmstadt.de,
More informationα α λ α = = λ λ α ψ = = α α α λ λ ψ α = + β = > θ θ β > β β θ θ θ β θ β γ θ β = γ θ > β > γ θ β γ = θ β = θ β = θ β = β θ = β β θ = = = β β θ = + α α α α α = = λ λ λ λ λ λ λ = λ λ α α α α λ ψ + α =
More informationSupplement to Call Centers with Delay Information: Models and Insights
Supplement to Call Centers with Delay Information: Models and Insights Oualid Jouini 1 Zeynep Akşin 2 Yves Dallery 1 1 Laboratoire Genie Industriel, Ecole Centrale Paris, Grande Voie des Vignes, 92290
More information3GPP Wireless Standard
3GPP Wireless Standard Shishir Pandey School of Technology and Computer Science TIFR, Mumbai April 10, 2009 Shishir Pandey (TIFR) 3GPP Wireless Standard April 10, 2009 1 / 23 3GPP Overview 3GPP : 3rd Generation
More informationIRMA: Integrated Routing and MAC Scheduling in Multihop Wireless Mesh Networks
IRMA: Integrated Routing and MAC Scheduling in Multihop Wireless Mesh Networks Zhibin Wu, Sachin Ganu and Dipankar Raychaudhuri WINLAB, Rutgers University 2006-11-16 IAB Research Review, Fall 2006 1 Contents
More informationInter-Cell Interference Coordination (ICIC) Technology
Inter-Cell Interference Coordination (ICIC) Technology Dai Kimura Hiroyuki Seki Long Term Evolution (LTE) is a promising standard for next-generation cellular systems targeted to have a peak downlink bit
More informationQuality Optimal Policy for H.264 Scalable Video Scheduling in Broadband Multimedia Wireless Networks
Quality Optimal Policy for H.264 Scalable Video Scheduling in Broadband Multimedia Wireless Networks Vamseedhar R. Reddyvari Electrical Engineering Indian Institute of Technology Kanpur Email: vamsee@iitk.ac.in
More informationInterference Management: From Autonomous to Closely Coordinated Approaches
Technische Universität München Lehrstuhl für Kommunikationsnetze Prof. Dr.-Ing. J. Eberspächer VDE/ITG Fachgruppe 5.2.4 Workshop Darmstadt 2010 Interference Management and Cooperation Strategies in Communication
More informationScheduling and capacity estimation in LTE. Olav Østerbø, Telenor CD (Corporate Development) ITC-23, September 6-8, 2011, San Francisco
Scheduling and capacity estimation in LTE Olav Østerbø, Telenor CD (Corporate Development) Agenda Introduction Obtainable bitrate as function of SINR Radio channel propagation model Radio signal fading
More informationPreliminaries: Problem Definition Agent model, POMDP, Bayesian RL
POMDP Tutorial Preliminaries: Problem Definition Agent model, POMDP, Bayesian RL Observation Belief ACTOR Transition Dynamics WORLD b Policy π Action Markov Decision Process -X: set of states [x s,x r
More informationA study on machine learning and regression based models for performance estimation of LTE HetNets
A study on machine learning and regression based models for performance estimation of LTE HetNets B. Bojović 1, E. Meshkova 2, N. Baldo 1, J. Riihijärvi 2 and M. Petrova 2 1 Centre Tecnològic de Telecomunicacions
More informationPredictive Scheduling in Multi-Carrier Wireless Networks with Link Adaptation
Predictive Scheduling in Multi-Carrier Wireless Networks with Link Adaptation Gokhan Sahin Department of Computer Science and Engineering University of Nebraska-Lincoln, Lincoln, Nebraska Email: gsahin@cse.unl.edu
More informationLoad Balancing in Cellular Networks with User-in-the-loop: A Spatial Traffic Shaping Approach
WC25 User-in-the-loop: A Spatial Traffic Shaping Approach Ziyang Wang, Rainer Schoenen,, Marc St-Hilaire Department of Systems and Computer Engineering Carleton University, Ottawa, Ontario, Canada Sources
More informationNEURAL NETWORKS AND REINFORCEMENT LEARNING. Abhijit Gosavi
NEURAL NETWORKS AND REINFORCEMENT LEARNING Abhijit Gosavi Department of Engineering Management and Systems Engineering Missouri University of Science and Technology Rolla, MO 65409 1 Outline A Quick Introduction
More informationScheduling Algorithms for Downlink Services in Wireless Networks: A Markov Decision Process Approach
Scheduling Algorithms for Downlink Services in Wireless Networks: A Markov Decision Process Approach William A. Massey ORFE Department Engineering Quadrangle, Princeton University Princeton, NJ 08544 K.
More informationRadio Resource Allocation Algorithm for Relay aided Cellular OFDMA System
Radio Resource Allocation Algorithm for Relay aided Cellular OFDMA System Megumi Kaneo # and Petar Popovsi Center for TeleInFrastructure (CTIF), Aalborg University Niels Jernes Vej 1, DK-90 Aalborg, Denmar
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Martin Lauer AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg martin.lauer@kit.edu
More informationOPPORTUNISTIC SCHEDULING OF VOICE AND DATA TRAFFIC IN WIRELESS NETWORKS. Thomas Bonald and Luca Muscariello
EuroFGI Workshop on IP QoS and Traffic Control P. Pereira (Ed.) Lisbon, Portugal, December 6 7, 2007 OPPORTUNISTIC SCHEDULING OF VOICE AND DATA TRAFFIC IN WIRELESS NETWORKS Thomas Bonald and Luca Muscariello
More informationCustomer Training Catalog Training Programs WCDMA RNP&RNO Technical Training
Customer Training Catalog Training Programs Customer Training Catalog Training Programs WCDMA RNP&RNO Technical Training HUAWEI Learning Service 2015 COMMERCIAL IN CONFIDENCE 1 Customer Training Catalog
More informationPriority-Coupling A Semi-Persistent MAC Scheduling Scheme for VoIP Traffic on 3G LTE
Priority-Coupling A Semi-Persistent MAC Scheduling Scheme for VoIP Traffic on 3G LTE S. Saha * and R. Quazi ** * Helsinki University of Technology, Helsinki, Finland ** University of Dhaka, Dhaka, Bangladesh
More informationFluid Approximation of Smart Grid Systems: Optimal Control of Energy Storage Units
Fluid Approximation of Smart Grid Systems: Optimal Control of Energy Storage Units by Rasha Ibrahim Sakr, B.Sc. A thesis submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfillment
More informationI. Wireless Channel Modeling
I. Wireless Channel Modeling April 29, 2008 Qinghai Yang School of Telecom. Engineering qhyang@xidian.edu.cn Qinghai Yang Wireless Communication Series 1 Contents Free space signal propagation Pass-Loss
More informationCall Admission Control for Voice/Data Integration in Broadband Wireless Networks
Call Admission Control for Voice/Data Integration in Broadband Wireless Networks Majid Ghaderi, Student Member, IEEE, and Raouf Boutaba, Senior Member, IEEE School of Computer Science University of Waterloo
More informationDownlink resource allocation algorithm: Quality of Service
International Association of Scientific Innovation and Research (IASIR) (An Association Unifying the Sciences, Engineering, and Applied Research) International Journal of Engineering, Business and Enterprise
More informationUnderstanding Purposeful Human Motion
M.I.T Media Laboratory Perceptual Computing Section Technical Report No. 85 Appears in Fourth IEEE International Conference on Automatic Face and Gesture Recognition Understanding Purposeful Human Motion
More informationPacket Queueing Delay in Wireless Networks with Multiple Base Stations and Cellular Frequency Reuse
Packet Queueing Delay in Wireless Networks with Multiple Base Stations and Cellular Frequency Reuse Abstract - Cellular frequency reuse is known to be an efficient method to allow many wireless telephone
More informationFunctional Optimization Models for Active Queue Management
Functional Optimization Models for Active Queue Management Yixin Chen Department of Computer Science and Engineering Washington University in St Louis 1 Brookings Drive St Louis, MO 63130, USA chen@cse.wustl.edu
More informationMarkov Decision Processes for Ad Network Optimization
Markov Decision Processes for Ad Network Optimization Flávio Sales Truzzi 1, Valdinei Freire da Silva 2, Anna Helena Reali Costa 1, Fabio Gagliardi Cozman 3 1 Laboratório de Técnicas Inteligentes (LTI)
More informationAssessing the quality of VoIP transmission affected by playout buffer scheme and encoding scheme
Assessing the quality of VoIP transmission affected by playout buffer scheme and encoding scheme Miroslaw Narbutt, Mark Davis Communications Network Research Institute Dublin Institute of Technology Wireless
More informationThe Evolution of Wireless Networks for the Internet of Things
The Evolution of Wireless Networks for the Internet of Things NSF Wireless Cities Workshop Presenter: Phil Fleming Mobile Networks Senior Technology Advisor Nokia Networks Arlington Hts., IL 1 Nokia Networks
More informationWireless Technologies for the 450 MHz band
Wireless Technologies for the 450 MHz band By CDG 450 Connectivity Special Interest Group (450 SIG) September 2013 1. Introduction Fast uptake of Machine- to Machine (M2M) applications and an installed
More informationSystem Design in Wireless Communication. Ali Khawaja
System Design in Wireless Communication Ali Khawaja University of Texas at Dallas December 6, 1999 1 Abstract This paper deals with the micro and macro aspects of a wireless system design. With the growing
More informationFigure 1: cellular system architecture
Question 1: (30 marks) Consider a FDM cellular system with 120 cites, a frequency reuse factor of N=12, and 900 overall two-way channels. Omni-directional antennas are used: Figure 1 shows some of the
More informationLTE Evolution for Cellular IoT Ericsson & NSN
LTE Evolution for Cellular IoT Ericsson & NSN LTE Evolution for Cellular IoT Overview and introduction White Paper on M2M is geared towards low cost M2M applications Utility (electricity/gas/water) metering
More informationRESOURCE ALLOCATION FOR INTERACTIVE TRAFFIC CLASS OVER GPRS
RESOURCE ALLOCATION FOR INTERACTIVE TRAFFIC CLASS OVER GPRS Edward Nowicki and John Murphy 1 ABSTRACT The General Packet Radio Service (GPRS) is a new bearer service for GSM that greatly simplify wireless
More informationPerformance of TD-CDMA systems during crossed slots
Performance of TD-CDMA systems during s Jad NASREDDINE and Xavier LAGRANGE Multimedia Networks and Services Department, GET / ENST de Bretagne 2 rue de la châtaigneraie, CS 1767, 35576 Cesson Sévigné Cedex,
More informationA Handover Scheme Towards Downlink Traffic Load Balance in Heterogeneous Cellular Networks
A Handover Scheme Towards Downlink Traffic Load Balance in Heterogeneous Cellular Networks Fei Liu, Petri Mähönen, and Marina Petrova Institute for Networked Systems, RWTH Aachen University Kackertstrasse
More informationProbabilistic Models for Big Data. Alex Davies and Roger Frigola University of Cambridge 13th February 2014
Probabilistic Models for Big Data Alex Davies and Roger Frigola University of Cambridge 13th February 2014 The State of Big Data Why probabilistic models for Big Data? 1. If you don t have to worry about
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Joschka Bödecker AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg jboedeck@informatik.uni-freiburg.de
More informationLTE in Unlicensed Spectrum: European Regulation and Co-existence Considerations
3GPP workshop on LTE in unlicensed spectrum Sophia Antipolis, France, June 13, 2014 RWS-140002 LTE in Unlicensed Spectrum: European Regulation and Co-existence Considerations Sari Nielsen & Antti Toskala
More informationCOMPATIBILITY STUDY FOR UMTS OPERATING WITHIN THE GSM 900 AND GSM 1800 FREQUENCY BANDS
Electronic Communications Committee (ECC) within the European Conference of Postal and Telecommunications Administrations (CEPT) COMPATIBILITY STUDY FOR UMTS OPERATING WITHIN THE GSM 900 AND GSM 1800 FREQUENCY
More informationHow To Understand The Gsm And Mts Mobile Network Evolution
Mobile Network Evolution Part 1 GSM and UMTS GSM Cell layout Architecture Call setup Mobility management Security GPRS Architecture Protocols QoS EDGE UMTS Architecture Integrated Communication Systems
More informationOscillations of the Sending Window in Compound TCP
Oscillations of the Sending Window in Compound TCP Alberto Blanc 1, Denis Collange 1, and Konstantin Avrachenkov 2 1 Orange Labs, 905 rue Albert Einstein, 06921 Sophia Antipolis, France 2 I.N.R.I.A. 2004
More informationResource allocation and opportunistic scheduling for UMTS-TDD
Resource allocation and opportunistic scheduling for UMTS-TDD Illia Racunica, Aawatif Menouni,Christian Bonnet Eurecom Institut 2229 Route des Cretes - BP 193 694 Sophia-Antipolis France e-mail: Illia.Racunica@eurecom.fr,
More informationSubcarrier Allocation Algorithms for multicellular OFDMA networks without Channel State Information
Subcarrier Allocation Algorithms for multicellular OFDMA networks without Channel State Information I.N. Stiakogiannakis, D.A. Zarbouti, G.V. Tsoulos, D.I. Kaklamani, NTUA Department of Telecommunication
More informationHigh-frequency trading in a limit order book
High-frequency trading in a limit order book Marco Avellaneda & Sasha Stoikov October 5, 006 Abstract We study a stock dealer s strategy for submitting bid and ask quotes in a limit order book. The agent
More informationInter-cell Interference Mitigation Reduction in LTE Using Frequency Reuse Scheme
International Journal of Scientific and Research Publications, Volume 5, Issue 8, August 2015 1 Inter-cell Interference Mitigation Reduction in LTE Using Frequency Reuse Scheme Rupali Patil 1, R.D.Patane
More informationNokia Networks. Voice over LTE (VoLTE) Optimization
Nokia Networks Voice over LTE (VoLTE) Optimization Contents 1. Introduction 3 2. VoIP Client Options 5 3. Radio Network Optimization 6 4. Voice Quality Optimization 11 5. Handset Power Consumption Optimization
More informationCloud Radios with Limited Feedback
Cloud Radios with Limited Feedback Dr. Kiran Kuchi Indian Institute of Technology, Hyderabad Dr. Kiran Kuchi (IIT Hyderabad) Cloud Radios with Limited Feedback 1 / 18 Overview 1 Introduction 2 Downlink
More information2G/3G Mobile Communication Systems
2G/3G Mobile Communication Systems Winter 2012/13 Integrated Communication Systems Group Ilmenau University of Technology Outline 2G Review: GSM Services Architecture Protocols Call setup Mobility management
More informationSpectrum and Power Measurements Using the E6474A Wireless Network Optimization Platform
Application Note Spectrum and Power Measurements Using the E6474A Wireless Network Optimization Platform By: Richard Komar Introduction With the rapid development of wireless technologies, it has become
More informationReal Time Scheduling Basic Concepts. Radek Pelánek
Real Time Scheduling Basic Concepts Radek Pelánek Basic Elements Model of RT System abstraction focus only on timing constraints idealization (e.g., zero switching time) Basic Elements Basic Notions task
More informationCellular Network Organization. Cellular Wireless Networks. Approaches to Cope with Increasing Capacity. Frequency Reuse
Cellular Network Organization Cellular Wireless Networks Use multiple low-power transmitters (100 W or less) Areas divided into cells Each served by its own antenna Served by base station consisting of
More informationSmart Mobility Management for D2D Communications in 5G Networks
Smart Mobility Management for D2D Communications in 5G Networks Osman N. C. Yilmaz, Zexian Li, Kimmo Valkealahti, Mikko A. Uusitalo, Martti Moisio, Petteri Lundén, Carl Wijting Nokia Research Center Nokia
More informationIntroduction to Clean-Slate Cellular IoT radio access solution. Robert Young (Neul) David Zhang (Huawei)
Introduction to Clean-Slate Cellular IoT radio access solution Robert Young (Neul) David Zhang (Huawei) Page 11 Introduction and motivation There is a huge opportunity for Mobile Network Operators to exploit
More informationSingle item inventory control under periodic review and a minimum order quantity
Single item inventory control under periodic review and a minimum order quantity G. P. Kiesmüller, A.G. de Kok, S. Dabia Faculty of Technology Management, Technische Universiteit Eindhoven, P.O. Box 513,
More informationChapter 2: Binomial Methods and the Black-Scholes Formula
Chapter 2: Binomial Methods and the Black-Scholes Formula 2.1 Binomial Trees We consider a financial market consisting of a bond B t = B(t), a stock S t = S(t), and a call-option C t = C(t), where the
More informationStatistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
More informationDecentralized Method for Traffic Monitoring
Decentralized Method for Traffic Monitoring Guillaume Sartoretti 1,2, Jean-Luc Falcone 1, Bastien Chopard 1, and Martin Gander 2 1 Computer Science Department 2 Department of Mathematics, University of
More informationSubscriber Maximization in CDMA Cellular Networks
CCCT 04: INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS, AND CONTROL TECHNOLOGIES 234 Subscriber Maximization in CDMA Cellular Networks Robert AKL Department of Computer Science and Engineering
More informationDSL Spectrum Management
DSL Spectrum Management Dr. Jianwei Huang Department of Electrical Engineering Princeton University Guest Lecture of ELE539A March 2007 Jianwei Huang (Princeton) DSL Spectrum Management March 2007 1 /
More informationPriority-Based Congestion Control Algorithm for Cross-Traffic Assistance on LTE Networks
Priority-Based Congestion Control Algorithm for Cross-Traffic Assistance on LTE Networks Lung-Chih Tung, You Lu, Mario Gerla Department of Computer Science University of California, Los Angeles Los Angeles,
More informationAn Interference Avoiding Wireless Network Architecture for Coexistence of CDMA 2000 1x EVDO and LTE Systems
ICWMC 211 : The Seventh International Conference on Wireless and Mobile Communications An Interference Avoiding Wireless Network Architecture for Coexistence of CDMA 2 1x EVDO and LTE Systems Xinsheng
More informationCellular M2M Network Access Congestion: Performance Analysis and Solutions
1st nternational Workshop on nternet of Things Communications and Technologies (ot'13) Cellular MM etwork Access Congestion: Performance Analysis and Solutions Fengming Cao and Zhong Fan Toshiba Research
More informationModern Optimization Methods for Big Data Problems MATH11146 The University of Edinburgh
Modern Optimization Methods for Big Data Problems MATH11146 The University of Edinburgh Peter Richtárik Week 3 Randomized Coordinate Descent With Arbitrary Sampling January 27, 2016 1 / 30 The Problem
More informationA Multi-agent Q-learning Framework for Optimizing Stock Trading Systems
A Multi-agent Q-learning Framework for Optimizing Stock Trading Systems Jae Won Lee 1 and Jangmin O 2 1 School of Computer Science and Engineering, Sungshin Women s University, Seoul, Korea 136-742 jwlee@cs.sungshin.ac.kr
More informationEfficient Node Discovery in Mobile Wireless Sensor Networks
Efficient Node Discovery in Mobile Wireless Sensor Networks Vladimir Dyo, Cecilia Mascolo 1 Department of Computer Science, University College London Gower Street, London WC1E 6BT, UK v.dyo@cs.ucl.ac.uk
More informationMAN-BITES-DOG BUSINESS CYCLES ONLINE APPENDIX
MAN-BITES-DOG BUSINESS CYCLES ONLINE APPENDIX KRISTOFFER P. NIMARK The next section derives the equilibrium expressions for the beauty contest model from Section 3 of the main paper. This is followed by
More informationEE4367 Telecom. Switching & Transmission. Prof. Murat Torlak
Path Loss Radio Wave Propagation The wireless radio channel puts fundamental limitations to the performance of wireless communications systems Radio channels are extremely random, and are not easily analyzed
More informationLearning Tetris Using the Noisy Cross-Entropy Method
NOTE Communicated by Andrew Barto Learning Tetris Using the Noisy Cross-Entropy Method István Szita szityu@eotvos.elte.hu András Lo rincz andras.lorincz@elte.hu Department of Information Systems, Eötvös
More informationUser-Network Association in an 802.11 WLAN & 3G UMTS Hybrid Cell: Individual Optimality
User-Network Association in an 802. WLAN & 3G UMTS Hybrid Cell: Individual Optimality Dinesh Kumar, Eitan Altman INRIA, France Email: {dkumar, altman}@sophia.inria.fr Jean-Marc Kelif France Telecom R&D,
More informationNumerical PDE methods for exotic options
Lecture 8 Numerical PDE methods for exotic options Lecture Notes by Andrzej Palczewski Computational Finance p. 1 Barrier options For barrier option part of the option contract is triggered if the asset
More informationNumerical methods for American options
Lecture 9 Numerical methods for American options Lecture Notes by Andrzej Palczewski Computational Finance p. 1 American options The holder of an American option has the right to exercise it at any moment
More informationA Traffic Load Balancing Framework for Software-defined Radio Access Networks Powered by Hybrid Energy Sources
arxiv:47.778v3 [cs.ni] 6 Dec 4 A Traffic Load Balancing Framework for Software-defined Radio Access Networks Powered by Hybrid Energy Sources Tao Han, Student Member, IEEE, and Nirwan Ansari, Fellow, IEEE
More informationChannel assignment for GSM half-rate and full-rate traffic
Computer Communications 23 (2000) 476 482 www.elsevier.com/locate/comcom Channel assignment for GSM half-rate and full-rate traffic P. Lin, Y.-B. Lin* Department of Computer Science and Information Engineering,
More informationAn Environment Model for N onstationary Reinforcement Learning
An Environment Model for N onstationary Reinforcement Learning Samuel P. M. Choi Dit-Yan Yeung Nevin L. Zhang pmchoi~cs.ust.hk dyyeung~cs.ust.hk lzhang~cs.ust.hk Department of Computer Science, Hong Kong
More informationRandom access protocols for channel access. Markov chains and their stability. Laurent Massoulié.
Random access protocols for channel access Markov chains and their stability laurent.massoulie@inria.fr Aloha: the first random access protocol for channel access [Abramson, Hawaii 70] Goal: allow machines
More informationEETS 8316 Wireless Networks Fall 2013
EETS 8316 Wireless Networks Fall 2013 Lecture: Cellular Overview: 3G and 4G http://lyle.smu.edu/~skangude/eets8316.html Dr. Shantanu Kangude skangude@lyle.smu.edu Third Generation Systems High-speed wireless
More informationElectronic Communications Committee (ECC) within the Conference of Postal and Telecommunications Administrations (CEPT)
Page 1 Electronic Communications Committee (ECC) within the Conference of Postal and Telecommunications Administrations (CEPT) ECC RECOMMENDATION (05)08 (replacing recommendations T/R 20-08 and 22-07)
More informationAssignment #1. Example: tetris state: board configuration + shape of the falling piece ~2 200 states! Recap RL so far. Page 1
Generalization and function approximation CS 287: Advanced Robotics Fall 2009 Lecture 14: Reinforcement Learning with Function Approximation and TD Gammon case study Pieter Abbeel UC Berkeley EECS Represent
More informationCourse Curriculum for Master Degree in Electrical Engineering/Wireless Communications
Course Curriculum for Master Degree in Electrical Engineering/Wireless Communications The Master Degree in Electrical Engineering/Wireless Communications, is awarded by the Faculty of Graduate Studies
More informationWireless Network Coding with partial Overhearing information
Wireless network coding with partial overhearing information Georgios S. Paschos Massachusetts Institute of Technology (MIT) Joint work with: C. Fragkiadakis University of Thessaly, Greece L. Georgiadis
More informationHeterogeneous LTE Networks and Inter-Cell Interference Coordination
Heterogeneous LTE Networks and Inter-Cell Interference Coordination Volker Pauli, Juan Diego Naranjo, Eiko Seidel Nomor Research GmbH, Munich, Germany December, 2010 Summary Initial deployments of LTE
More informationIN RECENT years, there have been significant efforts to develop
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 5, NO. 3, MARCH 2006 525 Effective Bandwidth of Multimedia Traffic in Packet Wireless CDMA Networks with LMMSE Receivers: A Cross-Layer Perspective Fei
More informationcommunication over wireless link handling mobile user who changes point of attachment to network
Wireless Networks Background: # wireless (mobile) phone subscribers now exceeds # wired phone subscribers! computer nets: laptops, palmtops, PDAs, Internet-enabled phone promise anytime untethered Internet
More informationDynamic Load Balance Algorithm (DLBA) for IEEE 802.11 Wireless LAN
Tamkang Journal of Science and Engineering, vol. 2, No. 1 pp. 45-52 (1999) 45 Dynamic Load Balance Algorithm () for IEEE 802.11 Wireless LAN Shiann-Tsong Sheu and Chih-Chiang Wu Department of Electrical
More informationComplexity-bounded Power Control in Video Transmission over a CDMA Wireless Network
Complexity-bounded Power Control in Video Transmission over a CDMA Wireless Network Xiaoan Lu, David Goodman, Yao Wang, and Elza Erkip Electrical and Computer Engineering, Polytechnic University, Brooklyn,
More information