Lecture 2: Single Layer Perceptrons Kevin Swingler


 Lester George
 2 years ago
 Views:
Transcription
1 Lecture 2: Sngle Layer Perceptrons Kevn Sngler
2 Recap: McCullochPtts Neuron Ths vastly smplfed model of real neurons s also knon as a Threshold Logc Unt: W 2 A Y 3 n W n. A set of synapses (.e. connectons) brngs n actvatons from other neurons 2. A processng unt sums the nputs, and then apples a nonlnear actvaton functon 3. An output lne transmts the result to other neurons 2
3 Netorks of McCullochPtts Neurons One neuron can t do much on ts on. Usually e ll have many neurons labelled by ndces k,, and actvaton flos beteen va synapses th strengths k, : W 2 Y 3 θ Neuron k k Neuron Synapse Neuron k Yk k Y sgn( k θ) Y n k 3
4 The Perceptron We can connect any number of McCullochPtts neurons together n any ay e lke An arrangement of one nput layer of McCullochPtts neurons feedng forard to one output layer of McCullochPtts neurons s knon as a Perceptron. θ 2 N : : θ 2 : : θ M 2 M Y n sgn( Y θ ) 4
5 mplementng Logc Gates th MP Neurons We can use McCullochPtts neurons to mplement the basc logc gates (e.g. AND, OR, NOT). t s ell knon from logc that e can construct any logcal functon from these three basc logc gates. All e need to do s fnd the approprate connecton eghts and neuron thresholds to produce the rght outputs for each set of nputs. We shall see explctly ho one can construct smple netorks that perform NOT, AND, and OR. 5
6 mplementaton of Logcal NOT, AND, and OR n NOT out n AND n 2 out n OR n 2 out??? Problem: Tran netork to calculate the approprate eghts and thresholds n order to classfy correctly the dfferent classes (.e. form decson boundares beteen classes). 6
7 Decson Surfaces Decson surface s the surface at hch the output of the unt s precsely equal to the threshold,.e. θ n D the surface s ust a pont: θ/ n 2D, the surface s Y Y θ hch e can rerte as θ So, n 2D the decson boundares are alays straght lnes. 7
8 Decson Boundares for AND and OR We can no plot the decson boundares of our logc gates AND, 2, θ.5 OR, 2, θ.5 OR 2 out AND 2 out (, ) (, ) (, ) (, ) (, ) (, ) 2 (, ) (, ) 2 8
9 Decson Boundary for XOR The dffculty n dealng th XOR s rather obvous. We need to straght lnes to separate the dfferent outputs/decsons: XOR 2 out 2 2 Soluton: ether change the transfer functon so that t has more than one decson boundary, or use a more complex netork that s able to generate more complex decson boundares. 9
10 ANN Archtectures Mathematcally, ANNs can be represented as eghted drected graphs. The most common ANN archtectures are: SngleLayer FeedForard NNs: One nput layer and one output layer of processng unts. No feedback connectons (e.g. a Perceptron) MultLayer FeedForard NNs: One nput layer, one output layer, and one or more hdden layers of processng unts. No feedback connectons (e.g. a MultLayer Perceptron) Recurrent NNs: Any netork th at least one feedback connecton. t may, or may not, have hdden unts Further nterestng varatons nclude: sparse connectons, tmedelayed connectons, movng ndos,
11 Examples of Netork Archtectures Sngle Layer MultLayer Recurrent FeedForard FeedForard Netork
12 Types of Actvaton/Transfer Functon Threshold Functon f ( x) f f x x < f(x) x PeceseLnear Functon f ( x) x +.5 f x.5 f.5 x f x.5.5 f(x) x Sgmod Functon f ( x) + e x f(x) x 2
13 3 The Threshold as a Specal Knd of Weght The basc Perceptron equaton can be smplfed f e consder that the threshold s another connecton eght: n n n θ θ K 2 2 f e defne θ and then n n n n K θ The Perceptron equaton then becomes ) sgn( ) sgn( n n Y θ So, e only have to compute the eghts.
14 Example: A Classfcaton Task A typcal neural netork applcaton s classfcaton. Consder the smple example of classfyng trucks gven ther masses and lengths: Mass Length Class Lorry Lorry Van Van Van Lorry Lorry Lorry Lorry Ho do e construct a neural netork that can classfy any Lorry and Van? 4
15 Cookbook Recpe for Buldng Neural Netorks Formulatng neural netork solutons for partcular problems s a multstage process:. Understand and specfy the problem n terms of nputs and requred outputs 2. Take the smplest form of netork you thnk mght be able to solve your problem 3. Try to fnd the approprate connecton eghts (ncludng neuron thresholds) so that the netork produces the rght outputs for each nput n ts tranng data 4. Make sure that the netork orks on ts tranng data and test ts generalzaton by checkng ts performance on ne testng data 5. f the netork doesn t perform ell enough, go back to stage 3 and try harder 6. f the netork stll doesn t perform ell enough, go back to stage 2 and try harder 7. f the netork stll doesn t perform ell enough, go back to stage and try harder 8. Problem solved or not 5
16 Buldng a Neural Netork (stages & 2) For our truck example, our nputs can be drect encodngs of the masses and lengths. Generally e ould have one output unt for each class, th actvaton for yes and for no. n our example, e stll have one output unt, but the actvaton corresponds to lorry and to van (or vce versa). The smplest netork e should try frst s the sngle layer Perceptron. We can further smplfy thngs by replacng the threshold by an extra eght as e dscussed before. Ths gves us: Classsgn( +.Mass+ 2.Length) 2 Mass Length 6
17 Tranng the Neural Netork (stage 3) Whether our neural netork s a smple Perceptron, or a much complcated multlayer netork, e need to develop a systematc procedure for determnng approprate connecton eghts. The common procedure s to have the netork learn the approprate eghts from a representatve set of tranng data. For classfcatons a smple Perceptron uses decson boundares (lnes or hyperplanes), hch t shfts around untl each tranng pattern s correctly classfed. The process of shftng around n a systematc ay s called learnng. The learnng process can then be dvded nto a number of small steps. 7
18 Supervsed Tranng. Generate a tranng par or pattern:  an nput x [ x x 2 x n ]  a target output y target (knon/gven) 2. Then, present the netork th x and allo t to generate an output y 3. Compare y th y target to compute the error 4. Adust eghts,, to reduce error 5. Repeat 24 multple tmes 8
19 Perceptron Learnng Rule. ntalze eghts at random 2. For each tranng par/pattern (x, y target )  Compute output y  Compute error, δ(y target y)  Use the error to update eghts as follos: old η*δ*x or ne old + η*δ*x here η s called the learnng rate or step sze and t determnes ho smoothly the learnng process s takng place. 3. Repeat 2 untl convergence (.e. error δ s zero) The Perceptron Learnng Rule s then gven by ne old + η*δ*x here δ(y target y) 9
Graph Theory and Cayley s Formula
Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll
More informationCausal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting
Causal, Explanatory Forecastng Assumes causeandeffect relatonshp between system nputs and ts output Forecastng wth Regresson Analyss Rchard S. Barr Inputs System Cause + Effect Relatonshp The job of
More informationSupport Vector Machines
Support Vector Machnes Max Wellng Department of Computer Scence Unversty of Toronto 10 Kng s College Road Toronto, M5S 3G5 Canada wellng@cs.toronto.edu Abstract Ths s a note to explan support vector machnes.
More informationMultiple stage amplifiers
Multple stage amplfers Ams: Examne a few common 2transstor amplfers:  Dfferental amplfers  Cascode amplfers  Darlngton pars  current mrrors Introduce formal methods for exactly analysng multple
More informationSolution of Algebraic and Transcendental Equations
CHAPTER Soluton of Algerac and Transcendental Equatons. INTRODUCTION One of the most common prolem encountered n engneerng analyss s that gven a functon f (, fnd the values of for whch f ( = 0. The soluton
More informationNonlinear data mapping by neural networks
Nonlnear data mappng by neural networks R.P.W. Dun Delft Unversty of Technology, Netherlands Abstract A revew s gven of the use of neural networks for nonlnear mappng of hgh dmensonal data on lower dmensonal
More informationThe OC Curve of Attribute Acceptance Plans
The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4
More informationNeural Networks. Hervé Abdi. The University of Texas at Dallas
Neural Netorks. Hervé Abd The Unversty o Texas at Dallas Introducton Neural netorks are adaptve statstcal models based on an analogy th the structure o the bran. They are adaptve because they can learn
More informationPerformance attribution for multilayered investment decisions
Performance attrbuton for multlayered nvestment decsons 880 Thrd Avenue 7th Floor Ne Yor, NY 10022 212.866.9200 t 212.866.9201 f qsnvestors.com Inna Oounova Head of Strategc Asset Allocaton Portfolo Management
More informationLogistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification
Lecture 4: More classfers and classes C4B Machne Learnng Hlary 20 A. Zsserman Logstc regresson Loss functons revsted Adaboost Loss functons revsted Optmzaton Multple class classfcaton Logstc Regresson
More informationII. PROBABILITY OF AN EVENT
II. PROBABILITY OF AN EVENT As ndcated above, probablty s a quantfcaton, or a mathematcal model, of a random experment. Ths quantfcaton s a measure of the lkelhood that a gven event wll occur when the
More informationThe example below solves a system in the unknowns α and β:
The Fnd Functon The functon Fnd returns a soluton to a system of equatons gven by a solve block. You can use Fnd to solve a lnear system, as wth lsolve, or to solve nonlnear systems. The example below
More information9.1 The Cumulative Sum Control Chart
Learnng Objectves 9.1 The Cumulatve Sum Control Chart 9.1.1 Basc Prncples: Cusum Control Chart for Montorng the Process Mean If s the target for the process mean, then the cumulatve sum control chart s
More informationLETTER IMAGE RECOGNITION
LETTER IMAGE RECOGNITION 1. Introducton. 1. Introducton. Objectve: desgn classfers for letter mage recognton. consder accuracy and tme n takng the decson. 20,000 samples: Startng set: mages based on 20
More informationRecurrence. 1 Definitions and main statements
Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.
More information+ + +   This circuit than can be reduced to a planar circuit
MeshCurrent Method The meshcurrent s analog of the nodeoltage method. We sole for a new set of arables, mesh currents, that automatcally satsfy KCLs. As such, meshcurrent method reduces crcut soluton to
More informationCapital asset pricing model, arbitrage pricing theory and portfolio management
Captal asset prcng model, arbtrage prcng theory and portfolo management Vnod Kothar The captal asset prcng model (CAPM) s great n terms of ts understandng of rsk decomposton of rsk nto securtyspecfc rsk
More informationChapter 7. RandomVariate Generation 7.1. Prof. Dr. Mesut Güneş Ch. 7 RandomVariate Generation
Chapter 7 RandomVarate Generaton 7. Contents Inversetransform Technque AcceptanceRejecton Technque Specal Propertes 7. Purpose & Overvew Develop understandng of generatng samples from a specfed dstrbuton
More informationNaïve Bayes classifier & Evaluation framework
Lecture aïve Bayes classfer & Evaluaton framework Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square Generatve approach to classfcaton Idea:. Represent and learn the dstrbuton p x, y. Use t to defne probablstc
More informationThe Magnetic Field. Concepts and Principles. Moving Charges. Permanent Magnets
. The Magnetc Feld Concepts and Prncples Movng Charges All charged partcles create electrc felds, and these felds can be detected by other charged partcles resultng n electrc force. However, a completely
More informationWhat is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More informationImplementation of Deutsch's Algorithm Using Mathcad
Implementaton of Deutsch's Algorthm Usng Mathcad Frank Roux The followng s a Mathcad mplementaton of Davd Deutsch's quantum computer prototype as presented on pages  n "Machnes, Logc and Quantum Physcs"
More informationForecasting the Demand of Emergency Supplies: Based on the CBR Theory and BP Neural Network
700 Proceedngs of the 8th Internatonal Conference on Innovaton & Management Forecastng the Demand of Emergency Supples: Based on the CBR Theory and BP Neural Network Fu Deqang, Lu Yun, L Changbng School
More informationIntroduction: Analysis of Electronic Circuits
/30/008 ntroducton / ntroducton: Analyss of Electronc Crcuts Readng Assgnment: KVL and KCL text from EECS Just lke EECS, the majorty of problems (hw and exam) n EECS 3 wll be crcut analyss problems. Thus,
More information21 Vectors: The Cross Product & Torque
21 Vectors: The Cross Product & Torque Do not use our left hand when applng ether the rghthand rule for the cross product of two vectors dscussed n ths chapter or the rghthand rule for somethng curl
More informationEXPLORATION 2.5A Exploring the motion diagram of a dropped object
5 Acceleraton Let s turn now to moton that s not at constant elocty. An example s the moton of an object you release from rest from some dstance aboe the floor. EXPLORATION.5A Explorng the moton dagram
More informationOverview. Naive Bayes Classifiers. A Sample Data Set. Frequencies and Probabilities. Connectionist and Statistical Language Processing
Overvew Nave Bayes Classfers Connectonst and Statstcal Language Processng Frank Keller keller@col.unsb.de Computerlngustk Unverstät des Saarlandes Sample data set wth frequences and probabltes Classfcaton
More informationMultiple discount and forward curves
Multple dscount and forward curves TopQuants presentaton 21 ovember 2012 Ton Broekhuzen, Head Market Rsk and Basel coordnator, IBC Ths presentaton reflects personal vews and not necessarly the vews of
More informationDETERMINATION THERMODYNAMIC PROPERTIES OF WATER AND STEAM
DETERMINATION THERMODYNAMIC PROPERTIES OF WATER AND STEAM S. Sngr, J. Spal Afflaton Abstract Ths work presents functons of thermodynamc parameters developed n MATLAB. There are functons to determne: saturaton
More informationA Fault Tree Analysis Strategy Using Binary Decision Diagrams.
A Fault Tree Analyss Strategy Usng Bnary Decson Dagrams. Karen A. Reay and John D. Andrews Loughborough Unversty, Loughborough, Lecestershre, LE 3TU. Abstract The use of Bnary Decson Dagrams (BDDs) n fault
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationForecasting the Direction and Strength of Stock Market Movement
Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract  Stock market s one of the most complcated systems
More informationCHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES
CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES In ths chapter, we wll learn how to descrbe the relatonshp between two quanttatve varables. Remember (from Chapter 2) that the terms quanttatve varable
More informationSingle and multiple stage classifiers implementing logistic discrimination
Sngle and multple stage classfers mplementng logstc dscrmnaton Hélo Radke Bttencourt 1 Dens Alter de Olvera Moraes 2 Vctor Haertel 2 1 Pontfíca Unversdade Católca do Ro Grande do Sul  PUCRS Av. Ipranga,
More informationAn Alternative Way to Measure Private Equity Performance
An Alternatve Way to Measure Prvate Equty Performance Peter Todd Parlux Investment Technology LLC Summary Internal Rate of Return (IRR) s probably the most common way to measure the performance of prvate
More informationTHE METHOD OF LEAST SQUARES THE METHOD OF LEAST SQUARES
The goal: to measure (determne) an unknown quantty x (the value of a RV X) Realsaton: n results: y 1, y 2,..., y j,..., y n, (the measured values of Y 1, Y 2,..., Y j,..., Y n ) every result s encumbered
More informationCHAPTER 14 MORE ABOUT REGRESSION
CHAPTER 14 MORE ABOUT REGRESSION We learned n Chapter 5 that often a straght lne descrbes the pattern of a relatonshp between two quanttatve varables. For nstance, n Example 5.1 we explored the relatonshp
More informationLinear Circuits Analysis. Superposition, Thevenin /Norton Equivalent circuits
Lnear Crcuts Analyss. Superposton, Theenn /Norton Equalent crcuts So far we hae explored tmendependent (resste) elements that are also lnear. A tmendependent elements s one for whch we can plot an / cure.
More informationCalculation of Sampling Weights
Perre Foy Statstcs Canada 4 Calculaton of Samplng Weghts 4.1 OVERVIEW The basc sample desgn used n TIMSS Populatons 1 and 2 was a twostage stratfed cluster desgn. 1 The frst stage conssted of a sample
More information1 Example 1: Axisaligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationA Probabilistic Theory of Coherence
A Probablstc Theory of Coherence BRANDEN FITELSON. The Coherence Measure C Let E be a set of n propostons E,..., E n. We seek a probablstc measure C(E) of the degree of coherence of E. Intutvely, we want
More informationThe covariance is the two variable analog to the variance. The formula for the covariance between two variables is
Regresson Lectures So far we have talked only about statstcs that descrbe one varable. What we are gong to be dscussng for much of the remander of the course s relatonshps between two or more varables.
More informationgreatest common divisor
4. GCD 1 The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no
More informationPing Pong Fun  Video Analysis Project
Png Pong Fun  Vdeo Analyss Project Objectve In ths experment we are gong to nvestgate the projectle moton of png pong balls usng Verner s Logger Pro Software. Does the object travel n a straght lne? What
More informationDescriptive Models. Cluster Analysis. Example. General Applications of Clustering. Examples of Clustering Applications
CMSC828G Prncples of Data Mnng Lecture #9 Today s Readng: HMS, chapter 9 Today s Lecture: Descrptve Modelng Clusterng Algorthms Descrptve Models model presents the man features of the data, a global summary
More information1. Measuring association using correlation and regression
How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a
More information2 The TTL Inverter. (i) An input transistor, T 1, which performs a current steering function, can be thought of as a backtoback diode arrangement.
The TTL Inverter.1 Crcut Structure The crcut dagram of the Transstor Transstor Logc nverter s shown n Fg..1. Ths crcut overcomes the lmtatons of the sngle transstor nverter crcut. Some of the notable features
More informationTHE APPLICATION OF DATA MINING TECHNIQUES AND MULTIPLE CLASSIFIERS TO MARKETING DECISION
Internatonal Journal of Electronc Busness Management, Vol. 3, No. 4, pp. 3030 (2005) 30 THE APPLICATION OF DATA MINING TECHNIQUES AND MULTIPLE CLASSIFIERS TO MARKETING DECISION YuMn Chang *, YuCheh
More informationQuestions that we may have about the variables
Antono Olmos, 01 Multple Regresson Problem: we want to determne the effect of Desre for control, Famly support, Number of frends, and Score on the BDI test on Perceved Support of Latno women. Dependent
More informationThinking about Newton's Laws
Newtonan modellng In ths actvty you wll see how Newton s Laws of Moton are used to connect the moton of an object wth the forces actng on t. You wll practse applyng Newton s three laws n some real contexts.
More informationCommunication Networks II Contents
8 / 1  Communcaton Networs II (Görg)  www.comnets.unbremen.de Communcaton Networs II Contents 1 Fundamentals of probablty theory 2 Traffc n communcaton networs 3 Stochastc & Marovan Processes (SP
More informationStatistical algorithms in Review Manager 5
Statstcal algorthms n Reve Manager 5 Jonathan J Deeks and Julan PT Hggns on behalf of the Statstcal Methods Group of The Cochrane Collaboraton August 00 Data structure Consder a metaanalyss of k studes
More informationResearch on Credit Risk Evaluation for Small and Mediumsized Enterprises in Supply Chain Based on BP Neural Network Xiaoping Zhang a, Chen Chen b
Internatonal Conference on Computatonal Scence and Engneerng (ICCSE 2015) Research on Credt Rsk Evaluaton for Small and Medumszed Enterprses n Supply Chan Based on BP Neural Network Xaopng Zhang a, Chen
More informationFinite Math Chapter 10: Study Guide and Solution to Problems
Fnte Math Chapter 10: Study Gude and Soluton to Problems Basc Formulas and Concepts 10.1 Interest Basc Concepts Interest A fee a bank pays you for money you depost nto a savngs account. Prncpal P The amount
More informationPortfolio Risk Decomposition (and Risk Budgeting)
ortfolo Rsk Decomposton (and Rsk Budgetng) Jason MacQueen RSquared Rsk Management Introducton to Rsk Decomposton Actve managers take rsk n the expectaton of achevng outperformance of ther benchmark Mandates
More informationINTRODUCTION. governed by a differential equation Need systematic approaches to generate FE equations
WEIGHTED RESIDUA METHOD INTRODUCTION Drect stffness method s lmted for smple D problems PMPE s lmted to potental problems FEM can be appled to many engneerng problems that are governed by a dfferental
More informationVRT012 User s guide V0.1. Address: Žirmūnų g. 27, Vilnius LT09105, Phone: (3705) 2127472, Fax: (3705) 276 1380, Email: info@teltonika.
VRT012 User s gude V0.1 Thank you for purchasng our product. We hope ths userfrendly devce wll be helpful n realsng your deas and brngng comfort to your lfe. Please take few mnutes to read ths manual
More informationPassive Filters. References: Barbow (pp 265275), Hayes & Horowitz (pp 3260), Rizzoni (Chap. 6)
Passve Flters eferences: Barbow (pp 6575), Hayes & Horowtz (pp 360), zzon (Chap. 6) Frequencyselectve or flter crcuts pass to the output only those nput sgnals that are n a desred range of frequences (called
More informationHarvard University Division of Engineering and Applied Sciences. Fall Lecture 3: The Systems Approach  Electrical Systems
Harvard Unversty Dvson of Engneerng and Appled Scences ES 45/25  INTRODUCTION TO SYSTEMS ANALYSIS WITH PHYSIOLOGICAL APPLICATIONS Fall 2000 Lecture 3: The Systems Approach  Electrcal Systems In the last
More informationIntraday Trading of the FTSE100 Futures Contract Using Neural Networks With Wavelet Encodings
Submtted to European Journal of Fnance Intraday Tradng of the FTSE00 Futures Contract Usng eural etworks Wth Wavelet Encodngs D L Toulson S P Toulson Intellgent Fnancal Systems Lmted Sute 4 Greener House
More informationHYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION
HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION Abdul Ghapor Hussn Centre for Foundaton Studes n Scence Unversty of Malaya 563 KUALA LUMPUR Emal: ghapor@umedumy Abstract Ths paper
More informationAPPLICATION OF NEURAL NETWORKS TO ACCELERATION CONTROL OF ELECTRIC WHEELCHAIR
Potr BOJARCZAK Zbgnew GORYCA APPLICATION OF NEURAL NETWORKS TO ACCELERATION CONTROL OF ELECTRIC WHEELCHAIR ABTRACT In ths paper the acceleraton block of controllng software of electrc wheelchar has been
More information9 Arithmetic and Geometric Sequence
AAU  Busness Mathematcs I Lecture #5, Aprl 4, 010 9 Arthmetc and Geometrc Sequence Fnte sequence: 1, 5, 9, 13, 17 Fnte seres: 1 + 5 + 9 + 13 +17 Infnte sequence: 1,, 4, 8, 16,... Infnte seres: 1 + + 4
More informationCS 2750 Machine Learning. Lecture 17a. Clustering. CS 2750 Machine Learning. Clustering
Lecture 7a Clusterng Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square Clusterng Groups together smlar nstances n the data sample Basc clusterng problem: dstrbute data nto k dfferent groups such that
More informationClustering Gene Expression Data. (Slides thanks to Dr. Mark Craven)
Clusterng Gene Epresson Data Sldes thanks to Dr. Mark Craven Gene Epresson Proles we ll assume we have a D matr o gene epresson measurements rows represent genes columns represent derent eperments tme
More informationSIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA
SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA E. LAGENDIJK Department of Appled Physcs, Delft Unversty of Technology Lorentzweg 1, 68 CJ, The Netherlands Emal: e.lagendjk@tnw.tudelft.nl
More informationProbabilistic Linear Classifier: Logistic Regression. CS534Machine Learning
robablstc Lnear Classfer: Logstc Regresson CS534Machne Learnng Three Man Approaches to learnng a Classfer Learn a classfer: a functon f, ŷ f Learn a probablstc dscrmnatve model,.e., the condtonal dstrbuton
More informationSimple Interest Loans (Section 5.1) :
Chapter 5 Fnance The frst part of ths revew wll explan the dfferent nterest and nvestment equatons you learned n secton 5.1 through 5.4 of your textbook and go through several examples. The second part
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationCS 2750 Machine Learning. Lecture 3. Density estimation. CS 2750 Machine Learning. Announcements
Lecture 3 Densty estmaton Mlos Hauskrecht mlos@cs.ptt.edu 5329 Sennott Square Next lecture: Matlab tutoral Announcements Rules for attendng the class: Regstered for credt Regstered for audt (only f there
More informationExperiment 8 Two Types of Pendulum
Experment 8 Two Types of Pendulum Preparaton For ths week's quz revew past experments and read about pendulums and harmonc moton Prncples Any object that swngs back and forth can be consdered a pendulum
More informationNMT EE 589 & UNM ME 482/582 ROBOT ENGINEERING. Dr. Stephen Bruder NMT EE 589 & UNM ME 482/582
NMT EE 589 & UNM ME 482/582 ROBOT ENGINEERING Dr. Stephen Bruder NMT EE 589 & UNM ME 482/582 7. Root Dynamcs 7.2 Intro to Root Dynamcs We now look at the forces requred to cause moton of the root.e. dynamcs!!
More informationImproved Methods of Geometric Shape Recognition using Fuzzy and Neural Techniques
Buletnul Stntfc al Unverstat Poltehnca dn Tmsoara, ROMANIA Sera AUTOMATICA s CALCULATOARE PERIODICA POLITECHNICA, Transactons on AUTOMATIC CONTROL and COMPUTER SCIENCE Vol.49 (63, 2004, ISSN 224600X Improved
More informationA study on the ability of Support Vector Regression and Neural Networks to Forecast Basic Time Series Patterns
A study on the ablty of Support Vector Regresson and Neural Networks to Forecast Basc Tme Seres Patterns Sven F. Crone, Jose Guajardo 2, and Rchard Weber 2 Lancaster Unversty, Department of Management
More informationEE 4343 Lab#1 Identification of Static Motor Module Parameters
EE 4343 Lab# Identfcaton of Statc Motor Module Parameters Prepared by: Stacy Cason Updated: Wednesday, May 26, 999 The block dagram for the DC motor module to be used n today s lab s shown below. (Fgure
More informationFormulating & Solving Integer Problems Chapter 11 289
Formulatng & Solvng Integer Problems Chapter 11 289 The Optonal Stop TSP If we drop the requrement that every stop must be vsted, we then get the optonal stop TSP. Ths mght correspond to a ob sequencng
More informationSolder paste inspection and 3D shape estimation using directional LED lightings
Ttle Solder paste nspecton and 3D shape estmaton usng drectonal LED lghtngs Advsor(s Pang, GKH Author(s Chu, Mnghe.; 朱 銘 熙. Ctaton Issued Date 27 UL http://hdl.handle.net/722/5552 ghts The author retans
More informationb) The mean of the fitted (predicted) values of Y is equal to the mean of the Y values: c) The residuals of the regression line sum up to zero: = ei
Mathematcal Propertes of the Least Squares Regresson The least squares regresson lne obeys certan mathematcal propertes whch are useful to know n practce. The followng propertes can be establshed algebracally:
More informationMoment of a force about a point and about an axis
3. STATICS O RIGID BODIES In the precedng chapter t was assumed that each of the bodes consdered could be treated as a sngle partcle. Such a vew, however, s not always possble, and a body, n general, should
More informationFace Verification Problem. Face Recognition Problem. Application: Access Control. Biometric Authentication. Face Verification (1:1 matching)
Face Recognton Problem Face Verfcaton Problem Face Verfcaton (1:1 matchng) Querymage face query Face Recognton (1:N matchng) database Applcaton: Access Control www.vsage.com www.vsoncs.com Bometrc Authentcaton
More informationWe assume your students are learning about selfregulation (how to change how alert they feel) through the Alert Program with its three stages:
Welcome to ALERT BINGO, a funflled and educatonal way to learn the fve ways to change engnes levels (Put somethng n your Mouth, Move, Touch, Look, and Lsten) as descrbed n the How Does Your Engne Run?
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationChapter 6. Classification and Prediction
Chapter 6. Classfcaton and Predcton What s classfcaton? What s Lazy learners (or learnng from predcton? your neghbors) Issues regardng classfcaton and Frequentpatternbased predcton classfcaton Classfcaton
More informationNaive Rule Induction for Text Classification based on Keyphrases
Nave Rule Inducton for Text Classfcaton based on Keyphrases Nktas N. Karankolas & Chrstos Skourlas Department of Informatcs, Technologcal Educatonal Insttute of Athens, Greece. Abstract In ths paper,
More informationFlow Factor Prediction of Centrifugal Hydraulic Turbine for Sea Water Reverse Osmosis (SWRO)
Internatonal Journal of Flud Machnery and Systems DOI: 1.593/IJFMS.1.3.4.369 Vol. 3, o.4, OctoberDecember 1 ISS (Onlne): 1889554 Orgnal Paper Flow Factor Predcton of Centrfugal Hydraulc Turbne for Sea
More information6. EIGENVALUES AND EIGENVECTORS 3 = 3 2
EIGENVALUES AND EIGENVECTORS The Characterstc Polynomal If A s a square matrx and v s a nonzero vector such that Av v we say that v s an egenvector of A and s the correspondng egenvalue Av v Example :
More informationMath 31 Lesson Plan. Day 27: Fundamental Theorem of Finite Abelian Groups. Elizabeth Gillaspy. November 11, 2011
Math 31 Lesson Plan Day 27: Fundamental Theorem of Fnte Abelan Groups Elzabeth Gllaspy November 11, 2011 Supples needed: Colored chal Quzzes Homewor 4 envelopes: evals, HW, presentaton rubrcs, * probs
More informationLossless Data Compression
Lossless Data Compresson Lecture : Unquely Decodable and Instantaneous Codes Sam Rowes September 5, 005 Let s focus on the lossless data compresson problem for now, and not worry about nosy channel codng
More informationUNIVERSITY OF TRENTO THE DIGITAL KERNEL PERCEPTRON. Davide Anguita, Andrea Boni and Sandro Ridella. Technical Report # DIT
UNIVERSITY OF TRENTO DEPARTMENT OF INFORMATION AND COMMUNICATION TECHNOLOGY 38050 Povo Trento (Italy), Va Sommarve 14 http://www.dt.untn.t THE DIGITAL KERNEL PERCEPTRON Davde Anguta, Andrea Bon and Sandro
More informationState function: eigenfunctions of hermitian operators> normalization, orthogonality completeness
Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators> normalzaton, orthogonalty completeness egenvalues and
More informationCLUSTER SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR 1
amplng Theory MODULE IX LECTURE  30 CLUTER AMPLIG DR HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR It s one of the asc assumptons n any samplng procedure that the populaton
More informationLeast Squares Fitting of Data
Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 19982016. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng
More informationFrequency Selective IQ Phase and IQ Amplitude Imbalance Adjustments for OFDM Direct Conversion Transmitters
Frequency Selectve IQ Phase and IQ Ampltude Imbalance Adjustments for OFDM Drect Converson ransmtters Edmund Coersmeer, Ernst Zelnsk Noka, Meesmannstrasse 103, 44807 Bochum, Germany edmund.coersmeer@noka.com,
More informationDesign of Output Codes for Fast Covering Learning using Basic Decomposition Techniques
Journal of Computer Scence (7): 56557, 6 ISSN 5966 6 Scence Publcatons Desgn of Output Codes for Fast Coverng Learnng usng Basc Decomposton Technques Aruna Twar and Narendra S. Chaudhar, Faculty of Computer
More informationApplication of RBF Network in Rotor Time Constant Adaptation
ELECTONIC AND ELECTICAL ENGINEEING IN 1392 1215 2011. No. 7(113) ELEKTONIKA I ELEKTOTECHNIKA ELECTICAL ENGINEEING T 190 ELEKTO INŽINEIJA Applcaton of BF Network n otor Tme Constant Adaptaton P. Brandstetter,
More informationFigure 1. Training and Test data sets for Nasdaq100 Index (b) NIFTY index
Modelng Chaotc Behavor of Stock Indces Usng Intellgent Paradgms Ajth Abraham, Nnan Sajth Phlp and P. Saratchandran Department of Computer Scence, Oklahoma State Unversty, ulsa, Oklahoma 746, USA, Emal:
More informationPerformance Analysis and Coding Strategy of ECOC SVMs
Internatonal Journal of Grd and Dstrbuted Computng Vol.7, No. (04), pp.6776 http://dx.do.org/0.457/jgdc.04.7..07 Performance Analyss and Codng Strategy of ECOC SVMs Zhgang Yan, and Yuanxuan Yang, School
More informationECE544NA Final Project: Robust Machine Learning Hardware via Classifier Ensemble
1 ECE544NA Fnal Project: Robust Machne Learnng Hardware va Classfer Ensemble Sa Zhang, szhang12@llnos.edu Dept. of Electr. & Comput. Eng., Unv. of Illnos at UrbanaChampagn, Urbana, IL, USA Abstract In
More informationDevelopment of an intelligent system for tool wear monitoring applying neural networks
of Achevements n Materals and Manufacturng Engneerng VOLUME 14 ISSUE 12 JanuaryFebruary 2006 Development of an ntellgent system for tool wear montorng applyng neural networks A. Antć a, J. Hodolč a,
More informationBERNSTEIN POLYNOMIALS
OnLne Geometrc Modelng Notes BERNSTEIN POLYNOMIALS Kenneth I. Joy Vsualzaton and Graphcs Research Group Department of Computer Scence Unversty of Calforna, Davs Overvew Polynomals are ncredbly useful
More information