Nonlinear data mapping by neural networks


 Myles Robbins
 2 years ago
 Views:
Transcription
1 Nonlnear data mappng by neural networks R.P.W. Dun Delft Unversty of Technology, Netherlands Abstract A revew s gven of the use of neural networks for nonlnear mappng of hgh dmensonal data on lower dmensonal structures. Both, unsupervsed and supervsed technques are consdered. Keywords: Nonlnear data mappng, neural networks, supervsed, unsupervsed, feedforward networks, selforgansng maps, vector quantzaton Introducton to nonlnear mappng The analyss of hghdmensonal data has an ncreasng mportance due to the growth of sensor resoluton and computer memory capacty. Typcal examples are mages, speech sgnals and multsensor data. In the analyss of these sgnals they are represented n ther entrety or part by part n a sample space. As an example, a sngle data pont may represent a 6x6 (sub)mage. A collecton of these mages consttutes a cloud of ponts n a 256dmensonal space. In most multsensor data sets there s a large dependency between the sensors or between the sensor elements. Ths s certanly true for nearby mage pxels. But also more fundamentally, t s not to be expected that any physcal experment contans hundreds of degrees of freedom that are of sgnfcant mportance. Consequently, multdmensonal data sets may be represented by lower dmensonal descrptons. There are varous reasons why such representatons may be of nterest. They may reveal the structure of the data or the problem, they may be used for relatng ndvdual data ponts to each other (e.g. fndng the most smlar one n a database) or they may be used for retrevng mssng data values. Below ths wll be defned more formally. The followng representatons of a set of kdmensonal data ponts x (x, x 2,..., x j,..., x k ), x R k defned by X {x,x 2,..., x,... x m wll be dscussed here: a. A set of prototypes Z {z,z 2,..., z,... z n wth z R k,.e. a small number of data ponts n the same data space, n < m, selected or constructed n such a way that each of the orgnal ponts x s nearby one of the prototypes z. So Z s chosen such that:  mn m j { x z j () s mnmsed.the dmensonalty of data space tself s not reduced. The reducton s realsed by assgnng new data ponts x to one out of a set of known prototypes. y argmn z j { x z j (2) Ths mght be used, for example, n codng applcatons. Sets of prototypes are therefore also addressed as codebooks. b. A subspace y g(x,θ) wth y R k, θ R k, k < k,.e. a structure havng a lower dmensonalty than the orgnal data space. Each of the data ponts wll be close to or n such a subspace. A natural crteron s the mean square error:
2  x m y 2 (3) c. A probablty densty functon f(x). Ths gves for each pont n the data space the probablty densty that a data pont s found there. If ths s done well the denstes of the data ponts n X wll be hgh, as measured by the maxmum lkelhood crteron: log( f( x )) In each of these cases we have a crteron for optmzng a map M, a rule for mappng new data ponts on M and a dstance D M (x) of that pont to the map. A partcular way to apply ths s the completon of ncomplete data. Let a data vector x consst out of a known part x and an unknown part y, so x (x,y). For a gven map M one can now fnd the vector y that mnmses D M (x): (4) ŷ argmn y ( D M ( x) ) argmn y ( D M ( x', y) ) (5) It has to be realsed that the above way for optmzng M (e.g. Equaton 3) s not focused on mnmsng the error n ŷ as t uses the dstance between the map and the entre vector x. In contrast to ths unsupervsed tranng of maps the technque of supervsed tranng can be defned usng some error measure E( ŷ,y) between an estmated and a desred vector y: Choose M such that for the set of gven data vectors {(x,y ),,m E( argmn y ( D M ( x', y), y )) s mnmum. (6) 2 Neural network mappng Nonlnear maps can be represented by neural networks. These are collectons of almost dentcal smple operators (neurons) each contrbutng partally to the map, e.g.: y ( N j ( x), j, n) (7) y y 2 n whch N j (x) s a sngle neuron computng one component of y. Such a set of parallel neurons may be nested: y ( N j2 ( N j ( x), j, n ), j, n 2 ) (8) In ths case the orgnal data vectors x are mapped on a frst layer of n nput neurons. Ther outputs are mapped on a second layer of n 2 output neurons. Thereby y has n 2 Fgure : 2layer neural network components. Ths can be represented n a graphcal way lke gven n Fgure. The neurons n the frst (nput) layer have k nputs (here k 7). The neurons n the second (output) layer have 5 nputs. All neurons have just a sngle output value. So ths network maps a 7dmensonal space frst on a 5dmensonal space and then on 2dmensonal space. x x k 2
3 In each neuron a dfferent set of weghts may be stored that makes ther operaton dfferent from the other neurons. If a neuron has k nputs the sze of ths set s usually k+: one weght for each nput, consttutng a kdmensonal vector w and an addtonal constant w 0, often called bas. Two very common types of neurons are the the spatal neurons and the drectonal neurons. The spatal neurons can be thought to be located at a partcular pont n ther nput space. Ther weghts represent ths locaton. The bas may represent a sze parameter determnng the sze of some nfluence sphere. Such a neuron may thereby be defned as: N( xww, 0 ) exp{ x w w 0 (9) Ths neuron yelds a hgh output value for nput data vectors that are close to ther locaton (relatve to w 0 ). Ths neuron transfer functon s called a radal bass functon. The drectonal neurons can be thought to represent a drecton n ther nput space. Ther outputs are related to the angles between the nput data vectors and ther weght vectors, e.g.: N( xww, 0 ) exp{ w x w 0 (0) Ths neuron transfer functon s called a sgmodal functon or just sgmod. Note that the transfer functons as defned by Equaton 9 and Equaton 0 yeld values between 0 and. It s very common the scale the values wthn neural network layers n ths way. Sometmes they are scaled between  and +. In order to be able to produce arbtrary output values n the output layer lnear transfer functon have to be used: N ( xww, 0 ) w x+ w 0 () The feedforward network as gven n Fgure can be used for all three types of mappngs gven n the frst secton. Prototypes can be represented by radal bass functons n the nput layer. The dstance between an nput vector and the set of prototypes s defned n the output layer. If sgmodal outputs are used the network represents some probablty densty functon f the outputs are correctly normalsed. A feedforward networks wth just sgmodal transfer functon represents a mappng by nonlnear subspaces. Another common type of neural networks s the selforgansng map (SOM) or Kohonen network as shown n Fgure 2. In ths network of spatal neurons, the neurons are not connected. They thereby represent a set of prototypes. Durng the optmzaton of the network some connectvty s assumed. Ths wll further be dscussed below. Fgure 2: Archtecture of a 2D selforgansng map. 3 Unsupervsed technques We wll now gve some examples on how neural networks can be traned n an unsupervsed way. The three mappng types gven n the ntroducton wll be treated separately. 3
4 3. Prototypes by vector quantzaton Suppose we have an ntal set of prototypes (e.g. a random selecton of the orgnal data set) Z{z,z 2,..., z,... z n. A very smple way of updatng ths set s by determnng the subsets X X,,n such that X contans all vectors n X that have z as ther nearest prototype. Now all prototypes are replaced by the means of the data vectors n the correspondng X. Ths s reterated untl stablty. Ths procedure s called the kmeans method. A sequental procedure can be defned by: z j z j + α(t)[x  z j ] f z j s the nearest prototype of x (2) repeat for,m teratvely repeat wth decreasng α(t). Formally ths procedure has not much relaton wth neural networks. It s, however, for hstorcal reasons treated n connecton wth these. 3.2 Subspaces by neural networks 3.2. Subspaces by selforgansng maps (SOMs) Subspaces can be found n relaton wth the above treated vector quantzaton method by condtonng the set of prototypes n a grd of the desred subspace dmensonalty. Most popular s the use of a n x n grd of n 2 neurons representng n 2 prototypes. Ths structure s emphaszed and preserved by replacng the above update rule by: z j z j + α jk (t)[x  z j ] f z j s the nearest prototype of x and z k s wthn some predefned grd neghbourhood of z j. α jk (t) s a weghtng functon that decreases wth the number of teratons and wth the grd dstance between z j and z k. Ths procedure may be followed for structures of any dmenson. In practce, however, just one, two, and sometmes threedmensonal grds are used. For more dmensons too many neurons wll be needed Subspaces by dabolo feedforward networks n 4 k n 3 n n 2 n Feedforward networks as gven n Fgure represent n each layer a subspace. If t s possble to map the nput data on a partcular layer a reconstructon by followng layers x should be possble, see Fgure 3. The 3rd and the 4th layer x k Fgure 3: 4layer dabolo network restore the orgnal data vectors after they are mapped on the 2nd layer. Tranng should be done by mnmzng the dfference between nputs and outputs of the entre network. In fact ths s a supervsed procedure, see below. The data set tself, however, does not contan any target values. Thereby ths s a supervsed soluton of a nonsupervsed problem. 4
5 3.3 Probablty densty functons In ths case the neural network outputs are consdered as probablty denstes. For that reason the output layer consst of a sngle neuron and has a lnear transfer functon. Usually the frst layer has radal bass transfer functons. A good network yelds hgh outputs for the tranng data vectors. The maxmum lkelhood crteron s thereby often chosen for optmzng the network: log( ) y (3) 4 Supervsed technques We wll now gve some examples on how neural networks can be traned n an supervsed way. Recall that n ths case the gven data set X conssts of vectors x (x,y) and that networks have to be found that estmate y as correctly as possble f the part x s gven. 4. Prototypes by learnng vector quantzaton The qualty of prototypes has to be judged on the bass of the dstance between the desred and the estmated yvalues (targets). Equaton 2 mght therefore be replaced by somethng lke z j z j + Α(t)[x  z j ] f z j s the nearest prototype of x (4) n whch the matrx A(t) has larger values for the target components. 4.2 Subspaces by neural networks Ths problem s the tradtonal use of the feedforward network, Fgure. The network outputs are the target values. Agan lnear output transfer functons mght be needed. A dabolo network s not necessary now. A wde range of network optmzaton technques s avalable. Tradtonally backpropagaton s used, an teratve gradent descent technque. Faster technques, especally for smaller networks, mght be preferred. 4.3 Probablty densty functons The unsupervsed soluton can be appled also here. If the jont probablty densty functon for x [x,y] s estmated by f(x,y), the yvalue for a gven x mght be found by ŷ argm ax y ( f( x', y) ) (5) References.C. Mao and A.K. an, Artfcal neural networks for feature extracton and multvarate data projecton, IEEE Transactons on Neural Networks, vol. 6, no. 2, 995, A.K. an,. Mao, and K.M. Mohuddn, Artfcal Neural Networks: A Tutoral, Computer, vol. 29, no. 3, pp. 344, T. Kohonen, Selforganzng maps, Sprnger, Berln, C.M. Bshop, Neural networks for pattern recognton, Clarendon Press, Oxford, B.D. Rpley, Pattern recognton and neural networks, Cambrdge Unversty Press, Cambrdge,
What is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More informationFace Verification Problem. Face Recognition Problem. Application: Access Control. Biometric Authentication. Face Verification (1:1 matching)
Face Recognton Problem Face Verfcaton Problem Face Verfcaton (1:1 matchng) Querymage face query Face Recognton (1:N matchng) database Applcaton: Access Control www.vsage.com www.vsoncs.com Bometrc Authentcaton
More informationL10: Linear discriminants analysis
L0: Lnear dscrmnants analyss Lnear dscrmnant analyss, two classes Lnear dscrmnant analyss, C classes LDA vs. PCA Lmtatons of LDA Varants of LDA Other dmensonalty reducton methods CSCE 666 Pattern Analyss
More informationForecasting the Demand of Emergency Supplies: Based on the CBR Theory and BP Neural Network
700 Proceedngs of the 8th Internatonal Conference on Innovaton & Management Forecastng the Demand of Emergency Supples: Based on the CBR Theory and BP Neural Network Fu Deqang, Lu Yun, L Changbng School
More informationMultivariate EWMA Control Chart
Multvarate EWMA Control Chart Summary The Multvarate EWMA Control Chart procedure creates control charts for two or more numerc varables. Examnng the varables n a multvarate sense s extremely mportant
More informationForecasting the Direction and Strength of Stock Market Movement
Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract  Stock market s one of the most complcated systems
More informationLecture 2: Single Layer Perceptrons Kevin Swingler
Lecture 2: Sngle Layer Perceptrons Kevn Sngler kms@cs.str.ac.uk Recap: McCullochPtts Neuron Ths vastly smplfed model of real neurons s also knon as a Threshold Logc Unt: W 2 A Y 3 n W n. A set of synapses
More informationSingle and multiple stage classifiers implementing logistic discrimination
Sngle and multple stage classfers mplementng logstc dscrmnaton Hélo Radke Bttencourt 1 Dens Alter de Olvera Moraes 2 Vctor Haertel 2 1 Pontfíca Unversdade Católca do Ro Grande do Sul  PUCRS Av. Ipranga,
More informationHYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION
HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION Abdul Ghapor Hussn Centre for Foundaton Studes n Scence Unversty of Malaya 563 KUALA LUMPUR Emal: ghapor@umedumy Abstract Ths paper
More informationLogistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification
Lecture 4: More classfers and classes C4B Machne Learnng Hlary 20 A. Zsserman Logstc regresson Loss functons revsted Adaboost Loss functons revsted Optmzaton Multple class classfcaton Logstc Regresson
More informationThe Development of Web Log Mining Based on ImproveKMeans Clustering Analysis
The Development of Web Log Mnng Based on ImproveKMeans Clusterng Analyss TngZhong Wang * College of Informaton Technology, Luoyang Normal Unversty, Luoyang, 471022, Chna wangtngzhong2@sna.cn Abstract.
More informationTHE METHOD OF LEAST SQUARES THE METHOD OF LEAST SQUARES
The goal: to measure (determne) an unknown quantty x (the value of a RV X) Realsaton: n results: y 1, y 2,..., y j,..., y n, (the measured values of Y 1, Y 2,..., Y j,..., Y n ) every result s encumbered
More informationVision Mouse. Saurabh Sarkar a* University of Cincinnati, Cincinnati, USA ABSTRACT 1. INTRODUCTION
Vson Mouse Saurabh Sarkar a* a Unversty of Cncnnat, Cncnnat, USA ABSTRACT The report dscusses a vson based approach towards trackng of eyes and fngers. The report descrbes the process of locatng the possble
More informationThe OC Curve of Attribute Acceptance Plans
The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4
More informationCS 2750 Machine Learning. Lecture 3. Density estimation. CS 2750 Machine Learning. Announcements
Lecture 3 Densty estmaton Mlos Hauskrecht mlos@cs.ptt.edu 5329 Sennott Square Next lecture: Matlab tutoral Announcements Rules for attendng the class: Regstered for credt Regstered for audt (only f there
More informationLETTER IMAGE RECOGNITION
LETTER IMAGE RECOGNITION 1. Introducton. 1. Introducton. Objectve: desgn classfers for letter mage recognton. consder accuracy and tme n takng the decson. 20,000 samples: Startng set: mages based on 20
More informationCS 2750 Machine Learning. Lecture 17a. Clustering. CS 2750 Machine Learning. Clustering
Lecture 7a Clusterng Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square Clusterng Groups together smlar nstances n the data sample Basc clusterng problem: dstrbute data nto k dfferent groups such that
More informationDescriptive Models. Cluster Analysis. Example. General Applications of Clustering. Examples of Clustering Applications
CMSC828G Prncples of Data Mnng Lecture #9 Today s Readng: HMS, chapter 9 Today s Lecture: Descrptve Modelng Clusterng Algorthms Descrptve Models model presents the man features of the data, a global summary
More information320 The Internatonal Arab Journal of Informaton Technology, Vol. 5, No. 3, July 2008 Comparsons Between Data Clusterng Algorthms Osama Abu Abbas Computer Scence Department, Yarmouk Unversty, Jordan Abstract:
More informationLecture 18: Clustering & classification
O CPS260/BGT204. Algorthms n Computatonal Bology October 30, 2003 Lecturer: Pana K. Agarwal Lecture 8: Clusterng & classfcaton Scrbe: Daun Hou Open Problem In HomeWor 2, problem 5 has an open problem whch
More informationData Visualization by Pairwise Distortion Minimization
Communcatons n Statstcs, Theory and Methods 34 (6), 005 Data Vsualzaton by Parwse Dstorton Mnmzaton By Marc Sobel, and Longn Jan Lateck* Department of Statstcs and Department of Computer and Informaton
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationv a 1 b 1 i, a 2 b 2 i,..., a n b n i.
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 455 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces we have studed thus far n the text are real vector spaces snce the scalars are
More informationCommunication Networks II Contents
8 / 1  Communcaton Networs II (Görg)  www.comnets.unbremen.de Communcaton Networs II Contents 1 Fundamentals of probablty theory 2 Traffc n communcaton networs 3 Stochastc & Marovan Processes (SP
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationUsing Mixture Covariance Matrices to Improve Face and Facial Expression Recognitions
Usng Mxture Covarance Matrces to Improve Face and Facal Expresson Recogntons Carlos E. homaz, Duncan F. Glles and Raul Q. Fetosa 2 Imperal College of Scence echnology and Medcne, Department of Computng,
More informationQUANTUM MECHANICS, BRAS AND KETS
PH575 SPRING QUANTUM MECHANICS, BRAS AND KETS The followng summares the man relatons and defntons from quantum mechancs that we wll be usng. State of a phscal sstem: The state of a phscal sstem s represented
More informationSIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA
SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA E. LAGENDIJK Department of Appled Physcs, Delft Unversty of Technology Lorentzweg 1, 68 CJ, The Netherlands Emal: e.lagendjk@tnw.tudelft.nl
More information1. Measuring association using correlation and regression
How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a
More information1 Approximation Algorithms
CME 305: Dscrete Mathematcs and Algorthms 1 Approxmaton Algorthms In lght of the apparent ntractablty of the problems we beleve not to le n P, t makes sense to pursue deas other than complete solutons
More information1 Example 1: Axisaligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationState function: eigenfunctions of hermitian operators> normalization, orthogonality completeness
Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators> normalzaton, orthogonalty completeness egenvalues and
More informationAn Alternative Way to Measure Private Equity Performance
An Alternatve Way to Measure Prvate Equty Performance Peter Todd Parlux Investment Technology LLC Summary Internal Rate of Return (IRR) s probably the most common way to measure the performance of prvate
More informationFeature selection for intrusion detection. Slobodan Petrović NISlab, Gjøvik University College
Feature selecton for ntruson detecton Slobodan Petrovć NISlab, Gjøvk Unversty College Contents The feature selecton problem Intruson detecton Traffc features relevant for IDS The CFS measure The mrmr measure
More informationA Note on the Decomposition of a Random Sample Size
A Note on the Decomposton of a Random Sample Sze Klaus Th. Hess Insttut für Mathematsche Stochastk Technsche Unverstät Dresden Abstract Ths note addresses some results of Hess 2000) on the decomposton
More informationConversion between the vector and raster data structures using Fuzzy Geographical Entities
Converson between the vector and raster data structures usng Fuzzy Geographcal Enttes Cdála Fonte Department of Mathematcs Faculty of Scences and Technology Unversty of Combra, Apartado 38, 3 454 Combra,
More informationQuestions that we may have about the variables
Antono Olmos, 01 Multple Regresson Problem: we want to determne the effect of Desre for control, Famly support, Number of frends, and Score on the BDI test on Perceved Support of Latno women. Dependent
More informationExperiment 8 Two Types of Pendulum
Experment 8 Two Types of Pendulum Preparaton For ths week's quz revew past experments and read about pendulums and harmonc moton Prncples Any object that swngs back and forth can be consdered a pendulum
More informationRiskbased Fatigue Estimate of Deep Water Risers  Course Project for EM388F: Fracture Mechanics, Spring 2008
Rskbased Fatgue Estmate of Deep Water Rsers  Course Project for EM388F: Fracture Mechancs, Sprng 2008 Chen Sh Department of Cvl, Archtectural, and Envronmental Engneerng The Unversty of Texas at Austn
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationSupport Vector Machines
Support Vector Machnes Max Wellng Department of Computer Scence Unversty of Toronto 10 Kng s College Road Toronto, M5S 3G5 Canada wellng@cs.toronto.edu Abstract Ths s a note to explan support vector machnes.
More informationLinear Regression, Regularization BiasVariance Tradeoff
HTF: Ch3, 7 B: Ch3 Lnear Regresson, Regularzaton BasVarance Tradeoff Thanks to C Guestrn, T Detterch, R Parr, N Ray 1 Outlne Lnear Regresson MLE = Least Squares! Bass functons Evaluatng Predctors Tranng
More informationReview of Hierarchical Models for Data Clustering and Visualization
Revew of Herarchcal Models for Data Clusterng and Vsualzaton Lola Vcente & Alfredo Velldo Grup de Soft Computng Seccó d Intel lgènca Artfcal Departament de Llenguatges Sstemes Informàtcs Unverstat Poltècnca
More informationRecurrent networks and types of associative memories
12 Assocatve Networks 12.1 Assocatve pattern recognton The prevous chapters were devoted to the analyss of neural networks wthout feedback, capable of mappng an nput space nto an output space usng only
More informationOnline Learning from Experts: Minimax Regret
E0 370 tatstcal Learnng Theory Lecture 2 Nov 24, 20) Onlne Learnng from Experts: Mn Regret Lecturer: hvan garwal crbe: Nkhl Vdhan Introducton In the last three lectures we have been dscussng the onlne
More informationAn Enhanced SuperResolution System with Improved Image Registration, Automatic Image Selection, and Image Enhancement
An Enhanced SuperResoluton System wth Improved Image Regstraton, Automatc Image Selecton, and Image Enhancement YuChuan Kuo ( ), ChenYu Chen ( ), and ChouShann Fuh ( ) Department of Computer Scence
More informationAdaptive Fractal Image Coding in the Frequency Domain
PROCEEDINGS OF INTERNATIONAL WORKSHOP ON IMAGE PROCESSING: THEORY, METHODOLOGY, SYSTEMS AND APPLICATIONS 222 JUNE,1994 BUDAPEST,HUNGARY Adaptve Fractal Image Codng n the Frequency Doman K AI UWE BARTHEL
More informationThe Magnetic Field. Concepts and Principles. Moving Charges. Permanent Magnets
. The Magnetc Feld Concepts and Prncples Movng Charges All charged partcles create electrc felds, and these felds can be detected by other charged partcles resultng n electrc force. However, a completely
More informationI. SCOPE, APPLICABILITY AND PARAMETERS Scope
D Executve Board Annex 9 Page A/R ethodologcal Tool alculaton of the number of sample plots for measurements wthn A/R D project actvtes (Verson 0) I. SOPE, PIABIITY AD PARAETERS Scope. Ths tool s applcable
More informationFormula of Total Probability, Bayes Rule, and Applications
1 Formula of Total Probablty, Bayes Rule, and Applcatons Recall that for any event A, the par of events A and A has an ntersecton that s empty, whereas the unon A A represents the total populaton of nterest.
More informationCHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES
CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES In ths chapter, we wll learn how to descrbe the relatonshp between two quanttatve varables. Remember (from Chapter 2) that the terms quanttatve varable
More informationA Computer Technique for Solving LP Problems with Bounded Variables
Dhaka Unv. J. Sc. 60(2): 163168, 2012 (July) A Computer Technque for Solvng LP Problems wth Bounded Varables S. M. Atqur Rahman Chowdhury * and Sanwar Uddn Ahmad Department of Mathematcs; Unversty of
More informationPoint cloud to point cloud rigid transformations. Minimizing Rigid Registration Errors
Pont cloud to pont cloud rgd transformatons Russell Taylor 600.445 1 600.445 Fall 000014 Copyrght R. H. Taylor Mnmzng Rgd Regstraton Errors Typcally, gven a set of ponts {a } n one coordnate system and
More informationAnts Can Schedule Software Projects
Ants Can Schedule Software Proects Broderck Crawford 1,2, Rcardo Soto 1,3, Frankln Johnson 4, and Erc Monfroy 5 1 Pontfca Unversdad Católca de Valparaíso, Chle FrstName.Name@ucv.cl 2 Unversdad Fns Terrae,
More informationOn Mean Squared Error of Hierarchical Estimator
S C H E D A E I N F O R M A T I C A E VOLUME 0 0 On Mean Squared Error of Herarchcal Estmator Stans law Brodowsk Faculty of Physcs, Astronomy, and Appled Computer Scence, Jagellonan Unversty, Reymonta
More informationELE427  Testing Linear Sensors. Linear Regression, Accuracy, and Resolution.
ELE47  Testng Lnear Sensors Lnear Regresson, Accurac, and Resoluton. Introducton: In the frst three la eperents we wll e concerned wth the characterstcs of lnear sensors. The asc functon of these sensors
More information"Research Note" APPLICATION OF CHARGE SIMULATION METHOD TO ELECTRIC FIELD CALCULATION IN THE POWER CABLES *
Iranan Journal of Scence & Technology, Transacton B, Engneerng, ol. 30, No. B6, 789794 rnted n The Islamc Republc of Iran, 006 Shraz Unversty "Research Note" ALICATION OF CHARGE SIMULATION METHOD TO ELECTRIC
More informationImplementation of Deutsch's Algorithm Using Mathcad
Implementaton of Deutsch's Algorthm Usng Mathcad Frank Roux The followng s a Mathcad mplementaton of Davd Deutsch's quantum computer prototype as presented on pages  n "Machnes, Logc and Quantum Physcs"
More informationTraffic State Estimation in the Traffic Management Center of Berlin
Traffc State Estmaton n the Traffc Management Center of Berln Authors: Peter Vortsch, PTV AG, Stumpfstrasse, D763 Karlsruhe, Germany phone ++49/72/965/35, emal peter.vortsch@ptv.de Peter Möhl, PTV AG,
More informationThe Greedy Method. Introduction. 0/1 Knapsack Problem
The Greedy Method Introducton We have completed data structures. We now are gong to look at algorthm desgn methods. Often we are lookng at optmzaton problems whose performance s exponental. For an optmzaton
More informationThe Analysis of Outliers in Statistical Data
THALES Project No. xxxx The Analyss of Outlers n Statstcal Data Research Team Chrysses Caron, Assocate Professor (P.I.) Vaslk Karot, Doctoral canddate Polychrons Economou, Chrstna Perrakou, Postgraduate
More informationOn the Use of Neural Network as a Universal Approximator
Internatonal Journal of Scences and Technques of Automatc control & computer engneerng IJSTA, Volume, N, Jul 8, pp 386 399 On the Use of Neural Network as a Unversal Appromator Amel SIFAOUI, Afef ABDELKRIM,
More informationLogistic Regression. Steve Kroon
Logstc Regresson Steve Kroon Course notes sectons: 24.324.4 Dsclamer: these notes do not explctly ndcate whether values are vectors or scalars, but expects the reader to dscern ths from the context. Scenaro
More informationMANY machine learning and pattern recognition applications
1 Trace Rato Problem Revsted Yangqng Ja, Fepng Ne, and Changshu Zhang Abstract Dmensonalty reducton s an mportant ssue n many machne learnng and pattern recognton applcatons, and the trace rato problem
More informationDocument Clustering Analysis Based on Hybrid PSO+Kmeans Algorithm
Document Clusterng Analyss Based on Hybrd PSO+Kmeans Algorthm Xaohu Cu, Thomas E. Potok Appled Software Engneerng Research Group, Computatonal Scences and Engneerng Dvson, Oak Rdge Natonal Laboratory,
More informationA hybrid global optimization algorithm based on parallel chaos optimization and outlook algorithm
Avalable onlne www.ocpr.com Journal of Chemcal and Pharmaceutcal Research, 2014, 6(7):18841889 Research Artcle ISSN : 09757384 CODEN(USA) : JCPRC5 A hybrd global optmzaton algorthm based on parallel
More informationA DATA MINING APPLICATION IN A STUDENT DATABASE
JOURNAL OF AERONAUTICS AND SPACE TECHNOLOGIES JULY 005 VOLUME NUMBER (5357) A DATA MINING APPLICATION IN A STUDENT DATABASE Şenol Zafer ERDOĞAN Maltepe Ünversty Faculty of Engneerng BüyükbakkalköyIstanbul
More informationUsing mixture covariance matrices to improve face and facial expression recognitions
Pattern Recognton Letters 24 (2003) 2159 2165 www.elsever.com/locate/patrec Usng mxture covarance matrces to mprove face and facal expresson recogntons Carlos E. Thomaz a, *, Duncan F. Glles a, Raul Q.
More informationBiometric Signature Processing & Recognition Using Radial Basis Function Network
Bometrc Sgnature Processng & Recognton Usng Radal Bass Functon Network Ankt Chadha, Neha Satam, and Vbha Wal Abstract Automatc recognton of sgnature s a challengng problem whch has receved much attenton
More informationNew bounds in BalogSzemerédiGowers theorem
New bounds n BalogSzemerédGowers theorem By Tomasz Schoen Abstract We prove, n partcular, that every fnte subset A of an abelan group wth the addtve energy κ A 3 contans a set A such that A κ A and A
More informationRing structure of splines on triangulations
www.oeaw.ac.at Rng structure of splnes on trangulatons N. Vllamzar RICAMReport 201448 www.rcam.oeaw.ac.at RING STRUCTURE OF SPLINES ON TRIANGULATIONS NELLY VILLAMIZAR Introducton For a trangulated regon
More informationLoop Parallelization
  Loop Parallelzaton C52 Complaton steps: nested loops operatng on arrays, sequentell executon of teraton space DECLARE B[..,..+] FOR I :=.. FOR J :=.. I B[I,J] := B[I,J]+B[I,J] ED FOR ED FOR analyze
More informationgreatest common divisor
4. GCD 1 The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no
More informationAryabhata s Root Extraction Methods. Abhishek Parakh Louisiana State University Aug 31 st 2006
Aryabhata s Root Extracton Methods Abhshek Parakh Lousana State Unversty Aug 1 st 1 Introducton Ths artcle presents an analyss of the root extracton algorthms of Aryabhata gven n hs book Āryabhatīya [1,
More informationCalculation of Sampling Weights
Perre Foy Statstcs Canada 4 Calculaton of Samplng Weghts 4.1 OVERVIEW The basc sample desgn used n TIMSS Populatons 1 and 2 was a twostage stratfed cluster desgn. 1 The frst stage conssted of a sample
More informationLeast Squares Fitting of Data
Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 19982016. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng
More informationEE201 Circuit Theory I 2015 Spring. Dr. Yılmaz KALKAN
EE201 Crcut Theory I 2015 Sprng Dr. Yılmaz KALKAN 1. Basc Concepts (Chapter 1 of Nlsson  3 Hrs.) Introducton, Current and Voltage, Power and Energy 2. Basc Laws (Chapter 2&3 of Nlsson  6 Hrs.) Voltage
More informationDEFINING %COMPLETE IN MICROSOFT PROJECT
CelersSystems DEFINING %COMPLETE IN MICROSOFT PROJECT PREPARED BY James E Aksel, PMP, PMISP, MVP For Addtonal Informaton about Earned Value Management Systems and reportng, please contact: CelersSystems,
More information1. Fundamentals of probability theory 2. Emergence of communication traffic 3. Stochastic & Markovian Processes (SP & MP)
6.3 /  Communcaton Networks II (Görg) SS20  www.comnets.unbremen.de Communcaton Networks II Contents. Fundamentals of probablty theory 2. Emergence of communcaton traffc 3. Stochastc & Markovan Processes
More informationMean Molecular Weight
Mean Molecular Weght The thermodynamc relatons between P, ρ, and T, as well as the calculaton of stellar opacty requres knowledge of the system s mean molecular weght defned as the mass per unt mole of
More informationPerformance Analysis and Coding Strategy of ECOC SVMs
Internatonal Journal of Grd and Dstrbuted Computng Vol.7, No. (04), pp.6776 http://dx.do.org/0.457/jgdc.04.7..07 Performance Analyss and Codng Strategy of ECOC SVMs Zhgang Yan, and Yuanxuan Yang, School
More information+ + +   This circuit than can be reduced to a planar circuit
MeshCurrent Method The meshcurrent s analog of the nodeoltage method. We sole for a new set of arables, mesh currents, that automatcally satsfy KCLs. As such, meshcurrent method reduces crcut soluton to
More informationNeural Networks. Hervé Abdi. The University of Texas at Dallas
Neural Netorks. Hervé Abd The Unversty o Texas at Dallas Introducton Neural netorks are adaptve statstcal models based on an analogy th the structure o the bran. They are adaptve because they can learn
More informationRotation Kinematics, Moment of Inertia, and Torque
Rotaton Knematcs, Moment of Inerta, and Torque Mathematcally, rotaton of a rgd body about a fxed axs s analogous to a lnear moton n one dmenson. Although the physcal quanttes nvolved n rotaton are qute
More informationUnsupervised Learning and Clustering
Unsupervsed Learnng and Clusterng Supervsed vs. Unsupervsed Learnng Up to now we consdered supervsed learnng scenaro, where we are gven 1. samples 1,, n 2. class labels for all samples 1,, n Ths s also
More informationMONITORING OF DISTILLATION COLUMN OPERATION THROUGH SELF ORGANIZING MAPS. Y.S. Ng and R. Srinivasan*
MONITORING OF DISTILLATION COLUMN OPERATION THROUGH SELF ORGANIZING MAPS Y.S. Ng and R. Srnvasan* Laboratory for Intellgent Applcatons n Chemcal Engneerng, Department of Chemcal and Bomolecular Engneerng,
More informationVLSI Technology Dr. Nandita Dasgupta Department of Electrical Engineering Indian Institute of Technology, Madras
VLI Technology Dr. Nandta Dasgupta Department of Electrcal Engneerng Indan Insttute of Technology, Madras Lecture  11 Oxdaton I netcs of Oxdaton o, the unt process step that we are gong to dscuss today
More informationA machine vision approach for detecting and inspecting circular parts
A machne vson approach for detectng and nspectng crcular parts DuMng Tsa Machne Vson Lab. Department of Industral Engneerng and Management YuanZe Unversty, ChungL, Tawan, R.O.C. Emal: edmtsa@saturn.yzu.edu.tw
More informationSPEE Recommended Evaluation Practice #6 Definition of Decline Curve Parameters Background:
SPEE Recommended Evaluaton Practce #6 efnton of eclne Curve Parameters Background: The producton hstores of ol and gas wells can be analyzed to estmate reserves and future ol and gas producton rates and
More informationIntraday Trading of the FTSE100 Futures Contract Using Neural Networks With Wavelet Encodings
Submtted to European Journal of Fnance Intraday Tradng of the FTSE00 Futures Contract Usng eural etworks Wth Wavelet Encodngs D L Toulson S P Toulson Intellgent Fnancal Systems Lmted Sute 4 Greener House
More informationGraph Theory and Cayley s Formula
Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll
More informationAn artificial Neural Network approach to monitor and diagnose multiattribute quality control processes. S. T. A. Niaki*
Journal of Industral Engneerng Internatonal July 008, Vol. 4, No. 7, 04 Islamc Azad Unversty, South Tehran Branch An artfcal Neural Network approach to montor and dagnose multattrbute qualty control processes
More informationImproved Methods of Geometric Shape Recognition using Fuzzy and Neural Techniques
Buletnul Stntfc al Unverstat Poltehnca dn Tmsoara, ROMANIA Sera AUTOMATICA s CALCULATOARE PERIODICA POLITECHNICA, Transactons on AUTOMATIC CONTROL and COMPUTER SCIENCE Vol.49 (63, 2004, ISSN 224600X Improved
More informationUncertain Data Mining: A New Research Direction
Uncertan Data Mnng: A New Research Drecton Mchael Chau 1, Reynold Cheng, and Ben Kao 3 1: School of Busness, The Unversty of Hong Kong, Pokfulam, Hong Kong : Department of Computng, Hong Kong Polytechnc
More informationBagofWords models. Lecture 9. Slides from: S. Lazebnik, A. Torralba, L. FeiFei, D. Lowe, C. Szurka
BagofWords models Lecture 9 Sldes from: S. Lazebnk, A. Torralba, L. FeFe, D. Lowe, C. Szurka Bagoffeatures models Overvew: Bagoffeatures models Orgns and motvaton Image representaton Dscrmnatve
More informationA GENERAL APPROACH FOR SECURITY MONITORING AND PREVENTIVE CONTROL OF NETWORKS WITH LARGE WIND POWER PRODUCTION
A GENERAL APPROACH FOR SECURITY MONITORING AND PREVENTIVE CONTROL OF NETWORKS WITH LARGE WIND POWER PRODUCTION Helena Vasconcelos INESC Porto hvasconcelos@nescportopt J N Fdalgo INESC Porto and FEUP jfdalgo@nescportopt
More informationCan Auto Liability Insurance Purchases Signal Risk Attitude?
Internatonal Journal of Busness and Economcs, 2011, Vol. 10, No. 2, 159164 Can Auto Lablty Insurance Purchases Sgnal Rsk Atttude? ChuShu L Department of Internatonal Busness, Asa Unversty, Tawan ShengChang
More informationLinear Circuits Analysis. Superposition, Thevenin /Norton Equivalent circuits
Lnear Crcuts Analyss. Superposton, Theenn /Norton Equalent crcuts So far we hae explored tmendependent (resste) elements that are also lnear. A tmendependent elements s one for whch we can plot an / cure.
More informationCalculating the high frequency transmission line parameters of power cables
< ' Calculatng the hgh frequency transmsson lne parameters of power cables Authors: Dr. John Dcknson, Laboratory Servces Manager, N 0 RW E B Communcatons Mr. Peter J. Ncholson, Project Assgnment Manager,
More informationGender Classification for RealTime Audience Analysis System
Gender Classfcaton for RealTme Audence Analyss System Vladmr Khryashchev, Lev Shmaglt, Andrey Shemyakov, Anton Lebedev Yaroslavl State Unversty Yaroslavl, Russa vhr@yandex.ru, shmaglt_lev@yahoo.com, andrey.shemakov@gmal.com,
More information