Using Mixture Covariance Matrices to Improve Face and Facial Expression Recognitions
|
|
- Horace Floyd
- 7 years ago
- Views:
Transcription
1 Usng Mxture Covarance Matrces to Improve Face and Facal Expresson Recogntons Carlos E. homaz, Duncan F. Glles and Raul Q. Fetosa 2 Imperal College of Scence echnology and Medcne, Department of Computng, 80 Queen s Gate, London SW7 2BZ, Unted Kngdom {cet, dfg}@doc.c.ac.u 2 Catholc Unversty of Ro de Janero, Department of Electrcal Engneerng, r. Marques de Sao Vcente 225, Ro de Janero , Brazl raul@ele.puc-ro.br Abstract. In several pattern recognton problems, partcularly n mage recognton ones, there are often a large number of features avalable, but the number of tranng samples for each pattern s sgnfcantly less than the dmenson of the feature space. hs statement mples that the sample group covarance matrces often used n the Gaussan maxmum probablty classfer are sngular. A common soluton to ths problem s to assume that all groups have equal covarance matrces and to use as ther estmates the pooled covarance matrx calculated from the whole tranng set. hs paper uses an alternatve estmate for the sample group covarance matrces, here called the mxture covarance, gven by an approprate lnear combnaton of the sample group and pooled covarance matrces. Experments were carred out to evaluate the performance assocated wth ths estmate n two recognton applcatons: face and facal expresson. he average recognton rates obtaned by usng the mxture covarance matrces were hgher than the usual estmates. Introducton A crtcal ssue for the Gaussan maxmum probablty classfer s the nverse of the sample group covarance matrces. Snce n practce these matrces are not nown, estmates must be computed based on the observatons (patterns) avalable n a tranng set. In some applcatons, however, there are often a large number of features avalable, but the number of tranng samples for each group s lmted and sgnfcantly less than the dmenson of the feature space. hs mples that the sample group covarance matrces wll be sngular. hs problem, whch s called a small sample sze problem [5], s qute common n pattern recognton, partcularly n mage recognton where the number of features s very large. One way to overcome ths problem s to assume that all groups have equal covarance matrces and to use as ther estmates the weghtng average of each sample group covarance matrx, gven by the pooled covarance matrx calculated from the whole tranng set. hs paper uses another estmate for the sample group covarance matrces [4], here called mxture covarance matrces, gven by an approprate lnear combnaton of the sample group covarance matrx and the pooled covarance one. he mxture covarance matrces have the property of havng the same ran as the pooled estmate, whle allowng
2 a dfferent estmate for each group. hus, the mxture estmate may result n hgher accuracy. In order to evaluate ths approach, two pattern recognton applcatons were consdered: face recognton and facal expresson recognton. he evaluaton used dfferent mage databases for each applcaton and a probablstc model combnes the well-nown dmensonalty reducton technque called Prncpal Component Analyss (PCA) and the Gaussan maxmum probablty classfer to nvestgate the mxture covarance matrces on the referred recognton tass. Experments carred out show that the mxture covarance estmates attaned the best performance n both applcatons consdered. 2 Dmensonalty Reducton One of the most successful approaches to the problem of creatng a low dmensonal mage representaton s based on Prncpal Component Analyss (PCA). PCA generates a set of orthonomal bass vectors, nown as prncpal components, that mnmzes the mean square reconstructon error and descrbe major varatons n the whole tranng set consdered. he reasonng behnd applyng PCA frst for dmensonalty reducton nstead of analyzng the maxmum probablty classfer drectly on the face or facal expresson mages s based on the orgnal hgh-dmensonal space. As the number of tranng samples s lmted and sgnfcantly less than the number of pxels of each mage, the hghdmensonal space s ndeed sparsely represented, mang the parameter estmaton qute complcated ths behavour s called the curse of dmensonalty [8]. Furthermore, many researchers have confrmed that the PCA representaton has good generalzaton ablty especally when the dstrbutons of each class are separated by the mean dfference [,6,7,9]. 3 Maxmum Probablty Classfer he basc problem n the decson-theoretc methods for pattern recognton conssts of fndng a set of g dscrmnant functons d (x), d 2 (x),..., d g (x), where g s the number of groups or classes, wth the decson rule such that f the p-dmensonal pattern vector x belongs to the class ( g), then d (x) d j (x), for all j and j g. he Bayes classfer desgned to maxmze the total probablty of correct classfcaton, where equal pror probabltes for all groups are assumed, corresponds to a set of dscrmnant functons equal to the correspondng probablty densty functons, that s, d (x)=f (x) for all classes [8]. he most common probablty densty functon appled to pattern recognton systems s based on the Gaussan multvarate dstrbuton d ( x) = f ( x µ, Σ ) = exp ( x µ ) ( ) p / 2 / 2 Σ x µ, (2π) Σ 2 () where µ and Σ are the class populaton mean vector and covarance matrx. Usually the true values of the mean and the covarance matrx are seldom nown and must be estmated from tranng samples. he mean s estmated by the usual sample mean
3 x, x = j = x µ, (2) where j s observaton j from class, and s the number of tranng observatons from class. he covarance matrx s commonly estmated by the sample group covarance matrx defned as Σ S = ( ) j=, j ( x, x )( x, x ) j j. (3) From replacng the true values of the mean and the covarance matrx n () by ther respectve estmates, the Bayes decson rule acheves optmal classfcaton accuracy only when the number of tranng samples ncreases toward nfnty [4]. In fact for p- dmensonal patterns the sample covarance matrx s sngular f less than p + tranng samples from each class are avalable, that s, the sample covarance matrx can not be calculated f s less than the dmenson of the feature space. One method routnely appled to solve ths problem s to assume that all classes have equal covarance matrces, and to use as ther estmates the pooled covarance matrx. hs covarance matrx s a weghtng average of each sample group covarance matrx and, assumng that all classes have the same number of tranng observatons, s gven by S = g pooled S g =. (4) Snce more observatons are taen to calculate the pooled covarance matrx S pooled, ths one wll potentally have a hgher ran than S and wll be eventually full ran. Although the pooled estmate does provde a soluton for the algebrac problem arsng from the nsuffcent number of tranng samples n each group, assumng equal covarance for all groups may brng about dstortons n the modelng of the classfcaton problem and consequently lower accuracy. 4 Mxture Covarance Matrx he choce between the sample group covarance matrx and the pooled covarance one represents a restrctve set of estmates for the true covarance matrx. A less lmted set can be obtaned usng the mxture covarance matrx. 4. Defnton he mxture covarance matrx s a lnear combnaton between the pooled covarance matrx S pooled and the sample covarance matrx of each class S. It s gven by Smx ( w ) w S ( w ) S = pooled +. (5)
4 he mxture parameter w taes on values 0 < w and s dfferent for each class. hs parameter controls the degree of shrnage of the sample group covarance matrx estmates toward the pooled one. Each Smx matrx has the mportant property of admttng an nverse f the pooled estmate S pooled does so [2]. hs mples that f the pooled estmate s non-sngular and the mxture parameter taes on values w > 0, then the Smx wll be non-sngular. hen the remanng queston s: what s the value of the w that gves a relevant lnear mxture between the pooled and sample covarance estmates? A method that determnes an approprate value of the mxture parameter s descrbed n the next secton. 4.2 he mxture parameter Accordng to Hoffbec and Landgrebe [4], the value of the mxture parameter w can be approprately selected so that a best ft to the tranng samples s acheved. her technque s based on the leave-one-out-lelhood (L) parameter estmaton. In the L method, one sample of the class tranng set s removed and the mean and covarance matrx from the remanng samples are estmated. hen the lelhood of the excluded sample s calculated gven the prevous mean and covarance matrx estmates. hs operaton s repeated tmes and the average log lelhood s computed over all the samples. her strategy s to evaluate several dfferent values of w n the range 0 < w, and then choose w that maxmzes the average log lelhood. he mean of class wthout sample r may be computed as x \ r = x, j x, r. (6) ( ) j = he notaton \r ndcates the correspondng quantty s calculated wth the r th observaton from class removed. Followng the same dea, the sample covarance matrx and the pooled covarance matrx of class wthout sample r are S\ r = ( x, j x \ r )( x, j x \ r ) ( x, r x \ r )( x, r x \ r ) ( 2) j =, (7) g S pooled = S j S + S r r \. (8) \ g j = hen the average log lelhood of the excluded samples can be wrtten as follows: L ( w ) = ln[ f ( x, r x \ r, Smx \ r ( w ))], (9) r = where ( x x, Smx ( w )) r f s the Gaussan probablty functon defned n () wth, r \ r \ r x \ mean vector and Smx ( w ) covarance matrx defned as Smx \ r = +. (0) \ r ( w ) w S pooled ( w ) S \ r \ r
5 hs approach, f mplemented n a straghtforward way, would requre computng the nverse and determnant of the Smx\ r ( w ) for each tranng sample. As the Smx\ r ( w ) s a p by p matrx and p s typcally a large number, ths computaton would be qute expensve. Hoffbec and Landgrebe [4], usng the Sherman-Morrson-Woodbury formula [3], have showed that t s possble to sgnfcantly reduce the requred computaton by wrtng the mxture covarance matrx n a form as follows: ln where d [ ( )] = [ ] f x x, Smx ( w ) ln Q ( vd), r \ r \ r, () 2 2 vd ( ) Q = ( w ) + w S + w S pooled, (2) ( 2) g( 2) 2 v = ( )( w 2) ( g ), g (3) ( x, r x ) Q ( x, r d = x ). (4) Once the mxture parameter w that maxmzes the average log lelhood s selected, the proposed covarance matrx estmate s calculated usng all the tranng samples and replaced nto the maxmum probablty classfer defned n (). 5 Experments wo experments wth two dfferent databases were performed. In the face recognton experment the ORL Face Database contanng ten mages for each of 40 ndvduals, a total of 400 mages, were used. he ohou Unversty has provded the database for the facal expresson experment. hs database s composed of 93 mages of expressons posed by nne Japanese females. Each person posed three or four examples of each sx fundamental facal expresson: anger, dsgust, fear, happness, sadness and surprse. he database has at least 29 mages for each fundamental facal expresson. For mplementaton convenence all mages were frst reszed to 64x64 pxels. he experments were carred out as follows. Frst PCA reduces the dmensonalty of the orgnal mages and secondly the Gaussan maxmum probablty classfer usng one out of the three covarance estmates (S, S pooled and Smx ) was appled. Each experment was repeated 25 tmes usng several PCA dmensons. Dstnct tranng and testng sets were randomly drawn, and the mean and standard devaton of the recognton rate were calculated. he face recognton classfcaton was computed usng for each ndvdual 5 mages to tran and 5 mages to test. In the facal expresson recognton, the tranng and test sets were respectvely composed of 20 and 9 mages. he sze of the mxture parameter (0 < w ) optmzaton range was taen to be 20, that s w = [0.05, 0.0, 0.5,, ].
6 6 Results ables and 2 present the tranng and test average recognton rates (wth standard devatons) of the face and facal expresson databases, respectvely, over the dfferent PCA dmensons. Snce only 5 mages of each ndvdual were used to form the face recognton tranng set, the results relatve to the sample group covarance estmate were lmted to 4 PCA components. able shows that n all but one experment the Smx estmate led to hgher accuracy than dd both the pooled covarance and sample group covarance matrces. In terms of how senstve the mxture covarance results were to the choce of the tranng and test sets, t s far to say that the Smx standard devatons were smlar to the other two covarance estmates. able 2 shows the results of the facal expresson recognton. For more than 20 components when the sample group covarance estmate became sngular, the mxture covarance estmate reached hgher recognton rates than the pooled covarance estmate. Agan, regardng the computed standard devatons, the Smx estmate showed to be as senstve to the choce of the tranng and test sets as the other two estmates. PCA Sgroup Spooled Smx Components ranng est ranng est ranng est (0.4) 5.6 (4.4) 73.3 (3.) 59.5 (3.0) 90. (2.) 70.8 (3.2) (.2) 88.4 (.4) 99.4 (0.5) 92.0 (.5) (0.6) 9.8 (.8) 00.0 (0.) 94.5 (.7) (0.2) 94.7 (.7) 00.0 (0.0) 95.9 (.5) (0.0) 95.4 (.5) 00.0 (0.0) 96.2 (.6) (0.0) 95.7 (.2) 00.0 (0.0) 96.4 (.5) (0.0) 95.0 (.6) 00.0 (0.0) 95.8 (.6) (0.0) 94.9 (.6) 00.0 (0.0) 95.4 (.6) able. Face Recognton Results PCA Sgroup Spooled Smx Components ranng est ranng est ranng est (4.2) 20.6 (3.9) 32.3 (3.0) 2.6 (3.8) 34.9 (3.3) 2.3 (4.) (3.6) 38.8 (5.6) 49.6 (3.9) 26.5 (6.8) 58.5 (3.7) 27.9 (5.6) (0.5) 64.3 (6.4) 69. (3.6) 44.4 (5.3) 82.9 (2.9) 49.7 (7.7) (2.6) 55.9 (7.7) 9.4 (2.8) 6.3 (7.) (2.8) 64.9 (6.9) 94.8 (2.2) 68.3 (5.) (.7) 70. (7.8) 96.8 (.3) 72.3 (6.2) (.7) 72.0 (7.4) 97.7 (.) 75.6 (5.5) (.4) 75.6 (7.) 98.3 (.) 77.2 (5.7) (.3) 78.4 (6.5) 98.6 (0.8) 79. (5.4) (.0) 79.4 (5.8) 99.2 (0.7) 8.0 (6.6) (0.9) 8.6 (6.6) 99.5 (0.6) 82.8 (6.3) (0.8) 82. (5.9) 99.6 (0.6) 83.6 (7.2) (0.6) 83.3 (5.5) 99.8 (0.4) 84.5 (6.2) able 2. Facal Expresson Recognton Results
7 7 Concluson hs paper used an estmate for the sample group covarance matrces, here called mxture covarance matrces, gven by an approprate lnear combnaton of the sample group covarance matrx and the pooled covarance one. he mxture covarance matrces have the property of havng the same ran as the pooled estmate, whle allowng a dfferent estmate for each group. Extensve experments were carred out to evaluate ths approach on two recognton tass: face recognton and facal expresson recognton. A Gaussan maxmum probablty classfer was bult usng the mxture estmate and the typcal sample group and pooled estmates. In both tass the mxture covarance estmate acheved the hghest accuracy. Regardng the senstveness to the choce of the tranng and test sets, the mxture covarance matrces presented smlar performance to the other two usual estmates. References. C. Lu and H. Wechsler, Learnng the Face Space Representaton and Recognton. In Proc. 5 th Int l Conference on Pattern Recognton, ICPR 2000, Barcelona, Span, September C.E. homaz, R.Q. Fetosa, A. Vega, Separate-Group Covarance Estmaton wth Insuffcent Data for Object Recognton. In Proc. Ffth All-Uranan Internatonal Conference, pp. 2-24, Urane, G.H. Golub and C.F. Van Loan, Matrx Computatons, second edton. Baltmore: Johns Hopns Unv. Press, J.P. Hoffbec and D.A. Landgrebe, "Covarance Matrx Estmaton and Classfcaton wth Lmted ranng Data", IEEE rans. Pattern Analyss and Machne Intellgence, vol. 8, no. 7, July K. Fuunaga, Introducton to Statstcal Pattern Recognton, second edton. Boston: Academc Press, M. Krby and L. Srovch, "Applcaton of the Karhunen-Loeve procedure for the characterzaton of human faces", IEEE rans. Pattern Analyss and Machne Intellgence, Vol. 2, No., Jan M. ur and A. Pentland, Egenfaces for Recognton, Journal of Cogntve Neuroscence, Vol. 3, pp , R.A. Johnson R.A. and D.W. Wchern, Appled Multvarate Statstcal Analyss, by Prentce- Hall, Inc., 3d. edton, W. Zhao, R. Chellappa and A. Krshnaswamy, Dscrmnant Analyss of Prncpal Components for Face Recognton, Proc. 2nd Internatonal Conference on Automatc Face and Gesture Recognton, pp , Japan, Aprl, 998.
Single and multiple stage classifiers implementing logistic discrimination
Sngle and multple stage classfers mplementng logstc dscrmnaton Hélo Radke Bttencourt 1 Dens Alter de Olvera Moraes 2 Vctor Haertel 2 1 Pontfíca Unversdade Católca do Ro Grande do Sul - PUCRS Av. Ipranga,
More informationFace Verification Problem. Face Recognition Problem. Application: Access Control. Biometric Authentication. Face Verification (1:1 matching)
Face Recognton Problem Face Verfcaton Problem Face Verfcaton (1:1 matchng) Querymage face query Face Recognton (1:N matchng) database Applcaton: Access Control www.vsage.com www.vsoncs.com Bometrc Authentcaton
More informationL10: Linear discriminants analysis
L0: Lnear dscrmnants analyss Lnear dscrmnant analyss, two classes Lnear dscrmnant analyss, C classes LDA vs. PCA Lmtatons of LDA Varants of LDA Other dmensonalty reducton methods CSCE 666 Pattern Analyss
More informationWhat is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 12
14 The Ch-squared dstrbuton PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 1 If a normal varable X, havng mean µ and varance σ, s standardsed, the new varable Z has a mean 0 and varance 1. When ths standardsed
More informationv a 1 b 1 i, a 2 b 2 i,..., a n b n i.
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 455 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces we have studed thus far n the text are real vector spaces snce the scalars are
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationFeature selection for intrusion detection. Slobodan Petrović NISlab, Gjøvik University College
Feature selecton for ntruson detecton Slobodan Petrovć NISlab, Gjøvk Unversty College Contents The feature selecton problem Intruson detecton Traffc features relevant for IDS The CFS measure The mrmr measure
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationLogistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification
Lecture 4: More classfers and classes C4B Machne Learnng Hlary 20 A. Zsserman Logstc regresson Loss functons revsted Adaboost Loss functons revsted Optmzaton Multple class classfcaton Logstc Regresson
More informationLogistic Regression. Steve Kroon
Logstc Regresson Steve Kroon Course notes sectons: 24.3-24.4 Dsclamer: these notes do not explctly ndcate whether values are vectors or scalars, but expects the reader to dscern ths from the context. Scenaro
More informationForecasting the Direction and Strength of Stock Market Movement
Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract - Stock market s one of the most complcated systems
More informationHow To Calculate The Accountng Perod Of Nequalty
Inequalty and The Accountng Perod Quentn Wodon and Shlomo Ytzha World Ban and Hebrew Unversty September Abstract Income nequalty typcally declnes wth the length of tme taen nto account for measurement.
More informationCS 2750 Machine Learning. Lecture 3. Density estimation. CS 2750 Machine Learning. Announcements
Lecture 3 Densty estmaton Mlos Hauskrecht mlos@cs.ptt.edu 5329 Sennott Square Next lecture: Matlab tutoral Announcements Rules for attendng the class: Regstered for credt Regstered for audt (only f there
More informationThe Development of Web Log Mining Based on Improve-K-Means Clustering Analysis
The Development of Web Log Mnng Based on Improve-K-Means Clusterng Analyss TngZhong Wang * College of Informaton Technology, Luoyang Normal Unversty, Luoyang, 471022, Chna wangtngzhong2@sna.cn Abstract.
More informationGender Classification for Real-Time Audience Analysis System
Gender Classfcaton for Real-Tme Audence Analyss System Vladmr Khryashchev, Lev Shmaglt, Andrey Shemyakov, Anton Lebedev Yaroslavl State Unversty Yaroslavl, Russa vhr@yandex.ru, shmaglt_lev@yahoo.com, andrey.shemakov@gmal.com,
More informationDescriptive Models. Cluster Analysis. Example. General Applications of Clustering. Examples of Clustering Applications
CMSC828G Prncples of Data Mnng Lecture #9 Today s Readng: HMS, chapter 9 Today s Lecture: Descrptve Modelng Clusterng Algorthms Descrptve Models model presents the man features of the data, a global summary
More informationCan Auto Liability Insurance Purchases Signal Risk Attitude?
Internatonal Journal of Busness and Economcs, 2011, Vol. 10, No. 2, 159-164 Can Auto Lablty Insurance Purchases Sgnal Rsk Atttude? Chu-Shu L Department of Internatonal Busness, Asa Unversty, Tawan Sheng-Chang
More informationForecasting the Demand of Emergency Supplies: Based on the CBR Theory and BP Neural Network
700 Proceedngs of the 8th Internatonal Conference on Innovaton & Management Forecastng the Demand of Emergency Supples: Based on the CBR Theory and BP Neural Network Fu Deqang, Lu Yun, L Changbng School
More informationVision Mouse. Saurabh Sarkar a* University of Cincinnati, Cincinnati, USA ABSTRACT 1. INTRODUCTION
Vson Mouse Saurabh Sarkar a* a Unversty of Cncnnat, Cncnnat, USA ABSTRACT The report dscusses a vson based approach towards trackng of eyes and fngers. The report descrbes the process of locatng the possble
More informationOn the Optimal Control of a Cascade of Hydro-Electric Power Stations
On the Optmal Control of a Cascade of Hydro-Electrc Power Statons M.C.M. Guedes a, A.F. Rbero a, G.V. Smrnov b and S. Vlela c a Department of Mathematcs, School of Scences, Unversty of Porto, Portugal;
More informationLearning from Multiple Outlooks
Learnng from Multple Outlooks Maayan Harel Department of Electrcal Engneerng, Technon, Hafa, Israel She Mannor Department of Electrcal Engneerng, Technon, Hafa, Israel maayanga@tx.technon.ac.l she@ee.technon.ac.l
More informationCalculation of Sampling Weights
Perre Foy Statstcs Canada 4 Calculaton of Samplng Weghts 4.1 OVERVIEW The basc sample desgn used n TIMSS Populatons 1 and 2 was a two-stage stratfed cluster desgn. 1 The frst stage conssted of a sample
More informationRobust Design of Public Storage Warehouses. Yeming (Yale) Gong EMLYON Business School
Robust Desgn of Publc Storage Warehouses Yemng (Yale) Gong EMLYON Busness School Rene de Koster Rotterdam school of management, Erasmus Unversty Abstract We apply robust optmzaton and revenue management
More informationFault tolerance in cloud technologies presented as a service
Internatonal Scentfc Conference Computer Scence 2015 Pavel Dzhunev, PhD student Fault tolerance n cloud technologes presented as a servce INTRODUCTION Improvements n technques for vrtualzaton and performance
More informationInstitute of Informatics, Faculty of Business and Management, Brno University of Technology,Czech Republic
Lagrange Multplers as Quanttatve Indcators n Economcs Ivan Mezník Insttute of Informatcs, Faculty of Busness and Management, Brno Unversty of TechnologCzech Republc Abstract The quanttatve role of Lagrange
More informationHallucinating Multiple Occluded CCTV Face Images of Different Resolutions
In Proc. IEEE Internatonal Conference on Advanced Vdeo and Sgnal based Survellance (AVSS 05), September 2005 Hallucnatng Multple Occluded CCTV Face Images of Dfferent Resolutons Ku Ja Shaogang Gong Computer
More informationRing structure of splines on triangulations
www.oeaw.ac.at Rng structure of splnes on trangulatons N. Vllamzar RICAM-Report 2014-48 www.rcam.oeaw.ac.at RING STRUCTURE OF SPLINES ON TRIANGULATIONS NELLY VILLAMIZAR Introducton For a trangulated regon
More informationCHOLESTEROL REFERENCE METHOD LABORATORY NETWORK. Sample Stability Protocol
CHOLESTEROL REFERENCE METHOD LABORATORY NETWORK Sample Stablty Protocol Background The Cholesterol Reference Method Laboratory Network (CRMLN) developed certfcaton protocols for total cholesterol, HDL
More informationRisk Model of Long-Term Production Scheduling in Open Pit Gold Mining
Rsk Model of Long-Term Producton Schedulng n Open Pt Gold Mnng R Halatchev 1 and P Lever 2 ABSTRACT Open pt gold mnng s an mportant sector of the Australan mnng ndustry. It uses large amounts of nvestments,
More informationProject Networks With Mixed-Time Constraints
Project Networs Wth Mxed-Tme Constrants L Caccetta and B Wattananon Western Australan Centre of Excellence n Industral Optmsaton (WACEIO) Curtn Unversty of Technology GPO Box U1987 Perth Western Australa
More informationStatistical Methods to Develop Rating Models
Statstcal Methods to Develop Ratng Models [Evelyn Hayden and Danel Porath, Österrechsche Natonalbank and Unversty of Appled Scences at Manz] Source: The Basel II Rsk Parameters Estmaton, Valdaton, and
More informationHow To Know The Components Of Mean Squared Error Of Herarchcal Estmator S
S C H E D A E I N F O R M A T I C A E VOLUME 0 0 On Mean Squared Error of Herarchcal Estmator Stans law Brodowsk Faculty of Physcs, Astronomy, and Appled Computer Scence, Jagellonan Unversty, Reymonta
More informationData Visualization by Pairwise Distortion Minimization
Communcatons n Statstcs, Theory and Methods 34 (6), 005 Data Vsualzaton by Parwse Dstorton Mnmzaton By Marc Sobel, and Longn Jan Lateck* Department of Statstcs and Department of Computer and Informaton
More informationA DYNAMIC CRASHING METHOD FOR PROJECT MANAGEMENT USING SIMULATION-BASED OPTIMIZATION. Michael E. Kuhl Radhamés A. Tolentino-Peña
Proceedngs of the 2008 Wnter Smulaton Conference S. J. Mason, R. R. Hll, L. Mönch, O. Rose, T. Jefferson, J. W. Fowler eds. A DYNAMIC CRASHING METHOD FOR PROJECT MANAGEMENT USING SIMULATION-BASED OPTIMIZATION
More informationMining Feature Importance: Applying Evolutionary Algorithms within a Web-based Educational System
Mnng Feature Importance: Applyng Evolutonary Algorthms wthn a Web-based Educatonal System Behrouz MINAEI-BIDGOLI 1, and Gerd KORTEMEYER 2, and Wllam F. PUNCH 1 1 Genetc Algorthms Research and Applcatons
More informationNumber of Levels Cumulative Annual operating Income per year construction costs costs ($) ($) ($) 1 600,000 35,000 100,000 2 2,200,000 60,000 350,000
Problem Set 5 Solutons 1 MIT s consderng buldng a new car park near Kendall Square. o unversty funds are avalable (overhead rates are under pressure and the new faclty would have to pay for tself from
More informationStochastic Protocol Modeling for Anomaly Based Network Intrusion Detection
Stochastc Protocol Modelng for Anomaly Based Network Intruson Detecton Juan M. Estevez-Tapador, Pedro Garca-Teodoro, and Jesus E. Daz-Verdejo Department of Electroncs and Computer Technology Unversty of
More informationImplementation of Deutsch's Algorithm Using Mathcad
Implementaton of Deutsch's Algorthm Usng Mathcad Frank Roux The followng s a Mathcad mplementaton of Davd Deutsch's quantum computer prototype as presented on pages - n "Machnes, Logc and Quantum Physcs"
More informationDEFINING %COMPLETE IN MICROSOFT PROJECT
CelersSystems DEFINING %COMPLETE IN MICROSOFT PROJECT PREPARED BY James E Aksel, PMP, PMI-SP, MVP For Addtonal Informaton about Earned Value Management Systems and reportng, please contact: CelersSystems,
More informationSection 5.4 Annuities, Present Value, and Amortization
Secton 5.4 Annutes, Present Value, and Amortzaton Present Value In Secton 5.2, we saw that the present value of A dollars at nterest rate per perod for n perods s the amount that must be deposted today
More informationPERRON FROBENIUS THEOREM
PERRON FROBENIUS THEOREM R. CLARK ROBINSON Defnton. A n n matrx M wth real entres m, s called a stochastc matrx provded () all the entres m satsfy 0 m, () each of the columns sum to one, m = for all, ()
More informationFast Fuzzy Clustering of Web Page Collections
Fast Fuzzy Clusterng of Web Page Collectons Chrstan Borgelt and Andreas Nürnberger Dept. of Knowledge Processng and Language Engneerng Otto-von-Guercke-Unversty of Magdeburg Unverstätsplatz, D-396 Magdeburg,
More informationRisk-based Fatigue Estimate of Deep Water Risers -- Course Project for EM388F: Fracture Mechanics, Spring 2008
Rsk-based Fatgue Estmate of Deep Water Rsers -- Course Project for EM388F: Fracture Mechancs, Sprng 2008 Chen Sh Department of Cvl, Archtectural, and Envronmental Engneerng The Unversty of Texas at Austn
More informationLecture 5,6 Linear Methods for Classification. Summary
Lecture 5,6 Lnear Methods for Classfcaton Rce ELEC 697 Farnaz Koushanfar Fall 2006 Summary Bayes Classfers Lnear Classfers Lnear regresson of an ndcator matrx Lnear dscrmnant analyss (LDA) Logstc regresson
More informationTime Delayed Independent Component Analysis for Data Quality Monitoring
IWSSIP 1-17th Internatonal Conference on Systems, Sgnals and Image Processng Tme Delayed Independent Component Analyss for Data Qualty Montorng José Márco Faer Sgnal Processng Laboratory, COE/Pol Federal
More informationPerformance Analysis and Coding Strategy of ECOC SVMs
Internatonal Journal of Grd and Dstrbuted Computng Vol.7, No. (04), pp.67-76 http://dx.do.org/0.457/jgdc.04.7..07 Performance Analyss and Codng Strategy of ECOC SVMs Zhgang Yan, and Yuanxuan Yang, School
More informationBERNSTEIN POLYNOMIALS
On-Lne Geometrc Modelng Notes BERNSTEIN POLYNOMIALS Kenneth I. Joy Vsualzaton and Graphcs Research Group Department of Computer Scence Unversty of Calforna, Davs Overvew Polynomals are ncredbly useful
More informationModelling high-dimensional data by mixtures of factor analyzers
Computatonal Statstcs & Data Analyss 41 (2003) 379 388 www.elsever.com/locate/csda Modellng hgh-dmensonal data by mxtures of factor analyzers G.J. McLachlan, D. Peel, R.W. Bean Department of Mathematcs,
More informationDesign and Development of a Security Evaluation Platform Based on International Standards
Internatonal Journal of Informatcs Socety, VOL.5, NO.2 (203) 7-80 7 Desgn and Development of a Securty Evaluaton Platform Based on Internatonal Standards Yuj Takahash and Yoshm Teshgawara Graduate School
More informationANALYZING THE RELATIONSHIPS BETWEEN QUALITY, TIME, AND COST IN PROJECT MANAGEMENT DECISION MAKING
ANALYZING THE RELATIONSHIPS BETWEEN QUALITY, TIME, AND COST IN PROJECT MANAGEMENT DECISION MAKING Matthew J. Lberatore, Department of Management and Operatons, Vllanova Unversty, Vllanova, PA 19085, 610-519-4390,
More informationECE544NA Final Project: Robust Machine Learning Hardware via Classifier Ensemble
1 ECE544NA Fnal Project: Robust Machne Learnng Hardware va Classfer Ensemble Sa Zhang, szhang12@llnos.edu Dept. of Electr. & Comput. Eng., Unv. of Illnos at Urbana-Champagn, Urbana, IL, USA Abstract In
More information1. Measuring association using correlation and regression
How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a
More informationStudy on Model of Risks Assessment of Standard Operation in Rural Power Network
Study on Model of Rsks Assessment of Standard Operaton n Rural Power Network Qngj L 1, Tao Yang 2 1 Qngj L, College of Informaton and Electrcal Engneerng, Shenyang Agrculture Unversty, Shenyang 110866,
More information"Research Note" APPLICATION OF CHARGE SIMULATION METHOD TO ELECTRIC FIELD CALCULATION IN THE POWER CABLES *
Iranan Journal of Scence & Technology, Transacton B, Engneerng, ol. 30, No. B6, 789-794 rnted n The Islamc Republc of Iran, 006 Shraz Unversty "Research Note" ALICATION OF CHARGE SIMULATION METHOD TO ELECTRIC
More informationAn Alternative Way to Measure Private Equity Performance
An Alternatve Way to Measure Prvate Equty Performance Peter Todd Parlux Investment Technology LLC Summary Internal Rate of Return (IRR) s probably the most common way to measure the performance of prvate
More informationLearning from Large Distributed Data: A Scaling Down Sampling Scheme for Efficient Data Processing
Internatonal Journal of Machne Learnng and Computng, Vol. 4, No. 3, June 04 Learnng from Large Dstrbuted Data: A Scalng Down Samplng Scheme for Effcent Data Processng Che Ngufor and Janusz Wojtusak part
More informationRecurrence. 1 Definitions and main statements
Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.
More informationSupport Vector Machines
Support Vector Machnes Max Wellng Department of Computer Scence Unversty of Toronto 10 Kng s College Road Toronto, M5S 3G5 Canada wellng@cs.toronto.edu Abstract Ths s a note to explan support vector machnes.
More informationEstimating the Number of Clusters in Genetics of Acute Lymphoblastic Leukemia Data
Journal of Al Azhar Unversty-Gaza (Natural Scences), 2011, 13 : 109-118 Estmatng the Number of Clusters n Genetcs of Acute Lymphoblastc Leukema Data Mahmoud K. Okasha, Khaled I.A. Almghar Department of
More informationSIMPLE LINEAR CORRELATION
SIMPLE LINEAR CORRELATION Smple lnear correlaton s a measure of the degree to whch two varables vary together, or a measure of the ntensty of the assocaton between two varables. Correlaton often s abused.
More informationStaff Paper. Farm Savings Accounts: Examining Income Variability, Eligibility, and Benefits. Brent Gloy, Eddy LaDue, and Charles Cuykendall
SP 2005-02 August 2005 Staff Paper Department of Appled Economcs and Management Cornell Unversty, Ithaca, New York 14853-7801 USA Farm Savngs Accounts: Examnng Income Varablty, Elgblty, and Benefts Brent
More informationSupport vector domain description
Pattern Recognton Letters 20 (1999) 1191±1199 www.elsever.nl/locate/patrec Support vector doman descrpton Davd M.J. Tax *,1, Robert P.W. Dun Pattern Recognton Group, Faculty of Appled Scence, Delft Unversty
More informationBrigid Mullany, Ph.D University of North Carolina, Charlotte
Evaluaton And Comparson Of The Dfferent Standards Used To Defne The Postonal Accuracy And Repeatablty Of Numercally Controlled Machnng Center Axes Brgd Mullany, Ph.D Unversty of North Carolna, Charlotte
More informationFREQUENCY OF OCCURRENCE OF CERTAIN CHEMICAL CLASSES OF GSR FROM VARIOUS AMMUNITION TYPES
FREQUENCY OF OCCURRENCE OF CERTAIN CHEMICAL CLASSES OF GSR FROM VARIOUS AMMUNITION TYPES Zuzanna BRO EK-MUCHA, Grzegorz ZADORA, 2 Insttute of Forensc Research, Cracow, Poland 2 Faculty of Chemstry, Jagellonan
More informationInterpreting Patterns and Analysis of Acute Leukemia Gene Expression Data by Multivariate Statistical Analysis
Interpretng Patterns and Analyss of Acute Leukema Gene Expresson Data by Multvarate Statstcal Analyss ChangKyoo Yoo * and Peter A. Vanrolleghem BIOMATH, Department of Appled Mathematcs, Bometrcs and Process
More informationA hybrid global optimization algorithm based on parallel chaos optimization and outlook algorithm
Avalable onlne www.ocpr.com Journal of Chemcal and Pharmaceutcal Research, 2014, 6(7):1884-1889 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 A hybrd global optmzaton algorthm based on parallel
More informationOn-Line Fault Detection in Wind Turbine Transmission System using Adaptive Filter and Robust Statistical Features
On-Lne Fault Detecton n Wnd Turbne Transmsson System usng Adaptve Flter and Robust Statstcal Features Ruoyu L Remote Dagnostcs Center SKF USA Inc. 3443 N. Sam Houston Pkwy., Houston TX 77086 Emal: ruoyu.l@skf.com
More informationPredicting Software Development Project Outcomes *
Predctng Software Development Project Outcomes * Rosna Weber, Mchael Waller, June Verner, Wllam Evanco College of Informaton Scence & Technology, Drexel Unversty 3141 Chestnut Street Phladelpha, PA 19104
More informationSketching Sampled Data Streams
Sketchng Sampled Data Streams Florn Rusu, Aln Dobra CISE Department Unversty of Florda Ganesvlle, FL, USA frusu@cse.ufl.edu adobra@cse.ufl.edu Abstract Samplng s used as a unversal method to reduce the
More informationDynamic Pricing for Smart Grid with Reinforcement Learning
Dynamc Prcng for Smart Grd wth Renforcement Learnng Byung-Gook Km, Yu Zhang, Mhaela van der Schaar, and Jang-Won Lee Samsung Electroncs, Suwon, Korea Department of Electrcal Engneerng, UCLA, Los Angeles,
More informationSample Design in TIMSS and PIRLS
Sample Desgn n TIMSS and PIRLS Introducton Marc Joncas Perre Foy TIMSS and PIRLS are desgned to provde vald and relable measurement of trends n student achevement n countres around the world, whle keepng
More informationAn Enhanced Super-Resolution System with Improved Image Registration, Automatic Image Selection, and Image Enhancement
An Enhanced Super-Resoluton System wth Improved Image Regstraton, Automatc Image Selecton, and Image Enhancement Yu-Chuan Kuo ( ), Chen-Yu Chen ( ), and Chou-Shann Fuh ( ) Department of Computer Scence
More informationAN APPOINTMENT ORDER OUTPATIENT SCHEDULING SYSTEM THAT IMPROVES OUTPATIENT EXPERIENCE
AN APPOINTMENT ORDER OUTPATIENT SCHEDULING SYSTEM THAT IMPROVES OUTPATIENT EXPERIENCE Yu-L Huang Industral Engneerng Department New Mexco State Unversty Las Cruces, New Mexco 88003, U.S.A. Abstract Patent
More informationAn Analysis of Central Processor Scheduling in Multiprogrammed Computer Systems
STAN-CS-73-355 I SU-SE-73-013 An Analyss of Central Processor Schedulng n Multprogrammed Computer Systems (Dgest Edton) by Thomas G. Prce October 1972 Techncal Report No. 57 Reproducton n whole or n part
More informationA Fast Incremental Spectral Clustering for Large Data Sets
2011 12th Internatonal Conference on Parallel and Dstrbuted Computng, Applcatons and Technologes A Fast Incremental Spectral Clusterng for Large Data Sets Tengteng Kong 1,YeTan 1, Hong Shen 1,2 1 School
More informationMarginal Benefit Incidence Analysis Using a Single Cross-section of Data. Mohamed Ihsan Ajwad and Quentin Wodon 1. World Bank.
Margnal Beneft Incdence Analyss Usng a Sngle Cross-secton of Data Mohamed Ihsan Ajwad and uentn Wodon World Bank August 200 Abstract In a recent paper, Lanjouw and Ravallon proposed an attractve and smple
More information1 Example 1: Axis-aligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationwhere the coordinates are related to those in the old frame as follows.
Chapter 2 - Cartesan Vectors and Tensors: Ther Algebra Defnton of a vector Examples of vectors Scalar multplcaton Addton of vectors coplanar vectors Unt vectors A bass of non-coplanar vectors Scalar product
More informationDamage detection in composite laminates using coin-tap method
Damage detecton n composte lamnates usng con-tap method S.J. Km Korea Aerospace Research Insttute, 45 Eoeun-Dong, Youseong-Gu, 35-333 Daejeon, Republc of Korea yaeln@kar.re.kr 45 The con-tap test has the
More informationJet Engine. Figure 1 Jet engine
Jet Engne Prof. Dr. Mustafa Cavcar Anadolu Unversty, School of Cvl Avaton Esksehr, urkey GROSS HRUS INAKE MOMENUM DRAG NE HRUS Fgure 1 Jet engne he thrust for a turboet engne can be derved from Newton
More informationBinomial Link Functions. Lori Murray, Phil Munz
Bnomal Lnk Functons Lor Murray, Phl Munz Bnomal Lnk Functons Logt Lnk functon: ( p) p ln 1 p Probt Lnk functon: ( p) 1 ( p) Complentary Log Log functon: ( p) ln( ln(1 p)) Motvatng Example A researcher
More informationMixtures of Factor Analyzers with Common Factor Loadings for the Clustering and Visualisation of High-Dimensional Data
Mxtures of Factor Analyzers wth Common Factor Loadngs for the Clusterng and Vsualsaton of Hgh-Dmensonal Data Jangsun Baek 1 and Geoffrey J. McLachlan 2 1 Department of Statstcs, Chonnam Natonal Unversty,
More informationConversion between the vector and raster data structures using Fuzzy Geographical Entities
Converson between the vector and raster data structures usng Fuzzy Geographcal Enttes Cdála Fonte Department of Mathematcs Faculty of Scences and Technology Unversty of Combra, Apartado 38, 3 454 Combra,
More informationCausal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting
Causal, Explanatory Forecastng Assumes cause-and-effect relatonshp between system nputs and ts output Forecastng wth Regresson Analyss Rchard S. Barr Inputs System Cause + Effect Relatonshp The job of
More informationThe Greedy Method. Introduction. 0/1 Knapsack Problem
The Greedy Method Introducton We have completed data structures. We now are gong to look at algorthm desgn methods. Often we are lookng at optmzaton problems whose performance s exponental. For an optmzaton
More informationFragility Based Rehabilitation Decision Analysis
.171. Fraglty Based Rehabltaton Decson Analyss Cagdas Kafal Graduate Student, School of Cvl and Envronmental Engneerng, Cornell Unversty Research Supervsor: rcea Grgoru, Professor Summary A method s presented
More information1. Fundamentals of probability theory 2. Emergence of communication traffic 3. Stochastic & Markovian Processes (SP & MP)
6.3 / -- Communcaton Networks II (Görg) SS20 -- www.comnets.un-bremen.de Communcaton Networks II Contents. Fundamentals of probablty theory 2. Emergence of communcaton traffc 3. Stochastc & Markovan Processes
More informationPRIVATE SCHOOL CHOICE: THE EFFECTS OF RELIGIOUS AFFILIATION AND PARTICIPATION
PRIVATE SCHOOL CHOICE: THE EFFECTS OF RELIIOUS AFFILIATION AND PARTICIPATION Danny Cohen-Zada Department of Economcs, Ben-uron Unversty, Beer-Sheva 84105, Israel Wllam Sander Department of Economcs, DePaul
More information320 The Internatonal Arab Journal of Informaton Technology, Vol. 5, No. 3, July 2008 Comparsons Between Data Clusterng Algorthms Osama Abu Abbas Computer Scence Department, Yarmouk Unversty, Jordan Abstract:
More informationLogical Development Of Vogel s Approximation Method (LD-VAM): An Approach To Find Basic Feasible Solution Of Transportation Problem
INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH VOLUME, ISSUE, FEBRUARY ISSN 77-866 Logcal Development Of Vogel s Approxmaton Method (LD- An Approach To Fnd Basc Feasble Soluton Of Transportaton
More informationTitle Language Model for Information Retrieval
Ttle Language Model for Informaton Retreval Rong Jn Language Technologes Insttute School of Computer Scence Carnege Mellon Unversty Alex G. Hauptmann Computer Scence Department School of Computer Scence
More informationA study on the ability of Support Vector Regression and Neural Networks to Forecast Basic Time Series Patterns
A study on the ablty of Support Vector Regresson and Neural Networks to Forecast Basc Tme Seres Patterns Sven F. Crone, Jose Guajardo 2, and Rchard Weber 2 Lancaster Unversty, Department of Management
More informationONE of the most crucial problems that every image
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 23, NO. 10, OCTOBER 2014 4413 Maxmum Margn Projecton Subspace Learnng for Vsual Data Analyss Symeon Nktds, Anastasos Tefas, Member, IEEE, and Ioanns Ptas, Fellow,
More informationImplementation of Boolean Functions through Multiplexers with the Help of Shannon Expansion Theorem
Internatonal Journal o Computer pplcatons (975 8887) Volume 62 No.6, January 23 Implementaton o Boolean Functons through Multplexers wth the Help o Shannon Expanson Theorem Saurabh Rawat Graphc Era Unversty.
More informationGeorey E. Hinton. University oftoronto. Email: zoubin@cs.toronto.edu. Technical Report CRG-TR-96-1. May 21, 1996 (revised Feb 27, 1997) Abstract
The EM Algorthm for Mxtures of Factor Analyzers Zoubn Ghahraman Georey E. Hnton Department of Computer Scence Unversty oftoronto 6 Kng's College Road Toronto, Canada M5S A4 Emal: zoubn@cs.toronto.edu Techncal
More informationExtending Probabilistic Dynamic Epistemic Logic
Extendng Probablstc Dynamc Epstemc Logc Joshua Sack May 29, 2008 Probablty Space Defnton A probablty space s a tuple (S, A, µ), where 1 S s a set called the sample space. 2 A P(S) s a σ-algebra: a set
More informationA Multi-mode Image Tracking System Based on Distributed Fusion
A Mult-mode Image Tracng System Based on Dstrbuted Fuson Ln zheng Chongzhao Han Dongguang Zuo Hongsen Yan School of Electroncs & nformaton engneerng, X an Jaotong Unversty X an, Shaanx, Chna Lnzheng@malst.xjtu.edu.cn
More information