Multivariate Statistical Inference and Applications


 Homer Jenkins
 1 years ago
 Views:
Transcription
1 Multivariate Statistical Inference and Applications ALVIN C. RENCHER Department of Statistics Brigham Young University A WileyInterscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane Singapore Toronto
2 Contents Some Properties of Random Vectors and Matrices Introduction, Univariate and Bivariate Random Variables, Univariate Random Variables, Bivariate Random Variables, Mean Vectors and Covariance Matrices for Random Vectors, Correlation Matrices, Partitioned Mean Vectors and Covariance Matrices, Linear Functions of Random Variables, Sample Means, Variances, and Covariances, Population Means, Variances, and Covariances, Measuring Intercorrelation, Mahalanobis Distance, MissingData, Robust Estimators of fi and 2, 27 The Multivariate Normal Distribution Univariate and Multivariate Normal Density Functions, Univariate Normal, Multivariate Normal, Constant Density Ellipsoids, Generating Multivariate Normal Data, Moments, Properties of Multivariate Normal Random Vectors, Estimation of Parameters in the Multivariate Normal Distribution, 49 v
3 vi CONTENTS Maximum Likelihood Method, PropertiesofyandS, Wishart Distribution, Additional Topics, Hotelling's T 2 Tests Introduction, Test for HQ: fi = fi 0 with 2 Known, Hotelling's T 2 test for // 0 : fi = /x 0 with 2 Unknown, Univariate ftest for Ho: ix IM> with a 2 Unknown, Likelihood Ratio Method of Test Construction, OneSample r 2 Test, Formal Definition of T 2 and Relationship to F, Effect on 7 2 of Adding a Variable, Propertiesofthe7 2 Test, Likelihood Ratio Test, UnionIntersection Test, Confidence Intervals and Tests for Linear Functions of fi, Confidence Region for ft, Confidence Interval for a Single Linear Combination a'fi, Simultaneous Confidence Intervals for IJLJ and a'/m, Bonferroni Confidence Intervals for /x, and a'/u, Tests for H 0 : a'/u, = a'jto and H 0 : ju, 7 = /xo ; , Tests for H 0 : Cp = 0, Tests of H 0 : fx { = ft 2 Assuming 21 = 2 2, Review of Univariate Likelihood Ratio Test for H 0 : ix\ n>2 When a 2 = er 2, Test for H 0 : (JL { = fi 2 When 21 = 2 2, Effect on T 2 of Adding a Variable, Properties of thetwosample r 2 Statistic, Likelihood Ratio and UnionIntersection Tests, Confidence Intervals and Tests for Linear Functions of Two Mean Vectors, Confidence Region for fn x fi, 2, Simultaneous Confidence Intervals for a'ipi ~~ M2) anc^ Mi;  M2;, Bonferroni Confidence Intervals for a'(/*i _ M2) anc * Mi; _ M2;, 94
4 CONTENTS vii Tests for H 0 :a'(fi 1 fi 2 ) = a '^o and H 0j : tnj ~ Mj = 0, Test for H 0 : C(/A,  fi 2 ) = 0, Robustness of the r 2 test, Robustness to 2, + X 2, Robustness to Nonnormality, Paired Observation Test, Testing H 0 : Mi = M 2 When 21 = X 2, Univariate Case, Multivariate Case, Power and Sample Size, Tests on a Subvector, TwoSample Case, StepDown Test, Selectionof Variables, OneSample Case, Nonnormal Approaches to Hypothesis Testing, Elliptically Contoured Distributions, Nonparametric Tests, Robust Versions of T 2, Application of T 2 In Multivariate Quality Control, Multivariate Analysis of Variance OneWay Classification, Model for OneWay Multivariate Analysis of Variance, Wilks' Likelihood Ratio Test, Roy's UnionIntersection Test, The Pillai and LawleyHotelling Test Statistics, Summary of the Four Test Statistics, Effect of an Additional Variable on Wilks' A, Tests on Individual Variables, Power and Robustness Comparisons for the Four MANOVA Test Statistics, Tests for Equality of Covariance Matrices, Power and Sample Size for the Four MANOVA Tests, Contrasts Among Mean Vectors, Univariate Contrasts, Multivariate Contrasts, 145
5 viii CONTENTS 4.6. TwoWay Multivariate Analysis of Variance, Higher Order Models, Unbalanced Data, Introduction, Univariate OneWay Model, Multivariate OneWay Model, Univariate TwoWay Model, Multivariate TwoWay Model, Tests on a Subvector, Testing a Single Subvector, StepDown Test, Stepwise Selection of Variables, Multivariate Analysis of Covariance, Introduction, Univariate Analysis of Covariance: OneWay Model with One Covariate, Univariate Analysis of Covariance: TwoWay Model with One Covariate, Additional Topics in Univariate Analysis of Covariance, Multivariate Analysis of Covariance, Alternative Approaches to Testing Hot*>i ~ J*2 =  Pk> Discriminant Functions for Descriptive Group Separation Introduction, TwoGroups, Several Groups, Discriminant Functions, Assumptions, Standardized Coefficients, Tests of Hypotheses, TwoGroups, Several Groups, Discriminant Analysis for Higher Order Designs, Interpretation of Discriminant Functions, Standardized Coefficients and Partial FValues, Correlations between Variables and Discriminant Functions, 211
6 CONTENTS ix Other Approaches, Confidence Intervals, Subset Selection, Discriminant Function Approach to Selection, Stepwise Selection, All Possible Subsets, Selection in Higher Order Designs, Bias in Subset Selection, Other Estimators of Discriminant Functions, Ridge Discriminant Analysis and Related Techniques, Robust Discriminant Analysis, Classification of Observations into Groups Introduction, Two Groups, Equal Population Covariance Matrices, Unequal Population Covariance Matrices, Unequal Costs of Misclassification, Posterior Probability Approach, Robustness to Departures from the Assumptions, Robust Procedures, Several Groups, Equal Population Covariance Matrices, Unequal Population Covariance Matrices, Use of Linear Discriminant Functions for Classification, Estimation of Error Rates, Correcting for Bias in the Apparent Error Rate, Partitioning the Sample, Holdout Method, Bootstrap Estimator, Comparison of Error Estimators, Subset Selection, Selection Based on Separation of Groups, Selection Based on Allocation, Selection in the Heteroscedastic Case, Bias in Stepwise Classification Analysis, Logistic and Probit Classification, 254
7 X CONTENTS The Logistic Model for Two Groups with 2, = 2 2 > Comparison of Logistic Classification with Linear Classification Functions, Quadratic Logistic Functions When X i = X2, Logistic Classification for Several Groups, Additional Topics in Logistic Classification, Probit Classification, Additional Topics in Classification, Multivariate Regression Introduction, Multiple Regression: Fixedx's, Least Squares Estimators and Properties, An Estimator for er 2, The Model in Centered Form, Hypothesis Tests and Confidence Intervals, R 2 in FixedJt Regression, Model Validation, Multiple Regression: Random x's, Model for Random x's, Estimation of ßo> ß\, and CT 2, R 2 in Randomx Regression, Tests and Confidence Intervals, Estimation in the Multivariate Multiple Regression Model: Fixedx's, The Multivariate Model, Least Squares Estimator for B, Properties of B, An Estimator for X, Normal Model for the y,'s, The Multivariate Model in Centered Form, Measures of Multivariate Association, Hypothesis Tests in the Multivariate Multiple Regression Model: Fixedx's, Test for Significance of Regression, Test onasubsetof the RowsofB, General Linear Hypotheses CB = O and CBM = O, Tests and Confidence Intervals for a Single ßß and a Bilinear Function a'bb, 297
8 CONTENTS xi Simultaneous Tests and Confidence Intervals for the ß jk 's and Bilinear Functions a'bb, Tests in the Presence of Missing Data, Multivariate Model Validation: Fixedx's, LackofFit Tests, Residuais, Influence and Outliers, Measurement Errors, Multivariate Regression: Random x's, Multivariate Normal Model for Random x's, Estimationofßo, Bi.andX, Tests and Confidence Intervals in the Multivariate Randomx Case, Additional Topics, Correlated Response Methods, Categorical Data, Subset Selection, Other Topics, Canonical Correlation Introduction, Canonical Correlations and Canonical Variates, Properties of Canonical Correlations and Variates, Properties of Canonical Correlations, Properties of Canonical Variates, Tests of Significance for Canonical Correlations, Tests of Independence of y and x, Test of Dimension of Relationship between the y's and the x's, Validation, Interpretation of Canonical Variates, Standardized Coefficients, Rotation of Canonical Variate Coefficients, Correlations between Variables and Canonical Variates, Redundancy Analysis, Additional Topics, 333
9 xii CONTENTS 9. Principal Component Analysis Introduction, Definition and Properties of Principal Components, Maximum Variance Property, Principal Components as Projections, Properties of Principal Components, Principal Components as a Rotation of Axes, Principal Components from the Correlation Matrix, Methods for Discarding Components, Percent of Variance, Average Eigenvalue, Scree Graph, Significance Tests, Other Methods, Information in the Last Few Principal Components, Interpretation of Principal Components, Special Patterns in S or R, Testing H 0 : X = er 2 [(1  p)i + pj] and P p = (1  p)i + pj, Additional Rotation, Correlations between Variables and Principal Components, Relationship Between Principal Components and Regression, Principal Component Regression, Latent Root Regression, Principal Component Analysis with Grouped Data, Additional Topics, Factor Analysis Introduction, Basic Factor Model, Model and Assumptions, Scale Invariance of the Model, Rotation of Factor Loadings in the Model, Estimation of Loadings and Communalities, Principal Component Method, Principal Factor Method, Iterated Principal Factor Method, 384
10 CONTENTS xiii Maximum Likelihood Method, Other Methods, Comparison of Methods, Determining the Number of Factors, m, Rotation of Factor Loadings, Introduction, Orthogonal Rotation, Oblique Rotations, Interpretation of the Factors, Factor Scores, Applicability of the Factor Analysis Model, Factor Analysis and Grouped Data, Additional Topics, 394 Appendix A. Review of Matrix Algebra 399 A.l. Introduction, 399 A.l.l. Basic Definitions, 399 A.1.2. Matrices with Special Patterns, 400 A.2. Properties of Matrix Addition and Multiphcation, 401 A.3. Partitioned Matrices, 404 A.4. Rank of Matrices, 406 A.5. Inverse Matrices, 407 A.6. Positive Definite and Positive Semidefinite Matrices, 408 A.7. Determinants, 409 A.8. Traceofa Matrix, 410 A.9. Orthogonal Vectors and Matrices, 410 A.10. Eigenvalues and Eigenvectors, 411 A. 11. Eigenstructure of Symmetrie and Positive Definite Matrices, 412 A.12. Idempotent Matrices, 414 A.B. Differentiation, 414 Appendix B. Tables 417 Appendix C. Answers and Hints to Selected Problems 449 Appendix D. About the Diskette 505 Bibliography 507 Index 549
Multivariate Analysis of Variance (MANOVA): I. Theory
Gregory Carey, 1998 MANOVA: I  1 Multivariate Analysis of Variance (MANOVA): I. Theory Introduction The purpose of a t test is to assess the likelihood that the means for two groups are sampled from the
More informationIBM SPSS Missing Values 22
IBM SPSS Missing Values 22 Note Before using this information and the product it supports, read the information in Notices on page 23. Product Information This edition applies to version 22, release 0,
More informationOn estimation efficiency of the central mean subspace
J. R. Statist. Soc. B (2014) 76, Part 5, pp. 885 901 On estimation efficiency of the central mean subspace Yanyuan Ma Texas A&M University, College Station, USA and Liping Zhu Shanghai University of Finance
More information5.1 CHISQUARE TEST OF INDEPENDENCE
C H A P T E R 5 Inferential Statistics and Predictive Analytics Inferential statistics draws valid inferences about a population based on an analysis of a representative sample of that population. The
More informationSupplementary PROCESS Documentation
Supplementary PROCESS Documentation This document is an addendum to Appendix A of Introduction to Mediation, Moderation, and Conditional Process Analysis that describes options and output added to PROCESS
More informationTHE USE OF PRINCIPAL COMPONENTS AND UNIVARIATE CHARTS TO CONTROL MULTIVARIATE PROCESSES
versão impressa ISSN 007438 / versão online ISSN 67854 THE USE OF PRINCIPAL COMPONENTS AND UNIVARIATE CHARTS TO CONTROL MULTIVARIATE PROCESSES Marcela A. G. Machado* Antonio F. B. Costa Production Department
More informationPartial Least Squares (PLS) Regression.
Partial Least Squares (PLS) Regression. Hervé Abdi 1 The University of Texas at Dallas Introduction Pls regression is a recent technique that generalizes and combines features from principal component
More informationAn analysis method for a quantitative outcome and two categorical explanatory variables.
Chapter 11 TwoWay ANOVA An analysis method for a quantitative outcome and two categorical explanatory variables. If an experiment has a quantitative outcome and two categorical explanatory variables that
More informationRecall this chart that showed how most of our course would be organized:
Chapter 4 OneWay ANOVA Recall this chart that showed how most of our course would be organized: Explanatory Variable(s) Response Variable Methods Categorical Categorical Contingency Tables Categorical
More information1 Theory: The General Linear Model
QMIN GLM Theory  1.1 1 Theory: The General Linear Model 1.1 Introduction Before digital computers, statistics textbooks spoke of three procedures regression, the analysis of variance (ANOVA), and the
More informationRegression. Chapter 2. 2.1 Weightspace View
Chapter Regression Supervised learning can be divided into regression and classification problems. Whereas the outputs for classification are discrete class labels, regression is concerned with the prediction
More informationRichard E. Zinbarg northwestern university, the family institute at northwestern university. William Revelle northwestern university
psychometrika vol. 70, no., 23 33 march 2005 DOI: 0.007/s33600309747 CRONBACH S α, REVELLE S β, AND MCDONALD S ω H : THEIR RELATIONS WITH EACH OTHER AND TWO ALTERNATIVE CONCEPTUALIZATIONS OF RELIABILITY
More informationThe InStat guide to choosing and interpreting statistical tests
Version 3.0 The InStat guide to choosing and interpreting statistical tests Harvey Motulsky 19902003, GraphPad Software, Inc. All rights reserved. Program design, manual and help screens: Programming:
More informationwww.rmsolutions.net R&M Solutons
Ahmed Hassouna, MD Professor of cardiovascular surgery, AinShams University, EGYPT. Diploma of medical statistics and clinical trial, Paris 6 university, Paris. 1A Choose the best answer The duration
More informationApplying MCMC Methods to Multilevel Models submitted by William J Browne for the degree of PhD of the University of Bath 1998 COPYRIGHT Attention is drawn tothefactthatcopyright of this thesis rests with
More informationAn Introduction to Variable and Feature Selection
Journal of Machine Learning Research 3 (23) 11571182 Submitted 11/2; Published 3/3 An Introduction to Variable and Feature Selection Isabelle Guyon Clopinet 955 Creston Road Berkeley, CA 9478151, USA
More informationNCSS Statistical Software
Chapter 06 Introduction This procedure provides several reports for the comparison of two distributions, including confidence intervals for the difference in means, twosample ttests, the ztest, the
More informationRanking Methods for Tensor Components Analysis and their Application to Face Images
Raning Methods for Tensor Components Analysis and their Application to Face Images Tiene A. Filisbino, Gilson A. Giraldi National Laboratory for Scientific Computing LNCC Petropolis, Brazil {tiene,gilson}@lncc.br
More informationNew Features in JMP 9
Version 9 New Features in JMP 9 The real voyage of discovery consists not in seeking new landscapes, but in having new eyes. Marcel Proust JMP, A Business Unit of SAS SAS Campus Drive Cary, NC 27513 The
More informationExplaining Cointegration Analysis: Part II
Explaining Cointegration Analysis: Part II David F. Hendry and Katarina Juselius Nuffield College, Oxford, OX1 1NF. Department of Economics, University of Copenhagen, Denmark Abstract We describe the concept
More informationGuide to Biostatistics
MedPage Tools Guide to Biostatistics Study Designs Here is a compilation of important epidemiologic and common biostatistical terms used in medical research. You can use it as a reference guide when reading
More informationGene Selection for Cancer Classification using Support Vector Machines
Gene Selection for Cancer Classification using Support Vector Machines Isabelle Guyon+, Jason Weston+, Stephen Barnhill, M.D.+ and Vladimir Vapnik* +Barnhill Bioinformatics, Savannah, Georgia, USA * AT&T
More informationKey Performance Monitoring and Diagnosis in Industrial Automation Processes
Key Performance Monitoring and Diagnosis in Industrial Automation Processes Von der Fakultät für Ingenieurwissenschaften Abteilung Elektrotechnik und Informationstechnik der Universität DuisburgEssen
More informationEffectSize Indices for Dichotomized Outcomes in MetaAnalysis
Psychological Methods Copyright 003 by the American Psychological Association, Inc. 003, Vol. 8, No. 4, 448 467 108989X/03/$1.00 DOI: 10.1037/108989X.8.4.448 EffectSize Indices for Dichotomized Outcomes
More informationEvaluation of Interest Point Detectors
International Journal of Computer Vision 37(2), 151 172, 2000 c 2000 Kluwer Academic Publishers. Manufactured in The Netherlands. Evaluation of Interest Point Detectors CORDELIA SCHMID, ROGER MOHR AND
More informationBest Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis
A peerreviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to
More informationModelling dependent yearly claim totals including zeroclaims in private health insurance
Modelling dependent yearly claim totals including zeroclaims in private health insurance Vinzenz Erhardt, Claudia Czado Technische Universität München, Zentrum Mathematik, Boltzmannstr. 3, 85747 Garching,
More informationED ESTIMATING DISTRIBUT LAGS IN SHORT PANELS WITH AN APPLICATION TO THE SPECIFICATION OF DEPRECTATION PATTERNS AND CAPITAL STOCK CONSTRUCTS
NBER WORKING PAPER SERIES ED ESTIMATING DISTRIBUT LAGS IN SHORT PANELS WITH AN APPLICATION TO THE SPECIFICATION OF DEPRECTATION PATTERNS AND CAPITAL STOCK CONSTRUCTS Ariel Pakes Zvi Griliches Working Paper
More informationRegression Modeling and MetaAnalysis for Decision Making: A CostBenefit Analysis of Incentives in Telephone Surveys
Regression Modeling and MetaAnalysis for Decision Making: A CostBenefit Analysis of Incentives in Telephone Surveys Andrew Gelman, Matt Stevens, and Valerie Chan Departments of Statistics and Political
More informationTesting for the Equivalence of Factor Covariance and Mean Structures: The Issue of Partial Measurement In variance
PsrchologKal Bulletin 989, Vol. IDS, No. 3,4564*6 Copyright 989 by the American Psy=hak>gical Association, Inc. 00332909/89/W0.75 Testing for the Equivalence of Factor Covariance and Mean Structures:
More information