SUMO user guide. PsN 4.6.0. Revised 2015-09-30



Similar documents
Data Analysis Tools. Tools for Summarizing Data

Regression step-by-step using Microsoft Excel

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

One-Way Analysis of Variance (ANOVA) Example Problem

CDD user guide. PsN Revised

Independent t- Test (Comparing Two Means)

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

2 Sample t-test (unequal sample sizes and unequal variances)

Bill Burton Albert Einstein College of Medicine April 28, 2014 EERS: Managing the Tension Between Rigor and Resources 1

Summary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)

Scatter Plots with Error Bars

Multivariate Analysis of Variance (MANOVA)

Drawing a histogram using Excel

Department of Economics

Regression Analysis: A Complete Example

STATISTICA Formula Guide: Logistic Regression. Table of Contents

ABSORBENCY OF PAPER TOWELS

Standard Deviation Estimator

Data Mining Techniques Chapter 5: The Lure of Statistics: Data Mining Using Familiar Tools

Part 2: Analysis of Relationship Between Two Variables

Linear Algebra and TI 89

1.5 Oneway Analysis of Variance

1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Chapter 5 Analysis of variance SPSS Analysis of variance

How Does My TI-84 Do That

Simple Linear Regression Inference

12: Analysis of Variance. Introduction

LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING

NCSS Statistical Software

Chapter 7 Notes - Inference for Single Samples. You know already for a large sample, you can invoke the CLT so:

Binary Diagnostic Tests Two Independent Samples

Factor Analysis. Chapter 420. Introduction

Multiple regression - Matrices

ee-quipment.com ee203 RTCM USB Quick-Start Guide

An introduction to Value-at-Risk Learning Curve September 2003

CHAPTER THREE COMMON DESCRIPTIVE STATISTICS COMMON DESCRIPTIVE STATISTICS / 13

Stepwise Regression. Chapter 311. Introduction. Variable Selection Procedures. Forward (Step-Up) Selection

Multivariate Analysis of Variance (MANOVA): I. Theory

One-Way ANOVA using SPSS SPSS ANOVA procedures found in the Compare Means analyses. Specifically, we demonstrate

Multivariate Analysis of Variance. The general purpose of multivariate analysis of variance (MANOVA) is to determine

Means, standard deviations and. and standard errors

Two-Sample T-Tests Assuming Equal Variance (Enter Means)

How To Check For Differences In The One Way Anova

Using Excel in Research. Hui Bian Office for Faculty Excellence

Chicago Booth BUSINESS STATISTICS Final Exam Fall 2011

Please follow the directions once you locate the Stata software in your computer. Room 114 (Business Lab) has computers with Stata software

Using R for Linear Regression

Two-Sample T-Tests Allowing Unequal Variance (Enter Difference)

CALCULATIONS & STATISTICS

3.4 Statistical inference for 2 populations based on two samples

UNDERSTANDING THE INDEPENDENT-SAMPLES t TEST

Two Related Samples t Test

4. Continuous Random Variables, the Pareto and Normal Distributions

Two Correlated Proportions (McNemar Test)

Using Excel for inferential statistics

Week 4: Standard Error and Confidence Intervals

Once saved, if the file was zipped you will need to unzip it. For the files that I will be posting you need to change the preferences.

Chapter 15. Mixed Models Overview. A flexible approach to correlated data.

Chapter 7. One-way ANOVA

Introduction to Analysis of Variance (ANOVA) Limitations of the t-test

Variables Control Charts

Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name:

A Brief Introduction to SPSS Factor Analysis

Chapter 3 RANDOM VARIATE GENERATION

Simple linear regression

Statistical Confidence Calculations

hp calculators HP 50g Trend Lines The STAT menu Trend Lines Practice predicting the future using trend lines

Gage Studies for Continuous Data

2013 MBA Jump Start Program. Statistics Module Part 3

CHAPTER 12 EXAMPLES: MONTE CARLO SIMULATION STUDIES

Statistical Functions in Excel

Multivariate normal distribution and testing for means (see MKB Ch 3)

Lecture 5: Singular Value Decomposition SVD (1)

MBA 611 STATISTICS AND QUANTITATIVE METHODS

Meta-Analytic Synthesis of Studies Conducted at Marzano Research Laboratory on Instructional Strategies

Factors affecting online sales

Calculating P-Values. Parkland College. Isela Guerra Parkland College. Recommended Citation

Comparables Sales Price

Regression Clustering

Stat 411/511 THE RANDOMIZATION TEST. Charlotte Wickham. stat511.cwick.co.nz. Oct

Confidence Intervals for Cp

Stats for Strategy Fall 2012 First-Discussion Handout: Stats Using Calculators and MINITAB

Understanding Confidence Intervals and Hypothesis Testing Using Excel Data Table Simulation

Lecture Notes Module 1

Lesson 1: Comparison of Population Means Part c: Comparison of Two- Means

Least-Squares Intersection of Lines

Data Analysis for Marketing Research - Using SPSS

Confidence Intervals for Exponential Reliability

Multiple-Comparison Procedures

Projects Involving Statistics (& SPSS)

Task Scheduler. Morgan N. Sandquist Developer: Gary Meyer Reviewer: Lauri Watts

Chapter 2 Probability Topics SPSS T tests

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION

Calculator Notes for the TI-Nspire and TI-Nspire CAS

ECONOMICS 351* -- Stata 10 Tutorial 2. Stata 10 Tutorial 2

Multicollinearity Richard Williams, University of Notre Dame, Last revised January 13, 2015

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Transcription:

SUMO user guide PsN 4.6.0 Revised 2015-09-30 1 Introduction The sumo script is used to summarize output from a NONMEM run and print it to screen. It takes a lst-file as input. Example sumo run33.lst 2 Output The above command may produce output similar to this: ----------------------------------------------------------------------- run33.lst Successful minimization [ OK ] No rounding errors [ OK ] No zero gradients [ OK ] No final zero gradients [ OK ] Hessian not reset [ OK ] Parameter(s) near boundary [ WARNING ] OMEGA(2,2) 0.000112 0 Covariance step [ OK ] Large standard errors found [ WARNING ] 1

OMEGA(1,1) 1.08589 OMEGA(2,2) 1.01786 OMEGA(3,2) 0.848024 OMEGA(3,3) 0.548035 Large condition number [ WARNING ] Correlations [ OK ] 0MINIMIZATION SUCCESSFUL NO. OF FUNCTION EVALUATIONS USED: 172 NO. OF SIG. DIGITS IN FINAL EST.: 3.4 ETABAR IS THE ARITHMETIC MEAN OF THE ETA-ESTIMATES, AND THE P-VALUE IS GIVEN FOR THE NULL HYPOTHESIS THAT THE TRUE MEAN IS 0. ETABAR: -0.41E-01 0.59E-03 0.30E-01 SE: 0.35E+00 0.25E-02 0.18E+00 P VAL.: 0.91E+00 0.82E+00 0.87E+00 Objective function value: 116.966 Condition number: 1.215e+004 THETA OMEGA SIGMA THETA1 1.87 (-0.2503) OMEGA(1,1) 1.277 (-1.086) SIGMA(1,1) 0.478 (-0.2762) THETA2 0.0862 (-0.05139) OMEGA(2,2) 0.01058 (-1.018) THETA3 0.0398 (-0.08266) OMEGA(3,2) 0.9187 (-0.848) OMEGA(3,3) 0.6768 (-0.548) ----------------------------------------------------------------------- The first section of the output from sumo contains run diagnostics. They are largely self-explanatory but some of them depends on cut-off values. For example, the diagnostics for a large condition number compares the obtained condition number to a cut-off value, normally 1000. The default values for the cut-off values can be changed by setting them in [default_sumo_options] in psn.conf. It is possible to override a default value by specifying it as an option to sumo (see below). Next are the NONMEM minimization messages and $COV messages, including etabars etc. Following this is the objective function value. If $COV 2

has been requested with the PRINT=E option (so that NONMEM reports eigenvalues) the condition number is also reported (the ratio between the largest and smallest eigenvalue) The column THETA contains the theta estimates as reported in the NONMEM output file and the numbers in parentheses after the theta estimates, are the relative standard errors (SE/Est). The square roots of the estimates of the diagonal elements of the OMEGA and SIGMA matrices in the NONMEM output file are reported in the OMEGA and SIGMA columns (except when -ci is used, see below). The off-diagonal cov(om1,om2) estimates are reported as the corresponding correlations, i.e. var(om1) var(om2). The numbers in parentheses after the OMEGA and SIGMA columns are the relative SEs of the variance and covariance estimates, as taken from the NONMEM output file (but see option -ci and -sd_rse below). Relative standard errors are not displayed unless NONMEM reports the standard errors in the output file, i.e. when the covariance step has been requested and has terminated successfully. If the user has set labels for the parameters in the control stream, those labels are used instead of the generic THETA1, OMEGA(1,1) etc. Parameters that are FIXED or SAME are excluded from the table. PsN will read the control stream copy at the top of the lst-file to investigate which parameters are estimated. It is a known bug that if the control stream has $MSFI, and hence no $THETA, $OMEGA or $SIGMA records, the table with population parameters will be empty. 3 Input and options 3.1 Required input An lst-file is required on the command-line. 3.2 Optional input -c_level = number Default 95. This option specifies the coverage of the confidence interval computed by the -ci option (see below). Allowed values are 90, 95, 99 and 99.5 3

-ci Default not set. This option computes and reports the traditional confidence intervals for the parameter estimates instead of the relative standard errors: CI = estimate +/- c_level*se. With this option the parameter estimates reported in the OMEGA and SIGMA columns are the numbers given in the NONMEM output file, i.e. no transformation to CVs or correlations is performed. -condition_number_limit = number Default 1000. The cut-off for issuing a warning for a high condition number. The test will only be made if the $COV step has been requested in the NMtran control stream and NONMEM has been asked to report eigenvalues ($COV PRINT=E). The default is set in psn.conf. -correlation_limit = number Default 0.9. The cut-off for issuing a warning for high correlations between the parameter estimates. This test will only be made if the $COV step has been requested in the NMtran control stream. The default is set in psn.conf. -csv Default not set. Produce output in which the columns of the parameters estimates and standard errors are comma separated. This option can be used if you wish to import the sumo output into a spreadsheet programs, such as MS Excel. (Something like this is probably what you would want to do in that case: sumo -csv run1.lst > sumooutput.csv) -large_omega_cv_limit = number Default 0.5. When the CV (SE/estimate) for a parameter estimates is greater than this a warning will be issued. -large_sigma_cv_limit = number Default 0.3. When the CV (SE/estimate) for a parameter estimates is greater than this a warning will be issued. -large_theta_cv_limit = number Default 0.3. When the CV (SE/estimate) for a parameter es- 4

timates is greater than this a warning will be issued. -max_problem_num = integer Default 1. The default is for sumo to report the results for the first $PROBLEM only. Set this option larger than 1 to report results for additional problems. -max_subproblem_num = integer Default 1. The default is for sumo to report the results only for the first subproblem of the selected problems. Each problem contains at least one sub-problem. Should $SIMULATION be used there will be as many sub-problems as the value of NSUBS. -near_bound_sign_digits = integer Default 2. When a parameter estimates is equal to a boundary with these many signi ficant digits, a warning will be issued. The default is for NONEM VI to report if parameter estimates are close to a boundary value but this can be turned off. The boundary test in sumo is independent of the way NONMEM is configured and will report these types of issues in output from NONMEM. -near_zero_boundary_limit = number Default 0.001. If the bound is 0, the boundary test will issue a warning if the estimate is this close to zero. -check_run Default set. When unset with -no-check_run the initial run diagnostic output of sumo will be suppressed. -precision = integer Default 4. Precision in output. -sd_rse Default set. If sd_rse is not set sumo will report the relative standard errors for the random effects parameters (omega and sigma) on the variance scale (SE/variance estimate). If sd_rse is set, sumo will report these on the (approximate) standard deviation scale: (SE/variance estimate)/2. 5

-sign_digits_off_diagonals = integer Default 2. The boundary test for off-diagonal omega elements are performed by first converting the covariances to the corresponding correlations and then check if they are close to +/-1 with this many significant digits. 6