# Linear Model Theory: Univariate, Multivariate, and Mixed Models / Edition 1

Hardcover (Print)
Buy New from BN.com
\$140.16
(Save 4%)
Used and New from Other Sellers
Used and New from Other Sellers
from \$72.87
Usually ships in 1-2 business days
(Save 50%)
Other sellers (Hardcover)
• All (6) from \$72.87
• New (5) from \$72.87
• Used (1) from \$145.99

### Overview

precise and accessible presentation of linear model theory, illustrated with data examples Statisticians often use linear models for data analysis and for developing new statistical methods. Most books on the subject have historically discussed univariate, multivariate, and mixed linear models separately, whereas Linear Model Theory: Univariate, Multivariate, and Mixed Models presents a unified treatment in order to make clear the distinctions among the three classes of models. Linear Model Theory: Univariate, Multivariate, and Mixed Models begins with six chapters devoted to providing brief and clear mathematical statements of models, procedures, and notation. Data examples motivate and illustrate the models. Chapters 7-10 address distribution theory of multivariate Gaussian variables and quadratic forms. Chapters 11-19 detail methods for estimation, hypothesis testing, and confidence intervals. The final chapters, 20-23, concentrate on choosing a sample size. Substantial sets of excercises of varying difficulty serve instructors for their classes, as well as help students to test their own knowledge. The reader needs a basic knowledge of statistics, probability, and inference, as well as a solid background in matrix theory and applied univariate linear models from a matrix perspective. Topics covered include: A review of matrix algebra for linear models The general linear univariate model The general linear multivariate model Generalizations of the multivariate linear model The linear mixed model Multivariate distribution theory Estimation in linear models Tests in Gaussian linear models Choosing a sample size in Gaussian linear models Filling the need for a text that provides the necessary theoretical foundations for applying a wide range of methods in real situations, Linear Model Theory: Univariate, Multivariate, and Mixed Models centers on linear models of interval scale responses with finite second moments. Models with

Read More Show Less

### Editorial Reviews

##### From the Publisher
"This text successfully offers a unified context for the theory of univariate, multivariate, and mixed modeling settings and may be useful supplemental text for individuals interested in multivariate modeling." (Journal of the American Statistician, December 2008)

"I believe that this text provides an important contribution to the long-memory time series literature.  I feel that it largely achieves its aims and could be useful for those instructors wishing to teach a semester-long special topics course … .I strongly recommend this book to anyone interested in long-memory time series.  Both researchers and beginners alike will find this text extremely useful." (Journal of the American Statistician, December 2008)

"The book will certainly be useful for Ph.D. students and researchers in biostatistics who want to learn a little bit of theory of linear models." (Mathematical Reviews, 2007)

"...stands out from the others...will certainly have its enthusiastic supporters." (Biometrics, March 2007)

"…an excellent book for graduate students and professional researchers." (MAA Reviews, February 2007)

"The focus of this book is on linear models with correlated observations and Gaussian errors." (Zentralblatt MATH, April 2007)

Read More Show Less

### Product Details

• ISBN-13: 9780471214885
• Publisher: Wiley
• Publication date: 8/4/2006
• Series: Wiley Series in Probability and Statistics
• Edition description: New Edition
• Edition number: 1
• Pages: 410
• Product dimensions: 6.34 (w) x 9.29 (h) x 0.99 (d)

### Meet the Author

KEITH E. MULLER, PhD, is Professor and Director of the Division of Biostatistics in the Department of Epidemiology and Health Policy Research in the College of Medicine at the University of Florida in Gainesville, as well as Professor Emeritus of Biostatistics at The University of North Carolina at Chapel Hill where the book was written.

PAUL W. STEWART, PhD, is Research Associate Professor of Biostatistics at The University of North Carolina at Chapel Hill.

Read More Show Less

Preface.

PART I: MODELS AND EXAMPLES.

1. Matrix Algebra for Linear Models.

1.1 Notation.

1.2 Some Operators and Special Types of Matrices.

1.3 Five Kinds of Multiplication.

1.4 The Direct Sum.

1.5 Rules of Operations.

1.6 Other Special Types of matrices.

1.7 Quadratic and Bilinear Forms.

1.8 Vector Spaces and Rank.

1.9 Finding Rank.

1.10 Determinants.

1.11 The Inverse and Generalized Inverse.

1.12 Eigenanalysis (Spectral Decomposition).

1.13 Some Factors of Symmetric Matrices.

1.14 Singular Value Decomposition.

1.15 Projections and Other Functions of a Design matrix.

1.16 Special Properties of Patterned Matrices.

1.17 Functional Optimization and Matrix Derivatives.

1.18 Statistical Notation Involving Matrices.

1.19 Statistical Formulas.

1.20 Principal Components.

1.21 Special Covariance Patterns.

2. The General Linear Univariate Model.

2.1 Introduction.

2.2 Model Concepts.

2.3 The General Linear Univariate Linear Model.

2.4 The Univariate General Linear Hypothesis.

2.5 Tests about Variances.

2.6 The Role of the Intercept.

2.7 Population Correlation and Strength of Relationship.

2.8 Statistical Estimates.

2.9 Testing the General Linear Hypothesis.

2.10 Confidence Regions for θ.

2.11 Sufficient Statistics for the Univariate Model.

Exercises.

3. The General Linear Multivariate Model.

3.1 Motivation.

3.2 Definition of the Multivariate Model.

3.3 The Multivariate General Linear Hypothesis.

3.4 Tests About Covariance Matrices.

3.5 Population Correlation.

3.6 Statistical Estimates.

3.7 Overview of Testing Multivariate Hypotheses.

3.8 Computing MULTIREP Tests.

3.9 Computing UNIREP tests.

3.10 Confidence Regions for Θ.

3.11 Sufficient Statistics for the Multivariate Model.

3.12 Allowing Missing Data in the Multivariate Model.

Exercises.

4. Generalizations of the Multivariate Linear Model.

4.1 Motivation.

4.2 The Generalized General Linear Univariate Model: Exact and Approximate Weighted Least Squares.

4.3 Doubly Multivariate Models.

4.4 Seemingly Unrelated Regression.

4.5 Growth Curve Models (GMANOVA).

4.6 The Relationship of the GCM to the Multivariate Model.

4.7 Mixed, Hierarchical, and Related Models.

5. The Linear Mixed Model.

5.1 Motivation.

5.2 Definition of the Mixed Model.

5.3 Distribution-Free and Noniterative Estimates.

5.4 Gaussian Likelihood and Iterative Estimates.

5.5 Tests about β (Means, Fixed Effects).

5.6 Tests of Covariance Parameters, τ (random Effects).

Exercises.

6. Choosing the Form of a Linear Model for Analysis.

6.1 The Importance of Understanding Dependence.

6.2 How Many Variables per Independent Sampling Unit?

6.3 What Types of Variables Play a Role?

6.4 What Repeated Sampling Scheme Was Used?

6.5 Analysis Strategies for Multivariate Data.

6.6 cautions and Recommendations.

6.7 Review of Linear Model Notation.

PART II: MULTIVARIATE DISTRIBUTION THEORY.

7. General Theory of Multivariate Distributions.

7.1 Motivation.

7.2 Notation and Concepts.

7.3 Families of Distributions.

7.4 Cumulative Distribution Function.

7.5 Probability Density Function.

7.6 Formulas for Probabilities and Moments.

7.7 Characteristic Function.

7.8 Moment Generating Function.

7.9 Cumulant generating Function.

7.10 Transforming Random Variables.

7.11 Marginal Distributions.

7.12 Independence of Random Vectors.

7.13 Conditional Distributions.

7.14 (Joint) Moments of Multivariate Distributions.

7.15 Conditional Moments of Distributions.

7.16 Special Considerations for Random Matrices.

8. Scalar, vector, and Matrix Gaussian Distributions.

8.1 Motivation.

8.2 The Scalar Gaussian Distribution.

8.3 The Vector (“Multivariate”) Gaussian Distribution.

8.4 Marginal Distributions.

8.5 Independence.

8.6 Conditional Distributions.

8.7 Asymptotic Properties.

8.8 The matrix Gaussian Distribution.

8.9 Assessing, Multivariate Gaussian Distribution.

8.10 Tests for Gaussian Distribution.

Exercises.

9. Univariate Quadratic Forms.

9.1 Motivation.

9.2 Chi-Square Distributions.

9.3 General Properties of Quadratic Forms.

9.4 Properties of Quadratic Forms in Gaussian Vectors.

9.5 Independence among Linear and Quadratic Forms.

9.6 The ANOVA Theorem.

9.7 Ratios Involving Quadratic Forms.

Exercises.

10. Multivariate Quadratic Forms.

10.1 The Wishart Distribution.

10.2 The Characteristic Function of the Wishart.

10.3 Properties of the Wishart.

10.4 The Inverse Wishart.

10.5 Related Distributions.

Exercises.

PART III: ESTIMATION IN LINEAR MODELS.

11. Estimation for Univariate and Weighted Linear Models.

11.1 Motivation.

11.2 Statement of the Problem.

11.3 (Unrestricted) Linear Equivalent Linear Models.

11.4 Estimability and Criteria for Checking It.

11.5 Coding Schemes and the Essence matrix.

11.6 Unrestricted Maximum Likelihood Estimation of β.

11.7 Unrestricted BLUE Estimation of β.

11.8 Unrestricted Least Squares Estimation of β.

11.9 Unrestricted Maximum Likelihood Estimation of θ.

11.10 Unrestricted BLUE of θ.

11.11 Related Distributions.

11.12 Formulations of Explicit Restrictions of β and θ.

11.13 Restricted Estimation Via Equivalent Models.

11.14 Fitting Piecewise Polynomial Models Via Splines.

11.15 Estimation for the GGLM: Weighted Least Squares.

Exercises.

12. Estimation for Multivariate Linear Models.

12.1 Alternate Formulations of the Model.

12.2 Estimability in the Multivariate GLM.

12.3 Unrestricted Likelihood Estimation.

12.4 Estimation of Secondary Parameters.

12.5 Estimation with Multivariate Restrictions.

12.6 Unrestricted Estimation With Compound Symmetry: the “Univariate” Approach to Repeated Measures.

Exercises.

13. Estimation for Generalizations of Multivariate Models.

13.1 Motivation.

13.2 Criteria and Algorithms.

13.3 Weighted Estimation of β and Σ.

13.4 Transformations among Growth Curve Designs.

13.5 Within-Individual Design matrices.

13.6 Estimation Methods.

13.7 Relationships to the Univariate and Mixed Models.

Exercises.

14. Estimation for Linear Mixed Models.

14.1 Motivation.

14.2 Statement of the General Linear Mixed Models.

14.3 Estimation and Estimability.

14.4 Some Special Types of Models.

14.5 ML Estimation.

14.6 REML Estimation.

14.7 Small-Sample Properties of Estimators.

14.8 Large-Sample Properties of Variance Estimators.

14.9 Conditional Estimation of di and BLUP Prediction.

Exercises.

PART IV: TESTS IN GAUSSIAN LINEAR MODELS.

15. Tests for Univariate Linear Models.

15.1 Motivation.

15.2 Testability of Univariate Hypotheses.

15.3 Tests of a Priori Hypotheses.

15.4 Related Distributions.

15.5 Transformations and Invariance Properties.

15.6 Confidence Regions for θ.

Exercises.

16. Tests for Multivariate Linear Models.

16.1 Motivation.

16.2 Testability of Multivariate Hypotheses.

16.3 Tests of a Priori Hypotheses.

16.4 Linear Invariance.

16.5 Four Multivariate Test Statistics.

16.6 Which Multivariate Test Is Best?

16.7 Univariate Approach to Repeated Measures: UNIREP.

16.8 More on Invariance Properties.

16.9 Tests of Hypotheses about Σ.

16.10 Confidence Regions for Θ.

Exercises.

17. Tests for Generalizations of Multivariate Linear Models.

17.1 Motivation.

17.2 Doubly Multivariate Models.

17.3 Missing Responses in Multivariate Linear Models.

17.4 Exact and Approximate Weighted Least Squares.

17.5 Seemingly Unrelated Regressions.

17.6 Growth Curve Models (GMANOVA).

17.7 Testing Hypotheses in the GCM.

17.8 Confidence Bands for Growth Curves.

18. Tests for Linear Mixed Models.

18.1 Overview.

18.2 Estimability of θ = Cβ.

18.3 Likelihood Ratio Tests of Cβ.

18.4 Likelihood Ratio Tests Involving τ.

18.5 Test Size of Wald-Type Tests of β Using REML.

18.6 Using Wald-Type Tests of β with REML.

18.7 Using Wald-Type Tests of {β,τ} with REML.

19. A Review of Multivariate and Univariate Linear Models.

19.1 Matrix Gaussian and Wishart Properties.

19.2 Design Matrix Properties.

19.3 Model Components.

19.4 Primary Parameter and Related Estimators.

19.5 Secondary Parameter Estimators.

PART V: CHOOSING A SIMPLE SIZE IN GAUSSIAN LINEAR MODELS.

20. Sample Size for Univariate Linear Model.

20.1 Sample Size Consulting: Before You begin.

20.2 The Machinery of a Power Analysis.

20.3 Independent t Example.

20.4 Paired t Example.

20.5 The Impact of σ2 or β in Power analysis.

20.6 Random Predictors.

20.7 Internal Pilot Design.

20.8 Other Criteria for Choosing a Sample Size.

Exercises.

21. Sample Size for Multivariate Linear Model.

21.1 The Machinery of a Power Analysis.

21.2 Paired t Example.

21.3 Time by Treatment Example.

21.4 Comparing between and within Designs.

21.5 Some Invariance Properties.

21.6 Random Predictors.

21.7 Internal Pilot Designs.

Exercises.

22. Sample Size for Generalizations of Multivariate Models.

22.1 Motivation.

22.2 Sample Size Methods for Growth Curve Models.

23. Sample Size for Linear Mixed Models.

23.1 Motivation.

23.2 Methods.

23.3 Internal Pilot Designs.

Appendix: Computing Resources.

References.

Index.
Read More Show Less

## Customer Reviews

Be the first to write a review
( 0 )
Rating Distribution

(0)

(0)

(0)

(0)

### 1 Star

(0)

Your Name: Create a Pen Name or

### Barnes & Noble.com Review Rules

Our reader reviews allow you to share your comments on titles you liked, or didn't, with others. By submitting an online review, you are representing to Barnes & Noble.com that all information contained in your review is original and accurate in all respects, and that the submission of such content by you and the posting of such content by Barnes & Noble.com does not and will not violate the rights of any third party. Please follow the rules below to help ensure that your review can be posted.

### Reviews by Our Customers Under the Age of 13

We highly value and respect everyone's opinion concerning the titles we offer. However, we cannot allow persons under the age of 13 to have accounts at BN.com or to post customer reviews. Please see our Terms of Use for more details.

### What to exclude from your review:

Please do not write about reviews, commentary, or information posted on the product page. If you see any errors in the information on the product page, please send us an email.

### Reviews should not contain any of the following:

• - HTML tags, profanity, obscenities, vulgarities, or comments that defame anyone
• - Time-sensitive information such as tour dates, signings, lectures, etc.
• - Single-word reviews. Other people will read your review to discover why you liked or didn't like the title. Be descriptive.
• - Comments focusing on the author or that may ruin the ending for others
• - Phone numbers, addresses, URLs
• - Pricing and availability information or alternative ordering information

### Reminder:

• - By submitting a review, you grant to Barnes & Noble.com and its sublicensees the royalty-free, perpetual, irrevocable right and license to use the review in accordance with the Barnes & Noble.com Terms of Use.
• - Barnes & Noble.com reserves the right not to post any review -- particularly those that do not follow the terms and conditions of these Rules. Barnes & Noble.com also reserves the right to remove any review at any time without notice.
• - See Terms of Use for other conditions and disclaimers.
Search for Products You'd Like to Recommend

### Recommend other products that relate to your review. Just search for them below and share!

Create a Pen Name

Your Pen Name is your unique identity on BN.com. It will appear on the reviews you write and other website activities. Your Pen Name cannot be edited, changed or deleted once submitted.

Your Pen Name can be any combination of alphanumeric characters (plus - and _), and must be at least two characters long.

Continue Anonymously

If you find inappropriate content, please report it to Barnes & Noble
Why is this product inappropriate?