Skip to content

Linear Models, Regression and Multivariate Analysis

CSIR NET Mathematical Sciences Unit 4: Gauss–Markov models, ANOVA, regression, multivariate normal and Wishart, correlation, PCA and discriminant analysis.

6
Topics
107
Min read

Chapter Overview

This chapter covers the linear-model and multivariate part of Unit 4 (statistics) of the CSIR NET Mathematical Sciences syllabus. It is where statistics meets Linear Algebra: least squares is an orthogonal projection, degrees of freedom are ranks, sums of squares are quadratic forms, and principal components, discriminant directions and canonical correlations are eigenvectors.

The notes assume an MSc course in linear models and multivariate analysis. They do not re-derive every theorem. They collect the exact statements (what Gauss–Markov does and does not assume, when a quadratic form is chi-square, which mean square goes in the F denominator), the small computations Part B rewards, and the counter-examples that settle multiple-correct Part C options.

What You’ll Learn

By the end of this chapter you will be able to:

  • Decide whether a parametric function is estimable, write its BLUE and variance, and test a linear hypothesis with the F statistic
  • Build one-way and two-way ANOVA tables, choose the right F denominator for fixed, random and mixed effects, estimate variance components, and adjust means by ANCOVA
  • Fit simple and multiple regressions, compute \( R^2 \), adjusted \( R^2 \) and t and F tests, read leverage, Cook’s distance, VIF and Durbin–Watson, and interpret a logistic coefficient as an odds ratio
  • Use the marginal and conditional distributions of the multivariate normal, decide when quadratic forms are chi-square and independent, and use the Wishart and Hotelling \( T^2 \) distributions
  • Compute partial and multiple correlations from simple correlations or from the inverse correlation matrix, and check whether a correlation matrix is possible
  • Find principal components, Fisher’s discriminant direction, dendrogram heights and canonical correlations in small cases

Prerequisites


Learning Path

graph TD
    A[1. Gauss-Markov Models, BLUE and Linear Hypotheses] --> B[2. ANOVA, ANCOVA and Effects Models]
    A --> C[3. Simple, Multiple and Logistic Regression]
    A --> D[4. Multivariate Normal, Wishart and Quadratic Forms]
    D --> B
    C --> E[5. Partial and Multiple Correlation]
    D --> E
    E --> F[6. PCA, Discriminant, Cluster and Canonical Correlation]
    B --> G[Quick Revision]
    F --> G

Pages 1 to 3 are the linear-model track and page 4 supplies the distribution theory behind their F tests. Pages 5 and 6 are the multivariate track. If you prepare Unit 4 selectively, pages 1, 3 and 4 carry the most reusable ideas.


Topics in This Chapter

#TopicWhat it coversTime
1Gauss–Markov Models, BLUE and Linear Hypothesesnormal equations, hat matrix, estimability, Gauss–Markov theorem, GLS, \( s^2 \), F test, restricted least squares35 min
2ANOVA, ANCOVA and Fixed, Random and Mixed Effectsone-way and two-way ANOVA, expected mean squares, variance components, intraclass correlation, ANCOVA adjustment35 min
3Simple, Multiple and Logistic Regressionslope and intercept, \( R^2 \), adjusted \( R^2 \), t and F tests, leverage, Cook’s distance, VIF, Durbin–Watson, logistic regression35 min
4Multivariate Normal, Wishart and Quadratic Formsproperties, conditionals, precision matrix, \( E(X^TAX) \), chi-square and independence of forms, Cochran, Wishart, Hotelling \( T^2 \)35 min
5Partial and Multiple Correlationthree-variable formulas, recursion, inverse correlation matrix, feasibility, tests30 min
6PCA, Discriminant, Cluster and Canonical Correlation Analysisprincipal components, Fisher’s discriminant, linkages and k-means, canonical correlations35 min
Quick Revisionevery formula and trap on one page10 min

Official syllabus lines and where they are covered

Official topic lineCovered in
Gauss-Markov models, BLUE, linear hypothesesGauss–Markov Models, BLUE and Linear Hypotheses
ANOVA and ANCOVA; fixed, random, mixed effectsANOVA, ANCOVA and Fixed, Random and Mixed Effects
Simple, multiple and logistic regression; diagnosticsSimple, Multiple and Logistic Regression
Multivariate normal and Wishart distributions, quadratic formsMultivariate Normal, Wishart and Quadratic Forms
Partial and multiple correlationPartial and Multiple Correlation
PCA, discriminant, cluster, canonical correlationPCA, Discriminant, Cluster and Canonical Correlation Analysis

How CSIR NET Asks It

Per the NTA information bulletin for December 2026, the Mathematical Sciences paper (code 704) is marked as follows:

Part BPart C
Questions given4060
Questions to attempt2520
Marks per correct answer34.75
Marks per wrong answer−0.750
Maximum7595

NTA publishes no topic-wise weightage, so we make no claim about how many questions come from this chapter. What the format tells you is how to prepare:

  • Part B (single correct) rewards short computations: a BLUE and its variance, \( E(\text{SSE}) \), an F ratio or variance component from a small table, a regression slope or adjusted \( R^2 \), a conditional normal mean, \( E(X^TAX) \), a partial correlation, the share of variance of the first principal component.
  • Part C (one or more correct) rewards exact statements. A typical stem fixes a model or a covariance matrix and lists four claims: “every parameter is estimable”, “the residuals are independent”, “\( X_1 \) and \( X_3 \) are conditionally independent given \( X_2 \)”, “principal components are scale invariant”. Each is settled by one theorem or one small example. Every topic page ends with Level 3 practice in exactly this format, with every option justified.

For the marking scheme and the other units, see the Mathematical Sciences overview. Part A (General Aptitude) is common to all subjects; its Experimental Design, Sampling and Data page covers the design ideas behind ANOVA at Part A depth. Found an error? See About for how to report it.


Start Learning

Begin with the first topic:

→ Gauss–Markov Models, BLUE and Linear Hypotheses

Advertisement
Advertisement