Pratidin
2026 · Statistics Optional Paper I · 10 marksMainsQuestion 5c

Discussing Gauss-Markov linear model Y_{n×1} = X_{n×p} β_{p×1} + u_{n×1} with E(Y) = Xβ and D(Y) = variance and covariance matrix of Y = σ²I, show that
E[Y′{I − X(X′X)⁻¹X′}Y] = σ²(n − p)

10 marks · directive: Show

Answer

The core of a good answer

With M = I − X(X′X)⁻¹X′ symmetric and idempotent, E(Y′MY) = σ² tr(M) + β′X′MXβ; since MX = 0 and tr(M) = n − tr[(X′X)⁻¹X′X] = n − p, E(Y′MY) = σ²(n − p), so the residual sum of squares divided by n − p is unbiased for σ².

An outline written by upsc.help, not an official UPSC answer; every fact checked by a separate review. How we work

What the question asks

After briefly stating the model and its assumptions (linear mean, homoscedastic uncorrelated errors, X of full column rank p), the proof is the expectation of a quadratic form. The key facts are MX = 0 and the trace identity tr(AB) = tr(BA).

Answer outline

Introduction

Gauss-Markov model: Y = Xβ + u, E(u) = 0, D(u) = σ²I, rank X = p (so X′X is invertible). H = X(X′X)⁻¹X′ is the hat matrix; M = I − H; Y′MY is the residual sum of squares.

Step 1: The model

Step 2: Properties of M

Step 3: Expectation of the quadratic form

Step 4: Trace

Step 5: Result

Conclusion

The residual sum of squares has expectation σ²(n − p), which justifies dividing by the error degrees of freedom n − p. No normality is needed.

Examples and data to cite

Facts

Facts to remember

Sources used for the explanation

Write a timed answer in the app