Pratidin
2026 · Statistics Optional Paper II · 20 marksMainsQuestion 7c

For the general linear model Y = X β + u (Y: n×1, X: n×k, β: k×1, u: n×1) with E(u) = 0 and E(uu′) = σ² Iₙ, where X (n×k) is a matrix of fixed numbers with rank k (k < n), obtain the ordinary least squares estimator β̂ of β and the dispersion matrix of β̂. Also, prove that β̂ is the best linear unbiased estimator (BLUE) of β.

20 marks · directive: Prove

Answer

The core of a good answer

Minimising S(β) = (Y − Xβ)′(Y − Xβ) gives the normal equations X′Xβ̂ = X′Y and β̂ = (X′X)⁻¹X′Y; since β̂ = β + (X′X)⁻¹X′u, E(β̂) = β and D(β̂) = (X′X)⁻¹X′E(uu′)X(X′X)⁻¹ = σ²(X′X)⁻¹; and for any other linear unbiased estimator β̃ = [(X′X)⁻¹X′ + D]Y unbiasedness forces DX = 0, so D(β̃) = σ²(X′X)⁻¹ + σ²DD′, which exceeds D(β̂) by a non-negative definite matrix: β̂ is BLUE (Gauss-Markov theorem).

An outline written by upsc.help, not an official UPSC answer; every fact checked by a separate review. How we work

What the question asks

Three tasks: derive OLS by matrix calculus, derive its dispersion matrix, and prove the Gauss-Markov theorem in matrix form. State clearly where each assumption (fixed X, full rank, zero mean errors, spherical errors) is used.

Answer outline

Introduction

Assumptions: X non-stochastic with rank k (so X′X is non-singular), E(u) = 0, E(uu′) = σ²Iₙ (homoscedastic, uncorrelated errors). No normality is needed.

Step 1: OLS estimator

Step 2: Unbiasedness

Step 3: Dispersion matrix

Step 4: Gauss-Markov proof

Step 5: Scalar form

Conclusion

β̂ = (X′X)⁻¹X′Y, D(β̂) = σ²(X′X)⁻¹, and β̂ is BLUE under the classical assumptions; normality is not required, but if E(uu′) ≠ σ²I the theorem fails and generalised least squares (Aitken) is BLUE instead.

Examples and data to cite

Facts

Facts to remember

Sources used for the explanation

Write a timed answer in the app