Pratidin
2026 · Statistics Optional Paper I · 20 marksMainsQuestion 6a

Let l′β be any estimable linear function of parameters β₁, β₂, ⋯, βₚ. Then prove that—
(i) there exists a unique linear function c′Y of random variables Y₁, Y₂, ⋯, Yₙ such that c ∈ V(A′) and E(c′Y) = l′β, where V(A′) is the vector space generated by row vectors of A′ and E(Y) = Aβ;
(ii) variance of c′Y is less than the variance of any other linear unbiased estimator.

20 marks · directive: Prove

Answer

The core of a good answer

Since l′β is estimable, some a′Y has E(a′Y) = l′β, i.e. A′a = l; projecting a onto the column space of A (the space spanned by the rows of A′) gives c with A′c = l, unique because two such vectors differ by a vector both in and orthogonal to that space; any other unbiased b′Y has b = c + d with A′d = 0, so V(b′Y) = σ²(c′c + d′d) > σ²c′c unless b = c.

An outline written by upsc.help, not an official UPSC answer; every fact checked by a separate review. How we work

What the question asks

This is the Gauss-Markov theorem in the possibly less-than-full-rank model, written in terms of the estimating space. The proof needs: the meaning of estimability, the orthogonal decomposition Rⁿ = V(A′) ⊕ V(A′)^⊥, and the dispersion assumption D(Y) = σ²I (implicit in the model, to be stated).

Answer outline

Introduction

Model: E(Y) = Aβ, D(Y) = σ²I, A of order n × p, any rank. V(A′) = column space of A ⊂ Rⁿ (spanned by the rows of A′). Its orthogonal complement is {d : A′d = 0}.

Step 1: Estimability

Step 2: Existence of c

Step 3: Uniqueness

Step 4: Minimum variance

Step 5: Link with least squares

Conclusion

For every estimable l′β there is exactly one unbiased linear estimator with coefficient vector in the estimation space, and it is the BLUE (Gauss-Markov theorem). Any other unbiased linear estimator adds an uncorrelated 'error-space' component d′Y that only increases variance.

Examples and data to cite

Facts

Facts to remember

Sources used for the explanation

Write a timed answer in the app