Learn Linear Algebra

Theorem

The column space of an m×n m \times n matrix A A is all of Rm \mathbb{R}^m if and only if the equation Ax⃗=b⃗ A\vec{x} = \vec{b} has a solution for each b⃗∈Rm \vec{b} \in \mathbb{R}^m .

Proof:

We want to prove that the column space of an m×n m \times n matrix A A is all of Rm \mathbb{R}^m if and only if the equation Ax⃗=b⃗ A \vec{x} = \vec{b} has a solution for every b⃗∈Rm \vec{b} \in \mathbb{R}^m .

Col(A)=Rm⇔For every b⃗∈Rm,b⃗ can be expressed as a linear combination of the columns of A.⇔For every b⃗∈Rm,b⃗∈Col(A)⇔For every b⃗∈Rm,∃ x⃗∈Rn such that Ax⃗=b⃗. \text{Col}(A) = \mathbb{R}^m \\ \Leftrightarrow \text{For every } \vec{b} \in \mathbb{R}^m, \vec{b} \text{ can be expressed as a linear combination of the columns of } A. \\ \Leftrightarrow \text{For every } \vec{b} \in \mathbb{R}^m, \vec{b} \in \text{Col}(A) \\ \Leftrightarrow \text{For every } \vec{b} \in \mathbb{R}^m, \exists \, \vec{x} \in \mathbb{R}^n \text{ such that } A \vec{x} = \vec{b}.

Thus, the column space of A A is all of Rm \mathbb{R}^m if and only if the equation Ax⃗=b⃗ A \vec{x} = \vec{b} has a solution for every b⃗∈Rm \vec{b} \in \mathbb{R}^m .

Theorem

The null space of an m×n m \times n matrix A A is a subspace of Rn \mathbb{R}^n . Equivalently, the set of all solutions to a system Ax⃗=0⃗ A\vec{x} = \vec{0} of m m homogeneous linear equations in n n unknowns is a subspace of Rn \mathbb{R}^n .

Proof:

Let A A be an m×n m \times n matrix. The null space of A A , denoted as Nul(A) \text{Nul}(A) , is defined as: Nul(A)={x⃗∈Rn∣Ax⃗=0⃗}. \text{Nul}(A) = \{ \vec{x} \in \mathbb{R}^n \mid A \vec{x} = \vec{0} \}. We will show that Nul(A) \text{Nul}(A) is a subspace of Rn \mathbb{R}^n by verifying the three subspace properties:

1. The zero vector is in Nul(A) \text{Nul}(A) :
Let x⃗=0⃗ \vec{x} = \vec{0} . Then: A0⃗=0⃗. A \vec{0} = \vec{0}. Hence, 0⃗∈Nul(A) \vec{0} \in \text{Nul}(A) .

2. Closed under addition:
Let u⃗,w⃗∈Nul(A) \vec{u}, \vec{w} \in \text{Nul}(A) . Then: Au⃗=0⃗andAw⃗=0⃗. A \vec{u} = \vec{0} \quad \text{and} \quad A \vec{w} = \vec{0}. Adding these equations gives: A(u⃗+w⃗)=Au⃗+Aw⃗=0⃗+0⃗=0⃗. A (\vec{u} + \vec{w}) = A \vec{u} + A \vec{w} = \vec{0} + \vec{0} = \vec{0}. Hence, u⃗+w⃗∈Nul(A) \vec{u} + \vec{w} \in \text{Nul}(A) .

3. Closed under scalar multiplication:
Let u⃗∈Nul(A) \vec{u} \in \text{Nul}(A) and let c∈R c \in \mathbb{R} . Then: Au⃗=0⃗. A \vec{u} = \vec{0}. Multiplying by c c gives: A(cu⃗)=c(Au⃗)=c0⃗=0⃗. A (c \vec{u}) = c (A \vec{u}) = c \vec{0} = \vec{0}. Hence, cu⃗∈Nul(A) c \vec{u} \in \text{Nul}(A) .

Thus, Nul(A) \text{Nul}(A) satisfies the conditions for a subspace of Rn \mathbb{R}^n .

Theorem

The column space of an m×n m \times n matrix A A is a subspace of Rm \mathbb{R}^m .

Proof:

Let A A be an m×n m \times n matrix. The column space of A A , denoted by Col(A) \text{Col}(A) , is defined as: Col(A)={Ax⃗∣x⃗∈Rn}. \text{Col}(A) = \{ A \vec{x} \mid \vec{x} \in \mathbb{R}^n \}. This is the set of all linear combinations of the columns of A A . We will show that Col(A) \text{Col}(A) is a subspace of Rm \mathbb{R}^m by verifying the three subspace properties:

1. The zero vector is in Col(A) \text{Col}(A) :
Let x⃗=0⃗∈Rn \vec{x} = \vec{0} \in \mathbb{R}^n . Then: Ax⃗=A0⃗=0⃗. A \vec{x} = A \vec{0} = \vec{0}. Hence, 0⃗∈Col(A) \vec{0} \in \text{Col}(A) .

2. Closed under addition:
Let u⃗,w⃗∈Col(A) \vec{u}, \vec{w} \in \text{Col}(A) . Then there exist x⃗1,x⃗2∈Rn \vec{x}_1, \vec{x}_2 \in \mathbb{R}^n such that: u⃗=Ax⃗1andw⃗=Ax⃗2. \vec{u} = A \vec{x}_1 \quad \text{and} \quad \vec{w} = A \vec{x}_2. Adding u⃗ \vec{u} and w⃗ \vec{w} gives: u⃗+w⃗=Ax⃗1+Ax⃗2=A(x⃗1+x⃗2). \vec{u} + \vec{w} = A \vec{x}_1 + A \vec{x}_2 = A (\vec{x}_1 + \vec{x}_2). Since x⃗1+x⃗2∈Rn \vec{x}_1 + \vec{x}_2 \in \mathbb{R}^n , u⃗+w⃗∈Col(A) \vec{u} + \vec{w} \in \text{Col}(A) .

3. Closed under scalar multiplication:
Let u⃗∈Col(A) \vec{u} \in \text{Col}(A) and c∈R c \in \mathbb{R} . Then there exists x⃗∈Rn \vec{x} \in \mathbb{R}^n such that: u⃗=Ax⃗. \vec{u} = A \vec{x}. Multiplying by c c gives: cu⃗=c(Ax⃗)=A(cx⃗). c \vec{u} = c (A \vec{x}) = A (c \vec{x}). Since cx⃗∈Rn c \vec{x} \in \mathbb{R}^n , cu⃗∈Col(A) c \vec{u} \in \text{Col}(A) .

Thus, Col(A) \text{Col}(A) satisfies the conditions for a subspace of Rm \mathbb{R}^m .