Algebra and Structures · Linear Algebra

From Module to Operator

«Motions of the Plane» and «Similarities of the Plane» already showed a telling pattern: translations add, and concentric homotheties multiply — exactly like numbers. Here we assemble the general algebraic framework behind that pattern: a module over a ring, its special cases (vector space, algebra), basis, coordinates, a linear operator and its matrix, the ring of matrices, and the dual space — and matrices, let's remember, can encode far more than just motions and similarities. At the end — motions and similarities themselves, now as linear operators on $\R^2$.

1. Module over a Ring

Any abelian group $\langle M,+\rangle$ becomes a module over $\Z$ in exactly one natural way: an integer $n$ acts on a vector by repeated addition — for $n>0$ this is the $n$-fold "$v+v+\dots+v$," for $n<0$ the same with a minus sign, and $0*v=\vec 0$. Let's take this idea and abstract it: let an arbitrary ring $K$ play the role of $\Z$, and let the concrete operation "add $n$ times" be replaced by an abstract operation $*$, subject to the very same identities that "add $n$ times" satisfies automatically.

Definition

Let $M$ be some set ("vectors") with an operation $+$, and let $K$ be some set ("numbers") with operations $+,\cdot$ and a distinguished element $1$. We say $M$ is a module over the ring $K$ if there is a further operation $*:K\times M\to M$ (multiplying a vector by a number) satisfying three groups of requirements:

  1. Mod1. $\langle M,+\rangle$ is an abelian group: vector addition is associative, commutative, there is a neutral vector $\vec 0$, and every vector has an opposite.
  2. Mod2. $\langle K,+,\cdot,1\rangle$ is a commutative ring with unity.
  3. Mod3. The operation $*$ is compatible with addition in $M$ and with addition/multiplication in $K$: $$ 1*v=v,\quad (\lambda\mu)*v=\lambda*(\mu*v),\quad \lambda*(u+v)=\lambda*u+\lambda*v,\quad (\lambda+\mu)*v=\lambda*v+\mu*v. $$

The signs $+$ and "$\cdot$" (or a short space instead of the dot) are each doing double duty here: the very same symbol "$+$" is both vector addition and number addition; the very same symbol "$\cdot$"/space is both a vector-by-number multiplication ($*$) and a number-by-number multiplication. This causes no confusion, because the type of an operand is always visible from its notation. Throughout this material, lowercase Latin letters ($u,v,w,x,\dots$) denote vectors, and lowercase Greek letters ($\lambda,\mu,\xi,\eta,\kappa,\alpha,\dots$) denote numbers; capital letters ($K,M,V,L,W,\dots$) denote rings, spaces, operators, matrices.

Left and Right Modules

We wrote multiplying a vector by a number as $\lambda*v$ — the number on the left. If instead we set up the operation $v*\lambda$ (number on the right) with mirrored axioms, we get a right module; the structure above is then called, for clarity, a left module. For commutative $K$ the distinction doesn't matter ($\lambda v$ and $v\lambda$ can be identified), but for a noncommutative ring, left and right modules are different, if related, structures. Everywhere below $K$ is commutative, so this distinction plays no role — but it's worth knowing that it exists at all.

K ⟨K,+,·,1⟩ — a commutative ring with unity M ⟨M,+⟩ — an abelian group ("vectors") ∗ : K × M → M Mod1–Mod3 (see the definition above) = MODULE over K VECTOR (LINEAR) SPACE if K is a field ALGEBRA OVER A RING / FIELD + multiplication on M: λ(uv)=(λu)v=u(λv)

Two special cases are important enough to get their own names.

Definition

If $K$ is a field (numbers can also be divided by one another), the module $M$ is called a vector (or linear) space.

If, moreover, $M$ also carries a multiplication of vectors $\cdot:M\times M\to M$, compatible with $*$ via the identity $\lambda(uv)=(\lambda u)v=u(\lambda v)$, the structure is called an algebra over the ring (or field) $K$.

Once a module becomes an algebra, its third operation interacts with $*$ by exactly the same rule we'll see below for the composition of linear operators.

In the terms of «How Mathematical Structures Are Constructed», a module is precisely the first, algebraic layer $\Sigma$, hung on a bare domain $M$: an internal operation $+:M\times M\to M$ (exactly an instance of the "internal operations $f:M^n\to M$" from that general scheme) and an external operation $*:K\times M\to M$ (an instance of the "external operations $R\times M\to M$" — there $R$ plays the role our $K$ plays here). A vector space and an algebra are the same layer $\Sigma$, just richer: a field adds division, an algebra adds a second internal operation. This material almost never reaches that scheme's next layers, the topological and the metric — the one exception: §6 will briefly need an inner product, which in that scheme already belongs to the metric layer $\Phi$.

The pair of commutative groups that a ring $K$ is built from in axiom Mod2 (addition and multiplication of numbers) has already appeared geometrically, just separately: in «Similarities of the Plane», translations of the plane compose exactly like addition of numbers ($T_a\circ T_b=T_{a+b}$), while concentric homotheties compose like multiplication ($H_O^k\circ H_O^s=H_O^{ks}$). In §6 we'll see how motions and similarities themselves become linear operators within the framework assembled here.

Example 1 Abelian Group $A$ over $\Z$ module over $\Z$ = abelian group
the canonical example

Any abelian group $\langle A,+\rangle$ becomes a $\Z$-module in exactly one way: $n*a=\underbrace{a+\dots+a}_{n}$ for $n>0$, $(-n)*a=-(n*a)$, $0*a=\vec 0$ — axioms Mod1–3 hold automatically, this is just repeated application of the addition already present. The converse holds too: every $\Z$-module is built only this way. In other words, "module over $\Z$" and "abelian group" are literally the same notion under two names.

Example 2 $\Z^n$ module over $\Z$ — not a vector space
the ring $\Z$ is not a field

Integer vectors with componentwise addition and multiplication by an integer — a module, since $\Z$ is not a field: for instance, the vector $\langle1,0\rangle$ can't be "divided by 3" and stay in $\Z^2$. Ordinary linear algebra (basis, dimension in the usual sense) doesn't carry over here without qualification.

Example 3 A Submodule of $\Z/6\Z$ with No Basis the ring $K=\Z/6\Z$ has zero divisors
a zero divisor — the source of torsion

In $K=\Z/6\Z$ the numbers $2$ and $3$ are zero divisors: $2\cdot3=6\equiv0$, yet both factors are nonzero. The submodule $M=\{0,2,4\}\subset K$ (all multiples of two) is generated by the element $2$, but the system $\{2\}$ is not independent: $3*2=6\equiv0$, while $3\ne0$. This isn't a matter of a poorly chosen generator — $M$ has only 3 elements, while a free $K$-module of rank $r$ would have $6^r$ elements ($1,6,36,\dots$), and $3$ isn't among them. So $M$ has no basis at all — the root of the problem is precisely that $2$ divides zero.

Example 4 $\R[x]$ a vector space and an algebra over $\R$
infinite-dimensional

Polynomials with real coefficients: they add and scale like vectors (the space $\R[x]$), but they can also be multiplied by one another — compatibility $\lambda(pq)=(\lambda p)q=p(\lambda q)$ holds, so this is an algebra over $\R$. A natural basis is $\{1,x,x^2,\dots\}$, which is infinite.

Example 5 $\mathrm{Mat}_n(\R)$ a vector space and a (noncommutative) algebra
matrix multiplication ↔ composition of operators

Square matrices add and scale componentwise (a space), and matrix multiplication supplies the second operation — compatible with $*$ in exactly the same way. Noncommutativity of this multiplication (unlike $\R[x]$) is the subject of §5.

Example 6 $\C$ as an $\R$-Space dimension 2, and an algebra too
see «Three Constructions of ℂ»

The complex numbers are a two-dimensional real vector space with basis $\{1,i\}$, and multiplication of complex numbers turns it into an algebra over $\R$ as well. In «Complex Numbers», this same multiplication is represented by $2\times2$ matrices of the form $\begin{pmatrix}x&-y\\y&x\end{pmatrix}$ — Construction II there is literally the matrix of a linear operator from §4 of this page.

2. Hamel Basis

Let $V$ be a module (in particular, a vector space) over a ring $K$.

Definition

Take a collection of vectors $\{\e_i\}_{i\in I}\subset V$, indexed by an arbitrary set $I$ — finite or infinite. Such a collection is called a system of vectors: unlike a set, in a system the index itself matters, so the very same vector can in principle correspond to different indices (a repeat) — linear independence, defined below, is exactly what rules such repeats out.

A linear combination of the system is always a finite expression $\xi_{i_1}\e_{i_1}+\dots+\xi_{i_n}\e_{i_n}$ with coefficients from $K$, where $i_1,\dots,i_n$ is an arbitrary finite collection of distinct indices from $I$: even if the system itself is infinite, any single combination involves only finitely many of its vectors. The set of all such combinations is called the linear span of the system.

A system is linearly independent if no nontrivial linear combination of it equals zero.

A basis (or Hamel basis) is a linearly independent system whose linear span is all of $V$ — that is, every vector decomposes, uniquely, into a linear combination of the system's vectors.

The word "Hamel" in the name emphasizes exactly what's already built into the definition of a linear combination: the decomposition of any vector in the basis is always a finite sum, even when the basis (as a system) is itself infinite.

Not Every Module Has a Basis

An example has already come up: the submodule $M=\{0,2,4\}\subset\Z/6\Z$ (example 3, §1) has no basis at all — the root of the problem there is the zero divisors of the ring $\Z/6\Z$. Below, starting from the equipotence theorem, we're back to talking only about vector spaces (modules over a field) — and a field, by definition, has no zero divisors (every nonzero element is invertible), so there, as we'll see, a basis always exists.

Existence of a Basis

Before asking whether all bases of a given space are "the same size," we need to make sure a basis exists at all. This is where set theory begins.

Theorem

Every vector space has a basis.

Proved by Zorn's Lemma: consider the family of all linearly independent subsets of $V$, ordered by inclusion; the union of any chain of such sets is again linearly independent (any particular linear dependence within the union involves only finitely many vectors, and so lies entirely within some single link of the chain), so Zorn's Lemma yields a maximal element — and a maximal, by inclusion, linearly independent set is exactly a basis. Zorn's Lemma is equivalent to the axiom of choice (AC; for more on this and other forms of AC — countable choice, dependent choice — see «Levels of Formalization of Mathematical Analysis»).

A Remarkable Fact (Blass, 1984)

The connection to the axiom of choice runs deeper than it looks: the statement "every vector space has a basis" doesn't just follow from AC, it's equivalent to it (in ZF set theory without AC). This was proved by Andreas Blass in 1984. The existence of a Hamel basis isn't a technicality — it's a full-fledged form of the axiom of choice.

Equipotence of Bases and Dimension

Theorem

Any two bases of one and the same vector space are equipotent — even if both are infinite.

For finite bases the proof is elementary, and it even works for an arbitrary module over a commutative ring, not just for a vector space:

Lemma. In a nonzero commutative ring, a homogeneous system of $m$ linear equations in $n$ unknowns with $m<n$ always has a nontrivial solution. Proved by induction on $n$: for $n=2$ the solution is written down explicitly ($\omega_{11}\xi_1+\omega_{12}\xi_2=0$ is solved by the pair $\xi_1=\omega_{12},\,\xi_2=-\omega_{11}$, or trivially if both coefficients are zero); the induction step eliminates the first variable from all equations but one by combining rows — commutativity of the ring is what makes this combination valid — and applies the induction hypothesis to the remaining $m-1$ equations in $n$ variables.

Proof. Let $\e_1,\dots,\e_m$ and $\e_1',\dots,\e_n'$ be two bases, $m<n$. Expand the second basis in the first: $\e_j'=\sum_i \omega_{ij}\e_i$. By the lemma, the homogeneous system $\sum_j \omega_{ij}\xi_j=0$ ($m$ equations, $n>m$ unknowns) has a nontrivial solution $\xi_1^*,\dots,\xi_n^*$. Then $$ \sum_j \xi_j^*\e_j' = \sum_j \xi_j^*\sum_i \omega_{ij}\e_i = \sum_i\Big(\sum_j \omega_{ij}\xi_j^*\Big)\e_i = \sum_i 0\cdot\e_i = 0, $$ that is, a nontrivial combination of $\e_1',\dots,\e_n'$ equals zero — a contradiction with their independence. So $n>m$ is impossible; by symmetry $m>n$ is impossible too, hence $m=n$.

The equipotence of any two infinite bases is proved separately: every vector of one basis is a finite linear combination of vectors of the other, so each element of one basis gets assigned a finite subset of the other; from this, using the arithmetic of infinite cardinals ($\kappa=\kappa\cdot\aleph_0$ for infinite $\kappa$ — itself, generally speaking, an AC-dependent equality), it follows that the two bases have the same cardinality.

Definition

The dimension $\dim V$ is the cardinality of the basis set — by the theorem above, it doesn't depend on which particular basis was chosen.

Examples of Bases

Finite-Dimensional $\R^n$, $\C$ over $\R$, $\mathrm{Mat}_n(\R)$

The standard basis $\{\langle1,0,\dots\rangle,\langle0,1,0,\dots\rangle,\dots\}$ in $\R^n$; $\{1,i\}$ in $\C$ over $\R$ ($\dim=2$); the matrix units $E_{ij}$ in $\mathrm{Mat}_n(\R)$ ($\dim=n^2$) — every one of these bases can be written down explicitly, is finite, and needs no choice at all.

Countably Infinite $\R[x]$ over $\R$

$\{1,x,x^2,x^3,\dots\}$ — every polynomial is a finite (this matters — precisely finite, exactly as a Hamel basis requires) linear combination of powers of $x$. The basis is explicit but infinite.

Uncountable and Fundamentally Non-Constructible $\R$ as a Vector Space over $\Q$
this is where the name "Hamel basis" comes from

Forget the multiplication of real numbers and keep only addition and multiplication by rationals — $\R$ becomes a $\Q$-vector space of cardinality the continuum. The theorem above guarantees it has a basis, but no such basis can be exhibited by an explicit formula: its existence is a direct consequence of AC (via Zorn's Lemma above), not a construction. The term "Hamel basis" comes from exactly this example: in 1905 Georg Hamel used such a basis of $\R$ over $\Q$ to build a discontinuous (and hence "pathological") solution of Cauchy's functional equation $f(x+y)=f(x)+f(y)$, distinct from the obvious linear solutions $f(x)=cx$ — by defining $f$ differently on different basis vectors and extending by $\Q$-linearity.

3. Coordinates and the Isomorphism with $\R^n$

Let $V$ be a vector space over $\R$ of dimension $n$ with basis $\e_1,\dots,\e_n$. By the definition of a basis, every vector $v\in V$ decomposes over it in a unique way: $v=\xi_1\e_1+\dots+\xi_n\e_n$.

Definition

The numbers $\langle\xi_1,\dots,\xi_n\rangle$ are called the coordinates of $v$ in this basis.

Uniqueness of the decomposition is no accident, but a direct consequence of the independence of the basis: if we had $v=\xi_1\e_1+\dots+\xi_n\e_n=\xi_1'\e_1+\dots+\xi_n'\e_n$, subtracting would give $(\xi_1-\xi_1')\e_1+\dots+(\xi_n-\xi_n')\e_n=0$, and linear independence of $\{\e_i\}$ forces every difference to be zero.

So the map $\Phi:V\to\R^n$, $\Phi(v)=\langle\xi_1,\dots,\xi_n\rangle$, is a bijection. Moreover it's linear: coordinates of a sum add, coordinates of $\lambda v$ scale by $\lambda$ — this follows directly from the vector-space axioms.

Definition

A bijective linear map is called an isomorphism of vector spaces.

Theorem

Every real vector space of dimension $n$ is isomorphic to $\R^n$.

An important caveat: this isomorphism is not canonical — it depends on the choice of basis. Change the basis, and the coordinates of the very same vector $v$ become different numbers. This is exactly why, further on (§4), the matrix of a linear operator will also depend on the choice of basis, rather than being a property of the operator "itself."

This is the same trick as ordinary Cartesian coordinates: two noncollinear vectors $\e_1,\e_2$ form a basis, any vector $v$ decomposes as $v=\xi\e_1+\eta\e_2$, and the pair $\langle\xi,\eta\rangle$ is exactly the coordinates familiar from the axes $Ox,Oy$ (the special case where $\e_1=\langle1,0\rangle$, $\e_2=\langle0,1\rangle$, the standard basis). This very identification of the point $z=x+iy$ with the pair of real coordinates $\langle x,y\rangle$ in the basis $\{1,i\}$ of the space $\C$ over $\R$ is used in «Complex Numbers» (Construction I) — and tacitly underlies how «Motions of the Plane» and «Similarities of the Plane» identify a point with a number $z=x+iy$.

4. Linear Operators and Their Matrix

Let $V$ and $U$ be vector spaces over the same field $K$.

Definition

A map $L:V\to U$ is called a linear operator if it is:

  1. L1 (additivity): $L(u+v)=L(u)+L(v)$;
  2. L2 (homogeneity): $L(\lambda v)=\lambda L(v)$.

If $V=U$, we say $L$ acts on the space $V$. Invertible linear operators (those that are bijections), with the operation of composition, form a group $\mathrm{GL}(V)$ — the general linear group.

Remark

A similarity of the plane $z\mapsto az+b$ (or $z\mapsto a\bar z+b$ for improper ones) is not a linear operator but an affine map: the term $b$ shifts the origin, and for $b\ne0$ homogeneity fails ($L(0)=b\ne0$). But its linear part — the map $z\mapsto az$ (resp. $z\mapsto a\bar z$), obtained by dropping the shift — already is a linear operator on $\R^2\cong\C$: additivity and homogeneity for real coefficients follow directly from the arithmetic of $\C$, and the difference between the images of two points depends only on the difference of the points themselves: $(az_2+b)-(az_1+b)=a(z_2-z_1)$.

It's exactly this linear part that we'll now equip with a matrix — the full correspondence "operator ↔ type of similarity" comes later, in §6.

The Matrix of an Operator in a Basis

Let $\e_1,\e_2$ be a basis of the plane $V$. By linearity, an operator $L:V\to V$ is completely determined by where it sends the basis vectors: if $v=\xi\e_1+\eta\e_2$, then $$ L(v)=\xi L(\e_1)+\eta L(\e_2)=\xi w_1+\eta w_2,\qquad w_1=L(\e_1),\ w_2=L(\e_2). $$ Expand $w_1,w_2$ again in the same basis: $w_1=\omega_{11}\e_1+\omega_{21}\e_2$, $w_2=\omega_{12}\e_1+\omega_{22}\e_2$, and assemble the coordinate columns into a matrix $$ W=\begin{pmatrix}\omega_{11}&\omega_{12}\\\omega_{21}&\omega_{22}\end{pmatrix}. $$

Definition

The matrix $W$ is called the matrix of the linear operator $L$ in the basis $\{\e_i\}$ — its columns are the coordinates of the images of the basis vectors.

A direct check shows that the coordinates of $L(v)$ are obtained from the coordinates of $v$ by ordinary multiplication of the matrix by the column vector: $$ \begin{pmatrix}\omega_{11}&\omega_{12}\\\omega_{21}&\omega_{22}\end{pmatrix}\begin{pmatrix}\xi\\\eta\end{pmatrix}=\begin{pmatrix}\xi\omega_{11}+\eta\omega_{12}\\\xi\omega_{21}+\eta\omega_{22}\end{pmatrix}. $$

In other words: through the isomorphism $\Phi:V\to\R^n$ from §3, the action of the abstract operator $L$ on $V$ becomes the action of the concrete matrix $W$ on $\R^n$ — it's exactly this matrix that makes the algebra of operators computable.

Rotation by $\alpha$

$$R_\alpha=\begin{pmatrix}\cos\alpha&-\sin\alpha\\\sin\alpha&\cos\alpha\end{pmatrix}$$

Reflection about $Ox$

$$S_x=\begin{pmatrix}1&0\\0&-1\end{pmatrix}$$

Homothety with Ratio $\kappa$

$$H_\kappa=\begin{pmatrix}\kappa&0\\0&\kappa\end{pmatrix}$$

Stretch Along $Ox$ — not a similarity!

$$\begin{pmatrix}\lambda&0\\0&1\end{pmatrix}$$ The first linear operator in this material that isn't built from motions and homotheties — distances grow differently along different axes (a reminder: matrices in general can do much more than just these geometric special cases).

5. The Ring of Matrices and the Dual Space

Let $L,M:V\to U$ be linear operators. Define $(L+M)(v)=L(v)+M(v)$ and $(\lambda L)(v)=\lambda L(v)$ — the operations on vectors carry over to operators, and satisfy the same module axioms. So the set $\mathcal L(V,U)$ of all linear operators from $V$ to $U$ is itself a vector space over the same field $K$.

Composition of Operators = Matrix Multiplication

On operators acting on one and the same space $V$ (that is, on $\mathrm{End}(V)=\mathcal L(V,V)$), there's also a composition $LM:=L\circ M$, which by convention we call multiplication here. It satisfies the identity $$ \lambda(LM)=(\lambda L)M=L(\lambda M), $$ — exactly the defining condition for an algebra from §1: $\mathrm{End}(V)$ is the algebra of linear operators over $K$. Expanding the composition $L\circ M$ in a basis, just as in §4, gives the usual "row by column" rule for matrix multiplication — that is, matrix arithmetic isn't postulated separately, but is derived from the arithmetic of operators.

In a fixed basis, the correspondence "operator ↔ matrix" is a bijection and preserves every operation: addition, scalar multiplication, composition/multiplication. The identity operator $\mathrm{id}$ corresponds to the identity matrix $E$. So the algebra $\mathrm{End}(V)$ is isomorphic to the algebra of square matrices $\mathrm{Mat}_n(K)$ — but unlike $\R[x]$ (example 4 in §1), this multiplication is noncommutative: $LM\ne ML$ in general (exactly as composition of transformations of the plane is).

Invertibility, Determinant, Rank

An operator $L$ is invertible if and only if its matrix is invertible. For a $2\times2$ matrix $W=\begin{pmatrix}\omega_{11}&\omega_{12}\\\omega_{21}&\omega_{22}\end{pmatrix}$, the decisive role is played by the number $\omega_{11}\omega_{22}-\omega_{12}\omega_{21}$.

Definition

This number is called the determinant of the matrix $W$ and is denoted $\det W$. In general dimension $n$, the determinant is given by a sum over permutations: $$ \det W=\sum_{\sigma\in\mathrm S_n}\mathrm{sgn}(\sigma)\,\omega^{(1)}_{\sigma(1)}\cdots \omega^{(n)}_{\sigma(n)}. $$

When $\det W\ne0$, a direct computation for $2\times2$ gives an explicit inverse matrix: $$ W^{-1}=\frac1{\det W}\begin{pmatrix}\omega_{22}&-\omega_{12}\\-\omega_{21}&\omega_{11}\end{pmatrix}, $$ and in any dimension the determinant satisfies $\det(WU)=\det W\det U$, $\det E=1$, $\det W^{-1}=1/\det W$.

The kernel $\ker L=\{v\mid Lv=0\}$ and the image $L[V]$ are subspaces of $V$, related by the identity $\dim\ker L+\dim L[V]=\dim V$.

Definition

The rank of the matrix $W$ of the operator $L$ is the dimension of its image: $\mathrm{rank}(W):=\dim L[V]$.

From this — a criterion uniting geometry and algebra in a single list of equivalent conditions:

Theorem

For a linear operator $L:V\to V$, the following are equivalent:

  • $L$ is invertible;
  • the matrix of $L$ is invertible;
  • $\det W\ne0$;
  • $\ker L=\{0\}$;
  • $\mathrm{rank}(W)=\dim V$;
  • $L[V]=V$.
Definition

The group $\mathrm{GL}(V)$ of invertible operators is isomorphic to the group $\mathrm{GL}(n)$ of invertible $n\times n$ matrices. Inside it we single out the orthogonal matrices $\mathrm O(n)=\{A\mid A^{\mathsf T}A=E\}$ and the matrices with determinant $\pm1$ — the special linear group $\mathrm{SL}(n)$; their intersection $\mathrm{SL}(n)\cap\mathrm O(n)$ (determinant exactly $+1$) is the special orthogonal group $\mathrm{SO}(n)$.

All three will return in §6, now in geometric guise.

The Dual (Conjugate) Space

The fact "$\mathcal L(V,U)$ is a vector space" was stated above for arbitrary $U$ — earlier in §5 we simply took $U=V$. Let's now take a different special case: $U=K$, the field of scalars itself, viewed as a one-dimensional vector space over itself.

Definition

Elements of $\mathcal L(V,K)$ — linear maps $f:V\to K$ — are called linear functionals. The space $$ V^*:=\mathcal L(V,K) $$ is called the dual (or conjugate) space to $V$.

For finite-dimensional $V$ with basis $\e_1,\dots,\e_n$, consider the functionals $\e_1^*,\dots,\e_n^*\in V^*$ given by the rule $\e_i^*(\e_j)=\delta_{ij}$ (one if $i=j$, zero otherwise) — that is, $\e_i^*$ is literally the $i$-th coordinate function $\xi_i$ from §3. Any functional $f$ is uniquely recovered from its values on the basis: $f=\sum_i f(\e_i)\,\e_i^*$, so $\{\e_i^*\}$ is a basis of $V^*$.

Definition

The basis $\e_1^*,\dots,\e_n^*$, built this way from the basis $\e_1,\dots,\e_n$ of $V$, is called the dual (or conjugate) basis. In particular, $$ \dim V^*=\dim V. $$

$\mathrm{End}(V)=\mathcal L(V,V)$ an algebra

Composition $LM$ type-checks correctly: $V\xrightarrow{M}V\xrightarrow{L}V$. This is exactly what supplies the second operation turning the space of operators into an algebra.

$V^*=\mathcal L(V,K)$ a space only

Composition $f\circ g$ for $f,g\in V^*$ doesn't type-check: $g:V\to K$, while $f$ needs to be applied to a vector from $V$, not to a number from $K$. There's no natural multiplication — so $V^*$ remains just a vector space, without the structure of an algebra.

The simplest example of a functional, besides the coordinate projections, is the trace $\mathrm{tr}:\mathrm{Mat}_n(\R)\to\R$, $\mathrm{tr}(A)=\sum_i \omega_{ii}$: applying the same construction to the space $V=\mathrm{Mat}_n(\R)$ from example 5 in §1, we get a linear functional on the space of matrices — an element of its own dual space.

6. Motions and Similarities as Operators on $\R^2$

Everything is in place to return to «Motions of the Plane» and «Similarities of the Plane» and see them precisely as a special class of the linear operators from §4–5.

Geometric TransformationMatrix (Standard Basis)$\det$
Identity $\mathrm{id}$$E=\begin{pmatrix}1&0\\0&1\end{pmatrix}$$+1$
Rotation $R_\alpha$$\begin{pmatrix}\cos\alpha&-\sin\alpha\\\sin\alpha&\cos\alpha\end{pmatrix}$$+1$
Homothety $H_\kappa$, $\kappa>0$$\kappa E$$+\kappa^2$
Rotational homothety $RH_\alpha^\kappa$$\kappa\begin{pmatrix}\cos\alpha&-\sin\alpha\\\sin\alpha&\cos\alpha\end{pmatrix}$$+\kappa^2$
Reflection $S_{Ox}$$\begin{pmatrix}1&0\\0&-1\end{pmatrix}$$-1$
Reflected homothety $SH^\kappa_{Ox}$$\begin{pmatrix}\kappa&0\\0&-\kappa\end{pmatrix}$$-\kappa^2$

All six matrices are built the same way: the columns are two mutually perpendicular vectors of the same length $\kappa$. This isn't a coincidence, but an exhaustive criterion that can be proved with the tools already assembled in §5.

Theorem (Matrix Criterion for a Similarity)

A linear operator $L$ on the plane (with the standard inner product) is the linear part of a similarity with ratio $\kappa>0$ — that is, $|Lx|=\kappa|x|$ for every vector $x$ — if and only if its matrix $W$ satisfies $W^{\mathsf T}W=\kappa^2E$: the columns of $W$ are perpendicular and of the same length $\kappa$. Here $\det W=\kappa^2>0$ corresponds to a rotational homothety (in particular, to a rotation when $\kappa=1$), and $\det W=-\kappa^2<0$ to a reflected homothety (in particular, to a reflection when $\kappa=1$).

The proof assembles from §5 without a single new ingredient. The condition $|Lx|=\kappa|x|$ for all $x$ is equivalent to $\langle Lx,Lx\rangle=\kappa^2\langle x,x\rangle$; substituting $x=u+v$ and expanding both sides by bilinearity of the inner product, then subtracting off the already-known equalities for $u$ and for $v$ separately, gives the polarized form $\langle Lu,Lv\rangle=\kappa^2\langle u,v\rangle$ for any $u,v$. On the other hand, $\langle Lu,Lv\rangle=\langle u,W^{\mathsf T}Wv\rangle$ (the identity from "Matrix Arithmetic," applied to $A=W^{\mathsf T}W$) — so $W^{\mathsf T}W=\kappa^2E$. Then $\det(W^{\mathsf T}W)=(\det W)^2=\det(\kappa^2E)=\kappa^4$, giving $\det W=\pm\kappa^2$; the sign fixes the orientation — whether it matches the original one (rotational homothety) or reverses it (reflected homothety), exactly per the classification of plane similarities.

The stretch operator $\mathrm{diag}(\lambda,1)$ from §4 violates this condition as soon as $\lambda\ne1$ ($\kappa_1=\lambda\ne1=\kappa_2$) — the simplest example of a linear operator that isn't a similarity, because it stretches different directions differently. This is exactly the mechanism that distinguishes general $\R$-linear maps $\R^2\to\R^2$ from $\C$-linear ones: complex differentiability is precisely the requirement of being locally a rotational homothety, with no license to stretch different directions differently (more on this in «Conformality and Fractional-Linear Transformations», §1–2).

Below — a constructor: drag the endpoints of the vectors $Le_1$ and $Le_2$ (or pick a preset) and see for which matrices the operator remains a similarity, and for which it doesn't.

Gray dashed vectors are the original basis $e_1,e_2$ and the unit square on them; blue/rust are their images $Le_1,Le_2$ under the operator, and the light-blue region is the image of the unit square.

«Motions of the Plane» and «Similarities of the Plane» are precisely the classification of all linear operators $\R^2\to\R^2$ satisfying $W^{\mathsf T}W=\kappa^2E$, by the sign of $\det W$ and the value of $\kappa$ — only arrived at geometrically rather than algebraically. And multiplication by a complex number $a\ne0$ from «Complex Numbers» is that very same operator, written not as a $2\times2$ matrix but as a single number $a=\kappa e^{i\alpha}$: Construction II there assigns to $a=x+iy$ exactly the matrix $\begin{pmatrix}x&-y\\y&x\end{pmatrix}$, whose columns are perpendicular and equal in length to $|a|$ — that is, they automatically satisfy this theorem's criterion.