Functional Analysis/Banach spaces

←Chapter 1: Preliminaries

Functional Analysis Chapter 2: Banach spaces

Chapter 3: Hilbert spaces→

Let ${\mathcal {X}}$ be a linear space. A norm is a real-valued function $f$ on ${\mathcal {X}}$, with the notation $\|\cdot \|=f(\cdot )$, such that

• (i) $\|x+y\|\leq \|x\|+\|y\|$ (w:triangular inequality)
• (ii) $\|\lambda x\|=|\lambda |\|x\|$ for any scalar $\lambda$
• (iii) $\|x\|=0$ implies $x=0$.

(ii) implies that $\|0\|=0$. This and (i) then implies $0=\|x-x\|\leq \|x\|+\|-x\|=2\|x\|$ for all $x$; that is, norms are always non-negative. A linear space with a norm is called a normed space. With the metric $d(x,y)=\|x-y\|$ a normed space is a metric space. Note that (i) implies that:

$\|x\|\leq \|x-y\|+\|y\|$ and $\|y\|\leq \|x-y\|+\|x\|$

and so: $|\|x\|-\|y\||\leq \|x-y\|$. (So, the map $x\mapsto \|x\|$ is continuous; in fact, 1-Lipschitz continuous.)

A complete normed space is called a Banach space. While there is seemingly no prototypical example of a Banach space, we still give one example of a Banach space: ${\mathcal {C}}(K)$, the space of all continuous functions on a compact space $K$, can be identified with a Banach space by introducing the norm:

$\|\cdot \|=\sup _{K}|\cdot |$

It is a routine exercise to check that this is indeed a norm. The completeness holds since, from real analysis, we know that a uniform limit of a sequence of continuous functions is continuous. In concrete spaces like this one, one can directly show the completeness. More often than that, however, we will see that the completeness is a necessary condition for some results (especially, reflexivity), and thus the space has to be complete. The matter will be picked up in the later chapters.

Another example of Banach spaces, which is more historical, is an $l_{p}$ space; that is, the space of convergent series. (The geometric properties of $l_{p}$ spaces will be investigated in Chapter 4.) It is clear that $l_{p}$ is a linear space, since the sum of two p-convergent series is again p-convergent. That the $l_{p}$ norm is in fact a norm follows from

Lemma 2.1.

If $\|x\|_{p}<\infty$, then

$\|x\|_{p}=\sup _{\|y\|_{q}=1}|\sum x_{j}{\overline {y_{j}}}|$, where $1/p+1/q=1$

Proof. By Hölder's inequality,

$\sup _{\|y\|_{q}=1}|\sum x_{j}{\overline {y_{j}}}|\leq \|x\|_{p}$

Conversely, if $\|x\|_{p}=1$, then taking $y_{j}={\overline {x_{j}}}|x_{j}|^{p-2}$ we have:

$\sum x_{j}{\overline {y_{j}}}=\sum |x_{j}|^{p}=1$, while $\|y\|_{q}=(\sum |x_{j}|^{(p-1)q})^{1/q}=1$.

since $p=(p-1)q$. More generally, if $\|x\|_{p}\neq 0$, then

${x \over \|x\|_{p}}=\sup _{\|y\|_{q}=1}|\sum x_{j}{\overline {y_{j}}}|{1 \over \|x\|_{p}}$.

Since the identity is obvious when $x=0$, the proof is complete. $\square$

Now, it remains to show that an $l_{p}$ space is complete. For that, let $x_{k}\in l_{p}$ be a Cauchy sequence. This means explicitly that

$\sum _{n=1}^{\infty }|(x_{k})_{n}-(x_{j})_{n}|^{2}\to 0$ as $n,m\to \infty$

For each $n$, by completeness, $\lim _{k\to \infty }(x_{k})_{n}$ exists and we denote it by $y_{n}$. Let $\epsilon >0$ be given. Since $x_{k}$ is Cauchy, there is $N$ such that

$\sum _{n=1}^{\infty }|(x_{k})_{n}-(x_{j})_{n}|^{2}<\epsilon$ for $k,j>N$

Then, for any $k>N$,

$\sum _{n=1}^{\infty }|(x_{k})_{n}-y_{n}|^{2}=\sup _{m\geq 1}\sum _{n=1}^{m}|(x_{k})_{n}-y_{n}|^{2}=\sup _{m\geq 1}\lim _{j\to \infty }\sum _{n=1}^{m}|(x_{k})_{n}-(x_{j})_{n}|^{2}<\epsilon$

Hence, $x_{k}\to y$ with $y=\sum _{n=1}^{\infty }y_{n}$. $y$ is in fact in $l_{p}$ since $\|y\|_{2}\leq \|y-x_{n}\|_{2}+\|x_{n}\|_{2}<\infty$. (We stress the fact that the completeness of $l_{p}$ spaces come from the fact that the field of complex numbers is complete; in other words, $l_{p}$ spaces may fail to be complete if the base field is not complete.) $l_{p}$ is also separable; i.e., it has a countable dense subset. This follows from the fact that $l_{p}$ can be written as a union of subspaces with dimensions 1, 2, ..., which are separable. (TODO: need more details.)

We define the operator norm of a continuous linear operator $f$ between normed spaces ${\mathcal {X}}$ and ${\mathcal {Y}}$, denoted by $\|f\|$, by

$\|f\|=\sup _{\|x\|_{\mathcal {X}}\leq 1}\|f(x)\|_{\mathcal {Y}}$

2 Theorem Let $T$ be a linear operator from a normed space ${\mathcal {X}}$ to a normed space ${\mathcal {Y}}$.

• (i) $T$ is continuous if and only if there is a constant $C>0$ such that $\|Tx\|\leq C\|x\|$ for all $x\in X$
• (ii) $\|f\|=\inf\{$ any $C$ as in (i) $\}=\sup _{\|x\|=1}\|f(x)\|$ if ${\mathcal {X}}$ has nonzero element. (Recall that the inf of the empty set is $\infty$.)

Proof: If $\|T\|<\infty$, then

$\|T(x_{n}-x)\|_{\mathcal {Y}}\leq \|T\|\|x_{n}-x\|_{\mathcal {X}}\to 0$

as $x_{n}\to x$. Hence, $T$ is continuous. Conversely, suppose $\|T\|=\infty$. Then we can find $x_{n}\in {\mathcal {X}}$ with $\|x_{n}\|_{\mathcal {X}}\leq 1$ and $\|Tx_{n}\|\geq n$. Then ${x_{n} \over n}\to 0$ while $\left\|T\left({x_{n} \over n}\right)\right\|\not \to 0$. Hence, $T$ is not continuous. The proof of (i) is complete. For (ii), see w:operator norm for now. (TODO: write an actual proof). $\square$

It is clear that an addition and a scalar multiplication are both continuous. (Use a sequence to check this.) Since the inverse of an addition is again addition, an addition is also an open mapping. Ditto to nonzero-scalar multiplications. In other words, translations and dilations of open (resp. closed) sets are again open (resp. closed).

Not all linear operators are continuous. Take the linear operator defined by $D(P)=XP'$ on the normed vector space of polynomials $\mathbb {R} [X]$ with the suprenum norm $\|P\|_{\infty }=\sup _{x\in [0,1]}|P(x)|$ ; since $D(X^{n})=nX^{n}$, the unit ball is not bounded and hence this linear operator is not continuous.

Notice that the kernel of this non continuous linear operator is closed: $\ker D=\{0\}$. However, when a linear operator is of finite rank, the closeness of the kernel is in fact synonymous to continuity. To see this, we start with the special case of linear forms.

2 Theorem A (non null) linear form is continuous iff it's kernel is closed.

$T$ continuous $\Leftrightarrow \ker T={\overline {\ker T}}$

Proof: If the linear form $T$ on a normed vector space $X$ is continuous, then it's kernel is closed since it's the continuous inverse image of the closed set $\{0\}$.

Conversely, suppose a linear form $T:X\to \mathbb {R}$ is not continuous. then by the previous theorem,

$\forall c>0,\exists x(c)s.t.|Tx(c)|\geqslant c\|x(c)\|$ so in particular, one can define a sequence $\{x_{n}\}$ such that $|Tx_{n}|\geqslant n\|x_{n}\|>0$. Then denote:

$u_{n}:={\frac {x_{n}}{|x_{n}|}}$, one has defined a unit normed sequence ($|u_{n}|=1$) s.t. $|Tu_{n}|\geqslant n$. Furthermore, denote

$v_{n}:={\dfrac {u_{n}}{|Tu_{n}|}}$. Since ${\frac {|u_{n}|}{|Tu_{n}|}}\leqslant {\dfrac {1}{n}}$, one can define a sequence that converges $\{v_{n}\}\to 0$ whilst $|Tv_{n}|=1$.

Now, since $\ker T\neq X$, then there exists $a$ such that $Ta\neq 0$. Then the sequence of general term converges

$\underbrace {a-v_{n}Ta} _{\in \ker T}\to a\notin \ker T$ and hence $\ker T$ is not closed. $\square$

Furthermore, if the linear form is continuous and the kernel is dense, then $\ker T={\overline {\ker T}}=X\Rightarrow f=0$, hence a continuous & non null linear has a non dense kernel, and hence a linear form with a dense kernel is whether null or non continuous so a non null continuous linear form with a dense kernel is not continuous, and a linear form with a dense kernel is not continuous.

2 Corollary' " A non null linear form on a normed vector space is not continuous iff it's kernel is dense.

${\overline {\ker T}}=X\Leftrightarrow T$ is not continuous"

More generally, we have: 2 Theorem " A non null linear operator of finite rank between normed vector spaces. then closeness of the null space is equivalent to continuity."
Proof: It remains to show that continuity implies closeness of the kernel. Suppose $T:X\to Y$ is not continuous. Denote $r:=\dim {\mbox{Im }}T$;

2 Lemma If $T:X\to Y$ is a linear operator between normed vector spaces, then $T$ is of finite rank $r$ iff there exists $r$ independent linear forms $(f_{1},\dots ,f_{r})$and $r$ independent vectors $(a_{1},\dots ,a_{r})$ such that $Tx=a_{1}f_{1}(x)+\dots +a_{r}f_{r}(x)$"
Proof: take a basis $(a_{1},\dots ,a_{r})$ of ${\mbox{Im }}T$, then from $Tx=\sum _{i=1}^{r}a_{i}y_{i}$, one can define $r$ mappings $f_{i}(x)=y_{i}$. Unicity and linearity of $T$ implies linearity of the $f_{i}$'s. Furthermore, the family $(f_{1},\dots ,f_{r})$ of linear forms of $X^{*}$ is linearly independent: suppose not, then there exist a non zero family $(\alpha _{1},\dots ,\alpha _{r})$ such that e.g. $f_{1}=\sum _{i=2}^{r}\alpha _{i}f_{i}$ so

$Tx=\sum _{i=1}^{r}f_{i}(x)a_{i}=(\sum _{i=2}^{r}\alpha _{i}f_{i}(x))a_{1}+\sum _{i=2}^{r}f_{i}(x)a_{i}=(\alpha _{2}a_{1}+a_{2})f_{2}(x)+\dots +(\alpha _{n}a_{1}+a_{r})f_{r}(x)$ and the family $(\alpha _{i}a_{1}+a_{i})_{i=2,\dots ,r}$ spans ${\mbox{Im }}T$, so $\dim {\mbox{Im }}T=r-1$ which is a contradiction. Finally, one has a unique decomposition of a finite rank linear operator:

$Tx=a_{1}f_{1}(x)+\dots a_{r}f_{r}(x)$ with $f_{i}\in E^{*}$ $\square$

Take $x\in \ker T\Rightarrow x\in \bigcap _{i=1}^{r}\ker f_{i}\subset \ker f_{i}$. Then there exists a vector subspace $H_{i}$ such that $\ker f_{i}=\ker T\oplus H_{i}$. Denote $T_{i}:H_{i}\to {\mbox{Im}}T$ the restriction of $T$ to $H_{i}$. Since $kerT_{i}=\{x\in H_{i}:T_{i}(x)\}=0=\ker T\cap H_{i}=\{0\}$, the linear operator $T_{i}$ is injective so ${\mbox{Im}}T_{i}\subset {\mbox{Im}}T$ and $H_{i}$ is of finite dimension, and this for all $i=1,\dots ,r$.

By hypothesis $\ker T$ is closed. Since the sum of this closed subspace and a subspace of finite dimension ($H_{i}$) is closed (see lemma bellow), it follows that the kernel of each $r$ linear forms $\ker f_{i}$ is closed, so the $f_{i}$'s are all continuous by the first case and hence $T$ is continuous. $\square$

2 Lemma The sum of subspace of finite dimension with a closed subspace is closed."
Proof: by induction on the dimension.

Case $n=1$. Let's show that $H:=F+\mathbb {K} a$ is closed when $F$ is closed (where $\mathbb {K}$ is a complete field). Any $x\in H$ can be uniquely written as $x=y+\lambda a$ with $y\in F$. There exists a linear form $L$ s.t. $x=y+L(x)a$. Since $L$ is closed in $(X,\|\cdot \|)$ so in $(H,\|\cdot \|)$, then $f$ is continuous by the first case. Take a convergente sequence ${x_{n}}\to x\in E$ of $H$. He have $x_{n}=y_{n}+L(x_{n})a$ with $y_{n}\in F$. Since the sequence ${x_{n}}$ is convergente, then it si Cauchy, so it's continuous image ${L(x_{n})}$ is also Cauchy. Since $\mathbb {R}$ is complete, then ${L(x_{n})}\to \lambda$. Finally, the sequence ${y_{n}}$ converges to $x-\lambda a$. Since $F$ is closed, then $x-\lambda a\in F$ and $x\in H$ so $H$ is closed.

Suppose the result holds for all subspaces of dimension $\leqslant p$. Let $G$ be a subspace of dimension $p+1$. Let $(a_{1},\dots ,a_{p+1})$ be a basis of $G$. Then $H:=F+\bigoplus _{i=1}^{p}\mathbb {K} a_{i}+\mathbb {K} a_{p+1}$ and concludes easily.$\square$

2 Corollary Any linear operator on a normed vector space of finite dimension onto a normed vector space is continuous.
Proof: Since $X$ is of finite dimension, then any linear operator is of finite rank. Then as $\dim \ker T+\dim {\mbox{Im}}T=\dim X$ holds, it comes that the null space is of finite dimension, so is closed (any $\mathbb {K}$ vector subspace of finite dimension $n$ is isomorphic to $\mathbb {K} ^{n}$ (where $\mathbb {K}$ is a complete field), so the subspace is complete and closed). Then one applies the previous theorem.$\square$

2 Lemma (Riesz) A normed space ${\mathcal {X}}$ is finite-dimensional if and only if its closed unit ball is compact.
Proof: Let $T:\mathbf {C} ^{n}\to X$ be a linear vector space isomorphism. Since $T$ has closed kernel, arguing as in the proof of the preceding theorem, we see that $T$ is continuous. By the same reasoning $T^{-1}$ is continuous. It follows:

$\{x\in {\mathcal {X}}|\|x\|\leq 1\}\subset T\{y\in \mathbf {C} ^{n}|\|y\|\leq \|T^{-1}\|\}$

In the above, the left-hand side is closed, and the right-hand is a continuous image of a closed ball, which is compact. Hence, the closed unit ball is a subset of a compact set and thus compact. Now, the converse. If ${\mathcal {X}}$ is not finite dimensional, we can construct a sequence $x_{j}$ such that:

$1=\|x_{j}\|\leq \|x_{j}-\sum _{k=1}^{j-1}a_{k}x_{k}\|$ for any sequence of scalars $a_{k}$.

Thus, in particular, $\|x_{j}-x_{k}\|\geq 1$ for all $j,k$. (For the details of this argument, see : w:Riesz's lemma for now) $\square$

2 Corollary Every finite-dimensional normed space is a Banach space.
Proof: Let $x_{n}$ be a Cauchy sequence. Since it is bounded, it is contained in some closed ball, which is compact. $x_{n}$ thus has a convergent subsequence and so $x_{n}$ itself converges. $\square$

2 Theorem A normed space ${\mathcal {X}}$ is finite-dimensional if and only if every linear operator $T$ defined on ${\mathcal {X}}$ is continuous.
Proof: Identifying the range of $T$ with $\mathbf {C} ^{n}$, we can write:

$Tx=(f_{1}(x),f_{2}(x),...f_{n}(x))$

where $f_{1},...f_{n}$ are linear functionals. The dimensions of the kernels of $f_{j}$ are finite. Thus, $f_{j}$ all have complete and thus closed kernels. Hence, they are continuous and so $T$ is continuous. For the converse, we need Axiom of Choice. (TODO: complete the proof.) $\square$

The graph of any function $f$ on a set $E$ is the set $\{(x,f(x))|x\in E\}$. A continuous function between metric spaces has closed graph. In fact, suppose $(x_{j},f(x_{j}))\to (x,y)$. By continuity, $f(x_{j})\to f(x)$; in other words, $y=f(x)$ and so $(x,y)$ is in the graph of $f$. It follows (in the next theorem) that a continuous linear operator with closed graph has closed domain. (Note the continuity here is a key; we will shortly study a linear operator that has closed graph but has non-closed domain.)

2 Theorem Let $T:{\mathcal {X}}\to {\mathcal {Y}}$ be a continuous densely defined linear operator between Banach spaces. Then its domain is closed; i.e., $T$ is actually defined everywhere.
Proof: Suppose $f_{j}\to f$ and $Tf_{j}$ is defined for every $j$; i.e., the sequence $f_{j}$ is in the domain of $T$. Since

$\|Tf_{j}-Tf_{k}\|\leq \|T\|\|f_{j}-f_{k}\|\to 0$,

$Tf_{j}$ is Cauchy. It follows that $(f_{j},Tf_{j})$ is Cauchy and, by completeness, has limit $(g,Tg)$ since the graph of T is closed. Since $f=g$, $Tf$ is defined; i.e., $f$ is in the domain of $T$. $\square$

The theorem is frequently useful in application. Suppose we wish to prove some linear formula. We first show it holds for a function with compact support and of varying smoothness, which is usually easy to do because the function vanishes on the boundary, where much of complications reside. Because of th linear nature in the formula, the theorem then tells that the formula is true for the space where the above functions are dense.

We shall now turn our attention to the consequences of the fact that a complete metric space is a Baire space. They tend to be more significant than results obtained by directly appealing to the completeness. Note that not every normed space that is a Baire space is a Banach space.

2 Theorem (open mapping theorem) Let ${\mathcal {X}},{\mathcal {Y}}$ be Banach spaces. If $T:{\mathcal {X}}\to {\mathcal {Y}}$ is a continuous linear surjection, then it is an open mapping; i.e., it maps open sets to open sets.
Proof: Let $B(r)=\{x\in {\mathcal {X}};\|x\|<r\}$. Since $T$ is surjective, $\cup _{n=1}^{\infty }T(B(n))=T(\cup _{n=1}^{\infty }B(n))=T(X)=Y$. Then by Baire's Theorem, some $B(k)$ contains an interior point; thus, it is a neighborhood of $0$. $\square$

2 Corollary If $({\mathcal {X}},\|\cdot \|_{1})$ and $({\mathcal {X}},\|\cdot \|_{2})$ are Banach spaces, then the norms $\|\cdot \|_{1}$ and $\|\cdot \|_{2}$ are equivalent; i.e., each norm is dominated by the other.
Proof: Let $I:({\mathcal {X}},\|\cdot \|_{1}+\|\cdot \|_{2})\to ({\mathcal {X}},\|\cdot \|_{1})$ be the identity map. Then we have:

$\|I\cdot \|_{1}=\|\cdot \|_{1}\leq (\|\cdot \|_{1}+\|\cdot \|_{2})$.

This is to say, $I$ is continuous. Since Cauchy sequences apparently converge in the norm $\|\cdot \|_{1}+\|\cdot \|_{2}$, the open mapping theorem says that the inverse of $I$ is also continuous, which means explicitly:

$\|\cdot \|_{1}+\|\cdot \|_{2}=\|I^{-1}\cdot \|_{1}+\|I^{-1}\cdot \|_{2}\leq \|I^{-1}\|\|\cdot \|_{1}$.

By the same argument we can show that $\|\cdot \|_{1}+\|\cdot \|_{2}$ is dominated by $\|\cdot \|_{2}$ $\square$

2 Corollary Let $({\mathcal {X}},\|\cdot \|_{\mathcal {X}})$ be a Banach space with dimension $n$. Then the norm $\|\cdot \|_{\mathcal {X}}$ is equivalent to the standard Euclidean norm:

$|(x_{1},...x_{n})|^{2}=\sum _{j}|x_{j}|^{2}$

2 Corollary If $T$ is a continuous linear operator between Banach spaces with closed range, then there exists a $K>0$ such that if $y\in \operatorname {im} (T)$ then $\|x\|\leq K\|y\|$ for some $x$ with $Tx=y$.
Proof: This is immediate once we have the notion of a quotient map, which we now define as follows.

Let ${\mathcal {M}}$ be a closed subspace of a normed space ${\mathcal {X}}$. The quotient space ${\mathcal {X}}/{\mathcal {M}}$ is a normed space with norm:

$\|\pi (x)\|=\inf\{\|x+m\|;m\in {\mathcal {M}}\}$

where $\pi :{\mathcal {X}}\to {\mathcal {X}}/{\mathcal {M}}$ is a canonical projection. That $\|\cdot \|$ is a norm is obvious except for the triangular inequality. But since

$\|\pi (x+y)\|\leq \|x+m\|+\|y+n\|$

for all $m,n\in {\mathcal {M}}$. Taking inf over $m,n$ separately we get:

$\|\pi (x+y)\|\leq \|\pi (x)\|+\|\pi (y)\|$

Suppose, further, that ${\mathcal {X}}$ is also a commutative algebra and ${\mathcal {M}}$ is an ideal. Then ${\mathcal {X}}/{\mathcal {M}}$ becomes a quotient algebra. In fact, as above, we have:

$\|\pi (x)\pi (y)\|=\|\pi ((x+m)(y+n))\|\leq \|x+m\|\|y+n\|$,

for all $m,n\in {\mathcal {M}}$ since $\pi$ is a homomorphism. Taking inf completes the proof.

So, the only nontrivial question is the completeness. It turns out that ${\mathcal {X}}/{\mathcal {M}}$ is a Banach space (or algebra) if ${\mathcal {X}}$ is Banach space (or algebra). In fact, suppose

$\sum _{n=1}^{\infty }\|\pi (x_{n})\|<\infty$

Then we can find a sequence $y_{n}\in {\mathcal {M}}$ such that

$\sum _{n=1}^{\infty }\|x_{n}+y_{n}\|<\infty$

By completeness, $\sum _{n=1}^{\infty }x_{n}+y_{n}$ converges, and since $\pi$ is continuous, $\sum _{n=1}^{\infty }\pi (x_{n})$ converges then. The completeness now follows from:

2 Lemma Let ${\mathcal {X}}$ be a normed space. Then ${\mathcal {X}}$ is complete (thus a Banach space) if and only if

$\sum _{n=1}^{\infty }\|x_{n}\|<\infty$ implies $\sum _{n=1}^{\infty }x_{n}$ converges.

Proof: ($\Rightarrow$) We have:

$\|\sum _{n=k}^{k+m}x_{n}\|\leq \sum _{n=k}^{k+m}\|x_{n}\|$.

By hypothesis, the right-hand side goes to 0 as $n,m\to \infty$. By completeness, $\sum _{n=1}^{\infty }x_{n}$ converges. Conversely, suppose $x_{j}$ is a Cauchy sequence. Thus, for each $j=1,2,...$, there exists an index $k_{j}$ such that $\|x_{n}-x_{m}\|<2^{-j}$ for any $n,m\geq k_{j}$. Let $x_{k_{0}}=0$. Then $\sum _{j=0}^{\infty }\|x_{k_{j+1}}-x_{k_{j}}\|<2$. Hence, by assumption we can get the limit $x=\sum _{j=0}^{\infty }x_{k_{j+1}}-x_{k_{j}}$, and since

$\|x_{n_{k}}-x\|=\|\sum _{j=1}^{n}x_{k_{j+1}}-x_{k_{j}}-x\|\to 0$ as $n\to \infty$,

we conclude that $x_{j}$ has a subsequence converging to $x$; thus, it converges to $x$. $\square$

The next result is arguably the most important theorem in the theory of Banach spaces. (At least, it is used the most frequently in application.)

2 Theorem (closed graph theorem) Let ${\mathcal {X}},{\mathcal {Y}}$ be Banach spaces, and $T:{\mathcal {X}}\to {\mathcal {Y}}$ a linear operator. The following are equivalent.

• (i) $T$ is continuous.
• (ii) If $x_{j}\to 0$ and $Tx_{j}$ is convergent, then $Tx_{j}\to 0$.
• (iii) The graph of $T$ is closed.

Proof: That (i) implies (ii) is clear. To show (iii), suppose $(x_{j},Tx_{j})$ is convergent in $X$. Then $x_{j}$ converges to some $x_{0}$ or $x_{j}-x_{0}\to 0$, and $Tx_{j}-Tx$ is convergent. Thus, if (ii) holds, $T(x_{j}-x)\to 0$. Finally, to prove (iii) $\Rightarrow$ (i), we note that Corollary 2.something gives the inequality:

$\|\cdot \|+\|T\cdot \|\leq K\|\cdot \|$

since by hypothesis the norm in the left-hand side is complete. Hence, if $x_{j}\to x$, then $Tx_{j}\to Tx$. $\square$

Note that when the domain of a linear operator is not a Banach space (e.g., just dense in a Banach space), the condition (ii) is not sufficient for the graph of the operator to be closed. (It is not hard to find an example of this in other fields, but the reader might want to construct one himself as an exercise.)

Finally, note that an injective linear operator has closed graph if and only if its inverse is closed, since the map $(x_{1},x_{2})\mapsto x_{2},x_{1}$ sends closed sets to closed sets.

2 Theorem Let $({\mathcal {X}}_{j},\|\cdot \|_{j})$ be Banach spaces. Let $T:{\mathcal {X}}_{1}\to {\mathcal {X}}_{2}$ be a closed densely defined operator and $S$ be a linear operator with $\operatorname {dom} (T)\subset \operatorname {dom} (S)$. If there are constants $a,b$ such that (i) $0\leq a<1$ and $b>0$ and (ii) $\|Su\|\leq a\|Tu\|+b\|u\|$ for every $u\in \operatorname {dom} (T)$, then $T+S$ is closed.
Proof: Suppose $\|u_{j}-u\|_{1}+\|(T+S)u_{j}-f\|_{2}\to 0$. Then

$\|T(u_{j}-u_{k})\|\leq \|(T+S)(u_{j}-u_{k})\|+a\|T(u_{j}-u_{k})\|+b\|u_{j}-u_{k}\|$

Thus,

$(1-a)\|T(u_{j}-u_{k})\|\leq \|(T+S)(u_{j}-u_{k})\|+b\|u_{j}-u_{k}\|$

By hypothesis, the right-hand side goes to $0$ as $j,k\to \infty$. Since $T$ is closed, $(u_{j},Tu_{j})$ converges to $(u,Tu)$. $\square$

In particular, with $a=0$, the hypothesis of the theorem is fulfilled, if $S$ is continuous.

When ${\mathcal {X}},{\mathcal {Y}}$ are normed spaces, by $L({\mathcal {X}},{\mathcal {Y}})$ we denote the space of all continuous linear operators from ${\mathcal {X}}$ to ${\mathcal {Y}}$.

2 Theorem If ${\mathcal {Y}}$ is complete, then every Cauchy sequence $T_{n}$ in $L({\mathcal {X}},{\mathcal {Y}})$ converges to a limit $T$ and $\|T\|=\lim _{n\to \infty }\|T_{n}\|$. Conversely, if $L({\mathcal {X}},{\mathcal {Y}})$ is complete, then so is Y.
Proof: Let $T_{n}$ be a Cauchy sequence in operator norm. For each $x\in {\mathcal {X}}$, since

$\|T_{n}(x)-T_{m}(x)\|\leq \|T_{n}-T_{m}\|\|x\|$

and ${\mathcal {Y}}$ is complete, there is a limit $y$ to which $T_{n}(x)$ converges. Define $T(x)=y$. $T$ is linear since the limit operations are linear. It is also continuous since $\|T(x)\|\leq \sup _{n}\|T_{n}\|\|x\|$. Finally, $\lim _{n\to \infty }\|T_{n}-T\|=\sup _{\|x\|\leq 1}\|\lim _{n\to \infty }T_{n}(x)-T(x)\|$ and $|\|T^{n}\|-\|T\||\leq \|T^{n}-T\|\to 0$ as $n\to \infty$. (TODO: a proof for the converse.) $\square$

2 Theorem (uniform boundedness principle) Let ${\mathcal {F}}$ be a family of continuous functions $f:X\to Y$ where $Y$ is a normed linear space. Suppose that $M\subset X$ is non-meager and that:

$\sup\{\|f(x)\|:f\in {\mathcal {F}}\}<\infty$ for each $x\in M$

It then follows: there is some $G\subset X$ open and such that

(a) $\sup\{\|f(x)\|:f\in {\mathcal {F}},x\in G\}<\infty$

If we assume in addition that each member of ${\mathcal {F}}$ is a linear operator and $X$ is a normed linear space, then

(b) $\sup\{\|f\|:f\in {\mathcal {F}}\}<\infty$

Proof: Let $E_{j}=\cap _{f\in {\mathcal {F}}}\{x\in X;\|f(x)\|\leq j\}$ be a sequence. By hypothesis, $M\subset \bigcup _{j=1}^{\infty }E_{j}$ and each $E_{j}$ is closed since $\{x\in X;\|f(x)\|>j\}$ is open by continuity. It then follows that some $E_{N}$ has an interior point $y$; otherwise, $M$ fails to be non-meager. Hence, (a) holds. To show (b), making additional assumptions, we can find an open ball $B=B(2r,y)\subset E_{N}$. It then follows: for any $f\in {\mathcal {F}}$ and any $x\in X$ with $\|x\|=1$,

$\|f(x)\|=r^{-1}\|f(rx+y)-f(y)\|\leq 2r^{-1}N$. $\square$

A family $\Gamma$ of linear operators is said to be equicontinuous if given any neighborhood $W$ of $0$ we can find a neighborhood $V$ of $0$ such that:

$f(V)\subset W$ for every $f\in \Gamma$

The conclusion of the theorem, therefore, means that the family satisfying the hypothesis of the theorem is equicontinuous.

2 Corollary Let ${\mathcal {X}},{\mathcal {Y}},{\mathcal {Z}}$ be Banach spaces. Let $T:{\mathcal {X}}\times {\mathcal {Y}}\to {\mathcal {Z}}$ be a bilinear or sesquilinear operator. If $T$ is separately continuous (i.e., the function is continuous when all but one variables are fixed) and ${\mathcal {Y}}$ is complete, then $T$ is continuous.
Proof: For each $y\in {\mathcal {Y}}$,

$\sup\{\|T(x,y)\|_{\mathcal {Z}};\|x\|_{\mathcal {X}}\leq 1\}=\|T(\cdot ,y)\|$

where the right-hand side is finite by continuity. Hence, the application of the principle of uniform boundedness to the family $\{T(x,\cdot );\|x\|_{\mathcal {X}}\leq 1\}$ shows the family is equicontinuous. That is, there is $K>0$ such that:

$\|T(x,y)\|_{\mathcal {Z}}\leq K\|y\|_{\mathcal {Y}}$ for every $\|x\|_{\mathcal {X}}le1$ and every $y\in {\mathcal {Y}}$.

The theorem now follows since ${\mathcal {X}}\times {\mathcal {Y}}$ is a metric space. $\square$

Since scalar multiplication is a continuous operation in normed spaces, the corollary says, in particular, that every linear operator on finite dimensional normed spaces is continuous. The next is one more example of the techniques discussed so far.

2. Theorem (Hahn-Banach) Let $({\mathcal {X}},\|\cdot \|)$ be normed space and ${\mathcal {M}}\subset {\mathcal {X}}$ be a linear subspace. If $z$ is a linear functional continuous on ${\mathcal {M}}$, then there exists a continuous linear functional $w$ on ${\mathcal {X}}$ such that $z=w$ on ${\mathcal {M}}$ and $\|z\|=\|w\|$.
Proof: Apply the Hahn-Banach stated in Chapter 1 with $\|z\|\|\cdot \|$ as a sublinear functional dominating $z$. Then:

$\|z\|=\sup\{\|w(x)\|;x\in {\mathcal {M}},\|x\|\leq 1\}\leq \sup\{\|w(x)\|;x\in {\mathcal {X}},\|x\|\leq 1\}=\|w\|\leq \|z\|$;

that is, $\|z\|=\|w\|$. $\square$

2. Corollary Let ${\mathcal {M}}$ be a subspace of a normed linear space ${\mathcal {X}}$. Then $x$ is in the closure of ${\mathcal {M}}$ if and only if $z(x)$ = 0 for any $z\in {\mathcal {X}}^{*}$ that vanishes on ${\mathcal {M}}$.
Proof: By continuity $z({\overline {\mathcal {M}}})\subset {\overline {z({\mathcal {M}})}}$. Thus, if $x\in {\overline {\mathcal {M}}}$, then $z(x)\in {\overline {z({\mathcal {M}})}}=\{0\}$. Conversely, suppose $x\not \in {\overline {\mathcal {M}}}$. Then there is a $\delta >0$ such that $\|y-x\|\geq \delta$ for every $y\in {\mathcal {M}}$. Define a linear functional $z(y+\lambda x)=\lambda$ for $y\in {\mathcal {M}}$ and scalars $\lambda$. For any $\lambda \neq 0$, since $-\lambda ^{-1}y\in {\mathcal {M}}$,

$|z(y+\lambda x)|=|\lambda |\delta ^{-1}\delta \leq \delta ^{-1}|\lambda ||\lambda ^{-1}y+x\|=\|y+\lambda x\|$.

Since the inequality holds for $\lambda =0$ as well, $z$ is continuous. Hence, in view of the Hahn-Banach theorem, $z\in {\mathcal {X}}$ while we still have $z=0$ on ${\mathcal {M}}$ and $z(x)\neq 0$. $\square$

Here is a classic application.

2 Theorem Let ${\mathcal {X}},{\mathcal {Y}}$ be Banach spaces, $T:{\mathcal {X}}\to {\mathcal {Y}}$ be a linear operator. If $x_{n}\to 0$ implies that $(z\circ T)x_{n}\to 0$ for every $z\in {\mathcal {X}}^{*}$, then $T$ is continuous.
Proof: Suppose $x_{n}\to 0$ and $Tx_{n}\to y$. For every $z\in {\mathcal {X}}^{*}$, by hypothesis and the continuity of $z$,

$0=\lim _{n\to \infty }z(Tx_{n})=z(y)$.

Now, by the preceding corollary $y=0$ and the continuity follows from the closed graph theorem. $\square$

2 Theorem Let ${\mathcal {X}}$ be a Banach space.

• (i) Given $E\subset {\mathcal {X}}$, $E$ is bounded if and only if $\sup _{E}|f|<\infty$ for every $f\in {\mathcal {X}}^{*}$
• (ii) Given $x\in {\mathcal {X}}$, if $f(x)=0$ for every $f\in {\mathcal {X}}^{*}$, then $x=0$.

Proof: (i) By continuity,

$\sup\{|f(x)|;x\in E\}\leq \|f\|\sup _{E}\|\cdot \|$.

This proves the direct part. For the converse, define $T_{x}f=f(x)$ for $x\in E,f\in {\mathcal {X}}^{*}$. By hypothesis

$|T_{x}f|\leq \sup _{E}|f|$ for every $x\in E$.

Thus, by the principle of uniform boundedness, there is $K>0$ such that:

$|T_{x}f|\leq K\|f\|$ for every $x\in E,f\in {\mathcal {X}}^{*}$

Hence, in view of Theorem 2.something, for $x\in E$,

$\|x\|=\sup\{|f(x)|;f\in {\mathcal {X}}^{*},\|f\|\leq 1\}\leq K$.

(ii) Suppose $x\neq 0$. Define $f(s(x))=s\|x\|$ for scalars $s$. Now, $f$ is continuous since its domain is finite-dimensional, and so by the Hahn-Banach theorem we could extend the domain of $f$ in such a way we have $f\in {\mathcal {X}}^{*}$. $\square$

2. Corollary Let $({\mathcal {X}},\|\cdot \|)$ be Banach, $f_{j}\in {\mathcal {X}}^{*}$ and ${\mathcal {M}}\subset {\mathcal {X}}$ dense and linear. Then $f_{j}(x)\to 0$ for every $x\in {\mathcal {X}}$ if and only if $\sup _{j}\|f_{j}\|<\infty$ and $f_{j}(y)\to 0$ for every $y\in {\mathcal {M}}$.
Proof: Since $f_{j}$ is Cauchy, it is bounded. This shows the direct part. To show the converse, let $x\in {\mathcal {X}}$. If $y_{j}\in {\mathcal {M}}$, then

$|f_{j}(x)|\leq |f_{j}(x-y_{j})|+|f_{j}(y_{j})|\leq (\sup _{j}\|f_{j}\|)\|x-y_{j}\|+|f_{j}(y_{j})|$

By denseness, we can take $y_{j}$ so that $\|y_{j}-x\|\to 0$. $\square$

2 Theorem Let $T$ be a continuous linear operator into a Banach space. If $\|I-T\|<1$ where $I$ is the identity operator, then the inverse $T^{-1}$ exists, is continuous and can be written by:

$T^{-1}(x)=\sum _{k=0}^{\infty }\left(I-T\right)^{k}(x)$ for each $x$ in the range of $T$.

Proof: For $n\geq m$, we have:

$\|\sum _{k=m}^{n}\left(I-T\right)^{k}(x)\|\leq \|x\|\sum _{k=m}^{n}\left\|I-T\right\|^{k}$.

Since the series is geometric by hypothesis, the right-hand side is finite. Let $S_{n}=\sum _{k=0}^{n}\left(I-T\right)^{k}$. By the above, each time $x$ is fixed, $S_{n}(x)$ is a Cauchy sequence and the assumed completeness implies that the sequence converges to the limit, which we denote by $S(x)$. Since for each $x$ $\sup _{n\geq 1}\|S_{n}(x)\|<\infty$, it follows from the principle of uniform boundedness that:

$\sup _{n\geq 1}\|S_{n}\|\leq \infty$.

Thus, by the continuity of norms,

$\|S(x)\|=\lim _{n\to \infty }\|S_{n}(x)\|\leq (\sup _{n\geq 1}\|S_{n}\|)\|x\|$.

This shows that $S$ is a continuous linear operator since the linearity is easily checked. Finally,

$\|TS(x)-x\|=\|\lim _{n\to \infty }-(I-T)^{n+1}(x)\|\leq \|x\|\lim _{n\to \infty }\|I-T\|^{n+1}=0$.

Hence, $S$ is the inverse to $T$. $\square$

2 Corollary The space of invertible continuous linear operators ${\mathcal {X}}$ is an open subspace of $L({\mathcal {X}},{\mathcal {X}})$.
Proof: If $T\in L({\mathcal {X}},{\mathcal {X}})$ and $\|S-T\|<{1 \over \|T^{-1}\|}$, then $S$ is invertible. $\square$

If $\mathbf {F}$ is a scalar field and ${\mathcal {X}}$ is a normed space, then $L({\mathcal {X}},\mathbf {F} )$ is called a dual of ${\mathcal {X}}$ and is denoted by ${\mathcal {X}}^{*}$. In view of Theorem 2.something, it is a Banach space.

A linear operator $T$ is said to be a compact operator if the image of the open unit ball under $T$ is relatively compact. We recall that if a linear operator between normed spaces maps bounded sets to bounded sets, then it is continuous. Thus, every compact operator is continuous.

2 Theorem Let ${\mathcal {X}}$ be a reflexive Banach space and ${\mathcal {Y}}$ be a Banach space. Then a linear operator $T:{\mathcal {X}}\to {\mathcal {Y}}$ is a compact operator if and only if $T$ sends weakly convergent sequence to norm convergent ones.
Proof: Let $x_{n}$ converges weakly to $0$, and suppose $Tx_{n}$ is not convergent. That is, there is an $\epsilon >0$ such that $Tx_{n}\geq \epsilon$ for infinitely many $n$. Denote this subsequence by $y_{n}$. By hypothesis we can then show (TODO: do this indeed) that it contains a subsequence $y_{n_{k}}$ such that $Ty_{n_{k}}$ converges in norm, which is a contradiction. To show the converse, let $E$ be a bounded set. Then since ${\mathcal {X}}$ is reflexive every countable subset of $E$ contains a sequence $x_{n}$ that is Cauchy in the weak topology and so by the hypothesis $Tx_{n}$ is a Cauchy sequence in norm. Thus, $T(E)$ is contained in a compact subset of ${\mathcal {Y}}$. $\square$

2 Corollary

• (i) Every finite-rank linear operator $T$ (i.e., a linear operator with finite-dimensional range) is a compact operator.
• (ii) Every linear operator $T$ with the finite-dimensional domain is continuous.

Proof: (i) is clear, and (ii) follows from (i) since the range of a linear operator has dimension less than that of the domain. $\square$

2 Theorem The set of all compact operators into a Banach space forms a closed subspace of the set of all continuous linear operators in operator norm.
Proof: Let $T$ be a linear operator and $\omega$ be the open unit ball in the domain of $T$. If $T$ is compact, then $T({\overline {\omega }})$ is bounded (try scalar multiplication); thus, $T$ is continuous. Since the sum of two compacts sets is again compact, the sum of two compact operators is again compact. For the similar reason, $\alpha T$ is compact for any scalar $\alpha$. We conclude that the set of all compact operators, which we denote by $E$, forms a subspace of continuous linear operators. To show the closedness, suppose $S$ is in the closure of $E$. Let $\epsilon >0$ be given. Then there is some compact operator $T$ such that $\|S-T\|<\epsilon /2$. Also, since $T$ is a compact operator, we can cover $T(\omega )$ by a finite number of open balls of radius $\epsilon /2$ centered at $z_{1},z_{2},...z_{n}$, respectively. It then follows: for $x\in \omega$, we can find some $j$ so that $\|Tx-z_{j}\|<\epsilon /2$ and so $\|Sx-Tx\|\leq \|Sx-z_{j}\|+\|z_{j}-Tx\|<\epsilon$. This is to say, $S(\omega )$ is totally bounded and since the completeness its closure is compact. $\square$

2 Corollary If $T_{n}$ is a sequence of compact operators which converges in operator norm, then its limit is a compact operator.

2 Theorem (transpose) Let ${\mathcal {X}},{\mathcal {Y}}$ be Banach spaces, and $u:{\mathcal {X}}\to {\mathcal {Y}}$ be a continuous linear operator. Define ${}^{t}\!u:{\mathcal {Y}}^{*}\to {\mathcal {X}}^{*}$ by the identity ${}^{t}\!u(z)(x)=u(z(x))$. Then ${}^{t}\!u$ is continuous both in operator norm and the weak-* topology, and $\|{}^{t}\!u\|=\|u\|$.
Proof: For any $z\in {\mathcal {Y}}^{*}$

$\|{}^{t}\!u(z)\|=\sup _{\|x\|\leq 1}|(u\circ z)(x)|\leq \|u\|\|z\|$

Thus, $\|{}^{t}\!u\|\leq \|u\|$ and ${}^{t}\!u$ is continuous in operator norm. To show the opposite inequality, let $\epsilon >0$ be given. Then there is $x_{0}\in {\mathcal {X}}$ with $(1-\epsilon )\|u\|\leq |u(x_{0})|$. Using the Hahn-Banach theorem we can also find $\|z_{0}\|=1$ and $z_{0}(u(x_{0}))=|u(x_{0})|$. Hence,

$\|{}^{t}\!u\|=\sup _{\|z\|\leq 1}\|{}^{t}\!u(z)\|\geq \|{}^{t}\!u(z_{0})\|=|z_{0}(u(x))|=|u(x_{0})|\geq (1-\epsilon )\|u\|$.

We conclude $\|{}^{t}\!u\|=\|u\|$. To show weak-* continuity let $V$ be a neighborhood of $0$ in ${\mathcal {X}}^{*}$; that is, $V=\{z;z\in {\mathcal {X}}^{*},|z(x_{1})|<\epsilon ,...,|z(x_{n})|<\epsilon \}$ for some $\epsilon >0,x_{1},...,x_{n}\in {\mathcal {X}}$. If we let $y_{j}=u(x_{j})$, then

${}^{t}\!u(\{z;z\in {\mathcal {Y}}^{*},|z(y_{1})|<\epsilon ,...,|z(y_{n})|<\epsilon \})\subset V$

since $z(y_{j})={}^{t}\!u(z)(x_{j})$. This is to say, ${}^{t}\!u$ is weak-* continuous. $\square$

2 Theorem Let $T:{\mathcal {X}}\to {\mathcal {Y}}$ be a linear operator between normed spaces. Then $T$ is compact if and only if its transpose $T'$ is compact.
Proof: Let $K$ be the closure of the image of the closed unit ball under $T$. If T is compact, then K is compact. Let $y_{n}\in Y^{*}$ be a bounded sequence. Then the restrictions of $y_{n}$ to K is a bounded equicontinuous sequence in $C(K)$; thus, it has a convergent subsequence $y_{n_{k}}$ by Ascoli's theorem. Thus, $T'y_{n_{k}}(x)=y_{n_{k}}(Tx)$ is convergent for every x with $\|x\|_{\mathcal {X}}\leq 1$, and so $T'y_{n_{k}}$ is convergent. The converse follows from noting that every normed space can be embedded continuously into its second dual. (TODO: need more details.)$\square$