Difference between revisions of "Inner product"

Revision as of 19:34, 10 July 2015

Definition

Given a vector space, $(V,F)$ (where $F$ is either $\mathbb{R}$ or $\mathbb{C}$ ), an inner product^[1]^[2]^[3] is a map:

$\langle\cdot,\cdot\rangle:V\times V\rightarrow\mathbb{R}$ (or sometimes $\langle\cdot,\cdot\rangle:V\times V\rightarrow\mathbb{C}$ )

Such that:

$\langle x,y\rangle = \overline{\langle y, x\rangle}$ (where the bar denotes Complex conjugate)
- Or just if the inner product is into $\mathbb{R}$
$\langle\lambda x+\mu y,z\rangle = \lambda\langle y,z\rangle + \mu\langle x,z\rangle$ ( linearity in first argument )
This may be alternatively stated as:
- $\langle\lambda x,y\rangle=\lambda\langle x,y\rangle$ and $\langle x+y,z\rangle = \langle x,z\rangle + \langle y,z\rangle$
$\langle x,x\rangle \ge 0$ but specifically:
- $\langle x,x\rangle=0\iff x=0$

Terminology

Given a vector space $X$ over either $\mathbb{R}$ or $\mathbb{C}$ , and an inner product $\langle\cdot,\cdot\rangle:X\times X\rangle F$ we call the space $(X,\langle\cdot,\cdot\rangle)$ an:

inner product space (or i.p.s for short)^[3] or sometimes a
pre-hilbert space^[3]

Properties

Notice that $\langle\cdot,\cdot\rangle$ is also linear (ish) in its second argument as:

[Expand]

$\langle x,\lambda y+\mu z\rangle =\bar{\lambda}\langle x,y\rangle+\bar{\mu}\langle x,z\rangle$

$\langle x,\lambda y+\mu z\rangle$

$=\overline{\langle \lambda y+\mu z, x\rangle}$

$=\overline{\lambda\langle y,x\rangle + \mu\langle z,x\rangle}$

$=\bar{\lambda}\overline{\langle y,x\rangle}+\bar{\mu}\overline{\langle z,x\rangle}$

$=\bar{\lambda}\langle x,y\rangle+\bar{\mu}\langle x,z\rangle$

As required.

From this we may conclude the following:

$\langle x,\lambda y\rangle = \bar{\lambda}\langle x,y\rangle$ and
$\langle x,y+z\rangle = \langle x,y\rangle + \langle x,z\rangle$

This leads to the most general form:

[Expand]

$\langle au+bv,cx+dy\rangle=a\overline{c}\langle u,x\rangle+a\overline{d}\langle u,y\rangle+b\overline{c}\langle v,x\rangle+b\overline{d}\langle v,y\rangle$ - which isn't worth remembering!

Proof:

$\langle au+bv,cx+dy\rangle$

$=a\langle u,cx+dy\rangle+b\langle v,cx+dy\rangle$

$=a\overline{\langle cx+dy,u\rangle}+b\overline{\langle cx+dy,v\rangle}$

$=a(\overline{c\langle x,u\rangle} + \overline{d\langle y,u\rangle})+b(\overline{c\langle x,v\rangle}+\overline{d\langle y,v\rangle})$

$=a\overline{c}\langle u,x\rangle+a\overline{d}\langle u,y\rangle+b\overline{c}\langle v,x\rangle+b\overline{d}\langle v,y\rangle$

As required

Notation

Typically, $\langle\cdot,\cdot\rangle$ is the notation for inner products, however I have seen some authors use $\langle a,b\rangle$ to denote the ordered pair containing $a$ and $b$ . Also, notably^[3] use $(\cdot,\cdot)$ for an inner product (and $\langle\cdot,\cdot\rangle$ for an ordered pair!)

Immediate theorems

Here $\langle\cdot,\cdot\rangle:X\times X\rightarrow \mathbb{C}$ is an inner product

[Expand]
Theorem: if $\forall x\in X[\langle x,y\rangle=0]$ then $y=0$

Suppose that

$y\ne 0$ , then by hypothesis:

$\forall x\in X[\langle x,y\rangle =0]$

Specifically that means for

$y\in X$ we have

$\langle y,y\rangle=0$

Of course by definition, ⟨y,y⟩≥0 for ∀y∈X, and specifically
- $\langle x,x\rangle = 0\iff x=0$

So we have

$\langle y,y\rangle =0$ contradicting that

$y\ne 0$

We conclude that if $\forall x\in X[\langle x,y\rangle=0]$ then we must have $y=0$
(As required)

Norm induced by

Given an inner product space (X,⟨⋅,⋅⟩) we can define a norm as follows^[3]:
- $\forall x\in X$ the inner product induces the norm $\Vert x\Vert:=\sqrt{\langle x,x\rangle}$

TODO: Find out what this is called, eg compared to the metric induced by a norm

Examples

Vector dot product

References

Jump up ↑ http://en.wikipedia.org/w/index.php?title=Inner_product_space&oldid=651022885
Jump up ↑ Functional Analysis I - Lecture Notes - Richard Sharp - Sep 2014
↑ ^{Jump up to: 3.0} ^3.1 ^3.2 ^3.3 ^3.4 Functional Analysis - George Bachman and Lawrence Narici

[1] Jump up ↑ http://en.wikipedia.org/w/index.php?title=Inner_product_space&oldid=651022885

[2] Jump up ↑ Functional Analysis I - Lecture Notes - Richard Sharp - Sep 2014

[FA-3] {Jump up to: 3.0} ^3.1 ^3.2 ^3.3 ^3.4 Functional Analysis - George Bachman and Lawrence Narici

[1]

[2]

[3]

@@ Line 10: / Line 10: @@
 * <math>\langle x,x\rangle \ge 0</math> but specifically:
 ** <math>\langle x,x\rangle=0\iff x=0</math>
+==Terminology==
+Given a vector space {{M|X}} over either {{M|\mathbb{R} }} or {{M|\mathbb{C} }}, and an inner product {{M|\langle\cdot,\cdot\rangle:X\times X\rangle F}} we call the space {{M|(X,\langle\cdot,\cdot\rangle)}} an:
+* ''inner product space'' (or ''i.p.s'' for short)<ref name="FA"/> or sometimes a
+* ''pre-[[Hilbert space|hilbert]] space''<ref name="FA"/>
 ==Properties==
 Notice that <math>\langle\cdot,\cdot\rangle</math> is also linear (ish) in its second argument as:
@@ Line 40: / Line 43: @@
 ==Notation==
 Typically, {{M|\langle\cdot,\cdot\rangle}} is the notation for inner products, however I have seen some authors use {{M|\langle a,b\rangle}} to denote the [[Ordered pair|ordered pair]] containing {{M|a}} and {{M|b}}. Also, notably<ref name="FA"/> use {{M|(\cdot,\cdot)}} for an inner product (and {{M|\langle\cdot,\cdot\rangle}} for an ordered pair!)
+==Immediate theorems==
+Here {{M|\langle\cdot,\cdot\rangle:X\times X\rightarrow \mathbb{C} }} is an ''inner product''
+{{Begin Theorem}}
+'''Theorem: ''' if {{M|1=\forall x\in X[\langle x,y\rangle=0]}} then {{M|1=y=0}}
+{{Begin Proof}}
+: Suppose that {{M|y\ne 0}}, then {{M|\forall x\in X[\langle x,y\rangle=0]}} by hypothesis:
+:* {{M|1=\forall x\in X[\langle x,y\rangle =0]}}
+: Specifically that means for {{M|y\in X}} we have {{M|1=\langle y,y\rangle=0}}
+:* Of course by definition, {{M|\langle y,y\rangle\ge 0}} for {{M|\forall y\in X}}, and specifically
+:** {{M|1=\langle x,x\rangle = 0\iff x=0}}
+: So we have {{M|1=\langle y,y\rangle =0}} '''contradicting''' that {{M|y\ne 0}}
+* We conclude that if {{M|1=\forall x\in X[\langle x,y\rangle=0]}} then we must have {{M|1=y=0}}
+*: (As required)
+{{End Proof}}{{End Theorem}}
+==Norm induced by==
+* Given an ''inner product space'' {{M|(X,\langle\cdot,\cdot\rangle)}} we can define a [[Norm|norm]] as follows<ref name="FA"/>:
+** {{M|1=\forall x\in X}} the inner product induces the norm {{M|1=\Vert x\Vert:=\sqrt{\langle x,x\rangle} }}
+{{Todo|Find out what this is called, eg compared to the [[Norm#Induced metric|metric induced by a norm]]}}
 ==Examples==
 * [[Vector dot product]]

Difference between revisions of "Inner product"

Revision as of 19:34, 10 July 2015

Contents

Definition

Terminology

Properties

Notation

Immediate theorems

Norm induced by

Examples

See also

References

Navigation menu

Views

Personal tools

Navigation

Search

Tools