Signals and Systems/Probability Operations
Expected Value Operator
editThe Expected value operator is a linear operator that provides a mathematical way to determine a number of different parameters of a random distribution. The downside of course is that the expected value operator is in the form of an integral, which can be difficult to calculate.
The expected value operator will be denoted by the symbol:
![{\displaystyle \mathbb {E} [\cdot ]}](https://wikimedia.org/api/rest_v1/media/math/render/svg/86271a96e0b2cf5aa63928187db4596d27a17d43)
For a random variable X with probability density fx, the expected value is defined as:
- .
![{\displaystyle \mathbb {E} [X]=\int _{-\infty }^{\infty }xf_{X}(x)dx}](https://wikimedia.org/api/rest_v1/media/math/render/svg/13d7f8d9483189e52bd96b030adbaf6527384dbf)
provided the integral exists.
The Expectation of a signal is the result of applying the expected value operator to that signal. The expectation is another word for the mean of a signal:
![{\displaystyle \mu _{x}=\mathbb {E} [X]}](https://wikimedia.org/api/rest_v1/media/math/render/svg/326cc9c4296e1136a170dd2b8b2b334f37d67699)
Moments
editThe expected value of the N-th power of X is called the N-th moment of X or of its distribution:
- .
![{\displaystyle \mathbb {E} [X^{N}]=\int _{-\infty }^{\infty }x^{N}f_{X}(x)dx}](https://wikimedia.org/api/rest_v1/media/math/render/svg/bf40cf9e0133f434e8943866a10c654c43e6f9cc)
Some moments have special names, and each one describes a certain aspect of the distribution.
Central Moments
editOnce we know the expected value of a distribution, we know its location. We may consider all other moments relative to this location and calculate the Nth moment of the random variable X - E[X]; the result is called the Nth central moment of the distribution. Each central moment has a different meaning, and describes a different facet of the random distribution. The N-th central moment of X is:
- .
![{\displaystyle \mathbb {E} [(X-\mathbb {E} [X])^{N}]=\int _{-\infty }^{\infty }(x-\mathbb {E} [X])^{N}f_{X}(x)dx}](https://wikimedia.org/api/rest_v1/media/math/render/svg/e45c13884787f0775b9b7f97d324fef490325453)
For sake of simplicity in the notation, the first moment, the expected value is named:
- ,
![{\displaystyle \mathbb {E} [X]=\mu _{X}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/d87b8266627228b3c3e6e7a20c1bd0865f428b97)
The formula for the N-th central moment of X becomes then:
- .
![{\displaystyle \mathbb {E} [(X-\mu _{X})^{N}]=\int _{-\infty }^{\infty }(x-\mu _{X})^{N}f_{X}(x)dx}](https://wikimedia.org/api/rest_v1/media/math/render/svg/41fe613e09bcc0fd3262283524ab997990f2958d)
It is obvious that the first central moment is zero:
![{\displaystyle \mathbb {E} [(X-\mu _{X})]=0}](https://wikimedia.org/api/rest_v1/media/math/render/svg/df9573242a3e47f4831b893cdbcad240244f5b94)
The second central moment is the variance,
![{\displaystyle \mathbb {E} [(X-\mu _{X})^{2}]=\sigma ^{2}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/915384d7af72c9a4a3e9dff59c1b3aadf5ab7144)
Variance
editThe variance, the second central moment, is denoted using the symbol σx2, and is defined as:
![{\displaystyle \sigma _{x}^{2}=\mathrm {var} (X)=\mathbb {E} [X-\mathbb {E} [X]]^{2}=\mathbb {E} [X^{2}]-\mathbb {E} [X]^{2}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/d605af00c7cc6ba0110624adb6b76d1a6340c374)
Standard Deviation
editThe standard deviation of a random distribution is the square root of the variance, and is given as such:
Moment Generating Functions
editTime-Average Operator
editThe time-average operator provides a mathematical way to determine the average value of a function over a given time range. The time average operator can provide the mean value of a given signal, but most importantly it can be used to find the average value of a small sample of a given signal. The operator also allows us a useful shorthand way for taking the average, which is used in many equations.
The time average operator is denoted by angle brackets (< and >) and is defined as such:
