User:Jclaer/Jensen
Inequality measurement
[edit]Inequality within a population has many definitions. Diverse people would like to manipulate it.
An economist might measure people's income inequality and propose policies to change it. But how should inequality be measured?
A well log analyst visualizes the earth as layers of distinct composition. At any depth there should be no reflectivity except where there is a change from one material to another. Instrumental parameters are adjusted to achieve a population of many small values (interior to a rock type) and a few large ones (at rock transitions).
Physicists and chemists seek to characterize equilibrium within an isolated volume. The material in the volume is viewed as a population. The presence of energy causes fluctuations. With time these fluctuations are distributed more uniformly as inequality within the population is minimized. The concept of entropy is associated (negatively) with inequality within the population. Maximizing entropy is associated with driving the population towards uniformity and the volume to equilibrium.
Examples of averages
[edit]Start with two positive numbers, x and y, and with two kinds of average, the arithmetic mean A and the geometric mean G.
If the values x and y are equal, then the two means A and G are equal. Otherwise G ≤ A. In other words, the product of square roots of two values is smaller than half the sum of the values. We could define inequality by the ratio 0 ≤ G/A ≤ 1, but that's only one of very many possible definitions. There are many more ways to define averages and many more ratios to chose from. Here are some averages for positive numbers:
The harmonic mean H is a good way to average velocities.
These various means have inequalities among them
Population inequality could be measured by the ratio of any mean to any larger one. But wait! There are still more possibilities.
An inequality can be based on any convex function
[edit]Let f be a function with a positive second derivative. Such a function is called "convex" and satisfies the inequality
This equation relates a function of an average to an average of the function. The average can be weighted, for example,
This is made clear by a graphical illustration (for the convex function ).
![](http://upload.wikimedia.org/wikipedia/en/thumb/a/a8/Jclaer.pvi.jen.Jen.png/700px-Jclaer.pvi.jen.Jen.png)
There is nothing special about , except that it is convex. Given three numbers a, b, and c, the inequality can first be applied to a and b; to the sum c can be included. Thus, recursively, an inequality for two numbers can build up a weighted average of three or more numbers. Define weights that are normalized . The result is known as the Jensen inequality.
If the are all identical, then comes out of the summations; the two parts of S are the same, and S vanishes. If you had a procedure to drive S to zero, then you would be driving all the to be identical. The populist politician claims to intend to drive S to zero, but how should he define S?
Examples of Jensen inequalities
[edit]The most familiar example of a Jensen inequality occurs when the weights are all equal to 1/N and the convex function is . In this case the Jensen inequality gives the familiar result that the mean square exceeds the square of the mean:
When the population consists of positive members pi the function f(p) need have a positive second derivative only for positive values of p. The function f(p)=1/p yields a Jensen inequality for the harmonic mean:
A more important case is the geometric inequality. Here , and
The more familiar form of the geometric inequality results from exponentiation and a choice of weights equal to 1/N:
The basic equation of statistical mechanics
[edit]An important inequality in statistical mechanics, information theory, and thermodynamics is the one based on
- ,
where is a small positive number tending to zero. This is a convex function, but just barely so.
Some algebraic steps [1] lead to
We can now define a positive variable S' with or without the positive scaling factor :
These equations resemble those of Relative entropy.
Here find additional speculations on what convex function should be used in data analysis.
References
[edit]- ^ Claerbout, J. F., 1992, Earth Soundings Analysis: Processing Versus Inversion: Blackwell Science. ISBN 0865422109. http://sep.stanford.edu/sep/prof/toc_html/toc_html/pvi/jen/paper_html/node1.html