FKG inequality

In mathematics, the Fortuin–Kasteleyn–Ginibre (FKG) inequality is a correlation inequality, a fundamental tool in statistical mechanics and probabilistic combinatorics (especially random graphs and the probabilistic method), due to Cees M. Fortuin, Pieter W. Kasteleyn, and Jean Ginibre (1971). Informally, it says that in many random systems, increasing events are positively correlated, while an increasing and a decreasing event are negatively correlated. It was obtained by studying the random cluster model.

An earlier version, for the special case of i.i.d. variables, called Harris inequality, is due to Theodore Edward Harris (1960), see below. One generalization of the FKG inequality is the Holley inequality (1974) below, and an even further generalization is the Ahlswede–Daykin "four functions" theorem (1978). Furthermore, it has the same conclusion as the Griffiths inequalities, but the hypotheses are different.

The inequality

Let $X$ be a finite distributive lattice, and μ a nonnegative function on it, that is assumed to satisfy the (FKG) lattice condition (sometimes a function satisfying this condition is called log supermodular) i.e.,

$\mu (x\wedge y)\mu (x\vee y)\geq \mu (x)\mu (y)$

for all x, y in the lattice $X$.

The FKG inequality then says that for any two monotonically increasing functions ƒ and g on $X$, the following positive correlation inequality holds:

$\left(\sum _{x\in X}f(x)g(x)\mu (x)\right)\left(\sum _{x\in X}\mu (x)\right)\geq \left(\sum _{x\in X}f(x)\mu (x)\right)\left(\sum _{x\in X}g(x)\mu (x)\right).$

The same inequality (positive correlation) is true when both ƒ and g are decreasing. If one is increasing and the other is decreasing, then they are negatively correlated and the above inequality is reversed.

Similar statements hold more generally, when $X$ is not necessarily finite, not even countable. In that case, μ has to be a finite measure, and the lattice condition has to be defined using cylinder events; see, e.g., Section 2.2 of Grimmett (1999).

For proofs, see Fortuin, Kasteleyn & Ginibre (1971) or the Ahlswede–Daykin inequality (1978). Also, a rough sketch is given below, due to Holley (1974), using a Markov chain coupling argument.

Variations on terminology

The lattice condition for μ is also called multivariate total positivity, and sometimes the strong FKG condition; the term (multiplicative) FKG condition is also used in older literature.

The property of μ that increasing functions are positively correlated is also called having positive associations, or the weak FKG condition.

Thus, the FKG theorem can be rephrased as "the strong FKG condition implies the weak FKG condition".

Probabilistic Version

Let $X$ be a random variable and let $g,f$ be real-valued and nondecreasing functions, then

$E[f(X)g(X)]\geq E[f(X)]E[g(X)]$

Proof: Let $X_{1},X_{2}$ be independent copies of $X$, and note that from our hypothesis we have that

$(g(X_{1})-g(X_{2}))(f(X_{1})-f(X_{2}))\geq 0.$

Taking expected value and factoring concludes the proof.

A special case: the Harris inequality

If the lattice $X$ is totally ordered, then the lattice condition is satisfied trivially for any measure μ. In case the measure μ is uniform, the FKG inequality is Chebyshev's sum inequality: if the two increasing functions take on values $a_{1}\leq a_{2}\leq \cdots \leq a_{n}$ and $b_{1}\leq b_{2}\leq \cdots \leq b_{n}$, then

${\frac {a_{1}b_{1}+\cdots +a_{n}b_{n}}{n}}\geq {\frac {a_{1}+\cdots +a_{n}}{n}}\;{\frac {b_{1}+\cdots +b_{n}}{n}}.$

More generally, for any probability measure μ on $\mathbb {R}$ and increasing functions ƒ and g,

$\int _{\mathbb {R} }f(x)g(x)\,d\mu (x)\geq \int _{\mathbb {R} }f(x)\,d\mu (x)\,\int _{\mathbb {R} }g(x)\,d\mu (x),$

which follows immediately from

$\int _{\mathbb {R} }\int _{\mathbb {R} }[f(x)-f(y)][g(x)-g(y)]\,d\mu (x)\,d\mu (y)\geq 0.$

The lattice condition is trivially satisfied also when the lattice is the product of totally ordered lattices, $X=X_{1}\times \cdots \times X_{n}$, and $\mu =\mu _{1}\otimes \cdots \otimes \mu _{n}$ is a product measure. Often all the factors (both the lattices and the measures) are identical, i.e., μ is the probability distribution of i.i.d. random variables.

The FKG inequality for the case of a product measure is known also as the Harris inequality after Harris (Harris 1960), who found and used it in his study of percolation in the plane. A proof of the Harris inequality that uses the above double integral trick on $\mathbb {R}$ can be found, e.g., in Section 2.2 of Grimmett (1999).

Simple examples

A typical example is the following. Color each hexagon of the infinite honeycomb lattice black with probability $p$ and white with probability $1-p$, independently of each other. Let a, b, c, d be four hexagons, not necessarily distinct. Let $a\leftrightarrow b$ and $c\leftrightarrow d$ be the events that there is a black path from a to b, and a black path from c to d, respectively. Then the Harris inequality says that these events are positively correlated: $\Pr(a\leftrightarrow b,\ c\leftrightarrow d)\geq \Pr(a\leftrightarrow b)\Pr(c\leftrightarrow d)$. In other words, assuming the presence of one path can only increase the probability of the other.

Similarly, if we randomly color the hexagons inside an $n\times n$ rhombus-shaped hex board, then the events that there is black crossing from the left side of the board to the right side is positively correlated with having a black crossing from the top side to the bottom. On the other hand, having a left-to-right black crossing is negatively correlated with having a top-to-bottom white crossing, since the first is an increasing event (in the amount of blackness), while the second is decreasing. In fact, in any coloring of the hex board exactly one of these two events happen — this is why hex is a well-defined game.

In the Erdős–Rényi random graph, the existence of a Hamiltonian cycle is negatively correlated with the 3-colorability of the graph, since the first is an increasing event, while the latter is decreasing.

Examples from statistical mechanics

In statistical mechanics, the usual source of measures that satisfy the lattice condition (and hence the FKG inequality) is the following:

If $S$ is an ordered set (such as $\{-1,+1\}$), and $\Gamma$ is a finite or infinite graph, then the set $S^{\Gamma }$ of $S$-valued configurations is a poset that is a distributive lattice.

Now, if $\Phi$ is a submodular potential (i.e., a family of functions

$\Phi _{\Lambda }:S^{\Lambda }\longrightarrow \mathbb {R} \cup \{\infty \},$

one for each finite $\Lambda \subset \Gamma$, such that each $\Phi _{\Lambda }$ is submodular), then one defines the corresponding Hamiltonians as

$H_{\Lambda }(\varphi ):=\sum _{\Delta \cap \Lambda \not =\emptyset }\Phi _{\Delta }(\varphi ).$

If μ is an extremal Gibbs measure for this Hamiltonian on the set of configurations $\varphi$, then it is easy to show that μ satisfies the lattice condition, see Sheffield (2005).

A key example is the Ising model on a graph $\Gamma$. Let $S=\{-1,+1\}$, called spins, and $\beta \in [0,\infty ]$. Take the following potential:

$\Phi _{\Lambda }(\varphi )={\begin{cases}\beta 1_{\{\varphi (x)\not =\varphi (y)\}}&{\text{if }}\Lambda =\{x,y\}{\text{ is a pair of adjacent vertices of }}\Gamma ;\\0&{\text{otherwise.}}\end{cases}}$

Submodularity is easy to check; intuitively, taking the min or the max of two configurations tends to decrease the number of disagreeing spins. Then, depending on the graph $\Gamma$ and the value of $\beta$, there could be one or more extremal Gibbs measures, see, e.g., Georgii, Häggström & Maes (2001) and Lyons (2000).

A generalization: the Holley inequality

The Holley inequality, due to Richard Holley (1974), states that the expectations

$\langle f\rangle _{i}={\frac {\sum _{x\in X}f(x)\mu _{i}(x)}{\sum _{x\in X}\mu _{i}(x)}}$

of a monotonically increasing function ƒ on a finite distributive lattice $X$ with respect to two positive functions μ₁, μ₂ on the lattice satisfy the condition

$\langle f\rangle _{1}\geq \langle f\rangle _{2},$

provided the functions satisfy the Holley condition (criterion)

$\mu _{2}(x\wedge y)\mu _{1}(x\vee y)\geq \mu _{1}(x)\mu _{2}(y)$

for all x, y in the lattice.

To recover the FKG inequality: If μ satisfies the lattice condition and ƒ and g are increasing functions on $X$, then μ₁(x) = g(x)μ(x) and μ₂(x) = μ(x) will satisfy the lattice-type condition of the Holley inequality. Then the Holley inequality states that

${\frac {\langle fg\rangle _{\mu }}{\langle g\rangle _{\mu }}}=\langle f\rangle _{1}\geq \langle f\rangle _{2}=\langle f\rangle _{\mu },$

which is just the FKG inequality.

As for FKG, the Holley inequality follows from the Ahlswede–Daykin inequality.

Weakening the lattice condition: monotonicity

Consider the usual case of $X$ being a product $\mathbb {R} ^{V}$ for some finite set $V$. The lattice condition on μ is easily seen to imply the following monotonicity, which has the virtue that it is often easier to check than the lattice condition:

Whenever one fixes a vertex $v\in V$ and two configurations φ and ψ outside v such that $\varphi (w)\geq \psi (w)$ for all $w\not =v$, the μ-conditional distribution of φ(v) given $\{\varphi (w):w\not =v\}$ stochastically dominates the μ-conditional distribution of ψ(v) given $\{\psi (w):w\not =v\}$.

Now, if μ satisfies this monotonicity property, that is already enough for the FKG inequality (positive associations) to hold.

Here is a rough sketch of the proof, due to Holley (1974): starting from any initial configuration on $V$, one can run a simple Markov chain (the Metropolis algorithm) that uses independent Uniform[0,1] random variables to update the configuration in each step, such that the chain has a unique stationary measure, the given μ. The monotonicity of μ implies that the configuration at each step is a monotone function of independent variables, hence the product measure version of Harris implies that it has positive associations. Therefore, the limiting stationary measure μ also has this property.

The monotonicity property has a natural version for two measures, saying that μ₁ conditionally pointwise dominates μ₂. It is again easy to see that if μ₁ and μ₂ satisfy the lattice-type condition of the Holley inequality, then μ₁ conditionally pointwise dominates μ₂. On the other hand, a Markov chain coupling argument similar to the above, but now without invoking the Harris inequality, shows that conditional pointwise domination, in fact, implies stochastically domination. Stochastic domination is equivalent to saying that $\langle f\rangle _{1}\geq \langle f\rangle _{2}$ for all increasing ƒ, thus we get a proof of the Holley inequality. (And thus also a proof of the FKG inequality, without using the Harris inequality.)

See Holley (1974) and Georgii, Häggström & Maes (2001) for details.

See also

• Ahlswede–Daykin inequality
• XYZ inequality
• BK inequality

References

• Eaton, Morris L. (1987), "The FKG inequality and association", Lectures on Topics in Probability Inequalities, Amsterdam, pp. 111–151, ISBN 90-6196-316-8{{citation}}: CS1 maint: location missing publisher (link)
• Fishburn, P.C. (2001) [1994], "FKG inequality", Encyclopedia of Mathematics, EMS Press
• Fortuin, C. M.; Kasteleyn, P. W.; Ginibre, J. (1971), "Correlation inequalities on some partially ordered sets", Communications in Mathematical Physics, 22 (2): 89–103, Bibcode:1971CMaPh..22...89F, doi:10.1007/BF01651330, MR 0309498, S2CID 1011815
• Friedli, S.; Velenik, Y. (2017). Statistical Mechanics of Lattice Systems: a Concrete Mathematical Introduction. Cambridge: Cambridge University Press. ISBN 9781107184824.
• Georgii, H-O.; Häggström, O.; Maes, C. (2001), "The random geometry of equilibrium phases", Phase Transitions and Critical Phenomena, vol. 18, Academic Press, San Diego, CA, pp. 1–142, arXiv:math/9905031, doi:10.1016/S1062-7901(01)80008-2, ISBN 9780122203183, MR 2014387, S2CID 119137791
• Grimmett, G. R. (1999), Percolation. Second edition, Grundlehren der mathematischen Wissenschaften, vol. 321, Springer-Verlag, doi:10.1007/978-3-662-03981-6, ISBN 3-540-64902-6, MR 1707339
• Harris, T. E. (1960), "A lower bound for the critical probability in a certain percolation process", Mathematical Proceedings of the Cambridge Philosophical Society, 56 (1): 13–20, Bibcode:1960PCPS...56...13H, doi:10.1017/S0305004100034241, MR 0115221, S2CID 122724783
• Holley, R. (1974), "Remarks on the FKG inequalities", Communications in Mathematical Physics, 36 (3): 227–231, Bibcode:1974CMaPh..36..227H, doi:10.1007/BF01645980, MR 0341552, S2CID 73649690
• Lyons, R. (2000), "Phase transitions on nonamenable graphs", J. Math. Phys., 41 (3): 1099–1126, arXiv:math/9908177, Bibcode:2000JMP....41.1099L, doi:10.1063/1.533179, MR 1757952, S2CID 10350129
• Sheffield, S. (2005), "Random surfaces", Astérisque, 304, arXiv:math/0304049, Bibcode:2003math......4049S, MR 2251117