Ising model

The Ising model (or Lenz–Ising model), named after the physicists Ernst Ising and Wilhelm Lenz, is a mathematical model of ferromagnetism in statistical mechanics. The model consists of discrete variables that represent magnetic dipole moments of atomic "spins" that can be in one of two states (+1 or −1). The spins are arranged in a graph, usually a lattice (where the local structure repeats periodically in all directions), allowing each spin to interact with its neighbors. Neighboring spins that agree have a lower energy than those that disagree; the system tends to the lowest energy but heat disturbs this tendency, thus creating the possibility of different structural phases. The model allows the identification of phase transitions as a simplified model of reality. The two-dimensional square-lattice Ising model is one of the simplest statistical models to show a phase transition.

The Ising model was invented by the physicist Wilhelm Lenz (1920), who gave it as a problem to his student Ernst Ising. The one-dimensional Ising model was solved by Ising (1925) alone in his 1924 thesis; it has no phase transition. The two-dimensional square-lattice Ising model is much harder and was only given an analytic description much later, by Lars Onsager (1944). It is usually solved by a transfer-matrix method, although there exist different approaches, more related to quantum field theory.

In dimensions greater than four, the phase transition of the Ising model is described by mean-field theory. The Ising model for greater dimensions was also explored with respect to various tree topologies in the late 1970s, culminating in an exact solution of the zero-field, time-independent Barth (1981) model for closed Cayley trees of arbitrary branching ratio, and thereby, arbitrarily large dimensionality within tree branches. The solution to this model exhibited a new, unusual phase transition behavior, along with non-vanishing long-range and nearest-neighbor spin-spin correlations, deemed relevant to large neural networks as one of its possible applications.

The Ising problem without an external field can be equivalently formulated as a graph maximum cut (Max-Cut) problem that can be solved via combinatorial optimization.

Definition

Consider a set $\Lambda$ of lattice sites, each with a set of adjacent sites (e.g. a graph) forming a $d$-dimensional lattice. For each lattice site $k\in \Lambda$ there is a discrete variable $\sigma _{k}$ such that $\sigma _{k}\in \{-1,+1\}$, representing the site's spin. A spin configuration, ${\sigma }=\{\sigma _{k}\}_{k\in \Lambda }$ is an assignment of spin value to each lattice site.

For any two adjacent sites $i,j\in \Lambda$ there is an interaction $J_{ij}$. Also a site $j\in \Lambda$ has an external magnetic field $h_{j}$ interacting with it. The energy of a configuration ${\sigma }$ is given by the Hamiltonian function

$$H(\sigma )=-\sum _{\langle ij\rangle }J_{ij}\sigma _{i}\sigma _{j}-\mu \sum _{j}h_{j}\sigma _{j},$$

where the first sum is over pairs of adjacent spins (every pair is counted once). The notation $\langle ij\rangle$ indicates that sites $i$ and $j$ are nearest neighbors. The magnetic moment is given by $\mu$. Note that the sign in the second term of the Hamiltonian above should actually be positive because the electron's magnetic moment is antiparallel to its spin, but the negative term is used conventionally. The configuration probability is given by the Boltzmann distribution with inverse temperature $\beta \geq 0$:

$$P_{\beta }(\sigma )={\frac {e^{-\beta H(\sigma )}}{Z_{\beta }}},$$

where $\beta =1/(k_{\text{B}}T)$, and the normalization constant

$$Z_{\beta }=\sum _{\sigma }e^{-\beta H(\sigma )}$$

is the partition function. For a function $f$ of the spins ("observable"), one denotes by

$$\langle f\rangle _{\beta }=\sum _{\sigma }f(\sigma )P_{\beta }(\sigma )$$

the expectation (mean) value of $f$.

The configuration probabilities $P_{\beta }(\sigma )$ represent the probability that (in equilibrium) the system is in a state with configuration $\sigma$.

Discussion

The minus sign on each term of the Hamiltonian function $H(\sigma )$ is conventional. Using this sign convention, Ising models can be classified according to the sign of the interaction: if, for a pair i, j

• $J_{ij}>0$, the interaction is called ferromagnetic,
• $J_{ij}<0$, the interaction is called antiferromagnetic,
• $J_{ij}=0$, the spins are noninteracting.

The system is called ferromagnetic or antiferromagnetic if all interactions are ferromagnetic or all are antiferromagnetic. The original Ising models were ferromagnetic, and it is still often assumed that "Ising model" means a ferromagnetic Ising model.

In a ferromagnetic Ising model, spins desire to be aligned: the configurations in which adjacent spins are of the same sign have higher probability. In an antiferromagnetic model, adjacent spins tend to have opposite signs.

The sign convention of H(σ) also explains how a spin site j interacts with the external field. Namely, the spin site wants to line up with the external field. If:

• $h_{j}>0$, the spin site j desires to line up in the positive direction,
• $h_{j}<0$, the spin site j desires to line up in the negative direction,
• $h_{j}=0$, there is no external influence on the spin site.

Simplifications

Ising models are often examined without an external field interacting with the lattice, that is, h = 0 for all j in the lattice Λ. Using this simplification, the Hamiltonian becomes

$$H(\sigma )=-\sum _{\langle i~j\rangle }J_{ij}\sigma _{i}\sigma _{j}.$$

When the external field is zero everywhere, h = 0, the Ising model is symmetric under switching the value of the spin in all the lattice sites; a nonzero field breaks this symmetry.

Another common simplification is to assume that all of the nearest neighbors ⟨ij⟩ have the same interaction strength. Then we can set J_ij = J for all pairs i, j in Λ. In this case the Hamiltonian is further simplified to

$$H(\sigma )=-J\sum _{\langle i~j\rangle }\sigma _{i}\sigma _{j}.$$

Connection to graph maximum cut

A subset S of the vertex set V(G) of a weighted undirected graph G determines a cut of the graph G into S and its complementary subset G\S. The size of the cut is the sum of the weights of the edges between S and G\S. A maximum cut size is at least the size of any other cut, varying S.

For the Ising model without an external field on a graph G, the Hamiltonian becomes the following sum over the graph edges E(G)

$H(\sigma )=-\sum _{ij\in E(G)}J_{ij}\sigma _{i}\sigma _{j}$.

Here each vertex i of the graph is a spin site that takes a spin value $\sigma _{i}=\pm 1$. A given spin configuration $\sigma$ partitions the set of vertices $V(G)$ into two $\sigma$-depended subsets, those with spin up $V^{+}$ and those with spin down $V^{-}$. We denote by $\delta (V^{+})$ the $\sigma$-depended set of edges that connects the two complementary vertex subsets $V^{+}$ and $V^{-}$. The size $\left|\delta (V^{+})\right|$ of the cut $\delta (V^{+})$ to bipartite the weighted undirected graph G can be defined as

$$\left|\delta (V^{+})\right|={\frac {1}{2}}\sum _{ij\in \delta (V^{+})}W_{ij},$$

where $W_{ij}$ denotes a weight of the edge $ij$ and the scaling 1/2 is introduced to compensate for double counting the same weights $W_{ij}=W_{ji}$.

The identities

$${\begin{aligned}H(\sigma )&=-\sum _{ij\in E(V^{+})}J_{ij}-\sum _{ij\in E(V^{-})}J_{ij}+\sum _{ij\in \delta (V^{+})}J_{ij}\\&=-\sum _{ij\in E(G)}J_{ij}+2\sum _{ij\in \delta (V^{+})}J_{ij},\end{aligned}}$$

where the total sum in the first term does not depend on $\sigma$, imply that minimizing $H(\sigma )$ in $\sigma$ is equivalent to minimizing $\sum _{ij\in \delta (V^{+})}J_{ij}$. Defining the edge weight $W_{ij}=-J_{ij}$ thus turns the Ising problem without an external field into a graph Max-Cut problem maximizing the cut size $\left|\delta (V^{+})\right|$, which is related to the Ising Hamiltonian as follows,

$$H(\sigma )=\sum _{ij\in E(G)}W_{ij}-4\left|\delta (V^{+})\right|.$$

Questions

A significant number of statistical questions to ask about this model are in the limit of large numbers of spins:

• In a typical configuration, are most of the spins +1 or −1, or are they split equally?
• If a spin at any given position i is 1, what is the probability that the spin at position j is also 1?
• If β is changed, is there a phase transition?
• On a lattice Λ, what is the fractal dimension of the shape of a large cluster of +1 spins?

Basic properties and history

Visualization of the translation-invariant probability measure of the one-dimensional Ising model

The most studied case of the Ising model is the translation-invariant ferromagnetic zero-field model on a d-dimensional lattice, namely, Λ = Z^d, J_ij = 1, h = 0.

No phase transition in one dimension

In his 1924 PhD thesis, Ising solved the model for the d = 1 case, which can be thought of as a linear horizontal lattice where each site only interacts with its left and right neighbor. In one dimension, the solution admits no phase transition. Namely, for any positive β, the correlations ⟨σ_iσ_j⟩ decay exponentially in |i − j|: $$\langle \sigma _{i}\sigma _{j}\rangle _{\beta }\leq C\exp \left(-c(\beta )|i-j|\right),$$

and the system is disordered. On the basis of this result, he incorrectly concluded that this model does not exhibit phase behaviour in any dimension.

Phase transition and exact solution in two dimensions

The Ising model undergoes a phase transition between an ordered and a disordered phase in 2 dimensions or more. Namely, the system is disordered for small β, whereas for large β the system exhibits ferromagnetic order:

$$\langle \sigma _{i}\sigma _{j}\rangle _{\beta }\geq c(\beta )>0.$$

This was first proven by Rudolf Peierls in 1936, using what is now called a Peierls argument.

The Ising model on a two-dimensional square lattice with no magnetic field was analytically solved by Lars Onsager (1944). Onsager showed that the correlation functions and free energy of the Ising model are determined by a noninteracting lattice fermion. Onsager announced the formula for the spontaneous magnetization for the 2-dimensional model in 1949 but did not give a derivation. Yang (1952) gave the first published proof of this formula, using a limit formula for Fredholm determinants, proved in 1951 by Szegő in direct response to Onsager's work.

Correlation inequalities

A number of correlation inequalities have been derived rigorously for the Ising spin correlations (for general lattice structures), which have enabled mathematicians to study the Ising model both on and off criticality.

Griffiths inequality

Main article: Griffiths inequality

Given any subset of spins $\sigma _{A}$ and $\sigma _{B}$ on the lattice, the following inequality holds,

$$\langle \sigma _{A}\sigma _{B}\rangle \geq \langle \sigma _{A}\rangle \langle \sigma _{B}\rangle ,$$

where $\langle \sigma _{A}\rangle =\langle \prod _{j\in A}\sigma _{j}\rangle$.

With $B=\emptyset$, the special case $\langle \sigma _{A}\rangle \geq 0$ results.

This means that spins are positively correlated on the Ising ferromagnet. An immediate application of this is that the magnetization of any set of spins $\langle \sigma _{A}\rangle$ is increasing with respect to any set of coupling constants $J_{B}$.

Simon-Lieb inequality

The Simon-Lieb inequality states that for any set $S$ disconnecting $x$ from $y$ (e.g. the boundary of a box with $x$ being inside the box and $y$ being outside),

$$\langle \sigma _{x}\sigma _{y}\rangle \leq \sum _{z\in S}\langle \sigma _{x}\sigma _{z}\rangle \langle \sigma _{z}\sigma _{y}\rangle .$$

This inequality can be used to establish the sharpness of phase transition for the Ising model.

FKG inequality

Main article: FKG inequality

This inequality is proven first for a type of positively-correlated percolation model, of which includes a representation of the Ising model. It is used to determine the critical temperatures of planar Potts model using percolation arguments (which includes the Ising model as a special case).

Historical significance

One of Democritus' arguments in support of atomism was that atoms naturally explain the sharp phase boundaries observed in materials, as when ice melts to water or water turns to steam. His idea was that small changes in atomic-scale properties would lead to big changes in the aggregate behavior. Others believed that matter is inherently continuous, not atomic, and that the large-scale properties of matter are not reducible to basic atomic properties.

While the laws of chemical bonding made it clear to nineteenth century chemists that atoms were real, among physicists the debate continued well into the early twentieth century. Atomists, notably James Clerk Maxwell and Ludwig Boltzmann, applied Hamilton's formulation of Newton's laws to large systems, and found that the statistical behavior of the atoms correctly describes room temperature gases. But classical statistical mechanics did not account for all of the properties of liquids and solids, nor of gases at low temperature.

Once modern quantum mechanics was formulated, atomism was no longer in conflict with experiment, but this did not lead to a universal acceptance of statistical mechanics, which went beyond atomism. Josiah Willard Gibbs had given a complete formalism to reproduce the laws of thermodynamics from the laws of mechanics. But many faulty arguments survived from the 19th century, when statistical mechanics was considered dubious. The lapses in intuition mostly stemmed from the fact that the limit of an infinite statistical system has many zero-one laws which are absent in finite systems: an infinitesimal change in a parameter can lead to big differences in the overall, aggregate behavior, as Democritus expected.

No phase transitions in finite volume

In the early part of the twentieth century, some believed that the partition function could never describe a phase transition, based on the following argument:

1. The partition function is a sum of e^−βE over all configurations.
2. The exponential function is everywhere analytic as a function of β.
3. The sum of analytic functions is an analytic function.

This argument works for a finite sum of exponentials, and correctly establishes that there are no singularities in the free energy of a system of a finite size. For systems which are in the thermodynamic limit (that is, for infinite systems) the infinite sum can lead to singularities. The convergence to the thermodynamic limit is fast, so that the phase behavior is apparent already on a relatively small lattice, even though the singularities are smoothed out by the system's finite size.

This was first established by Rudolf Peierls in the Ising model.

Peierls droplets

Shortly after Lenz and Ising constructed the Ising model, Peierls was able to explicitly show that a phase transition occurs in two dimensions.

To do this, he compared the high-temperature and low-temperature limits. At infinite temperature (β = 0) all configurations have equal probability. Each spin is completely independent of any other, and if typical configurations at infinite temperature are plotted so that plus/minus are represented by black and white, they look like television snow. For high, but not infinite temperature, there are small correlations between neighboring positions, the snow tends to clump a little bit, but the screen stays randomly looking, and there is no net excess of black or white.

A quantitative measure of the excess is the magnetization, which is the average value of the spin:

$$M={\frac {1}{N}}\sum _{i=1}^{N}\sigma _{i}.$$

A bogus argument analogous to the argument in the last section now establishes that the magnetization in the Ising model is always zero.

1. Every configuration of spins has equal energy to the configuration with all spins flipped.
2. So for every configuration with magnetization M there is a configuration with magnetization −M with equal probability.
3. The system should therefore spend equal amounts of time in the configuration with magnetization M as with magnetization −M.
4. So the average magnetization (over all time) is zero.

As before, this only proves that the average magnetization is zero at any finite volume. For an infinite system, fluctuations might not be able to push the system from a mostly plus state to a mostly minus with a nonzero probability.

For very high temperatures, the magnetization is zero, as it is at infinite temperature. To see this, note that if spin A has only a small correlation ε with spin B, and B is only weakly correlated with C, but C is otherwise independent of A, the amount of correlation of A and C goes like ε². For two spins separated by distance L, the amount of correlation goes as ε^L, but if there is more than one path by which the correlations can travel, this amount is enhanced by the number of paths.

The number of paths of length L on a square lattice in d dimensions is $$N(L)=(2d)^{L},$$ since there are 2d choices for where to go at each step.

A bound on the total correlation is given by the contribution to the correlation by summing over all paths linking two points, which is bounded above by the sum over all paths of length L divided by $$\sum _{L}(2d)^{L}\varepsilon ^{L},$$ which goes to zero when ε is small.

At low temperatures (β ≫ 1) the configurations are near the lowest-energy configuration, the one where all the spins are plus or all the spins are minus. Peierls asked whether it is statistically possible at low temperature, starting with all the spins minus, to fluctuate to a state where most of the spins are plus. For this to happen, droplets of plus spin must be able to congeal to make the plus state.

The energy of a droplet of plus spins in a minus background is proportional to the perimeter of the droplet L, where plus spins and minus spins neighbor each other. For a droplet with perimeter L, the area is somewhere between (L − 2)/2 (the straight line) and (L/4)² (the square box). The probability cost for introducing a droplet has the factor e^−βL, but this contributes to the partition function multiplied by the total number of droplets with perimeter L, which is less than the total number of paths of length L: $$N(L)<4^{2L}.$$ So that the total spin contribution from droplets, even overcounting by allowing each site to have a separate droplet, is bounded above by $$\sum _{L}L^{2}4^{2L}e^{-4\beta L},$$

which goes to zero at large β. For β sufficiently large, this exponentially suppresses long loops, so that they cannot occur, and the magnetization never fluctuates too far from −1.

So Peierls established that the magnetization in the Ising model eventually defines superselection sectors, separated domains not linked by finite fluctuations.

Kramers–Wannier duality

Main article: Kramers–Wannier duality

Kramers and Wannier were able to show that the high-temperature expansion and the low-temperature expansion of the model are equal up to an overall rescaling of the free energy. This allowed the phase-transition point in the two-dimensional model to be determined exactly (under the assumption that there is a unique critical point).

Yang–Lee zeros

Main article: Lee–Yang theorem

After Onsager's solution, Yang and Lee investigated the way in which the partition function becomes singular as the temperature approaches the critical temperature.

Monte Carlo methods for numerical simulation

Quench of an Ising system on a two-dimensional square lattice (500 × 500) with inverse temperature β = 10, starting from a random configuration

Definitions

The Ising model can often be difficult to evaluate numerically if there are many states in the system. Consider an Ising model with

L = |Λ|: the total number of sites on the lattice,

σ_j ∈ {−1, +1}: an individual spin site on the lattice, j = 1, ..., L,

S ∈ {−1, +1}^L: state of the system.

Since every spin site has ±1 spin, there are 2^L different states that are possible. This motivates the reason for the Ising model to be simulated using Monte Carlo methods.

The Hamiltonian that is commonly used to represent the energy of the model when using Monte Carlo methods is $$H(\sigma )=-J\sum _{\langle i~j\rangle }\sigma _{i}\sigma _{j}-h\sum _{j}\sigma _{j}.$$ Furthermore, the Hamiltonian is further simplified by assuming zero external field h, since many questions that are posed to be solved using the model can be answered in absence of an external field. This leads us to the following energy equation for state σ: $$H(\sigma )=-J\sum _{\langle i~j\rangle }\sigma _{i}\sigma _{j}.$$ Given this Hamiltonian, quantities of interest such as the specific heat or the magnetization of the magnet at a given temperature can be calculated.

Metropolis algorithm

Overview

The Metropolis–Hastings algorithm is the most commonly used Monte Carlo algorithm to calculate Ising model estimations. The algorithm first chooses selection probabilities g(μ, ν), which represent the probability that state ν is selected by the algorithm out of all states, given that one is in state μ. It then uses acceptance probabilities A(μ, ν) so that detailed balance is satisfied. If the new state ν is accepted, then we move to that state and repeat with selecting a new state and deciding to accept it. If ν is not accepted then we stay in μ. This process is repeated until some stopping criterion is met, which for the Ising model is often when the lattice becomes ferromagnetic, meaning all of the sites point in the same direction.

When implementing the algorithm, one must ensure that g(μ, ν) is selected such that ergodicity is met. In thermal equilibrium a system's energy only fluctuates within a small range. This is the motivation behind the concept of single-spin-flip dynamics, which states that in each transition, we will only change one of the spin sites on the lattice. Furthermore, by using single- spin-flip dynamics, one can get from any state to any other state by flipping each site that differs between the two states one at a time.

The maximum amount of change between the energy of the present state, H_μ and any possible new state's energy H_ν (using single-spin-flip dynamics) is 2J between the spin we choose to "flip" to move to the new state and that spin's neighbor. Thus, in a 1D Ising model, where each site has two neighbors (left and right), the maximum difference in energy would be 4J.

Let c represent the lattice coordination number; the number of nearest neighbors that any lattice site has. We assume that all sites have the same number of neighbors due to periodic boundary conditions. It is important to note that the Metropolis–Hastings algorithm does not perform well around the critical point due to critical slowing down. Other techniques such as multigrid methods, Niedermayer's algorithm, Swendsen–Wang algorithm, or the Wolff algorithm are required in order to resolve the model near the critical point; a requirement for determining the critical exponents of the system.

Open-source packages implementing these algorithms are available.

Specification

Specifically for the Ising model and using single-spin-flip dynamics, one can establish the following.

Since there are L total sites on the lattice, using single-spin-flip as the only way we transition to another state, we can see that there are a total of L new states ν from our present state μ. The algorithm assumes that the selection probabilities are equal to the L states: g(μ, ν) = 1/L. Detailed balance tells us that the following equation must hold:

$${\frac {P(\mu ,\nu )}{P(\nu ,\mu )}}={\frac {g(\mu ,\nu )A(\mu ,\nu )}{g(\nu ,\mu )A(\nu ,\mu )}}={\frac {A(\mu ,\nu )}{A(\nu ,\mu )}}={\frac {P_{\beta }(\nu )}{P_{\beta }(\mu )}}={\frac {{\frac {1}{Z}}e^{-\beta (H_{\nu })}}{{\frac {1}{Z}}e^{-\beta (H_{\mu })}}}=e^{-\beta (H_{\nu }-H_{\mu })}.$$

Thus, we want to select the acceptance probability for our algorithm to satisfy $${\frac {A(\mu ,\nu )}{A(\nu ,\mu )}}=e^{-\beta (H_{\nu }-H_{\mu })}.$$

If H_ν > H_μ, then A(ν, μ) > A(μ, ν). Metropolis sets the larger of A(μ, ν) or A(ν, μ) to be 1. By this reasoning the acceptance algorithm is:

$$A(\mu ,\nu )={\begin{cases}e^{-\beta (H_{\nu }-H_{\mu })},&{\text{if }}H_{\nu }-H_{\mu }>0,\\1&{\text{otherwise}}.\end{cases}}$$

The basic form of the algorithm is as follows:

1. Pick a spin site using selection probability g(μ, ν) and calculate the contribution to the energy involving this spin.
2. Flip the value of the spin and calculate the new contribution.
3. If the new energy is less, keep the flipped value.
4. If the new energy is more, only keep with probability $e^{-\beta (H_{\nu }-H_{\mu })}.$
5. Repeat.

The change in energy H_ν − H_μ only depends on the value of the spin and its nearest graph neighbors. So if the graph is not too connected, the algorithm is fast. This process will eventually produce a pick from the distribution.

Viewing the Ising model as a Markov chain

It is possible to view the Ising model as a Markov chain, as the immediate probability P_β(ν) of transitioning to a future state ν only depends on the present state μ. The Metropolis algorithm is actually a version of a Markov chain Monte Carlo simulation, and since we use single-spin-flip dynamics in the Metropolis algorithm, every state can be viewed as having links to exactly L other states, where each transition corresponds to flipping a single spin site to the opposite value. Furthermore, since the energy equation H_σ change only depends on the nearest-neighbor interaction strength J, the Ising model and its variants such the Sznajd model can be seen as a form of a voter model for opinion dynamics.

One dimension

The thermodynamic limit exists as long as the interaction decay is $J_{ij}\sim |i-j|^{-\alpha }$ with α > 1.

• In the case of ferromagnetic interaction $J_{ij}\sim |i-j|^{-\alpha }$ with 1 < α < 2, Dyson proved, by comparison with the hierarchical case, that there is phase transition at small enough temperature.
• In the case of ferromagnetic interaction $J_{ij}\sim |i-j|^{-2}$, Fröhlich and Spencer proved that there is phase transition at small enough temperature (in contrast with the hierarchical case).
• In the case of interaction $J_{ij}\sim |i-j|^{-\alpha }$ with α > 2 (which includes the case of finite-range interactions), there is no phase transition at any positive temperature (i.e. finite β), since the free energy is analytic in the thermodynamic parameters.
• In the case of nearest neighbor interactions, E. Ising provided an exact solution of the model. At any positive temperature (i.e. finite β) the free energy is analytic in the thermodynamics parameters, and the truncated two-point spin correlation decays exponentially fast. At zero temperature (i.e. infinite β), there is a second-order phase transition: the free energy is infinite, and the truncated two-point spin correlation does not decay (remains constant). Therefore, T = 0 is the critical temperature of this case. Scaling formulas are satisfied.

Ising's exact solution

In the nearest neighbor case (with periodic or free boundary conditions) an exact solution is available. The Hamiltonian of the one-dimensional Ising model on a lattice of L sites with free boundary conditions is $$H(\sigma )=-J\sum _{i=1,\ldots ,L-1}\sigma _{i}\sigma _{i+1}-h\sum _{i}\sigma _{i},$$ where J and h can be any number, since in this simplified case J is a constant representing the interaction strength between the nearest neighbors and h is the constant external magnetic field applied to lattice sites. Then the free energy is $$f(\beta ,h)=-\lim _{L\to \infty }{\frac {1}{\beta L}}\ln Z(\beta )=-{\frac {1}{\beta }}\ln \left(e^{\beta J}\cosh \beta h+{\sqrt {e^{2\beta J}(\sinh \beta h)^{2}+e^{-2\beta J}}}\right),$$ and the spin-spin correlation (i.e. the covariance) is $$\langle \sigma _{i}\sigma _{j}\rangle -\langle \sigma _{i}\rangle \langle \sigma _{j}\rangle =C(\beta )e^{-c(\beta )|i-j|},$$ where C(β) and c(β) are positive functions for T > 0. For T → 0, though, the inverse correlation length c(β) vanishes.

Proof

The proof of this result is a simple computation.

If h = 0, it is very easy to obtain the free energy in the case of free boundary condition, i.e. when $$H(\sigma )=-J\left(\sigma _{1}\sigma _{2}+\cdots +\sigma _{L-1}\sigma _{L}\right).$$ Then the model factorizes under the change of variables $$\sigma '_{j}=\sigma _{j}\sigma _{j-1},\quad j\geq 2.$$

This gives $$Z(\beta )=\sum _{\sigma _{1},\ldots ,\sigma _{L}}e^{\beta J\sigma _{1}\sigma _{2}}e^{\beta J\sigma _{2}\sigma _{3}}\cdots e^{\beta J\sigma _{L-1}\sigma _{L}}=2\prod _{j=2}^{L}\sum _{\sigma '_{j}}e^{\beta J\sigma '_{j}}=2\left[e^{\beta J}+e^{-\beta J}\right]^{L-1}.$$

Therefore, the free energy is

$$f(\beta ,0)=-{\frac {1}{\beta }}\ln \left[e^{\beta J}+e^{-\beta J}\right].$$

With the same change of variables

$$\langle \sigma _{j}\sigma _{j+N}\rangle =\left[{\frac {e^{\beta J}-e^{-\beta J}}{e^{\beta J}+e^{-\beta J}}}\right]^{N},$$

hence it decays exponentially as soon as T ≠ 0; but for T = 0, i.e. in the limit β → ∞ there is no decay.

If h ≠ 0 we need the transfer matrix method. For the periodic boundary conditions case is the following. The partition function is $$Z(\beta )=\sum _{\sigma _{1},\ldots ,\sigma _{L}}e^{\beta h\sigma _{1}}e^{\beta J\sigma _{1}\sigma _{2}}e^{\beta h\sigma _{2}}e^{\beta J\sigma _{2}\sigma _{3}}\cdots e^{\beta h\sigma _{L}}e^{\beta J\sigma _{L}\sigma _{1}}=\sum _{\sigma _{1},\ldots ,\sigma _{L}}V_{\sigma _{1},\sigma _{2}}V_{\sigma _{2},\sigma _{3}}\cdots V_{\sigma _{L},\sigma _{1}}.$$ The coefficients $V_{\sigma ,\sigma '}$ can be seen as the entries of a matrix. There are different possible choices: a convenient one (because the matrix is symmetric) is $$V_{\sigma ,\sigma '}=e^{{\frac {\beta h}{2}}\sigma }e^{\beta J\sigma \sigma '}e^{{\frac {\beta h}{2}}\sigma '}$$ or $$V={\begin{bmatrix}e^{\beta (h+J)}&e^{-\beta J}\\e^{-\beta J}&e^{-\beta (h-J)}\end{bmatrix}}.$$ In matrix formalism $$Z(\beta )=\operatorname {Tr} \left(V^{L}\right)=\lambda _{1}^{L}+\lambda _{2}^{L}=\lambda _{1}^{L}\left[1+\left({\frac {\lambda _{2}}{\lambda _{1}}}\right)^{L}\right],$$ where λ₁ is the highest eigenvalue of V, while λ₂ is the other eigenvalue: $$\lambda _{1}=e^{\beta J}\cosh \beta h+{\sqrt {e^{2\beta J}(\sinh \beta h)^{2}+e^{-2\beta J}}},$$ and |λ₂| < λ₁. This gives the formula of the free energy.

Comments

The energy of the lowest state is −JL, when all the spins are the same. For any other configuration, the extra energy is equal to 2J times the number of sign changes that are encountered when scanning the configuration from left to right.

If we designate the number of sign changes in a configuration as k, the difference in energy from the lowest energy state is 2k. Since the energy is additive in the number of flips, the probability p of having a spin-flip at each position is independent. The ratio of the probability of finding a flip to the probability of not finding one is the Boltzmann factor:

$${\frac {p}{1-p}}=e^{-2\beta J}.$$

The problem is reduced to independent biased coin tosses. This essentially completes the mathematical description.

From the description in terms of independent tosses, the statistics of the model for long lines can be understood. The line splits into domains. Each domain is of average length exp(2β). The length of a domain is distributed exponentially, since there is a constant probability at any step of encountering a flip. The domains never become infinite, so a long system is never magnetized. Each step reduces the correlation between a spin and its neighbor by an amount proportional to p, so the correlations fall off exponentially.

$$\langle S_{i}S_{j}\rangle \propto e^{-p|i-j|}.$$

The partition function is the volume of configurations, each configuration weighted by its Boltzmann weight. Since each configuration is described by the sign-changes, the partition function factorizes:

$$Z=\sum _{\text{configs}}e^{\sum _{k}S_{k}}=\prod _{k}(1+p)=(1+p)^{L}.$$

The logarithm divided by L is the free energy density:

$$\beta f=\log(1+p)=\log \left(1+{\frac {e^{-2\beta J}}{1+e^{-2\beta J}}}\right),$$

which is analytic away from β = ∞. A sign of a phase transition is a non-analytic free energy, so the one-dimensional model does not have a phase transition.

One-dimensional solution with transverse field

To express the Ising Hamiltonian using a quantum mechanical description of spins, we replace the spin variables with their respective Pauli matrices. However, depending on the direction of the magnetic field, we can create a transverse-field or longitudinal-field Hamiltonian. The transverse-field Hamiltonian is given by

$$H(\sigma )=-J\sum _{i=1,\ldots ,L}\sigma _{i}^{z}\sigma _{i+1}^{z}-h\sum _{i}\sigma _{i}^{x}.$$

The transverse-field model experiences a phase transition between an ordered and disordered regime at J ~ h. This can be shown by a mapping of Pauli matrices

$$\sigma _{n}^{z}=\prod _{i=1}^{n}T_{i}^{x},$$

$$\sigma _{n}^{x}=T_{n}^{z}T_{n+1}^{z}.$$

Upon rewriting the Hamiltonian in terms of this change-of-basis matrices, we obtain

$$H(\sigma )=-h\sum _{i=1,\ldots ,L}T_{i}^{z}T_{i+1}^{z}-J\sum _{i}T_{i}^{x}.$$

Since the roles of h and J are switched, the Hamiltonian undergoes a transition at J = h.

Renormalization

When there is no external field, we can derive a functional equation that $f(\beta ,0)=f(\beta )$ satisfies using renormalization. Specifically, let $Z_{N}(\beta ,J)$ be the partition function with $N$ sites. Now we have:$$Z_{N}(\beta ,J)=\sum _{\sigma }e^{K\sigma _{2}(\sigma _{1}+\sigma _{3})}e^{K\sigma _{4}(\sigma _{3}+\sigma _{5})}\cdots$$where $K:=\beta J$. We sum over each of $\sigma _{2},\sigma _{4},\cdots$, to obtain$$Z_{N}(\beta ,J)=\sum _{\sigma }(2\cosh(K(\sigma _{1}+\sigma _{3})))\cdot (2\cosh(K(\sigma _{3}+\sigma _{5})))\cdots$$Now, since the cosh function is even, we can solve $Ae^{K'\sigma _{1}\sigma _{3}}=2\cosh(K(\sigma _{1}+\sigma _{3}))$ as ${\textstyle A=2{\sqrt {\cosh(2K)}},K'={\frac {1}{2}}\ln \cosh(2K)}$. Now we have a self-similarity relation:$${\frac {1}{N}}\ln Z_{N}(K)={\frac {1}{2}}\ln \left(2{\sqrt {\cosh(2K)}}\right)+{\frac {1}{2}}{\frac {1}{N/2}}\ln Z_{N/2}(K')$$Taking the limit, we obtain$$f(\beta )={\frac {1}{2}}\ln \left(2{\sqrt {\cosh(2K)}}\right)+{\frac {1}{2}}f(\beta ')$$where $\beta 'J={\frac {1}{2}}\ln \cosh(2\beta J)$.

When $\beta$ is small, we have $f(\beta )\approx \ln 2$, so we can numerically evaluate $f(\beta )$ by iterating the functional equation until $K$ is small.

Two dimensions

• In the ferromagnetic case there is a phase transition. At low temperature, the Peierls argument proves positive magnetization for the nearest neighbor case and then, by the Griffiths inequality, also when longer range interactions are added. Meanwhile, at high temperature, the cluster expansion gives analyticity of the thermodynamic functions.
• In the nearest-neighbor case, the free energy was exactly computed by Onsager, through the equivalence of the model with free fermions on lattice. The spin-spin correlation functions were computed by McCoy and Wu.

Onsager's exact solution

Main article: Square lattice Ising model

Onsager (1944) obtained the following analytical expression for the free energy of the Ising model on the anisotropic square lattice when the magnetic field $h=0$ in the thermodynamic limit as a function of temperature and the horizontal and vertical interaction energies $J_{1}$ and $J_{2}$, respectively

$$-\beta f=\ln 2+{\frac {1}{8\pi ^{2}}}\int _{0}^{2\pi }d\theta _{1}\int _{0}^{2\pi }d\theta _{2}\ln[\cosh(2\beta J_{1})\cosh(2\beta J_{2})-\sinh(2\beta J_{1})\cos(\theta _{1})-\sinh(2\beta J_{2})\cos(\theta _{2})].$$

From this expression for the free energy, all thermodynamic functions of the model can be calculated by using an appropriate derivative. The 2D Ising model was the first model to exhibit a continuous phase transition at a positive temperature. It occurs at the temperature $T_{c}$ which solves the equation

$$\sinh \left({\frac {2J_{1}}{kT_{c}}}\right)\sinh \left({\frac {2J_{2}}{kT_{c}}}\right)=1.$$

In the isotropic case when the horizontal and vertical interaction energies are equal $J_{1}=J_{2}=J$, the critical temperature $T_{c}$ occurs at the following point

$$T_{c}={\frac {2J}{k\ln(1+{\sqrt {2}})}}=(2.269185\cdots ){\frac {J}{k}}$$

When the interaction energies $J_{1}$, $J_{2}$ are both negative, the Ising model becomes an antiferromagnet. Since the square lattice is bi-partite, it is invariant under this change when the magnetic field $h=0$, so the free energy and critical temperature are the same for the antiferromagnetic case. For the triangular lattice, which is not bi-partite, the ferromagnetic and antiferromagnetic Ising model behave notably differently. Specifically, around a triangle, it is impossible to make all 3 spin-pairs antiparallel, so the antiferromagnetic Ising model cannot reach the minimal energy state. This is an example of geometric frustration.

Transfer matrix

Start with an analogy with quantum mechanics. The Ising model on a long periodic lattice has a partition function

$$\sum _{\{S\}}\exp {\biggl (}\sum _{ij}S_{i,j}\left(S_{i,j+1}+S_{i+1,j}\right){\biggr )}.$$

Think of the i direction as space, and the j direction as time. This is an independent sum over all the values that the spins can take at each time slice. This is a type of path integral, it is the sum over all spin histories.

A path integral can be rewritten as a Hamiltonian evolution. The Hamiltonian steps through time by performing a unitary rotation between time t and time t + Δt: $$U=e^{iH\Delta t}$$

The product of the U matrices, one after the other, is the total time evolution operator, which is the path integral we started with.

$$U^{N}=(e^{iH\Delta t})^{N}=\int DXe^{iL}$$

where N is the number of time slices. The sum over all paths is given by a product of matrices, each matrix element is the transition probability from one slice to the next.

Similarly, one can divide the sum over all partition function configurations into slices, where each slice is the one-dimensional configuration at time 1. This defines the transfer matrix: $$T_{C_{1}C_{2}}.$$

The configuration in each slice is a one-dimensional collection of spins. At each time slice, T has matrix elements between two configurations of spins, one in the immediate future and one in the immediate past. These two configurations are C₁ and C₂, and they are all one-dimensional spin configurations. We can think of the vector space that T acts on as all complex linear combinations of these. Using quantum mechanical notation: $$|A\rangle =\sum _{S}A(S)|S\rangle$$

where each basis vector $|S\rangle$ is a spin configuration of a one-dimensional Ising model.

Like the Hamiltonian, the transfer matrix acts on all linear combinations of states. The partition function is a matrix function of T, which is defined by the sum over all histories which come back to the original configuration after N steps: $$Z=\mathrm {tr} (T^{N}).$$

Since this is a matrix equation, it can be evaluated in any basis. So if we can diagonalize the matrix T, we can find Z.

T in terms of Pauli matrices

The contribution to the partition function for each past/future pair of configurations on a slice is the sum of two terms. There is the number of spin flips in the past slice and there is the number of spin flips between the past and future slice. Define an operator on configurations which flips the spin at site i:

$$\sigma _{i}^{x}.$$

In the usual Ising basis, acting on any linear combination of past configurations, it produces the same linear combination but with the spin at position i of each basis vector flipped.

Define a second operator which multiplies the basis vector by +1 and −1 according to the spin at position i:

$$\sigma _{i}^{z}.$$

T can be written in terms of these:

$$\sum _{i}A\sigma _{i}^{x}+B\sigma _{i}^{z}\sigma _{i+1}^{z}$$

where A and B are constants which are to be determined so as to reproduce the partition function. The interpretation is that the statistical configuration at this slice contributes according to both the number of spin flips in the slice, and whether or not the spin at position i has flipped.

Spin flip creation and annihilation operators

Just as in the one-dimensional case, we will shift attention from the spins to the spin-flips. The σ^z term in T counts the number of spin flips, which we can write in terms of spin-flip creation and annihilation operators:

$$\sum C\psi _{i}^{\dagger }\psi _{i}.\,$$

The first term flips a spin, so depending on the basis state it either:

1. moves a spin-flip one unit to the right
2. moves a spin-flip one unit to the left
3. produces two spin-flips on neighboring sites
4. destroys two spin-flips on neighboring sites.

Writing this out in terms of creation and annihilation operators: $$\sigma _{i}^{x}=D{\psi ^{\dagger }}_{i}\psi _{i+1}+D^{*}{\psi ^{\dagger }}_{i}\psi _{i-1}+C\psi _{i}\psi _{i+1}+C^{*}{\psi ^{\dagger }}_{i}{\psi ^{\dagger }}_{i+1}.$$

Ignore the constant coefficients, and focus attention on the form. They are all quadratic. Since the coefficients are constant, this means that the T matrix can be diagonalized by Fourier transforms.

Carrying out the diagonalization produces the Onsager free energy.

Onsager's formula for spontaneous magnetization

Onsager famously announced the following expression for the spontaneous magnetization M of a two-dimensional Ising ferromagnet on the square lattice at two different conferences in 1948, though without proof $$M=\left(1-\left[\sinh 2\beta J_{1}\sinh 2\beta J_{2}\right]^{-2}\right)^{\frac {1}{8}}$$ where $J_{1}$ and $J_{2}$ are horizontal and vertical interaction energies.

A complete derivation was only given in 1951 by Yang (1952) using a limiting process of transfer matrix eigenvalues. The proof was subsequently greatly simplified in 1963 by Montroll, Potts, and Ward using Szegő's limit formula for Toeplitz determinants by treating the magnetization as the limit of correlation functions.

Minimal model

Main article: Two-dimensional critical Ising model

At the critical point, the two-dimensional Ising model is a two-dimensional conformal field theory. The spin and energy correlation functions are described by a minimal model, which has been exactly solved.

Three dimensions

In three as in two dimensions, the most studied case of the Ising model is the translation-invariant model on a cubic lattice with nearest-neighbor coupling in the zero magnetic field. Many theoreticians searched for an analytical three-dimensional solution for many decades, which would be analogous to Onsager's solution in the two-dimensional case. Such a solution has not been found until now, although there is no proof that it may not exist.

In three dimensions, the Ising model was shown to have a representation in terms of non-interacting fermionic strings by Alexander Polyakov and Vladimir Dotsenko. This construction has been carried on the lattice, and the continuum limit, conjecturally describing the critical point, is unknown.

Phase transition

In three as in two dimensions, Peierls' argument shows that there is a phase transition. This phase transition is rigorously known to be continuous (in the sense that correlation length diverges and the magnetization goes to zero), and is called the critical point. It is believed that the critical point can be described by a renormalization group fixed point of the Wilson-Kadanoff renormalization group transformation. It is also believed that the phase transition can be described by a three-dimensional unitary conformal field theory, as evidenced by Monte Carlo simulations, exact diagonalization results in quantum models, and quantum field theoretical arguments. Although it is an open problem to establish rigorously the renormalization group picture or the conformal field theory picture, theoretical physicists have used these two methods to compute the critical exponents of the phase transition, which agree with the experiments and with the Monte Carlo simulations.

This conformal field theory describing the three-dimensional Ising critical point is under active investigation using the method of the conformal bootstrap. This method currently yields the most precise information about the structure of the critical theory (see Ising critical exponents).

Istrail's NP-completeness result for the general spin glass model

In 2000, Sorin Istrail of Sandia National Laboratories proved that the spin glass Ising model on a nonplanar lattice is NP-complete. That is, assuming P ≠ NP, the general spin glass Ising model is exactly solvable only in planar cases, so solutions for dimensions higher than two are also intractable. Istrail's result only concerns the spin glass model with spatially varying couplings, and tells nothing about Ising's original ferromagnetic model with equal couplings.

Four dimensions and above

In any dimension, the Ising model can be productively described by a locally varying mean field. The field is defined as the average spin value over a large region, but not so large so as to include the entire system. The field still has slow variations from point to point, as the averaging volume moves. These fluctuations in the field are described by a continuum field theory in the infinite system limit.

Local field

The field H is defined as the long wavelength Fourier components of the spin variable, in the limit that the wavelengths are long. There are many ways to take the long wavelength average, depending on the details of how high wavelengths are cut off. The details are not too important, since the goal is to find the statistics of H and not the spins. Once the correlations in H are known, the long-distance correlations between the spins will be proportional to the long-distance correlations in H.

For any value of the slowly varying field H, the free energy (log-probability) is a local analytic function of H and its gradients. The free energy F(H) is defined to be the sum over all Ising configurations which are consistent with the long wavelength field. Since H is a coarse description, there are many Ising configurations consistent with each value of H, so long as not too much exactness is required for the match.

Since the allowed range of values of the spin in any region only depends on the values of H within one averaging volume from that region, the free energy contribution from each region only depends on the value of H there and in the neighboring regions. So F is a sum over all regions of a local contribution, which only depends on H and its derivatives.

By symmetry in H, only even powers contribute. By reflection symmetry on a square lattice, only even powers of gradients contribute. Writing out the first few terms in the free energy:

$$\beta F=\int d^{d}x\left[AH^{2}+\sum _{i=1}^{d}Z_{i}(\partial _{i}H)^{2}+\lambda H^{4}+\cdots \right].$$

On a square lattice, symmetries guarantee that the coefficients Z_i of the derivative terms are all equal. But even for an anisotropic Ising model, where the Z_i's in different directions are different, the fluctuations in H are isotropic in a coordinate system where the different directions of space are rescaled.

On any lattice, the derivative term $$Z_{ij}\,\partial _{i}H\,\partial _{j}H$$ is a positive definite quadratic form, and can be used to define the metric for space. So any translationally invariant Ising model is rotationally invariant at long distances, in coordinates that make Z_ij = δ_ij. Rotational symmetry emerges spontaneously at large distances just because there aren't very many low order terms. At higher order multicritical points, this accidental symmetry is lost.

Since βF is a function of a slowly spatially varying field, the probability of any field configuration is (omitting higher-order terms):

$$P(H)\propto e^{-\int d^{d}x\left[AH^{2}+Z|\nabla H|^{2}+\lambda H^{4}\right]}=e^{-\beta F[H]}.$$

The statistical average of any product of H terms is equal to:

$$\langle H(x_{1})H(x_{2})\cdots H(x_{n})\rangle ={\int DH\,e^{-\int d^{d}x\left[AH^{2}+Z|\nabla H|^{2}+\lambda H^{4}\right]}H(x_{1})H(x_{2})\cdots H(x_{n}) \over \int DH\,e^{-\int d^{d}x\left[AH^{2}+Z|\nabla H|^{2}+\lambda H^{4}\right]}}.$$

The denominator in this expression is called the partition function:$$Z=\int DH\,e^{-\int d^{d}x\left[AH^{2}+Z|\nabla H|^{2}+\lambda H^{4}\right]}$$and the integral over all possible values of H is a statistical path integral. It integrates exp(βF) over all values of H, over all the long wavelength fourier components of the spins. F is a "Euclidean" Lagrangian for the field H. It is similar to the Lagrangian in of a scalar field in quantum field theory, the difference being that all the derivative terms enter with a positive sign, and there is no overall factor of i (thus "Euclidean").

Dimensional analysis

The form of F can be used to predict which terms are most important by dimensional analysis. Dimensional analysis is not completely straightforward, because the scaling of H needs to be determined.

In the generic case, choosing the scaling law for H is easy, since the only term that contributes is the first one,

$$F=\int d^{d}x\,AH^{2}.$$

This term is the most significant, but it gives trivial behavior. This form of the free energy is ultralocal, meaning that it is a sum of an independent contribution from each point. This is like the spin-flips in the one-dimensional Ising model. Every value of H at any point fluctuates completely independently of the value at any other point.

The scale of the field can be redefined to absorb the coefficient A, and then it is clear that A only determines the overall scale of fluctuations. The ultralocal model describes the long wavelength high temperature behavior of the Ising model, since in this limit the fluctuation averages are independent from point to point.

To find the critical point, lower the temperature. As the temperature goes down, the fluctuations in H go up because the fluctuations are more correlated. This means that the average of a large number of spins does not become small as quickly as if they were uncorrelated, because they tend to be the same. This corresponds to decreasing A in the system of units where H does not absorb A. The phase transition can only happen when the subleading terms in F can contribute, but since the first term dominates at long distances, the coefficient A must be tuned to zero. This is the location of the critical point:

$$F=\int d^{d}x\left[tH^{2}+\lambda H^{4}+Z(\nabla H)^{2}\right],$$

where t is a parameter which goes through zero at the transition.

Since t is vanishing, fixing the scale of the field using this term makes the other terms blow up. Once t is small, the scale of the field can either be set to fix the coefficient of the H⁴ term or the (∇H)² term to 1.

Magnetization

To find the magnetization, fix the scaling of H so that λ is one. Now the field H has dimension −d/4, so that H⁴d^dx is dimensionless, and Z has dimension 2 − d/2. In this scaling, the gradient term is only important at long distances for d ≤ 4. Above four dimensions, at long wavelengths, the overall magnetization is only affected by the ultralocal terms.

There is one subtle point. The field H is fluctuating statistically, and the fluctuations can shift the zero point of t. To see how, consider H⁴ split in the following way:

$$H(x)^{4}=-\langle H(x)^{2}\rangle ^{2}+2\langle H(x)^{2}\rangle H(x)^{2}+\left(H(x)^{2}-\langle H(x)^{2}\rangle \right)^{2}$$

The first term is a constant contribution to the free energy, and can be ignored. The second term is a finite shift in t. The third term is a quantity that scales to zero at long distances. This means that when analyzing the scaling of t by dimensional analysis, it is the shifted t that is important. This was historically very confusing, because the shift in t at any finite λ is finite, but near the transition t is very small. The fractional change in t is very large, and in units where t is fixed the shift looks infinite.

The magnetization is at the minimum of the free energy, and this is an analytic equation. In terms of the shifted t,

$${\partial \over \partial H}\left(tH^{2}+\lambda H^{4}\right)=2tH+4\lambda H^{3}=0$$

For t < 0, the minima are at H proportional to the square root of t. So Landau's catastrophe argument is correct in dimensions larger than 5. The magnetization exponent in dimensions higher than 5 is equal to the mean-field value.

When t is negative, the fluctuations about the new minimum are described by a new positive quadratic coefficient. Since this term always dominates, at temperatures below the transition the fluctuations again become ultralocal at long distances.

Fluctuations

To find the behavior of fluctuations, rescale the field to fix the gradient term. Then the length scaling dimension of the field is 1 − d/2. Now the field has constant quadratic spatial fluctuations at all temperatures. The scale dimension of the H² term is 2, while the scale dimension of the H⁴ term is 4 − d. For d < 4, the H⁴ term has positive scale dimension. In dimensions higher than 4 it has negative scale dimensions.

This is an essential difference. In dimensions higher than 4, fixing the scale of the gradient term means that the coefficient of the H⁴ term is less and less important at longer and longer wavelengths. The dimension at which nonquadratic contributions begin to contribute is known as the critical dimension. In the Ising model, the critical dimension is 4.

In dimensions above 4, the critical fluctuations are described by a purely quadratic free energy at long wavelengths. This means that the correlation functions are all computable from as Gaussian averages:

$$\langle S(x)S(y)\rangle \propto \langle H(x)H(y)\rangle =G(x-y)=\int {dk \over (2\pi )^{d}}{e^{ik(x-y)} \over k^{2}+t}$$

valid when x − y is large. The function G(x − y) is the analytic continuation to imaginary time of the Feynman propagator, since the free energy is the analytic continuation of the quantum field action for a free scalar field. For dimensions 5 and higher, all the other correlation functions at long distances are then determined by Wick's theorem. All the odd moments are zero, by ± symmetry. The even moments are the sum over all partition into pairs of the product of G(x − y) for each pair.

$$\langle S(x_{1})S(x_{2})\cdots S(x_{2n})\rangle =C^{n}\sum G(x_{i1},x_{j1})G(x_{i2},x_{j2})\ldots G(x_{in},x_{jn})$$

where C is the proportionality constant. So knowing G is enough. It determines all the multipoint correlations of the field.

The critical two-point function

To determine the form of G, consider that the fields in a path integral obey the classical equations of motion derived by varying the free energy:

$${\begin{aligned}&&\left(-\nabla _{x}^{2}+t\right)\langle H(x)H(y)\rangle &=0\\\rightarrow {}&&\nabla ^{2}G(x)+tG(x)&=0\end{aligned}}$$

This is valid at noncoincident points only, since the correlations of H are singular when points collide. H obeys classical equations of motion for the same reason that quantum mechanical operators obey them—its fluctuations are defined by a path integral.

At the critical point t = 0, this is Laplace's equation, which can be solved by Gauss's method from electrostatics. Define an electric field analog by

$$E=\nabla G$$

Away from the origin:

$$\nabla \cdot E=0$$

since G is spherically symmetric in d dimensions, and E is the radial gradient of G. Integrating over a large d − 1 dimensional sphere,

$$\int d^{d-1}SE_{r}=\mathrm {constant}$$

This gives:

$$E={C \over r^{d-1}}$$

and G can be found by integrating with respect to r.

$$G(r)={C \over r^{d-2}}$$

The constant C fixes the overall normalization of the field.

G(r) away from the critical point

When t does not equal zero, so that H is fluctuating at a temperature slightly away from critical, the two point function decays at long distances. The equation it obeys is altered:

$$\nabla ^{2}G+tG=0\to {1 \over r^{d-1}}{d \over dr}\left(r^{d-1}{dG \over dr}\right)+tG(r)=0$$

For r small compared with ${\sqrt {t}}$, the solution diverges exactly the same way as in the critical case, but the long distance behavior is modified.

To see how, it is convenient to represent the two point function as an integral, introduced by Schwinger in the quantum field theory context:

$$G(x)=\int d\tau {1 \over \left({\sqrt {2\pi \tau }}\right)^{d}}e^{-{x^{2} \over 4\tau }-t\tau }$$

This is G, since the Fourier transform of this integral is easy. Each fixed τ contribution is a Gaussian in x, whose Fourier transform is another Gaussian of reciprocal width in k.

$$G(k)=\int d\tau e^{-(k^{2}-t)\tau }={1 \over k^{2}-t}$$

This is the inverse of the operator ∇² − t in k-space, acting on the unit function in k-space, which is the Fourier transform of a delta function source localized at the origin. So it satisfies the same equation as G with the same boundary conditions that determine the strength of the divergence at 0.

The interpretation of the integral representation over the proper time τ is that the two point function is the sum over all random walk paths that link position 0 to position x over time τ. The density of these paths at time τ at position x is Gaussian, but the random walkers disappear at a steady rate proportional to t so that the Gaussian at time τ is diminished in height by a factor that decreases steadily exponentially. In the quantum field theory context, these are the paths of relativistically localized quanta in a formalism that follows the paths of individual particles. In the pure statistical context, these paths still appear by the mathematical correspondence with quantum fields, but their interpretation is less directly physical.

The integral representation immediately shows that G(r) is positive, since it is represented as a weighted sum of positive Gaussians. It also gives the rate of decay at large r, since the proper time for a random walk to reach position τ is r² and in this time, the Gaussian height has decayed by $e^{-t\tau }=e^{-tr^{2}}$. The decay factor appropriate for position r is therefore $e^{-{\sqrt {t}}r}$.

A heuristic approximation for G(r) is:

$$G(r)\approx {e^{-{\sqrt {t}}r} \over r^{d-2}}$$

This is not an exact form, except in three dimensions, where interactions between paths become important. The exact forms in high dimensions are variants of Bessel functions.

Symanzik polymer interpretation

The interpretation of the correlations as fixed size quanta travelling along random walks gives a way of understanding why the critical dimension of the H⁴ interaction is 4. The term H⁴ can be thought of as the square of the density of the random walkers at any point. In order for such a term to alter the finite order correlation functions, which only introduce a few new random walks into the fluctuating environment, the new paths must intersect. Otherwise, the square of the density is just proportional to the density and only shifts the H² coefficient by a constant. But the intersection probability of random walks depends on the dimension, and random walks in dimension higher than 4 do not intersect.

The fractal dimension of an ordinary random walk is 2. The number of balls of size ε required to cover the path increase as ε⁻². Two objects of fractal dimension 2 will intersect with reasonable probability only in a space of dimension 4 or less, the same condition as for a generic pair of planes. Kurt Symanzik argued that this implies that the critical Ising fluctuations in dimensions higher than 4 should be described by a free field. This argument eventually became a mathematical proof.

4 − ε dimensions – renormalization group

The Ising model in four dimensions is described by a fluctuating field, but now the fluctuations are interacting. In the polymer representation, intersections of random walks are marginally possible. In the quantum field continuation, the quanta interact.

The negative logarithm of the probability of any field configuration H is the free energy function

$$F=\int d^{4}x\left[{Z \over 2}|\nabla H|^{2}+{t \over 2}H^{2}+{\lambda \over 4!}H^{4}\right]\,$$

The numerical factors are there to simplify the equations of motion. The goal is to understand the statistical fluctuations. Like any other non-quadratic path integral, the correlation functions have a Feynman expansion as particles travelling along random walks, splitting and rejoining at vertices. The interaction strength is parametrized by the classically dimensionless quantity λ.

Although dimensional analysis shows that both λ and Z are dimensionless, this is misleading. The long wavelength statistical fluctuations are not exactly scale invariant, and only become scale invariant when the interaction strength vanishes.

The reason is that there is a cutoff used to define H, and the cutoff defines the shortest wavelength. Fluctuations of H at wavelengths near the cutoff can affect the longer-wavelength fluctuations. If the system is scaled along with the cutoff, the parameters will scale by dimensional analysis, but then comparing parameters doesn't compare behavior because the rescaled system has more modes. If the system is rescaled in such a way that the short wavelength cutoff remains fixed, the long-wavelength fluctuations are modified.

Wilson renormalization

A quick heuristic way of studying the scaling is to cut off the H wavenumbers at a point λ. Fourier modes of H with wavenumbers larger than λ are not allowed to fluctuate. A rescaling of length that make the whole system smaller increases all wavenumbers, and moves some fluctuations above the cutoff.

To restore the old cutoff, perform a partial integration over all the wavenumbers which used to be forbidden, but are now fluctuating. In Feynman diagrams, integrating over a fluctuating mode at wavenumber k links up lines carrying momentum k in a correlation function in pairs, with a factor of the inverse propagator.

Under rescaling, when the system is shrunk by a factor of (1+b), the t coefficient scales up by a factor (1+b)² by dimensional analysis. The change in t for infinitesimal b is 2bt. The other two coefficients are dimensionless and do not change at all.

The lowest order effect of integrating out can be calculated from the equations of motion:

$$\nabla ^{2}H+tH=-{\lambda \over 6}H^{3}.$$

This equation is an identity inside any correlation function away from other insertions. After integrating out the modes with Λ < k < (1+b)Λ, it will be a slightly different identity.

Since the form of the equation will be preserved, to find the change in coefficients it is sufficient to analyze the change in the H³ term. In a Feynman diagram expansion, the H³ term in a correlation function inside a correlation has three dangling lines. Joining two of them at large wavenumber k gives a change H³ with one dangling line, so proportional to H:

$$\delta H^{3}=3H\int _{\Lambda <|k|<(1+b)\Lambda }{d^{4}k \over (2\pi )^{4}}{1 \over (k^{2}+t)}$$

The factor of 3 comes from the fact that the loop can be closed in three different ways.

The integral should be split into two parts:

$$\int dk{1 \over k^{2}}-t\int dk{1 \over k^{2}(k^{2}+t)}=A\Lambda ^{2}b+Bbt$$

The first part is not proportional to t, and in the equation of motion it can be absorbed by a constant shift in t. It is caused by the fact that the H³ term has a linear part. Only the second term, which varies from t to t, contributes to the critical scaling.

This new linear term adds to the first term on the left hand side, changing t by an amount proportional to t. The total change in t is the sum of the term from dimensional analysis and this second term from operator products:

$$\delta t=\left(2-{B\lambda \over 2}\right)bt$$

So t is rescaled, but its dimension is anomalous, it is changed by an amount proportional to the value of λ.

But λ also changes. The change in λ requires considering the lines splitting and then quickly rejoining. The lowest order process is one where one of the three lines from H³ splits into three, which quickly joins with one of the other lines from the same vertex. The correction to the vertex is

$$\delta \lambda =-{3\lambda ^{2} \over 2}\int _{k}dk{1 \over (k^{2}+t)^{2}}=-{3\lambda ^{2} \over 2}b$$

The numerical factor is three times bigger because there is an extra factor of three in choosing which of the three new lines to contract. So

$$\delta \lambda =-3B\lambda ^{2}b$$

These two equations together define the renormalization group equations in four dimensions:

$${\begin{aligned}{dt \over t}&=\left(2-{B\lambda \over 2}\right)b\\{d\lambda \over \lambda }&={-3B\lambda \over 2}b\end{aligned}}$$

The coefficient B is determined by the formula $$Bb=\int _{\Lambda <|k|<(1+b)\Lambda }{d^{4}k \over (2\pi )^{4}}{1 \over k^{4}}$$

and is proportional to the area of a three-dimensional sphere of radius λ, times the width of the integration region bΛ divided by Λ⁴: $$B=(2\pi ^{2}\Lambda ^{3}){1 \over (2\pi )^{4}}{b\Lambda }{1 \over b\Lambda ^{4}}={1 \over 8\pi ^{2}}$$

In other dimensions, the constant B changes, but the same constant appears both in the t flow and in the coupling flow. The reason is that the derivative with respect to t of the closed loop with a single vertex is a closed loop with two vertices. This means that the only difference between the scaling of the coupling and the t is the combinatorial factors from joining and splitting.

Wilson–Fisher fixed point

To investigate three dimensions starting from the four-dimensional theory should be possible, because the intersection probabilities of random walks depend continuously on the dimensionality of the space. In the language of Feynman graphs, the coupling does not change very much when the dimension is changed.

The process of continuing away from dimension 4 is not completely well defined without a prescription for how to do it. The prescription is only well defined on diagrams. It replaces the Schwinger representation in dimension 4 with the Schwinger representation in dimension 4 − ε defined by: $$G(x-y)=\int d\tau {1 \over t^{d \over 2}}e^{{x^{2} \over 2\tau }+t\tau }$$

In dimension 4 − ε, the coupling λ has positive scale dimension ε, and this must be added to the flow.

$${\begin{aligned}{d\lambda \over \lambda }&=\varepsilon -3B\lambda \\{dt \over t}&=2-\lambda B\end{aligned}}$$

The coefficient B is dimension dependent, but it will cancel. The fixed point for λ is no longer zero, but at: $$\lambda ={\varepsilon \over 3B}$$ where the scale dimensions of t is altered by an amount λB = ε/3.

The magnetization exponent is altered proportionately to: $${\tfrac {1}{2}}\left(1-{\varepsilon \over 3}\right)$$

which is .333 in 3 dimensions (ε = 1) and .166 in 2 dimensions (ε = 2). This is not so far off from the measured exponent .308 and the Onsager two dimensional exponent .125.

Infinite dimensions – mean field

Main article: Mean-field theory

The behavior of an Ising model on a fully connected graph may be completely understood by mean-field theory. This type of description is appropriate to very-high-dimensional square lattices, because then each site has a very large number of neighbors.

The idea is that if each spin is connected to a large number of spins, only the average ratio of + spins to − spins is important, since the fluctuations about this mean will be small. The mean field H is the average fraction of spins which are + minus the average fraction of spins which are −. The energy cost of flipping a single spin in the mean field H is ±2JNH. It is convenient to redefine J to absorb the factor N, so that the limit N → ∞ is smooth. In terms of the new J, the energy cost for flipping a spin is ±2JH.

This energy cost gives the ratio of probability p that the spin is + to the probability 1−p that the spin is −. This ratio is the Boltzmann factor: $${p \over 1-p}=e^{2\beta JH}$$

so that $$p={1 \over 1+e^{-2\beta JH}}$$

The mean value of the spin is given by averaging 1 and −1 with the weights p and 1 − p, so the mean value is 2p − 1. But this average is the same for all spins, and is therefore equal to H. $$H=2p-1={1-e^{-2\beta JH} \over 1+e^{-2\beta JH}}=\tanh(\beta JH)$$

The solutions to this equation are the possible consistent mean fields. For βJ < 1 there is only the one solution at H = 0. For bigger values of β there are three solutions, and the solution at H = 0 is unstable.

The instability means that increasing the mean field above zero a little bit produces a statistical fraction of spins which are + which is bigger than the value of the mean field. So a mean field which fluctuates above zero will produce an even greater mean field, and will eventually settle at the stable solution. This means that for temperatures below the critical value βJ = 1 the mean-field Ising model undergoes a phase transition in the limit of large N.

Above the critical temperature, fluctuations in H are damped because the mean field restores the fluctuation to zero field. Below the critical temperature, the mean field is driven to a new equilibrium value, which is either the positive H or negative H solution to the equation.

For βJ = 1 + ε, just below the critical temperature, the value of H can be calculated from the Taylor expansion of the hyperbolic tangent: $$H=\tanh(\beta JH)\approx (1+\varepsilon )H-{(1+\varepsilon )^{3}H^{3} \over 3}$$

Dividing by H to discard the unstable solution at H = 0, the stable solutions are: $$H={\sqrt {3\varepsilon }}$$

The spontaneous magnetization H grows near the critical point as the square root of the change in temperature. This is true whenever H can be calculated from the solution of an analytic equation which is symmetric between positive and negative values, which led Landau to suspect that all Ising type phase transitions in all dimensions should follow this law.

The mean-field exponent is universal because changes in the character of solutions of analytic equations are always described by catastrophes in the Taylor series, which is a polynomial equation. By symmetry, the equation for H must only have odd powers of H on the right hand side. Changing β should only smoothly change the coefficients. The transition happens when the coefficient of H on the right hand side is 1. Near the transition: $$H={\partial (\beta F) \over \partial h}=(1+A\varepsilon )H+BH^{3}+\cdots$$

Whatever A and B are, so long as neither of them is tuned to zero, the spontaneous magnetization will grow as the square root of ε. This argument can only fail if the free energy βF is either non-analytic or non-generic at the exact β where the transition occurs.

But the spontaneous magnetization in magnetic systems and the density in gasses near the critical point are measured very accurately. The density and the magnetization in three dimensions have the same power-law dependence on the temperature near the critical point, but the behavior from experiments is: $$H\propto \varepsilon ^{0.308}$$

The exponent is also universal, since it is the same in the Ising model as in the experimental magnet and gas, but it is not equal to the mean-field value. This was a great surprise.

This is also true in two dimensions, where $$H\propto \varepsilon ^{0.125}$$

But there it was not a surprise, because it was predicted by Onsager.

Low dimensions – block spins

In three dimensions, the perturbative series from the field theory is an expansion in a coupling constant λ which is not particularly small. The effective size of the coupling at the fixed point is one over the branching factor of the particle paths, so the expansion parameter is about 1/3. In two dimensions, the perturbative expansion parameter is 2/3.

But renormalization can also be productively applied to the spins directly, without passing to an average field. Historically, this approach is due to Leo Kadanoff and predated the perturbative ε expansion.

The idea is to integrate out lattice spins iteratively, generating a flow in couplings. But now the couplings are lattice energy coefficients. The fact that a continuum description exists guarantees that this iteration will converge to a fixed point when the temperature is tuned to criticality.

Migdal–Kadanoff renormalization

Write the two-dimensional Ising model with an infinite number of possible higher order interactions. To keep spin reflection symmetry, only even powers contribute: $$E=\sum _{ij}J_{ij}S_{i}S_{j}+\sum J_{ijkl}S_{i}S_{j}S_{k}S_{l}\ldots .$$

By translation invariance, J_ij is only a function of i-j. By the accidental rotational symmetry, at large i and j its size only depends on the magnitude of the two-dimensional vector i − j. The higher order coefficients are also similarly restricted.

The renormalization iteration divides the lattice into two parts – even spins and odd spins. The odd spins live on the odd-checkerboard lattice positions, and the even ones on the even-checkerboard. When the spins are indexed by the position (i,j), the odd sites are those with i + j odd and the even sites those with i + j even, and even sites are only connected to odd sites.

The two possible values of the odd spins will be integrated out, by summing over both possible values. This will produce a new free energy function for the remaining even spins, with new adjusted couplings. The even spins are again in a lattice, with axes tilted at 45 degrees to the old ones. Unrotating the system restores the old configuration, but with new parameters. These parameters describe the interaction between spins at distances ${\textstyle {\sqrt {2}}}$ larger.

Starting from the Ising model and repeating this iteration eventually changes all the couplings. When the temperature is higher than the critical temperature, the couplings will converge to zero, since the spins at large distances are uncorrelated. But when the temperature is critical, there will be nonzero coefficients linking spins at all orders. The flow can be approximated by only considering the first few terms. This truncated flow will produce better and better approximations to the critical exponents when more terms are included.

The simplest approximation is to keep only the usual J term, and discard everything else. This will generate a flow in J, analogous to the flow in t at the fixed point of λ in the ε expansion.

To find the change in J, consider the four neighbors of an odd site. These are the only spins which interact with it. The multiplicative contribution to the partition function from the sum over the two values of the spin at the odd site is: $$e^{J(N_{+}-N_{-})}+e^{J(N_{-}-N_{+})}=2\cosh(J[N_{+}-N_{-}])$$

where N_± is the number of neighbors which are ±. Ignoring the factor of 2, the free energy contribution from this odd site is: $$F=\log(\cosh[J(N_{+}-N_{-})]).$$

This includes nearest neighbor and next-nearest neighbor interactions, as expected, but also a four-spin interaction which is to be discarded. To truncate to nearest neighbor interactions, consider that the difference in energy between all spins the same and equal numbers + and – is: $$\Delta F=\ln(\cosh[4J]).$$

From nearest neighbor couplings, the difference in energy between all spins equal and staggered spins is 8J. The difference in energy between all spins equal and nonstaggered but net zero spin is 4J. Ignoring four-spin interactions, a reasonable truncation is the average of these two energies or 6J. Since each link will contribute to two odd spins, the right value to compare with the previous one is half that: $$3J'=\ln(\cosh[4J]).$$

For small J, this quickly flows to zero coupling. Large J's flow to large couplings. The magnetization exponent is determined from the slope of the equation at the fixed point.

Variants of this method produce good numerical approximations for the critical exponents when many terms are included, in both two and three dimensions.

Applications

Magnetism

The original motivation for the model was the phenomenon of ferromagnetism. Iron is magnetic; once it is magnetized it stays magnetized for a long time compared to any atomic time.

In the 19th century, it was thought that magnetic fields are due to currents in matter, and Ampère postulated that permanent magnets are caused by permanent atomic currents. The motion of classical charged particles could not explain permanent currents though, as shown by Larmor. In order to have ferromagnetism, the atoms must have permanent magnetic moments which are not due to the motion of classical charges.

Once the electron's spin was discovered, it was clear that the magnetism should be due to a large number of electron spins all oriented in the same direction. It was natural to ask how the electrons' spins all know which direction to point in, because the electrons on one side of a magnet don't directly interact with the electrons on the other side. They can only influence their neighbors. The Ising model was designed to investigate whether a large fraction of the electron spins could be oriented in the same direction using only local forces.

Lattice gas

The Ising model can be reinterpreted as a statistical model for the motion of atoms. Since the kinetic energy depends only on momentum and not on position, while the statistics of the positions only depends on the potential energy, the thermodynamics of the gas only depends on the potential energy for each configuration of atoms.

A coarse model is to make space-time a lattice and imagine that each position either contains an atom or it doesn't. The space of configuration is that of independent bits B_i, where each bit is either 0 or 1 depending on whether the position is occupied or not. An attractive interaction reduces the energy of two nearby atoms. If the attraction is only between nearest neighbors, the energy is reduced by −4JB_iB_j for each occupied neighboring pair.

The density of the atoms can be controlled by adding a chemical potential, which is a multiplicative probability cost for adding one more atom. A multiplicative factor in probability can be reinterpreted as an additive term in the logarithm – the energy. The extra energy of a configuration with N atoms is changed by μN. The probability cost of one more atom is a factor of exp(−βμ).

So the energy of the lattice gas is: $$E=-{\frac {1}{2}}\sum _{\langle i,j\rangle }4JB_{i}B_{j}+\sum _{i}\mu B_{i}$$

Rewriting the bits in terms of spins, $B_{i}=(S_{i}+1)/2.$ $$E=-{\frac {1}{2}}\sum _{\langle i,j\rangle }JS_{i}S_{j}-{\frac {1}{2}}\sum _{i}(4J-\mu )S_{i}$$

For lattices where every site has an equal number of neighbors, this is the Ising model with a magnetic field h = (zJ − μ)/2, where z is the number of neighbors.

In biological systems, modified versions of the lattice gas model have been used to understand a range of binding behaviors. These include the binding of ligands to receptors in the cell surface, the binding of chemotaxis proteins to the flagellar motor, and the condensation of DNA.

Neuroscience

The activity of neurons in the brain can be modelled statistically. Each neuron at any time is either active + or inactive −. The active neurons are those that send an action potential down the axon in any given time window, and the inactive ones are those that do not.

Following the general approach of Jaynes, a later interpretation of Schneidman, Berry, Segev and Bialek, is that the Ising model is useful for any model of neural function, because a statistical model for neural activity should be chosen using the principle of maximum entropy. Given a collection of neurons, a statistical model which can reproduce the average firing rate for each neuron introduces a Lagrange multiplier for each neuron: $$E=-\sum _{i}h_{i}S_{i}$$ But the activity of each neuron in this model is statistically independent. To allow for pair correlations, when one neuron tends to fire (or not to fire) along with another, introduce pair-wise lagrange multipliers: $$E=-{\tfrac {1}{2}}\sum _{ij}J_{ij}S_{i}S_{j}-\sum _{i}h_{i}S_{i}$$ where $J_{ij}$ are not restricted to neighbors. Note that this generalization of Ising model is sometimes called the quadratic exponential binary distribution in statistics. This energy function only introduces probability biases for a spin having a value and for a pair of spins having the same value. Higher order correlations are unconstrained by the multipliers. An activity pattern sampled from this distribution requires the largest number of bits to store in a computer, in the most efficient coding scheme imaginable, as compared with any other distribution with the same average activity and pairwise correlations. This means that Ising models are relevant to any system which is described by bits which are as random as possible, with constraints on the pairwise correlations and the average number of 1s, which frequently occurs in both the physical and social sciences.

Spin glasses

With the Ising model the so-called spin glasses can also be described, by the usual Hamiltonian ${\textstyle H=-{\frac {1}{2}}\,\sum J_{i,k}\,S_{i}\,S_{k},}$ where the S-variables describe the Ising spins, while the J_i,k are taken from a random distribution. For spin glasses a typical distribution chooses antiferromagnetic bonds with probability p and ferromagnetic bonds with probability 1 − p (also known as the random-bond Ising model). These bonds stay fixed or "quenched" even in the presence of thermal fluctuations. When p = 0 we have the original Ising model. This system deserves interest in its own; particularly one has "non-ergodic" properties leading to strange relaxation behaviour. Much attention has been also attracted by the related bond and site dilute Ising model, especially in two dimensions, leading to intriguing critical behavior.

Artificial neural network

Main article: Hopfield network

Ising model was instrumental in the development of the Hopfield network. The original Ising model is a model for equilibrium. Roy J. Glauber in 1963 studied the Ising model evolving in time, as a process towards thermal equilibrium (Glauber dynamics), adding in the component of time. (Kaoru Nakano, 1971) and (Shun'ichi Amari, 1972), proposed to modify the weights of an Ising model by Hebbian learning rule as a model of associative memory. The same idea was published by (William A. Little, 1974), who was cited by Hopfield in his 1982 paper.

The Sherrington–Kirkpatrick model of spin glass, published in 1975, is the Hopfield network with random initialization. Sherrington and Kirkpatrick found that it is highly likely for the energy function of the SK model to have many local minima. In the 1982 paper, Hopfield applied this recently developed theory to study the Hopfield network with binary activation functions. In a 1984 paper he extended this to continuous activation functions. It became a standard model for the study of neural networks through statistical mechanics.

Sea ice

The melt pond can be modelled by the Ising model; sea ice topography data bears rather heavily on the results. The state variable is binary for a simple 2D approximation, being either water or ice.

Cayley tree topologies and large neural networks

An Open Cayley Tree or Branch with Branching Ratio = 2 and k Generations

In order to investigate an Ising model with potential relevance for large (e.g. with $10^{4}$ or $10^{5}$ interactions per node) neural nets, at the suggestion of Krizan in 1979, Barth (1981) obtained the exact analytical expression for the free energy of the Ising model on the closed Cayley tree (with an arbitrarily large branching ratio) for a zero-external magnetic field (in the thermodynamic limit) by applying the methodologies of Glasser (1970) and Jellito (1979)

$$-\beta f=\ln 2+{\frac {2\gamma }{(\gamma +1)}}\ln(\cosh J)+{\frac {\gamma (\gamma -1)}{(\gamma +1)}}\sum _{i=2}^{z}{\frac {1}{\gamma ^{i}}}\ln J_{i}(\tau )$$

A Closed Cayley Tree with Branching Ratio = 4. (Only sites for generations k, k-1, and k=1(overlapping as one row) are shown for the joined trees)

where $\gamma$ is an arbitrary branching ratio (greater than or equal to 2), $t\equiv \tanh J$, $\tau \equiv t^{2}$, $J\equiv \beta \epsilon$ (with $\epsilon$ representing the nearest-neighbor interaction energy) and there are k (→ ∞ in the thermodynamic limit) generations in each of the tree branches (forming the closed tree architecture as shown in the given closed Cayley tree diagram.) The sum in the last term can be shown to converge uniformly and rapidly (i.e. for z → ∞, it remains finite) yielding a continuous and monotonous function, establishing that, for $\gamma$ greater than or equal to 2, the free energy is a continuous function of temperature T. Further analysis of the free energy indicates that it exhibits an unusual discontinuous first derivative at the critical temperature (Krizan, Barth & Glasser (1983), Glasser & Goldberg (1983).)

The spin-spin correlation between sites (in general, m and n) on the tree was found to have a transition point when considered at the vertices (e.g. A and Ā, its reflection), their respective neighboring sites (such as B and its reflection), and between sites adjacent to the top and bottom extreme vertices of the two trees (e.g. A and B), as may be determined from $$\langle s_{m}s_{n}\rangle ={Z_{N}}^{-1}(0,T)[\cosh J]^{N_{b}}2^{N}\sum _{l=1}^{z}g_{mn}(l)t^{l}$$ where $N_{b}$ is equal to the number of bonds, $g_{mn}(l)t^{l}$ is the number of graphs counted for odd vertices with even intermediate sites (see cited methodologies and references for detailed calculations), $2^{N}$ is the multiplicity resulting from two-valued spin possibilities and the partition function ${Z_{N}}$ is derived from $\sum _{\{s\}}e^{-\beta H}$. (Note: $s_{i}$ is consistent with the referenced literature in this section and is equivalent to $S_{i}$ or $\sigma _{i}$ utilized above and in earlier sections; it is valued at $\pm 1$.) The critical temperature $T_{C}$ is given by $$T_{C}={\frac {2\epsilon }{k_{\text{B}}[\ln({\sqrt {\gamma }}+1)-\ln({\sqrt {\gamma }}-1)]}}.$$

The critical temperature for this model is only determined by the branching ratio $\gamma$ and the site-to-site interaction energy $\epsilon$, a fact which may have direct implications associated with neural structure vs. its function (in that it relates the energies of interaction and branching ratio to its transitional behavior.) For example, a relationship between the transition behavior of activities of neural networks between sleeping and wakeful states (which may correlate with a spin-spin type of phase transition) in terms of changes in neural interconnectivity ($\gamma$) and/or neighbor-to-neighbor interactions ($\epsilon$), over time, is just one possible avenue suggested for further experimental investigation into such a phenomenon. In any case, for this Ising model it was established, that “the stability of the long-range correlation increases with increasing $\gamma$ or increasing $\epsilon$.”

For this topology, the spin-spin correlation was found to be zero between the extreme vertices and the central sites at which the two trees (or branches) are joined (i.e. between A and individually C, D, or E.) This behavior is explained to be due to the fact that, as k increases, the number of links increases exponentially (between the extreme vertices) and so even though the contribution to spin correlations decrease exponentially, the correlation between sites such as the extreme vertex (A) in one tree and the extreme vertex in the joined tree (Ā) remains finite (above the critical temperature.) In addition, A and B also exhibit a non-vanishing correlation (as do their reflections) thus lending itself to, for B level sites (with A level), being considered “clusters” which tend to exhibit synchronization of firing.

Based upon a review of other classical network models as a comparison, the Ising model on a closed Cayley tree was determined to be the first classical statistical mechanical model to demonstrate both local and long-range sites with non-vanishing spin-spin correlations, while at the same time exhibiting intermediate sites with zero correlation, which indeed was a relevant matter for large neural networks at the time of its consideration. The model's behavior is also of relevance for any other divergent-convergent tree physical (or biological) system exhibiting a closed Cayley tree topology with an Ising-type of interaction. This topology should not be ignored since its behavior for Ising models has been solved exactly, and presumably nature will have found a way of taking advantage of such simple symmetries at many levels of its designs.

Barth (1981) early on noted the possibility of interrelationships between (1) the classical large neural network model (with similar coupled divergent-convergent topologies) with (2) an underlying statistical quantum mechanical model (independent of topology and with persistence in fundamental quantum states):

The most significant result obtained from the closed Cayley tree model involves the occurrence of long-range correlation in the absence of intermediate-range correlation. This result has not been demonstrated by other classical models. The failure of the classical view of impulse transmission to account for this phenomenon has been cited by numerous investigators (Ricciiardi and Umezawa, 1967, Hokkyo 1972, Stuart, Takahashi and Umezawa 1978, 1979) as significant enough to warrant radically new assumptions on a very fundamental level and have suggested the existence of quantum cooperative modes within the brain…In addition, it is interesting to note that the (modeling) of…Goldstone particles or bosons (as per Umezawa, et al)…within the brain, demonstrates the long-range correlation of quantum numbers preserved in the ground state…In the closed Cayley tree model ground states of pairs of sites, as well as the state variable of individual sites, (can) exhibit long-range correlation.

It was a natural and common belief among early neurophysicists (e.g. Umezawa, Krizan, Barth, etc.) that classical neural models (including those with statistical mechanical aspects) will one day have to be integrated with quantum physics (with quantum statistical aspects), similar perhaps to how the domain of chemistry has historically integrated itself into quantum physics via quantum chemistry.

Several additional statistical mechanical problems of interest remain to be solved for the closed Cayley tree, including the time-dependent case and the external field situation, as well as theoretical efforts aimed at understanding interrelationships with underlying quantum constituents and their physics.

See also

• ANNNI model
• Binder parameter
• Boltzmann machine
• Conformal bootstrap
• Construction of an irreducible Markov chain in the Ising model
• Geometrically frustrated magnet
• Classical Heisenberg model
• Quantum Heisenberg model
• Hopfield net
• Ising critical exponents
• J. C. Ward
• Kuramoto model
• Maximal evenness
• Order operator
• Potts model (common with Ashkin–Teller model)
• Spin models
• Square-lattice Ising model
• Swendsen–Wang algorithm
• t-J model
• Two-dimensional critical Ising model
• Wolff algorithm
• XY model
• Z N model

References

• Barth, P. F. (1981), "Cooperativity and the Transition Behavior of Large Neural Nets", Master of Science Thesis, Burlington: University of Vermont: 1–118, OCLC 8231704
• Baxter, Rodney J. (1982), Exactly solved models in statistical mechanics, London: Academic Press Inc. [Harcourt Brace Jovanovich Publishers], ISBN 978-0-12-083180-7, MR 0690578
• K. Binder (2001) [1994], "Ising model", Encyclopedia of Mathematics, EMS Press
• Brush, Stephen G. (1967). "History of the Lenz-Ising Model". Reviews of Modern Physics. 39 (4): 883–893. Bibcode:1967RvMP...39..883B. doi:10.1103/RevModPhys.39.883.
• Baierlein, R. (1999), Thermal Physics, Cambridge: Cambridge University Press, ISBN 978-0-521-59082-2
• Gallavotti, G. (1999), Statistical mechanics, Texts and Monographs in Physics, Berlin: Springer-Verlag, doi:10.1007/978-3-662-03952-6, ISBN 978-3-540-64883-3, MR 1707309
• Huang, Kerson (1987), Statistical mechanics (2nd ed.), Wiley, ISBN 978-0-471-81518-1
• Ising, E. (1925), "Beitrag zur Theorie des Ferromagnetismus", Z. Phys., 31 (1): 253–258, Bibcode:1925ZPhy...31..253I, doi:10.1007/BF02980577, S2CID 122157319
• Itzykson, Claude; Drouffe, Jean-Michel (1989), Théorie statistique des champs, Volume 1, Savoirs actuels (CNRS), EDP Sciences Editions, ISBN 978-2-86883-360-0
• Itzykson, Claude; Drouffe, Jean-Michel (1989), Statistical field theory, Volume 1: From Brownian motion to renormalization and lattice gauge theory, Cambridge University Press, ISBN 978-0-521-40805-9
• Friedli, S.; Velenik, Y. (2017). Statistical Mechanics of Lattice Systems: a Concrete Mathematical Introduction. Cambridge: Cambridge University Press. ISBN 9781107184824.
• Ross Kindermann and J. Laurie Snell (1980), Markov Random Fields and Their Applications. American Mathematical Society. ISBN 0-8218-3381-2.
• Kleinert, H (1989), Gauge Fields in Condensed Matter, Vol. I, "Superflow and Vortex Lines", pp. 1–742, Vol. II, "Stresses and Defects", pp. 743–1456, World Scientific (Singapore); Paperback ISBN 9971-5-0210-0 (also available online: Vol. I and Vol. II)
• Kleinert, H and Schulte-Frohlinde, V (2001), Critical Properties of φ⁴-Theories, World Scientific (Singapore); Paperback ISBN 981-02-4658-7 (also available online)
• Lenz, W. (1920), "Beiträge zum Verständnis der magnetischen Eigenschaften in festen Körpern", Physikalische Zeitschrift, 21: 613–615
• Barry M. McCoy and Tai Tsun Wu (1973), The Two-Dimensional Ising Model. Harvard University Press, Cambridge Massachusetts, ISBN 0-674-91440-6
• Montroll, Elliott W.; Potts, Renfrey B.; Ward, John C. (1963), "Correlations and spontaneous magnetization of the two-dimensional Ising model", Journal of Mathematical Physics, 4 (2): 308–322, Bibcode:1963JMP.....4..308M, doi:10.1063/1.1703955, ISSN 0022-2488, MR 0148406, archived from the original on 2013-01-12, retrieved 2009-10-25
• Onsager, Lars (1944), "Crystal statistics. I. A two-dimensional model with an order-disorder transition", Physical Review, Series II, 65 (3–4): 117–149, Bibcode:1944PhRv...65..117O, doi:10.1103/PhysRev.65.117, MR 0010315
• Onsager, Lars (1949), "Discussion", Supplemento al Nuovo Cimento, 6: 261
• John Palmer (2007), Planar Ising Correlations. Birkhäuser, Boston, ISBN 978-0-8176-4248-8.
• Istrail, Sorin (2000), "Statistical mechanics, three-dimensionality and NP-completeness. I. Universality of intractability for the partition function of the Ising model across non-planar surfaces (extended abstract)" (PDF), Proceedings of the Thirty-Second Annual ACM Symposium on Theory of Computing, ACM, pp. 87–96, doi:10.1145/335305.335316, ISBN 978-1581131840, MR 2114521, S2CID 7944336
• Yang, C. N. (1952), "The spontaneous magnetization of a two-dimensional Ising model", Physical Review, Series II, 85 (5): 808–816, Bibcode:1952PhRv...85..808Y, doi:10.1103/PhysRev.85.808, MR 0051740
• Glasser, M. L. (1970), "Exact Partition Function for the Two-Dimensional Ising Model", American Journal of Physics, 38 (8): 1033–1036, Bibcode:1970AmJPh..38.1033G, doi:10.1119/1.1976530
• Jellito, R. J. (1979), "The Ising Model on a Closed Cayley Tree", Physica, 99A (1): 268–280, Bibcode:1979PhyA...99..268J, doi:10.1016/0378-4371(79)90134-1
• Krizan, J. E.; Barth, P. F.; Glasser, M.L. (1983), "Exact Phase Transitions for the Ising Model on the Closed Cayley Tree", Physica, 119A, North-Holland Publishing Co.: 230–242, doi:10.1016/0378-4371(83)90157-7
• Glasser, M. L.; Goldberg, M. (1983), "The Ising model on a closed Cayley tree", Physica, 117A (2): 670–672, Bibcode:1983PhyA..117..670G, doi:10.1016/0378-4371(83)90138-3
• Süzen, Mehmet (2014), "Effective ergodicity in single-spin-flip dynamics", Physical Review E, 90 (3): 032141, arXiv:1405.4497, doi:10.1103/PhysRevE.90.032141

External links

• Ising model at The Net Advance of Physics
• Barry Arthur Cipra, "The Ising model is NP-complete", SIAM News, Vol. 33, No. 6; online edition (.pdf)
• Science World article on the Ising Model
• A dynamical 2D Ising java applet by UCSC
• A dynamical 2D Ising java applet
• A larger/more complicated 2D Ising java applet Archived 2020-11-25 at the Wayback Machine
• “I sing well-tempered” The Ising Model: A simple model for critical behavior in a system of spins by Dirk Brockman, is an interactive simulation that allows users to export the working code to a presentation slide
• Ising Model simulation by Enrique Zeleny, the Wolfram Demonstrations Project
• Phase transitions on lattices
• Three-dimensional proof for Ising Model impossible, Sandia researcher claims
• Interactive Monte Carlo simulation of the Ising, XY and Heisenberg models with 3D graphics(requires WebGL compatible browser)
• Ising Model code , image denoising example with Ising Model
• David Tong's Lecture Notes provide a good introduction
• The Cartoon Picture of Magnets That Has Transformed Science - Quanta Magazine article about Ising model
• Simulation of the 2-dimensional Ising model in Julia: https://github.com/cossio/SquareIsingModel.jl