Spectrum of a sentence

In mathematical logic, the spectrum of a sentence is the set of natural numbers occurring as the size of a finite model in which a given sentence is true. By a result in descriptive complexity, a set of natural numbers is a spectrum if and only if it can be recognized in non-deterministic exponential time.

Definition

Let ψ be a sentence in first-order logic. The spectrum of ψ is the set of natural numbers n such that there is a finite model for ψ with n elements.

If the vocabulary for ψ consists only of relational symbols, then ψ can be regarded as a sentence in existential second-order logic (ESOL) quantified over the relations, over the empty vocabulary. A generalised spectrum is the set of models of a general ESOL sentence.

Examples

• The sentence $\psi _{n}\equiv \exists x_{1}\ldots \exists x_{n}\forall y(y=x_{1}\lor \ldots \lor y=x_{n})$ expresses "there are at most $n$ things". Thus ${\text{Spec}}(\psi _{n})=\mathbb {N} _{\leq n}$.
• $\neg \psi _{n}$ expresses "there are more than $n$ things". Thus ${\text{Spec}}(\neg \psi _{n})=\mathbb {N} _{>n}$.
• $\psi _{n}\land \neg \psi _{n-1}$ expresses "there are exactly $n$ things". Thus ${\text{Spec}}(\psi _{n}\land \neg \psi _{n-1})=\{n\}$.
• The spectrum of the first-order formula

$\exists z,o~\forall a,b,c~\exists d,e$

$a+z=a=z+a~\land ~a\cdot z=z=z\cdot a~\land ~a+d=z$

$\land ~a+b=b+a~\land ~a\cdot (b+c)=a\cdot b+a\cdot c~\land ~(a+b)+c=a+(b+c)$

$\land ~a\cdot o=a=o\cdot a~\land ~a\cdot e=o~\land ~(a\cdot b)\cdot c=a\cdot (b\cdot c)$

is $\{p^{n}\mid p{\text{ prime}},n\in \mathbb {N} \}$, the set of powers of a prime number. Indeed, with $z$ for $0$ and $o$ for $1$, this sentence describes the set of fields; the cardinality of a finite field is the power of a prime number.

• The spectrum of the monadic second-order logic formula $\exists S,T~\forall x~\left\{x\in S\iff x\not \in T\land ~f(f(x))=x\land ~x\in S\iff f(x)\in T\right\}$ is the set of even numbers. Indeed, $f$ is a bijection between $S$ and $T$, and $S$ and $T$ are a partition of the universe. Hence the cardinality of the universe is even.
• The set of finite and co-finite sets is the set of spectra of first-order logic with the successor relation.
• The set of ultimately periodic sets is the set of spectra of monadic second-order logic with a unary function. It is also the set of spectra of monadic second-order logic with the successor function.

Descriptive complexity

Fagin's theorem is a result in descriptive complexity theory that states that the set of all properties expressible in existential second-order logic is precisely the complexity class NP. It is remarkable since it is a characterization of the class NP that does not invoke a model of computation such as a Turing machine. The theorem was proven by Ronald Fagin in 1974 (strictly, in 1973 in his doctoral thesis).

As a corollary, Jones and Selman showed that a set is a spectrum if and only if it is in the complexity class NEXP.

One direction of the proof is to show that, for every first-order formula $\varphi$, the problem of determining whether there is a model of the formula of cardinality n is equivalent to the problem of satisfying a formula of size polynomial in n, which is in NP(n) and thus in NEXP of the input to the problem (the number n in binary form, which is a string of size log(n)).

This is done by replacing every existential quantifier in $\varphi$ with disjunction over all the elements in the model and replacing every universal quantifier with conjunction over all the elements in the model. Now every predicate is on elements in the model, and finally every appearance of a predicate on specific elements is replaced by a new propositional variable. Equalities are replaced by their truth values according to their assignments.

For example:

$\forall {x}\forall {y}\left(P(x)\wedge P(y)\right)\rightarrow (x=y)$

For a model of cardinality 2 (i.e. n= 2) is replaced by

${\big (}\left(P(a_{1})\wedge P(a_{1})\right)\rightarrow (a_{1}=a_{1}){\big )}\wedge {\big (}\left(P(a_{1})\wedge P(a_{2})\right)\rightarrow (a_{1}=a_{2}){\big )}\wedge {\big (}\left(P(a_{2})\wedge P(a_{1})\right)\rightarrow (a_{2}=a_{1}){\big )}\wedge {\big (}\left(P(a_{2})\wedge P(a_{2})\right)\rightarrow (a_{2}=a_{2}){\big )}$

Which is then replaced by ${\big (}\left(p_{1}\wedge p_{1}\right)\rightarrow \top {\big )}\wedge {\big (}\left(p_{1}\wedge p_{2}\right)\rightarrow \bot {\big )}\wedge {\big (}\left(p_{2}\wedge p_{1}\right)\rightarrow \bot {\big )}\wedge {\big (}\left(p_{2}\wedge p_{2}\right)\rightarrow \top {\big )}$

where $\top$ is truth, $\bot$ is falsity, and $p_{1}$, $p_{2}$ are propositional variables. In this particular case, the last formula is equivalent to $\neg (p_{1}\wedge p_{2})$, which is satisfiable.

The other direction of the proof is to show that, for every set of binary strings accepted by a non-deterministic Turing machine running in exponential time ($2^{cx}$ for input length x), there is a first-order formula $\varphi$ such that the set of numbers represented by these binary strings are the spectrum of $\varphi$.

Jones and Selman mention that the spectrum of first-order formulas without equality is just the set of all natural numbers not smaller than some minimal cardinality.

Other properties

The set of spectra of a theory is closed under union, intersection, addition, and multiplication. In full generality, it is not known if the set of spectra of a theory is closed by complementation; this is the so-called Asser's problem. By the result of Jones and Selman, it is equivalent to the problem of whether NEXPTIME = co-NEXPTIME; that is, whether NEXPTIME is closed under complementation.

See also

• Spectrum of a theory
• Counting quantification

References

• Fagin, Ronald (1974). "Generalized First-Order Spectra and Polynomial-Time Recognizable Sets" (PDF). In Karp, Richard M. (ed.). Complexity of Computation. Proc. Syp. App. Math. SIAM-AMS Proceedings. Vol. 7. pp. 27–41. Zbl 0303.68035.
• Grädel, Erich; Kolaitis, Phokion G.; Libkin, Leonid; Maarten, Marx; Spencer, Joel; Vardi, Moshe Y.; Venema, Yde; Weinstein, Scott (2007). Finite model theory and its applications. Texts in Theoretical Computer Science. An EATCS Series. Berlin: Springer-Verlag. doi:10.1007/3-540-68804-8. ISBN 978-3-540-00428-8. Zbl 1133.03001.
• Immerman, Neil (1999). Descriptive Complexity. Graduate Texts in Computer Science. New York: Springer-Verlag. pp. 113–119. ISBN 0-387-98600-6. Zbl 0918.68031.
• Durand, Arnaud; Jones, Neil; Markowsky, Johann; More, Malika (2012). "Fifty Years of the Spectrum Problem: Survey and New Results". Bulletin of Symbolic Logic. 18 (4): 505–553. arXiv:0907.5495. Bibcode:2009arXiv0907.5495D. doi:10.2178/bsl.1804020. S2CID 9507429.