Jump to content

Lp space

From Wikipedia, the free encyclopedia
(Redirected from L^p space)

In mathematics, the Lp spaces are function spaces defined using a natural generalization of the p-norm for finite-dimensional vector spaces. They are sometimes called Lebesgue spaces, named after Henri Lebesgue (Dunford & Schwartz 1958, III.3), although according to the Bourbaki group (Bourbaki 1987) they were first introduced by Frigyes Riesz (Riesz 1910).

Lp spaces form an important class of Banach spaces in functional analysis, and of topological vector spaces. Because of their key role in the mathematical analysis of measure and probability spaces, Lebesgue spaces are used also in the theoretical discussion of problems in physics, statistics, economics, finance, engineering, and other disciplines.

Preliminaries

[edit]

The p-norm in finite dimensions

[edit]
Illustrations of unit circles (see also superellipse) in based on different -norms (every vector from the origin to the unit circle has a length of one, the length being calculated with length-formula of the corresponding ).

The Euclidean length of a vector in the -dimensional real vector space is given by the Euclidean norm:

The Euclidean distance between two points and is the length of the straight line between the two points. In many situations, the Euclidean distance is appropriate for capturing the actual distances in a given space. In contrast, consider taxi drivers in a grid street plan who should measure distance not in terms of the length of the straight line to their destination, but in terms of the rectilinear distance, which takes into account that streets are either orthogonal or parallel to each other. The class of -norms generalizes these two examples and has an abundance of applications in many parts of mathematics, physics, and computer science.

For a real number the -norm or -norm of is defined by The absolute value bars can be dropped when is a rational number with an even numerator in its reduced form, and is drawn from the set of real numbers, or one of its subsets.

The Euclidean norm from above falls into this class and is the -norm, and the -norm is the norm that corresponds to the rectilinear distance.

The -norm or maximum norm (or uniform norm) is the limit of the -norms for , given by:

For all the -norms and maximum norm satisfy the properties of a "length function" (or norm), that is:

  • only the zero vector has zero length,
  • the length of the vector is positive homogeneous with respect to multiplication by a scalar (positive homogeneity), and
  • the length of the sum of two vectors is no larger than the sum of lengths of the vectors (triangle inequality).

Abstractly speaking, this means that together with the -norm is a normed vector space. Moreover, it turns out that this space is complete, thus making it a Banach space.

Relations between p-norms

[edit]

The grid distance or rectilinear distance (sometimes called the "Manhattan distance") between two points is never shorter than the length of the line segment between them (the Euclidean or "as the crow flies" distance). Formally, this means that the Euclidean norm of any vector is bounded by its 1-norm:

This fact generalizes to -norms in that the -norm of any given vector does not grow with :

for any vector and real numbers and (In fact this remains true for and .)

For the opposite direction, the following relation between the -norm and the -norm is known:

This inequality depends on the dimension of the underlying vector space and follows directly from the Cauchy–Schwarz inequality.

In general, for vectors in where

This is a consequence of Hölder's inequality.

When 0 < p < 1

[edit]
Astroid, unit circle in metric

In for the formula defines an absolutely homogeneous function for however, the resulting function does not define a norm, because it is not subadditive. On the other hand, the formula defines a subadditive function at the cost of losing absolute homogeneity. It does define an F-norm, though, which is homogeneous of degree

Hence, the function defines a metric. The metric space is denoted by

Although the -unit ball around the origin in this metric is "concave", the topology defined on by the metric is the usual vector space topology of hence is a locally convex topological vector space. Beyond this qualitative statement, a quantitative way to measure the lack of convexity of is to denote by the smallest constant such that the scalar multiple of the -unit ball contains the convex hull of which is equal to The fact that for fixed we have shows that the infinite-dimensional sequence space defined below, is no longer locally convex.[citation needed]

When p = 0

[edit]

There is one norm and another function called the "norm" (with quotation marks).

The mathematical definition of the norm was established by Banach's Theory of Linear Operations. The space of sequences has a complete metric topology provided by the F-norm on the product metric:[citation needed] The -normed space is studied in functional analysis, probability theory, and harmonic analysis.

Another function was called the "norm" by David Donoho—whose quotation marks warn that this function is not a proper norm—is the number of non-zero entries of the vector [citation needed] Many authors abuse terminology by omitting the quotation marks. Defining the zero "norm" of is equal to

An animated gif of p-norms 0.1 through 2 with a step of 0.05.
An animated gif of p-norms 0.1 through 2 with a step of 0.05.

This is not a norm because it is not homogeneous. For example, scaling the vector by a positive constant does not change the "norm". Despite these defects as a mathematical norm, the non-zero counting "norm" has uses in scientific computing, information theory, and statistics–notably in compressed sensing in signal processing and computational harmonic analysis. Despite not being a norm, the associated metric, known as Hamming distance, is a valid distance, since homogeneity is not required for distances.

p spaces and sequence spaces

[edit]

The -norm can be extended to vectors that have an infinite number of components (sequences), which yields the space This contains as special cases:

  • the space of sequences whose series are absolutely convergent,
  • the space of square-summable sequences, which is a Hilbert space, and
  • the space of bounded sequences.

The space of sequences has a natural vector space structure by applying scalar addition and multiplication. Explicitly, the vector sum and the scalar action for infinite sequences of real (or complex) numbers are given by:

Define the -norm:

Here, a complication arises, namely that the series on the right is not always convergent, so for example, the sequence made up of only ones, will have an infinite -norm for The space is then defined as the set of all infinite sequences of real (or complex) numbers such that the -norm is finite.

One can check that as increases, the set grows larger. For example, the sequence is not in but it is in for as the series diverges for (the harmonic series), but is convergent for

One also defines the -norm using the supremum: and the corresponding space of all bounded sequences. It turns out that[1] if the right-hand side is finite, or the left-hand side is infinite. Thus, we will consider spaces for

The -norm thus defined on is indeed a norm, and together with this norm is a Banach space.

General ℓp-space

[edit]

In complete analogy to the preceding definition one can define the space over a general index set (and ) as where convergence on the right means that only countably many summands are nonzero (see also Unconditional convergence). With the norm the space becomes a Banach space. In the case where is finite with elements, this construction yields with the -norm defined above. If is countably infinite, this is exactly the sequence space defined above. For uncountable sets this is a non-separable Banach space which can be seen as the locally convex direct limit of -sequence spaces.[2]

For the -norm is even induced by a canonical inner product called the Euclidean inner product, which means that holds for all vectors This inner product can expressed in terms of the norm by using the polarization identity. On it can be defined by Now consider the case Define[note 1] where for all [3][note 2]

The index set can be turned into a measure space by giving it the discrete σ-algebra and the counting measure. Then the space is just a special case of the more general -space (defined below).

Lp spaces and Lebesgue integrals

[edit]

An space may be defined as a space of measurable functions for which the -th power of the absolute value is Lebesgue integrable, where functions which agree almost everywhere are identified. More generally, let be a measure space and [note 3] When , consider the set of all measurable functions from to or whose absolute value raised to the -th power has a finite integral, or in symbols:[4]

To define the set for recall that two functions and defined on are said to be equal almost everywhere, written a.e., if the set is measurable and has measure zero. Similarly, a measurable function (and its absolute value) is bounded (or dominated) almost everywhere by a real number written a.e., if the (necessarily) measurable set has measure zero. The space is the set of all measurable functions that are bounded almost everywhere (by some real ) and is defined as the infimum of these bounds: When then this is the same as the essential supremum of the absolute value of :[note 4]

For example, if is a measurable function that is equal to almost everywhere[note 5] then for every and thus for all

For every positive the value under of a measurable function and its absolute value are always the same (that is, for all ) and so a measurable function belongs to if and only if its absolute value does. Because of this, many formulas involving -norms are stated only for non-negative real-valued functions. Consider for example the identity which holds whenever is measurable, is real, and (here when ). The non-negativity requirement can be removed by substituting in for which gives Note in particular that when is finite then the formula relates the -norm to the -norm.

Seminormed space of -th power integrable functions

Each set of functions forms a vector space when addition and scalar multiplication are defined pointwise.[note 6] That the sum of two -th power integrable functions and is again -th power integrable follows from [proof 1] although it is also a consequence of Minkowski's inequality which establishes that satisfies the triangle inequality for (the triangle inequality does not hold for ). That is closed under scalar multiplication is due to being absolutely homogeneous, which means that for every scalar and every function

Absolute homogeneity, the triangle inequality, and non-negativity are the defining properties of a seminorm. Thus is a seminorm and the set of -th power integrable functions together with the function defines a seminormed vector space. In general, the seminorm is not a norm because there might exist measurable functions that satisfy but are not identically equal to [note 5] ( is a norm if and only if no such exists).

Zero sets of -seminorms

If is measurable and equals a.e. then for all positive On the other hand, if is a measurable function for which there exists some such that then almost everywhere. When is finite then this follows from the case and the formula mentioned above.

Thus if is positive and is any measurable function, then if and only if almost everywhere. Since the right hand side ( a.e.) does not mention it follows that all have the same zero set (it does not depend on ). So denote this common set by This set is a vector subspace of for every positive

Quotient vector space

Like every seminorm, the seminorm induces a norm (defined shortly) on the canonical quotient vector space of by its vector subspace This normed quotient space is called Lebesgue space and it is the subject of this article. We begin by defining the quotient vector space.

Given any the coset consists of all measurable functions that are equal to almost everywhere. The set of all cosets, typically denoted by forms a vector space with origin when vector addition and scalar multiplication are defined by and This particular quotient vector space will be denoted by Two cosets are equal if and only if (or equivalently, ), which happens if and only if almost everywhere; if this is the case then and are identified in the quotient space. Hence, strictly speaking consists of equivalence classes of functions.[5][6]

Given any the value of the seminorm on the coset is constant and equal to , that is: The map is a norm on called the -norm. The value of a coset is independent of the particular function that was chosen to represent the coset, meaning that if is any coset then for every (since for every ).

The Lebesgue space

The normed vector space is called space or the Lebesgue space of -th power integrable functions and it is a Banach space for every (meaning that it is a complete metric space, a result that is sometimes called the Riesz–Fischer theorem). When the underlying measure space is understood then is often abbreviated or even just Depending on the author, the subscript notation might denote either or

If the seminorm on happens to be a norm (which happens if and only if ) then the normed space will be linearly isometrically isomorphic to the normed quotient space via the canonical map (since ); in other words, they will be, up to a linear isometry, the same normed space and so they may both be called " space".

The above definitions generalize to Bochner spaces.

In general, this process cannot be reversed: there is no consistent way to define a "canonical" representative of each coset of in For however, there is a theory of lifts enabling such recovery.

Special cases

[edit]

For the spaces are a special case of spaces; when are the natural numbers and is the counting measure. More generally, if one considers any set with the counting measure, the resulting space is denoted For example, is the space of all sequences indexed by the integers, and when defining the -norm on such a space, one sums over all the integers. The space where is the set with elements, is with its -norm as defined above.

Similar to spaces, is the only Hilbert space among spaces. In the complex case, the inner product on is defined by Functions in are sometimes called square-integrable functions, quadratically integrable functions or square-summable functions, but sometimes these terms are reserved for functions that are square-integrable in some other sense, such as in the sense of a Riemann integral (Titchmarsh 1976).

As any Hilbert space, every space is linearly isometric to a suitable where the cardinality of the set is the cardinality of an arbitrary basis for this particular

If we use complex-valued functions, the space is a commutative C*-algebra with pointwise multiplication and conjugation. For many measure spaces, including all sigma-finite ones, it is in fact a commutative von Neumann algebra. An element of defines a bounded operator on any space by multiplication.

When (0 < p < 1)

[edit]

If then can be defined as above, that is: In this case, however, the -norm does not satisfy the triangle inequality and defines only a quasi-norm. The inequality valid for implies that and so the function is a metric on The resulting metric space is complete.[7]

In this setting satisfies a reverse Minkowski inequality, that is for

This result may be used to prove Clarkson's inequalities, which are in turn used to establish the uniform convexity of the spaces for (Adams & Fournier 2003).

The space for is an F-space: it admits a complete translation-invariant metric with respect to which the vector space operations are continuous. It is the prototypical example of an F-space that, for most reasonable measure spaces, is not locally convex: in or every open convex set containing the function is unbounded for the -quasi-norm; therefore, the vector does not possess a fundamental system of convex neighborhoods. Specifically, this is true if the measure space contains an infinite family of disjoint measurable sets of finite positive measure.

The only nonempty convex open set in is the entire space. Consequently, there are no nonzero continuous linear functionals on the continuous dual space is the zero space. In the case of the counting measure on the natural numbers (i.e. ), the bounded linear functionals on are exactly those that are bounded on , i.e., those given by sequences in Although does contain non-trivial convex open sets, it fails to have enough of them to give a base for the topology.

Having no linear functionals is highly undesirable for the purposes of doing analysis. In case of the Lebesgue measure on rather than work with for it is common to work with the Hardy space Hp whenever possible, as this has quite a few linear functionals: enough to distinguish points from one another. However, the Hahn–Banach theorem still fails in Hp for (Duren 1970, §7.5).

Properties

[edit]

Hölder's inequality

[edit]

Suppose satisfy . If and then and[8]

This inequality, called Hölder's inequality, is in some sense optimal since if and is a measurable function such that where the supremum is taken over the closed unit ball of then and

Atomic decomposition

[edit]

If then every non-negative has an atomic decomposition,[9] meaning that there exist a sequence of non-negative real numbers and a sequence of non-negative functions called the atoms, whose supports are pairwise disjoint sets of measure such that and for every integer and and where moreover, the sequence of functions depends only on (it is independent of ). These inequalities guarantee that for all integers while the supports of being pairwise disjoint implies

Dual spaces

[edit]

The dual space of for has a natural isomorphism with where is such that . This isomorphism associates with the functional defined by for every

is a well defined continuous linear mapping which is an isometry by the extremal case of Hölder's inequality. If is a -finite measure space one can use the Radon–Nikodym theorem to show that any can be expressed this way, i.e., is an isometric isomorphism of Banach spaces.[10] Hence, it is usual to say simply that is the continuous dual space of

For the space is reflexive. Let be as above and let be the corresponding linear isometry. Consider the map from to obtained by composing with the transpose (or adjoint) of the inverse of

This map coincides with the canonical embedding of into its bidual. Moreover, the map is onto, as composition of two onto isometries, and this proves reflexivity.

If the measure on is sigma-finite, then the dual of is isometrically isomorphic to (more precisely, the map corresponding to is an isometry from onto

The dual of is subtler. Elements of can be identified with bounded signed finitely additive measures on that are absolutely continuous with respect to See ba space for more details. If we assume the axiom of choice, this space is much bigger than except in some trivial cases. However, Saharon Shelah proved that there are relatively consistent extensions of Zermelo–Fraenkel set theory (ZF + DC + "Every subset of the real numbers has the Baire property") in which the dual of is [11]

Embeddings

[edit]

Colloquially, if then contains functions that are more locally singular, while elements of can be more spread out. Consider the Lebesgue measure on the half line A continuous function in might blow up near but must decay sufficiently fast toward infinity. On the other hand, continuous functions in need not decay at all but no blow-up is allowed. More formally, suppose that , then:[12]

  1. if and only if does not contain sets of finite but arbitrarily large measure (e.g. any finite measure).
  2. if and only if does not contain sets of non-zero but arbitrarily small measure (e.g. the counting measure).

Neither condition holds for the Lebesgue measure on the real line while both conditions holds for the counting measure on any finite set. As a consequence of the closed graph theorem, the embedding is continuous, i.e., the identity operator is a bounded linear map from to in the first case and to in the second. Indeed, if the domain has finite measure, one can make the following explicit calculation using Hölder's inequality leading to

The constant appearing in the above inequality is optimal, in the sense that the operator norm of the identity is precisely the case of equality being achieved exactly when -almost-everywhere.

Dense subspaces

[edit]

Let and be a measure space and consider an integrable simple function on given by where are scalars, has finite measure and is the indicator function of the set for By construction of the integral, the vector space of integrable simple functions is dense in

More can be said when is a normal topological space and its Borel 𝜎–algebra.

Suppose is an open set with Then for every Borel set contained in there exist a closed set and an open set such that for every . Subsequently, there exists a Urysohn function on that is on and on with

If can be covered by an increasing sequence of open sets that have finite measure, then the space of –integrable continuous functions is dense in More precisely, one can use bounded continuous functions that vanish outside one of the open sets

This applies in particular when and when is the Lebesgue measure. For example, the space of continuous and compactly supported functions as well as the space of integrable step functions are dense in .

Closed subspaces

[edit]

Suppose . If is a probability space and is a closed subspace of then is finite-dimensional.[13] It is crucial that the vector space be a subset of since it is possible to construct an infinite-dimensional closed vector subspace of which lies in ; taking the Lebesgue measure on the circle group divided by as the probability measure.

Applications

[edit]

Statistics

[edit]

In statistics, measures of central tendency and statistical dispersion, such as the mean, median, and standard deviation, can be defined in terms of metrics, and measures of central tendency can be characterized as solutions to variational problems.

In penalized regression, "L1 penalty" and "L2 penalty" refer to penalizing either the norm of a solution's vector of parameter values (i.e. the sum of its absolute values), or its squared norm (its Euclidean length). Techniques which use an L1 penalty, like LASSO, encourage sparse solutions (where the many parameters are zero).[14] Elastic net regularization uses a penalty term that is a combination of the norm and the squared norm of the parameter vector.

Hausdorff–Young inequality

[edit]

The Fourier transform for the real line (or, for periodic functions, see Fourier series), maps to (or to ) respectively, where and This is a consequence of the Riesz–Thorin interpolation theorem, and is made precise with the Hausdorff–Young inequality.

By contrast, if the Fourier transform does not map into

Hilbert spaces

[edit]

Hilbert spaces are central to many applications, from quantum mechanics to stochastic calculus. The spaces and are both Hilbert spaces. In fact, by choosing a Hilbert basis i.e., a maximal orthonormal subset of or any Hilbert space, one sees that every Hilbert space is isometrically isomorphic to (same as above), i.e., a Hilbert space of type

Generalizations and extensions

[edit]

Weak Lp

[edit]

Let be a measure space, and a measurable function with real or complex values on The distribution function of is defined for by

If is in for some with then by Markov's inequality,

A function is said to be in the space weak , or if there is a constant such that, for all

The best constant for this inequality is the -norm of and is denoted by

The weak coincide with the Lorentz spaces so this notation is also used to denote them.

The -norm is not a true norm, since the triangle inequality fails to hold. Nevertheless, for in and in particular

In fact, one has and raising to power and taking the supremum in one has

Under the convention that two functions are equal if they are equal almost everywhere, then the spaces are complete (Grafakos 2004).

For any the expression is comparable to the -norm. Further in the case this expression defines a norm if Hence for the weak spaces are Banach spaces (Grafakos 2004).

A major result that uses the -spaces is the Marcinkiewicz interpolation theorem, which has broad applications to harmonic analysis and the study of singular integrals.

Weighted Lp spaces

[edit]

As before, consider a measure space Let be a measurable function. The -weighted space is defined as where means the measure defined by

or, in terms of the Radon–Nikodym derivative, the norm for is explicitly

As -spaces, the weighted spaces have nothing special, since is equal to But they are the natural framework for several results in harmonic analysis (Grafakos 2004); they appear for example in the Muckenhoupt theorem: for the classical Hilbert transform is defined on where denotes the unit circle and the Lebesgue measure; the (nonlinear) Hardy–Littlewood maximal operator is bounded on Muckenhoupt's theorem describes weights such that the Hilbert transform remains bounded on and the maximal operator on

Lp spaces on manifolds

[edit]

One may also define spaces on a manifold, called the intrinsic spaces of the manifold, using densities.

Vector-valued Lp spaces

[edit]

Given a measure space and a locally convex space (here assumed to be complete), it is possible to define spaces of -integrable -valued functions on in a number of ways. One way is to define the spaces of Bochner integrable and Pettis integrable functions, and then endow them with locally convex TVS-topologies that are (each in their own way) a natural generalization of the usual topology. Another way involves topological tensor products of with Element of the vector space are finite sums of simple tensors where each simple tensor may be identified with the function that sends This tensor product is then endowed with a locally convex topology that turns it into a topological tensor product, the most common of which are the projective tensor product, denoted by and the injective tensor product, denoted by In general, neither of these space are complete so their completions are constructed, which are respectively denoted by and (this is analogous to how the space of scalar-valued simple functions on when seminormed by any is not complete so a completion is constructed which, after being quotiented by is isometrically isomorphic to the Banach space ). Alexander Grothendieck showed that when is a nuclear space (a concept he introduced), then these two constructions are, respectively, canonically TVS-isomorphic with the spaces of Bochner and Pettis integral functions mentioned earlier; in short, they are indistinguishable.

L0 space of measurable functions

[edit]

The vector space of (equivalence classes of) measurable functions on is denoted (Kalton, Peck & Roberts 1984). By definition, it contains all the and is equipped with the topology of convergence in measure. When is a probability measure (i.e., ), this mode of convergence is named convergence in probability. The space is always a topological abelian group but is only a topological vector space if This is because scalar multiplication is continuous if and only if If is -finite then the weaker topology of local convergence in measure is an F-space, i.e. a completely metrizable topological vector space. Moreover, this topology is isometric to global convergence in measure for a suitable choice of probability measure

The description is easier when is finite. If is a finite measure on the function admits for the convergence in measure the following fundamental system of neighborhoods

The topology can be defined by any metric of the form where is bounded continuous concave and non-decreasing on with and when (for example, Such a metric is called Lévy-metric for Under this metric the space is complete. However, as mentioned above, scalar multiplication is continuous with respect to this metric only if . To see this, consider the Lebesgue measurable function defined by . Then clearly . The space is in general not locally bounded, and not locally convex.

For the infinite Lebesgue measure on the definition of the fundamental system of neighborhoods could be modified as follows

The resulting space , with the topology of local convergence in measure, is isomorphic to the space for any positive –integrable density

See also

[edit]

Notes

[edit]
  1. ^ Maddox, I. J. (1988), Elements of Functional Analysis (2nd ed.), Cambridge: CUP, page 16
  2. ^ Rafael Dahmen, Gábor Lukács: Long colimits of topological groups I: Continuous maps and homeomorphisms. in: Topology and its Applications Nr. 270, 2020. Example 2.14
  3. ^ Garling, D. J. H. (2007). Inequalities: A Journey into Linear Analysis. Cambridge University Press. p. 54. ISBN 978-0-521-87624-7.
  4. ^ Rudin 1987, p. 65.
  5. ^ Stein & Shakarchi 2012, p. 2.
  6. ^ Weisstein, Eric W. "L^2-Space". MathWorld.
  7. ^ Rudin 1991, p. 37.
  8. ^ Bahouri, Chemin & Danchin 2011, pp. 1–4.
  9. ^ Bahouri, Chemin & Danchin 2011, pp. 7–8.
  10. ^ Rudin 1987, Theorem 6.16.
  11. ^ Schechter, Eric (1997), Handbook of Analysis and its Foundations, London: Academic Press Inc. See Sections 14.77 and 27.44–47
  12. ^ Villani, Alfonso (1985), "Another note on the inclusion Lp(μ) ⊂ Lq(μ)", Amer. Math. Monthly, 92 (7): 485–487, doi:10.2307/2322503, JSTOR 2322503, MR 0801221
  13. ^ Rudin 1991, pp. 117–119.
  14. ^ Hastie, T. J.; Tibshirani, R.; Wainwright, M. J. (2015). Statistical Learning with Sparsity: The Lasso and Generalizations. CRC Press. ISBN 978-1-4987-1216-3.
  1. ^ The condition is not equivalent to being finite, unless
  2. ^ If then
  3. ^ The definitions of and can be extended to all (rather than just ), but it is only when that is guaranteed to be a norm (although is a quasi-seminorm for all ).
  4. ^ If then
  5. ^ a b For example, if a non-empty measurable set of measure exists then its indicator function satisfies although
  6. ^ Explicitly, the vector space operations are defined by: for all and all scalars These operations make into a vector space because if is any scalar and then both and also belong to
  1. ^ When the inequality can be deduced from the fact that the function defined by is convex, which by definition means that for all and all in the domain of Substituting and in for and gives which proves that The triangle inequality now implies The desired inequality follows by integrating both sides.

References

[edit]
[edit]