Multidimensional modulation

Multidimensional modulation (MD modulation) is modifying or multiplying an MD signal (typically sinusoidal and referred to as the carrier signal) with another signal that carries some information or message. In the frequency domain, the signal is moved from one frequency to another.

if

$x(n_{1},...,n_{M}){\overset {\underset {\mathrm {FT} }{}}{\longleftrightarrow }}X(\omega _{1},...,\omega _{M})$ (1)

then

$e^{(j\theta _{1}n_{1}+,...,+\theta _{M}n_{M})}x(n_{1},...,n_{M}){\overset {\underset {\mathrm {FT} }{}}{\longleftrightarrow }}X(\omega _{1}-\theta _{1},...,\omega _{M}-\theta _{M})$ (2)

Typically the carrier signal is a sinusoidal signal and in various applications. The figures below illustrate a quick example of a 2-D modulation. The original signal from (3) is modulated with a sinusoidal signal to get (4). The equations (5) and (6) are the real and the imaginary components of the modulated signal.

$x(n_{1},n_{2}){=}\cos {(2\pi n_{1}+4\pi n_{2})}$ (3)

$y(n_{1},n_{2}){=}e^{(j\pi n_{1}+\pi n_{2})}x(n_{1},n_{2})$ (4)

$\mathbf {Re} \lbrace y(n_{1},n_{2})\rbrace {=}\cos {(\pi n_{1}+\pi n_{2})}x(n_{1},n_{2})$ (5)

$\mathbf {Im} \lbrace y(n_{1},n_{2})\rbrace {=}\sin {(\pi n_{1}+\pi n_{2})}x(n_{1},n_{2})$ (6)

Original plot of MD signal

Real value plot of MD modulated signal

Imaginary value plot (90^o phase shift) of MD modulated signal

Absolute value plot of MD modulated signal

Phase plot of MD modulated signal

Background/Motivation

The MD modulation is one of the properties of the Multidimensional Fourier Transform.

MD Fourier Transform (FT)

Fourier Transform (FT) of multi-dimensional (MD) signal or system is the transform of the MD signal or system that decomposes it into its frequency components. Essentially, it is the frequency response of the MD signal or system, so it depicts the frequency characteristics of the signal or system. A special case of the MD transform is the 1-D Fourier transform.

Computation

The formula for computing the Fourier transform of an MD signal is

$X(\omega _{1},\omega _{2},...,\omega _{M}){=}\sum _{n_{1}=-\infty }^{\infty }\sum _{n_{2}=-\infty }^{\infty }...\sum _{n_{M}=-\infty }^{\infty }x(n_{1},n_{2},...,n_{M})e^{-j(\omega _{1}n_{1}+\omega _{2}n_{2}+,...,+\omega _{M}n_{M})}$

If the frequency response is given instead, then the inverse FT formula is used to derive the input signal or system. In this case the formula used is:

$x(n_{1},n_{2},...,n_{M}){=}{\frac {1}{(2\pi )^{M}}}\int \limits _{-\pi }^{\pi }\int \limits _{-\pi }^{\pi }...\int \limits _{-\pi }^{\pi }X(\omega _{1},\omega _{2},...,\omega _{M})e^{j(\omega _{1}n_{1}+\omega _{2}n_{2}+,...,+\omega _{M}n_{M})}d\omega _{1}d\omega _{2}...d\omega _{M}$

Approaches / Extended Applications of MD Modulation

Multidimensional AM and FM

Multidimensional AM or FM is AM-FM modulation where the a Multidimensional message signal is modulated (or multiplied) with a Multidimensional sinusoidal signal. From the special case of Parseval’s theorem (MD FT Properties), it is noted that the energy or power of a signal is directly proportional to the magnitude of the signal, and since most of the signals in this case are sinusoidal, it is well noted that the energy or power is directly proportional to the amplitude of the sinusoid. Since power management is always an issue, the modulation of the amplitude isn’t always the best solution when the application is trying to be power conscious.

2-D Modulation based Applications

A 2-D modulation comprises a space domain that has 2 independent variables e.g. x(n1,n2) with a corresponding frequency domain that also has 2 independent variables X(ω1, ω2).

2-D AM and FM analysis

Image texturization is an application of multidimensional AM-FM modulation. In this method, the image (2-D signal) is expressed into its special frequencies and amplitude estimates. The signal is represented as a product of 2 FM functions (using the independent frequencies), making is separable. Using the instantaneous frequency, the image can be represented topologically to illustrate its texture.

3-D Modulation based Applications

3-D modulation uses 3-D message and carrier signals.

3D scanner: Some 3-D scanners used modulated light, typically amplitude modulation, together with a camera to scan an object.

3-D TOF cameras: They use modulated light sources and its reflection for depth perception computation. In essence, creating a 2-D image with depth perception helps separate the foreground and background.

References

• Dudgeon and Mersereau (1984). Multidimensional Digital Signal Processing. Upper Saddle River, NJ: Prentice-Hall. ISBN 978-0-13-604959-3.
• Li, Larry. "Time-of-Flight Camera - An introduction" (PDF). Texas Instruments.
• Pattichis, Marios S.; Bovik, Alan C. (2007). "Analyzing Image Structure by Multidimensional Frequency Modulation". IEEE Transactions on Pattern Analysis and Machine Intelligence. 29 (5): 753–766. CiteSeerX 10.1.1.80.1213. doi:10.1109/TPAMI.2007.1051. PMID 17356197. S2CID 2798475.