Median filter

The median filter is a non-linear digital filtering technique, often used to remove noise from an image,^[1] signal,^[2] and video.^[3] Such noise reduction is a typical pre-processing step to improve the results of later processing (for example, edge detection on an image). Median filtering is very widely used in digital image processing because, under certain conditions, it preserves edges while removing noise (but see the discussion below for which kinds of noise), also having applications in signal processing.

Algorithm description

The main idea of the median filter is to run through the signal entry by entry, replacing each entry with the median of the entry and its neighboring entries. The idea is very similar to a moving average filter, which replaces each entry with the arithmetic mean of the entry and its neighbors. The pattern of neighbors is called the "window", which slides, entry by entry, over the entire signal. For one-dimensional signals, the most obvious window is just the first few preceding and following entries, whereas for two-dimensional (or higher-dimensional) data, the window must include all entries within a given radius or ellipsoidal or rectangular region (i.e., the median filter is not a separable filter).^{[citation needed]}

Worked one-dimensional example

To demonstrate, using a window size of three with one entry immediately preceding and following each entry, and zero-padded boundaries, a median filter will be applied to the following simple one-dimensional signal:

x = (2, 3, 80, 6, 2, 3).

This signal has mainly small valued entries, except for one entry that is unusually high and considered to be a noise spike, and the aim is to eliminate it. So, the median filtered output signal y will be:

y₀ = med(0, 2, 3) = 2, (the boundary value is taken to be 0)

y₁ = med(2, 3, 80) = 3, (already 2, 3, and 80 are in the increasing order so no need to arrange them)

y₂ = med(3, 80, 6) = med(3, 6, 80) = 6, (3, 80, and 6 are rearranged to find the median)

y₃ = med(80, 6, 2) = med(2, 6, 80) = 6,

y₄ = med(6, 2, 3) = med(2, 3, 6) = 3,

y₅ = med(2, 3, 0) = med(0, 2, 3) = 2,

i.e.,

y = (2, 3, 6, 6, 3, 2).

It is clear that the noise spike has been essentially eliminated (and the signal has also been smoothed a bit). The result of a moving average filter with the same window width on the same dataset would be y = (1.7, 28.3, 29.7, 29.3, 3.7, 1.7). It can be seen that the noise spike has infected neighbouring elements in the moving average signal, and that the median filter has performed much better (for this type of impulse noise). Median filtering works well for both positive impulses (spikes) and negative impulses (dropouts), so long as a window can be chosen so that the number of entries infected with impulse noise is (almost) always smaller than half of the window size.

Boundary issues

When implementing a median filter, the boundaries of the signal must be handled with special care, as there are not enough entries to fill an entire window. There are several schemes that have different properties that might be preferred in particular circumstances:

When calculating the median of a value near the boundary, missing values are filled by repeating the boundary value to obtain enough entries to fill the window.
Avoid processing the boundaries, with or without cropping the signal or image boundary afterwards,
Fetching entries from other places in the signal such as values from the far ends (repeating boundary conditions) or reversing the signal (reflected boundary conditions). With 2D images for example, entries from the far horizontal or vertical boundary might be selected, or repeating in reverse order the points at the same boundary
Shrinking the window near the boundaries, so that every window is full,
Assuming zero-padded boundaries.

Two-dimensional median filter pseudo code

Code for a simple two-dimensional median filter algorithm might look like this:

1. allocate outputPixelValue[image width][image height]
2. allocate window[window width × window height]
3. edgex := (window width / 2) rounded down
4. edgey := (window height / 2) rounded down

    for x from edgex to image width - edgex do
    for y from edgey to image height - edgey do
        i = 0
        for fx from 0 to window width do
            for fy from 0 to window height do
                window[i] := inputPixelValue[x + fx - edgex][y + fy - edgey]
                i := i + 1
        sort entries in window[]
        outputPixelValue[x][y] := window[window width * window height / 2]

This algorithm:

Processes one color channel only,
Takes the "not processing boundaries" approach (see above discussion about boundary issues).

Use of a median filter to improve an image severely corrupted by defective pixels

Algorithm implementation issues

Typically, by far the majority of the computational effort and time is spent on calculating the median of each window. Because the filter must process every entry in the signal, for large signals such as images, the efficiency of this median calculation is a critical factor in determining how fast the algorithm can run. The naïve implementation described above sorts every entry in the window to find the median; however, since only the middle value in a list of numbers is required, selection algorithms can be much more efficient. Furthermore, some types of signals (very often the case for images) use whole number representations: in these cases, histogram medians can be far more efficient because it is simple to update the histogram from window to window, and finding the median of a histogram is not particularly onerous.^[4]

Worked two-dimensional example

The median filter operates by considering a local window (also known as a kernel) around each pixel in the image. The steps for applying the median filter are as follows:

Window Selection:
- Choose a window of a specific size (e.g., 3x3, 5x5) centered around the pixel to be filtered.
- For our example, let’s use a 3x3 window.
Collect Pixel Values:
- Collect the pixel values within the window.
- For the center pixel, we have the following values:
  - Window: ${\begin{bmatrix}1&2&3\\4&8&6\\7&5&9\end{bmatrix}}$
  - Center pixel: 8
Sort the Values:
- Sort the collected pixel values in ascending order.
- For the center pixel, the sorted values are: [1, 2, 3, 4, 5, 6, 7, 8, 9]
Choose the Median Value:
- The median value is the middle value in the sorted list.
- In our case, the median value is 5.
Replace the Center Pixel:
- Replace the original center pixel value (8) with the median value (5).
Repeat for All Pixels:
- Repeat steps 2-5 for all pixels in the image.

Converted Image

After applying the median filter to all pixels, the converted image becomes: ${\begin{bmatrix}2&3&3\\4&5&6\\7&7&8\end{bmatrix}}$ This filtered image effectively removes noisy pixels while preserving important features. Remember that we assumed virtual rows and columns with repeated border pixel values to handle the edge pixels.

Edge preservation properties

Median filtering is one kind of smoothing technique, as is linear Gaussian filtering. All smoothing techniques are effective at removing noise in smooth patches or smooth regions of a signal, but adversely affect edges. Often though, at the same time as reducing the noise in a signal, it is important to preserve the edges. Edges are of critical importance to the visual appearance of images, for example. For small to moderate levels of Gaussian noise, the median filter is demonstrably better than Gaussian blur at removing noise whilst preserving edges for a given, fixed window size.^[5] However, its performance is not that much better than Gaussian blur for high levels of noise, whereas, for speckle noise and salt-and-pepper noise (impulsive noise), it is particularly effective.^[6] Because of this, median filtering is very widely used in digital image processing.

References

^ Rezaee, Alireza (April 2021). "Partition Fuzzy Median Filter for Image Restoration". Fuzzy Information and Engineering. 13 (2): 199–210. doi:10.1080/16168658.2021.1921377. ISSN 1616-8658.
^ Tay, David B. (July 2023). "Median Autoregressive Graph Filters". IEEE Signal Processing Letters. 30: 833–837. doi:10.1109/LSP.2023.3292741. ISSN 1070-9908.
^ Baboshina, V.A.; Orazaev, A.R.; Lyakhov, P.A.; Boyarskaya, E.E. (August 2024). "Neural network recognition system for video transmitted through a binary symmetric channel". Computer Optics. 48 (4): 582–591. doi:10.18287/2412-6179-CO-1388.
^ Huang, Thomas S.; Yang, George J.; Tang, Gregory Y. (February 1979). "A fast two-dimensional median filtering algorithm" (PDF). IEEE Transactions on Acoustics, Speech, and Signal Processing. 27 (1): 13–18. doi:10.1109/TASSP.1979.1163188.
^ Arias-Castro, Ery; Donoho, David L. (June 2009). "Does median filtering truly preserve edges better than linear filtering?". Annals of Statistics. 37 (3): 1172–2009. arXiv:math/0612422. Bibcode:2006math.....12422A. doi:10.1214/08-AOS604. MR 2509071. Zbl 1160.62086.
^ Arce, Gonzalo R. (2005). Nonlinear Signal Processing: A Statistical Approach. New Jersey, USA: Wiley. ISBN 0-471-67624-1.

External links

Fast MATLAB one-dimensional median filter implementation
Mathematica MedianFilter function
Median filter
Fast two-dimensional median filter
Implementation of two-dimensional median filter in constant time (GPL license) – the running time per pixel of this algorithm is proportional to the number of elements in a histogram (typically this is $2^{n}$ , where n is the number of bits per channel), even though this in turn is a constant.
Implementation written in different programming languages (on Rosetta Code)
Dr Dobbs article
100+ Times Faster Weighted Median Filter
Circle median filter Median filter for circle-valued data such as phase or orientation images (C++/Matlab)

[1] Rezaee, Alireza (April 2021). "Partition Fuzzy Median Filter for Image Restoration". Fuzzy Information and Engineering. 13 (2): 199–210. doi:10.1080/16168658.2021.1921377. ISSN 1616-8658.

[2] Tay, David B. (July 2023). "Median Autoregressive Graph Filters". IEEE Signal Processing Letters. 30: 833–837. doi:10.1109/LSP.2023.3292741. ISSN 1070-9908.

[3] Baboshina, V.A.; Orazaev, A.R.; Lyakhov, P.A.; Boyarskaya, E.E. (August 2024). "Neural network recognition system for video transmitted through a binary symmetric channel". Computer Optics. 48 (4): 582–591. doi:10.18287/2412-6179-CO-1388.

[huang79-4] Huang, Thomas S.; Yang, George J.; Tang, Gregory Y. (February 1979). "A fast two-dimensional median filtering algorithm" (PDF). IEEE Transactions on Acoustics, Speech, and Signal Processing. 27 (1): 13–18. doi:10.1109/TASSP.1979.1163188.

[ariascastro09-5] Arias-Castro, Ery; Donoho, David L. (June 2009). "Does median filtering truly preserve edges better than linear filtering?". Annals of Statistics. 37 (3): 1172–2009. arXiv:math/0612422. Bibcode:2006math.....12422A. doi:10.1214/08-AOS604. MR 2509071. Zbl 1160.62086.

[arce05-6] Arce, Gonzalo R. (2005). Nonlinear Signal Processing: A Statistical Approach. New Jersey, USA: Wiley. ISBN 0-471-67624-1.

[1]

[2]

[3]

[4]

[5]

[6]