Noise removal
Signals often get corrupted during transmission or processing; and a frequent goal in filter design is the restoration of the original signal, a process commonly called "noise removal". The simplest type of corruption is additive noise, when the desired signal S gets added with an unwanted signal N that has no known connection with S. If the noise N has a simple statistical description, such as Gaussian noise, then a Kalman filter will reduce N and restore S to the extent allowed by Shannon's theorem. In particular, if S and N do not overlap in the frequency domain, they can be completely separated by linear bandpass filters.
For almost any other form of noise, on the other hand, some sort of non-linear filter will be needed for maximum signal recovery. For multiplicative noise (that gets multiplied by the signal, instead of added to it), for example, it may suffice to convert the input to a logarithmic scale, apply a linear filter, and then convert the result to linear scale. In this example, the first and third steps are not linear.
Non-linear filters may also be useful when certain "nonlinear" features of the signal are more important than the overall information contents. In digital image processing, for example, one may wish to preserve the sharpness of silhouette edges of objects in photographs, or the connectivity of lines in scanned drawings. A linear noise-removal filter will usually blur those features; a non-linear filter may give more satisfactory results (even if the blurry image may be more "correct" in the information-theoretic sense).
Many nonlinear noise-removal filters operate in the time domain. They typically examine the input digital signal within a finite window surrounding each sample, and use some statistical inference model (implicitly or explicitly) to estimate the most likely value for the original signal at that point. The design of such filters is known as the filtering problem for a stochastic process in estimation theory and control theory.
Examples of nonlinear filters include:
Nonlinear filter also occupy a decisive position in the image processing functions. In a typical pipeline for real-time image processing, it is common to have many nonlinear filter included to form, shape, detect, and manipulate image information. Furthermore, each of these filter types can be parameterized to work one way under certain circumstances and another way under a different set of circumstance using adaptive filter rule generation. The goals vary from noise removal to feature abstraction. Filtering image data is a standard process used in almost all image processing systems. Nonlinear filters are the most utilized forms of filter construction. For example, if an image contains a low amount of noise but with relatively high magnitude, then a median filter may be more appropriate.
Kushner–Stratonovich filtering
The context here is the formulation of the nonlinear filtering problem seen through the lens of the theory of stochastic processes. In this context, both the random signal and the noisy partial observations are described by continuous time stochastic processes. The unobserved random signal to be estimated is modeled through a non-linear Ito stochastic differential equation and the observation function is a continuous time non-linear transformation of the unobserved signal, an observation perturbed by continuous time observation noise.
Given the nonlinear nature of the dynamics, familiar frequency domain concepts that can be applied to linear filters are not viable, and a theory based on the state space representation is formulated. The complete information on the nonlinear filter at a given time is the probability law of the unobserved signal at that time conditional on the history of observations up to that time. This law may have a density, and the infinite dimensional equation for the density of this law takes the form of a stochastic partial differential equation (SPDE).
The problem of optimal nonlinear filtering in this context was solved in the late 1950s and early 1960s by Ruslan L. Stratonovich[1][2][3][4] and Harold J. Kushner.[5]
The optimal filter SPDE is called Kushner-Stratonovich equation.
In 1969, Moshe Zakai introduced a simplified dynamics for the unnormalized conditional law of the filter known as Zakai equation.[6]
It has been proved by Mireille Chaleyat-Maurel and Dominique Michel[7] that the solution is infinite dimensional in general, and as such requires finite dimensional approximations. These may be heuristics-based such as the extended Kalman filter or the assumed density filters described by Peter S. Maybeck[8] or the projection filters introduced by Damiano Brigo, Bernard Hanzon and François Le Gland,[9] some sub-families of which are shown to coincide with the assumed density filters.[10] Particle filters[11] are another option, related to sequential Monte Carlo methods.
