State estimation of random dynamical systems with noisy observations has been an important problem in many areas of science and engineering. Efficient new algorithms to estimate the present and future state of a dynamic signal based upon corrupted, distorted, and possibly partial observations of the signal are required. Since the true state is usually hidden and evolves according to its own dynamics, the objective of this work is to get an optimal estimation of the true state via noisy observations. The theory of filtering provides a recursive procedure for estimating an evolving signal or state from a noisy observation process. We consider a particle filter approach for nonlinear filtering in multiscale dynamical systems. Particle filters represent the posterior conditional distribution of the state variables by a system of particles, which evolves and adapts recursively as new information becomes available. Particle filters suffer from computational inefficiency when applied to high dimensional problems. In practice, large numbers of particles may be required to provide adequate approximations in higher dimensional poblems. In several high dimensional applications, after a sequence of updates, the particle system will often collapse to a single point. With the help of rigorous dimensional reduction methods, particle filters could regain their versatility. Based on our theoretical developments (Park, J. H., Sri Namachchivaya, N., and Sowers, R. B., 2008, “A Problem in Stochastic Averaging of Nonlinear Filters,” Stochastics Dyn., 8(3), pp. 543–560; Park, J. H., Sowers, R. B., and Sri Namachchivaya, N., 2010, “Dimensional Reduction in Nonlinear Filtering,” Nonlinearity, 23(2), pp. 305–324), we devise an efficient particle filter algorithm, which is applicable to high dimensional multiscale nonlinear filtering problems. In this paper, we present the homogenized hybrid particle filtering method that combines homogenization of random dynamical systems, reduced order nonlinear filtering, and particle methods.

References

1.
E
,
W.
, and
Engquist
,
B.
, 2003, “
Multiscale Modeling and Computation
,”
Not. Am. Math. Soc.
,
50
(
9
), pp.
1062
1070
.
2.
Crisan
,
D.
,
Gaines
,
J.
, and
Lyons
,
T.
, 1998, “
Convergence of a Branching Particle Method to the Solution of the Zakai Equation
,”
SIAM J. Appl. Math.
,
58
(
5
), pp.
1568
1590
.
3.
Del Moral
,
P.
, 2004,
Feynman-Kac Formulae: Genealogical and Interacting Particle Systems With Applications
,
Springer
,
New York.
4.
Doucet
,
A.
,
de Freitas
,
N.
, and
Gordon
,
N.
, 2001,
Sequential Monte Carlo Methods in Practice
,
Springer
,
New York
.
5.
Evensen
,
G.
, 2003, “
The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation
,”
Ocean Dyn.
,
53
(
4
), pp.
343
367
.
6.
Florchinger
,
P.
, and
LeGland
,
F.
, 1991, “
Time-Discretization of the Zakai Equation for Diffusion Processes Observed in Correlated Noise
,”
Stoch. Stoch. Rep.
,
35
, pp.
233
256
.
7.
Jazwinski
,
A. H.
, 1970,
Stochastic Processes and Filtering Theory
,
Academic
,
New York.
8.
Wan
,
E. A.
, and Van
DerMerwe
,
R.
, 2000, “
The Unscented Kalman Filter for Nonlinear Estimation
,”
The IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium, ASSPCC
, pp.
153
158
.
9.
Budhiraja
,
A.
,
Chen
,
L.
, and
Lee
,
C.
, 2007, “
A Survey of Numerical Methods for Nonlinear Filtering Problems
,”
Physica D
,
230
(
1–2
), pp.
27
36
.
10.
Daum
,
F.
, and
Huang
,
J.
, 2003, “
Curse of Dimensionality and Particle Filters
,” 2003
IEEE Aerospace Conference Proceedings, IEEE
,
Vol. 4
, pp.
1979
1993
.
11.
Snyder
,
C.
,
Bengtsson
,
T.
,
Bickel
,
P.
, and
Anderson
,
J.
, 2008, “
Obstacles to High-Dimensional Particle Filtering
,”
Mon. Weather Rev.
,
136
(
12
), pp.
4629
4640
.
12.
Park
,
J. H.
, Sri
Namachchivaya
,
N.
, and
Sowers
,
R. B.
, 2008, “
A Problem in Stochastic Averaging of Nonlinear Filters
,”
Stochastics Dyn.
,
8
(
3
), pp.
543
560
.
13.
Park
,
J. H.
,
Sowers
,
R. B.
, and Sri
Namachchivaya
,
N.
, 2010, “
Dimensional Reduction in Nonlinear Filtering
,”
Nonlinearity
,
23
(
2
), pp.
305
324
.
14.
Crisan
,
D.
, 2006, “
Particle Approximations for a Class of Stochastic Partial Differential Equations
,”
Appl. Math. Optim.
,
54
(
3
), pp.
293
314
.
15.
Crisan
,
D.
, and
Lyons
,
T.
, 1997, “
Nonlinear Filtering and Measure-Valued Processes
,”
Probab. Theory Relat. Fields
,
109
(
2
), pp.
217
244
.
16.
Fearnhead
,
P.
,
Papaspiliopoulos
,
O.
, and
Roberts
,
G.
, 2008, “
Particle Filters for Partially Observed Diffusions
,”
J. R. Stat. Soc. Ser. B (Stat. Methodol.)
,
70
(
4
), pp.
755
777
.
17.
Ionides
,
E. L.
, 2003, “
Inference and Filtering for Partially Observed Diffusion Processes via Sequential Monte Carlo
,” Department of Statistics Technical, University of Michigan, Report No. 405.
18.
Sarkka
,
S.
, and
Sottinen
,
T.
, 2008, “
Application of Girsanov Theorem to Particle Filtering of Discretely Observed Continuous-Time Nonlinear Systems
,”
Bayesian Analysis
,
3
, pp.
555
584
.
19.
Doucet
,
A.
, 1998, “
On Sequential Simulation-Based Methods for Bayesian Filtering
,” Cambridge University, Technical Report No. CUED/F-INFENG/TR.310.
20.
Gordon
,
N. J.
,
Salmond
,
D. J.
, and
Smith
,
A. F. M.
, 1993, “
Novel Approach to Nonlinear/NonGaussian Bayesian State Estimation
,”
IEE Proc. F, Radar Signal Process.
,
140
(
2
), pp.
107
113
.
21.
Kitagawa
,
G.
, 1996, “
Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models
,”
J. Comput. Graph. Stat.
,
5
(
1
), pp.
1
25
.
22.
Givon
,
D.
,
Stinis
,
P.
, and
Weare
,
J.
, 2009, “
Variance Reduction for Particle Filters of Systems With Time-Scale Separation
,”
IEEE Trans. Signal Processing
,
57
(
2
), pp.
424
435
.
23.
Papavasiliou
,
A.
, 2007, “
Particle Filters for Multiscale Diffusions
,”
ESAIM Proceedings
, Vol.
19
, pp.
108
114
.
24.
Vanden-Eijnden
,
E.
, 2003, “
Numerical Techniques for Multi-Scale Dynamical Systems With Stochastic Effects
,”
Commun. Math. Sci.
,
1
(
2
), pp.
385
391
.
25.
Weinan
E.
,
Liu
,
D.
, and
Vanden-Eijnden
,
E.
, 2005, “
Analysis of Multiscale Methods for Stochastic Differential Equations
,”
Commun. Pure Appl. Math.
,
58
, pp.
1544
1585
.
26.
Kushner
,
H. J.
, 1964, “
On the Differential Equations Satisfied by Conditional Probability Densities of Markov Processes
,”
SIAM Journal on Control and Optimization
,
2
, pp.
106
119
.
27.
Freidlin
,
M. I.
, and
Wentzell
,
A. D.
, 1994,
Random Perturbations of Hamiltonian Systems
,
American Mathematical Society
,
Providence, RI
.
28.
Khasminskii
,
R. Z.
, 1968, “
On the Principles of Averaging for the Itô Stochastic Differential Equations
,”
Kybernetika
,
4
, pp.
260
279
.
29.
Kloeden
,
P. E.
, and
Platen
,
E.
, 1992,
Numerical Solution of Stochastic Differential Equations
,
Springer-Verlag
,
Berlin
.
30.
2005, Program in Geophysical Fluid Dynamics: Fast Times and Fine Scales, Woods Hole Oceanographic Institution, Woods Hole, MA.
31.
Perkowski
,
N.
,
Yeong
,
H. C.
,
Imkeller
,
P.
, and Sri
Namachchivaya
,
N.
, 2011, “
Convergence of a Branching Particle Method to the Solution of a Homogenized Nonlinear Filter With Real Observations
,” unpublished.
32.
Yeong
,
H. C.
,
Park
,
J. H.
, and
Sri Namachchivaya
,
N.
, 2011, “
Particle Filters in a Multiscale Environment: With Application to the Lorenz 96 Atmospheric Model
,” Special Issue of Stochastics and Dynamics, to be published.
You do not currently have access to this content.