Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Estimate exponential memory decay in Hidden Markov Model and its
  applications   Inference in hidden Markov model has been challenging in terms of scalability
due to dependencies in the observation data. In this paper, we utilize the
inherent memory decay in hidden Markov models, such that the forward and
backward probabilities can be carried out with subsequences, enabling efficient
inference over long sequences of observations. We formulate this forward
filtering process in the setting of the random dynamical system and there exist
Lyapunov exponents in the i.i.d random matrices production. And the rate of the
memory decay is known as $\lambda_2-\lambda_1$, the gap of the top two Lyapunov
exponents almost surely. An efficient and accurate algorithm is proposed to
numerically estimate the gap after the soft-max parametrization. The length of
subsequences $B$ given the controlled error $\epsilon$ is
$B=\log(\epsilon)/(\lambda_2-\lambda_1)$. We theoretically prove the validity
of the algorithm and demonstrate the effectiveness with numerical examples. The
method developed here can be applied to widely used algorithms, such as
mini-batch stochastic gradient method. Moreover, the continuity of Lyapunov
spectrum ensures the estimated $B$ could be reused for the nearby parameter
during the inference.

8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
1
The categories of this paper are: cs
25
The categories of this paper are: patt-sol
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin