Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fast Adaptation of Activity Sensing Policies in Mobile Devices   With the proliferation of sensors, such as accelerometers, in mobile devices,
activity and motion tracking has become a viable technology to understand and
create an engaging user experience. This paper proposes a fast adaptation and
learning scheme of activity tracking policies when user statistics are unknown
a priori, varying with time, and inconsistent for different users. In our
stochastic optimization, user activities are required to be synchronized with a
backend under a cellular data limit to avoid overcharges from cellular
operators. The mobile device is charged intermittently using wireless or wired
charging for receiving the required energy for transmission and sensing
operations. Firstly, we propose an activity tracking policy by formulating a
stochastic optimization as a constrained Markov decision process (CMDP).
Secondly, we prove that the optimal policy of the CMDP has a threshold
structure using a Lagrangian relaxation approach and the submodularity concept.
We accordingly present a fast Q-learning algorithm by considering the policy
structure to improve the convergence speed over that of conventional
Q-learning. Finally, simulation examples are presented to support the
theoretical findings of this paper.

37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
16
The categories of this paper are: stat
24
The categories of this paper are: dg-ga
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess