Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Optimal WiFi Sensing via Dynamic Programming   The problem of finding an optimal sensing schedule for a mobile device that
encounters an intermittent WiFi access opportunity is considered. At any given
time, the WiFi is in any of the two modes, ON or OFF, and the mobile's
incentive is to connect to the WiFi in the ON mode as soon as possible, while
spending as little sensing energy. We introduce a dynamic programming framework
which enables the characterization of an explicit solution for several models,
particularly when the OFF periods are exponentially distributed. While the
problem for non-exponential OFF periods is ill-posed in general, a usual
workaround in literature is to make the mobile device aware if one ON period is
completely missed. In this restricted setting, using the DP framework, the
deterministic nature of the optimal sensing policy is established, and value
iterations are shown to converge to the optimal solution. Finally, we address
the blind situation where the distributions of ON and OFF periods are unknown.
A continuous bandit based learning algorithm that has vanishing regret (loss
compared to the optimal strategy with the knowledge of distributions) is
presented, and comparisons with the optimal schemes are provided for
exponential ON and OFF times.

36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph