Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning-NUM: Network Utility Maximization with Unknown Utility
  Functions and Queueing Delay   Network Utility Maximization (NUM) studies the problems of allocating traffic
rates to network users in order to maximize the users' total utility subject to
network resource constraints. In this paper, we propose a new NUM framework,
Learning-NUM, where the users' utility functions are unknown apriori and the
utility function values of the traffic rates can be observed only after the
corresponding traffic is delivered to the destination, which means that the
utility feedback experiences \textit{queueing delay}.
  The goal is to design a policy that gradually learns the utility functions
and makes rate allocation and network scheduling/routing decisions so as to
maximize the total utility obtained over a finite time horizon $T$. In addition
to unknown utility functions and stochastic constraints, a central challenge of
our problem lies in the queueing delay of the observations, which may be
unbounded and depends on the decisions of the policy.
  We first show that the expected total utility obtained by the best dynamic
policy is upper bounded by the solution to a static optimization problem.
Without the presence of feedback delay, we design an algorithm based on the
ideas of gradient estimation and Max-Weight scheduling. To handle the feedback
delay, we embed the algorithm in a parallel-instance paradigm to form a policy
that achieves $\tilde{O}(T^{3/4})$-regret, i.e., the difference between the
expected utility obtained by the best dynamic policy and our policy is in
$\tilde{O}(T^{3/4})$. Finally, to demonstrate the practical applicability of
the Learning-NUM framework, we apply it to three application scenarios
including database query, job scheduling and video streaming. We further
conduct simulations on the job scheduling application to evaluate the empirical
performance of our policy.

28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
15
The categories of this paper are: nucl-ex
16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph