Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Entropy and Source Coding for Integer-Dimensional Singular Random
  Variables   Entropy and differential entropy are important quantities in information
theory. A tractable extension to singular random variables-which are neither
discrete nor continuous-has not been available so far. Here, we present such an
extension for the practically relevant class of integer-dimensional singular
random variables. The proposed entropy definition contains the entropy of
discrete random variables and the differential entropy of continuous random
variables as special cases. We show that it transforms in a natural manner
under Lipschitz functions, and that it is invariant under unitary
transformations. We define joint entropy and conditional entropy for
integer-dimensional singular random variables, and we show that the proposed
entropy conveys useful expressions of the mutual information. As first
applications of our entropy definition, we present a result on the minimal
expected codeword length of quantized integer-dimensional singular sources and
a Shannon lower bound for integer-dimensional singular sources.

21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th