  The first part of this work considers the entropy of the sum of (possibly
dependent and non-identically distributed) Bernoulli random variables. Upper
bounds on the error that follows from an approximation of this entropy by the
entropy of a Poisson random variable with the same mean are derived via the
Chen-Stein method. The second part of this work derives new lower bounds on the
total variation (TV) distance and relative entropy between the distribution of
the sum of independent Bernoulli random variables and the Poisson distribution.
The starting point of the derivation of the new bounds in the second part of
this work is an introduction of a new lower bound on the total variation
distance, whose derivation generalizes and refines the analysis by Barbour and
Hall (1984), based on the Chen-Stein method for the Poisson approximation. A
new lower bound on the relative entropy between these two distributions is
introduced, and this lower bound is compared to a previously reported upper
bound on the relative entropy by Kontoyiannis et al. (2005). The derivation of
the new lower bound on the relative entropy follows from the new lower bound on
the total variation distance, combined with a distribution-dependent refinement
of Pinsker's inequality by Ordentlich and Weinberger (2005). Upper and lower
bounds on the Bhattacharyya parameter, Chernoff information and Hellinger
distance between the distribution of the sum of independent Bernoulli random
variables and the Poisson distribution with the same mean are derived as well
via some relations between these quantities with the total variation distance
and the relative entropy. The analysis in this work combines elements of
information theory with the Chen-Stein method for the Poisson approximation.
The resulting bounds are easy to compute, and their applicability is
exemplified.
