  Artificial Intelligence and Machine learning have been widely used in various
fields of mathematical computing, physical modeling, computational science,
communication science, and stochastic analysis. Approaches based on Deep
Artificial Neural Networks (DANN) are very popular in our days. Depending on
the learning task, the exact form of DANNs is determined via their multi-layer
architecture, activation functions and the so-called loss function. However,
for a majority of deep learning approaches based on DANNs, the kernel structure
of neural signal processing remains the same, where the node response is
encoded as a linear superposition of neural activity, while the non-linearity
is triggered by the activation functions. In the current paper, we suggest to
analyze the neural signal processing in DANNs from the point of view of
homogeneous chaos theory as known from polynomial chaos expansion (PCE). From
the PCE perspective, the (linear) response on each node of a DANN could be seen
as a $1^{st}$ degree multi-variate polynomial of single neurons from the
previous layer, i.e. linear weighted sum of monomials. From this point of view,
the conventional DANN structure relies implicitly (but erroneously) on a
Gaussian distribution of neural signals. Additionally, this view revels that by
design DANNs do not necessarily fulfill any orthogonality or orthonormality
condition for a majority of data-driven applications. Therefore, the prevailing
handling of neural signals in DANNs could lead to redundant representation as
any neural signal could contain some partial information from other neural
signals. To tackle that challenge, we suggest to employ the data-driven
generalization of PCE theory known as arbitrary polynomial chaos (aPC) to
construct a corresponding multi-variate orthonormal representations on each
node of a DANN to obtain Deep arbitrary polynomial chaos neural networks.
