Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Parametric Rectified Power Sigmoid Units: Learning Nonlinear Neural
  Transfer Analytical Forms   The paper proposes representation functionals in a dual paradigm where
learning jointly concerns both linear convolutional weights and parametric
forms of nonlinear activation functions. The nonlinear forms proposed for
performing the functional representation are associated with a new class of
parametric neural transfer functions called rectified power sigmoid units. This
class is constructed to integrate both advantages of sigmoid and rectified
linear unit functions, in addition with rejecting the drawbacks of these
functions. Moreover, the analytic form of this new neural class involves scale,
shift and shape parameters so as to obtain a wide range of activation shapes,
including the standard rectified linear unit as a limit case. Parameters of
this neural transfer class are considered as learnable for the sake of
discovering the complex shapes that can contribute in solving machine learning
issues. Performance achieved by the joint learning of convolutional and
rectified power sigmoid learnable parameters are shown outstanding in both
shallow and deep learning frameworks. This class opens new prospects with
respect to machine learning in the sense that learnable parameters are not only
attached to linear transformations, but also to suitable nonlinear operators.

36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys