Why doesn't the use of a forget gate in LSTMs cause vanishing/dying gradients?
42381
How does LSTM prevent the vanishing gradient problem?
74904
Random initialization/order in neural network — bias or variance?
122194
How many parameters are in a gated recurrent unit (GRU) recurrent neural network (RNN) layer?
93143
Why do we need autoencoders?
119698
Why are bias nodes used in neural networks?
83377
Deep learning model (LSTM) with temporal and non temporal attributes
79824
Varied Activation Functions in Neural Networks
135655
Using (leaky) ReLU as an activation function
7027
What is the purpose of a neural network activation function?
138385
Why does the first forward pass in a neural-network (NN) classification model computes to zero for all classes before final activation?
50254
Is it a valid claim, that by differencing a time series, it loses its memory, and as a result its predictive power?
38690
Why are non zero-centered activation functions a problem in backpropagation?
142609
No regularisation term for bias unit in neural network
101873
Leave one out cross validation for LSTM
98554
Deep NNs, backpropagation and error calculation
75450
How does rectilinear activation function solve the vanishing gradient problem in neural networks?
130956
Should we average weight decay loss in neural network?