In a CNN is not it better to apply the activation function after the pooling layer rather than after the convolutional layer?
52786
Can we do activations before convolution and maxpooling
114914
Bad performance with ReLU activation function on MNIST data set
75450
How does rectilinear activation function solve the vanishing gradient problem in neural networks?
16209
Importance of optimizing the correct loss function
123715
Why is it important to include a bias correction term for the Adam optimizer for Deep Learning?
126706
Why do we need to normalize the images before we put them into CNN?
98111
Sigmoid vs Relu function in Convnets
41356
Reason for square images in deep learning
139822
Does the universal approximation theorem for neural networks hold for any activation function?
13412
Motivating sigmoid output units in neural networks starting with unnormalized log probabilities linear in $z=w^Th+b$ and $\phi(z)$
109044
Does it makes sense to perturb images on-the-run while training CNNs?
133566
Deep Neural Network weight initialization
14183
Why Lasso or ElasticNet perform better than Ridge when the features are correlated
95509
Why is the sum of two random variables a convolution?
62842
Most common method for deciding when to stop training a neural net on a batch
19651
What are the advantages of ReLU over sigmoid function in deep neural networks?
102350
Cost function of neural network is non-convex?