Dimensions in convolutional neural network
I am trying to understand how the dimensions in convolutional neural network behave. In the figure below the input is 28-by-28 matrix with 1 channel. Then there are 32 5-by-5 filters (with stride 2 in height and width). So I understand that the result is 14-by-14-by-32. But then in the next convolutional layer we have 64 5-by-5 filters (again with stride 2). So why the result is 7-by-7- by 64 and not 7-by-7-by 32*64? Aren't we applying each one of the 64 filters to each one of the 32 channels?
One filter is the sum of all the dimensions in the previous layer. This means that the 5x5 filter sums up over all 32 dimensions and in essence is a weighted sum of 32*5*5 values. However the weight values are shared across dimensions. Then there are 64 such filters. A better explanation with images can be found here: http://cs231n.github.io/convolutional-networks/.
- Values of weights and outputs in Convolutional Neural Networks
- How should I determine the input size for layers following the initial layer in a CNN?
- Assertion Failure in Eigen Matrix Broadcasting: Dimension Mismatch in Neural Network Forward Pass
- Reinforcement learning toy project
- Reinforcement learning And POMDP
- Reinforcement learning with neural networks
- How is the hidden layer size determined for MLPRegressor in SciKitLearn?
- what is a 'layer' in a neural network
- The analogue of torch.autograd in TensorFlow
- Need some help debugging this java
- Best way to implicitly change the value of nn.Parameter() in Pytorch?
- NotImplementedError YOLO ultralitycs
- How to train an artificial neural network to play Diablo 2 using visual input?
- Python neural network accuracy - correct implementation?
- Super low accuracy for neural network model
- Neural network: How to calculate the error for a unit
- Constant loss value in Adam optimization method
- How to deploy a tensorflow model on Android without TF Lite and without using a server
- Calculate the accuracy every epoch in PyTorch
- Open Source Neural Network Library
- What is the role of "Flatten" in Keras?
- How to compute number of weights of CNN?
- Can a neural network be trained while it changes in size?
- Is it possible to set different activation functions for different outputs at the final layer in the neural net?
- Multi dimensional inputs in pytorch Linear method?
- I implemented a MLP Neural Network in C++, but if i normally compile it doesn't work, if i use the debugger with VS Code it works
- Am I implementing my perceptron with backpropagation correctly?
- I need to write complex-value neural network in tensorflow but I get an error
- Multi Step Prediction Neural Networks
- How to know if I am not overfitting my neural network?