Difficulty understanding FLOPS in this scenario
Given FLOPS are the floating point operations per second, would that not be dependent on the power of the machine rather than the model and how many parameters it has? What am I missing here? Screenshot is from "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks". Thanks.
Solution
Some hardware manufacturers specify FLOPS as the performance metric. On the other hand, you can calculate approximate FLOPs value for your model, for regular (not depthwise) convolutional layer it would be (according to this):
where 2 is for two different types of instructions: multiplying and accumulating.
You need to keep in mind that low FLOPS value do not automatically provide high performance.
- Why do we do batch matrix-matrix product?
- Unable to update a latent vector using custom loss function in pytorch
- Deep learning for inferences in sequences
- DeepLearning Anomaly Detection for images
- Custom Encoder and Decoder Layers within Keras Model Show As Unbuilt
- How to stop training when it hits a specific validation accuracy?
- Multiclass classifier using Keras from 'Deep Learning with Python' yields very different accuracy compared to what's in the textbook
- `TypeError: Unsupported integer size (0)` when attempted to save custom Keras model
- AMD ROCm with Pytorch on Navi10 (RX 5700 / RX 5700 XT)
- tensorflow TypeError: cannot unpack non-iterable float object
- Why do we divide by batch_size in the backward pass of Softmax with Cross-Entropy Loss?
- How to interpret increase in both loss and accuracy
- Understanding Keras Long Short Term Memories (LSTMs)
- AttributeError : 'tuple' has no attribute 'to'
- Understanding How YOLO is trained
- Confused about Yolo
- How to implement contractive autoencoder in Pytorch?
- Using positional encoding in pytorch
- How to convert FlatBuffer message from binary to human readable text format with Python?
- Transfer an LSTM model from cpu to GPU
- Adding batch normalization decreases the performance
- Inference error after training an IP-Adapter plus model
- Clarifying batch size when using multiple GPU's
- Real time object detection with Yolo model not working
- The training loss of vgg16 implemented in pytorch does not decrease
- State-of-art for sensor's anomaly detection
- Importing deepspeech error: Module not found
- YOLOV8 how does it handle different image sizes
- resnet50.to() function on a non-NVIDIA GPU
- How to automatically judge whether the training process of the deep learning model is converged?