After transfer learning how to use original output layer and get both models predictions?
I trained a new network using EfficientNet for object detection, instead of using the original output layer of EfficientNet i change it to 5 output dense (5 labels from the original layer). in the training procedure, i locked all the layers and only train my custom output layer i managed to achieve a better result in my custom output layer labels (in EfficientNet they achieve 84% i managed to get an average of 92% accuracy ) i would like to get the original 1000 label and also my own 5 output layer
TLDR
what I am trying to achieve is this :
let's say I have 2 neural networks: A, B they both contains N-1 identical layers and different output layer
- A (output layer) dim is 5
- B (output layer) dim is 1000
because they both identical up until the output layer they both will have the same output before the output layer
I would like to run model B then get the output of the dropout layer, run this output against model A output layer instead of running both of the models again is it possible or I am facing an XY problem ? what is the right way to create a neural network with 2 output layers?
I illustrated the problem :
I found how to do it just need to find the point of the split copy the first layer and direct its input to the other model and then concatenate all layers together
efficientnet = efn.EfficientNetB0()
retrained_model = load_model(model_path, custom_objects=get_custom_objects())
top_conv = efficientnet.get_layer('top_conv')
top_conv._name = top_conv._name + str("ef0")
top_bn = efficientnet.get_layer("top_bn")
top_bn._name = top_bn._name + str("ef0")
top_activation = efficientnet.get_layer('top_activation')
top_activation._name = top_activation._name + str("ef0")
avg_pool = efficientnet.get_layer('avg_pool')
avg_pool._name = avg_pool._name + str("ef0")
top_dropout = efficientnet.get_layer('top_dropout')
top_dropout._name = top_dropout._name + str("ef0")
probs = efficientnet.get_layer('probs')
probs(top_dropout(
avg_pool(top_activation(top_bn(top_conv(retrained_model.get_layer('block7a_project_bn').output))))))
model = Model(inputs=retrained_model.input,
outputs=[retrained_model.output, probs.get_output_at(0)])
model.summary()
model.save("/home/naor/projects/efficientnetretrainedmodel/bin/model-2-pred.h5")
the new model created as model A input and as output an [A.output ,B.output]
- Linear vs nonlinear neural network?
- Can we use GNN on graphs with only edge features?
- How do I initialize weights in PyTorch?
- Does one convolutional filter always have different coefficients for each of the channels of the previous layer?
- How to use a Dense layer with an input that has a dynamically sized dimension?
- Should we do learning rate decay for adam optimizer
- InceptionResnetV2 STEM block keras implementation mismatch the one in the original paper?
- TypeError: '_IncompatibleKeys' object is not callable
- Debugging GAN covergence
- Loss is increasing from first epoch itself
- Handling Absence of Color Data in 3D Mesh Neural Network Input
- Can a neural network be trained while it changes in size?
- unexpected transformer's dataset structure after set_transform or with_transform
- Using scikit-learn's MLPClassifier in AdaBoostClassifier
- Do I fit t-SNE the two sets of embeddings from two different models at the same time or do I fit each separately then visualize and compare?
- Autograd error caused by ReLU in Pytorch?
- Early stopping in Bert Trainer instances
- Google Colab is very slow compared to my PC
- torch.nn.functional vs torch.nn - Pytorch
- Is a neural network a lazy or eager learning method?
- Why is the accuracy for my Keras model always 0 when training?
- Does calling the model.fit method again reinitialize the already trained weights?
- Why do we divide by batch_size in the backward pass of Softmax with Cross-Entropy Loss?
- Why do BF16 models have slower inference on Mac M-series chips compared to F16 models?
- Efficient way to compare two similar images
- why do we need a y variable in keras model.fit()?
- How to create a neural network for regression?
- training neural network for user recognition in MATLAB
- Values of weights and outputs in Convolutional Neural Networks
- How should I determine the input size for layers following the initial layer in a CNN?