NEAT algorithm: How to crossover disjoint and excess genes?
I am currently implementing the NEAT algorithm developed by Kenneth Stanley, taking the original paper as a reference.
In the section where the crossover method is described, one thing confuses me a little bit.
So, the above figure is illustrating the crossover method for NEAT. To decide from which parent a gene inherited, the paper says the following:
Matching genes are inherited randomly, whereas disjoint genes (those that do not match in the middle) and excess genes (those that do not match in the end) are inherited from the more fit parent.
For the matching genes (1 - 5) it's easy to understand. You just randomly inherit from either Parent1 or Parent2 (with 50% chance for both). But for the disjoint (6-8) and excess (9-10) genes you cannot inherit from the more fit parent because you only have those genes in either Parent1 or Parent2.
For example:
Parent1's fitness is higher than Parent2's. The disjoint gene 6 only exists in Parent2 (of course, because disjoint and excess genes only occur in one parent) So, you cannot decide to inherit this gene from the more fit parent. Same goes for all other disjoint and excess genes. You can only inherit those from the parent they exist in.
So my question is: Do you maybe inherit all matching genes from the more fit parent and just take over the disjoint and excess genes? Or do i missunderstand something here?
Thanks in advance.
It might help to look at the actual implementation and see how it is handled. In the original C++ code here (look at lines 2085 onwards), the disjoint and excess genes from the unfit parent seem to be just skipped.
In your implementation, you could inherit disjoint and excess genes from the unfit parent but disable them with probability 1 so you can do pointwise mutations on them (toggle disabled to enabled) later on. However, this might result in significant genome bloat, so test and see what works.
- Division by neural network; fixed value produced each time
- How to choose the number of hidden layers and nodes?
- NotImplementedError YOLO ultralitycs
- Learning stops when you multiply the weights of a layer with a scalar?
- MSELoss when mask is used
- Why is the accuracy for my Keras model always 0 when training?
- The concept of straight through estimator (STE)
- How to convert the output of an artificial neural network into probabilities?
- Single-headed transformer model, output and target tensor sizes don't match
- How to add the bounding box values to the labels text files during prediction with a trained YOLO-V8 instance segmentation model?
- Inconsistency in input shape to neural network
- Wrong shape at fully connected layer: mat1 and mat2 shapes cannot be multiplied
- How to calculate optimal batch size?
- How to handle categorical features in neural network?
- Shapes (4,1) and (2,1) not aligned: 1 (dim 1) != 2 (dim 0)
- Are neural networks really abandonware?
- Does static quantization enable the model to feed a layer with the output of the previous one, without converting to fp (and back to int)?
- How to get an output dimension for each layer of the Neural Network in Pytorch?
- Merge weights of same model trained on 2 different computers using tensorflow
- pytorch BCEWithLogitsLoss calculating pos_weight
- Should the random noise given to a GAN kept constant?
- Why Do Two Different Ways of Adding a Drop Out Layer in Tensor Flow Function Differently?
- Fast sigmoid algorithm
- Why does my pruned model have a larger file size than my initial model?
- How a neural network is mapped to a GPU?
- Dimensions in convolutional neural network
- Uninitialized nested pointers after initializing them (Not deterministic) [C++]
- When to use / not use bias term in convolutional neural networks
- Computing the Jacobian matrix in TensorFlow
- Recurrent neural network trained with torch.autograd predicts nonsense