NEAT algorithm: How to crossover disjoint and excess genes?
I am currently implementing the NEAT algorithm developed by Kenneth Stanley, taking the original paper as a reference.
In the section where the crossover method is described, one thing confuses me a little bit.
So, the above figure is illustrating the crossover method for NEAT. To decide from which parent a gene inherited, the paper says the following:
Matching genes are inherited randomly, whereas disjoint genes (those that do not match in the middle) and excess genes (those that do not match in the end) are inherited from the more fit parent.
For the matching genes (1 - 5) it's easy to understand. You just randomly inherit from either Parent1 or Parent2 (with 50% chance for both). But for the disjoint (6-8) and excess (9-10) genes you cannot inherit from the more fit parent because you only have those genes in either Parent1 or Parent2.
For example:
Parent1's fitness is higher than Parent2's. The disjoint gene 6 only exists in Parent2 (of course, because disjoint and excess genes only occur in one parent) So, you cannot decide to inherit this gene from the more fit parent. Same goes for all other disjoint and excess genes. You can only inherit those from the parent they exist in.
So my question is: Do you maybe inherit all matching genes from the more fit parent and just take over the disjoint and excess genes? Or do i missunderstand something here?
Thanks in advance.
It might help to look at the actual implementation and see how it is handled. In the original C++ code here (look at lines 2085 onwards), the disjoint and excess genes from the unfit parent seem to be just skipped.
In your implementation, you could inherit disjoint and excess genes from the unfit parent but disable them with probability 1 so you can do pointwise mutations on them (toggle disabled to enabled) later on. However, this might result in significant genome bloat, so test and see what works.
- Can we use GNN on graphs with only edge features?
- How do I initialize weights in PyTorch?
- Does one convolutional filter always have different coefficients for each of the channels of the previous layer?
- How to use a Dense layer with an input that has a dynamically sized dimension?
- Should we do learning rate decay for adam optimizer
- InceptionResnetV2 STEM block keras implementation mismatch the one in the original paper?
- TypeError: '_IncompatibleKeys' object is not callable
- Debugging GAN covergence
- Loss is increasing from first epoch itself
- Handling Absence of Color Data in 3D Mesh Neural Network Input
- Can a neural network be trained while it changes in size?
- unexpected transformer's dataset structure after set_transform or with_transform
- Using scikit-learn's MLPClassifier in AdaBoostClassifier
- Do I fit t-SNE the two sets of embeddings from two different models at the same time or do I fit each separately then visualize and compare?
- Autograd error caused by ReLU in Pytorch?
- Early stopping in Bert Trainer instances
- Google Colab is very slow compared to my PC
- torch.nn.functional vs torch.nn - Pytorch
- Is a neural network a lazy or eager learning method?
- Why is the accuracy for my Keras model always 0 when training?
- Does calling the model.fit method again reinitialize the already trained weights?
- Why do we divide by batch_size in the backward pass of Softmax with Cross-Entropy Loss?
- Why do BF16 models have slower inference on Mac M-series chips compared to F16 models?
- Efficient way to compare two similar images
- why do we need a y variable in keras model.fit()?
- How to create a neural network for regression?
- training neural network for user recognition in MATLAB
- Values of weights and outputs in Convolutional Neural Networks
- How should I determine the input size for layers following the initial layer in a CNN?
- Assertion Failure in Eigen Matrix Broadcasting: Dimension Mismatch in Neural Network Forward Pass