machine-learningnlpnamed-entity-recognitionwandb

How to get a graph with the best performing runs via Sweeps (Weights & Biases)?


For my NER model I use Weights & Biases sweeps for hyperparameter search. I do a grid search with about 100 runs and there are some really meaningful graphs. However, I can't figure out how to create a graph that shows about the best 10 runs in terms of f-score. Does anyone know how to do this?


Solution

  • In the sweep view, you can filter runs by certain criteria by clicking this button: enter image description here

    There, you can add a filter to only show runs with an f1 score, or an accuracy or whatever metric you have logged higher than a certain value: enter image description here

    Of course, this won't filter for the 10 best runs, but for all runs with an accuracy of 0.9 and higher (example in picture).