How to determine relationship between two entities when there is more than one relation while creating distant supervision training data?
I got the concepts of distant supervision. As for my understanding, the creating training data process is like;
- Extract named entities from sentences
- Find two entities named "e1" and "e2" from each sentence.
- Search these two entities in knowledge base (freebase etc.) to find relationship between them
I got confused at this step. What if there is more than 1 relation between these two entities (e1 and e2) ? If so which relation should I select?
Solution
It depends on the model you're training.
Are you learning a model for one kind of relationship and doing bootstrapping? Then only pay attention to that one relationship and drop the others from your DB.
Are you trying to learn a bunch of relationships? Then use the presence or absence of each as a feature in your model. This is how Universals Schemas work.
Here's an image of a feature matrix from the Universal Schema paper:
- Hugging face tokenizer cannot load files properly
- How to convert character indices to BERT token indices
- How can I share a complex spaCy NLP model across multiple Python processes to minimize memory usage?
- Finding Root Form of Verbs using Curiosity-AI/Catalyst
- Is it possible to get embeddings from NV-Embed using Candle?
- Dutch sentiment analysis RobBERTje outputs just positive/negative labels, netural label is missing
- Target modules for applying PEFT / LoRA on different models
- How to reconstruct text entities with Hugging Face's transformers pipelines without IOB tags?
- How to guess, with spaCy, the frequency of a lemma or a word form in general language use?
- Importing deepspeech error: Module not found
- llama-cpp-python not using NVIDIA GPU CUDA
- Question about data_collator throwing a key error in Hugging face
- cannot import name 'split_torch_state_dict_into_shards' from 'huggingface_hub'
- How to compute precision, recall, accuracy and f1-score for the multiclass case with scikit learn?
- ImportError: cannot import name 'deprecated' from 'typing_extensions'
- Trainer huggingface - RuntimeError: cannot pin 'torch.cuda.FloatTensor' only dense CPU tensors can be pinned
- TypeError: "hypothesis" expects pre-tokenized hypothesis (Iterable[str]):
- How to derive attributes/labels from short plain text descriptions? (NER, LLM, ?)
- Varying embedding dim due to changing padding in batch size
- Break after first PER sequence found with Spacy
- With spaCy, how can I get all lemmas from a string?
- Why do Transformers in Natural Language Processing need a stack of encoders?
- Tokenizer.from_file() HUGGINFACE : Exception: data did not match any variant of untagged enum ModelWrapper
- Apertium + Python: POS-tagger not providing surface form
- Reaching the main word from the suffix list
- Print all the tokens in the file that are labelled with the morphological tag
- How to get wordforms in sphinx?
- Increasing relevancy of search results
- How can morph dictionary be built using postgresql?
- Morphological text analysis with Python using *.dic *.aff