nlpword-embeddingelmobert-language-model

What is the difference between Sentence Encodings and Contextualized Word Embeddings?


I have seen both terms used while reading papers about BERT and ELMo so I wonder if there is a difference between them.


Solution

  • So in short, a conextualized word embedding represents a word in a context, whereas a sentence encoding represents a whole sentence.