What is: Continuous Bag-of-Words Word2Vec?
Source | Efficient Estimation of Word Representations in Vector Space |
Year | 2000 |
Data Source | CC BY-SA - https://paperswithcode.com |
Continuous Bag-of-Words Word2Vec is an architecture for creating word embeddings that uses future words as well as past words to create a word embedding. The objective function for CBOW is:
In the CBOW model, the distributed representations of context are used to predict the word in the middle of the window. This contrasts with Skip-gram Word2Vec where the distributed representation of the input word is used to predict the context.