Explain lemmatization.

734    Asked by NakanoHase in Data Science , Asked on Nov 17, 2019
Answered by Nakano Hase

In contrast to stemming, lemmatization looks beyond word reduction, and considers a language’s full vocabulary to apply a morphological analysis to words.

For instance, the lemma of ‘was’ is ‘to be’ and the lemma of ‘mice’ is ‘mouse’. But for words like ‘meeting’ the lemma could be either ‘meet’ or ‘meeting’ as both are logical so in this case it will depend on its use in a sentence.

It looks at surrounding text to determine a given word’s part of speech, it does not categorize phrases.

The lemma is implemented in spacy in the following manner represented below.




Your Answer

Interviews

Parent Categories