Relation

Word Generalization for Hate Speech Classification

  • Words are clustered and cluster id is given to each word.

  • Cluster id along with other features are used to do text classification.

  • Brown clustering algorithm is an example, this algorithm produces hard clusters which means each word belongs to a specific cluster.

  • Neural networks introduced distributed word representations also called word embeddings which serve the purpose of word generalization

0

1

Updated 2022-08-14

Tags

Data Science