Natural Language Processing and Neural Networks

Introduction to NLP – Word Vectors : slides handoouts

Word2Vec Implementation (with Maximum Log-Likelihood)

• pytorch tutorials
• pytorch documentation
• Natural Language Processing with PyTorch

• Christopher Manning Lectures : 1 and 2

  ---

Introduction to NLP – Word Vectors : slides handoouts

Word2Vec Implementation (with Maximum Log-Likelihood)

• pytorch tutorials
• pytorch documentation
• Natural Language Processing with PyTorch

• Christopher Manning Lectures : 1 and 2

  ---

Convolutional Networks for Text: slides handouts

Sentiment Analysis with CNNs

• Christopher Manning Lectures : course 11 and video
• https://arxiv.org/abs/1408.5882 one of the first paper describing such a system
• Webpage describing tuorial's dataset: https://deft.limsi.fr/2018/

Definition of n-gram Language Models and Neural Language Models : slides and handouts

Language Models Language Models

• Christopher Manning's lectures: slides 7 and notes

Transformers and Self-Attention: slides and handouts

Transformer-based Language Models

• Christopher Manning Lecture cours 21, Tranformers,

Pretraining Transformers and Self-supervised Learning: slides and handouts

Pretrained Transformers