This post contains everything I found excellent and interesting about NLP research. Some are tutorials including slides, videos, and blogs, others are some inspiring papers.
P.S. This is not an exhausting list about NLP resources like awesome-nlp, so I try not to put anything I haven't read or articles with depulicated content here. Hope we can all survive from the information flood :)
- NLP-progress: Repository to track the progress in NLP, including the datasets and the current state-of-the-art for the most common NLP tasks.
- Natural Language Processing: State of The Art, Current Trends and Challenges (Out of Date)
- Chinese Information Processing Report (2016): a report discussing both Chinese and English language processing
- Deep Learning, NLP, and Representations by Colah: “The representation perspective of deep learning is a powerful view that seems to answer why deep neural networks are so effective”
- A review of vector semantics covering from word2vec to BERT (in Chinese)
- An Intuitive Understanding of Word Embeddings: From Count Vectors to Word2Vec by NSS
- Two awesome tutorials about word2vec by Chris McCormick: Part 1 is about Skip-gram and Part 2 is about negative sampling
- The Illustrated Transformer and The Illustrated BERT: breaks the models apart and explains their details
- Why transformer is better than CNN/RNN as feature extraction (in Chinese)
- Another post by Calvo explains the transformer architecture
- Code example - The Annotated Transformer by Harvard NLP group
- An excellent tutorial given by David Blei about LDA
- How to Run Text Summarization with TensorFlow by Pavel Surmenok
- 文本自动摘要技术 by 万小军
- QA in E-commerce Scenarios (also includes search and recommendation in E-com)
- Miracles of Human Language: An Introduction to Linguistics: a MOOC about linguistics on Coursera
- Book: Linguistic fundamentals for NLP: 100 essentials from morphology and syntax