- Transformers by Chai pe charcha
- The discussion is around the book, Book- NLP Transformers
-
- natural language processing with transformers
- Lewis tunstall
- Friday 9.30PM night
- transformersbook
- sota models?
- do you suspect a further increase in the use of RL in sota models?
- which open-source llm model are best for performance like gpt3?
- davinci is closest one
- gptneox, opt model from meta, blue
- instruction model:
- Google uses burt to enhance query
- transformers came in 2017
- second chapter: text classification
- community.h20.ai
- classify text in emotions
- h20 hydrogen torch
- Microsoft/deberta-base backbone model
- ulmfit whitepaper
- distill pub attention matrix
- encoder decoder are blocks of transformers
- named entity recognition is good to summarise long paragraph
- pipeline from huggingface
Links