All posts Catergories Cloud Tags Cloud List by Date

BART- Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

Title of paper - BART- Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

This is a brief summary of paper for me to study and organize it, BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension (Lewis et al., ACL 2020) that I read and studied. [Read More]
Tags: language model, pre-training

fairseq - A Fast, Extensible Toolkit for Sequence Modeling

Title of paper - fairseq- A Fast, Extensible Toolkit for Sequence Modeling

This is a brief summary of paper for me to study and organize it, fairseq: A Fast, Extensible Toolkit for Sequence Modeling (Ott et al., NAACL 2019) that I read and studied. They introduce the toolkit to make researches and developer to train custom models for translation, summarization, language modeling,... [Read More]
Tags: toolkit, sequence modeling