This is a brief summary of paper for me to study and organize it, MASS: Sequence to Sequence Pre-training for Language Generation (Song et al., arXiv 2019) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, RoBERTa: A Robustly Optimized BERT Pretraining Approach (Liu et al., arXiv 2019) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension (Lewis et al., ACL 2020) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, fairseq: A Fast, Extensible Toolkit for Sequence Modeling (Ott et al., NAACL 2019) that I read and studied. They introduce the toolkit to make researches and developer to train custom models for translation, summarization, language modeling,... [Read More]

This is a brief summary of paper for me to study and organize it, SpanBERT: Improving Pre-training by Representing and Predicting Spans (Joshi et al., TACL 2019) that I read and studied. [Read More]