This is a brief summary of paper for me to study and organize it, fairseq: A Fast, Extensible Toolkit for Sequence Modeling (Ott et al., NAACL 2019) that I read and studied. They introduce the toolkit to make researches and developer to train custom models for translation, summarization, language modeling,... [Read More]

This is a brief summary of paper for me to study and organize it, SpanBERT: Improving Pre-training by Representing and Predicting Spans (Joshi et al., TACL 2019) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, Exploring the Limits of Language Modeling (Jozefowicz et al., arXiv 2016) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, Deep Semantic Role Labeling: What Works and What’s Next (He et al., ACL 2017) that I read and studied. [Read More]

This is a brief summary of paper for me to study and organize it, MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices (Sun et al., ACL 2020) that I read and studied. [Read More]